本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新466篇论文，其中：

自然语言处理47篇
信息检索8篇
计算机视觉68篇

自然语言处理

1. 【2607.22529】Skill Self-Play: Pushing the Frontier of LLM Capability with Co-Evolving Skills

作者：Siyuan Huang,Pengyu Cheng,Haotian Liu,Tao Chen,Yihao Liu,Jingwei Ni,Shijie Zhou,Ziyi Yang,Gangwei Jiang,Mengyu Zhou,Yu Cheng,Xiaoxi Jiang,Guanjun Jiang

类目：Computation and Language (cs.CL)

关键词：LLM training, interaction-driven self-evolution, shifting from manual, manual design, design and annotation

备注：

点击查看摘要

Abstract:LLM training is shifting from manual design and annotation to interaction-driven self-evolution. However, existing self-evolutionary methods face a fundamental dilemma between task diversity and verification reliability: environment-bound methods obtain precise feedback but confine learning to narrow domains, while open-ended self-generation broadens the task space but lacks reliable verification, allowing misleading rewards to pollute the training loop. We identify agent skills as a powerful middle ground to reconcile this tension: each skill ensures deep, verifiable execution in a specific scenario, while dynamic routing across skills maintains open-ended task variety. Leveraging this insight, we introduce Skill Self-Play (Skill-SP), a co-evolutionary framework comprising a proposer, a solver, and a dynamic skill controller. Orchestrated via a reinforcement learning loop, these components co-evolve in a continuous self-play loop: the proposer generates challenging tasks conditioned on dynamically sampled skills; the solver explores candidate solutions to push its capability boundaries; and the skill controller collects execution feedback to update and expand the skill library. This interactive co-evolution effectively bridges the gap between structured verification and open-ended exploration. Empirical evaluations on tool-use and reasoning benchmarks demonstrate that Skill-SP, serving as a robust evolution engine, consistently pushes the performance ceiling of competent backbones while catalyzing striking turnarounds for initially misaligned models. Our code is available at this https URL.

2. 【2607.22513】Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-Science

链接：https://arxiv.org/abs/2607.22513

作者：Davide Scarso,Hugo Noronha de Almeida,Joaquim Pina

类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Commercial large language, contested scientific claims, large language models, Frank Salter biosocial, knowledge references

备注： 16 pages, 2 tables

点击查看摘要

Abstract:Commercial large language models are increasingly used as knowledge references, yet their stance on contested scientific claims is neither stable nor transparent. We tested how four major LLM families (Claude, Grok, GPT, Gemini) evaluate ethnonationalist pseudo-science derived from Frank Salter's biosocial framework across four temporal snapshots (October 2025-February 2026), via both API and web interfaces. Grok's Fast versions (which power the default user experience on X) consistently assigned credibility scores of 70-75, two to five times higher than all other models (which scored 15-40). This pattern was absent from control prompts testing basic evolutionary consensus and refuted Lamarckian claims, where all models performed comparably. Three additional findings emerged: (1) a silent patch reversed Grok's behaviour from chaotic to stably high validation overnight, without any public documentation; (2) the same Grok model identifier produced radically divergent outputs via API (75) and web (5.5) three months later; (3) refusal to rate the pseudo-scientific claim, the most defensible response observed, appeared in two model families through different interfaces (Claude Opus 4.1 categorically via web, GPT-5.1 Chat intermittently via API) and eroded in the successor version of each. These results indicate that the epistemic stance of a commercial LLM is not a stable property of the model but a contingent effect of deployment configuration: system prompts, safety layers, interface routing, and silent updates. This remains opaque to users and researchers alike. We argue this constitutes a matter of public concern requiring new forms of epistemic accountability.

3. 【2607.22456】grapheme-kit: Grapheme-Level Metrics and Text Processing for Multilingual NLP

链接：https://arxiv.org/abs/2607.22456

作者：Izzath Nisfer,Ashini Kavindya,Ovindu Atukorala,Purushoth Velayuthan,Menan Velayuthan

类目：Computation and Language (cs.CL)

关键词：

备注：

点击查看摘要

None

4. 【2607.22376】A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books

链接：https://arxiv.org/abs/2607.22376

作者：Varun Ghat Ravikumar,Sina Ahmadi,Lena Jäger,Rico Sennrich

类目：Computation and Language (cs.CL)

关键词：descriptive grammar books, endangered languages lack, parallel data required, existence of descriptive, grammar books

备注： Accepted at CLiC-it 2026

点击查看摘要

Abstract:Most endangered languages lack the parallel data required for machine translation, despite the existence of descriptive grammar books. We introduce a pipeline that uses large language models to extract grammatical rules, example sentences, and lexicons from grammar books and generate synthetic parallel corpora for fine-tuning-rather than feeding grammar content into prompts at inference time, as in prior work. Validated on three typologically diverse low-resource languages-Kalamang (Papuan), Tuatschin (Romance), and Mandan (Siouan)-we show that fine-tuning on synthetic data improves over seed-data baselines in 75% of configurations for Kalamang and 59% for Tuatschin, with best-case ChrF++ gains of +8.8, +5.3, and +3.3 respectively. Through a systematic factorial study across 96 configurations varying target part-of-speech, retrieval granularity, and sample volume, we identify which factor combinations drive gains and where they break down. Our results demonstrate that static linguistic documentation can be repurposed for machine translation fine-tuning, offering a practical path towards translation tools for severely under-resourced languages.

5. 【2607.22334】Cross-Tokenizer On-Policy Distillation via Byte-Prefix Marginalization

链接：https://arxiv.org/abs/2607.22334

作者：Hao Wang,Kun Yuan,Wenlin Zhong,Minglei Zhang,Han Xiao,Ming Sun,Honggang Qi

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Open-weight language models, exhibit complementary capabilities, families exhibit complementary, Open-weight language, complementary capabilities

备注： Project page: [this https URL](https://bpm-opd.github.io/)

点击查看摘要

Abstract:Open-weight language models from different families exhibit complementary capabilities, motivating their consolidation into a compact student through on-policy distillation (OPD). However, full-vocabulary OPD typically assumes a shared tokenizer, while existing cross-tokenizer methods may discard teacher probability mass or assign it to student tokens with unrelated content. We introduce Byte-Prefix Marginalization (BPM), which re-expresses the teacher's next-token distribution over the student vocabulary in a shared byte space. Specifically, BPM assigns each teacher token's probability to the longest student token whose byte representation is a prefix of the teacher token's bytes, aggregates mass mapped to the same student token, and places otherwise unmatched mass in an explicit residual category. This produces a vocabulary-complete, byte-aligned, and mass-preserving target for dense OPD. The target exactly recovers the teacher-induced byte-prefix marginal when the relevant prefix does not span multiple teacher tokens (a condition satisfied at more than 99% of training positions) and uses a mass-preserving, chain-factorized lower bound otherwise. Across Qwen3-32B, GLM-Z1-9B-0414, and MiniMax-M2.7 as teachers, BPM consistently outperforms current cross-tokenizer methods on six mathematics and programming benchmarks, improving six-benchmark avg@8 by 3.7-6.6 points over the strongest baselines.

6. 【2607.22300】Biomedical Machine Translation for Low-Resource Arabic-Script Languages via Cross-Lingual Transfer and LoRA Adapter Merging

链接：https://arxiv.org/abs/2607.22300

作者：Abdullah Alabdullah,Arash Eslamighayour,Sarp Harbalioglu,Lifeng Han

类目：Computation and Language (cs.CL)

关键词：biomedical NMT resources, NMT resources, resources for Arabic-script, Arabic-script languages, Sorani Kurdish

备注：

点击查看摘要

Abstract:We present a systematic study of healthcare-domain cross-lingual transfer to address the scarcity of biomedical NMT resources for Arabic-script languages. We use Arabic and Persian as higher-resource pivots to improve translation for \textbf{four severely low-resource} targets: Dari (Afghan Persian, a standardised variety of Persian), Pashto, Sorani Kurdish (Central Kurdish, a major standardized variety of Kurdish), and Urdu (closely related to Hindi). Using LoRA fine-tuning on small decoder-only LLMs, we train \textit{domain-specific pivot adapters} and evaluate \textbf{three transfer strategies}: few-shot in-context learning, minimal supervised adaptation, and, to the best of our knowledge, for the first time in this setting, zero-data LoRA adapter merging. Supervised adaptation with just 500 sentences achieves near pivot-language quality for Dari (CHrF++ 41.01) and meaningful gains for Urdu (28.88), while adapter merging reaches within 3.5 CHrF++ of supervised adaptation for Dari at zero additional cost. Pashto and Sorani Kurdish remain insufficient for high-stakes clinical deployment exposing the limits of cross-lingual transfer when structural distance from the pivots is too great. LoRA adapter merging works surprisingly well for closely related languages, even without target-language biomedical data.

7. 【2607.22218】Why Large Language Models and Humans Converge and Diverge in Evaluating Creativity

链接：https://arxiv.org/abs/2607.22218

作者：Pengzhao Lyu,Yeun Joon Kim,Hanlin Xiao,Yingyue Luna Luan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：large language models, raising the question, standards, LLMs, large language

备注：

点击查看摘要

Abstract:Despite the growing use of large language models (LLMs) as creativity evaluators, evidence of their alignment with human evaluations remains mixed, raising the question of when and why their judgments converge with or diverge from human judgments. Across three studies and six widely used LLMs, we addressed this gap by identifying the standards underlying LLM creativity evaluation and examining their downstream implications. Study 1 showed that LLMs generally relied on a narrower subset of human creativity evaluation standards. Convergence with human standards was strongest in the novelty dimension, whereas divergence was clearest in the contextual dimension, which captures social, market, and reputational information. Moreover, each LLM exhibited distinct, model-specific standards that varied substantially in breadth. These differences in evaluation standards were reflected in actual creativity judgments. Study 2 (N = 1,103 ideas) showed that LLM evaluations were moderately correlated with human evaluations, and individual LLMs with broader standards better distinguished ideas humans judged as more versus less creative. Study 3 (N = 1,195) showed that LLMs were less sensitive to contextual information: such information significantly altered human creativity ratings but left LLM ratings largely unchanged. Together, our findings help explain the mixed evidence on LLM-human alignment, showing that alignment depends on the evidence a judgment demands and the standards each model applies. LLMs may resemble humans when evaluations emphasize intrinsic qualities such as novelty, yet diverge when judgments require contextual information. Selecting an LLM evaluator is therefore a consequential decision: different models, applying different standards, recognize different ideas as creative.

8. 【2607.22182】From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models

链接：https://arxiv.org/abs/2607.22182

作者：Shixin Fang,Jiachen Wo,Wenjuan Qin,Sihang Jiang,Yanghua Xiao(Fudan University)

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：evidence remains organized, spans diverse tasks, Large language model, evaluation spans diverse, capabilities tasks recruit

备注： 34 pages, 5 figures, 20 tables

点击查看摘要

Abstract:Large language model (LLM) evaluation spans diverse tasks and benchmarks, yet evidence remains organized around tasks rather than the capabilities they probe. This fragmentation limits cross-study comparison, obscures capabilities tasks recruit, and makes coverage gaps difficult to identify. We introduce a multi-layer taxonomy of 14 capability domains and 91 subskills across Primitive, Constructed, and Integrative layers. Human cognitive science guides capability definition and organization, not LLM architecture. Layer assignments draw on developmental precedence and hypothesized functional support, while human-origin constructs are adapted to observable model behavior. To demonstrate operational utility, we screened 31,505 papers from ACL, AAAI, ICML, and NeurIPS between 2023 and 2025 and mapped 15,934 LLM-focused papers through multi-model annotation, consensus, and arbitration. Direct research attention concentrated on Language-Semantic Competence (3,551; 22.3%), Reasoning (3,388; 21.3%), Planning and Decision-Making (2,149; 13.5%), and Perception (1,954; 12.3%), whereas six domains appeared in fewer than 2% of papers. Within domains, the most frequent subskill had a median prevalence of 97.9% and appeared in at least 90% of papers in 10 of 14 domains. Language-Semantic Competence and Reasoning formed the highest-volume pair (n = 1,864; 11.7%; lift = 2.47), whereas Theory of Mind and Social Reasoning and Interaction showed the highest lift among pairs with at least 20 co-occurrences (n = 62; lift = 30.84). By shifting the unit of analysis from isolated tasks to structured capabilities, the taxonomy supports research organization, coverage audits, evaluation interpretation, and testable hypotheses for diagnosis, training, and transfer.

Comments:
34 pages, 5 figures, 20 tables

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

ACMclasses:
I.2.7; I.2.6

Cite as:
arXiv:2607.22182 [cs.CL]

(or
arXiv:2607.22182v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.22182

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Jiachen Wo [view email] [v1]
Fri, 24 Jul 2026 10:49:50 UTC (1,374 KB)

9. 【2607.22165】DBA-Bench: A Production-Fidelity Benchmark for LLM-Based Database Operations Agents

链接：https://arxiv.org/abs/2607.22165

作者：Junming Chen,Junyang Jiang,Xu Chen,Zibo Liang,Kai Zheng

类目：Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：metrics hinder comparison, agents show promise, differing task scopes, LLM-based database agents, database agents show

备注： 14 pages, 6 figures, 2 tables

点击查看摘要

Abstract:LLM-based database agents show promise, but differing task scopes, testbeds, and metrics hinder comparison. We identify four gaps between evaluation and production operations: live-environment fidelity (multi-turn read-write interaction with a running database); observation-space scale and complexity (causal diagnosis across thousands of time series, business logs, and concurrent activity); solution-space openness (multiple remediations with different operational trade-offs); and scenario complexity and coverage (faults cascading across internal mechanisms and operational domains). We present DBA-Bench, a benchmark addressing these gaps through production fidelity, outcome-first evaluation, and controlled scenario reproducibility. It uses instrumented PostgreSQL environments with active workloads, persistent state, and multi-source observations; defines success by measurable recovery or fault elimination under safety constraints; and restores snapshots with scenario-specific checks before each run. The benchmark contains 106 scenarios across seven task domains, with two public difficulty labels based on reference-path diagnostic depth and environmental complexity. We evaluate nine baseline groups, including six foundation-model systems, two GPT-5.5-backed database agents, and a Human DBA reference. Across 848 automated runs, Diagnosis, Outcome, and Safe Pass rates are 32.7%, 19.6%, and 12.4%; the best automated baseline reaches 17.9% Safe Pass versus 93.4% for the Human DBA reference. Automated Safe Pass falls from 19.6% on Easy scenarios to 7.6% on Hard scenarios, underscoring the difficulty of safe end-to-end remediation.

10. 【2607.22136】Dynamic Commonsense Coordination for Empathetic Response Generation

链接：https://arxiv.org/abs/2607.22136

作者：Zhengyu Qi

类目：Computation and Language (cs.CL)

关键词：Empathetic Response Generation, recognize users' emotions, generate empathetic responses, requires models, Empathetic Response

备注：

点击查看摘要

Abstract:Empathetic Response Generation (ERG) requires models to recognize users' emotions and generate empathetic responses. Commonsense knowledge has been shown to support such reasoning, yet existing approaches typically reuse fixed commonsense representations across understanding and generation, limiting their ability to coordinate such knowledge across different stages. We propose DCC, a Dynamic Commonsense Coordination Framework with three complementary modules: residual-based commonsense interaction (SCE-AttnRes) to integrate contextual and situational commonsense representations, Association-Guided Commonsense Filtering (AGCF) to down-weight low-relevance commonsense relations, and Iterative Commonsense-Aware Decoding (ICAD) to dynamically retrieve commonsense memories during generation. Experiments on the Empathetic-Dialogues benchmark show that DCC improves emotion classification accuracy and response diversity over the CEM baseline while maintaining comparable perplexity. An LLM-based blind evaluation further demonstrates that DCC generates responses with better relevance, coherence, and informativeness. The code and implementation details will be publicly available at this https URL.

11. 【2607.22100】MEUSLI: a Multilingual Projector for LLM-based ASR and Beyond

链接：https://arxiv.org/abs/2607.22100

作者：Lorenzo Concina,Seraphina Fong,Marco Matassoni,Alessio Brutti

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)

关键词：mapping acoustic features, spoken question answering, large language models, Lightweight projectors, connect pre-trained speech

备注：

点击查看摘要

Abstract:Lightweight projectors are an established way to connect pre-trained speech encoders with large language models (LLMs), mapping acoustic features into token-level embeddings for tasks like ASR and spoken question answering. Existing systems, however, typically only support a few languages and are often limited to English. We introduce MEUSLI, the first open-science multilingual projector family that links a Whisper encoder with open-source multilingual LLMs, enabling fully open-source end-to-end ASR in 28 European languages. MEUSLI extends prior monolingual pipelines, delivering strong results across high- and low-resource languages. Using proper continual leaning techniques, MEUSLI can be easily extended to other languages not seen in training. We further demonstrate that the MEUSLI projector can be leveraged beyond ASR, enabling multilingual speech translation and topic identification with only a few hours of task specific supervision per language. Overall, MEUSLI provides a solid foundation for multilingual speech understanding tasks, supporting scalable and inclu- sive open-source SpeechLLM

12. 【2607.22083】Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Mode

链接：https://arxiv.org/abs/2607.22083

作者：Nanbeige Lab:Chen Yang,Chengrui Huang,Fufeng Lan,Hanhui Chen,Hao Zhou,Huatong Song,Jiaqi Cao,Jiaying Zhu,Jinlin Niu,Kai Wang,Lisheng Huang,Qiliang Liang,Ran Le,Ruixiang Feng,Shuang Sun,Tao Gu,Tao Zhang,Tianyu Luo,Yang Song,Yun Xing,Yuntao Wen,Ziyao Xu,Zongchao Chen,Zongqiang Li

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：compact general agentic, general agentic model, non-embedding parameters, general agentic, compact general

备注：

点击查看摘要

Abstract:We present Nanbeige4.2-3B, a compact general agentic model with 3B non-embedding parameters. It delivers strong performance across code-agent, office-agent, and complex tool-use tasks while maintaining highly competitive reasoning capabilities in mathematics, coding, and science. Nanbeige4.2-3B is pretrained from scratch on 28T tokens with a Looped Transformer that reuses the layer stack to increase capacity without adding parameters. For SFT data and trajectory construction, we expand the diversity of executable environments, task assets, and agentic scaffolds through real-world deployment and large-scale synthesis. Our RL pipeline applies mixed-mode RLHF over Think and Non-Think responses to improve overall model quality and reduce failure cases, length-controlled reasoning RL to balance accuracy and reasoning efficiency, and agentic RL with outcome and process rewards to stabilize long-horizon training. Extensive evaluations show that Nanbeige4.2-3B outperforms larger models, including Qwen3.5-9B and Gemma4-12B, across diverse agentic benchmarks while remaining competitive on reasoning and alignment tasks. Performance with OpenClaw further supports its use as a compact local personal assistant.

13. 【2607.22075】FSE: Continual Learning for Named Entity Recognition by Fast-Slow Experts

链接：https://arxiv.org/abs/2607.22075

作者：Yunan Zhang,Yang Fan,Heng Li,Xiangping Wu,Qingcai Chen

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Named Entity Recognition, Entity Recognition, Named Entity, forgetting previously acquired, entity types

备注： Preprint submitted to Pattern Recognition Letters

点击查看摘要

Abstract:Continual Learning for Named Entity Recognition (CLNER) enable models to incrementally learn new entity types without forgetting previously acquired ones. However, existing methods suffer from catastrophic forgetting and insufficient exploitation of shared information across tasks. This paper proposes FSE, a Fast-Slow Experts enhanced span-based NER model for CLNER. The shared fast expert learns token-level links to efficiently filter out unlikely spans, while the task-specific slow expert performs span classification only on the remaining candidates. It stabilizes learning by promoting knowledge sharing across tasks and maintains plasticity by reducing learning burden at each task. A length-decay negative sampling strategy to mitigate span imbalance is also introduced. Extensive experiments on OntoNotes and FewNERD synthestic datasets demonstrate that FSE achieves state-of-the-art performance in CLNER scenarios, with effectiveness of each component, empirical evidence of faster convergence and expected functionality of both experts.

14. 【2607.22067】Benchmarking Fine-tuning and Retrieval Strategies for a Multimodal Language Model on the NRC Reactor Operator Licensing Examination

链接：https://arxiv.org/abs/2607.22067

作者：Isak Hwang,Yoon Pyo Lee

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：nuclear power industry, power industry requires, industry requires outputs, requires outputs grounded, Nuclear Regulatory Commission

备注：

点击查看摘要

Abstract:The integration of large language models (LLMs) into the nuclear power industry requires outputs grounded in domain-specific knowledge. This study evaluates a 31-billion-parameter open-weight multimodal model (Gemma 4 31B-IT) on its capacity to apply nuclear knowledge by benchmarking eight model-retrieval configurations against the U.S. Nuclear Regulatory Commission (NRC) Reactor Operator licensing examination. We evaluate 14 Generic Fundamentals Examinations (GFE) from the 2015-2021 March sittings (seven pressurized and seven boiling water reactor exams) using the standard 80% human passing criterion. The base model is compared against configurations utilizing supervised fine-tuning (SFT) on Gemini-distilled chain-of-thought (CoT) rationales, retrieval-augmented generation (RAG) with BM25 sparse retrieval over the U.S. Department of Energy Fundamentals Handbook, and retrieval-augmented fine-tuning (RAFT). Within the retrieval pipeline, we compare fixed-size sliding-window chunking against structure-aware chunking. The SFT configuration with fixed-size chunking RAG met the criterion on 8 of the 14 examinations, outperforming all alternatives, whereas no configuration without fine-tuning passed any. Aggregate accuracy reached 79.7%, with a confidence interval spanning the threshold, and 80.2% on PWR items specifically. Furthermore, two regularities emerged: the preferred chunking strategy reverses depending on the model's training state, and RAFT underperforms compared to standard SFT in matching search environments. These results demonstrate which combination of fine-tuning and search approaches achieves operator-level capabilities.

15. 【2607.22043】Scaling Native Multimodal Pre-Training From Scratch

链接：https://arxiv.org/abs/2607.22043

作者：Haoyuan Wu,Aoqi Wu,Hai Wang,Jiajia Wu,Jinxiang Ou,Bei Yu

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：text-only pre-training restricts, multimodal physical world, remarkable reasoning capabilities, exhibit remarkable reasoning, exhibit remarkable

备注：

点击查看摘要

Abstract:Although large language models (LLMs) exhibit remarkable reasoning capabilities, their reliance on text-only pre-training restricts the perception of the multimodal physical world. Native multimodal pre-training avoids this limitation by training models from scratch on multimodal inputs, thereby achieving deep cross-modal integration and mitigating optimization asymmetries inherent to traditional late-fusion architectures. Despite these advantages, the scaling properties of this paradigm remain systematically uncharacterized. To address this gap, we investigate the optimal model size and token count for training a transformer-based vision-language model under a fixed computational budget. We demonstrate that minimal objective loss adheres to a predictable compute law, whereas compute-optimal model sizes and token counts scale as power laws. Notably, language and multimodal objectives manifest distinct scaling behaviors. The language allocation law is largely invariant to the composition of the data, indicating stable language learning regardless of the multimodal data ratio. Conversely, the multimodal allocation law is highly sensitive to this composition. Specifically, text-heavy mixtures become compute-efficient only at larger model scales, shifting the optimal resource allocation toward greater model capacity. Additionally, by modeling the influence of data composition on compute laws and allocation exponents, we derive an efficiency frontier specifying precise configurations of model size, token count, and data mixture. Downstream evaluations further reveal that native multimodal pre-training induces positive cross-modal transfer, thereby enhancing pure-text spatial reasoning and enabling robust multimodal in-context learning. In summary, this empirical research establishes the essential groundwork for predictably scaling multimodal foundation models.

16. 【2607.22041】Developing and Validating the Spanish Version of the Large Language Models Dependency Scale (LLM-D12-SP)

链接：https://arxiv.org/abs/2607.22041

作者：Tran Gia Bao,Mo El-Haj,Sameha Al-Shakhsi,Antonio Garcia-Cabot,Raian Ali,Ala Yankouskaya

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：large language models, Large Language Model, Language Model Dependency, large language, culturally validated instruments

备注： 32 pages

点击查看摘要

Abstract:There is a growing need for reliable and culturally validated instruments to assess psychological dependency on large language models (LLMs), particularly as LLMs are increasingly used for task execution, decision-making, and communication in organizational and work-related settings. This need is especially relevant for Spanish-speaking populations, where LLM adoption is rapidly expanding, yet validated psychometric tools remain scarce. The present study reports the first validation of the Spanish version of the Large Language Model Dependency Scale (LLM-D12-SP), extending prior validations conducted in English- and Arabic-speaking samples. The LLM-D12 is a two-dimensional instrument assessing Instrumental Dependency (reliance on LLMs for performing tasks and supporting decisions) and Relationship Dependency (psychological reliance on LLMs for companionship and social interaction). A total of 386 Spanish-speaking participants (M = 28.0 years, SD = 6.1; 55% male) completed the LLM-D12-SP. Confirmatory factor analysis supported the original two-factor structure. The scale demonstrated good internal consistency (Cronbach's alpha = 0.89 total; 0.86 Instrumental; 0.85 Relationship). Discriminant validity analyses indicated that the two subscales represent related but distinct constructs. External validation showed that both dependency dimensions were positively associated with internet addiction and perceived trustworthiness of LLMs, while showing weak or no association with need for cognition. Together with prior English and Arabic validations, these findings establish cross-linguistic support for the scale's structure and provide a psychometrically sound tool for investigating psychological aspects of LLM use in organizational contexts.

17. 【2607.22039】Enough is as good as a feast: A Comprehensive Analysis of How Reinforcement Learning Mitigates Task Conflicts in LLMs

链接：https://arxiv.org/abs/2607.22039

作者：Zixuan Ren,Jinliang Lu,Junhong Wu,Yang Zhao,Dai Dai,Hua Wu,Haifeng Wang,Chengqing Zong

类目：Computation and Language (cs.CL)

关键词：consolidating multiple specialized, multiple specialized models, large language models, Model merging plays, plays a crucial

备注： Published in ICLR 2026

点击查看摘要

Abstract:Model merging plays a crucial role in consolidating multiple specialized models into a single, unified model, especially in the era of large language models (LLMs). Recent research has primarily focused on developing strategies to enhance merging performance with the trained models, while the impact of training paradigms, such as supervised fine-tuning (SFT) and reinforcement learning (RL), on the effectiveness of model merging remains underexplored. In this study, we systematically explore the merging behavior of RL-trained LLMs compared to those trained with traditional SFT. Through comprehensive evaluations across five representative tasks, we find that RL significantly reduces task conflicts and results in less performance degradation after merging, making RL-trained models particularly well-suited for this process. To unearth the reasons behind the superior suitability of RL for model merging, we conduct extensive empirical experiments and theoretical analyses. Our findings highlight three key factors: (1) On-policy training data in RL control the gradient updates in a smaller magnitude, reducing the risk of overwriting existing knowledge for other tasks in the model. (2) The RL optimization objective, which favors ``\textit{enough is as good as a feast}", progressively reduces the magnitude and the number of conflict parameter updates as the model converges. (3) Joint optimization of positive and negative examples in RL steers the model towards an unbiased task-specific parameter subspace, ensuring robust performance while further preventing parameter conflicts.

18. 【2607.22034】Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation

链接：https://arxiv.org/abs/2607.22034

作者：M M Asif Ferdous

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：camera shake, Vision-language models, degraded by compression, poor lighting, increasingly deployed

备注： 15 pages, 4 figures

点击查看摘要

Abstract:Vision-language models (VLMs) are increasingly deployed on consumer hardware where input images are degraded by compression, camera shake, and poor lighting. In such settings, a reliable uncertainty signal matters more than raw accuracy, because it determines when a system should defer rather than answer. We evaluate two small open-weight VLMs -- Qwen2-VL-2B-Instruct and SmolVLM-Instruct -- across six realistic photographic degradations at three severity levels, comparing two confidence signals: the confidence the model states in natural language, and the model's own mean token probability over its generated answer. Across 3,800 predictions, we find a large and consistent gap. Verbalized confidence in Qwen2-VL is almost constant (mean 0.87-0.90 across all conditions) and detects its own errors at chance level (AUROC 0.39-0.75, typically ~0.50), while internal token probability from the same model separates correct from incorrect answers with AUROC 0.92-0.99. In SmolVLM, verbalized confidence proved largely unobtainable: across three prompt templates, only one of five pilot attempts produced a parseable confidence value, while internal probability again yielded above-chance error detection (AUROC 0.54-0.92). Both models fail in the same place: under severe underexposure, accuracy collapses (0.99-0.22 for Qwen2-VL, 0.97-0.42 for SmolVLM) while both confidence signals barely move, and internal error-detection falls to chance. We conclude that small VLMs encode usable self-knowledge that their verbalized output does not express, that internal probability is therefore the better deferral signal in constrained deployment, and that neither signal should be trusted under severe low-light conditions.

19. 【2607.22026】DWT-Fusion: A Signal-Based Framework for Training-Free LLM-Generated Text Detection

链接：https://arxiv.org/abs/2607.22026

作者：Mehmet Batuhan Özdaş,Murat Osmanoğlu

类目：Computation and Language (cs.CL)

关键词：Detecting LLM-generated text, text remains challenging, generalize across datasets, unseen generators, challenging under zero-shot

备注： 40 pages, 4 figures, 6 tables

点击查看摘要

Abstract:Detecting LLM-generated text remains challenging under zero-shot and training-free conditions, especially when detectors must generalize across datasets, domains, and unseen generators. While existing training-free approaches exploit language-model statistics as detection signals, they typically characterize a text through global measures that summarize overall model behavior. Consequently, potentially informative local and multiscale variations in token-level predictability may remain underutilized. Motivated by this observation, we introduce DWT-Fusion, a training-free signal-based framework for detecting LLM-generated text using discrete wavelet analysis of token-level log-probability sequences produced by a proxy causal language model. The proposed framework analyzes these sequences through wavelet-based multiresolution signal representations and derives detection signals from localized probability dynamics. We further evaluate four training-free voting variants, including equal-weight hard voting, equal-weight soft voting, calibration-weighted hard voting, and calibration-weighted soft voting, to combine multiple wavelet configurations without training a supervised meta-classifier. We evaluate the framework on HC3, M4, and MAGE using GPT-Neo-2.7B, GPT-J-6B, Falcon-7B, and LLaMA-3-8B as proxy models. The best single wavelet configurations achieve AUROC values of 0.9872, 0.8185, and 0.7138 on HC3, M4, and MAGE, respectively. With calibration-weighted voting, the best ensemble variants further improve AUROC to 0.9919, 0.8477, and 0.7471. These findings show that DWT-based multiresolution scoring and calibration-guided voting fusion provide effective and interpretable signals for training-free LLM-generated text detection.

20. 【2607.22014】Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents

链接：https://arxiv.org/abs/2607.22014

作者：Suman Navaratnarajah,Taehyoung Kim,Jona Ruthardt,Ishaan Bhimwal,Ryousuke Yamada,Yannik Blei,Wolfram Burgard,Yuki M Asano

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Multimodal Large Language, single high-level instruction, Large Language Models, Multimodal Large, solve long-horizon embodied

备注： Preprint

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) are emerging as core reasoning modules for embodied agents, yet it remains unclear how well general-purpose models can solve long-horizon embodied tasks from a single high-level instruction. We introduce MissionBench, a benchmark for mission-level evaluation of MLLMs in aerial 3D environments. It comprises 120 missions across five simulated 3D environments and four task families. Agents must autonomously plan, navigate, and report outcomes using only egocentric observations and its action history, without aerial-specific fine-tuning. Across 22 open- and closed-source MLLMs, the strongest model succeeds on fewer than 35% of missions compared to 84.4% human performance, highlighting the difficulty of multi-step embodied tasks. Despite large variations between model families, we observe gains from scaling, indicating that larger general-purpose models possess stronger zero-shot embodied capabilities. Our analysis shows that mission-level competence requires coordinating multiple capabilities beyond spatial perception, including multi-step planning and adaptive reasoning. This motivates closed-loop evaluation and highlights both the promise and risk of scaling-driven improvements for embodied AI.

21. 【2607.21988】Analysing Self-Harm Representations in Language Models: a Cross-Architecture Study

链接：https://arxiv.org/abs/2607.21988

作者：Luis Espinosa-Anke,Carla Perez-Almendros

类目：Computation and Language (cs.CL)

关键词：flagging at-risk users, enable timely intervention, NLP techniques, detect using NLP, at-risk users

备注：

点击查看摘要

Abstract:Self-harm content is particularly challenging to detect using NLP techniques, and is also a high-stakes task which requires the highest accuracy to enable timely intervention or flagging at-risk users. We therefore present an analysis of how LLMs represent such self-harm content, which has downstream applications in self-harm detection, LLM intervention and governance and policing. In this paper, we focus on two datasets and four models, and perform two main experiments: (1) We train and evaluate linear probes across all layers of each model on two self-harm datasets: X-Sensitive and SH-Detection. Across both corpora, self-harm information crystallizes in the final 3 - 7% of network layers (93 to 97% depth). (2) We extract contrastive self-harm directions and, after performing a normaliation step, we find that the most accurate probes are not necessarily the most linearly separable. In particular, we find Gemma-3-4B to represent this \textit{contrastive self-harm direction} in a slightly different, more intricate way than the other LLMs.

22. 【2607.21981】J-CoT: Chain-of-Thought in J-Space

链接：https://arxiv.org/abs/2607.21981

作者：Junde Wu,Jiayuan Zhu,Fengling Liu,Minhao Hu,Jiazhen Pan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：prompting improves language-model, improves language-model reasoning, successive computation steps, prompting improves, improves language-model

备注： work in progress

点击查看摘要

Abstract:Chain-of-thought prompting improves language-model reasoning by carrying intermediate states across successive computation steps. However, relying on natural language as the only recurrent interface is overly restrictive, since many transient computations do not need to be fully verbalized. Existing latent-reasoning methods remove this constraint by recurrently propagating continuous hidden states. However, these methods pass a dense hidden vector as a whole, without an explicit mechanism for selecting and organizing the information needed by the next reasoning step. This motivates an intermediate interface that remains linguistically grounded without requiring a decoded sentence. We introduce \textbf{J-CoT}, a recurrent reasoning framework built on \emph{J-space}, a vocabulary-indexed coordinate system within the model's hidden representations. Within each cycle, the model computes in its full hidden space. At the cycle boundary, J-CoT expresses the intermediate state as vocabulary-indexed coefficients, carries these coefficients forward as a \emph{J-thought}, and maps them back into the model's hidden representation for the next cycle. J-CoT therefore requires neither a fluent intermediate rationale nor recurrence over the complete hidden state. Under matched backbone and inference settings, J-CoT-Zero matches or exceeds the strongest evaluated latent-reasoning baseline on every benchmark, while J-CoT-Train obtains the highest score across the evaluated mathematical, scientific, coding, and structured path-reasoning tasks.

23. 【2607.21980】Analyzing Toxic Behavior and Its Impact on the Mastodon Community

链接：https://arxiv.org/abs/2607.21980

作者：Pasan Kamburugamuwa,Scrivner,Olga B

类目：Computation and Language (cs.CL); Computational Engineering, Finance, and Science (cs.CE)

关键词：independently moderated social, moderated social servers, social servers poses, servers poses unique, poses unique challenges

备注： 5 pages, 1 figure

点击查看摘要

Abstract:Mastodon as a decentralized federation of independently moderated social servers poses unique challenges for the detection and mitigation of toxic content. There are no unified moderation standards. The ecosystem is very diverse and uneven. This paper explores the development and spread of toxicity in Mastodon, utilizing machine learning methods to examine user posts. The results offer clarity on toxicity trends and its implications for community health and decentralized governance.

24. 【2607.21978】MoE$^2$-LoRA: When MoE Models Meet MoE-style Low-Rank Adaptation

链接：https://arxiv.org/abs/2607.21978

作者：Qingyu Yang,Haonan He,Minglei Li,Jingqi Ye,Tao Chen,Lei Bai,Peng Ye

类目：Computation and Language (cs.CL)

关键词：models remains underexplored, large language models, parameter-efficient fine-tuning, remains underexplored, Existing PEFT methods

备注： Preprint, under review

点击查看摘要

Abstract:Mixture-of-Experts (MoE) architectures have been widely adopted in large language models, yet parameter-efficient fine-tuning (PEFT) for MoE models remains underexplored. Existing PEFT methods for MoE either ignore router priors with uniform adapters, reducing efficiency and risking forgetting, or rely on static expert selection, limiting per-token capacity and cross-expert feature learning. In this paper, we make the first attempt to fine-tune MoE models with MoE-style low-rank adaptation: our method, entitled MoE$^2$-LoRA, deeply couples the pretrained expert specialization with task-specific adaptivity via a dual-channel Routing-Conditioned Projection (RCP) module, which reuses base router activations to inform LoRA routing. We further introduce a single global LoRA expert pool shared across all layers, enabling model-wide adaptation with emergent layer-wise affinities and balanced expert utilization. MoE$^2$-LoRA simultaneously benefits from the advantages of prior reuse, dynamic adapter routing, and model-wide knowledge sharing. Evaluated on multiple MoE backbones with varying scales and expert granularities, MoE$^2$-LoRA consistently achieves state-of-the-art downstream accuracy while retaining stronger general capabilities.

25. 【2607.21971】aching LLMs to Self-Evolve: Cultivating Core Meta-Skills with Reinforcement Learning

链接：https://arxiv.org/abs/2607.21971

作者：Shujin Wu,Cheng Qian,Xiusi Chen,Heng Ji

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：shows remarkable performance, remarkable performance gains, Test-time scaling, environment feedback, demonstrated by AlphaEvolve

备注：

点击查看摘要

Abstract:Test-time scaling through iterative self-evolution with environment feedback, as demonstrated by AlphaEvolve, shows remarkable performance gains. We hypothesize that the success of such evolution frameworks hinges on meta-skills, such as self-reflection with environment feedback, that enable effective multi-round refinement, yet are largely neglected by traditional post-training. To bridge this gap, we present MetaEvolve, a framework designed to develop these meta-skills via a data synthesis pipeline, evolution-aware reinforcement learning (RL), and inference-time evolutionary search. Concretely, we ground MetaEvolve in coding, where program execution provides natural, continuous reward signals beyond binary correctness. Building on these signals, we synthesize evolution trajectories as training data, each containing a current program, its fitness score (combining correctness and efficiency), and a history of prior attempts, and train the model via RL with verifiable rewards derived from test case execution. By training on large-scale code data, we aim to inspire generalizable domain-agnostic meta-skills that can transfer broadly to open-ended problems where such rich training signals are scarce. Across seven coding benchmarks, MetaEvolve outperforms the strongest baseline by 10.01% absolute on in-distribution tasks and 24.12% on out-of-distribution tasks. On open-ended algorithm optimization problems entirely outside the training domain, it further achieves a 46.9% relative improvement. These results demonstrate that explicitly cultivating self-evolution meta-skills offers a principled path toward more capable and autonomously self-evolving AI.

26. 【2607.21962】Ground Truth First: A Longitudinal Evaluation Instrument for Agent Memory, and the Tenure Crossover in Memory-Architecture Rankings

链接：https://arxiv.org/abs/2607.21962

作者：Quentin Spencer

类目：Computation and Language (cs.CL)

关键词：typically generate conversations, extract answer keys, short interaction histories, LLM-agent memory typically, memory typically generate

备注： 25 pages, 2 figures. Code: [this https URL](https://github.com/veracium-ai/Veracium)

点击查看摘要

Abstract:Benchmarks for LLM-agent memory typically generate conversations first and extract answer keys afterwards -- with documented label-error and contamination problems -- and they overwhelmingly measure short interaction histories. We invert the pipeline: a seeded life-script sampler emits facts with validity intervals, volatility classes, and source channels before any text exists; an LLM renderer writes chat and email from per-event fact manifests; a fidelity verifier confirms every planted fact; and questions are instantiated mechanically from the script, so gold answers are script-valid by construction and separately validated for answerability. The synthetic, fictionalized corpus (~380 questions, 15 types) embeds features absent from the benchmarks we survey: per-fact validity intervals, sent/received trust distinctions, injection probes in a benign harness, and as-of-date question sets. Benchmarking five memory architectures against a no-memory control (fixed answerer, versioned LLM judge, three replicates, two horizons), we find backend rankings invert with history length: the budgeted curated-map memory that leads at three weeks loses recall of evicted content by nine weeks (96% to 72%) while a provenance-typed graph rises to 90%; the inversion is positive for all six users under complete cross-family re-judging (exact p=0.031). A full-rendered-history baseline ties or exceeds the best memory system at the short horizon but shows no judge-independent advantage at nine weeks, at about twice the read cost. Write-stage quality strongly correlates with downstream quality (weakly-written facts fail 24% vs 2%), and injection resistance tracked whether provenance boundaries survive representation. A layered architecture performs best among the memory systems in both regimes (96.8% short-horizon) and is released as Veracium, an open-source library, with the corpus generator and harness.

27. 【2607.21961】On Improving Faithfulness of Podcasts from Documents

链接：https://arxiv.org/abs/2607.21961

作者：Soumya Dutta,Tejas Indulal Dhamecha,Pannaga Shivaswamy

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, Large, conversational, language models

备注： Under Submission

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used to generate long-form conversational content such as podcasts from textual sources. While these systems produce fluent and engaging narratives, they often introduce ungrounded information. In this work, we present the first systematic study of faithfulness in document-grounded podcast generation, where grounding must be maintained across conversational turns in long-form, multi-speaker transcripts. We construct a dataset of over 1500 documents spanning five domains and generate podcast transcripts using multiple LLMs. We introduce a turn-level LLM-as-a-judge framework for evaluating whether conversational turns are supported by the source document, and validate its reliability through human studies. Our analysis shows that even state-of-the-art models, including GPT-4o, frequently generate ungrounded content. To mitigate this issue, we propose catch-n-repair, a model-agnostic framework that detects and rewrites unfaithful conversational turns while preserving conversational flow. Experiments demonstrate consistent improvements in faithfulness across both in-domain and out-of-domain settings.

28. 【2607.21936】Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models

链接：https://arxiv.org/abs/2607.21936

作者：Gabeen Kim,Kyeongpil Kang

类目：Computation and Language (cs.CL)

关键词：invaluable knowledge archives, deterioration and damage, act as invaluable, suffer from illegibility, illegibility due

备注： Accepted to Findings of ACL 2026

点击查看摘要

Abstract:Historical documents act as invaluable knowledge archives but often suffer from illegibility due to physical deterioration and damage. While existing restoration methods based on masked language modeling effectively utilize local context, they struggle to restore named entities that require external historical knowledge. To address this limitation, we introduce a novel framework for historical document restoration that leverages large language models with retrieval-augmented generation (RAG). By combining the implicit knowledge of pre-trained LLMs with explicitly retrieved external context, our model ARI effectively mitigates the challenge of inferring context-dependent proper nouns. Extensive experiments on Korean historical documents demonstrate that our approach significantly outperforms baselines, achieving substantial gains in restoring both general characters and named entities. Furthermore, comprehensive evaluations including expert assessments confirm that ARI serves as a practical tool for domain experts, promising to accelerate the analysis of historical records.

29. 【2607.21904】Diffusion Models in Medical Image Inpainting: Challenges, Solution Taxonomy, and Future Directions

链接：https://arxiv.org/abs/2607.21904

作者：Arthur Dantas Mangussi,Joana Cristo Santos,Ricardo Cardoso Pereira,Ana Carolina Lorena,Mário A. T. Figueiredo,Pedro Henriques Abreu

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：medical image inpainting, Image inpainting aims, Image inpainting, medical image, visual and semantic

备注：

点击查看摘要

Abstract:Image inpainting aims to reconstruct missing or corrupted regions of an image while preserving as much as possible, visual and semantic consistency. In medical imaging, this task is particularly important because artifacts, missing information, and pathological alterations can compromise diagnostic reliability and downstream clinical applications. Recently, diffusion models have emerged as state-of-the-art generative approaches for medical image inpainting due to their ability to generate anatomically consistent reconstructions. This survey presents a systematic review of diffusion-based methods for medical image inpainting, covering the main architectures, applications, datasets, and evaluation strategies reported across 60 studies. In addition, we propose a taxonomy for diffusion-based approaches. The analysis reveals a rapid growth of research interest in diffusion-based medical image inpainting, with denoising diffusion probabilistic models and latent diffusion models emerging as the dominant architectures. The reviewed studies mainly focus on artifact removal, data augmentation, pseudo-healthy tissue reconstruction, and anomaly detection, particularly in magnetic resonance imaging and computed tomography imaging. Overall, diffusion models demonstrate strong performance in producing anatomically plausible reconstructions and aiding downstream clinical tasks. However, the review also highlights important challenges, including the lack of standardized benchmarks, limited dataset diversity, and restricted validation procedures across diverse clinical applications and imaging scenarios.

30. 【2607.21887】owards Reducing Foreign Language Anxiety Using Level-Appropriate Embodied Conversational Agents

链接：https://arxiv.org/abs/2607.21887

作者：Krishan Rajaratnam,Wenbin Gan,Yuan Sun

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词：Foreign language anxiety, FLA, Foreign language, foreign language education, major barrier

备注： 8 pages, 6 figures, published in the proceedings of EDULEARN26

点击查看摘要

Abstract:Foreign language anxiety (FLA) can be a major barrier to second language acquisition (SLA), especially in conversational contexts. With the proliferation of large language models (LLMs) throughout all areas of life, recent work suggests that interacting with LLM agents can be instrumental within the field of SLA and foreign language education, especially for reducing FLA. Related work also suggests that linguistic demands and task complexity can be predictors of FLA, implying that the use of demanding, complex language could lead to learners experiencing higher FLA. In this paper, we propose a novel multi-agent embodied conversational system that generates level-appropriate dialogue for English language learners. These levels are based on those defined by the Common European Framework of Reference for Languages (CEFR) to describe non-native listener and speaker proficiency. Using a "generate-evaluate-regenerate" loop with multiple LLM agents and a level classifier, it achieves a desired simplicity that is adaptive to the user's proficiency level. We also share the results of a preliminary small-sample pilot study that tested this system with Japanese university students, to see whether it would yield lower FLA levels than an unsimplified embodied conversational agent. Analysis of conversational output showed that 87.4% of dialogue sentences generated by the proposed multi-agent system fell within one predicted CEFR level of the learner's self-assessed proficiency, compared to 54.1% for the unsimplified agent. This suggests that the novel system is better able to produce output at an appropriate level for the learner. Though this study did not yield statistically significant evidence that the system reduces FLA levels in Japanese learners of English, likely due to a small sample size, it provides usability findings and culturally-informed design insights that will inform future study.

31. 【2607.21861】Data Quality over Capacity: Internalizing Documents into LoRA Adapters for Closed-Book QA

链接：https://arxiv.org/abs/2607.21861

作者：Joan Figuerola Hurtado

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：baking documents directly, study baking documents, context-window budget, outweighing LoRA rank, baking documents

备注：

点击查看摘要

Abstract:We study baking documents directly into the weights of a 4-bit Gemma-4-e4b model via LoRA, so a system can answer questions about a corpus closed-book: no retrieval and no context-window budget. Across roughly 100 training runs from single documents to a 99-document corpus, we find that once adapter capacity is adequate, training-data quality is the dominant lever on closed-book accuracy, outweighing LoRA rank, learning rate, and two alternative architectures combined; capacity itself is a hard gate below which no data intervention helps. A single curation pass (shortening gold answers to canonical 1-6 word spans and dropping trivia) moved closed-book accuracy from 57.7% to 85.7% on a 15-document corpus, a larger jump than any architectural change. We confirm a capacity trend (rank must grow with corpus size) entangled with a coupling between rank and learning rate that we initially misdiagnosed. On a 15-document slice we add a real retrieval baseline: the internalized adapter (84.2% recall) beats a BM25-RAG pipeline with a base reader (58.9%) and even a realistic gold-chunk oracle (65.6%) at lower latency. We report the full arc, including three misdiagnoses, as a case study in debugging LLM training empirically.

32. 【2607.21856】LeAct: Learning to Reason from Expert Actions

链接：https://arxiv.org/abs/2607.21856

作者：Ziran Yang,Chengshuai Shi,Raj Ghugare,Benjamin Eysenbach,Karthik Narasimhan,Chi Jin

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Modern reasoning models, Modern reasoning, today sourced, stronger LLMs, sourced from human

备注： 27 pages, 3 figures, 11 tables

点击查看摘要

Abstract:Modern reasoning models depend on reasoning data, today sourced from human annotations or distilled from stronger LLMs. However, a rich and largely untapped source of supervision lies in expert systems (e.g., game engines, classical planners, theorem provers), which routinely produce near-optimal actions across diverse domains. But these experts are silent: they commit to an action without writing down the chain of thought (CoT) behind it. Recovering that CoT as natural-language reasoning would distill expert knowledge into a student that generalizes beyond the demonstrated actions. We treat it as a latent variable and study how to recover it from the action alone. Our approach, LeAct (Learning to reason from Actions), optimizes this latent variable: the student samples candidate CoTs for each expert action, and we retain those that measurably improve its own probability of recovering the action. Across imperfect-information games at multiple scales and a simulated robotics benchmark, LeAct reaches the solver's numerical floor on small enumerable games. At larger scale, it is $5\times$ closer to the solver than the strongest expert-iteration baseline. At Flop Hold'em ($\sim 10^9$ infosets), LeAct wins head-to-head by $+60$ mbb/g, and on the robotics probe it is the only training recipe that improves on direct imitation. We present a principled framework and the result: expert systems become a categorically new source of reasoning teachers for foundation models.

33. 【2607.21804】Adversarial Prompts for Acceptance Collapse in Speculative Decoding

链接：https://arxiv.org/abs/2607.21804

作者：Run Wang,Chaoyi Zhou,Xi Liu,Yi Zhu,Amir Salarpour,Pedram MohajerAnsari,Zhi-Qi Cheng,Feng Luo,Siyu Huang,Mert D. Pesé

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Lossless acceleration schemes, promise significant inference, significant inference speedups, dynamic token-level alignment, Lossless acceleration

备注：

点击查看摘要

Abstract:Lossless acceleration schemes, such as speculative decoding, promise significant inference speedups by relying on dynamic token-level alignment between a draft and a target model. However, this guarantee of semantic equivalence masks a severe operational vulnerability: draft-target alignment can be systematically attacked. In this paper, we introduce ADSD, which, to the best of our knowledge, is the first prompt-suffix attack that collapses verifier acceptance by pushing draft probability mass toward tokens the target is unlikely to accept. ADSD uses Soft-Collapse, a verifier-aligned surrogate derived from the asymmetric speculative acceptance rule, together with a target-preservation objective that discourages obvious task corruption. ADSD successfully generates highly effective adversarial suffixes. On the GSM8K dataset, our attack increases the mean sample time by 62.3% while preserving the task quality. We further show that this vulnerability exists across different domains, speculative decoding strategies, and model architectures.

34. 【2607.21799】Agentic Evaluation of Copyright Law Compliance

链接：https://arxiv.org/abs/2607.21799

作者：Zheng Hui,Doni Bloomfield,Noam Kolt

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Large language model, Large language, agents increasingly perform, increasingly perform commercial, involve retrieving external

备注： ICML 2026 Spotlight

点击查看摘要

Abstract:Large language model (LLM) agents increasingly perform commercial tasks that involve retrieving external content such as images and, where appropriate, reproducing that content. LLM agents should comply with the law, including copyright law. Presently, however, we lack adequate frameworks to assess whether they do so in practice. To that end, we introduce \textbf{Copyright-Bench}, a benchmark designed to evaluate \textit{LLM agents' compliance with} \emph{copyright law}. Copyright-Bench is comprised of realistic commercial tasks---website development, merchandise design, and pitch deck production---that involve agents selecting between public-domain content (the use of which is \textit{legal}) and copyrighted content (the use of which is \textit{infringing} in this setting).The evaluation introduces prompt variations that simulate different user preferences, as well as time this http URL state-of-the-art LLM agents against a human baseline, we find that: (1) agents select copyrighted works despite the availability of public-domain alternatives; and (2) for open-weights models, violation rates increase in response to certain user preferences and simulated time pressure.

35. 【2607.21785】From Seasonality to Semantics: Benchmarking a Hybrid Probabilistic Forecasting System for Roadblocks in Bolivia

链接：https://arxiv.org/abs/2607.21785

作者：Rodrigo Vargas Sainz,Christian Berón Curti

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Gross Domestic Product, national Gross Domestic, Domestic Product, devastating economic impacts, Gross Domestic

备注： 21 pages in English + 21 pages in Spanish, 7 figures

点击查看摘要

Abstract:Roadblocks in Bolivia are a social conflict phenomenon with devastating economic impacts, estimated at losses equivalent to 4% of the national Gross Domestic Product. Despite their recurrence and impact, there is a lack of local predictive systems to anticipate these events for logistical decision-making. This paper presents a hybrid probabilistic forecasting system that integrates time series decomposition (Prophet) with natural language processing (NLP) techniques applied to a six-year corpus of Bolivian news coverage. The methodology employs vector semantic embeddings and zero-shot classification models to capture signals of discursive escalation prior to the materialization of the roadblocks. Using an expanding walk-forward validation scheme applied over 1,762 days and seven forecasting horizons (H+1 to H+7), seven internal configurations and four external benchmarks were compared, including SARIMA and LightGBM. The results demonstrate that the hybrid configuration (Prophet + NLP, C6) consistently outperforms purely statistical models, achieving an AUC-ROC of 0.677 at H+1 and reducing the Brier Score by 10.9% relative to the baseline temporal model (0.220 vs. 0.247), maintaining a statistically significant error reduction across all evaluated horizons ($p 0.02$). This research validates that the integration of semantic news signals allows for the detection of social tension peaks not captured by historical inertia, providing a technical tool for risk management in critical transport corridors.

36. 【2607.21780】Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms

链接：https://arxiv.org/abs/2607.21780

作者：Abu Tyeb Azad,Fahim Ahmed,Ishita Sur Apan,Ezharuddin Jubaer,Sumaiya Karim Katha,Armun Alam,Amin Ahsan Ali,Aman Chadha,Md Mofijul Islam,AKM Mahbubur Rahman

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：multiple documents concatenated, Bangladeshi government forms, single file, Bangladeshi government, multiple documents

备注：

点击查看摘要

Abstract:Document packets, multiple documents concatenated into a single file, are common in government and administrative workflows, yet splitting them into their constituent documents is difficult, especially for low-resource languages. We introduce Khondo (Bangla for split/segment), the first benchmark for document packet splitting on Bangladeshi government forms. Unlike prior English and OCR-text-based datasets, Khondo is bilingual (Bangla--English) and vision-native; where models operate directly on page images. It spans five concatenation schemes, from sequential to fully shuffled, across 14 administrative domains, with ground-truth boundaries, domain types, and page order. Zero-shot evaluation of MLLMs shows they cluster pages into their source documents fairly well but struggle in restoring the original page order once shuffled. To isolate what drives this difficulty, we run two controlled analyses, varying the prompt instruction and then the packet language. Both primarily affect ordering rather than clustering: (a) explicit page-order instructions are necessary but insufficient, and (b) English packets are ordered more reliably than Bangla, making page arrangement the dominant challenge and language a secondary but consistent factor. Khondo establishes page-order reconstruction as a key open problem in vision-based, low-resource document understanding, and provides a controlled benchmark for measuring progress toward solving it. Our dataset and code is available at this https URL

37. 【2607.21774】Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders

链接：https://arxiv.org/abs/2607.21774

作者：Pablo Santiago Potes Velasco,María del Mar García Matabanchoy,Óscar Julián Pérez Ladino,Jhoan Stevan Mosquera Ortiz,Nicolás Lozano Mazuera,Gilber Alexis Corrales Gallego

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：infer demographic attributes, Large language models, Large language, explicitly stated, subtle linguistic cues

备注：

点击查看摘要

Abstract:Large language models may infer demographic attributes from subtle linguistic cues even when those attributes are not explicitly stated. This pilot study examines whether Qwen2.5-7B-Instruct internally represents Colombian identity, socioeconomic status, or stereotype-related information when processing Colombian-Spanish and English prompts. We use Natural Language Autoencoders (NLA) to verbalize residual-stream activations from layer 20 across four positional quartiles per prompt. Our dataset contains 30 prompts arranged as 15 matched Spanish-English pairs, spanning explicit Colombian cues, implicit Colombian cues, and neutral controls. We report descriptive rates and qualitative evidence rather than statistically powered effects, focusing on whether latent nationality or stereotype representations appear before they are verbalized in the model output. This work connects activation-level interpretability with bias evaluation for underrepresented Spanish varieties.

38. 【2607.21758】Humanly: A Configurable and Traceable Environment for Human-AI Collaborative Writing

链接：https://arxiv.org/abs/2607.21758

作者：Shenzhe Zhu,Haoqian Zhang,Xu Yang,Jingyu Tang,Yi Nian,Xiaoxue Du,Shu Yang,Alex Pentland,Joachim Baumann,Jiaxin Pei

类目：Computation and Language (cs.CL)

关键词：conference chairs, public readers, readers all judge, Teachers, writing

备注：

点击查看摘要

Abstract:Teachers, conference chairs, and public readers all judge writing from limited evidence, seeing only a finished document and not the process that produced it. Final text alone cannot reveal whether a document was produced through human typing, AI generation, or mixed human-AI collaboration. Existing process-tracking tools help, but many are tied to host-document histories, provide coarse activity records, and offer limited control over the writing environment. Humanly is a writing platform that makes the writing process itself the evidence. Users configure writing environments for personal documents or assigned tasks and draft in a workspace that records writing activity and in-platform AI assistance. Humanly can package a completed session into a sealed writing certificate with configuration-aware anomaly behavior review. It can support writing scenarios such as course assignments, peer review, and personal certification. Our user study shows that Humanly is helpful across roles, and a red-teaming study shows that the Humanly Typing Detector distinguishes human hand typing from automated typing.

39. 【2607.21692】Learning What Matters: Supervising Sparse Attention Routing with Causal Evidence Sets

链接：https://arxiv.org/abs/2607.21692

作者：Jim Allchin

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Sparse attention reduces, Sparse attention, attention, reduces the cost, cost of long

备注： 18 pages, 4 figures, 15 tables

点击查看摘要

Abstract:Sparse attention reduces the cost of long contexts by allowing each query to read only selected parts of the input. These selectors are often trained by distilling the attention patterns of a dense teacher, assuming that attention reveals which context the teacher actually uses. We test that assumption on retrieval tasks where the evidence for each answer is known exactly. By masking parts of the context and measuring whether the answer changes, we find that attention and causal dependence often disagree, and distilled selectors inherit the mismatch. Teachers attend to outdated facts they have learned to ignore, and their attention can vary across training runs even when they rely on the same evidence. In a two-step reference task, attention at the answer skips the intermediate step because it was resolved earlier in the forward pass: a selector trained on attention achieves 41% accuracy, while the same selector trained on causal evidence reaches 99% and matches the teacher. These evidence sets require no annotation: recovered from a frozen teacher by masking alone, they train selectors to the same accuracy. We find the same conflict in pretrained models: Qwen2.5-3B gives more attention to an outdated fact than the current one on 58% of conflicting-fact examples despite answering correctly, while Gemma-2-9B rises from 56% to 99% accuracy when restricted to the two relevant sentences. Attention shows where a model looks, not necessarily what its answer depends on; across the regimes we tested, that dependence matched or outperformed attention as a training target.

40. 【2607.21685】Evaluation design conditions the expert-vs-auto MeSH gap: a controlled comparison of bag-of-words and BiomedBERT on the Cohen benchmark

链接：https://arxiv.org/abs/2607.21685

作者：Samuel M. Okoe-Mensah

类目：Computation and Language (cs.CL)

关键词：systematic review begins, Medical Subject Headings, reading thousands, systematic review, review begins

备注： 15 pages, 2 figures, 10 tables

点击查看摘要

Abstract:A systematic review begins with someone reading thousands of abstracts to identify the few that are relevant, and classifiers are used to prioritise that reading. Their inputs are often augmented with Medical Subject Headings (MeSH), assigned either by expert indexers weeks or months after publication or by automatic tools at once. To our knowledge the two have not been compared directly as classifier features, and no previous work has asked whether that comparison's outcome depends on how the classifier is evaluated. Using the Cohen et al. (2006) drug-class benchmark on three topics, we characterise a bag-of-words logistic regression classifier (seven reruns) and BiomedBERT (five seeds), then examine how the Statins result changes under alternative designs. Under the canonical 5-fold full-corpus design, the bag-of-words expert-vs-auto gap on Statins is +0.096 WSS@95%. Matching the corpus size to the smaller topics (n = 803) reduces it to +0.033 (95% bootstrap CI includes zero), and 10-fold cross-validation at full size to +0.021 (CI narrowly excludes zero). Under canonical evaluation BiomedBERT gives +0.020, within sampling noise of the bag-of-words 10-fold result. A power analysis indicates a Statins-sized effect would not have been detectable at the Opioids or ADHD variance, so those nulls are design-limited rather than informative. A representation asymmetry remains: 15.1% of Statins inputs exceed BiomedBERT's 512-token limit when expert MeSH terms are appended, so truncation may contribute to the smaller transformer gap, although this cannot be separated from training volume here. In screening pipelines using transformers or 10-fold bag-of-words, the gap on the topics tested is about 0.02 WSS@95%, with CIs spanning zero on at least one bound. More broadly, benchmark conclusions about feature sources can change substantially under reasonable changes to the evaluation design.

41. 【2607.21655】Progress Reward Modeling for Robotic Learning: A Comprehensive Survey

链接：https://arxiv.org/abs/2607.21655

作者：Jianshu Zhang,Keliang Wu,Haoran Lu,Anbang Liu,Ce Zhang,Weijie Yin,Chengxuan Qian,Xiyuan Yang,Zhenyu Pan,Guo Ye,Han Liu

类目：Robotics (cs.RO); Computation and Language (cs.CL)

关键词：large behavior spaces, place in dynamic, dynamic environments, environments with large, progress

备注： Project page: [this https URL](https://github.com/sterzhang/Awesome-Progress-Models)

点击查看摘要

Abstract:Robotic learning takes place in dynamic environments with large behavior spaces. A terminal success signal only tells the robot whether the task is completed. It does not explain whether the current behavior is making progress, remaining unchanged, or undoing earlier progress. For this reason, recent studies have increasingly explored progress rewards that provide feedback during task execution. However, the current literature lacks a shared framework. Existing methods use different observations, goal specifications, output signals, supervision sources, and evaluation protocols. This makes it difficult to compare them and understand what their results actually validate. In this survey, we provide a unified view of progress reward modeling for robotic learning. We organize the field in three connected steps. We first study the interface of a progress model. This defines the problem from the outside by asking what information the model receives and what form of progress signal it produces. We then move inside the model and study the methods used to construct this signal. This reveals the different assumptions and mechanisms behind progress estimation and reward generation. Finally, we examine the data and benchmarks that support these methods. This shows how progress supervision is obtained and what different evaluations actually measure. Together, these three perspectives connect what a progress model is, how it is built, and how its quality is validated. We further summarize the main limitations of current approaches and discuss future research directions.

42. 【2607.21653】Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning

链接：https://arxiv.org/abs/2607.21653

作者：Jian Hu,Huiying Li,Hao Zhang,Binfeng Xu,Yifan Zhang,Shaokun Zhang,Hemil Desai,Michael Demoret,Pavlo Molchanov,Jan Kautz,Yi Dong

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

关键词：Agentic reinforcement learning, reinforcement learning research, constant algorithm modification, Agentic reinforcement, rollout schemes

备注： tech report for Molt

点击查看摘要

Abstract:Agentic reinforcement learning research is constant algorithm modification, new estimators, new pipeline stages, new rollout schemes, and in mainstream frameworks each change threads through layers of trainer, distributed backend, and rollout glue: the cost lands on the researcher at every iteration. Molt is a PyTorch-native training framework built to keep that cost small: a codebase compact and clean enough for a researcher to hold in their head, and for an AI coding assistant to read and reason about in its entirety, so the algorithm flow can be traced and changed end to end. The agent is an ordinary program, and one asynchronous loop trains multimodal and mixture-of-experts policies while never training on a token it did not generate, consistent in tokens, policy versions, and model semantics. Leanness does not cost performance: under a matched, fully asynchronous protocol, Molt is statistically comparable to a state-of-the-art Megatron-based stack. Molt is open source and provides recipes and containers at this https URL.

43. 【2607.21632】A Consensus-Based Framework for Relative Preference Evaluation of Large Language Models

链接：https://arxiv.org/abs/2607.21632

作者：Mohtashim Khan

类目：Computation and Language (cs.CL)

关键词：Traditional benchmarks, LLMs primarily rely, objective scoring metrics, scoring metrics, primarily rely

备注： 14 pages, 7 figures

点击查看摘要

Abstract:Traditional benchmarks for LLMs primarily rely on static datasets and objective scoring metrics, which often fail to capture differences in response quality when multiple answers are acceptable. In such settings, correctness alone is insufficient to distinguish between responses that vary in clarity, completeness, and usefulness. This paper introduces a consensus-based evaluation framework that measures relative preference among model-generated responses rather than absolute correctness. Instead of evaluating outputs against a fixed ground truth, we assess how a panel of diverse LLMs ranks anonymized candidate responses to the same prompt. This approach treats aggregate inter-model agreement as a proxy for perceived response quality under blind conditions. We conduct a controlled study using five state-of-the-art LLMs across multiple domains, including programming, general knowledge, safety, logical reasoning, and mathematics. Each model generates responses and independently ranks peer outputs through a structured voting process. Scores are aggregated into a Relative Intelligence Index (RII), representing how frequently a model's responses are preferred by other models. Our findings reveal consistent preference patterns across domains, with certain models more frequently ranked highly by their peers. However, we emphasize that these results reflect inter-model preference alignment rather than objective correctness or human judgment. This framework provides a scalable, model-driven method for comparative evaluation, offering an alternative perspective on response quality in scenarios where multiple valid answers exist. While not directly aligned with human evaluation, prior work suggests that aggregated model preferences can partially correlate with human judgments, motivating this as a proxy signal.

Comments:
14 pages, 7 figures

Subjects:

Computation and Language (cs.CL)

MSC classes:
I.2

Cite as:
arXiv:2607.21632 [cs.CL]

(or
arXiv:2607.21632v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.21632

Focus to learn more

              arXiv-issued DOI via DataCite

Submission history From: Mohtashim Khan [view email] [v1]
Sun, 19 Jul 2026 08:59:19 UTC (463 KB)

44. 【2607.21619】Adversarial Style Optimization: Enhancing VLM Jailbreaks by GRPO-based Stylistic Triggers Optimization

链接：https://arxiv.org/abs/2607.21619

作者：Bingjun Luo,Jialin Guo,Yue Yao,Xinpeng Ding

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, alignment remains vulnerable

备注： Accepted by CVPR 2026 (Oral)

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have achieved impressive performance, but their safety alignment remains vulnerable to jailbreak attacks. Existing content-based jailbreaks are often inconsistent and show unsatisfying performance against the rapidly evolving MLLMs, failing to exploit non-content-based vulnerabilities. Unlike previous research, we empirically find that MLLMs exhibit a Stylistic Inconsistency between their comprehension ability and safety ability: MLLMs can robustly understand content regardless of visual style, yet their defense mechanisms can be easily bypassed by specific stylistic triggers. Based on this finding, we propose Adversarial Style Optimization (ASO), a plug-and-play enhancement module to amplify existing visual jailbreaks. ASO fine-tunes an image-editing model to superimpose an optimized stylistic modification onto a given adversarial image, using a Group Relative Policy Optimization (GRPO) agent guided by a Structurally-Tiered Reward Function that combines a logit-based signal for detecting explicit refusals with a high-fidelity semantic evaluation from a powerful judge model. Extensive experiments show that ASO significantly enhances the ASR of SOTA attacks, demonstrating that stylistic biases are a scalable vector for red-teaming MLLMs. Our code is available at this https URL.

45. 【2607.21617】Do VLMs Read or Rewrite? On Transcription Faithfulness in Vision-Language Models

链接：https://arxiv.org/abs/2607.21617

作者：Gwang Gook Lee,Kenan Emir Ak,Jay Mohta,Yan Xu,Dimitrios Dimitriadis

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Vision Language Models, Vision Language, traditional OCR pipelines, Language Models, traditional OCR

备注： 15 pages, 6 figures

点击查看摘要

Abstract:Vision Language Models (VLMs) are increasingly used in place of traditional OCR pipelines for document understanding. In this paper, we show they do not always act as faithful transcribers: when text is imperfect, they often tend to rewrite it into a more plausible form - a behavior that clean-text OCR benchmarks cannot detect. We introduce FaithC4, a multilingual perturbation benchmark of 1,455 single-page documents (English, Chinese, Korean) with three perturbation families: scramble, random substitution, and visually similar substitution. We use the benchmark to evaluate 15 systems spanning general-purpose VLMs, OCR-specialized VLMs, and traditional OCR pipelines. These three categories differ in WER degradation under perturbation: general-purpose VLMs degrade by up to 4.5 points, OCR-specialized VLMs by 0.2-2 points, and traditional OCR by less than 0.6 points on English. Probing Qwen3-VL-4B layer-by-layer, we identify a consistent pattern: rewriting fires only when a perturbed word's final layer FFN representation stays close to the original encoding; when the representation diverges sufficiently, the model transcribes faithfully. Word length affects rewriting rate: short words (4-6 characters) are rewritten up to 10% of the time, with a sharp cutoff at 8 characters above which rewriting drops to 0%.

46. 【2607.21613】he Hard Decision Layer: Evidence for Committed Inference in Transformers

链接：https://arxiv.org/abs/2607.21613

作者：Ashwath Vaithinathan Aravindan,Mayank Kejriwal

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：multiple-choice question answering, Hard Decision Layer, question answering, commit to predictions, predictions in multiple-choice

备注：

点击查看摘要

Abstract:We investigate where and how transformer-based language models commit to predictions in multiple-choice question answering. We identify the _Hard Decision Layer_ (HDL), a natural architectural property where answer option rankings stabilize abruptly during inference. Empirical validation across four language models (Qwen, Llama, Granite, Mistral) and four benchmark datasets demonstrates consistent HDL emergence without learned routing policies. We also show that the HDL is invariant to fine-tuning. Our results reveal striking accuracy improvements at the HDL: up to +0.61 (Qwen on CommonsenseQA), after which performance stabilizes. Systematic ablations on label formats and problem complexity confirm the phenomenon is fundamental to model architecture. These findings offer mechanistic insights into transformer inference and suggest opportunities for efficient reasoning and model steering. All code and results required to reproduce this work are available in this https URL

47. 【2607.21608】From Obligation to Specification: A Survey on Validating EU AI Act Requirements in RE

链接：https://arxiv.org/abs/2607.21608

作者：T.Y. Emmy Lai,Sven Giesselbach,Matthias Koch,Héctor Allende-Cid

类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：risk management, entering into force, developing or operating, operating AI systems, systems face

备注：

点击查看摘要

Abstract:With the EU AI Act entering into force, organizations developing or operating AI systems face new obligations on transparency, risk management, and traceability. For Requirements Engineering (RE), these obligations must be translated into testable, auditable requirements and verifiable evidence. However, many organizations currently lack systematic processes to achieve this. We hypothesize that LLM-based agentic validation tools can support this translation, thereby helping to close this gap. We present a mixed-method exploratory study with expert interviews (N=10) and an online survey (N=15) to assess organizational preparedness for EU AI Act-oriented RE and perceptions of LLM-based, agentic closed-loop validation tools, with participants spanning RE, data science, development, and compliance roles. Our results show that, although the EU AI Act is viewed as highly relevant, structured mechanisms to capture regulatory obligations, propagate updates into projects, and maintain lifecycle-wide traceability and evidence are often missing. Participants see LLM-based tools as promising for mapping obligations to requirements, assessing coverage, and organizing evidence, but express strong concerns about full automation and stress the need for safeguards. Based on these findings, we outline minimum requirements for an EU AI Act-ready closed-loop approach.

信息检索

1. 【2607.22518】PinEqualizer: Full Funnel Content Exploration and Debiasing System at Pinterest

链接：https://arxiv.org/abs/2607.22518

作者：Olafur Gudmundsson,Bo Zhao,Huayi Liao,Anna Kiyantseva,Sai Xiao,Heath Vinicombe,Mostafa Keikha,Luke DeLuccia,Zihao Chen,Junpeng Hou,Weijie Jiang,Bhawna Juneja,Andreanne Lemay,Wei-Ting Lin,Keyvan Moghadam,Jiaxing Qu,Zhiqing Rao,Zhihua Zhang

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：content cold-start problem, cold-start problem, problem in industry-scale, industry-scale search, search and recommender

备注： 10 pages, 2 figures. Accepted at KDD 2026

点击查看摘要

Abstract:In this paper, we propose a new solution for addressing the content cold-start problem in industry-scale search and recommender systems. Compared to prior approaches, we have made the following new contributions: 1) our solution spans the entire multi-stage funnel and generalizes well for both search and recommendation surfaces, 2) our solution reduces bias favoring existing content, allowing more accurate model prediction across content types and reducing short-term tradeoffs associated with high volumes of explicit content exploration, 3) our solution is evaluated with a scalable measurement framework that enables fast short-term experimentation while validating long-term impact. We have iteratively built and successfully deployed this new system at Pinterest in the past two years and observed significant improvements in fresh content exploration, overall user engagement, and content ecosystem health.

2. 【2607.22479】Legal Nugget Extraction for Granular Retrieval over Long Jurisprudential Texts

链接：https://arxiv.org/abs/2607.22479

作者：Lucas Pereira,Erick Brito,Roberto Lotufo,Jayr Pereira

类目：Information Retrieval (cs.IR)

关键词：relevant legal thesis, Brazilian legal collections, decisions are long, Legal, challenging because court

备注：

点击查看摘要

Abstract:Legal retrieval over jurisprudential collections is challenging because court decisions are long, heterogeneous documents whose relevant legal thesis may occupy only a small portion of the text. This paper asks whether legal nuggets, defined as short and self-contained legal theses extracted from source documents, can improve dense retrieval over Brazilian legal collections. We propose a pipeline that extracts nuggets from each document, indexes them with embeddings, retrieves nugget-level evidence, and aggregates the retrieved nuggets back to document-level rankings. We evaluate this approach on four Portuguese legal retrieval benchmarks from the JUA ecosystem, reporting NDCG@10, MAP@10, and MRR@10. Nugget retrieval substantially improves the two jurisprudential datasets: on JUA-Juris, NDCG@10 increases from 0.10265 to 0.20461, and on JurisTCU from 0.20898 to 0.32696. However, it underperforms full-document retrieval on NormasTCU and BR-TaxQA, and an embedding-model ablation shows that strong domain-adapted retrievers can remain better in the full-document setting. The results demonstrate that legal nuggets can be useful for jurisprudence search, especially when queries are formulated as legal theses, but they may not transfer equally well to other legal retrieval scenarios.

3. 【2607.22413】Reflector: Arrangement-Aware Harmonic Retrieval for Sample-Based Composition

链接：https://arxiv.org/abs/2607.22413

作者：Austin Rockman

类目：ound (cs.SD); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：find harmonically compatible, composers find harmonically, harmonic context shifts, harmonically compatible material, Sample retrieval tools

备注： 15 pages, 7 figures, 1 table, code, application, and other resources at [this https URL](https://github.com/austinrockman/reflector)

点击查看摘要

Abstract:Sample retrieval tools can help composers find harmonically compatible material, but querying from a fixed reference sample becomes less informative as arrangements evolve and the harmonic context shifts with each musical decision. We present Reflector, an interactive audio workstation that tracks harmonic combinations as they accumulate on the composer's timeline and adapts retrieval as the arrangement develops. The system is organized around a fixed interval-class oracle: a hand-designed table of weights that scores how pitch-class content combines between sources. An encoder trained entirely on synthetic audio learns to approximate the oracle in a 128-dimensional embedding space, where dot products stand in for compatibility scores at interactive speed. As the composer arranges material on a multi-track timeline, a sweep-line analysis discovers co-sounding regions, computes oracle-weighted centroids, and retrieves against the composite harmonic identity of the session as it evolves. Session centroids projected into a navigable 3-D space reveal structural harmonic relations across the composer's body of work. This paper is a systems account: we give the design rationale for each architectural decision, characterize Reflector's behavior through intrinsic measurements on a working sample library, and describe the implementation. The characterization yields a central finding: the learned embedding preserves the kernel's pairwise judgments while covering the whole library, something the kernel cannot do when used directly as a retrieval rule, because the embedding's normalized geometry cannot express the degenerate solutions that direct scoring favors. The entire pipeline runs locally with no copyrighted training data. Reflector is free, and the training pipeline is open source.

4. 【2607.22392】he Prompt Is Not the Query: How Request State Evolves Across Multi-Turn AI Conversations

链接：https://arxiv.org/abs/2607.22392

作者：Benjamin Tannenbaum

类目：Information Retrieval (cs.IR)

关键词：AI-search evaluation commonly, evaluation commonly treats, final prompt, AI-search evaluation, replayed in isolation

备注：

点击查看摘要

Abstract:AI-search evaluation commonly treats a prompt as a stable query that can be counted, classified, and replayed in isolation. A conversation makes that unit of analysis questionable: each user turn can add a constraint, revise an assumption, request evidence, or refer to alternatives established earlier. We replace latent "intent" with an observable construct, conversation-conditioned request state, and measure how that state is distributed across user turns. The analysis reuses frozen rules and the governed cohort of a preceding conversation study: 670 English commercial multi-turn conversations in a discovery-replication design and 7,463 public PRISM conversations from 1,389 participants. In the commercial corpus, the final prompt contains a median 35.6% of the session's unique user-side content vocabulary; in PRISM, the median is 36.4%. The final prompt contains at most half of that vocabulary in 68.4% and 74.3% of conversations, respectively. More importantly, transparent rules detect at least one request-state dimension in history but not in the final prompt in 50.3% of commercial conversations and 44.8% of PRISM conversations. Among dimension-bearing conversations, the final prompt reproduces the full observed dimension set in only 26.1% and 26.2%. At the same time, the final prompt adds a previously unseen dimension in 17.9% and 19.3%, showing that the endpoint is neither a summary nor merely a reference: it is often another state update. Length-matched nulls show that low lexical coverage is largely a consequence of turn length, so vocabulary results are interpreted as information availability, not semantic drift. The categorical results support session-level measurement for AI search. They do not estimate the causal effect of history on model answers.

5. 【2607.22341】Bringing GRACE to Recommendation: Fine-Tuning for Sustainable and Accurate Personalization

链接：https://arxiv.org/abs/2607.22341

作者：Yibowen Zhao,Yinan Zhang,Ning Liu,Lizhen Cui,Chunyan Miao

类目：Information Retrieval (cs.IR)

关键词：reducing carbon emissions, Growing concern, green recommender systems, reducing carbon, healthier choices

备注：

点击查看摘要

Abstract:Growing concern about environmental sustainability (e.g., reducing carbon emissions and resource use) and public health has motivated ``green'' recommender systems that steer users toward more eco-friendly and healthier choices. However, many existing green recommendation approaches require training new models from scratch, incurring substantial computational and energy costs. Reranking-based methods, meanwhile, introduce an additional sorting stage at inference, increasing latency and computational cost. In this work, we propose GRACE (Green Recommendation via Adaptive Conflict-rEsolution), a fine-tuning framework that integrates item-level sustainability signals (e.g., eco-scores or health indices) into pretrained recommendation models. Since these green values are usually discrete and non-differentiable, existing methods often rely on pairwise comparisons to promote greener items. GRACE instead introduces a differentiable approximation that enables direct optimization of the green criterion. To balance sustainability and personalization quality, GRACE further employs a gradient projection mechanism to mitigate conflicts between the green objective and the accuracy objective during fine-tuning. Experiments on real-world datasets demonstrate that GRACE improves sustainability-oriented recommendation outcomes while generally preserving recommendation accuracy through a controllable preference-anchored update mechanism.

6. 【2607.22042】LAMAR: An Open Language-Aware Multilingual Alignment Reranker

链接：https://arxiv.org/abs/2607.22042

作者：Seongtae Hong,Youngjoon Jang,Jungseob Lee,Seungyoon Lee,Heuiseok Lim

类目：Information Retrieval (cs.IR)

关键词：retrieve relevant documents, documents written, language, LAMAR, retrieval augmented generation

备注： preprint

点击查看摘要

Abstract:In multilingual retrieval augmented generation, a retriever can retrieve relevant documents written in multiple languages, which are subsequently reranked before answer generation. However, it remains unclear whether existing multilingual rerankers consider document language when ordering semantically relevant candidates. Our analysis shows that these rerankers do not consistently prioritize documents written in the same language as the query when semantically equivalent documents are available across languages, even though document language can affect answer generation. We release LAMAR, a language aware multilingual cross encoder trained to account for both semantic relevance and language coherence. LAMAR first uses English anchored relevance distillation to establish consistent relevance scoring across multilingual inputs and then applies preference alignment for language coherence to encourage documents written in the same language as the query to receive higher rankings while retaining semantic relevance. In a controlled experiment designed to assess language coherence, LAMAR achieves the best performance overall and across all languages examined individually. LAMAR also remains competitive on established multilingual reranking benchmarks. In practical retrieval settings, LAMAR achieves the best results across all reported metrics when reranking candidates retrieved in the first stage. These results demonstrate that LAMAR accounts for language coherence while achieving strong performance on general multilingual reranking benchmarks.

7. 【2607.21951】SIREN (Luring LLMs onto the Rocks): PAIR-Driven Preference Manipulation in Web-RAG Recommenders

链接：https://arxiv.org/abs/2607.21951

作者：Evan Caville,Siamak Layeghy,Billy Sung,Sara Dolnicar,Marius Portmann

类目：Information Retrieval (cs.IR); Cryptography and Security (cs.CR)

关键词：web-augmented large language, ranked recommendations produced, large language models, paper investigates, investigates the adversarial

备注：

点击查看摘要

Abstract:This paper investigates the adversarial manipulation of the ranked recommendations produced by web-augmented large language models (LLMs). When an LLM answers a recommendation query by retrieving and reading live webpages, it acts as a recommender, and each retrieved page becomes a potential attack surface. Prior work has examined fabricated products, retrieval poisoning, and rank promotion. However, these studies do not compare how different edits to an already retrieved page change the model's final ranking while the surrounding source set remains unchanged. To address this gap, we propose SIREN, an automated attacker--judge method that adapts the PAIR jailbreaking loop to competitive rank manipulation, with the goal of moving a chosen entity to rank~1 in an LLM-generated recommendation. SIREN retrieves and captures webpages using Anthropic's web tools, then iteratively edits a retrieved source using an interpretable taxonomy of 23 content-poisoning techniques. The custom-RAG replay platform keeps the same sources in the same order, so changes in the model's ranking can be linked to changes in the supplied content rather than to differences in retrieval. Across two production Claude models, SIREN reaches rank~1 in 62 of 124 technique trials nested within eight query--model contexts. The payloads that reached rank~1 were then tested in fresh sessions, where they reproduced the result with a mean success rate of 0.805. Across the evaluated settings, declarative ranking claims and seeded lists were generally more effective than directive-form injections, although the strength of this difference depended on the target model. To the best of our knowledge, this is among the first controlled studies of competitive rank manipulation in production LLMs where the supplied source context is kept fixed.

8. 【2607.21802】StARS: Socially Appropriate Robot Actions via a Recommender System-Driven Approach

链接：https://arxiv.org/abs/2607.21802

作者：Erencem Ozbey,Fethiye Irmak Dogan,Jin Huang,Hatice Gunes

类目：Robotics (cs.RO); Information Retrieval (cs.IR)

关键词：Social appropriateness, robot action differently, candidate robot actions, human-robot interaction, people can judge

备注： IROS 2026

点击查看摘要

Abstract:Social appropriateness in human-robot interaction (HRI) is not universal: different people can judge the same robot action differently in the same situation. To capture this inter-subject variability, we reformulate socially appropriate action generation as a preference modelling problem inspired by recommender systems, treating annotators as users, contexts/scenes as items, and appropriateness scores over a set of candidate robot actions as targets. We propose StARS, a novel model-agnostic framework that integrates collaborative filtering with learnable scene representations to generate user-specific appropriateness scores over candidate robot actions. StARS is model-agnostic: it can be integrated with various scene encoders and backbones, enabling personalisation without redesigning the underlying model. We evaluate StARS on two socially aware robotics datasets, MannersDB+ and SocNav1, and analyse robustness under sparse preference feedback. Across datasets and backbones, StARS consistently improves performance and agreement with annotators, supporting personalised action selection aligned with user norms. Our code is publicly available at this https URL.

计算机视觉

1. 【2607.22535】Robot-Factored World Models via Robot Rendering

链接：https://arxiv.org/abs/2607.22535

作者：Byungjun Kim,Taeksoo Kim,Hyunsoo Cha,Hanbyul Joo

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Action-conditioned video world, robot, Action-conditioned video, predict future observations, future observations

备注： Project Page: [this https URL](https://bjkim95.github.io/rofacto/)

点击查看摘要

Abstract:Action-conditioned video world models predict future observations from an initial observation and an action signal. In robotics, actions influence future observations through two distinct processes: they are first realized into robot motion by the robot body and controller, and the scene then responds through contact and object motion. Conditioning directly on action commands asks the world model to learn the realization process itself, while conditioning on logged future states leaks the interaction outcomes it is meant to predict. We propose robot-factored world models, which move two robot-specific factors outside the world model. First, action realization: each command is rolled through the robot's own controller and kinematics into a deployment-available nominal trajectory, a middle signal that avoids both action-realization learning and future-state leakage. Second, robot rendering: this nominal trajectory is rendered through the robot URDF, factoring the robot's geometry, kinematics, and appearance out of the model and into explicit rendered robot geometry. To resolve depth ambiguity, we pair end-effector depth with scene depth, giving geometric cues for contact and occlusion beyond image-plane overlap. Together, camera-aware static RGB/depth context and rendered robot geometry form a shared visual world-model interface that stays consistent across viewpoints and robot embodiments, so the model sees the action only as visible robot geometry and learns how objects respond to it. Our experiments show that the rendered interface outperforms vector-conditioned baselines and generalizes to unseen robot embodiments at inference. We further demonstrate that our model generates robot manipulation videos from human demonstrations by retargeting and rendering the hand motion as robot geometry.

2. 【2607.22534】SM4RT: Learning Structured Motion Geometry for 4D Reconstruction

链接：https://arxiv.org/abs/2607.22534

作者：Shing Ho J. Lin,Wenzhao Zheng,Dong Zhuo,Yuqi Wu,Jie Zhou,Jiwen Lu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)

关键词：Geometry Foundation Models, Foundation Models, Geometry Foundation, dynamic understanding remains, motion

备注： Code is available at: [this https URL](https://github.com/wzzheng/SM4RT)

点击查看摘要

Abstract:Geometry Foundation Models (GFMs) have substantially advanced monocular 3D reconstruction, yet extending this capability to 4D dynamic understanding remains a fundamental challenge. Most existing motion perception methods (e.g., sparse tracking, dense point-wise flow) treat motion as independent point-wise displacements, ignoring the structured nature of physical motion. However, real-world objects usually obey rigid-body kinematics, and points thus usually move collectively, not in isolation. Motion itself possesses geometric structure: physical objects undergo a set of rigid-body transformations governed by SE(3), rather than unstructured point-wise displacements. Building on this insight, we propose SM4RT, a Structured Motion 4D Reconstruction Transformer for end-to-end 3D reconstruction and structured motion perception. SM4RT introduces Structure-of-Motion to represent scene dynamics, where scene motion is decomposed into a compact set of motion bases, each represented as a temporal sequence of 6D twists in SE(3). Dense scene motion is then recovered by sparse, time-shared per-pixel assignment weights over these bases, ensuring points on the same object share a common rigid-body motion trajectory. SM4RT introduces a parallel motion geometry encoder and decoder that jointly infer 3D geometry, world-coordinate motion, and scene kinematic structure in a single forward pass from monocular RGB video. SM4RT achieves strong motion reconstruction performance while preserving the geometric structure of scene motion.

3. 【2607.22531】wins: Learn to Predict Unified Representations with Focal Loss

链接：https://arxiv.org/abs/2607.22531

作者：Kaixiong Gong,Xin Cai,Bin Lin,Hao Wang,Yunlong Lin,Mingzhe Zheng,Bohao Li,Jian-Wei Zhang,Miles Yang,Zhao Zhong,Liefeng Bo,Xiangyu Yue

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：shared visual token, visual token space, image generation, VAE, unified continuous token

备注： ICML 2026. Code: [this https URL](https://github.com/Tencent-Hunyuan/Twins)

点击查看摘要

Abstract:Unified multimodal models seek a shared visual token space that supports both multimodal understanding and image generation. Discrete methods unify the interface via a shared codebook, whereas continuous pipelines often rely on two disparate representations -- semantic features (e.g., ViT) for understanding and low-level latents (e.g., VAE) for synthesis -- resulting in mismatched latent spaces. We propose Twins, a unified continuous token space formed by channel-wise concatenating ViT and VAE features on the same token grid, so the sequence length is unchanged and attention cost does not increase. However, jointly modeling Twins in a Diffusion Transformer exposes a severe optimization imbalance: the model fits the ViT component well but struggles to match the VAE latent distribution. We trace this imbalance to three sources of heterogeneity: frequency bias, intrinsic dimensionality, and condition-aligned vs condition-independent uncertainty. To address it, we adapt a focal regression objective for flow matching that upweights large-error VAE dimensions, better balancing optimization across the ViT and VAE components. On ImageNet, this yields up to 10.57 gFID gain over naive MSE loss without classifier-free guidance. Twins also performs competitively on multimodal understanding benchmarks and improves reconstruction fidelity, narrowing the gap between understanding- and generation-oriented representations.

4. 【2607.22494】CARA: Concept-Aware Risk Attention for Interpretable Collision Anticipation

链接：https://arxiv.org/abs/2607.22494

作者：Zhishan Tao,Ruoyu Wang,Yucheng Wu,Enjun Du,Yilei Yuan,Sherwin Ho,Yue Su,Jinbo Su,Yi Hong

类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

关键词：autonomous driving requires, accurate early warnings, accurate early, Collision anticipation, risk

备注： Accepted to ACM Multimedia 2026(Oral)

点击查看摘要

Abstract:Collision anticipation in autonomous driving requires not only accurate early warnings but also interpretable reasoning about what risk factors are being tracked and how risk evolves over time. Existing methods fall short in this regard: feature-driven models are opaque, post-hoc explanations often lack fidelity, and concept-based methods are mostly designed for static recognition rather than dynamic driving scenes. We propose CARA (Concept-Aware Risk Attention), an intrinsically interpretable spatio-temporal framework for collision anticipation. CARA derives domain-grounded risk concepts from accident narratives, aligns them with video frames via vision-language similarity, and organizes them into evolving concept trajectories. These trajectories provide explicit risk evidence that guides spatial attention, temporal attention, and anticipation, allowing semantic concepts to directly influence both where the model attends and how it predicts risk over time. By treating semantic risk factors as dynamic intermediate evidence rather than auxiliary post-hoc explanations, CARA tightly couples interpretability with the predictive process. Extensive experiments on three benchmarks show that CARA consistently improves anticipation accuracy and warning earliness over strong baselines, while providing sparse and semantically grounded concept evidence.

5. 【2607.22486】Optimal Transport Image Representation and Deep Covariance Alignment (CORAL) for Control Valve Stiction Detection

链接：https://arxiv.org/abs/2607.22486

作者：Seshu K. Damarla

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：poor control-loop performance, Deep CORAL, unwanted oscillations, oscillations and poor, poor control-loop

备注： 7 pages, 6 figures, 6 tables

点击查看摘要

Abstract:Control valve stiction is a common cause of unwanted oscillations and poor control-loop performance in industrial processes. Data-driven methods can automatically detect stiction, but models trained purely on simulated data often struggle to generalize to real industrial control loops due to domain shift. To bridge this gap, this work propose a novel stiction detection methodology that combines optimal transport (OT) imaging technique with deep correlation alignment (Deep CORAL) algorithm. Closed loop signals: controller output and process variable are converted into two-dimensional OT images. These images capture the dynamic behaviour of control loops. The proposed methodology includes a convolutional neural network (CNN) encoder (or feature extractor) trained to learn domain-invariant representations by optimizing a combined objective: a cross-entropy loss on labeled simulation data and a Deep CORAL (covariance-alignment) loss between simulation data and unlabeled target-domain industrial data. Downstream classifiers trained on the domain-invariant target features were evaluated on an independent test set of 20 benchmark loops from industrial stiction data benchmark. The proposed methodology successfully diagnosed 18 out of the 20 loops and achieved100% recall across all 13 stiction cases, an accuracy of 90.00% and an F1-score of 92.86%. Compared to standard baseline approach (hand-crafted features-based method), the proposed methodology significantly mitigates domain shift, providing robust, highly reliable stiction detection for real-world industrial control loops.

6. 【2607.22446】Deformable Triangle Splatting: Flexible Primitives for Real-Time Radiance Field Rendering

链接：https://arxiv.org/abs/2607.22446

作者：Oriol Jiménez-Ayguadé,Antonio Agudo

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：radiance field methods, field methods represent, offer surface alignment, concave structures demand, structures demand excessive

备注： Accepted at ECCV 2026. Project page: [this https URL](https://orioljim1.github.io/detris)

点击查看摘要

Abstract:Recent radiance field methods represent scenes with 2D primitives that offer surface alignment and efficient rasterization, from Gaussian disks to triangles, yet all rely on convex boundaries: curved and concave structures demand excessive primitives. We introduce Deformable Triangle Splatting, which augments each triangle with $K$ control points per edge, each parameterized by a single learnable scalar displacement that shifts the boundary inward or outward, enabling non-convex shape representation while preserving the three base vertices that define the 3D plane. To render these non-convex primitives differentiably, we design a rasterization pipeline in the triangle's barycentric coordinate space, ensuring view-consistent rendering. A winding number test determines whether each pixel lies inside the deformed primitive, and a window function controlled by two learnable parameters, sharpness and corner smoothness, together with a per-primitive scalar opacity, produces the smooth opacity transition from interior to boundary. Validation is done in a variety of real-world scenes, outperforming recent works based on non-volumetric primitives in terms of visual quality and versatility while still achieving competitive rendering efficiency.

7. 【2607.22393】SceneActBench: Can Agents Act on the 3D Scenes They See?

链接：https://arxiv.org/abs/2607.22393

作者：Yifei Zhao,Xiangxin Zhou,Wenhao Yang,Jiaqi Tang,Pu Jian,Huanjin Yao,Jiarui Yao,Haowei Lin,Chunchao Guo,Zhuo Chen,Wenkai Lyu,Jianzhu Ma,Xueqian Wang,Wenxi Zhu

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Vision-language model, increasingly use tools, Vision-language, agents increasingly, scenes

备注：

点击查看摘要

Abstract:Vision-language model (VLM) agents increasingly use tools to act on 3D scenes rather than only describe them. Existing 3D benchmarks score textual responses or single-object operations, leaving agent action on complete multi-object 3D scenes under evaluated. We present SceneActBench, a benchmark for visually conditioned action across five 3D tasks under a unified agent-environment loop. Given PNG images or sampled video frames and, where applicable, supplied 3D assets, an agent acts on a 3D environment. We evaluate each final output against hidden ground truth with task-specific geometric metrics. SceneActBench comprises five tasks built from 210 source instances, yielding 520 task cases including paired input conditions. Every task runs through one fixed agent loop to keep the comparison fair. Across eleven proprietary VLM configurations, Overall scores span 38.6-50.2, and none performs consistently well across tasks. We further analyse where and how failures manifest.

8. 【2607.22386】Correlation-Aware and Gaussianity-Preserving Robust Latent Angular Watermarking for Diffusion Models

链接：https://arxiv.org/abs/2607.22386

作者：Yebin Zheng,Haonan An,Guang Hua,Zhiping Lin,Yuguang Fang

类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

关键词：diffusion models embeds, models embeds watermarks, embeds watermarks directly, Latent domain watermarking, diffusion models

备注：

点击查看摘要

Abstract:Latent domain watermarking for diffusion models embeds watermarks directly into the latent prior, enjoying non-intrusiveness to model parameters and seamless integration with the generation process. However, due to the violation of latent Gaussianity or sensitivity to normal and malicious perturbations during latent inversion, existing methods are prone to watermark detection or removal attacks. A further overlooked problem is the violation of the i.i.d. latent condition after watermarking, which leads to latent correlation degradation and generation fidelity loss. Although this has been externally measured by FID, the internal correlation structure has yet to be rigorously characterized. To address the above issues, and motivated by the rotation-invariant property of isotropic Gaussian, we propose \textit{Latent Angular Watermarking (LAW)}, which encodes watermark bits as antipodal angles ($\pm\pi/2$ relative to a reference pair) between disjoint pairs of latent elements while preserving the Gaussianity. The antipodal ($\pi$-separation) encoding maximizes geometric separation between bit values, and we prove that the decoding angular-error variance is proportional to the norm of the latent pair, i.e., $\operatorname{var}(\Delta\phi) \propto 1/\rho^2$. We further propose a magnitude-driven variant, LAW-M, which anchors watermark bits in the most geometrically stable latent dimensions, yielding additional robustness gains. Theoretically, we provide a rigorous characterization of the induced correlation degradation, deriving in closed form the autocorrelation structure of the watermarked latent and proving that correlations are confined to a sparse, structured set of off-diagonal elements with fixed $\pm\pi/4$ values.

9. 【2607.22380】IR275K: A Benchmark for Infrared Multi-Frame Super-Resolution Toward Efficient Remote Sensing

链接：https://arxiv.org/abs/2607.22380

作者：Jie Deng,Heyang Wang,Changxin Wang,Junkai Shen,Hongyi Chen,Zhiping He,Hongxing Qi,Xudong Zhang,Jianyu Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：constrained detector resolution, satellite constellations produce, constellations produce large, produce large volumes, Efficient processing

备注：

点击查看摘要

Abstract:Efficient processing is becoming increasingly important in infrared remote sensing, where satellite constellations produce large volumes of observations under constrained detector resolution, power, and downlink bandwidth. Multi-frame super-resolution (MFSR) offers a software-based route to spatial enhancement, but its evaluation in infrared sensing remains fragmented across private datasets and ad-hoc protocols. Existing benchmarks do not explicitly capture the thermal contrast, sensor noise, weak texture, and platform-induced frame-to-frame variation that characterize infrared video. We introduce IR275K, a curated benchmark containing 594 infrared video sequences and 275,196 frames. It provides sequence-level train/validation/test splits and a reproducible X4 evaluation protocol. As an initial architectural probe, we further evaluate CGMamba, a lightweight state-space model with 10.90M parameters and 112.14G FLOPs. CGMamba combines 2D rotary position encoding (2D~RoPE) with center-guided cross-Mamba (CGCM) fusion for implicit multi-frame reconstruction. It achieves 33.19dB PSNR, outperforming infrared single-image super-resolution references by 0.35--0.52~dB at substantially lower computational cost. Ablation results show that removing 2D~RoPE from CGCM causes a 1.53dB drop and severe grid-like artifacts. This indicates that explicit spatial anchoring is critical for stabilizing SSM-based cross-frame gating under infrared conditions. IR275K provides a reproducible foundation for accuracy--efficiency evaluation of infrared MFSR methods, while the architectural analysis offers a concrete starting point for spatially aware SSM design under resource-constrained infrared sensing. Dataset and evaluation resources are available at: this https URL.

10. 【2607.22371】Active few-shot segmentation by reinforcing data selection

链接：https://arxiv.org/abs/2607.22371

作者：Chenlan Zhao,Benny Wong,Timothy F. Lundberg,Ahmed M. Elsayed,Abdallah Aljarkas,Hamad A. Aljamaan,Lynn Karam,Qianye Yang,Yipeng Hu,Claire C. Villette,Shaheer U. Saeed

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：models to adapt, small number, number of labelled, Few-shot learning enables, enables medical image

备注： Accepted at EMA4MICCAI 2026 - The 2nd MICCAI Workshop on Efficient Medical AI

点击查看摘要

Abstract:Few-shot learning enables medical image segmentation models to adapt to new tasks using only a small number of labelled examples. However, adaptation performance depends strongly on which examples are selected for the support set. Effective support sets should capture relevant variation within the target domain and be informative for adaptation, with constituent samples providing complementary information. Despite this, existing active data selection approaches largely prioritise samples individually and do not explicitly account for interactions between examples. In this work, we propose a reinforcement learning framework for support-set selection in few-shot medical image segmentation, enabling support sets to be optimised jointly rather than through independent sample scoring. Given a pool of unlabelled candidate images, an agent directly predicts a support set that maximises downstream segmentation performance. Experiments on a cross-institutional pelvic MRI dataset demonstrate improvements over random selection and current state-of-the-art methods. Our findings highlight the importance of support-set complementarity for effective adaptation and demonstrate the potential of reinforcement learning for optimising adaptation sets.

11. 【2607.22355】SiPhy: Single-Image Physical Property Reasoning

链接：https://arxiv.org/abs/2607.22355

作者：Hoang Le,Joonwoo Kwon,Elkhan Ismayilzada,Yufei Zhang,Zijun Cui

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Inferring physical properties, existing approaches rely, Inferring physical, physics-based supervision, essential for simulation

备注： Accepted to ECCV 2026 (main track)

点击查看摘要

Abstract:Inferring physical properties such as mass, stiffness, and elasticity from a single image is essential for simulation and embodied AI, yet most existing approaches rely on multi-view reconstruction or physics-based supervision. We introduce SiPhy, a unified framework for single-image physical property reasoning that aligns 3D-aware visual cues, depth with language-based material knowledge. From one RGB image, SiPhy samples pseudo-voxel points, extracts CLIP features, and grounds them to material candidates proposed by a VLM. A part-based contrastive aggregator enforces region consistency, while a heaviness-aware refinement improves thickness and volume estimation for dense objects. Across ABO-500, MVImgNet-100, and PhysXNet-100, SiPhy achieves state-of-the-art single-image performance, surpassing multi-view reconstruction methods by improving mass MnRE by up to 93% (vs. PUGS), reducing density MAE by 35.5% (vs. NeRF2Physics), and lowering Young's modulus error by 23.5%. We further validate SiPhy on real hand-object interaction datasets, demonstrating its potential as a data annotation engine for physical understanding from single-view imagery.

12. 【2607.22352】me-Reversed Imaging: A Multimodal Benchmark and Framework for Reconstructing Past Human-Environment Interactions

链接：https://arxiv.org/abs/2607.22352

作者：Jorge Bacca,Kebin Contreras,Luis Toscano-Palomino,Mauro Dalla Mura

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)

关键词：introduce time-reversed imaging, time-reversed imaging, introduce time-reversed, infer past human-environment, imaging

备注：

点击查看摘要

Abstract:We introduce time-reversed imaging, a new paradigm that infers what just happened in a scene from fading multimodal traces. Instead of extrapolating or interpolating video frames, our goal is to infer past human-environment interactions from residual physical imprints observable in thermal, ultraviolet, and visible spectra. To study this problem, we present TRACE-HEI, the first proof-of-concept dataset for time-reversed imaging, containing synchronized tri-modal video sequences of actions such as sitting, touching, moving objects, and liquid spills, captured across diverse materials and recorded up to three minutes after contact. To establish the benchmark, we propose a multimodal inference approach that extracts structured textual descriptions of detected traces and uses them to constrain a vision-language-guided diffusion model for reconstructing plausible past frames. Experiments show that inferring recent events from fading traces is challenging but feasible when complementary modalities reduce solution ambiguity. This work defines the first computational and experimental foundation for time-reversed imaging, bridging vision, physics, and generative reasoning, and opening new directions for scene understanding beyond instantaneous observation.

13. 【2607.22332】SLIP: Segmentation with Low-latency Interactive Prompting for 3D Medical Images

链接：https://arxiv.org/abs/2607.22332

作者：Baptiste Podvin,Alexandre Ancel,Flavio Milana,Chiara Innocenzi,Davide Arrigo,Federico Espinola Schulze,Guido Torzilli,Jacques Marescaux,Daniel George,Alexandre Hostettler,Toby Collins

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：iteratively refining predictions, negative clicks, iteratively refining, positive and negative, image

备注：

点击查看摘要

Abstract:Interactive deep image segmentation enables efficient medical image annotation by iteratively refining predictions from user prompts, such as positive and negative clicks. Recent patch-based methods, including nnInteractive, achieve strong segmentation performance but remain limited in annotation workflows by high interaction latency, limited responsiveness to successive interactions, and the lack of support for reversible prompting. Furthermore, evaluation relies predominantly on simulated rather than controlled real-user interaction studies. We present SLIP, an end-to-end trainable framework for interactive 3D medical image segmentation that decouples image encoding from prompt-guided refinement. Image features are computed once and reused, while a lightweight patch memory bank maintains an interaction-aware segmentation state shared across patches. This representation enables prediction updates by propagating interaction context throughout the image, supports reversible prompting without recomputing image features, and substantially reduces interaction latency. By separating image representation from interactive reasoning, SLIP remains compatible with a wide range of image encoders. We train a single SLIP model for general interactive segmentation across diverse anatomical structures and imaging modalities. Beyond standard simulated evaluation, we conduct a controlled prospective user study comparing manual segmentation, nnInteractive, and SLIP across three clinical annotation tasks, six expert participants, and subjective usability measures, addressing the limited human validation of interactive segmentation methods. SLIP achieves SOTA interactive segmentation performance across 13 public datasets while providing lower interaction latency, greater responsiveness, support for reversible prompting, and higher user preference than existing approaches.

14. 【2607.22325】Geometric 2D Scene Graph Generation

链接：https://arxiv.org/abs/2607.22325

作者：Christoph Jahn,Urs Waldmann,Bastian Goldluecke

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：production process, consumer products, processes for consumer, instructions are essential, assembly instructions

备注： Accepted at the 18th International Conference on Agents and Artificial Intelligence ICAART 2026, Marbella, Spain

点击查看摘要

Abstract:In production processes for consumer products, assembly instructions are essential not only for planning but also for executing the production process. Likewise in robotics, it is crucial for an assembly robot to understand how components fit together and can be assembled. To facilitate these tasks, we contribute a method for constructing scene graphs to represent and characterize assembly relationships between components. Our approach does not rely on semantic data and is capable of handling a very small dataset. To realize this, the output of a Faster R-CNN model is used to create geometric representations, which are then processed by a transformer architecture to generate an adjacency matrix. This matrix serves as input to a Siamese network that uses message passing based on an attentional graph convolutional network (aGCN) architecture to characterize the connections between the components. We validate our method on a study dataset of toy model components which can be assembled into transportation vehicles.

15. 【2607.22302】fMRI2Face: A Full-HD fMRI-Video Dataset and Geometry-Guided Neural Decoding Framework for Dynamic Human Face Reconstruction

链接：https://arxiv.org/abs/2607.22302

作者：Jingyang Huo,Xiangru Huang,Chentao Shen,Yikai Wang,Yun Wang,Jianxiong Gao,Shihao Jin,Yanwei Fu,Jianfeng Feng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：mind perceives identity, facial, mind perceives, facial videos, Brain-derived Appearance Context

备注：

点击查看摘要

Abstract:Reconstructing dynamic human faces from brain activity provides a powerful way to study how the mind perceives identity, expression, and facial motion. However, progress in fMRI-based face decoding has been limited by scarce controlled, high-resolution neural datasets and by methods that struggle to recover both identity-specific appearance and time-varying facial dynamics. We present fMRI-Face, the first fMRI dataset paired with controllable full-HD digital human facial videos rendered at 1920$\times$1080 resolution. During scanning, participants watched photorealistic, background-free facial videos with controlled identity, expression, and head pose, while fMRI activity was recorded. The resulting dataset contains 62,856 paired fMRI-video samples, providing a structured resource for studying dynamic face perception and reconstruction. Building on this dataset, we propose fMRI2Face, a geometry-guided neural video decoding framework for reconstructing facial videos from fMRI signals. fMRI2Face derives two complementary neural controls from brain activity: Brain-derived Appearance Context, which captures global identity-related visual attributes, and Morphable 3D Facial Control, which provides explicit geometry-aware guidance for pose, expression, and non-rigid facial dynamics. These controls are integrated through Neural-Controlled Video Diffusion with auxiliary latent completion, enabling high-fidelity facial video reconstruction directly from brain activity. Experiments show that fMRI2Face consistently improves reconstruction fidelity, identity preservation, facial geometry, and motion consistency over representative neural decoding baselines. Together, fMRI-Face and fMRI2Face establish a controlled platform for studying dynamic face perception and provide a new benchmark for fMRI-based digital human reconstruction.

16. 【2607.22293】RadSight: Towards Perceptually Reliable Multimodal Radiology Image Understanding

链接：https://arxiv.org/abs/2607.22293

作者：Jianqin Liu,Weiwei Cao,Wanxing Chang,Ruifeng Yuan,Bowen Shi,Zhilin Zheng,Xianjie Zhang,Ling Zhang,Peng Wang,Jianpeng Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：multimodal large language, perform complex image, Medical multimodal large, large language models, multimodal large

备注：

点击查看摘要

Abstract:Medical multimodal large language models (MLLMs) are increasingly expected to perform complex image understanding tasks, yet their reliability is often compromised by frequent errors in visual interpretation. To systematically trace these failures, we traverse the hierarchy from high-level clinical tasks down to fundamental visual perception. We therefore introduce Perception-Bench, a large-scale benchmark comprising 1.13 million samples that assesses medical MLLMs across six dimensions: attribute judgment, spatial grounding, spatial understanding, disease prediction, anomaly detection, and report generation, spanning both 2D and 3D radiology images. Our analysis on Perception-Bench reveals that existing MLLMs lack the ability to capture even the most basic lesion attributes, such as location, size, and density. This inability to ground clinical outputs in primary visual evidence reveals that the models' diagnostic unreliability is rooted in a critical but overlooked bottleneck in low-level visual perception. Motivated by this, we propose RadSight, a perception-driven MLLM built upon a dual 2D/3D encoder architecture that preserves native imaging spatial structures. RadSight formulates medical image understanding as a four-stage progressive process: visual-language alignment, fine-grained visual perception, clinical diagnosis, and diagnostic interpretation. The model is trained on an 8.37 million perception-oriented corpus using progressive curriculum learning. On Perception-Bench, RadSight consistently outperforms existing MLLMs across all six evaluation dimensions, with particularly strong gains in spatial grounding and clinical diagnosis. It also achieves consistent improvements on public 2D and 3D medical benchmarks, further demonstrating that robust low-level visual perception is a critical foundation for reliable clinical understanding. Code and model will be publicly available.

17. 【2607.22258】Class-Balanced Softmax: A Bayes Theory-Based Method for Long-Tailed Recognition

链接：https://arxiv.org/abs/2607.22258

作者：Yi-Hang Zhu,Rajeev Raman,Shiqi Su,Jianyuan Sun,Xinyu Yang,Nan Xing,Huiyu Zhou

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：Deep learning models, achieved remarkable success, traditional softmax classifiers, Deep learning, classification tasks

备注： 39 pages, 8 figures, under review in a journal

点击查看摘要

Abstract:Deep learning models using traditional softmax classifiers have achieved remarkable success in various classification tasks. However, their performance degrades significantly on imbalanced datasets. Although Balanced Softmax is widely adopted as a state-of-the-art rebalancing method, it possesses inherent limitations, such as yielding disproportionately lower testing accuracy for tail classes. To mitigate these shortcomings, we propose the Class-Balanced Softmax (CBS). Rooted in a theoretical Bayesian framework and a heuristic power-law assumption, the CBS is a simple logit adjustment that is computationally inexpensive and easily integrated into existing pipelines. Furthermore, we characterise a fundamental phenomenon in models trained on imbalanced data, termed the preference issue, wherein models exhibit higher training error and a larger generalisation gap for classes with limited data. To quantify this issue, we introduce a novel metric and demonstrate that CBS effectively mitigates the preference issue. Extensive experiments on large-scale benchmarks show that CBS is highly scalable and outperforms existing methods, including Balanced Softmax.

18. 【2607.22255】From level set evolution to threshold optimization: A grayscale level set framework for image segmentation

链接：https://arxiv.org/abs/2607.22255

作者：Xingkai Li,Jiebao Sun,Fanghui Song,Zhichang Guo

类目：Computer Vision and Pattern Recognition (cs.CV); Mathematical Physics (math-ph)

关键词：length term, multiple degradations, challenging problem, length regularization term, segmentation

备注：

点击查看摘要

Abstract:The segmentation of multiple degradations has been a challenging problem in the field of image segmentation. Existing level set approaches commonly adopt a length regularization term to constrain the geometric shape of the segmentation contour. However, the introduction of the length term often results in numerical instability and high computational cost. In this paper, we show that the length term is not essential under certain smoothness constraints, and theoretically prove that the presence of the length term affects the property of $|\nabla \phi|=1$. Based on the finding, we define a class of smooth images, construct the grayscale level set, and propose a fast segmentation framework for degraded images, such as heavily noisy images and intensity inhomogeneous images. The framework transforms PDE evolution into one-dimensional threshold search, which has significant advantages in computational speed, especially on large-scale images. Experiments validate the segmentation performance of the proposed framework on various degraded images.

19. 【2607.22241】AgentHOI: Multi-Agent Reasoning for Human-Object-Interaction Video Generation via Implicit Representation Alignment

链接：https://arxiv.org/abs/2607.22241

作者：Ziyao Huang,Shunkai Li,Juan Cao,Chenyu Li,Youliang Zhang,Zixiang Zhou,Cong Wang,Yuan Zhou,Qinglin Lu,Fan Tang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent advances, demands fine-grained control, single-subject animation, spurred interest, interest in human-object

备注：

点击查看摘要

Abstract:Recent advances in video diffusion models have spurred interest in human-object interaction (HOI) video generation, which demands fine-grained control over interaction logic beyond single-subject animation. However, existing HOI methods rely heavily on explicit motion control, limiting scalability and generalization across diverse objects and interactions. In this study, we propose AgentHOI, a text-driven HOI video generation following a thinking-before-generation framework that bridges the gap between high-level textual intent and physical execution through multi-agent reasoning over perception, interaction, and motion planning. Building upon the generated interaction plans, we further strengthen text-driven motion understanding. We introduce an implicit text-motion alignment strategy that distills text-to-motion priors into the video diffusion model, enabling robust HOI synthesis without explicit motion inputs at inference. Experiments show that AgentHOI significantly improves interaction naturalness, object appearance preservation, and adherence to complex textual instructions across challenging object-centric scenarios such as wearing and riding. The code is available at this https URL.

20. 【2607.22231】RaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolution

链接：https://arxiv.org/abs/2607.22231

作者：Sicheng Gao,Zhuyun Zhou,Yixuan Liu,Tong Shen,Zongwei Wu,Radu Timofte

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：large-scale Diffusion Transformer, achieves exceptional perceptual, quadratic computational cost, processing dense spatio-temporal, spatio-temporal token sequences

备注： 18 pages, 7 figures

点击查看摘要

Abstract:Video super-resolution (VSR) using large-scale Diffusion Transformer (DiT) priors achieves exceptional perceptual quality but is often impractical due to the quadratic computational cost of processing dense spatio-temporal token sequences. Existing efficiency-oriented methods risk irreversible detail loss and temporal flickering, a vulnerability especially pronounced in one-step diffusion models. To address this, we propose TRaM-VSR, a Token Routing and Merging framework for adaptive token allocation, leveraging both context-aware video priors and network-level priors. First, token importance is estimated by fusing motion-sensitive temporal cues with semantic text similarity, isolating dynamic objects and structural boundaries. Next, this importance is further calibrated and adjusted by an offline planner to guide routing across optimally grouped network blocks. Technically, within each routed group, structurally critical tokens are processed in a high-fidelity local stream, while less informative tokens are aggregated into a compact global stream, both modulated by network depth and aligned with the multigranular nature of diffusion models. Extensive experiments show that TRaM-VSR accelerates inference significantly while preserving state-of-the-art reconstruction quality and robust temporal consistency. The code is available at this https URL.

21. 【2607.22212】Deep Convolutional Large-Margin $\ell_p$-SVDD for Visual Anomaly Detection

链接：https://arxiv.org/abs/2607.22212

作者：Alireza Dastmalchi Saei,Shervin Rahimzadeh Arashloo

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：anomalous training samples, reliable decision boundaries, Visual anomaly detection, requires adaptive representations, detection requires adaptive

备注：

点击查看摘要

Abstract:Visual anomaly detection requires adaptive representations and reliable decision boundaries, particularly when anomalous training samples are scarce and class distributions are highly imbalanced. Classical kernel-based methods yield principled geometric decision regions but typically operate on fixed features, while deep detectors learn task-specific representations but often fail to provide an explicit margin-aware kernel boundary. In this study, we propose DLM-SVDD, a deep large-margin novelty-detection framework that jointly learns convolutional features and an explicit kernel-based decision boundary. By drawing on the large-margin $\ell_p$-Support Vector Data Description ($\ell_p$-SVDD) approach, the proposed method performs explicit margin maximization and nonlinear slack penalization while adapting the representation to the target task. To train the proposed model, we present an optimization scheme that alternates between a Frank--Wolfe--based update of the convex dual boundary and a CNN update step operating on a smooth margin-violation loss induced by the recovered boundary. To improve scalability, we analyze the efficiency--accuracy trade-offs for different kernel approximation strategies, deriving practical propositions for large-scale anomaly detection. Extensive experiments on multiple standard benchmarks show consistent performance improvements over the baseline and strong overall performance compared with state-of-the-art methods while illustrating that the proposed joint representation--boundary learning scheme remains effective under severe imbalanced class distributions.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

Cite as:
arXiv:2607.22212 [cs.CV]

(or
arXiv:2607.22212v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.22212

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

22. 【2607.22205】Filling Before Advancing: Capability-Gap-Driven Post-Training for Scenario-Specialized Remote Sensing MLLMs

链接：https://arxiv.org/abs/2607.22205

作者：Yuheng Zong,Minghua Wang,Xin Zhao,Zhi-Hui Zhan,Antonio Plaza,Jon Atli Benediktsson

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：large language models, multimodal large language, improved general aerial-image, sensing multimodal large, Remote sensing multimodal

备注：

点击查看摘要

Abstract:Remote sensing multimodal large language models (RS-MLLMs) have improved general aerial-image understanding. However, Earth observation applications require fine-grained scenario specialization, constrained by scarce high-quality scenario data and incomplete capability coverage. We formulate this adaptation as a capability-gap-driven post-training problem and propose filling before advancing (FBA). Rather than relying on single-stage supervised fine-tuning (SFT) over target-domain samples, FBA first fills prerequisite capability gaps before advancing toward scenario specialization. We instantiate FBA for coastal harbor understanding, a representative multi-source scenario, by constructing CPRS (Coastal-Port Remote Sensing), a three-layer supervision dataset coupled with three ordered stages: (1) RS semantic anchoring for overhead-view visual-language alignment; (2) domain-bridge convergence for shared RS priors across target and bridging scenarios under different modalities; and (3) evidence-grounded scenario tuning for downstream performance. We construct HarborEval, an eight-track diagnostic benchmark covering perception, spatial understanding, robustness, and generation. Under comparable training budgets, HarborEval increases from 57.95 with Direct-SFT to 70.29 with FBA on LLaVA-v1.5, and from 81.09 to 83.37 on Qwen3-VL. FBA also outperforms Collapsed-SFT and leads on harbor-related VRSBench/RSVQA subsets and OpenEval. Stage-wise and role-replacement analyses validate progressive gap filling and stage-specific roles. Public examples and release updates for CPRS, HarborEval, code, and trained weights are available at this https URL.

23. 【2607.22200】LayoutLite: Token-Level Implicit Layout Analysis for Efficient Document OCR

链接：https://arxiv.org/abs/2607.22200

作者：Xudong Liu,Bicheng Wan,Yulin Jin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieved strong performance, complex document OCR, OCR systems based, based on vision-language, achieved strong

备注： 11 pages, 7 figures

点击查看摘要

Abstract:End-to-end OCR systems based on vision-language models have achieved strong performance in complex document OCR, but their efficiency is limited by the large number of visual tokens produced from document images. Many of these tokens correspond to blank margins or visually redundant regions, yet directly applying generic visual token compression methods may remove OCR-critical fine-grained details. In this paper, we propose LayoutLite, a lightweight plug-and-play module for efficient document OCR. Instead of relying on explicit document layout detection, LayoutLite performs implicit layout analysis at the token level between the vision encoder and the language decoder. It aggregates multi-layer visual representations from the vision encoder, and predicts an importance score for each visual token with a lightweight scoring network. Low-information tokens are then removed before entering the language decoder while preserving the original spatial positional information of retained tokens. To train LayoutLite without human annotations, we cast token selection as a reinforcement learning problem and optimize it with a group-relative policy optimization objective driven by OCR output consistency, together with an auxiliary layout supervision signal to stabilize training. Experiments on OmniDocBench demonstrate that LayoutLite can substantially reduce visual token length and inference cost with negligible degradation in recognition quality. We further evaluate LayoutLite on two OCR-specialized VLMs, FireRed-OCR and Logics-Parsing-V2. Under up to 50% token compression, LayoutLite preserves almost the same score on both models while reducing prefill latency, FLOPs, and KV cache memory by over 40%, with only a small additional inference overhead. These results show that token-level implicit layout analysis is an effective and practical approach for accelerating VLM-based OCR systems.

24. 【2607.22173】Bowel Obstruction Detection and Localization on Abdominal CT with Deep Learning

链接：https://arxiv.org/abs/2607.22173

作者：Moritz Vandenhirtz,Andrea Agostini,Dana Belde,Mélanie Roschewitz,Ismaiel Chikh Bakri,Tilo Niemann,André Euler,Julia E Vogt

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：life-threatening gastrointestinal condition, potentially life-threatening gastrointestinal, Bowel obstruction, gastrointestinal condition, common and potentially

备注：

点击查看摘要

Abstract:Bowel obstruction is a common and potentially life-threatening gastrointestinal condition. In the face of rising diagnostic workloads, the automated diagnosis of bowel obstruction on CT scans supports radiologists by accelerating detection and improving patient outcomes. In this work, we propose a deep learning framework with a multi-task objective that jointly detects bowel obstruction and localizes its transition zone. Additionally, we extend the method with an inherently interpretable classification method that locates the suspected transition point within a slice. It does so by learning a probabilistic selection mask that faithfully bases the classifier's prediction solely on a small image region. The proposed method is evaluated on an internal dataset comprising 1,427 abdominal CTs. Here, the model achieves an obstruction detection test accuracy of 93% and a Hit@10 transition zone localization of 95%. As the first method to reliably localize the transition zone, this marks a significant step towards the automated identification of this critical clinical landmark.

25. 【2607.22172】JustDepth: Real-Time Radar-Camera Depth Estimation with Single-Scan LiDAR Supervision

链接：https://arxiv.org/abs/2607.22172

作者：Wooyung Yun,Dongwook Kim,Soomok Lee

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Accurate yet low-latency, autonomous systems, perception in autonomous, Accurate, radar-camera perception

备注： Project page: [this https URL](https://github.com/TPyun/JustDepth)

点击查看摘要

Abstract:Accurate yet low-latency depth is essential for radar-camera perception in autonomous systems. Cameras provide rich appearance but lack metric scale, whereas automotive radar offers metric range but is sparse and noisy. Many pipelines are multi-stage or depend on auxiliary annotations, increasing latency and limiting portability. We introduce JustDepth, a single-stage radar-camera depth estimator trained only with radar, camera, and single-scan LiDAR. All radar returns are aggregated into a fixed-width 1D representation, decoupling runtime from point count. A Height Fusion Block fuses modalities, a lightweight GNN propagates depth globally, and a training-only confidence decoder stabilizes learning with zero test-time cost. We mitigate stripe artifacts via simple augmentations and quantify them using the Vertical-Horizontal Gradient Ratio (VHGR). On nuScenes, compared to recent state-of-the-art methods, JustDepth maintains accuracy while reducing inference time by 39.7x and stripe artifacts by 66% as measured by VHGR.

26. 【2607.22148】dRAE: Representation Autoencoder with Hyper-Spherical Codes

链接：https://arxiv.org/abs/2607.22148

作者：Tianren Ma,Lin Long,Chuyan Chen,Mu Zhang,Junbo Zhao,Tong Zhang,Qixiang Ye

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：existing quantization methods, quantization methods suffer, high-dimensional visual representations, preserving semantic coherence, language models

备注： Preprint. Project Page: [this https URL](https://drae-hsq.github.io)

点击查看摘要

Abstract:In this work, we aim to discretize the high-dimensional visual representations to bridge the gap with language models - a non-trivial challenge, as existing quantization methods suffer from codebook collapse, failing to scale while preserving semantic coherence. We identify the root cause as metric mismatch: standard Euclidean codebook objectives are fundamentally misaligned with the anisotropic geometry of representation space, leading to codebook embeddings with high-variance magnitude scales and uneven angular distributions that hinder scalability. To address this, we propose Hyper-Spherical Quantization (HSQ), which decouples semantic content from feature magnitude via angular routing, preventing code assignment from being dominated by scale rather than meaning. The resulting discrete Representation Autoencoder (dRAE) achieves high-fidelity reconstruction while preserving semantic integrity and supporting scalable codebook budget. Extensive experiments demonstrate consistent performance gains as the vocabulary size scales to 131{,}072, along with 100\% codebook utilization, simplified training pipeline, and strong performance across understanding and generation tasks.

27. 【2607.22147】Visual Relocalization from Sparse Views in Aliased and Low-Texture Environments via Novel View Synthesis

链接：https://arxiv.org/abs/2607.22147

作者：Maria Peribañez,Javier Civera,Rudolph Triebel,Riccardo Giubilato

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：unconstrained driving directions, weakly overlapping viewpoints, planetary-like terrains characterized, overlapping viewpoints induced, forward rover motion

备注： Accepted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)

点击查看摘要

Abstract:Visual localization becomes extremely challenging in planetary-like terrains characterized by low texture, perceptual aliasing, harsh illumination, and sparse, weakly overlapping viewpoints induced by forward rover motion and unconstrained driving directions. Under these conditions, state-of-the-art image-to-image and image-to-map matching pipelines suffer significant performance degradation. In this work, we propose a visual relocalization method that departs from classical correspondence-based pipelines by directly estimating camera poses against a differentiable map representation built with 3D Gaussian Splatting (3DGS). Our key contribution is a geometry-aware training strategy that combines photometric and geometric losses, where the geometric supervision is provided for the first time by combining multi-view stereo (MVS) and LiDAR depths. We show that this joint optimization produces a 3DGS model that better fits the underlying scene geometry, leading to improved photometric and geometric consistency and more robust, accurate single-image 6-DoF pose estimation. Extensive experiments on data acquired in planetary-analog environments validate the effectiveness of our approach, showing substantial gains in relocalization accuracy under challenging conditions. Code is available at this https URL.

28. 【2607.22139】CARDIAG: A Dense Segment Classification Benchmark of Deep Learning Architectures for Coronary Angiography

链接：https://arxiv.org/abs/2607.22139

作者：Dominik Bernard Lau,Hubert Malinowski,Jerzy Szyjut,Adam Brzeski,Tomasz Dziubich,Radosław Targoński,Tomasz Figatowski,Natalia Zielińska

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Accurate pixel-level classification, field lacks standardized, cardiovascular disease assessment, standardized evaluation protocols, lacks standardized evaluation

备注： 19 pages, 12 figures, 3 tables, dataset available on Zenodo at [this https URL](https://zenodo.org/records/19958730) , code available at [this https URL](https://github.com/cvlab-ai/cardiag-benchmark)

点击查看摘要

Abstract:Accurate pixel-level classification of coronary angiograms is critical for cardiovascular disease assessment, yet the field lacks standardized evaluation protocols. In this work we demonstrate a new benchmark for the assessment of deep learning models which densely classify pixels of coronary angiograms to one of SYNTAX classes (or background). The evaluation covers 24 distinct architectures starting with classic convnets to recent state-space-based vision algorithms. We release CARDIAG - a multi-center, multi-label dataset which we carefully split to reliably compute metrics, accounting for diameter error, overlap, centerline quality and calibration. The data contains SYNTAX labels, binary, uncertainty and segmentation masks as well as intermediate frames together with the selected non-sensitive DICOM metadata. From the multitude of algorithms, we nominate ConvNeXt V2 encoder with DeepLab V3 Plus decoder as the best performing, achieving macro $F_1=0.456$, which we then ensemble with Mamba U-Net and Feature Pyramid Network, for an increased $F_1=0.479$. We demonstrate all the architectures to be well calibrated and determine the generalization of the top 5 methods, together with the data efficiency of these architectures. We highlight the importance of both high-resolution and low-resolution features in encoding. We also demonstrate the model correctness in the context of patient demographic, vessel sides and projection angle configurations. Overall the released benchmark allows for future studies to robustly and rigorously assess the proposals, not only for SYNTAX segmentation, but lesion detection and many more.

29. 【2607.22135】GLI-AL: A Multi-Modal Glioma MRI Label Resource with Unified Anatomy-Lesion Labels

链接：https://arxiv.org/abs/2607.22135

作者：Xingyu Xiang,Shuang Hao,Fan Wang,Jianhua Ma,Chunfeng Lian

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：white matter hyperintensities, task definition focuses, adult glioma MRI, glioma MRI segmentation, Existing BraTS-GLI datasets

备注：

点击查看摘要

Abstract:Existing BraTS-GLI datasets provide a widely used benchmark for adult glioma MRI segmentation, but their task definition focuses on tumor subregions and does not systematically represent coexisting white matter hyperintensities (WMH). In joint segmentation settings, such unlabeled abnormalities introduce task-specific label noise by treating pathological regions as normal tissue. To address this limitation, we introduce BraTS-GLI Anatomy-Lesion, a controlled-access, labels-only derived resource built from the BraTS 2023-GLI training cohort. The resource provides 1,251 unified eight-class anatomy-lesion label sets aligned with the original four-modal MRI cases, including image-repair labels for 116 cases requiring repaired imaging inputs. The cohort is organized into a 394-case purified subset and an 857-case extended subset, with case-level metadata covering label source, image-repair requirements, quality-control status, access conditions, checksums, and release boundaries. Compared with the original BraTS-GLI annotations, the resource substantially expands foreground supervision by incorporating healthy brain tissues and previously unlabeled coexisting abnormalities within a unified label space. A validation study using MedNeXt and T1/FLAIR inputs suggests that WMH-aware supervision preserves healthy-tissue segmentation performance across both in-domain GLI and external WMH datasets, while improving sensitivity to coexisting lesions relative to noisy-control training. The resource is intended for scientific research and supports joint anatomy-lesion supervision, label-noise analysis, and reproducible evaluation. Data are available at this https URL, and code is available at this https URL. The data resource DOI is this https URL.

30. 【2607.22129】A Framework for Individual Tree Growth Reconstruction Using Multi-Platform Laser Scanning

链接：https://arxiv.org/abs/2607.22129

作者：Daniella Tavi,Valtteri Soininen,Lassi Ruoppa,Jesse Muhojoki,Juha Hyyppä

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Accurate tree-level forest, tree-level forest monitoring, Accurate tree-level, scanning data requires, point clouds

备注：

点击查看摘要

Abstract:Accurate tree-level forest monitoring using laser scanning data requires reliable tree delineation, consistent tree correspondence across multitemporal point clouds, and accurate estimation of tree attributes and their change. Reconstructing tree growth in boreal forests is challenging due to the scarcity of historical stem-level data, propagation of errors from older sensors into change estimation, and growth rates with a magnitude of measurement uncertainty. This study investigates a framework for estimating individual tree diameter at breast height (DBH) and stem volume growth using 136 point clouds acquired between 2014--2025 with 11 scanners on airborne (ALS), mobile (MLS), and terrestrial laser scanning (TLS) platforms across boreal forest test sites. Trees were delineated from an MLS point cloud using deep learning-based segmentation which was transferred to the remaining point clouds, resulting in reliable multitemporal tree correspondence. Stem curves were derived from MLS/TLS data, with ALS data used for height estimation, enabling DBH and volume estimation and time series. A height growth-based scaling model was used to reconstruct stem attributes across time and estimate growth. Results showed that modeled growth achieved higher agreement with manual growth estimates than differencing independently estimated attributes from point clouds. The modeled-manual 5- and 10-year growth RMSEs were 55--111\% and 26--67\% for DBH, and 31--87\% and 21--67\% for volume, respectively, depending on plot difficulty. The scaling model was temporally robust, with errors remaining stable or stabilizing after 5--6 years, reaching maximum RMSEs of 8--12\% for DBH and 12--23\% for volume after 12 years. Combining MLS/TLS-derived stem measurements with multitemporal ALS-derived heights provided a robust framework for individual tree growth estimation without requiring multiple under-canopy scans.

31. 【2607.22117】Projection Pursuit CPCANet for Domain Generalization

链接：https://arxiv.org/abs/2607.22117

作者：Yu-Hsi Chen,Abd-Krim Seghouane

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Domain Generalization, Principal Component Analysis, distribution shifts, Common Principal Component, common principal components

备注： 8 pages, 5 tables

点击查看摘要

Abstract:Domain Generalization (DG) aims to learn representations robust to distribution shifts. Recent geometric alignment methods, such as CPCANet, extract domain-invariant structures through batch-wise Common Principal Component Analysis (CPCA). However, CPCANet suffers from rank-deficient covariance estimation due to the small-sample-size issue in mini-batch training. To address this limitation, we propose Projection Pursuit CPCANet (PP-CPCANet), a covariance-free framework that learns a global orthogonal basis on the Stiefel manifold and jointly optimizes it with network parameters via the Cayley transform. We further introduce a symmetry-breaking detached-median PP dispersion objective to extract common principal components (CPCs) with dense and robust optimization signals. Experiments on four DG benchmarks show that PP-CPCANet achieves SOTA performance while maintaining stable training.

32. 【2607.22101】InnoText: A Unified Model for Visual Text Generation and Editing

链接：https://arxiv.org/abs/2607.22101

作者：Haowei Liu,Runze He,Jian Lu,Ao Ma,Run Ling,Ke Cao,Jiasong Feng,Wei Feng,Shuo Lu,Yexing Xu,Yun Wang,Jing Wang,Zhanjie Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：recently achieved remarkable, achieved remarkable success, high-fidelity image synthesis, Diffusion models, remains relatively underexplored

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Diffusion models have recently achieved remarkable success in high-fidelity image synthesis, yet their application to visual text generation and editing remains relatively underexplored. Unlike general image generation, visual text tasks demand precise structural regularity and legibility, which may pose additional challenges for small-scale text and non-Latin scripts such as Chinese. Existing UNet-based models often struggle to produce clear and coherent text, while DiT-based models, though more expressive, are typically limited to a single task, which may lead to redundant training pipelines, inconsistent visual styles, and reduced cross-task generalization. To address these challenges, we propose InnoText, a unified DiT-based framework capable of performing both text generation and editing within a single model. We introduce a Font Size-Aware Modulation (FSAM) module to enhance representations across font scales, a Small-Character Aware Augmentation strategy to improve fine-grained fidelity, and a Task-Specific Region Weighted Loss for adaptive optimization. To support training and evaluation, we also construct a high-quality bilingual (English-Chinese) visual text dataset covering diverse fonts, sizes, and backgrounds. Experimental results demonstrate that our method achieves superior generation accuracy and editing quality, producing visually appealing and realistic text images.

33. 【2607.22091】Spectral Prior for Reducing Exposure Bias in Diffusion Models

链接：https://arxiv.org/abs/2607.22091

作者：Yuya Kobayashi,Masato Ishii,Yuhta Takida,Takashi Shibuya,Yuki Mitsufuji

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：models typically suffer, iterative sampling, commonly referred, exposure bias, frequency-dependent SNR error

备注： Accepted at ECCV2026

点击查看摘要

Abstract:Diffusion models typically suffer from error accumulation during iterative sampling, commonly referred to as exposure bias. We reveal systematic frequency-dependent discrepancies between training and inference, which can be interpreted as frequency-dependent SNR error. Crucially, the direction of this mismatch varies across models and timesteps, indicating that fixed correction rules do not generalize. We propose Spectral Alignment (SPA), a lightweight, guidance-based method that calibrates the power spectrum of intermediate predictions to a pre-computed prior. Our approach consists of two stages: (1) offline fitting of a parametric spectrum model from training data, and (2) inference-time guidance via efficient FFT-based gradient computation. SPA introduces minimal computational overhead (3-4\%) and is complementary to Classifier-Free Guidance (CFG). We demonstrate consistent improvements across diverse architectures, from pixel-space models (DDPM, ADM) to latent diffusion models (SD2.0, SDXL) and flow-matching models (SD3.5, FLUX). Our implementation is available at this https URL.

34. 【2607.22087】FAIR: Feature-Augmented Implicit Regularization for AI-generated Fake Image Detection

链接：https://arxiv.org/abs/2607.22087

作者：Md Redwanul Haque,Manzur Murshed,Manoranjan Paul,Tsz-Kwan Lee

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：AI-generated image detection, image detection, remains a critical, critical bottleneck, bottleneck in AI-generated

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:Generalization remains a critical bottleneck in AI-generated image detection. Because many modern generators are proprietary or adversarially modified, existing detectors overfit to the low-level textural patterns of accessible training data, resulting in severe failures on unseen domains. Conventional regularization techniques (e.g., $L_1$/$L_2$ norms, Dropout) apply indiscriminate parametric constraints and fail to provide the domain-invariant structure necessary for cross-generator robustness. To address this, we propose Feature-Augmented Implicit Regularization (FAIR). FAIR introduces an orthogonal, macro-structural prior, specifically, Scene Composition Structure (SCS), during training to geometrically constrain the model's optimization trajectory. By augmenting the primary feature space with domain-invariant SCS features, FAIR explicitly penalizes texture-biased shortcut learning. Crucially, this structural prior is entirely discarded at inference, yielding a smoothed, generalized decision boundary with zero architectural or computational overhead. Extensive evaluations across five massive benchmarks demonstrate that integrating FAIR into state-of-the-art detectors significantly improves cross-generator generalization, boosting accuracy by up to 8.04% and establishing new state-of-the-art robustness in zero-shot transfer scenarios.

35. 【2607.22078】CommandLM: Data driven behavior level descriptor for ego vehicles

链接：https://arxiv.org/abs/2607.22078

作者：Boris Tokic,Constantin Selzer,Fabian B. Flohr

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large language model, decision-making is essential, driving systems move, language model, large language

备注：

点击查看摘要

Abstract:As autonomous driving systems move toward real-world deployment, interpretable, behavior-level decision-making is essential for safety, trust, and regulation. We introduce CommandLM, a multimodal large language model that generates concise, human-readable behavior descriptions for ego vehicles from fused multi-sensor data. Our model processes temporally fused bird's-eye view representations from LiDAR and multi-camera inputs via a Q-Former adapter connected to a quantized, LoRA-fine-tuned large language model. Trained on our CommandLM-nuScenes dataset, CommandLM produces intent-aware, interpretable captions suitable for planner supervision and safety auditing. Experiments demonstrate strong linguistic and behavioral alignment, achieving CIDEr 0.67, and BERT-F1 0.88, substantially outperforming the BLIP-2 baseline (CIDEr 0.52, BERT-F1 0.86). In human evaluation, 58% of the generated descriptions were rated accurate, efficient and rule-compliant, confirming their real-world plausibility. While the remaining descriptions may not always select the most efficient, goal-oriented behavior, CommandLM's interpretable outputs enable downstream validation systems to identify and correct such cases, making it an effective tool for transparent behavior auditing. These results show that integrating multimodal fusion with language reasoning yields efficient and transparent behavior-level understanding for autonomous driving. We release our code and dataset at: this https URL

36. 【2607.22072】Alleviating Regional Shortcuts for Few-Shot Class-Incremental Learning

链接：https://arxiv.org/abs/2607.22072

作者：Haichen Zhou,Yazhe Lyu,Yixiong Zou,Ruixuan Li,Yuhua Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Few-shot class-incremental learning, avoiding forgetting base, Few-shot class-incremental, forgetting base classes, class-incremental learning

备注： Accepted by TMM 2026

点击查看摘要

Abstract:Few-shot class-incremental learning (FSCIL) aims to incrementally learn novel classes with only a few samples while avoiding forgetting base classes. However, current methods show a tendency to misclassify novel-class samples into base classes, which we find to be caused by the excessive focus on base-class-discriminative regions on novel-class samples. In this work, we aim to explore the underlying mechanism for an interpretation and solution. We first provide a compositional view to analyze the transferred and reused spatial patterns on novel-class samples. Then, through extensive experiments and theoretical analysis, we identify both empirically and theoretically that a shortcut exists in the model's base-class training, which naturally forms the excessive focus on only the most discriminative regions (primitives), which we term as the regional shortcut. Finally, based on this interpretation, to address this problem, we propose a compositional-learning-based method to learn two primitive sets (a common set and a discriminative set), which alleviates the regional shortcut by constraining the model to learn and utilize the common primitive set for base- and novel-class recognition. Extensive experiments on standard FSCIL benchmarks demonstrate the effectiveness of our approach, yielding consistent improvements over existing state-of-the-art methods in both accuracy and interpretability.

37. 【2607.22071】ReCowGnition: A Realistic Biometric Benchmark for Cow Face Recognition

链接：https://arxiv.org/abs/2607.22071

作者：Marco Huber,Marco Kiesewalter,Judith Louise Pieper,Bastian Kubsch,Naser Damer

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：precision livestock farming, visual animal biometrics, computer vision, gained attention, development of precision

备注： Accepted at ICPR 2026 Workshops

点击查看摘要

Abstract:With the development of precision livestock farming and the advances in computer vision, visual animal biometrics has gained attention. Using biometric technologies that have been proven effective for humans to identify livestock can increase animal welfare as well as production efficiency. However, challenges such as complex scenarios, similar appearances, occlusions, and non-cooperative behavior, as well as the limited amount of publicly available labeled datasets, remain. In this work, we contribute a novel, publicly available cow face benchmark dataset that has been collected in a realistic automatic scenario with 6,838 images of 161 different cows at a dairy farm. In addition to the public dataset, we define two verification and four identification evaluation protocols to foster comparable research in the cow recognition research field. Further, we provide evaluation results on our dataset of six benchmark models, which include models trained on limited data, cross-species fine-tuned models, and zero-shot foundation model approaches.

38. 【2607.22068】Rethinking Multi-Branch and Cross-Backbone Fusion for Vehicle Re-Identification in the Foundation-Model Era

链接：https://arxiv.org/abs/2607.22068

作者：Yu Wang,Hongyu Yang

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：improve vehicle re-identification, combining complementary representations, vehicle re-identification, architectures and CNN-Transformer, long been regarded

备注：

点击查看摘要

Abstract:Multi-branch architectures and CNN-Transformer fusion have long been regarded as effective ways to improve vehicle re-identification (Re-ID) by combining complementary representations. In this work, we revisit this assumption in the foundation-model era through a comprehensive empirical study. A single DINOv3-pretrained ConvNeXt trained with a tuned recipe achieves 88.19 mAP on VeRi-Wild Small and 77.47 mAP on VeRi-Wild Large using visual cues alone, matching the strongest protocol-verified metadata-dependent multi-branch baseline. Applying training-free re-ranking further improves performance to 92.38 and 83.68 mAP, respectively. Using this strong baseline together with retrieval-level branch diagnostics, we evaluate whether increasing representational diversity still provides measurable gains. Across both benchmarks, concatenating multiple branches built on a shared backbone changes the best single-branch performance by less than one mAP point while increasing the embedding dimension by 4x, and the resulting representation has an effective rank close to the original feature dimension. We further study cross-backbone fusion using an asymmetric frozen-anchor strategy to combine ConvNeXt and Vision Transformer representations. Despite these favorable conditions, Transformer branches consistently remain 13-15 mAP below the ConvNeXt backbone, and paired per-query bootstrap analysis estimates the largest observed fusion gain to be only +0.11 mAP (95% confidence interval). Our results suggest that, under the evaluated setting, improving a single strong foundation-model backbone together with retrieval-stage re-ranking is more effective than increasing architectural complexity through additional branches or heterogeneous backbones. We restrict our conclusions to single-seed training and one family of foundation models and discuss conditions under which these observations may not hold.

39. 【2607.22053】A Smooth Phase-Separation Model for Weak-Boundary Segmentation of Homogeneous Structures

链接：https://arxiv.org/abs/2607.22053

作者：Zihan Li,Jiebao Sun,Fanghui Song,Zhichang Guo

类目：Computer Vision and Pattern Recognition (cs.CV); Mathematical Physics (math-ph)

关键词：similar intensity distributions, intensity distributions remains, similar intensity, intensity distributions, distributions remains

备注：

点击查看摘要

Abstract:Segmentation of adjacent structures with similar intensity distributions remains a challenging problem in image analysis, particularly when object boundaries are weak or ambiguous. Under such conditions, classical variational models may suffer from degenerated image-driven forces, leading to boundary leakage or undesired merging of neighboring regions. To address these limitations, we propose a smooth phase-separation variational model based on the Cahn--Hilliard equation for weak-boundary segmentation of homogeneous-appearance structures. The proposed framework integrates softmax-based region fitting with Cahn--Hilliard phase-field regularization to maintain interface discrimination under weak image-driven forces. We further introduce a mixed $L^2-H^{-1}$ gradient flow, which preserves higher-order interfacial regularization while allowing adaptive changes of phase masses, establish the continuous energy dissipation law, and prove the existence and uniqueness of weak solutions in the natural solution class. For numerical computation, we develop a stabilized scalar auxiliary variable (SAV) scheme that is linear, FFT-based, and satisfies a modified discrete energy dissipation law. Numerical experiments on synthetic and medical images demonstrate that the proposed method effectively separates adjacent homogeneous structures across weak boundaries and achieves competitive segmentation accuracy and improved boundary localization compared with representative variational, phase-field, and deep learning methods.

40. 【2607.22043】Scaling Native Multimodal Pre-Training From Scratch

链接：https://arxiv.org/abs/2607.22043

作者：Haoyuan Wu,Aoqi Wu,Hai Wang,Jiajia Wu,Jinxiang Ou,Bei Yu

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：text-only pre-training restricts, multimodal physical world, remarkable reasoning capabilities, exhibit remarkable reasoning, exhibit remarkable

备注：

点击查看摘要

41. 【2607.22034】Small Vision-Language Models Know When They Are Wrong But Cannot Say So: A Two-Model Study of Stated versus Internal Confidence Under Realistic Image Degradation

链接：https://arxiv.org/abs/2607.22034

作者：M M Asif Ferdous

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：camera shake, Vision-language models, degraded by compression, poor lighting, increasingly deployed

备注： 15 pages, 4 figures

点击查看摘要

42. 【2607.22016】EVL-MCoT: Enhanced Vision-Language Multi-CoT for Harmful Meme Detection

链接：https://arxiv.org/abs/2607.22016

作者：Hao Yang,Jin Wang,Xuejie Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：carry strong elements, sarcasm or irony, carry strong, strong elements, elements of sarcasm

备注：

点击查看摘要

Abstract:MEMEs are widely used on the internet and often carry strong elements of sarcasm or irony. Understanding their hidden meanings typically requires a joint interpretation of text and vision. Existing methods focus on the dual-stream vision-language model to extract the visual and text simultaneously, which lacks background information and prior knowledge about the comprehensive explanation of MEME. One feasible option is to adopt chain-of-thought (CoT). However, the simple CoT approach lacks multi-perspective thinking, which may compromise the reliability of the resulting answers. Moreover, it often relies on shallow feature fusion, lacking the fusion of local details and fine-grained visual-prompt text alignment. This limitation prevents a deeper understanding of the intricate connections between the visual and the text. Herein, an enhanced vision-language multi-CoT (EVL-MCoT) approach is proposed to address these limitations. By promoting multi-CoT, EVL-MCoT enhances consistency and reduces bias in the decision-making process. Additionally, we design a prototype-guided and context-guided decoding framework, which incorporates visual prototypes to guide the fusion process and enables the model to align textual and visual information more precisely. We achieve promising results on the HatefulMemes and MultiOff datasets. The source code has been publicly released and is available at this https URL.

43. 【2607.22014】Zero-Shot Mission-Level Evaluation for Aerial MLLM Agents

链接：https://arxiv.org/abs/2607.22014

作者：Suman Navaratnarajah,Taehyoung Kim,Jona Ruthardt,Ishaan Bhimwal,Ryousuke Yamada,Yannik Blei,Wolfram Burgard,Yuki M Asano

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Multimodal Large Language, single high-level instruction, Large Language Models, Multimodal Large, solve long-horizon embodied

备注： Preprint

点击查看摘要

44. 【2607.22013】Visual Saliency Steering Distillation for Multimodal Chain-of-Thought Reasoning

链接：https://arxiv.org/abs/2607.22013

作者：Hao Yang,Jin Wang,Xuejie Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：reasoning integrates visual, reasoning integrates, textual cues, integrates visual, Saliency Steering Distillation

备注：

点击查看摘要

Abstract:Multimodal chain-of-thought (CoT) reasoning integrates visual and textual cues through step-by-step inference. In small models with limited token budgets, modality-interaction fusion often suppresses tiny cross-modal differences. In particular, multimodal CoT often struggles when different images pair with identical text or different texts pair with an identical image, making such inputs nearly indistinguishable after fusion. This study proposes Visual Saliency Steering Distillation (VSSD). VSSD leverages the attention maps of multimodal large language models to generate perturbed images that capture task-sensitive feature directions, and then applies singular value decomposition to extract dominant steering vectors to guide inter-layer distillation. Experiments on ScienceQA and M$^3$CoT demonstrate that VSSD improves rationale generation and answer inference. The code is available at this https URL.

45. 【2607.21998】Medical-Checklist: Assessing the Comprehension of Medical Images by Multimodal Models

链接：https://arxiv.org/abs/2607.21998

作者：Bannapol Limanond,Masanori Suganuma,Takayuki Okatani

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：medical multimodal models, assessing medical multimodal, multimodal models, paper introduces, models

备注： Accepted for publication in IEEE Journal of Biomedical and Health Informatics

点击查看摘要

Abstract:This paper introduces a new benchmark test, Medical-Checklist, for assessing medical multimodal models. The recent advancements in multimodal models have demonstrated significant potential in the field of medical vision-language tasks. However, it is becoming increasingly clear that evaluating these models' performance, whether they are applied to natural or medical images, is challenging. The critical question is whether the models can accurately understand an input image while associating it with relevant input text. To address this, Medical-Checklist imposes a binary test on the models: they are given an image and two captions, where one is correct and the other incorrect, and the model must select the correct one. The incorrect caption contains a single medical concept (word or phrase) that is inaccurately substituted from the correct caption. Although the task is simple, this simplicity enables the unified assessment of diverse multimodal models designed and learned on different principles. It also enables us to verify whether models correctly understand a wide range of medical concepts across various medical sub-domains. Medical-Checklist is designed to reduce potential biases in data and to enable evaluation of the models' ability to handle out-of-distribution inputs, which were difficult in existing datasets. When evaluating four state-of-the-art medical multimodal models with Medical-Checklist, it was revealed that despite their excellent performance in specific tasks such as Med-VQA, they may not correctly understand images, suggesting a long journey ahead for clinical application. The dataset and code will be made public upon acceptance.

46. 【2607.21973】Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation

链接：https://arxiv.org/abs/2607.21973

作者：Yuqi Li,Xi Xiao,Yunbei Zhang,Lin Zhao,Yu Li,Aiden Zhao,Tianyang Wang,Hao Xu,Yingli Tian

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：making parameter-efficient adaptation, downstream visual recognition, making parameter-efficient, central problem, Vision foundation models

备注： Accepted by ACM MM 2026

点击查看摘要

Abstract:Vision foundation models are increasingly reused as frozen backbones for downstream visual recognition, making parameter-efficient adaptation a central problem. Prompt-based adaptation, including Visual Prompt Tuning (VPT), provides a lightweight way to specialize these models, but its layer-wise behavior remains poorly understood: performance is sensitive to prompt depth, placement, and task distribution, and gains on standard in-domain benchmarks do not always translate into robust generalization. We argue that this limitation is not solely an optimization issue, but a layer-wise information allocation issue: existing prompt-based methods lack principled control over what prompt-conditioned representations should preserve, suppress, and propagate across depth. Inspired by the Information Bottleneck principle, we introduce Prompted Information Bottlenecks (PIB), a framework that regularizes layer-wise compression-sufficiency trade-offs and promotes a more coherent cross-layer information path. The key idea is that effective adaptation should be minimal yet sufficient, retaining task-relevant local evidence in earlier layers while progressively discarding nuisance factors and redundant details in deeper layers. Extensive experiments show that PIB achieves strong performance across 34 datasets, reaching 92.1% on FGVC, 93.01% on HTA, and 77.33% on VTAB-1k, while tuning only 0.35% parameters on average across the main settings. Beyond benchmark accuracy, PIB helps explain the non-monotonic behavior of prompt capacity scaling, reduces shortcut reliance, and improves robustness under distribution shift and fine-grained recognition settings. These results position PIB as both a practical method and an information-allocation perspective for adapting frozen vision foundation models. Our code is available at this https URL

47. 【2607.21970】xtSLIP: Text Self-Supervised CLIP for Medical Report Generation

链接：https://arxiv.org/abs/2607.21970

作者：Haoyu Jiang,Ziping Cong

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：vision language modeling, Automating radiology report, Automating radiology, insufficient fine-grained semantic, Image Pretraining

备注： 9 pages

点击查看摘要

Abstract:Automating radiology report generation is important for improving reporting consistency and clinical workflows . While Contrastive Language--Image Pretraining (CLIP) has advanced medical vision language modeling, existing CLIP-style approaches may still provide insufficient fine-grained semantic supervision for complex report generation. Standard CLIP primarily optimizes cross-modal alignment, without explicitly structuring the textual embedding space that guides visual representation learning. To address this limitation, we propose TextSLIP, a general medical vision-language pretraining framework that augments CLIP with intra-modal text contrastive learning. By improving textual embedding discriminability through self-supervised augmented text pairs, TextSLIP is designed to provide finer-grained linguistic supervision to the visual encoder. As an initial validation, we pretrain TextSLIP on a curated dataset of 7 million brain MRI image-text pairs and fine-tune the pretrained visual encoder within a report generation architecture. In controlled comparisons with CLIP-style baselines, TextSLIP shows consistent improvements on report generation metrics. Ablation studies further suggest that text-side self-supervision contributes to the observed gains. These results indicate that text-level contrastive learning is a promising direction for improving medical visual-textual alignment, while broader validation across additional medical domains remains an important next step.

48. 【2607.21953】Low-Altitude Channel Multipath Prediction via Panoramic Perception and Vision-Language Model

链接：https://arxiv.org/abs/2607.21953

作者：Zihang Zeng,Shu Sun,Meixia Tao,Zhiyong Chen,Jianhua Mo,Xiangwen Gu

类目：Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

关键词：Unmanned aerial vehicle, Unmanned aerial, mobile networks, aerial vehicle, communication is expected

备注：

点击查看摘要

Abstract:Unmanned aerial vehicle (UAV) communication is expected to support a wide range of low-altitude applications in 6G mobile networks. However, traditional statistical channel models provide limited accuracy in specific environments, while deterministic methods such as ray tracing usually rely on accurate three-dimensional environment models and involve high computational complexity. Existing multimodal channel prediction approaches mainly focus on large-scale metrics such as path loss, and remain insufficient for modeling small-scale parameters. To address these limitations, this paper proposes PanoLAMP, a Panoramic perception and vision-language model-based Low-Altitude Multipath Prediction framework. It adopts a pretrained vision-language model as the backbone and captures the propagation environment features through panoramic RGB-D observations collected at both the transmitter and receiver to predict the delay, power, azimuth angle, and zenith angle offset relative to the line-of-sight path. Experiments are conducted on a synthetic dataset containing 18,949 UAV-vehicle links across seven UAV altitudes. Experimental results show that the proposed method consistently outperforms representative baselines in both multipath parameters and statistical metrics, and demonstrates stronger generalization across different flight heights.

49. 【2607.21904】Diffusion Models in Medical Image Inpainting: Challenges, Solution Taxonomy, and Future Directions

链接：https://arxiv.org/abs/2607.21904

作者：Arthur Dantas Mangussi,Joana Cristo Santos,Ricardo Cardoso Pereira,Ana Carolina Lorena,Mário A. T. Figueiredo,Pedro Henriques Abreu

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：medical image inpainting, Image inpainting aims, Image inpainting, medical image, visual and semantic

备注：

点击查看摘要

50. 【2607.21897】ISPCloak: Weaponizing ISP for Optimization-Free Physical Camouflage against Deepfake Detectors

链接：https://arxiv.org/abs/2607.21897

作者：Jiale Zhao,Jiajun Wan,Lei Tang,Ye Qin,Kebing Jin,Jinghui Qin

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

关键词：rapid advancement, spurred the critical, evaluate the worst-case, worst-case robustness, Image Signal Processing

备注： Accpted by ACM MM 2026

点击查看摘要

Abstract:The rapid advancement of generative models has spurred the critical need to evaluate the worst-case robustness of deepfake detectors. In this paper, we reveal a fundamental blind spot in current forensic paradigms: while existing detectors excel at capturing digital synthesis artifacts, their effectiveness drops drastically when AI-generated content is cloaked in authentic physical imaging characteristics. We posit that genuine photographs inherently possess hardware-intrinsic statistical signatures, which are imperceptible footprints imprinted by optical sensors and Image Signal Processing (ISP) pipelines, and are fundamentally absent in purely data-driven generative models. Driven by this insight, we propose ISPCloak, a novel optimization-free adversarial attack framework that explicitly weaponizes the ISP pipeline to mislead the judgment of deepfake detectors. Rather than relying on computationally expensive gradient perturbations, our method first employs an Invertible ISP network to project images into the RAW domain. Then, we seamlessly imprint the complex statistical priors of real cameras onto AI-generated images by injecting realistic Poisson-Gaussian sensor noise and conducting forward ISP reconstruction. Synergized with generative artifact suppression and adaptive masking, this streamlined physical simulation enables ultra-fast generation of adversarial examples. Extensive experiments show that embedding authentic physical perturbations fundamentally disrupts a broad range of current detection mechanisms, yielding universally evasive adversarial examples with imperceptible visual alterations.

51. 【2607.21896】Learning Adaptive Semantic Gaussian Allocation for 3D Occupancy

链接：https://arxiv.org/abs/2607.21896

作者：Kanglin Ning,Yiran Zhao,Wenrui Li,Houde Quan,Qifan Li,Xingtao Wang,Xiaopeng Fan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：rendering semantic primitives, voxel-wise supervision, provide a compact, volume under voxel-wise, Gaussian Allocation Transformer

备注：

点击查看摘要

Abstract:Semantic 3D Gaussians provide a compact representation for 3D semantic occupancy prediction by rendering semantic primitives into a voxel volume under voxel-wise supervision. Recent methods have improved the modeling ability and efficiency of this representation through more flexible primitive shapes, geometry-guided initialization, and progressive densification. However, these advances mainly determine how primitives are represented, initialized, or added, and do not explicitly address how to select the most useful Gaussians when their total number must be limited to control memory and computation. This imbalance creates an allocation bottleneck: redundant Gaussians remain in simple regions, while difficult regions receive insufficient semantic support. We propose the Semantic Gaussian Allocation Transformer (SAGFormer), which uses Gaussian attributes and local geometric-semantic features to score candidates and select a fixed final Gaussian set. Experiments on nuScenes-SurroundOcc and SSCBench-KITTI-360 show that SAGFormer improves occupancy prediction under the evaluated protocols and yields more semantically consistent and better-utilized Gaussian representations. Under similar final counts and raw coverage, it reduces semantic mixing, strengthens class-consistent voxel support, and produces fewer unused Gaussians. The results indicate that explicit capacity allocation is a useful complement to Gaussian refinement for semantic occupancy prediction.

52. 【2607.21881】Farmland Extent and Visible Boundary Mapping from 1 m NAIP Imagery Using Residual U-Net and Text-Prompted SAM 3 Refinement

链接：https://arxiv.org/abs/2607.21881

作者：Mohammadreza Narimani,Vikram Anand,Parastoo Farajpoor

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

关键词：NAIP RGB imagery, production accounting, land-conversion analysis, provide the spatial, spatial framework

备注： 12 pages, 7 figures, 3 tables. Preprint submitted to Taylor Francis. Code: [this https URL](https://github.com/MohammadrezaNarimaniUCDavis/NAIP_Farmland_ResSAM) Dataset: [this https URL](https://doi.org/10.5281/zenodo.21519912)

点击查看摘要

Abstract:Agricultural field maps are often proprietary, incomplete, or outdated, yet they provide the spatial framework for crop monitoring, production accounting, and land-conversion analysis. This study presents a reproducible workflow for mapping farmland extent and visible boundaries from 1 m NAIP RGB imagery. Thirty-seven scenes spanning open cropland, peri-urban interfaces, semi-arid irrigation geometries, and fragmented mosaics were annotated in CVAT and converted to binary masks. Non-overlapping 256 x 256 patches yielded 5,698 samples, split by source scene into 3,850 training, 770 validation, and 1,078 test patches. A residual U-Net (ResUNet) trained with a Dice-dominant loss, L = 2.5(1 - Dice) + BCE, achieved test accuracy 0.8808, IoU 0.8605, Dice 0.9234, precision 0.8766, and recall 0.9794. A frozen SAM 3 branch prompted with "agricultural farmland field" was fused with ResUNet by logical OR. On selected difficult patches, Dice improved from 0.858 to 0.955 (orchard rows) and from 0.804 to 0.903 (fragmented parcels). Sliding-window stitching produced coherent regional masks (example tile Dice 0.898 and 0.919). The product is a semantic farmland-extent layer, not a cadastral parcel map, and supports agricultural monitoring where current field layers are unavailable.

53. 【2607.21850】SCALE: Self-Supervised Constraint-Aware Layout GEneration for Local PR DRV Fixing at Advanced Nodes

链接：https://arxiv.org/abs/2607.21850

作者：Chia-Tung Ho,Haoyu Yang,Guanglei Zhou,Yoshi Nishi,Yaguang Li,Walker Turner,Cunxi Yu,Yiran Chen,Brucek Khailany

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：semiconductor manufacturing advances, complex rule interactions, dense multi-layer routing, multi-layer routing geometries, Large Language Models

备注： 8 pages, 5 Figures, 6 Tables

点击查看摘要

Abstract:As semiconductor manufacturing advances toward sub-2nm nodes, local place-and-route (PR) design-rule violation (DRV) fixing is increasingly limited by complex rule interactions, dense multi-layer routing geometries, and foundry-specific constraints. While Large Language Models (LLMs) have recently demonstrated strong capabilities in EDA scripting and documentation, their application to visual layout understanding remains largely unexplored: diagnosing DRC violations from layout imagery demands precise geometric reasoning and foundry-specific rule knowledge absent from general-purpose VLM training. We propose SCALE, a framework with a self-supervised layout-generation stage for local DRV fixing at advanced nodes. Multi-layer layout geometry is serialized into structured text, and a fine-tuned language model learns to reconstruct randomly masked polygons from surrounding BEOL context alone without violation labels. At inference, natural-language rule constraints and high-temperature sampling steer generation toward diverse, violation-prone layout variants validated by an industrial signoff DRC checker, producing DRC-annotated layout--violation pairs used to fine-tune a domain-adapted DRC-VLM. This VLM provides rule-aware geometric guidance for local DRV repair, boosting state-of-the-art agents' solve rates by +12--25% (up to 97%) on 100 real sub-2nm cases spanning enclosure, spacing, width, and color-spacing violations.

54. 【2607.21848】Closing the Loop: Training-Free Revisit Consistency for Autoregressive Generative Rendering

链接：https://arxiv.org/abs/2607.21848

作者：Wenchao Ma,Changran Liu,Sharon X. Huang,Haomiao Jiang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：immersive content creation, Recent conditional video, shown promising potentials, Recent conditional, potentials to transform

备注：

点击查看摘要

Abstract:Recent conditional video generation models have shown promising potentials to transform 3D engine renderings, such as depth maps and untextured geometry, into photorealistic videos for gaming and immersive content creation. These applications require long-horizon auto-regressive generation that continuously synthesizes new frames while preserving a persistent 3D world. Auto-regressive generators synthesize video chunk by chunk with a bounded KV cache, so when the camera revisits a location after its context has been evicted, the model often regenerates inconsistent appearance, even though the conditioning renderings (e.g., depth) remain perfectly aligned with the underlying this http URL address this revisit inconsistency without any post-training by exploiting correspondences the 3D engine already provides: temporal correspondence retrieves pose-matched historical latent chunks into the KV cache as loop-closure memory, while spatial correspondence from camera pose and depth reprojection biases token-level attention toward geometrically corresponding regions of the retrieved chunks. We demonstrate our method on loop-closure trajectories mined from TartanAir and TartanGround dataset to mirror complicate real-world application scenarios, where it outperforms existing training-free baselines on revisit consistency without losing overall video quality. Project Page: this https URL

55. 【2607.21840】oward High-Fidelity 3D Point-Cloud Learning for Brain Folding Morphology Prediction Using Trans-Unet

链接：https://arxiv.org/abs/2607.21840

作者：Geran Zhao,Xiaotian Li,Poorya Chavoshnejad,Mir Jalil Razavi,Akbar Solhtalab,Lijun Yin,Guifang Fu

类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Methodology (stat.ME); Machine Learning (stat.ML)

关键词：Learning high-fidelity point-cloud, including permutation invariance, space poses significant, poses significant challenges, Learning high-fidelity

备注：

点击查看摘要

Abstract:Learning high-fidelity point-cloud features in the 3D space poses significant challenges, including permutation invariance, lack of local context, difficulty in fine-grained surface reconstruction, and high computational cost. In this article, we propose Trans-Unet, a novel framework that addresses these issues by first tansforming 3D point-cloud data into a 2D grid domain and then employing a U-shaped hybrid model that integrates Convolutional Neural Networks, and self-attention mechanisms. The proposed Trans-Unet effectively learns and reconstructs precise features from high-resolution 3D point-cloud data (with 40,401 points in surface and 2,382 points in fiber) derived from a predefined finite element brain patch growth model, enabling accurate prediction of brain folding patterns. By combining multiple techniques, Trans-Unet leverages the complementary strengths: the 3D-to-2D transformation preserves fine-grained structural information while significantly reducing computational cost and the curse of dimensionality; convolutional blocks capture hierarchical, low-level local representations; and the self-attention mechanism models global, high-level semantics and long-range dependencies. The dataset consists of 3D point-clouds containing both brain surface patches and fiber information generated by a large-scale finite element model. Trans-Unet is applied to predict brain surface folding from the initial state (state 0 or states 0-2) to the final state (state 3). Experimental results demonstrate that Trans-Unet achieves high-resolution predictions of brain patch growth, surpassing existing methods in both fidelity and accuracy.

56. 【2607.21792】What Happens to Accuracy When Photo Lineups Contain Non-Mated Rank-One Images From Large Galleries?

链接：https://arxiv.org/abs/2607.21792

作者：Genesis Argueta,Kevin W. Bowyer,Michael King,Jayeeta Dhar

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：photo lineup, match a probe, surveillance video, driver licenses, gallery

备注： 22 pages, 18 figures, the last 8 pages are figures of suspects used

点击查看摘要

Abstract:One-to-many facial identification is commonly used to match a probe image from surveillance video against a gallery of driver's licenses and/or booking photos. The algorithm's rank-one image from the gallery, or a human examiner's selection from the algorithm's top-ranked images, may then be placed in a photo lineup shown to a witness. Witness selection of the gallery image in the photo lineup may then lead directly to the person in the gallery image being arrested. This facial identification process is involved in at least 9 wrongful arrests. This work specifically examines whether the probability of a witness making an incorrect identification increases with the size of the gallery searched. We compare photo lineup accuracy when the "suspect" image is drawn from galleries of 500, 5,000, and 24,000 images. We find that larger galleries increase both the likelihood of a witness making an incorrect identification and their confidence in that (incorrect) identification. These results raise questions of whether an image resulting from such a facial identification process should be used in photo lineups and of whether results of a photo lineup alone should constitute probable cause for arrest.

57. 【2607.21787】Risk-Routed Implicit Boundary Refinement for Robust Ultrasound Image Segmentation

链接：https://arxiv.org/abs/2607.21787

作者：Jingguo Qu,Xinyang Han,Xiang Wang,Yuqi Yang,Tonghuan Xiao,Sheng Ning,Jing Qin,Ann Dorothy King,Winnie Chiu-Wing Chu,Jing Cai,Michael Ying

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：faces significant challenges, significant challenges due, Medical ultrasound, image segmentation faces, segmentation faces significant

备注：

点击查看摘要

Abstract:Medical ultrasound (US) image segmentation faces significant challenges due to speckle noise, low-contrast boundaries, acoustic shadowing, and acquisition variation across operators and clinical centers. Although encoder-decoder and transformer-based networks have achieved strong performance, many methods recover boundary details through dense decoders or larger backbones, which may still produce over-smoothed contours or unstable predictions under external distribution shifts. In this article, we propose Risk-routed Implicit Boundary Refinement (RIBR), a compact segmentation framework that uses implicit neural representation as a risk-routed residual correction rather than an unconstrained full-mask predictor. RIBR combines boundary-refinement implicit residuals, risk-routed residual control, and geometry- and speckle-aware boundary regularization to refine uncertain contours while suppressing non-boundary oscillations. Evaluation on nine US datasets covering lymph nodes, breast lesions, thyroid nodules, and prostate shows that RIBR achieves the best overall macro-average and consistently reduces boundary error across grouped and organ-specific comparisons under a compact parameter budget. These findings suggest that controlled implicit residual learning is a practical strategy for resource-constrained and boundary-sensitive US segmentation. Source code is available at this https URL.

58. 【2607.21780】Khondo: A Multimodal Benchmark for Document Packet Splitting of Bangla Forms

链接：https://arxiv.org/abs/2607.21780

作者：Abu Tyeb Azad,Fahim Ahmed,Ishita Sur Apan,Ezharuddin Jubaer,Sumaiya Karim Katha,Armun Alam,Amin Ahsan Ali,Aman Chadha,Md Mofijul Islam,AKM Mahbubur Rahman

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：multiple documents concatenated, Bangladeshi government forms, single file, Bangladeshi government, multiple documents

备注：

点击查看摘要

59. 【2607.21776】Physiological Signals as a Forensic Modality for Talking-Face Deepfake Detection

链接：https://arxiv.org/abs/2607.21776

作者：Othmane Harraq,Tamer Aldwairi

类目：Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：deepfake generation synthesizes, generation synthesizes photore, static source image, alistic facial video, image-based detectors consistently

备注：

点击查看摘要

Abstract:Talking-face (TF) deepfake generation synthesizes photore- alistic facial video from a static source image and an au- dio signal, producing forgeries that current image-based detectors consistently fail to identify. Unlike face-swap ma- nipulation, TF synthesis has no underlying real video from which to inherit physiological characteristics, making re- mote photoplethysmography (rPPG) a uniquely motivated detection modality for this forgery category. We propose a detection framework that extracts per-video rPPG wave- forms via RhythmFormer and trains a suite of lightweight classifiers to distinguish real from synthesized physiologi- cal signals. Evaluated on the TF subset of Celeb-DF++ un- der a strict subject-independent protocol, where test identi- ties are completely separated from training identities, our 1D ResNet achieves an AUC of 0.806 and EER of 27.8%, placing it within 2.4 points of the best published general- purpose detector (Effort, ICML 2025) while operating ex- clusively on the physiological channel. We document a con- trolled reproduction study of DeepFakesON-Phys, the rep- resentative prior rPPG detector, demonstrating degrada- tion from AUC 0.999 on legacy face-swap data to 0.622 on the TF subset of Celeb-DF++. We further show that detec- tion difficulty is strongly method-dependent: AUC ranges from 0.985 (Real3DPortrait) to 0.690 (IP-LAP) across the seven TF generators, with the ranking remaining perfectly stable across all evaluation protocols. This spread reflects an interpretable physiological property of each generator rather than evaluation noise, and constitutes the primary theoretical contribution of the work.

60. 【2607.21722】Be Consistent! Enhancing Robust Visual Reasoning in LVLMs with Consistency Constraints

链接：https://arxiv.org/abs/2607.21722

作者：Liqiang Jing,Xiong Zhou,Siddharth Varia,Neha Anna John,Xinya Du,Vassilis N. Ioannidis

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large Vision-Language Models, strong perceptual capabilities, exhibit strong perceptual, Large Vision-Language, visual reasoning tasks

备注：

点击查看摘要

Abstract:While Large Vision-Language Models (LVLMs) exhibit strong perceptual capabilities, they remain vulnerable in visual reasoning tasks. Existing benchmarks largely focus on symbolic mathematical or scientific problems and simple vision-centric tasks, offering limited assessment of complex visual reasoning and logical consistency, a critical requirement for reliable reasoning systems. We introduce ConVBench, a complex vision-centric reasoning benchmark in which each image is paired with two logically equivalent questions across six categories: action and state, complex counting, spatial reasoning, causal and intent understanding, commonsense reasoning, and temporal perception. To complement this benchmark, we define two evaluation metrics, logical consistency and robust accuracy, that jointly assess both the correctness and consistency of model responses. We further present ConVLM, which improves LVLM reasoning through Group Relative Policy Optimization (GRPO)-based reinforcement learning with a novel consistency reward. This method leverages automatically generated logically equivalent question-answer pairs and a dual-reward design combining accuracy- and consistency-based signals, encouraging agreement between paired responses. The framework functions effectively with or without strict answer supervision.

61. 【2607.21694】Oxygen-TryOn: Fashion-Native Foundation Model for Any-item Virtual Try-On

链接：https://arxiv.org/abs/2607.21694

作者：Yong Liu,Xiaolong Fu,Zihang Xu,Wen Xue,Xueheng Li,Lin Song,Yuan Zhang,Chuyang Zhao,Haoyang Huang,Nan Duan,Yipeng Sun,Yan Li,Simiu Gu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：any-item virtual try-on, unified foundation model, unified foundation, any-item virtual, try-on

备注：

点击查看摘要

Abstract:We present Oxygen-TryOn, a unified foundation model for any-item virtual try-on. Rather than repurposing a general-purpose image editor, Oxygen-TryOn is fashion-native, built for try-on through a dedicated data engine and try-on-specific training. Given one or more reference items (clean product shots or in-the-wild worn-on photos) and a single target subject image, it synthesizes a photorealistic image of the subject wearing the items across virtually any fashion category. Prior systems handle a single garment category in a studio setting, and recent multi-reference methods remain garment-centric; in contrast, Oxygen-TryOn supports diverse items and scenarios, including full- and half-body views, a variable number of references, and free multi-item composition, while faithfully preserving both subject identity and item appearance. Instead of mask-based inpainting, we reformulate try-on as a multi-reference, understanding-driven generation task. We build a data engine that collects, manufactures, annotates, and filters high-quality try-on data at scale, and design a three-stage recipe of continued pre-training (CPT), supervised fine-tuning (SFT), and reinforcement learning (RL). The RL stage uses a hybrid reward combining an in-house try-on reward model with a proprietary, rubric-guided general-purpose model, jointly supervising fine-grained consistency and instruction-level quality. It also follows general editing instructions (e.g., pose changes) in the same pass. Across public benchmarks and our in-house Oxygen-TryOn Bench, it achieves state-of-the-art consistency and realism on single-item try-on and leads on multi-item try-on, matching or surpassing both leading proprietary systems (Nano Banana Pro, GPT-Image-2, Seedream5 Lite) and open-source models (FLUX.2).

62. 【2607.21673】Self-Poisoning in Adaptive Out-of-Distribution Detection: A Sharp-Threshold Theory and Certified Label-Free Calibration

链接：https://arxiv.org/abs/2607.21673

作者：Vishnu Bindu Balachandran

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

关键词：unlabelled stream, update a memory, Test-time adaptive, Test-time, memory bank

备注： 28 Pages, 5 figures

点击查看摘要

Abstract:Test-time adaptive out-of-distribution (OOD) detectors update a memory bank from the unlabelled stream. We show this adaptation obeys a provable dynamical law. Modelling bank impurity as a generalized Pólya urn, we prove almost-sure convergence to a mean-field equilibrium whose slope acts as a reproduction number. Below one, impurity stays benign. Above one, the bank is fully poisoned and the detector collapses. The measured admission kernel is affine ($R^2 \ge 0.996$) with slope just below one in every encoder family (a protocol signature), so this detector class is near-critical by design, and across 96 settings the predicted threshold matches the empirical collapse, where ungated dictionaries lose up to $0.163$ AUROC. We then prove that a certified admission gate, reading only a frozen reserve, severs the feedback loop and removes the transition at every contamination rate, even adversarially, while controlling false positives label-free. For the complementary static-calibration failure under drift we give CDC, which restores nominal FPR label-free on all tested drift-affected cells. Finally we prove a two-world impossibility theorem. Drift and contamination are indistinguishable without labels, forcing a closed-form power ceiling our procedure approaches. Together these give a complete possibility/impossibility characterization of label-free adaptive OOD detection.

63. 【2607.21672】Pixels for Programs? A Cross-Provider Case Study of Input-Token Accounting for Source Code as Text and Images

链接：https://arxiv.org/abs/2607.21672

作者：Ronak Bhalgami

类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Long source-code contexts, source-code contexts consume, Long source-code, motivating the proposal, source-code contexts

备注：

点击查看摘要

Abstract:Long source-code contexts consume many text tokens, motivating the proposal to render code as images for vision-language models. Recent work asks whether models can still solve code tasks after this transformation. We examine a different systems question: how commercial APIs count the resulting requests. We present a reproducible measurement case study of provider-reported input tokens for raw source text and a compact rendered-image representation. The benchmark pairs requests across five programming languages, nine source lengths from 20 to 2,000 lines, and 15 available model aliases exposed by Anthropic, OpenAI, and Google Vertex AI. These aliases collapse to approximately five distinct accounting signatures and are not independent model replications. Across 675 complete text/image pairs, aggregate image-to-text ratios are 0.135, 0.194, and 0.242, corresponding to reported input-token reductions of 86.5\%, 80.6\%, and 75.8\%, respectively. These totals conceal materially different break-even behavior: Anthropic and OpenAI images receive lower counts at every tested size, while Gemini images require 6.95 times as many tokens at 20 lines and cross below text only at 200 lines in the aggregate. A targeted audit also reproduces non-monotonic Gemini image accounting across a page boundary. This study measures black-box request accounting for one compact rendering pipeline. It does not measure semantic fidelity, task accuracy, latency, monetary cost, or coding-agent efficiency. We release the scripts, revision-pinned corpus specification, raw usage records, validators, and deterministic analysis needed to reproduce and extend the study.

64. 【2607.21622】Local Synaptic Rules Can Implement a SIGReg Gradient Without Backpropagation

链接：https://arxiv.org/abs/2607.21622

作者：Martin Andrews

类目：Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：self-supervised learning objective, SIGReg-like self-supervised learning, local synaptic learning, canonical local synaptic, synaptic learning rules

备注： 10 pages, 1 figure. Associated code at [this https URL](https://github.com/mdda/biological-sigreg)

点击查看摘要

Abstract:We prove that two canonical local synaptic learning rules, the potentiation arm of spike-timing-dependent plasticity (STDP$^+$) and homeostatic plasticity (instantiated here via flashlight granule-cell-like neurons), together can implement the exact gradient of a SIGReg-like self-supervised learning objective. The equivalence requires no gradient calculations, no global error signals, no weight transport, and no label information: the only inputs are pre- and post-synaptic firing rates, local firing statistics, and the temporal contiguity of natural sensory streams. On a synthetic clustering task designed to probe whether class structure can be recovered from temporal ordering of inputs alone, ordered presentation raised cluster separation (CSR) to 2.49 while random ordering left it near baseline (0.83), a roughly threefold ($\approx 3.5\sigma$) separation attributable solely to input ordering. On temporally ordered MNIST, a two-layer network trained entirely with these rules achieved 87.3% linear-probe accuracy, showing that the mechanism functions end-to-end.

65. 【2607.17441】An Explainable FFT-Based Spatial-Frequency Fusion Framework for Deepfake Detection

链接：https://arxiv.org/abs/2607.17441

作者：Pamela Kirui,Cho Hyuk,Qingzhong Liu,Haodi Jiang

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：digital media authenticity, raised growing concerns, Fast Fourier Transform, identity fraud, media authenticity

备注：

点击查看摘要

Abstract:Deepfake generation has raised growing concerns regarding digital media authenticity, misinformation, identity fraud, and public trust. Recent studies show that combining spatial and frequency features leads to stronger detection results than using independently. This paper presents MSCA-FFT, a Fast Fourier Transform (FFT)-based multi-scale cross-attention framework for image-level deepfake detection. The model combines a partially fine-tuned Xception spatial branch with an FFT-based frequency branch. The frequency branch processes the log-scaled FFT magnitude spectrum through shallow convolutional layers, avoiding inverse frequency-to-image reconstruction used in DCT-based pipelines. The spatial and frequency representations are refined by transformer encoders, fused through cross-attention, and passed to an MLP classifier for real/fake prediction. Experimental results show that MSCA-FFT achieves consistently higher performance than the DCT-based state-of-the-art spatial-frequency fusion method and the compared baseline models. The ablation study further indicates that the FFT-based frequency branch provides complementary spectral cues when fused with spatial features. In addition, FFT-based frequency analysis and Grad-CAM/LIME explanations show consistent evidence around manipulation-sensitive facial regions, including the eyes, mouth, nose, and facial boundaries.

66. 【2607.22077】he Lift Spectrum: How Measurement-to-Space Adaptivity Shapes Robustness in Image-Free Single-Pixel Sensing

链接：https://arxiv.org/abs/2607.22077

作者：Yuyuan Han,Jingwei Li,Long Qiu,Chong Wang,Wenxuan Hao,Jiangyu Han,Xinyu Yao,Yuchen He,Hui Chen,Jianbin Liu,Huaibin Zheng

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Optics (physics.optics)

关键词：Single-pixel sensing encodes, short sequence, image-free methods infer, encodes a scene, infer the task

备注： 26 pages (14 main text + 12 supplementary material), 9 figures. Submitted to IEEE Transactions on Computational Imaging

点击查看摘要

Abstract:Single-pixel sensing encodes a scene as a short sequence of coded measurements, and image-free methods infer the task directly from that sequence. Removing reconstruction does not remove the difficulty: it relocates it to the lift, the map from 1D measurements to a 2D representation, which prior work treats as a trivial reshape. We recast the lift as the central design axis of image-free sensing and order methods by how strongly it adapts to its input: a fixed-physics inverse (reconstruct-then-segment), a learned static projection, or a content-adaptive retrieval; position on this lift spectrum predicts behavior as acquisition degrades. The spatiotemporal soft-fusion (STSF) network pairs a probe-selected recurrent encoder with a cross-attention lift chosen by a parameter-matched ablation, ahead of its U-Net++ decoder, and trains under task-prioritized loss scheduling (TPLS), a scheduled reconstruction prior. In simulation, STSF+TPLS surpasses the prior image-free baseline on three datasets at 3.13% sampling (+3.2 to +9.9 pp foreground mIoU) and plateaus down to 0.39%. The strongest clean-trained reconstruct-then-segment baseline wins the noiseless limit, but under calibrated measurement noise image-free inference overtakes it, for a measured reason: the reconstruction pipeline amplifies the identical measurement noise before its segmenter reads it. Each region fails in its own signature: collapse, imprinting, or coarsening. STSF+TPLS transfers without fine-tuning to a real single-pixel bench as a proof of concept, at about 14 ms per mask. Charting the lift turns a scattered design space into a map of which lift to deploy at each operating point. Code and pretrained weights: this https URL

67. 【2607.21800】A Dual Path Framework with Hotspot Guided Fusion for Three Dimensional CT to PET Synthesis in Head and Neck Cancer

链接：https://arxiv.org/abs/2607.21800

作者：Mohd Maaz Khan,Oluwaseyi Oderinde

类目：Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV)

关键词：treatment planning, role in staging, providing functional information, plays a central, central role

备注： 25 pages, 11 figures

点击查看摘要

Abstract:18F-FDG PET/CT plays a central role in staging, treatment planning, and response assessment for head and neck cancer by providing functional information that complements anatomical CT imaging. However, PET acquisition requires radiotracer administration, specialized infrastructure, and additional cost, limiting its availability for repeated imaging. We present a proof of concept deep learning framework for synthesizing PET like images directly from routine CT scans with the goal of providing complementary metabolic information that may support imaging triage and clinical decision support rather than replace diagnostic PET. Forty-four patients from the publicly available QIN-HEADNECK dataset were retrospectively analyzed using five fold cross-validation. We propose a fully three dimensional dual path architecture consisting of (i) a regression U-Net optimized for voxel-wise quantitative SUV estimation and (ii) a conditional generative adversarial network optimized for realistic PET texture. Their outputs are integrated using hotspot guided Laplacian pyramid blending, allowing quantitative information from the regression pathway to be preserved within metabolically active regions while leveraging adversarial texture synthesis elsewhere. The proposed framework achieved a mean absolute error of 0.00395, PSNR of 39.19 dB, and SSIM of 0.9634 on reconstructed three dimensional PET volumes. Qualitative evaluation demonstrated accurate localization of many FDG-avid lesions while producing anatomically realistic background texture. Consistent with previous CT to PET synthesis studies, the principal limitation was systematic underestimation of SUV within highly metabolically active tumor regions.

68. 【2607.21675】Hash-QNeRF: Multiresolution Hash Encoding for Quantum Neural Radiance Fields

链接：https://arxiv.org/abs/2607.21675

作者：Digonto Biswas,Tana Ballove,Anjan Bandyopadhyay,Sutanu Mangal,Arun Kumar Pati

类目：Quantum Physics (quant-ph); Computer Vision and Pattern Recognition (cs.CV)

关键词：Neural Radiance Fields, implementations remain computationally, remain computationally intensive, classical implementations remain, Neural Radiance

备注：

点击查看摘要

Abstract:Neural Radiance Fields (NeRF) have revolutionized novel view synthesis, yet their classical implementations remain computationally intensive for high-fidelity rendering. QNeRF recently demonstrated the feasibility of training NeRF on gate-based quantum computers by combining amplitude embedding, parameterized quantum circuits (PQCs), parity-based measurements, and volumetric rendering. However, QNeRF relies on classical sinusoidal positional encoding for spatial coordinates, which scales poorly with scene complexity and resolution. In this work, we replace the sinusoidal positional encoding for spatial coordinates with the multiresolution hash encoding from Instant-NGP while keeping the view-direction encoding, amplitude MLP, quantum circuit, parity measurement, output scaling, and volumetric rendering pipeline unchanged. This hybrid design, Hash-QNeRF, retains the quantum radiance prediction step while benefiting from the fast convergence and memory efficiency of learnable hash grids. On a synthetic Blender scene, we achieve a final training loss of 0.003534, corresponding to approximately 24.5 dB PSNR on the fitted batch. Noise resilience experiments using Qiskit FakeKyiv and FakeTorino backends yield state fidelities of 0.93 to 0.98, indicating that hash encoding does not degrade the quantum circuit's noise tolerance.

Subjects:

Quantum Physics (quant-ph); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.21675 [quant-ph]

(or
arXiv:2607.21675v1 [quant-ph] for this version)

https://doi.org/10.48550/arXiv.2607.21675

Focus to learn more

              arXiv-issued DOI via DataCite</p>