本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新428篇论文，其中：

自然语言处理36篇
信息检索5篇
计算机视觉77篇

自然语言处理

1. 【2607.09623】ask-Specific Multimodal Question Answering Agents via Confidence Calibration and Incremental Reasoning for QANTA 2026

链接：https://arxiv.org/abs/2607.09623

作者：Nirjhar Das,Md. Al-Mamun Provath

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Multimodal Question Answering, present our submission, EMM-QA, Workshop on Efficient, QANTA

备注： 10 pages, 1 figure. Accepted at the EMM-QA 2026 Workshop, ICML 2026 (Non-Archival). Rank #1 overall system in the QANTA 2026 Challenge

点击查看摘要

Abstract:We present our submission to the QANTA 2026 shared challenge at the ICML 2026 Workshop on Efficient Multimodal Question Answering (EMM-QA). Quanta evaluates multimodal quizbowl systems that answer pyramid-style questions from incrementally revealed text and accompanying images while operating under realistic efficiency constraints. The challenge consists of two distinct tasks: Tossup questions, which require deciding when to answer under uncertainty, and Bonus questions, which emphasize accurate answer selection and human adoption. To address these differing objectives, we develop a task-specific two-agent architecture. Our Tossup agent utilizes a GPT-4o-mini-class model (referred to as GPT-4.1-mini in the competition logs) with confidence-calibrated answering and a domain-specific numeric reasoning policy that reduces overconfident predictions from isolated quantitative clues. Our Bonus agent uses GPT-4o-class model (referred to as GPT-4.1) with leadin-aware reasoning, structured relational reasoning, and multimodal evidence integration to improve exact answer selection. Rather than relying on a retrieval pipeline or model ensembles, our approach emphasizes efficient reasoning policies and confidence calibration within a hosted-only environment. Our system achieved the highest overall leaderboard score of 0.402, including a Tossup score of 0.238 and a Bonus Effect score of 0.164. The results demonstrate that lightweight, task-specific reasoning strategies can provide strong performance on resource-constrained multimodal question answering benchmarks.

2. 【2607.09611】oward Real-Time Sentence-Level Sign Language Translation

链接：https://arxiv.org/abs/2607.09611

作者：Thanh-Hoang Nguyen Doan(The University of Danang - University of Science and Technology)

类目：Computation and Language (cs.CL)

关键词：sign language understanding, understanding systems operate, language understanding systems, sign language translation, sentence-level sign language

备注： 8 pages, 4 figures, 9 tables

点击查看摘要

Abstract:Most sign language understanding systems operate at the level of isolated signs, limiting their usefulness in natural communication. We study sentence-level sign language translation (SLT) with the primary goal of real-time deployment rather than proposing a new translation architecture. We fine-tune a SHuBERT-ByT5 translation stack on a uniformly sampled 9,872-example subset of How2Sign, selected because of compute and storage constraints, using QLoRA while keeping SHuBERT frozen. The model obtains a validation BLEU of 16.7 and, on the test split, BLEU 15.9 and BLEURT 44.7. The main contribution is a hardware-aware streaming system: a Raspberry Pi 4B reference client provides camera capture, local text display, and speech output, while compute-intensive perception and translation run on a CPU/GPU backend. The capture protocol remains client-agnostic, so the same backend can serve a browser, phone, or laptop. Chunked ingestion, bounded queues, parallelized perception, temporal reordering, and a sentence-boundary state machine reduce mean post-finalization response latency from 1.873 to 1.354 seconds (27.71%) and P95 latency from 2.919 to 2.130 seconds (27.03%) over the complete 9,872-example working subset.

3. 【2607.09600】Agora: Enhancing LLM Agent Reasoning Via Auction-Based Task Allocation

链接：https://arxiv.org/abs/2607.09600

作者：Kaiji Zhou,Ales Leonardis,Yue Feng

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：requires effective orchestration, large language model, agents requires effective, diverse expert models, expert models

备注： Preprint. 12 pages, 4 figures

点击查看摘要

Abstract:Enhancing the reasoning capabilities of large language model (LLM) agents requires effective orchestration of diverse expert models and tools. However, existing frameworks typically call APIs based on coarse-grained matching between tasks and the functions of expert models or tools, while overlooking critical factors such as performance variability and cost efficiency among functionally similar alternatives. To address this, we propose Agora, a framework that introduces an incentive-compatible auction mechanism for dynamically allocating tasks to expert models and tools. By treating reasoning steps as tradeable items, Agora enables agents to bid based on their rectified competence-ensuring that critical logic is routed to the most capable solver rather than the most overconfident one. Evaluations across five benchmarks show that Agora improves over matched single-model, routing, and cascade baselines under comparable candidate pools, while exposing a controllable cost-quality trade-off through a single auction parameter.

4. 【2607.09598】okenizer Transplantation: Mitigating Autoregressive Collapse in Edge-Efficient Bengali ASR

链接：https://arxiv.org/abs/2607.09598

作者：Sanjid Hasan,Md. Abdur Rahman

类目：Computation and Language (cs.CL)

关键词：Lightweight speech recognition, speech recognition models, Lightweight speech, Moonshine often fail, highly optimized architectures

备注： 5 pages, 2 figures. Accepted as a poster at the MusIML Workshop, ICML 2026

点击查看摘要

Abstract:Lightweight speech recognition models are critical for edge deployment, yet highly optimized architectures like Moonshine often fail on morphologically rich, non-Latin languages such as Bengali. This study identifies the root cause of this failure as the model's English-centric byte-level tokenizer, which fragments Bengali words into high-fertility byte chains and triggers catastrophic autoregressive collapse during inference. To resolve this, a novel vocabulary transplantation pipeline is proposed to replace the decoder vocabulary with the native-script BanglaBERT WordPiece vocabulary and resize the corresponding token embedding matrix. Experimental results demonstrate a reduction in token fertility from 9.16 to 1.30. By decreasing autoregressive sequence length by 85.8%, decoding instability is entirely mitigated. When evaluated on the 882-hour Lipi-Ghor dataset, the modified architecture achieves a competitive 21.54% Word Error Rate (WER) and a Real-Time Factor (RTF) of 0.0053. Ultimately, this research provides a scalable, reproducible blueprint for cross-script adaptation of compact ASR models without the need for resource-intensive pre-training.

5. 【2607.09576】Conceptual Networks for Cross-Linguistic Idiomatic Expressions:A Feature-Based Graph Approach

链接：https://arxiv.org/abs/2607.09576

作者：Kiran Pala,Punam Silu,Lixun Yu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET)

关键词：typologically diverse languages, typologically diverse, large majority, conventional expressions, pairwise Jaccard similarities

备注：

点击查看摘要

Abstract:We present an interpretable network-based framework for representing idiomatic and figurative meaning across eight typologically diverse languages, totaling 160 conventional expressions, the large majority of which are idiomatic. Each expression is annotated with binary conceptual features (containment, concealment, emotional, social, etc.) derived from cognitive-linguistic theory, and pairwise Jaccard similarities define a weighted graph. Community detection reveals that idioms cluster by conceptual schema rather than by language, producing a structure consistent with cognitive-linguistic predictions. The conceptual network captures unique semantic information not present in distributional embeddings, can be scaled via automatic annotation with LLMs, improves downstream idiom detection, and remains robust when enriched with corpus frequencies. Cross-lingual transfer experiments show that conceptual proximity alone can identify acceptable translation equivalents across five language families, with substantial gains over embedding-based baselines. Ablation studies demonstrate that all three feature dimensions -- schemas, roles, and valence -- contribute non-redundantly to both the network's organizational properties and its performance on idiom detection, and that specific graph-derived signals (community membership, neighbor similarity) are particularly informative. The framework offers an interpretable, cross-linguistically stable representation of idiomatic meaning, combining theoretical grounding with practical utility.

6. 【2607.09530】FreyaTTS Technical Report

链接：https://arxiv.org/abs/2607.09530

作者：Ahmet Erdem Pamuk,Ömer Yentür,Ahmet Tunga Bayrak,Yavuz Alp Sencer Öztürk,Mustafa Yavuz

类目：Computation and Language (cs.CL)

关键词：efficient conversational synthesis, flow-matching Diffusion Transformer, conversational synthesis, designed for highly, highly reliable

备注：

点击查看摘要

Abstract:We introduce Freya-TTS, a compact, tokenizer-free, Turkish-first text-to-speech model designed for highly reliable and efficient conversational synthesis. Freya-TTS is a 183.2M-parameter non-autoregressive conditional flow-matching Diffusion Transformer (DiT) that operates in the frozen continuous latent space of AudioVAE2 (16 kHz encode, 48 kHz decode), allowing the model to focus its capacity on text-to-latent mapping while inheriting high-quality 48 kHz reconstruction. We advance the framework along three key dimensions: (1) rule-free end-to-end modeling from a 92-symbol Turkish character vocabulary without a phonemizer, grapheme-to-phoneme frontend, or discrete speech tokenizer; (2) non-autoregressive parallel denoising, which predicts the entire latent sequence simultaneously over a predicted duration; and (3) a production-oriented two-stage post-training recipe consisting of single-speaker voice locking and short-utterance coverage, improving speaker consistency and robustness on short inputs. On the Freya-TR-Eval benchmark, Freya-TTS achieves a band-matched word error rate (WER) of 8.0% and character error rate (CER) of 3.0%, outperforming substantially larger open-source systems while using a fraction of their parameters. The model achieves a real-time factor of 0.11 on consumer GPUs and runs faster than real time on a laptop CPU, making it well suited for resource-constrained edge deployment. We release the model weights, training and inference code, and evaluation benchmark under the Apache-2.0 license.

7. 【2607.09501】Normalisation-Based Likelihood Ratio Estimation for Forensic Authorship Verification

链接：https://arxiv.org/abs/2607.09501

作者：Sadie Barlow,Andrea Nini,Edoardo Manino

类目：Computation and Language (cs.CL); Applications (stat.AP)

关键词：Authorship verification, Hapax Correction, logistic regression calibration, task of determining, likelihood ratios

备注：

点击查看摘要

Abstract:Authorship verification (AV) is the task of determining whether two texts were written by the same author. In a forensic context, the strength of AV evidence can be quantified using likelihood ratios. Most AV methods are score-based and deriving well-calibrated likelihood ratios from these scores requires a separate calibration model. This, in turn, requires additional amounts of case-relevant data, which is often time-consuming to obtain and prepare. This study proposes two novel normalisation techniques, the Square Root Correction and the Hapax Correction, for deriving likelihood ratios from the AV method LambdaG without the need of a calibration model (Nini et al. 2026). These corrections are designed to mitigate the overestimation of evidential strength that may result from long or highly repetitive texts. Performance is evaluated against logistic regression calibration across fifteen corpora and a range of text lengths (100-9,500 tokens), using the log-likelihood ratio cost (Cllr). The proposed methods achieve performance comparable to logistic regression calibration, with the Hapax Correction outperforming it in approximately 45% of tests (weighted by corpora). Furthermore, performance was more frequently close (within 5%) when the Hapax Correction was outperformed by logistic regression calibration, compared with the reverse comparison. Eliminating the need to train a calibration model reduces data-requirements, time and complexity, thereby increasing the accessibility and transparency of forensic text comparison. This combination of empirical performance and practical advantages supports the adoption of the proposed methods in forensic settings.

8. 【2607.09487】Neural Collapse Is Forbidden: Information Floors in Language Models

链接：https://arxiv.org/abs/2607.09487

作者：Bruno Abrahao

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)

关键词：incomplete neural collapse, neural collapse, Within-class variance, language-model representations, representations is commonly

备注：

点击查看摘要

Abstract:Within-class variance in language-model representations is commonly read as incomplete neural collapse. We argue it is allocated information storage, and that the allocation obeys a law. A one-line centering identity voids a family of simplex equiangular-tight-frame claims, including our own earlier ones; in dimensionless variance shares across 14 models, macro-category structure carries only 4-12% of representational variance and within-token context carries 79-91%, stable across a 100x parameter range. On the theory side, token-level weight decay penalizes a category in proportion to its type count, not its occurrence mass, reducing next-token prediction to an imbalanced K-class problem whose optimum orders category norms by type count. A converse floor, proved for binary categories, forces within-category dispersion to be at least proportional to the conditional mutual information I(token; context | category). The law holds: identity dispersion, not total variance, tracks this information across every tested model and partition, under a model-free estimate and even across models, where one model's information predicts another's dispersion; and over pretraining the category share overshoots, decays, and partially recovers, because the information it must carry never left.

9. 【2607.09438】st-Time Scaling for Small VLMs on Multilingual Visual MCQ

链接：https://arxiv.org/abs/2607.09438

作者：Spiros Baxevanakis,Peng-Jian Yang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：small open vision-language, Test-time scaling, reliably improves reasoning, models remains unclear, large language models

备注： 14 pages, 2 figures, accepted at ImageCLEF 2026

点击查看摘要

Abstract:Test-time scaling (TTS) reliably improves reasoning in large language models, but whether it transfers to small open vision-language models remains unclear. We examine this on EXAMS-V, a multilingual visual multiple-choice benchmark, comparing self-consistency, describe-then-reason with PRM-guided beam search, and two post-hoc selectors across Qwen2.5-VL-7B-Instruct and Qwen3.5-4B. What matters is the conditions under which TTS runs, not the search or verification machinery. The largest factor is parseability: an early prompt format left many chains reasoning correctly yet never committing to an answer letter, which a standard answer cue and a guided repair step largely remove. A larger decoding budget removes the rest: raising the per-chain token limit from 1k to 2k recovers 3.7 pp, whereas sampling more chains (8 to 16) adds only 0.15 pp. Once chains have room to finish, elaborate methods contribute little: PRM-guided beam search trails plain self-consistency by 0.39 pp at over eight times the cost, and neither a training-free generative critic nor a trained multimodal PRM beats majority vote across both policies. The largest gain comes instead from the policy model itself (+11.4 pp). Our best configuration reaches 84.1% on the held-out ImageCLEF 2026 test split, ranking first on the Visual MCQ leaderboard.

10. 【2607.09424】A Sovereign, Open-Source Foundation Model for German and English

链接：https://arxiv.org/abs/2607.09424

作者：TheSoofi-Team:Benedikt Droste,David Fitzek,Ruben Härle,Lukas Helff,Maximilian Idahl,Alex Jude,Abbas Goher Khan,Maurice Kraus,Timm Ruland,Richard Rutmann,Sebastian Sztwiertnia,Markus Frey,Daniil Gurgurov,Jan Pfister,Tom Röhr,Sebastian von Rohrscheidt,Jörg Bienert,Nicolas Flores-Herr,Simon Gottschalk,Andreas Hotho,Kristian Kersting,Joachim Köhler,Alexander Löser,Wolfgang Nejdl,Simon Ostermann,Jan Plogsties,Patrick Putzky,Mehdi Ali,Michael Fromm,Max Lübbering

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Mamba Transformer foundation, hybrid Mamba Transformer, Transformer foundation model, Mamba Transformer, Transformer foundation

备注：

点击查看摘要

Abstract:We present Soofi S 30B-A3B, a sovereign, open-source Mixture-of-Experts (MoE) hybrid Mamba Transformer foundation model for German and English. Its hybrid design activates only 3B of 30B parameters per token and keeps the inference cache near-constant as context grows, giving it a decisive throughput advantage over dense models for long-context, high-concurrency deployment. Pretrained on roughly 27 trillion tokens with deliberately up-weighted German, Soofi S matches dense 14 to 27B models on aggregate English and German benchmarks while achieving the best code aggregates in both languages among 17 open base models, and outperforms every European sovereign baseline in our comparison, including ones far larger in active parameters. Among fully open models, Soofi S obtains the highest English and German evaluation scores, ahead of Olmo 3 32B and Apertus 70B. Soofi S was built end-to-end on the German Industrial AI Cloud, a sovereign HPC scale AI infrastructure operated by Deutsche Telekom in Munich. Soofi S will be released under highly permissive, open-access terms: weights, selected intermediate checkpoints, full per-source data accounting, hyperparameters, and training and evaluation code. Where source licenses permit, data-construction artifacts are released under permissive licenses; commercially licensed sources are documented with aggregate statistics and exact mixture accounting.

11. 【2607.09415】Self-Guided Test-Time Training for Long-Context LLMs

链接：https://arxiv.org/abs/2607.09415

作者：Xinyu Zhu,Zhe Xu,Xiaohan Wei,Yunchen Pu,Fei Tian,Chonglin Sun,Kaushik Rangadurai,Hua Zhi,Frank Shyu,Sandeep Pandey,Luke Simon,Yu Meng,Xi Liu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：guarantee effective utilization, large language models, increasingly important, important for large, large language

备注：

点击查看摘要

Abstract:Long-context processing has become increasingly important for large language models (LLMs), but simply extending the context window does not guarantee effective utilization of long inputs. As input length grows, accuracy often degrades, indicating that models still struggle to identify and use the evidence most relevant to a question. A promising way to improve long-context utilization is test-time training (TTT), which treats the test context as a training example for instance-specific parameter adaptation. However, applying TTT to the entire long context is prohibitively expensive, while adapting on randomly sampled spans introduces severe noise. Because most spans in a long context are irrelevant to the specific question, training on them may even degrade the base model's performance. Our preliminary study shows that TTT is highly sensitive to training-span quality: on LongBench-v2, TTT on randomly sampled spans hurts performance, whereas TTT on oracle spans substantially improves it. Motivated by this, we propose a simple method, Self-Guided TTT (S-TTT): before adaptation, the model identifies the evidence spans it should learn from, and the standard language-modeling training objective is applied only to those selected spans. On two challenging long-context reasoning benchmarks, LongBench-v2 and LongBench-Pro, S-TTT improves accuracy for both Qwen3-4B-Thinking-2507 and Llama-3.1-8B-Instruct, achieving up to a 15% relative improvement.

12. 【2607.09375】Mach-Mind-4-Flash Technical Report

链接：https://arxiv.org/abs/2607.09375

作者：Foundation Model Team(Li Auto Inc)

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Hybrid Median-length Policy, Median-length Policy Optimization, model achieves performance, activated parameters, scaling pre-training compute

备注：

点击查看摘要

Abstract:We present Mach-Mind-4-Flash, a 35B-parameter Mixture-of-Experts (MoE) agentic model with 3B activated parameters. Through post-training optimization alone without scaling pre-training compute, the model achieves performance on par with or surpassing that of 100B-parameter-class models. By introducing scalable agentic interaction environments for large-scale reinforcement learning, the model attains significant performance gains on real-world application tasks. Our pipeline comprises three stages: (1) a unified RL/OPD training infrastructure with dynamic multi-teacher scheduling and operator-level acceleration, delivering 17\% end-to-end training speedup; (2) multiple domain-specific RL experts trained in parallel across Reasoning, General, and Agent tracks, then fused into a single generalist via Multi-Teacher On-Policy Distillation (MOPD) -- a routed reverse-KL objective that eliminates the see-saw degradation of mixed-reward RL; (3) Hybrid Median-length Policy Optimization (HMPO), a single-stage token-efficiency method that compresses reasoning chains by 19--46\% with $\le$0.7 percentage-point accuracy loss. Mach-Mind-4-Flash scores 92.70 on AIME'26, 82.82 on IFBench, 80.74 on Behavioral-SafetyBench, 75.80 on BFCL-v4, 72.31 on BrowseComp-zh, and 84.20 on ClawBench -- leading or matching models with 10--30$\times$ its activated size at a fraction of the inference cost.

13. 【2607.09349】Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation

链接：https://arxiv.org/abs/2607.09349

作者：Cedric Caruzzo,Donggeun Yoo,Tae Soo Kim

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Toggle, Toggle Hugging Face, generation evaluation checks, Bibliographic Explorer Toggle, Toggle Bibliographic Explorer

备注： 24 pages, 7 figures, 12 tables

点击查看摘要

Abstract:Retrieval-augmented generation evaluation checks whether model claims are factually grounded in retrieved documents. It does not check whether retrieved evidence is attributed to the correct entity. A clinical RAG response can pass every automated check (zero hallucinations, near-perfect faithfulness, real citations) while presenting drug Y's clinical evidence as evidence about queried drug X. We term this deceptive grounding (DG): a failure invisible to faithfulness, hallucination, and citation checks because every claim is sourced from a real document, about the wrong entity. Using a controlled factorial benchmark across 13 models, we find DG rates spanning 8-87% at peak adversarial conditions. Medical and biomedical fine-tuned models reach up to 86.7%; domain specialization amplifies the failure rather than mitigating it. A controlled ablation identifies the mechanism: removing entity-specific clinical evidence from retrieved documents eliminates entity-attribution failure entirely, shifting all failures to confabulation. The two failure modes respond to the same trigger, taking different paths. Production measurement across 740 drug-disease pairs finds 7.8% overall DG in a deployed RAG system, rising to 13.6% for recently approved drugs. Entity-attribution verification (checking that cited evidence applies to the queried entity) detects DG at 97.0% precision and 98.7% DG recall (IPW-adjusted human gold standard); no existing framework implements it.

Comments:
24 pages, 7 figures, 12 tables

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

Cite as:
arXiv:2607.09349 [cs.CL]

(or
arXiv:2607.09349v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.09349

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Cedric Caruzzo [view email] [v1]
Fri, 10 Jul 2026 12:29:10 UTC (4,137 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled Deceptive Grounding: Entity Attribution Failure in Clinical Retrieval-Augmented Generation, by Cedric Caruzzo and 2 other authorsView PDFHTML (experimental)TeX Source

view license

Current browse context:
cs.CL

|
next

new
|
recent
| 2026-07

Change to browse by:

cs
cs.AI
cs.LG

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

信息检索

1. 【2607.09540】From Raw IDs to Semantic Planning: How Recommender Systems Utilize Information at Scale

链接：https://arxiv.org/abs/2607.09540

作者：Changhong Jin,Shiqiu Yang,Roger Zhe Li,Yingjie Niu,Aghiles Salah,Mete Sertkan,Zheng Ju,Xingsheng Guo,Huifeng Guo,Ruihai Dong,Barry Smyth

类目：Information Retrieval (cs.IR)

关键词：recommender systems, systems, recommender, information, recommender systems utilize

备注： 6 pages, 1 figures, RecSys 2026

点击查看摘要

Abstract:The evolution of recommender systems can be explored by asking how they utilize information at scale. Throughout most of the historical period under consideration during the past two decades, industrial systems have relied on raw IDs, which are discrete, globally unique, and semantically opaque identifiers that enable exact lookup, logging, and item-specific memorization at scale. Over time, however, recommender systems have sought to utilize richer sources of information, including item content, context, multimodal signals, and cross-domain structure. This development has led to a new stage in which part of such information is no longer used solely as auxiliary features around item identity, but is increasingly encapsulated in semantic IDs that provide a more structured, model-facing form of identity. We argue that this shift goes beyond the rise of generative recommendation over traditional methods. Indeed, it reflects a broader evolution in how recommender systems utilize information under industrial-scale constraints. This paper looks at the past, present, and future to examine three connected questions: why raw IDs dominated the early development of recommender systems, why semantic information is increasingly being encapsulated in IDs today, and what may come next once recommendations move beyond semantic retrieval. In particular, we introduce semantic planning as a possible future direction in which the system first predicts the semantic target of the next exposure, and only then instantiates that target as a specific item or generated creative. We further argue that such a shift may require changes not only in model design but also in evaluation and in the way recommender systems coordinate the objectives of users, platforms, and providers.

2. 【2607.09502】All Explanations are Wrong, But Many Are Useful: Exploring the Rashomon Explanation Set with Large Language Models

链接：https://arxiv.org/abs/2607.09502

作者：Pan Li

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：Explaining machine-learning models, persistent accuracy-explainability trade-off, existing Explainable, Explaining machine-learning, methods suffer

备注：

点击查看摘要

Abstract:Explaining machine-learning models is increasingly important for decision-making and consumer trust, yet it is widely believed to come at a cost: existing Explainable AI (XAI) methods suffer from a persistent accuracy-explainability trade-off. We argue that this trade-off is not fundamental, but an artifact of treating explanation and prediction as separate objectives; when properly coupled, they become complementary, so that equipping a model to explain itself improves, rather than degrades, its accuracy. We introduce the Rashomon Explanation paradigm, which builds a set of faithful, prediction-guiding explanations rather than a single one, and prove that this set is generally non-empty and that explanation fidelity bounds the performance of the models it guides. To explore this set, we propose RashomonLLM, an Explanation-Prediction-Reflection agentic workflow that generates explanations in natural language by iteratively aligning them with predictions, and we prove it converges and recovers the full set. Across customer-churn classification, clinical survival regression, and industrial click-through prediction on large-scale live-streaming logs, RashomonLLM significantly outperforms state-of-the-art prediction and XAI baselines on both accuracy and explanation quality, with gains driven by explanation fidelity and robust to distribution shifts, temporal splits, and seeds. Our framework thus advances business performance while laying the groundwork for consumer trust.

3. 【2607.09324】Letting the Data Speak: Extracting Keywords from Crowdsourced Collections with AI

链接：https://arxiv.org/abs/2607.09324

作者：Miguel Arana-Catania,Catherine Conisbee,Matthew Kidd

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：Hour Online Archive, Natural Language Processing, Finest Hour Online, Identifying and assigning, Named Entity Recognition

备注： 45 pages, 6 tables

点击查看摘要

4. 【2607.09316】Automatic Thematic Indexing of Large Literary Corpora: A Machine Learning Approach to Voltaire's Complete Works

链接：https://arxiv.org/abs/2607.09316

作者：Miguel Arana-Catania,Gillian Pink,Glenn Roe

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：assigning structured conceptual, structured conceptual labels, labour-intensive process, automatic thematic indexing, largely manual

备注： 22 pages, 3 figures, 3 tables

点击查看摘要

5. 【2607.09264】Beyond Topicality: A Conceptual Analysis of Societal Relevance and Its Application to Search Results and AI Responses

链接：https://arxiv.org/abs/2607.09264

作者：Dirk Lewandowski

类目：Information Retrieval (cs.IR)

关键词：Haider and Sundin, introduced by Haider, Sundin to address, traditional relevance models, address the limitations

备注：

点击查看摘要

Abstract:This paper examines "societal relevance," a concept introduced by Haider and Sundin to address the limitations of traditional relevance models in web search. While topical and user relevance are foundational to information science, they are insufficient for managing harmful content such as misinformation or discrimination found on the uncontrolled web. This study investigates three analytical questions: the definition of societal relevance, its practical application in search systems, and its distinction from information quality measures. By analyzing various combinations of system, user, and societal relevance, the paper explores how search outputs can be optimized for the "greater good". Although the concept remains theoretically underdeveloped, it provides a vital framework for developing value-driven search engines that prioritize ethical outcomes and societal interests over mere keyword matching.

计算机视觉

1. 【2607.09661】PanoWorld: Real-World Panoramic Generation

链接：https://arxiv.org/abs/2607.09661

作者：Haoyuan Li,Dizhe Zhang,Yuemei Zhou,Xiangkai Zhang,Haoran Feng,Xiaofan Lin,Wenjie Jiang,Bo Du,Ming-Hsuan Yang,Lu Qi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Geometry-aware Memory Augmentation, Dense Panoramic Ray-Conditioning, simplifies camera trajectories, Memory Augmentation, long-range memory

备注： Project page: [this https URL](https://lihaoy-ux.github.io/panoworld-page/) Code: [this https URL](https://github.com/Insta360-Research-Team/PanoWorld)

点击查看摘要

Abstract:In this work, we aim to address the challenge of long-range memory in panoramic world models by exploiting the rotation-equivariant property of omnidirectional representations, where rotation can be treated as an implicit geometric this http URL on this insight, we propose PanoWorld, which simplifies camera trajectories into translations via fixed headings for both current-action modeling and long-range memory through Dense Panoramic Ray-Conditioning (DPRC) and Geometry-aware Memory Augmentation (GMA).Then, a three-stage training pipeline is introduced to progressively optimize each component. To better evaluate physical consistency under large-scale spatial variations and diverse illumination conditions, where existing datasets are relatively stable, we construct World360, a large-scale dataset consisting of both real-world video clips collected via panoramic unmanned aerial vehicles and high-quality simulated clips generated by this http URL experiments on World360 demonstrate the effectiveness of PanoWorld, outperforming alternative methods by a large this http URL models, training code, and dataset will be publicly available. More information can be found on our project page: this https URL.

2. 【2607.09657】Scalable Visual Pretraining for Language Intelligence

链接：https://arxiv.org/abs/2607.09657

作者：Yiming Zhang,Zhonghan Zhao,Wenwei Zhang,Haiteng Zhao,Tianyang Lin,Yunhua Zhou,Demin Song,Kuikun Liu,Haochen Ye,Haian Huang,Yuzhe Gu,Haijun Lv,Qipeng Guo,Bin Liu,Gaoang Wang,Kai Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

关键词：rapid progress, progress of large, driven predominantly, large foundation models, pretraining

备注：

点击查看摘要

Abstract:The rapid progress of large foundation models has been driven predominantly by pretraining on large-scale text corpora. However, many forms of knowledge are conveyed through visual representations, where figures, typeset equations, and page layouts carry rich information that cannot be faithfully or completely captured by text alone. Yet current pretraining approaches discard these visual cues by converting visually rich sources, such as documents and web pages, into plain text for learning language intelligence. This paper challenges the default assumption that language models must be trained on text-only representations and shows that Visual Pretraining is a scalable learner for foundation model intelligence. To this end, we conduct a systematic study of unsupervised visual pretraining paradigms that directly leverage visual documents without text extraction. Across multiple backbones and benchmarks, visual pretraining on the same underlying corpora consistently outperforms text-only pretraining, offering an efficient pathway to scalable language intelligence.

3. 【2607.09655】OpenLongTail: Generative Scaling of Long-Tail Driving Data

链接：https://arxiv.org/abs/2607.09655

作者：Lulin Liu,Nuo Chen,Yan Wang,Bangya Liu,Wenyan Cong,Hezhen Hu,Boris Ivanovic,Hao Wang,Ziyao Zeng,Xinyu Gong,Yang Zhou,Zixiang Xiong,Dilin Wang,Zhangyang Wang,Weisong Shi,Ruohan Zhang,Marco Pavone,Zhiwen Fan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：curated datasets, fundamentally bottlenecked, scarcity of edge, edge cases, cases in curated

备注： Project page: [this https URL](https://openlongtail.github.io/)

点击查看摘要

Abstract:Scaling robust driving policies is fundamentally bottlenecked by the scarcity of edge cases in curated datasets. While the real world continuously captures these critical events, such long-tail events remain underutilized when collected from heterogeneous sources. Specifically, diverse but valuable in-the-wild long-tail videos lack the full view coverage required for training policy models, often missing multi-view poses or originating solely from monocular dash cameras. This modality gap prevents these ubiquitous observations from being converted into scalable training data for long-tail generalization. We introduce OpenLongTail, an open-source generative data engine for scaling autonomous driving policies under long-tail events. To transform heterogeneous data sources into view-aligned and temporally coherent multi-view assets that are useful for policy learning, we develop a pose-informed extrapolative view synthesis pipeline that generates the missing views. We further enhance cross-view consistency and the temporal alignment for the newly generated views by injecting Plücker ray geometry into the scalable generation engine. By synthesizing heterogeneous long-tail data, we observe a significant improvement in closed-loop driving robustness in handling long-tail events. By measuring the extrapolative view synthesis and pose metrics, we validate the effectiveness of OpenLongTail in visual fidelity, cross-view consistency, and ego-trajectory recovery.

4. 【2607.09654】Evolution of Accuracy and Visual-Cognitive Errors in a Decade of Vision-Language AI Models

链接：https://arxiv.org/abs/2607.09654

作者：Shravan Murlidaran,Miguel P. Eckstein

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Vision language models, made remarkable progress, Vision language, Complex Social Behavior, language models

备注：

点击查看摘要

Abstract:Vision language models (VLMs) have made remarkable progress in visual reasoning during the last decade. Most evaluations have used simple scenes (MS-COCO) that do not showcase complex human interactions or behaviors, only a handful of non-curated human descriptions as a benchmark, and have not focused on understanding the model's error types. Here, we introduce the Complex Social Behavior (CSB) dataset, containing 100 images depicting complex social interactions/behaviors. We analyze the progression of scene descriptions over a decade (2017-2025) of VLMs (four pre-Multimodal Large Language Models, MLLMs, and five MLLMs). We evaluate the accuracy of the models and 20 human descriptions relative to a gold standard on the CSB dataset and on a sample from MS-COCO. We analyzed five visual-cognitive error types: object detection, recognition, hallucination, scene understanding, and spatial dependence. The CSB dataset showed a more pronounced improvement than MS-COCO in scene description accuracy, with pre-MLLMs achieving much lower accuracy than the bottom-ranked human descriptions and MLLMs attaining accuracies similar to the top-ranked human descriptions. We show that MLLMs have eliminated the gap in scene description accuracy between simpler MS-COCO scenes and scenes depicting complex behaviors (CSB). MLLMs have almost eliminated all error types in our tested datasets, except for occasionally relying on different image regions for scene descriptions than humans do (spatial dependence error). We also show that detection, recognition, and hallucination errors have the highest impact on scene description accuracy. Together, our findings provide a more thorough evaluation of how visual language models have advanced over the last decade.

5. 【2607.09650】Revisiting Euler-Angle Regression with Kolmogorov-Arnold Networks

链接：https://arxiv.org/abs/2607.09650

作者：Yangting Sun,Zijun Cui,Yufei Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：including articulated robots, regressing Euler angles, Euler angles remains, real-world systems, including articulated

备注：

点击查看摘要

Abstract:In many real-world systems, including articulated robots and biomechanical models, rotations are defined in joint space and naturally parameterized by Euler angles with bounded ranges. Yet regressing Euler angles remains challenging, as their discontinuities and singularities often destabilize training. In this work, we revisit Euler-angle regression and show that its effectiveness depends critically on the interaction between rotation representation, regression architecture, and domain constraints. We introduce a new framework that combines range-aware Euler modeling with Kolmogorov-Arnold Networks (KAN), which replace fixed node-wise activations with learnable univariate functions on edges. We further provide theoretical analysis indicating that bounded Euler ranges motivate a near-additive structure in the regression function, which favors the additive functional form of KAN, and we confirm this trend empirically. Extensive experiments on controlled rotation regression, object pose estimation, and robotic and human inverse kinematics demonstrate consistent improvements in accuracy, convergence, and efficiency. The code will be publicly available.

6. 【2607.09630】he Effects of Synthetic Data and Label Distribution on Canola Branch Counting

链接：https://arxiv.org/abs/2607.09630

作者：Amirsalar Darvishpour,Mikolaj Cieslak,Adam Runions

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Collecting annotated plant, Collecting annotated, slow and expensive, annotated plant images, automated phenotyping

备注： 5 pages, 4 figures, submitted to EPA 2026

点击查看摘要

Abstract:Collecting annotated plant images for automated phenotyping is often slow and expensive. Plant models simulating growth and development can generate unlimited synthetic images with exact labels. However, previous work has established that whether incorporating synthetic data improves performance depends on the ratio of synthetic to real images and the label distribution of the synthetic dataset. To systematically quantify both factors, we train ResNet-18 models on a canola branch-counting task using a calibrated L-system plant model. We vary each factor independently. Synthetic-to-real ratios of 1:5 to 1:22 broadly improve performance; the best ratio (1:7) reduces mean absolute difference by 7.6% over real-only training. For label distribution, a uniform synthetic distribution is strongly suboptimal (abs. diff. of approximately 1.70); interpolating 90% toward the real distribution yields abs. diff. 0.927, whereas Gaussian smoothing of the real label distribution yields the best overall result (abs. diff. 0.912, a 14.7% improvement over real-only). A minimum of 10 synthetic images per label offers a simpler alternative with modest gains, while 100 per label over-corrects and hurts performance.

7. 【2607.09629】4DR360: State Reasoning for Joint 3D Detection and Occupancy Prediction in 4D Radar-Camera Full-Scene Perception

链接：https://arxiv.org/abs/2607.09629

作者：Xiaokai Bai,Lianqing Zheng,Runwei Guan,Songkai Wang,Siyuan Cao,Hui-liang Shen

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Reliable autonomous driving, autonomous driving requires, couples foreground objects, Reliable autonomous, dense semantic layout

备注： 5 pages, 8 figures

点击查看摘要

Abstract:Reliable autonomous driving requires full-scene perception that couples foreground objects with dense semantic layout. Recently, 4D millimeter-wave radar has emerged as a robust and affordable sensor, yet its sparse returns make radar-camera fusion necessary for comprehensive scene understanding. Existing radar-camera methods mainly optimize detection, while dual-task systems usually decode boxes and occupancy with limited interaction. To address this gap and advance radar-based multi-task learning, we propose \method, a 4D radar-camera framework for 360$^\circ$ full-scene perception, which models semantic occupancy as a persistent scene state rather than a terminal output. \method{} follows a cross-modal state reasoning paradigm, where the occupancy state is modeled and propagated through stages for coarse-to-fine feature aggregation. Specifically, State-guided BEV Enhancement (SBE) strengthens intra-frame BEV representation, while Doppler-guided Temporal Fusion (DTF) preserves state evidence over longer temporal horizons. Beyond the model, we further extend ManTruckScenes with satellite-map-based generated occupancy labels and pair it with OmniHD-Scenes in a unified cross-dataset detection-and-occupancy protocol. The resulting experiments cover accuracy, robustness, ablation, and efficiency under one radar-camera multi-task evaluation framework. Code and labels will be released upon acceptance.

8. 【2607.09583】Promptable Concept Segmentation from Above: Evaluating SAM 3's Zero-Shot and One-Shot Capabilities in Remote Sensing

链接：https://arxiv.org/abs/2607.09583

作者：Mohammad Dabaja,Turgay Celik

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：training-free computer vision, large-scale foundation models, Earth Observation imagery, promises a transition, transition toward open-vocabulary

备注： 14 pages, 4 figures

点击查看摘要

Abstract:The deployment of large-scale foundation models, such as the Segment Anything Model 3 (SAM 3), promises a transition toward open-vocabulary, training-free computer vision. However, their capacity to generalize out-of-distribution to the complex, top-down geometric structures of Earth Observation imagery remains largely unquantified. Driven by SAM 3's performance disparities in highly specialized domains, we present a comprehensive, multi-task empirical evaluation across remote sensing scene classification, object detection, and instance segmentation under strict zero-shot and one-shot constraints. To achieve this, we introduce a structural adaptation of SAM 3 by repurposing its decoupled binary presence head into a standalone zero-shot classifier. Furthermore, by systematically isolating textual and visual prompt modalities across five configurations, we explicitly diagnose the alignment mechanics within the model's multimodal decoder. Our findings reveal severe cross-modal interference: while visual prompts successfully align the decoder to complex remote sensing geometry, textual prompts inject misaligned, ground-level semantic bias, actively degrading coordinate regression. To benchmark these capabilities without resource-intensive training, we formulate a novel training-free proxy evaluation protocol for Generalized Zero-Shot tasks (scene classification and instance segmentation). Ultimately, our results demonstrate that SAM 3 avoids the overfitting commonly seen in legacy domain-adapted models, achieving high Harmonic Mean scores in segmentation tasks. However, it remains fundamentally constrained by sub-pixel resolution limits and overhead semantic blind spots, charting a definitive mandate for parameter-efficient geospatial fine-tuning of its multimodal decoder.

9. 【2607.09581】Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation

链接：https://arxiv.org/abs/2607.09581

作者：Mingyang Huang,Peng Zhang,Li Hu,Guangyuan Wang,Bang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

关键词：rhythmically synchronized dance, current diffusion models, significant challenge, primarily due, rhythmically synchronized

备注： 17 pages, 13 figures, project: [this https URL](https://github.com/Wan-Video/Wan-Dancer)

点击查看摘要

Abstract:Generating long-duration, high-definition, and rhythmically synchronized dance videos directly from music remains a significant challenge, primarily due to the temporal constraints of current diffusion models, which typically fail beyond 20 seconds. Existing approaches, whether they rely on intermediate 3D skeletons or on end-to-end video synthesis, suffer from temporal drift, identity inconsistency, and repetitive motion patterns when extended to longer horizons. To address these limitations, we propose a novel hierarchical framework for minute-scale coherent music-to-dance generation. Our method decouples the process into global keyframe planning and local temporal refinement, leveraging full-track musical context to ensure long-range coherence. Key innovations include dynamic frame rate adaptation via time-mapped RoPE embeddings for precise alignment, an optical-flow-based loss function to enhance motion continuity, and motion-speed control to preserve high-fidelity details during rapid movements. Extensive experiments demonstrate that our framework surpasses the conventional duration barrier, generating stable, 720p/30fps videos exceeding one minute with superior temporal stability. Furthermore, the model exhibits robust versatility across five distinct dance genres, conditioned on both audio and textual prompts, establishing a new state-of-the-art in coherent, long-form dance video synthesis.

10. 【2607.09562】CLA: Training-Free Class-wise Logit Adaptation for Medical Vision-Language Models

链接：https://arxiv.org/abs/2607.09562

作者：Tianyou Jiang,Ziyu Zhou

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Medical Vision-Language Models, exhibit strong zero-shot, class bias inherited, Vision-Language Models, strong zero-shot performance

备注：

点击查看摘要

Abstract:Medical Vision-Language Models (VLMs) exhibit strong zero-shot performance, yet their effectiveness still declines on out-of-distribution (OOD) data due to domain shifts and class bias inherited from large-scale pretraining. Existing few-shot adaptation methods typically introduce additional trainable components, which can be unstable in extremely low-data regimes (e.g., 1-shot), and lack robustness on different medical data. We present TCLA, a purely training-free few-shot adaptation method for Medical VLMs, which is fast and model-agnostic. TCLA corrects inference logits based on a small set of support samples, boosting pretrained VLMs performance by improving inter-class deconfusion and reducing domain shift. Extensive experiments on nine datasets across multiple medical imaging modalities including X-ray, Ultrasound, MRI, CT, Histopathology, demonstrate that TCLA consistently improves OOD performance of Medical VLMs and, in most of cases, outperforms existing training-based adaptation methods.

11. 【2607.09544】he Count Is There, but Misaligned: Understanding and Correcting Counting Failures in VLMs

链接：https://arxiv.org/abs/2607.09544

作者：Ahmed Oumar El-Shangiti,Abzal Nurgazy,Hilal AlQuabeh,Nikolai Rozanov,Kentaro Inui

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：multimodal tasks, basic object counting, struggle with basic, basic object, counting

备注：

点击查看摘要

Abstract:Despite strong performance on many multimodal tasks, vision-language models (VLMs) still struggle with basic object counting. We investigate whether this reflects missing internal knowledge or a gap between internal representations and verbalized outputs. Training simple probes on activations from four VLMs across five counting datasets reveals that nonlinear probes can reliably detect counting errors, suggesting that VLMs often encode the correct count even when they output the wrong answer. SVCCA analysis shows that probes trained on ground-truth counts and probes trained on model outputs occupy a partially shared activation subspace but read out along misaligned directions. We further validate our findings using a causal steering intervention, proving that strengthening the direction of count-identified probes does improve model counting performance. Motivated by this result, we propose a detector-guided self-correction method that selectively re-prompts the model only when an internal error detector predicts failure. This simple inference-time intervention improves counting accuracy by up to 15.6 absolute percentage points, without any parameter updates. Our results establish activation-based error probing as both a practical tool for improving VLM counting and a mechanistic lens on the gap between internal knowledge and model outputs.

12. 【2607.09526】ALICE: Learning a General-Purpose Pathology Foundation Model from Vision, Vision-Language, and Slide-Level Experts

链接：https://arxiv.org/abs/2607.09526

作者：Jiawen Li,Tian Guan,Huijuan Shi,Xitong Ling,Mingxi Fu,Anjia Han,Chao He,Yonghong He

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：fragmenting complementary expertise, capabilities remain shaped, data sources, pretraining objectives, spatial scales

备注：

点击查看摘要

Abstract:Foundation models are reshaping computational pathology, yet their capabilities remain shaped by pretraining objectives, data sources, and spatial scales, fragmenting complementary expertise across separate backbones. Here we present ALICE, a unified foundation model trained through multi-stage agglomerative distillation that sequentially distills eight vision-only, vision-language, and slide-level teacher models into dedicated modules of a single backbone. ALICE is pretrained on 24,985,184 tile-level pathology images and 155,604 high-resolution images, and evaluated across 21 task scenarios, 96 downstream tasks, and 48 data sources, spanning region-of-interest tissue analysis, vision-language multimodal evaluation, and whole-slide clinical assessment. In all three evaluation settings, ALICE achieved the best average rank among task-matched pathology foundation models. These results demonstrate that agglomerative distillation can consolidate complementary capabilities from specialized models into a unified backbone for broad computational pathology applications. The model is available at this https URL.

13. 【2607.09520】Seeing is Free, Speaking is Not: Uncovering the True Energy Bottleneck in Edge VLM Inference

链接：https://arxiv.org/abs/2607.09520

作者：Junfei Zhan,Haoxun Shen,Mingang Guo,Zixuan Huang,Tengjiao He

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：remains poorly understood, hardware remains poorly, poorly understood, energy, perceptual backbone

备注： Accepted to ACM MM 2026. 10 pages, 5 figures

点击查看摘要

Abstract:Vision-Language Models (VLMs) are the perceptual backbone of embodied AI, but their energy footprint on edge hardware remains poorly understood. Existing efficiency efforts focus predominantly on reducing visual tokens, implicitly treating visual processing as the dominant energy cost. We overturn this implicit assumption through the first systematic energy profiling of on-device VLM inference, spanning five models across three architecture families, four input resolutions, and two hardware platforms (NVIDIA RTX 3070 and Jetson Orin NX). Our analysis yields three findings. First, average inference power is a model-intrinsic constant, invariant to input resolution, image complexity, and prompt type, with less than 5% variation across all conditions. This means that all energy variation across inputs must arise from variation in inference time, not from variation in power draw. Second, each output token costs 11 to 39x more wall-clock time than each input token due to the compute-bound and memory-bound asymmetry between prefill and decode, making output token count the dominant driver of both latency and energy. Third, image complexity, measured by the number of objects in an image, induces up to 4.1x energy differences at identical resolution. This variation arises not from increased visual processing cost, but from differences in output length. These findings expose a fundamental limitation of visual token pruning: even removing all visual tokens saves at most 10% of total energy for fixed-token models. Across models spanning 1 billion to 8 billion parameters, controlling output length saves up to 97% of total energy, with the energy dominance of decoding growing stronger at larger model scale. In short, the true energy bottleneck in edge VLM inference is not what the model sees, but how much it says.

14. 【2607.09507】DGSfM: Depth-Guided Scale-Aware Global Structure-from-Motion

链接：https://arxiv.org/abs/2607.09507

作者：Sithu Aung,Viktor Kocur,Yaqing Ding,Torsten Sattler,Zuzana Kukelova

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：recovering camera poses, structure from unordered, efficient paradigm, paradigm for recovering, recovering camera

备注：

点击查看摘要

Abstract:Global Structure-from-Motion (SfM) is an efficient paradigm for recovering camera poses and sparse 3D structure from unordered images. However, its reliance on scale-ambiguous epipolar geometry makes global positioning sensitive to noisy baseline estimates and weak view-graph constraints, while false edges from visually ambiguous pairs can further degrade reconstruction. We propose DGSfM, a depth-aware global SfM pipeline that uses monocular depth maps as a scalable prior while preserving explicit multi-view optimization. For each image pair, we use a depth-aware relative pose solver to convert scale-ambiguous epipolar constraints into scale-aware relative pose constraints. We further improve robustness through view-graph filtering and depth-consistency-based correspondence pruning, which suppress false edges and matches that remain plausible under epipolar geometry alone. Finally, global scale averaging and depth-guided pose-point initialization align monocular depth maps into a common reconstruction scale and provide stable initialization for global positioning and bundle adjustment. Experiments on ETH3D and IMC2021 show that DGSfM consistently improves over strong global SfM baselines across sparse and dense matching front-ends, achieving substantial gains in pose accuracy. Code is available at this https URL.

15. 【2607.09503】What VGGT Knows About Overlap: Probing Geometric Foundation Models for Co-Visibility

链接：https://arxiv.org/abs/2607.09503

作者：Filippo Ziliotto,Luciano Serafini,Lamberto Ballan,Tommaso Campari

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：overlapping visible surfaces, share overlapping visible, image pairs share, pairs share overlapping, reconstruction and robotic

备注：

点击查看摘要

Abstract:A fundamental challenge in 3D reconstruction and robotic localization is co-visibility: determining which image pairs share overlapping visible surfaces, particularly in scenarios with minimal overlap. We demonstrate that VGGT implicitly encodes co-visibility as an emergent behavior: without any supervision for this task, its internal representations exhibit a clear hierarchical structure mirroring that of large language models, i.e. early layers build a 3D-aware scene representation, while late layers act as dedicated co-visibility reasoners. In particular, we identify layer L17 as a negative anchor that consistently routes non-co-visible pairs for this backbone, regardless of the evaluation setting, providing task-grounded evidence of layer specialization in a geometry-grounded foundation model. Building on this, we introduce Co-VGGT, which freezes VGGT and trains only a lightweight layer-wise mixture-of-experts head (less than 7.5M parameters) to classify co-visibility from RGB alone, treating each layer as a specialized expert whose geometric abstraction is adaptively weighted per input pair. On the Co-VisiON benchmark, Co-VGGT surpasses the human annotation baseline and improves over prior work by more than 25% pairwise and 10% multiview. Pairwise predictions are well-calibrated (ECE=0.030), enabling direct use as edge weights in visibility graphs for downstream SfM and SLAM pipelines without post-hoc correction. Code and data are available.

16. 【2607.09488】SigLIP-HD by Fine-to-Coarse Supervision

链接：https://arxiv.org/abs/2607.09488

作者：Lihe Yang,Zhen Zhao,Hengshuang Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：High-quality visual representation, High-quality visual, computer vision, long-standing pursuit, pursuit in computer

备注： ICLR 2026. Code and model: [this https URL](https://github.com/LiheYoung/SigLIP-HD)

点击查看摘要

Abstract:High-quality visual representation is a long-standing pursuit in computer vision. In the context of multimodal LLMs (MLLMs), feeding higher-resolution images can produce more fine-grained visual tokens. However, it introduces additional computational and design complexity, due to multiple forward passes and post-processing of increased tokens. Before simply adopting a higher resolution, have we truly unlocked the model's full perception capability at a standard resolution? Therefore, we study an interesting problem: how to achieve fine visual perception under lower cost without larger images. We present SigLIP-HD in this work. The core is a highly simple fine-to-coarse supervision design. We enforce the coarse feature of a mid-resolution image to mimic the fine-grained feature of its high-resolution version. We build this framework on the advanced SigLIP 2 model. Our final model produces better visual tokens at exactly the same inference budget. It is validated on extensive MLLM benchmarks and consistently delivers stronger results than our baseline model, especially on OCR-related tasks.

17. 【2607.09481】Decoupling Language Guidance from Backbones for Text-Guided Medical Segmentation

链接：https://arxiv.org/abs/2607.09481

作者：Yungeng Liu,Xuanzi Fang,Haijin Zeng,Qi Dai,Yongyong Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：existing models bind, segmentation leverages clinical, leverages clinical semantics, Text-guided medical image, medical image segmentation

备注：

点击查看摘要

Abstract:Text-guided medical image segmentation leverages clinical semantics to improve lesion delineation, yet many existing models bind cross-modal fusion, supervision, and decoder design into a task-specific architecture. Such tight coupling makes it difficult to reuse language guidance modules across heterogeneous vision and text backbones, and often requires redesigning the network when the encoder pair changes. This paper presents BTHA, a backbone-transferable hierarchical adapter framework for text-guided medical image segmentation. BTHA is built around a stable feature-level interface: given multi-scale visual features and a text representation, it injects semantic guidance through shape-preserving adapters while maintaining the decoder-side tensor contract. To make this interface effective, we introduce a Hierarchical Coarse-to-Fine Supervision Strategy that decomposes learning into global image-text alignment, multi-scale auxiliary localization, and boundary-aware final mask refinement. We further design a Scale-Adaptive Gated Semantic Guidance (SAGSG) adapter, where resolution-specific gates adaptively control textual injection and channel recalibration suppresses redundant cross-modal responses. Evaluations across diverse vision and text backbones show that the same adapter and supervision design remains effective across convolutional and transformer-based visual encoders as well as different language encoders. Experiments on four public datasets further demonstrate that BTHA improves strong text-guided baselines with modest computational overhead.

18. 【2607.09480】Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers

链接：https://arxiv.org/abs/2607.09480

作者：Ibrahim Batuhan Akkaya,Kishaan Jeeveswaran,Bahram Zonooz,Elahe Arani

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

关键词：human visual system, employs foveated sampling, achieve efficient perception, Foveated Dynamic Transformer, visual system

备注：

点击查看摘要

Abstract:The human visual system (HVS) employs foveated sampling and eye movements to achieve efficient perception, conserving both metabolic energy and computational resources. Drawing inspiration from this robustness and adaptability, we introduce the Foveated Dynamic Transformer (FDT), a foveation-guided dynamic token-selection architecture that integrates these mechanisms into a vision transformer framework. The FDT exhibits strong resilience to various types of noise and adversarial attacks, despite not being explicitly trained for such challenges. This inherent robustness is achieved through the use of fixation and foveation modules: the fixation module identifies fixation points to filter out irrelevant information, while the foveation module generates foveated embeddings with multi-scale information. At the 50% fixation-budget setting, FDT achieves higher accuracy than DeiT-S (81.9% vs. 80.9%) while reducing multiply-accumulate operations by 34.57%, highlighting one operating point on its accuracy-efficiency trade-off. These attributes position FDT as an HVS-inspired step toward artificial neural networks that combine adaptive computation with improved resilience.

19. 【2607.09455】Hydra++: Real-Time Hierarchical 3D Scene Graph Construction With Object-Level Shape Estimation

链接：https://arxiv.org/abs/2607.09455

作者：Hyungtae Lim,Nathan Hughes,Xihang Yu,Ruihan Xu,Yun Chang,Jingnan Shi,Rajat Talak,Luca Carlone

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：encoding spatial entities, scene graphs provide, spatial entities, encoding spatial, scene graph

备注： 8 pages, 12 figures, accepted in Proc. IEEE/RSJ IROS

点击查看摘要

Abstract:3D scene graphs provide a hierarchical abstraction of environments by encoding spatial entities, such as objects and places, and their relationships. However, existing scene graph systems model object geometry coarsely, relying on partial point clouds or class-level CAD templates, which limits instance-specific shape detail. This paper presents Hydra++, a system-level investigation into how learning-based object shape estimators can be integrated into a hierarchical 3D scene graph pipeline. Hydra++ incorporates category-agnostic shape estimation and a reprojection-mask consistency check to reject degenerate predictions from partial observations or imprecise segmentation. In its default CRISP-based configuration, Hydra++ performs online scene graph construction; slower estimators such as SAM3D are evaluated as modular alternatives to demonstrate generalization-latency trade-offs. Furthermore, to address the challenges of sparse and noisy depth measurements in outdoor environments, Hydra++ supports a hybrid LiDAR-camera configuration for large-scale operation, improving scene-level reconstruction quality. Experiments in both simulation and real-world outdoor campus scenarios demonstrate that Hydra++ improves object- and scene-level reconstruction quality. Project page is available at this https URL.

20. 【2607.09450】Robustifying Vision-Language Models via Test-Time Prompt Adaptation

链接：https://arxiv.org/abs/2607.09450

作者：Xingyu Zhu,Huanshen Wu,Shuo Wang,Beier Zhu,Jiannan Ge,Jiaheng Zhang,Long Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Pre-trained Vision-Language Models, CLIP achieve strong, strong zero-shot generalization, achieve strong zero-shot, performance degrades sharply

备注： ICML 2026 regular

点击查看摘要

Abstract:Pre-trained Vision-Language Models (VLMs) such as CLIP achieve strong zero-shot generalization, but their performance degrades sharply under adversarial perturbations. Existing test-time adaptation methods typically rely on sample-level confidence heuristics, overlooking the intrinsic distributional structure of the data. This sample-centric approach limits robustness, as it fails to distinguish confident adversarial mispredictions from true semantic consistency. In this work, we observe that adversarial distortion is structurally brittle: while holistic representations are corrupted, semantic integrity is often preserved in the distribution of augmented views. Motivated by this insight, we propose RITA, a Robust test-tIme prompt-TAdaptation framework that shifts from sample-level estimates to distribution-level alignment. Specifically, RITA employs optimal transport to align the distribution of augmented visual features with textual prototypes, mitigating adversarial outliers and rectifying cross-modal semantic misalignment. Furthermore, we introduce a dynamic cache to progressively accumulate reliable cues from the test stream for online refinement. Extensive experiments demonstrate that RITA significantly improves adversarial robustness without compromising clean accuracy.

21. 【2607.09443】Parameter-Efficient Vision-Language Adaptation with Continuous Metadata Conditioning for Animal Re-Identification

链接：https://arxiv.org/abs/2607.09443

作者：Anil Osman Tur,Tonje Knutsen Sordalen,Kim Tallaksen Halvorsen,Cigdem Beyan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Long-term animal re-identification, gradual morphological evolution, Long-term animal, seasonal appearance shifts, temporal distribution shifts

备注： This is the author's version of the paper accepted for publication in Expert Systems with Applications. The final authenticated version will be available from the publisher

点击查看摘要

Abstract:Long-term animal re-identification (ReID) must remain robust to gradual morphological evolution and seasonal appearance shifts. Although recent vision-language models provide strong pretrained visual representations, adapting them to longitudinal ecological settings remains challenging, particularly under identity and temporal distribution shifts. We present a parameter-efficient CLIP adaptation framework for animal ReID and introduce a continuous metadata-conditioning mechanism that incorporates numerical attributes directly into the prompt representation during training. While low-rank visual adaptation, prompt-based supervision, and cross-modal alignment provide the adaptation framework, the proposed metadata-conditioning strategy constitutes the primary methodological contribution. By preserving the continuous structure of numerical metadata rather than discretizing it into textual categories, the proposed approach enables smooth modulation of the embedding space during training while maintaining a purely visual inference pipeline. Experiments on a seven-year longitudinal fish dataset and multiple wildlife benchmarks demonstrate improved performance under closed-set, open-set, and time-aware evaluation protocols. The results demonstrate that continuous metadata conditioning improves robustness to longitudinal appearance variation and temporal distribution shifts, while parameter-efficient adaptation enables a purely visual inference pipeline without requiring metadata at test time. Code and evaluation splits can be found at: this https URL.

22. 【2607.09428】Multimodal Scenario Similarity Search for Autonomous Driving

链接：https://arxiv.org/abs/2607.09428

作者：Tamás Matuszka,András Tamásy,Balázs Szolár

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：identify situations similar, Large-scale autonomous-driving datasets, Large-scale autonomous-driving, vast numbers, numbers of recorded

备注：

点击查看摘要

Abstract:Large-scale autonomous-driving datasets contain vast numbers of recorded scenarios, creating a need for efficient retrieval methods that can identify situations similar to a given query. Existing approaches typically rely on either visual representations or motion-based descriptions, making it difficult to understand their relative strengths and limitations for scenario retrieval. In this work, we present a multimodal framework for autonomous-driving scenario retrieval that combines visual and trajectory-based representations within a unified retrieval pipeline. We investigate two trajectory-based approaches: Exo-Trajectory, an explicit matching method based on surrounding-agent motion, and ScenarioFormer, a transformer-based representation learned from object trajectories using contrastive learning. We compare these approaches against strong vision-based baselines and analyze their behavior across a diverse set of driving scenarios. Experimental results show that trajectory representations provide strong retrieval performance for motion-centric events such as cut-ins, turning maneuvers, and traffic queueing, while visual embeddings excel when appearance cues are informative. Most importantly, combining visual and trajectory information consistently improves retrieval quality, yielding the best overall performance. These findings demonstrate that appearance and motion capture are complementary notions of scenario similarity and motivate multimodal retrieval systems for autonomous-driving data mining, dataset curation, and scenario-based validation.

23. 【2607.09417】SVF-CR: Synchronized Visual-Facial Cross-Refinement for Multimodal Ambivalence and Hesitancy Recognition

链接：https://arxiv.org/abs/2607.09417

作者：Hyein Park,Namho Kim,Junhwa Kim

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：subtle behavioral states, verbal content, combination of verbal, subtle behavioral, behavioral states

备注：

点击查看摘要

Abstract:Ambivalence and hesitancy are subtle behavioral states that are expressed through a combination of verbal content, facial behavior, visual context, and acoustic cues. Effective recognition therefore requires not only extracting informative unimodal representations, but also modeling how temporally aligned behavioral evidence interacts across modalities. In this paper, we propose a synchronized visual-facial cross-refinement framework (SVF-CR) with pairwise multimodal evidence fusion for ambivalence and hesitancy recognition. The proposed method first extracts whole-video segment tokens and cropped-face segment tokens using the same temporal partition. The synchronized visual and facial tokens are refined through intra-modal self-attention and bidirectional visual-facial cross-attention, allowing whole-video context and local facial behavior to mutually refine each other before evidence construction. We then construct segment-level visual-facial evidence using consistency and discrepancy modeling, followed by temporal self-attention and attention pooling. Textual and acoustic features are lightly refined through context self-attention and are fused with the enhanced visual-facial evidence at the final decision stage using pairwise evidence fusion. Experiments on the BAH (Behavioral Ambivalence/Hesitancy) public evaluation split show that the proposed synchronized visual-facial cross-refinement improves public macro-F1 over both global visual-face token fusion and synchronized evidence baselines, achieving a public macro-F1 of 0.7156. Code is available at : this https URL\_SVF-CR.

24. 【2607.09362】CtrlVTON: Controllable Virtual Try-On via Visual-Instance-Prompt Segmentation

链接：https://arxiv.org/abs/2607.09362

作者：Seungyong Lee,Hyun Jun Jang,Sangoh Kim,Sungjoon Park

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：made significant progress, realistically transferring garments, Virtual try-on, made significant, significant progress

备注： 13 + 17 pages, 20 figures

点击查看摘要

Abstract:Virtual try-on (VTO) has made significant progress in realistically transferring garments onto a target person. Yet most systems give the user little control over how a garment should be worn -- its size (loose or fitted), style (e.g., tucked in or untucked, open or closed), and spatial placement on the body. We address this gap with two complementary contributions. First, we define and solve Visual-Instance-Prompt Segmentation via VIP-SAM: given a flatlay image of a garment, segment that specific instance in a photograph of a person wearing it. This is an instance-level task, distinct from the typically studied category-level segmentation. Second, we introduce CtrlVTON, a controllable VTO framework that recasts try-on as an image editing problem and adds segmentation masks as pixel-level control over garment layout, including style, size, and spatial placement on the body. VIP-SAM and CtrlVTON each achieve state-of-the-art results on their respective tasks. In particular, CtrlVTON generates images that follow user-provided layouts far more faithfully than the strongest proprietary editing systems while matching them on garment fidelity.

25. 【2607.09351】Simon-SR: Spatially Adaptive Modulation and Visual Prompt Adaptation for Text-Reinforced Super-Resolution

链接：https://arxiv.org/abs/2607.09351

作者：Haotong Cheng,Yuxuan Li,Zijie Cui,Rongling Tan,Chenyuan Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Single Image Super-Resolution, reconstructs high-quality images, Single Image, Image Super-Resolution, high-quality images

备注： Multi-modal Single Image Super-Resolution

点击查看摘要

Abstract:Single Image Super-Resolution (SISR) reconstructs high-quality images from low-resolution inputs. While recent multi-modal methods improve perceptual quality, they remain sensitive to erroneous priors and require expensive annotations. To address these issues, we propose Simon-SR, a multi-modal SISR framework leveraging learnable prompts for efficient semantic mining and robust text-image fusion. Our approach combines Contrastive Prompt Learning with Prompt-Guided Spatially Adaptive Refinement to enhance multi-modal alignment. Experiments demonstrate that Simon-SR surpasses state-of-the-art methods, achieving maximum improvements of 0.50 dB in PSNR, 0.0133 in SSIM, and 0.0695 in LPIPS. Code will be released.

26. 【2607.09329】Dynamic Inverse Rendering for Enhanced Material-Lighting Decomposition

链接：https://arxiv.org/abs/2607.09329

作者：Raza Yunus,Benjamin Ummenhofer,Jan Eric Lenssen,Eddy Ilg

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：Decomposing outgoing surface, outgoing surface radiance, Decomposing outgoing, augmented reality, outgoing surface

备注： Accepted at ECCV 2026. Project page: [this https URL](https://razayunus.github.io/DIR)

点击查看摘要

Abstract:Decomposing outgoing surface radiance into material and illumination during inverse rendering is essential for applications such as relighting and augmented reality, yet it is severely ill-posed since multiple combinations can result in the same observed colour. Capturing an object under multiple lighting conditions usually helps resolve this ambiguity as it constrains the optimization towards correct solutions. In this work, we explore the potential of reconstructing rigidly moving objects -- which provides observations of diverse light-surface interactions -- to resolve the material-lighting ambiguity in inverse rendering. For this purpose, we introduce a relightable approach that marries object tracking and reconstruction with inverse rendering for general rigidly moving objects. Our experimental analysis on synthetic data demonstrates that motion can be an advantage for disentangling material and lighting: the reconstructed material is significantly more accurate when the object is observed under rigid motion than when it is static. Moreover, results on RGB videos of real hand-held objects show that our pipeline preserves this advantage even under noisy real-world conditions.

27. 【2607.09305】From Classification to Localization and Clinical Validation: Large-Scale Development of a Deep Learning System for Thoracic Disease Detection on Chest Radiographs in Thailand

链接：https://arxiv.org/abs/2607.09305

作者：Isarun Chamveha,Tretap Promwiset,Napat Wanchaitanawong,Trongtum Tongdee,Pairash Saiviroonporn,Warasinee Chaisangmongkon

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Southeast Asia, thoracic imaging modality, imaging modality, expert interpretation, interpretation is constrained

备注：

点击查看摘要

Abstract:Chest radiography (CXR) remains the most widely used thoracic imaging modality, yet expert interpretation is constrained by a severe shortage of radiologists in Thailand and across Southeast Asia. Local adaptation of deep learning models to Thai data has been shown to substantially improve accuracy on Thai populations. Here we present the development and comprehensive validation of the chest radiograph analysis model in Inspectra CXR version 5, a deep learning system that performs multi-label thoracic disease classification and weakly supervised lesion localization within a single model. The architecture couples a DenseNet-121 backbone with Attend-and-Compare Modules (ACM) and a Probabilistic Class Activation Map (PCAM) aggregation layer, producing a per-condition classification score and heatmap simultaneously. The model was developed on 874,858 frontal chest radiographs with paired radiologist reports from Siriraj Hospital, Bangkok. On a held-out, radiologist-verified in-domain test set of 19,871 cases, it achieved a mean AUROC of 0.994 (mean sensitivity 92.4%, specificity 98.6%) across nine clinically important conditions. On an independent generalization set of 5,992 cases from 13 hospitals across Thailand, the mean AUROC was 0.970, indicating robust transfer across sites. For localization, evaluated on 4,549 radiologist-annotated cases, the model attained a mean lesion-localization fraction (LLF) of 77.9% at 0.59 non-lesion localizations per image. In a usability evaluation with five thoracic radiologists, the system reached a classification concordance of 93.6%, a localization concordance of 94.7%, and a mean System Usability Scale (SUS) score of 89. These results indicate that a locally developed, localization-capable CXR system can deliver high accuracy, generalize across heterogeneous Thai hospitals, and earn the trust of practicing radiologists.

28. 【2607.09299】xtileNet: Towards Zero-shot Text-style Segmentation of Manuscripts

链接：https://arxiv.org/abs/2607.09299

作者：Anguelos Nicolaou,Antonella Ambrosio,Desiree Di Donato,Georg Vogeler

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：open scribe sets, degraded image quality, Automatic writer identification, archival paleography remains, paleography remains limited

备注： accepted for publication in the ICDAR 2026 workshop (peer reviewed) "IWCP: 4th International Workshop on Computational Paleography"

点击查看摘要

Abstract:Automatic writer identification systems have progressed remarkably in recent years, yet their deployment in archival paleography remains limited by the scarcity of labeled training data, open scribe sets, and degraded image quality. We present TextileNet, a fully convolutional multi-task network trained exclusively on synthetic data to produce dense pixel-level texture embeddings, which we transfer zeroshot to historical manuscript analysis. As an original contribution to evaluation methodology, we designed a paleographic visual quiz of 80 pair and triplet questions and administered it to a range from lay participants to senior paleographers under strict anonymity, establishing to our knowledge for the first time a human baseline for script-style discrimination on late medieval text. We employ TextileNet embeddings to perform zero-shot retrieval on sub-word granularity for hand and gender identification. Our experimental results help in building the credibility of TextileNet in the paleographic domain, but more than that demonstrate in experimental terms that the question of gender in handwriting needs to be treated with caution.

29. 【2607.09291】Letter Lemmatization: One-to-one and Banded RNNs for Reversing Character-Set Simplification and Abbreviation in Medieval Text

链接：https://arxiv.org/abs/2607.09291

作者：Anguelos Nicolaou,Maria Pia Tiseo,Tamas Kovacs,Nicolas Renet,Georg Vogeler

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：heterogeneous digitization policies, Medieval document transcribers, heterogeneous digitization, viewed as fluid, document transcribers

备注： Accepted for publication (after peer review ) in the ICDAR 2026 workshop "VINALDO: 3rd International Workshop on Machine Vision and NLP for Document Analysis"

点击查看摘要

30. 【2607.09284】Rethinking Monocular Depth Embedding for Generalized Stereo Matching

链接：https://arxiv.org/abs/2607.09284

作者：Libo Lin,Shuangli Du,Minghua Zhao,Zhenzhen You,Shun Lv,Yiguang Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：lack geometric precision, capture rich contextual, rich contextual priors, methods capture rich, monocular depth

备注： 15 pages, submitted to Pattern Recognition

点击查看摘要

Abstract:Generally, monocular methods capture rich contextual priors but lack geometric precision, whereas stereo methods are geometrically accurate yet struggle in textureless and occluded regions. Several approaches attempt to combine their strengths to enhance the generalization of stereo matching (SM) by aligning monocular depth with stereo information. However, establishing a stable and generalizable alignment is challenging, and unreliable monocular cues can substantially degrade performance. This paper rethinks monocular depth embedding. First, to prevent shortcut learning, we reduce branch coupling instead of expanding network width. Second, we construct soft constraints instead of hard ones from monocular depth to improve tolerance to monocular depth errors. Based on the principles, we integrate monocular information into both feature extraction and GRU iterations. Specifically, the monocular depth map is fused with the RGB image to sharpen depth boundary perception and suppress matching ambiguities. The fused image is then used for feature extraction, allowing the contextual features to encode global geometric information. Furthermore, the monocular depth gradient feature is employed to guide disparity updates, helping to escape local oscillations. Finally, to address the boundary blurring of supervised disparity caused by data augmentation, we propose an edge confidence estimation method and an edge-aware loss function. Our method achieves state-of-the-art (SOTA) performance on multiple standard benchmarks, demonstrating excellent generalization while improving accuracy. The code is available at this https URL.

31. 【2607.09267】REMIND: RE-Identification with Memory for INDoor Navigation

链接：https://arxiv.org/abs/2607.09267

作者：Pablo Diaz-Pereda,Alejandro Rodriguez-Ramos,David Perez-Saura,Pascual Campoy

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Mobile robots operating, long temporal gaps, severe illumination variations, re-identify previously observed, previously observed objects

备注： 11 pages

点击查看摘要

Abstract:Mobile robots operating indoors must re-identify previously observed objects after long temporal gaps, significant viewpoint changes, and severe illumination variations. This remains a challenging problem: multi-object tracking methods are optimized for short-term association of pedestrians and vehicles at video rates, person and vehicle re-identification approaches lack persistent memory mechanisms, and state-of-the-art video object segmentation techniques rely on reactive distractor filtering rather than enforcing global identity consistency. To address these limitations, we present REMIND, an online tracker designed for long-term multi-object re-identification of generic indoor objects from monocular RGB imagery, requiring neither camera pose nor depth. Motivated by evidence from visual cognition that humans rely on accumulated appearance familiarity and spatial context rather than explicit self-localization, REMIND combines frozen DINOv3 features with a dual-bank multi-prototype appearance memory, part- and background-level descriptors, a neighbour-context reasoning module exploiting spatial co-occurrence, and joint Hungarian assignment with ambiguity-aware safeguards. On a purpose-built indoor dataset featuring controlled revisits and dense same-class clutter, REMIND reaches 90.35% IDF1, nearly 20 points above a state-of-the-art video object segmentation baseline and more than 36 above a strong tracking-by-detection baseline. On ScanNet++, it attains the highest IDF1 in every setting but one, end-to-end detection over all scenes, where the tracking-by-detection baseline is marginally ahead while REMIND still associates and recovers identities more accurately; it also completes every scene, whereas the video object segmentation baseline exhausts GPU memory on 66.9% under YOLO detections. The complete system, evaluation framework, and dataset are publicly released.

Comments:
11 pages

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.09267 [cs.CV]

(or
arXiv:2607.09267v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.09267

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

32. 【2607.09263】Semantic Hardness Is Not Visual Hardness: Sign-Aware Hard Negative Mining for Sign Language Retrieval

链接：https://arxiv.org/abs/2607.09263

作者：Junmyeong Lee,Chan Hur,ChangSu Choi,Sukmin Cho,Fitsum Gaim,Eui Jun Hwang,Hoyun Song,KyungTae Lim

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：enables efficient access, enables efficient, Sign Language Retrieval, sign language content, efficient access

备注： Accepted to ACL 2026 main

点击查看摘要

Abstract:Sign Language Retrieval (SLRet) enables efficient access to sign language content but remains fragile in fine-grained scenarios where visually similar signs must be distinguished. We show that this limitation does not stem from model capacity, but from ineffective hard negative supervision. Specifically, we formulate fine-grained retrieval failures as a negative distribution mismatch: semantically distinct yet visually confusable signs are rarely treated as hard negatives, while existing text-based mining strategies fail to capture such visual ambiguity. To address this issue, we propose Sign-Aware Hard Negative Mining (SAN), which constructs hard negatives based on visual confusability in the sign embedding space rather than linguistic similarity. Experiments on PHOENIX-2014T demonstrate that SAN substantially improves fine-grained retrieval performance while preserving coarse-grained accuracy, highlighting the importance of aligning negative supervision with visual ambiguity in sign language retrieval.

33. 【2607.09260】AnythingReality: Robust Online Gaussian Splatting SLAM for Open-Vocabulary VR Scene Exploration

链接：https://arxiv.org/abs/2607.09260

作者：Timofei Kozlov,Dmitrii Maliukov,Andrey Marchenko,Miguel Altamirano Cabrera,Dzmitry Tsetserukou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：online Gaussian, Gaussian splatting, integrated architecture, architecture for robust, Gaussian

备注：

点击查看摘要

Abstract:We present a novel integrated architecture for robust online 3D Gaussian splatting, real-time VR exploration, and speech-driven Vision-Language-Model interaction. Unlike methods assuming clean depth or external poses, our system combines ORB-SLAM3-based pose estimation with online Gaussian reconstruction for noisy real-world data. A VR pipeline enables immersive exploration of incremental reconstructions; a semantic module transcribes voice commands, generates scene descriptions, and records points of interest. Against state-of-the-art online Gaussian splatting methods, we improve image quality on our dataset (+14.5% PSNR, +8.6% SSIM, -14.3% LPIPS) and TUM-RGBD (+11.7% PSNR, +7.8% SSIM, -21.6% LPIPS), with comparable or superior frame rates via quality-speed configurations. We achieve an 88% VLM object-recognition rate.

34. 【2607.09235】All you need is SAMPAT

链接：https://arxiv.org/abs/2607.09235

作者：Jayadeva,Madhur Aswani

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Functional Analysis (math.FA)

关键词：deep neural architectures, current state, rests on deep, SAMPAT, layer neural architecture

备注： 7 pages

点击查看摘要

Abstract:The current state of the art in AI/ML rests on deep neural architectures, which, in general, suffer from a lack of interpretability. Interpretability is crucial to gleaning insights while analyzing experimental data, where quantitative predictions may not be adequate for a scientist. We present a three layer neural architecture, SAMPAT (Smooth Approximation via Multivariate Polynomials and Analytic Transformations), that can provably learn a continuous, everywhere differentiable function, that can approximate any smooth function arbitrarily closely. SAMPAT's approximant can be expressed as a closed and compact algebraic, analytic expression, providing complete interpretability. Experiments on synthetic and benchmark datasets indicate that SAMPAT yields competitive performance with simpler representations. For many tasks, a two layer SAMPAT suffices. By imposing restrictions on the connectivity between neurons, SAMPAT may be used to provide a range of approximants, including regular and trigonometric polynomials, rational expressions, Gaussians, mixtures of Gaussians, as well as arbitrary combinations of the same; without restrictions, it learns a suitable structure. SAMPAT may be used to factorize polynomials and model nonlinear systems. With the addition of skip connections, a 4 to 6 layer SAMPAT is adequate to represent a substantive range of methods widely used in AI/ML, allowing the choice of a model's family, not just its parameters, to also be optimized as part of the learning process.

35. 【2607.09225】Glob3R: Global Structure-from-Motion with 3D Foundation Models

链接：https://arxiv.org/abs/2607.09225

作者：Junyuan Deng,Heng Li,Kejie Qiu,Lingteng Qiu,Rui Peng,Weichao Shen,Weihao Yuan,Siyu Zhu,Zilong Dong,Ping Tan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：directly predicting camera, directly predicting, points from input, foundation models, geometric foundation models

备注：

点击查看摘要

Abstract:Recent 3D geometric foundation models, such as VGGT, provide robust feed-forward 3D reconstruction by directly predicting camera poses and 3D scene points from input images. However, their results remain inaccurate, and scaling them to long sequences or large unordered image sets typically requires chunk-wise processing, which can introduce drift and inconsistency. We present Glob3R, a global SfM-style reconstruction built on 3D foundation models. Our key idea is to explicitly optimize feed-forward geometric predictions. To this end, we augment a frozen Pi3X backbone with a lightweight dense matching head that predicts image warps between selected reference frames and neighboring views. These dense warps are converted into sparse but reliable multi-view feature tracks, which provide correspondence constraints for global optimization. We further introduce a keyframe-based sliding-window association strategy that propagates tracks and relative poses across overlapping windows, enabling scalable reconstruction. Finally, we perform global motion averaging and bundle adjustment to refine camera poses, reduce scale inconsistencies, and recover dense scene geometry. Extensive experiments on indoor, outdoor, large-scale driving, and unordered SfM benchmarks demonstrate that Glob3R achieves robust and accurate reconstruction. It consistently improves over feed-forward foundation-model baselines and recent scalable reconstruction methods, while being more robust than classical SfM pipelines. The refined poses also lead to higher-quality neural rendering, validating the benefit of combining foundation-model priors with global geometric optimization. Project page: this https URL

36. 【2607.09193】YeTI: You Only Need Two Noisy Images for Real-World sRGB Noise Generation

链接：https://arxiv.org/abs/2607.09193

作者：Jaekyun Ko,Byung Wan Lim,Soomin Lee,Dongjin Kim,Tae Hyun Kim

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：remains challenging due, acquiring aligned clean-noisy, clean-noisy image pairs, aligned clean-noisy image, denoising remains challenging

备注： Accepted to ECCV 2026. Includes supplementary material

点击查看摘要

Abstract:Real-world sRGB image denoising remains challenging due to the nonlinear characteristics of sensor noise and the difficulty of acquiring aligned clean-noisy image pairs. Supervised denoisers often overfit to limited paired datasets, while self-supervised methods still depend on sufficiently diverse noisy observations. These limitations motivate scalable noise synthesis methods that can model real-world noise without clean ground truth or camera metadata. We propose YeTI, a real-world sRGB noise generation framework that learns from only two noisy observations of the same scene. YeTI uses a Reconstruction Autoencoder to disentangle scene structure and noise characteristics, and models the latent noise distribution with a one-step Conditional Diffusion Transformer trained using consistency objectives. Given a single noisy input at inference time, YeTI generates realistic, signal-dependent noise while preserving the underlying scene content. Extensive experiments demonstrate the effectiveness of YeTI across real-world benchmarks. We evaluate noise generation on SIDD and further assess generalization on SIDD+, MAI2021, and SID, covering smartphone and diverse consumer-camera sensors. Downstream denoising results on DND further show that denoisers trained with YeTI-synthesized images achieve strong real-world performance, highlighting the practical value of clean-image-free and metadata-free noise generation.

37. 【2607.09186】HiHR: Hierarchical Hyperbolic Representation for Aerial-Ground Person Re-Identification

链接：https://arxiv.org/abs/2607.09186

作者：Qiwei Yang,Pingping Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Aerial-Ground Person Re-IDentification, ground camera platforms, Aerial-Ground Person, Person Re-IDentification, aims to retrieve

备注： Accepted by ECCV2026. More modifications may be performed

点击查看摘要

Abstract:Aerial-Ground Person Re-IDentification (AG-ReID) aims to retrieve the same person across heterogeneous aerial and ground camera platforms. Although great progress has been made, existing methods remain suboptimal due to the direct feature alignment across views, overlooking view-specific cues. To address this issue, we propose a novel Hierarchical Hyperbolic Representation (HiHR) framework for AG-ReID. More specifically, we first extract multi-granularity features based on pre-trained visual-text encoders. Then, we propose a Text-guided Multi-granularity Fusion (TMF) to fuse multi-granularity features and enhance the representation ability of identity features. Furthermore, we introduce the Hierarchical Hyperbolic Learning (HHL) to construct a hierarchical feature structure in a hyperbolic space. This hierarchy includes a coarse level that ensures identity separability and cross-view consistency, and a fine level that preserves view-specific discriminative cues. As a result, our proposed framework can effectively aggregate view-invariant and view-specific discriminative features for AG-ReID. Extensive experiments on four AG-ReID benchmarks demonstrate the effectiveness of our framework. The source code is available at this https URL.

38. 【2607.09185】Causally Debiased Latent Action Model for Embodied Action Conditioned World Models

链接：https://arxiv.org/abs/2607.09185

作者：Yufan Wei,Kun Zhou,Lingjun Mao,Zijun Zhang,Ziming Xu,Ziqiao Xi,Shuang Liang,Ruobing Han,Yuchen Yan,Xinyue Wang,Fan Feng,Biwei Huang

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Action-conditioned world models, simulate future observations, future observations conditioned, Action-conditioned world, aim to simulate

备注：

点击查看摘要

Abstract:Action-conditioned world models (ACWMs) aim to simulate future observations conditioned on embodied actions, offering a promising foundation for robot planning, policy evaluation, and data augmentation. However, learning controllable ACWMs requires large-scale action-labeled data, which remains costly to collect in the real world. Latent action models (LAMs) mitigate this bottleneck by inferring latent actions from unlabeled videos, but existing LAMs are typically trained with reconstruction-only objectives and therefore entangle action-relevant dynamics with action-irrelevant visual factors such as backgrounds and untouched objects. In this work, we identify this action-irrelevant bias as a key obstacle to controllable ACWMs and introduce evaluation metrics to measure latent-action bias, action following, and robustness. We propose CD-LAM, a causally debiased framework for LAM-based ACWMs. CD-LAM introduces three efficient fine-tuning objectives: embodiment-centric reconstruction, action-centric contrastive learning, and latent space calibration, which together encourage embodiment-focused, action-aware, and calibrated non-collapsed latent action representations. Experiments on 2B and 14B ACWM backbones show that CD-LAM substantially improves latent-action controllability, downstream robot-action following, visual fidelity, and adaptation efficiency, requiring only 6k fine-tuning steps and more than 12$\times$ fewer robot-action adaptation updates than the baseline.

39. 【2607.09169】SR-Ego: Temporally Guided Stereo Refinement Framework for Egocentric 3D Human Pose Estimation

链接：https://arxiv.org/abs/2607.09169

作者：Md Mushfiqur Azam,John Quarles,Kevin Desai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：head-mounted stereo cameras, human pose estimation, severe self-occlusion, camera field, field of view

备注：

点击查看摘要

Abstract:Egocentric 3D human pose estimation from head-mounted stereo cameras is challenging due to fisheye distortion, severe self-occlusion, and frequent truncation of body joints outside the camera field of view. Recent stereo egocentric methods have improved performance through heatmap lifting, stereo correspondence, and transformer-based refinement, but they often rely heavily on frame-local evidence or use temporal information only as auxiliary pose-level context. This limits robustness when current-frame stereo cues are weak, occluded, or ambiguous. We propose TSR-Ego, a temporally guided stereo framework that couples short-term motion evidence with projection-guided feature sampling. The model first enriches dense stereo feature maps using a causal depthwise-separable temporal convolution, allowing past visual evidence to influence the feature space before deformable cross-attention. A single-stage causal stereo decoder then refines learned 3D joint queries through temporal self-attention, joint self-attention, and fisheye deformable stereo cross-attention, using the evolving pose estimate to generate 2D sampling references. Unlike methods that apply temporal reasoning mainly after pose prediction, TSR-Ego uses motion context to shape both the sampled stereo features and the joint representations while preserving online inference without future frames. Experiments on UnrealEgo2 and UnrealEgo-RW show state-of-the-art performance, with especially strong gains on real-world sequences.

40. 【2607.09164】What Pixels Are Enough? SEAMS: Sufficiency Saliency via MSE-Preservation Soft-Masks

链接：https://arxiv.org/abs/2607.09164

作者：Magdalena Trędowicz,Łukasz Struski,Arkadiusz Lewicki,Karolina Pachota,Andrzej Grudzień,Mateusz Jagła,Jacek Tabor

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Saliency maps, sufficiency-based saliency method, model behaviour, image regions, sufficiency-based saliency

备注：

点击查看摘要

Abstract:Saliency maps are most useful when they identify the image regions that are sufficient to preserve a model's behaviour. We introduce SEAMS, a sufficiency-based saliency method that directly optimises a soft mask using a preservation objective. Given a frozen differentiable model output, such as a class probability, CLS embedding, or token representation, SEAMS searches for a compact mask that preserves the selected output. The approach relies on a simple optimisation framework based on soft masks, a learnable budget, and a three-way image composite generated entirely from the query image. As a result, it requires no auxiliary distractor dataset, architecture-specific attribution mechanism, or differentiable top-k relaxation. Experiments with frozen ViT-S/16 and ConvNeXt models show that the same optimisation pipeline can generate object-level, class-conditioned, and token-level explanations by changing only the preserved target. The resulting masks are compact, interpretable, stable across random initialisations, and competitive on insertion and deletion benchmarks. Our results also indicate that different architectures often rely on different sufficient evidence while achieving similar preservation fidelity, highlighting the architecture-dependent nature of visual explanations.

41. 【2607.09143】Weaving Light and Time: Unified Harmonic-Geometric Representation Learning for Dense RGB-Event Parsing

链接：https://arxiv.org/abs/2607.09143

作者：Chenxu Peng,Chongtian zhou,Dicheng Liu,Bo-Wen Yin,Yimian Dai,Xialei Liu,Ming-Ming Cheng,Xiang Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Fusing standard RGB, standard RGB frames, Fusing standard, standard RGB, RGB frames

备注：

点击查看摘要

Abstract:Fusing standard RGB frames with asynchronous event streams has emerged as a definitive paradigm for robust perception in degraded environments. Although unified backbones have recently gained traction in multi-modal vision, adapting them to the RGB-Event domain remains fundamentally challenging. Existing architectures either resort to decoupled dual encoders that double computational overhead, or adopt generic unified designs that fail to resolve implicit geometric parallax and cross-spectral aliasing under the extreme representational divide between dense intensity grids and sparse kinematic spikes. To transcend these bottlenecks, we present Evita, the first unified backbone specifically engineered for dedicated dense RGB-Event parsing. To achieve profound modal synergy, Evita explicitly embeds a suite of intrinsic co-learning modules directly into every encoder layer. Specifically, it features Geometric Parallax Rectification for adaptive spatial alignment, Harmonic Spectral Resonance for texture transfer exclusively in the complex frequency domain, and Transient Global Routing for event-driven asymmetric attention. To guarantee robust feature extraction against spatial misalignments and decouple representations from specific event encodings, we construct N-ImageNetV2 alongside a stochastic event representation mixing pretraining protocol, empowering the network to seamlessly accommodate arbitrary event formats in downstream tasks. Extensive evaluations across the DELIVER, DDD17, and DSEC benchmarks confirm that Evita establishes new state-of-the-art metrics while delivering a superior accuracy-latency trade-off for real-time multimodal this http URL code are publicly available at: this https URL.

42. 【2607.09142】MedRealMM: A Real-World Multimodal Benchmark for Chinese Online Medical Consultation

链接：https://arxiv.org/abs/2607.09142

作者：Runhan Shi,Quan Zhou,Yuqian Xu,Shuai Yang,Xin Wu,Zitong Zhou,Hui Liu,Bin Cha,Zheming Wang,Liya Li,Wei Wei,Haoyuan Hu,Jun Xu

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Large language models, Large language, real clinical practice, increasingly deployed, aligned with real

备注：

点击查看摘要

43. 【2607.09135】Super-Generalist: Towards Comprehensive and Accurate Medical Image Understanding via Generalist-Specialist Synergy

链接：https://arxiv.org/abs/2607.09135

作者：Shaoteng Zhang,Weiwei Cao,Wanxing Chang,Yutong Xie,Kai Cao,Zaiyi Liu,Yu Shi,Tingbo Liang,Qi Zhang,Ling Zhang,Yong Xia,Jianpeng Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Medical images require, diverse clincial conditions, images require comprehensive, Medical images, clincial conditions

备注：

点击查看摘要

Abstract:Medical images require comprehensive and accurate interpretation to support the diagnosis of diverse clincial conditions. Recent vision-language generalist models offer broad task coverage and promising zero-shot capabilities, yet often lack fine-grained anatomical and lesion awareness for reliable diagnosis and spatial interpretability. In contrast, supervised specialist models achieve strong performance on specific tasks but typically lack generalization across diseases and anatomies. In this work, we present SuG, a Super-Generalist framework that unifies generalist vision-language learning with specialist objectives, enabling both broad generalization and specialist-level diagnostic capability. We perform specialist-enhanced vision-language alignment in SuG by incorporating spatial priors from multiple segmentation experts, including anatomy, class-specific lesion and class-agnostic lesion segmentors that captures lesions beyond anatomies annotated during training. To improve lesion grounding capability, we leverage lesion masks as spatial priors to calibrate text-conditioned visual attention, encouraging disease-related semantics to focus on clinically relevant regions. We evaluate SuG on extensive chest and abdominal CT benchmarks, including CT-RATE, Merlin, MedVL-CT69K, and several in-house tumor datasets. SuG achieves state-of-the-art performance across a wide range of disease diagnosis tasks and surpasses specialist models on several critical tumor diagnosis benchmarks. Furthermore, SuG demonstrates strong lesion grounding capability, including robust generalization to lesion types lacking class-specific supervision.

44. 【2607.09133】IB-Flow: Information Bottleneck-Guided CFG Distillation for Few-Step Text-to-Image Generation

链接：https://arxiv.org/abs/2607.09133

作者：Yiting Wang,Jingyi Zhang,Wenhu Zhang,Ke Chao,Yves Liang,Kun Cheng,Kang Zhao

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：achieved unprecedented visual, multi-step iterative solvers, iterative solvers incurs, severe inference latency, solvers incurs severe

备注：

点击查看摘要

Abstract:While large-scale text-to-image generative models have achieved unprecedented visual performance, their inherent reliance on multi-step iterative solvers incurs severe inference latency. Few-step distillation targeting the Classifier-Free Guidance (CFG) trajectory has emerged as the prevalent dual-dimensional compression paradigm. However, existing frameworks remain subjugated by a coarse-grained blind injection paradigm that perpetually enforces a globally static guidance strength while indiscriminately sampling the supervisor timestep. This state-agnostic design completely disregards the intrinsic nature of image generation as a dynamic evolutionary process characterized by progressive entropy reduction, which not only restricts the performance boundary of few-step compression but also precipitates severe CFG over-conditioning artifacts. To transcend these limitations, we re-examine the distillation procedure through the theoretical lens of Information Theory, formally modeling it as a dynamic mutual information game constrained by the Information Bottleneck (IB) principle. Specifically, we dismantle traditional blind assumptions via a dual-track adaptive framework. To determine the injection target, we propose an instance-aware selection mechanism that transmutes the intractable KL divergence constraint into a zero-overhead closed-form solution predicated on the local vector field norm. To regulate the injection strength, we introduce an entropy-aware schedule that dynamically decays alongside the SNR, applying maximal thrust for initial structural anchoring before smoothly reverting to the natural manifold to refine micro-details. Extensive empirical evaluations corroborate that our framework fundamentally eradicates over-conditioning artifacts, shattering the performance ceiling to achieve SOTA generative fidelity under extremely stringent 2-step configurations.

45. 【2607.09126】VTaMo: Video-Text Alignment Model for Sign Language Translation

链接：https://arxiv.org/abs/2607.09126

作者：Junyi Hu,Zhewen He,Haomian Huang,Aoxiang Yang,Yi Fang

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：converts continuous sign, continuous sign videos, spoken language text, Sign language translation, continuous sign

备注： 18 pages, 5 figures, 8 tables. Accepted to ECCV 2026

点击查看摘要

46. 【2607.09125】4D Human-Scene Reconstruction from Low-Overlap Captures

链接：https://arxiv.org/abs/2607.09125

作者：Minhyuk Hwang,Sangmin Kim,Seunguk Do,Daneul Kim,Jaesik Park

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Existing volumetric capture, Existing volumetric, dense camera arrays, dynamic human performance, performance achieves high

备注： Accepted to SIGGRAPH Conference Papers '26. First two authors contributed equally. Project page: [this https URL](https://sisyphm.github.io/studiorecon-page/)

点击查看摘要

Abstract:Existing volumetric capture of dynamic human performance achieves high fidelity with dense camera arrays. However, in real-world scenarios, only a handful of low-overlap cameras are available, which degrades the output quality and leaves large areas unobserved. Recent 4D reconstruction methods have focused on low-overlap settings, yet they still produce noticeable artifacts in under-observed regions. Video diffusion models have emerged as another option, but they show geometrically inconsistent results for humans. To address these limitations, we propose StudioRecon, a pipeline that reconstructs 4D human scenes from sparse, low-overlap cameras by decoupling background and humans. We densify background supervision by synthesizing hundreds of camera-controlled novel views with a video diffusion model. We also robustly initialize deformable Gaussian humans with cross-view identity association and triangulated multi-view keypoint fitting. Finally, our recursive enhancement module with motion-adaptive consistency injection harmonizes the composed output, thereby further avoiding remaining artifacts. We achieve state-of-the-art novel view synthesis across four real-world datasets and demonstrate applications such as novel trajectory rendering and human replacement.

47. 【2607.09115】Event Burst Trigger: An Availability Backdoor Attack on Event-Based SNN Object Detection

链接：https://arxiv.org/abs/2607.09115

作者：Jaesun Baek,Chanwook Lee,Eun-Kyu Lee

类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

关键词：spiking neural networks, event-based SNN object, SNN object detection, event-based SNN, SNN object

备注： The 56th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2026)

点击查看摘要

Abstract:Event-based vision and spiking neural networks (SNNs) are increasingly adopted for edge intelligence under strict latency and energy constraints. However, the vulnerability of event-based SNN object detection models to availability backdoor attacks remains insufficiently studied. This paper presents Event Burst Trigger (EBT), an availability backdoor attack targeting SNN-based object detection models. EBT injects carefully crafted event-based triggers into the training data, which induce temporally concentrated event streams during inference. These burst-like activations increase the number of phantom (i.e., spurious) object candidates, and consequently inflate the computational cost of the post-processing stage, particularly Non-Maximum Suppression (NMS). We evaluate EBT on SpikeYOLO, the state-of-the-art SNN-based object detector, under a poison-only threat model that does not require modifications to the model architecture, loss function, or inference pipeline. Experimental results show that while detection accuracy remains largely preserved, with mAP@0.5 decreasing by less than 0.099, the latency of the NMS stage increases by up to 38%. This indicates that NMS can become a dominant availability bottleneck in event-based SNN object detection. Experiments on an edge platform further show that the proposed attack elevates baseline resource utilization and reduces scheduling slack without inducing conspicuous peaks in resource usage. In addition, STRIP-based backdoor detection fails to reliably distinguish the proposed attack from benign inputs. These results characterize a previously underexplored availability backdoor threat in event-based SNN object detection systems.

48. 【2607.09114】Event Stream based Multi-Modal Video Anomaly Detection: A Benchmark Dataset and Algorithms

链接：https://arxiv.org/abs/2607.09114

作者：Peipei Zhu,Yueqing Niu,Lin Zhu,Guanchong Niu,Yang Yu,Zheng Li

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

关键词：critical for automated, automated surveillance, surveillance but remains, remains fragile, fragile under challenging

备注：

点击查看摘要

Abstract:Video anomaly detection (VAD) is critical for automated surveillance but remains fragile under challenging conditions such as illumination variations, fast motion, and complex backgrounds when relying solely on visible light videos. To address these limitations, we propose EVAD, an event enhanced VAD framework that jointly exploits conventional video and event streams captured by bio inspired event cameras. Event sensors asynchronously capture brightness changes with high temporal resolution, offering robustness to motion blur and extreme lighting, and providing motion salient cues complementary to video based visual information. To support multi modal VAD research, we construct a large scale visible event benchmark comprising 6.3 billion events and 376,368 video frames collected under diverse illumination levels, motion patterns, and background complexities, filling the gap of realistic and scalable datasets for event based anomaly detection. Building upon this dataset, we design a contrastive multi modal pretraining framework to learn discriminative event representations by aligning semantic embeddings across event streams, visible videos, and textual descriptions. An adaptive fusion module then dynamically integrates event based temporal cues with video based spatial semantics, improving robustness to environmental disturbances. Experiments on benchmarks and the proposed TJUTCM Pha dataset demonstrate that E VAD consistently outperforms methods, validating the effectiveness of event-based sensing for VAD in real world scenarios.

49. 【2607.09104】Integrating Large Language Models and Graph Convolutional Networks for Semi-Supervised Image Classification

链接：https://arxiv.org/abs/2607.09104

作者：Camila Piscioneri Magalhães,Lucas Pascotti Valem

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：driven significant advances, labeling datasets remains, datasets remains costly, significant advances, labeling datasets

备注：

点击查看摘要

Abstract:While the growing availability of image data has driven significant advances, labeling datasets remains costly and time-consuming. Therefore, semi-supervised approaches such as Graph Convolutional Networks (GCNs), which learn from both labeled and unlabeled data, have emerged as a promising solution. One of the primary challenges in applying GCNs to image classification is graph construction, since, unlike in citation networks or similar domains, images typically do not come with a predefined structural representation. For visual data, most studies construct graphs based on the similarity between feature vectors from pretrained deep learning backbones, typically by employing kNN or reciprocal kNN algorithms. Although Large Language Models (LLMs) have shown remarkable capability in capturing high-level semantics, their integration with GCNs for image classification remains underexplored. Aiming to fill this gap, our approach uses a Vision Language Model (VLM) to generate textual image descriptions, which are then processed by an LLM to estimate semantic similarity scores between connected images. These scores guide the pruning of edges in kNN and reciprocal kNN graphs, filtering out semantically irrelevant neighbors. Experimental results reveal that leveraging LLMs for graph refinement can improve classification accuracy, particularly for kNN graphs and some backbones. The source code is publicly available at this http URL.

50. 【2607.09103】Equivariant Filter for High Performance Image Tracking using an Event Camera

链接：https://arxiv.org/abs/2607.09103

作者：Angus Apps,Yixiao Ge,Timothy L. Molloy,Robert Mahony

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：original reference image, original reference, Image, equivariant filter, Image tracking

备注：

点击查看摘要

Abstract:Image tracking is the problem of estimating the transformation that relates a moving image of a scene to an original reference image. The problem is important in control of autonomous vehicles or robots, where the image encodes information about the motion of the camera or environment, as well as in pure computer vision applications. In this paper, we present an equivariant filter design for high performance tracking of planar image transformations using an event camera. The design exploits the Asynchronous Event Blob (AEB) tracker (Wang et al., 2024) to extract feature-position measurements from the raw event stream, and an equivariant filter to compute an affine image translation and rotation using the special Euclidean group symmetry. The equivariant filter incorporates an equivalent-measurement update step that de-correlates the (highly temporally correlated) feature-position measurements provided by the AEB tracker. We evaluate the design experimentally using two datasets involving general and fast rotational motion. We benchmark results against direct optimisation (estimating the relative transformation from the raw blob tracks), and a covariance intersection approach for overcoming data correlation. Our design provides smooth image tracking for features moving up to 7000 pixels per second on the image plane.

51. 【2607.09100】A Coreset Selection Framework with Ensemble Aggregation for Image Classification

链接：https://arxiv.org/abs/2607.09100

作者：Pedro Rocha Dantas,Lucas Pascotti Valem

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：produced large-scale datasets, raising concerns, rapid growth, growth of image, produced large-scale

备注：

点击查看摘要

Abstract:The rapid growth of image data has produced large-scale datasets, raising concerns about the time and memory costs of model training. Selecting representative training subsets, however, remains challenging: individual sample contributions are unclear, and model behavior varies across datasets and runs. We address these challenges with a framework that combines coreset selection with an ensemble aggregation over multiple runs. For coreset selection, we propose SCOre-Stratified Selection (SCOSS), which partitions the training data into intervals based on a chosen score and samples from each interval. The ensemble combines predictions from multiple runs, each performed on an independently sampled training subset. As baselines, we use moderate and random selection, each in original and class-balanced versions. We assess the framework with Simple Graph Convolution (SGC) and Support Vector Machine (SVM) classifiers under different sampling ratios. Experiments show that SCOSS is competitive with baselines, often the best choice for SGC, and enables favorable trade-offs between accuracy and efficiency. On the fine-grained dataset, SGC with SCOSS outperforms SVMs when using fewer labeled samples. The code and supplementary materials are publicly available at this http URL.

52. 【2607.09091】Beyond Time Shifts: Adapting Omni-LLM as a Reference-Free Evaluator for Generative Audio-Visual Models

链接：https://arxiv.org/abs/2607.09091

作者：Yijie Qian,Juncheng Wang,Chao Xu,Huihan Wang,Yuxiang Feng,Yang Liu,Baigui Sun,Yong Liu,Shujun Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：audio-visual generative models, generative models evolve, world simulators, generated content, world dynamics

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:As audio-visual generative models evolve into world simulators, cross-modal synchronization stands as a critical proxy for assessing the consistency of world dynamics and causality in generated content. However, existing evaluation metrics presume structural correctness, reducing synchronization to mere temporal alignment. Consequently, they fail on generative outputs, especially when exhibiting structural hallucinations and asymmetric cross-modal relations, which currently \textbf{mandate expert human annotation to assess synchronization.} This dependency introduces a critical paradox: \emph{human evaluators rely on relative, reference-dependent comparisons, whereas automated metrics require reference-free, absolute scalars.} We resolve this paradox by proposing a framework that distills relative human perception into a continuous, globally consistent metric. First, we introduce SynthSync, a dataset of generative failures ranked via pairwise human annotations. Second, we adapt the Omni-LLM equipped with a continuous latent projection to translate relative human rankings into continuous absolute values. Third, we propose Real-Valued Group Relative Policy Optimization ($\mathbb{R}$-GRPO) to internalize the global causal structure of synchronization via listwise score distributions. Empirically, our metric achieves state-of-the-art human preference alignment. We leverage this estimator to establish a standardized benchmark, advancing AV-Gen assessment from low-level signal correlation to visually grounded causality.

53. 【2607.09089】DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes

链接：https://arxiv.org/abs/2607.09089

作者：Chunggi Lee,Seonwook Park,Wanhua Li,Umar Iqbal,Hanspeter Pfister

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：human mesh recovery, mesh recovery, difficult to handle, handle due, multi-person HMR

备注：

点击查看摘要

Abstract:In the task of human mesh recovery (HMR), multi-person scenes are particularly difficult to handle due to the many entities that appear and occlusions between them over time. In particular for video inputs, there is a need to track each entity reliably and consistently. Existing methods rely on pretrained human detection modules, increasing their runtime and limiting the number of tracked entities. We present DETRAM, a unified framework for multi-person HMR and tracking that simultaneously detects, reconstructs, and tracks humans across time, both automatically and via user prompts. DETRAM uses a single transformer decoder with an identity-consistent set of learnable query embeddings that persist across frames: detection queries discover new people, tracking queries maintain pose and shape for existing individuals, and prompt queries follow user-specified identities. Our approach achieves state-of-the-art tracking results on PoseTrack21, 3DPW, BEDLAM, and MuPoTS-3D, and competitive reconstruction accuracy on BEDLAM and 3DPW, while uniquely supporting prompt-based tracking of individuals in multi-person scenes. To our knowledge, this is the first method to unify promptability and multi-person HMR with tracking in an end-to-end trainable framework, enabling user-directed human analysis in videos.

54. 【2607.09086】Subtoken Vision Transformer for Fine-grained Recognition

链接：https://arxiv.org/abs/2607.09086

作者：Jie Zhu,Ivy Zhang,Minchul Kim,Xiaoming Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Subtoken Vision Transformer, present Subtoken Vision, selective image tokenization, image tokenization method, Standard Vision Transformers

备注：

点击查看摘要

Abstract:We present Subtoken Vision Transformer (SubViT), a selective image tokenization method for fine-grained visual recognition. Standard Vision Transformers compress each fixed-size patch into a single token, although fine-grained distinctions often depend on localized variations within only a few patches. SubViT addresses this mismatch by representing discriminative patches with multiple subtokens while retaining the original token sequence for global context, thereby allocating additional capacity where it is most needed. Since attention heads encode complementary semantics and extracting attention maps at inference requires an extra backbone forward, we adopt a two-stage training strategy. Stage 1 fine-tunes the ViT using subdivision regions sampled from random attention heads, exposing the model to diverse subdivision patterns. Stage 2 identifies informative attention maps through feature-degradation distances and distills them into a lightweight single-map router, which directly predicts deterministic token-importance scores without a separate attention forward. We evaluate SubViT on Generalized Category Discovery (GCD), a challenging task requiring both fine-grained discrimination and generalization to unlabeled novel categories. Across CUB, FGVC-Aircraft, and Stanford Cars, SubViT improves the average novel-category accuracy of DINOv2 from $81.3\%$ to $84.7\%$, with only $0.50$ ms additional latency and $3.4\%$ more FLOPs, while reducing latency by $73.8\%$ relative to Retina Patch. Results on CIFAR-10 and ImageNet-100 demonstrate its broader applicability.

55. 【2607.09082】REBASE: Reference-Background Subspace Elimination for Training-Free In-Context Segmentation

链接：https://arxiv.org/abs/2607.09082

作者：Mantha Sai Gopal,Jaison Saji Chacko,Harsh Nandwana,Sandesh Hegde,Debarshi Banerjee,Uma Mahesh

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：in-context segmentation enables, single annotated reference, Training-free in-context segmentation, annotated reference image, eliminating the retraining

备注：

点击查看摘要

Abstract:Training-free in-context segmentation enables new object categories to be introduced at inference time from a single annotated reference image, eliminating the retraining and memory overhead of class-incremental learning. Recent approaches achieve this by combining vision foundation models for semantic correspondence with promptable segmentation networks like SAM. However, their performance is fundamentally limited by the quality of the cross-image similarity map; shared contextual backgrounds between the reference and query systematically elevate similarity in non-target regions, degrading prompt localization. We present REBASE, a training-free framework that explicitly suppresses these spurious contextual correspondences. Our method identifies the low-rank background feature subspace from the reference image and project the reference and query features onto its orthogonal complement in closed form, yielding cleaner semantic matching. We then generate positive point prompts using similarity-weighted farthest-point sampling, paired with a refined dense similarity prior. Without any training or parameter updates, our approach establishes a new state of the art among training-free methods on PACO-Part, FSS-1000, and cross-domain datasets such as ISIC2018, demonstrating that explicit background subspace removal is a highly effective principle for one-shot localization.

56. 【2607.09081】Adaptive Latent Trajectory Anchoring for Action Segmentation Dataset Condensation

链接：https://arxiv.org/abs/2607.09081

作者：Artheme Gauthier-Villar,Guodong Ding,Angela Yao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：segmentation synthesizes compact, untrimmed video datasets, synthesizes compact, informative representations, representations of long

备注： 16 pages, 5 figures, accepted to ECCV 2026

点击查看摘要

Abstract:Dataset condensation for action segmentation synthesizes compact, informative representations of long, untrimmed video datasets. The existing approach relies on Variational Autoencoders and an iterative latent optimization; it is computationally expensive and suffers from over-smoothed reconstructions and rigid temporal constraints. This paper proposes to shift the condensation paradigm from optimization-based inversion to deterministic latent mapping. By leveraging Denoising Diffusion Implicit Models, we represent action segments as continuous trajectories anchored by sparse latent points in the noise manifold. To maximize representational efficiency, we introduce an adaptive allocation mechanism that dynamically redistributes the anchoring budget based on segment-wise reconstruction difficulty. Extensive experiments demonstrate that our framework significantly outperforms state-of-the-art methods in segmentation performance across common datasets. Notably, our approach achieves performance parity with real data training while maintaining a condensation ratio of 2.4\% on Breakfast dataset.

57. 【2607.09080】GeoTrace: Geometry-Aware Trajectory Token Compression for Video Large Language Models

链接：https://arxiv.org/abs/2607.09080

作者：Guohuan Xie,Mengqi Lei,Chuan Shi,Wei Bao,Yue Gao,Siqi Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Video Large Language, Large Language Models, Large Language, large number, Video Large

备注：

点击查看摘要

Abstract:Although Video Large Language Models (Video LLMs) have shown strong performance in video understanding, their efficiency is still limited by the large number of visual tokens. Existing video token compression methods typically rely on frame-wise saliency or heuristic token merging, which can over-focus on locally salient regions and produce ambiguous fused features. To address these issues, we propose GeoTrace, a training-free spatiotemporal token compression framework that decomposes video evidence into exact skeleton tokens and traceable residual event tokens. Specifically, Contextual Farthest-Point Anchoring (CFPA) preserves salient, context-consistent, and high-coverage skeleton tokens, while Trajectory-Constrained Residual Condensation (TCRC) compresses residual tokens through one-to-one temporal trajectories and constrained near-manifold condensation, producing traceable event tokens with reduced ambiguity. We evaluate GeoTrace on four Video LLMs across four video understanding benchmarks, and the results demonstrate its effectiveness and generalization across different model architectures and scenarios. On LLaVA-OneVision, with only 10\% visual tokens retained, GeoTrace achieves a $12.99\times$ TFLOPs reduction while preserving 99.1\% of the vanilla performance. Overall, GeoTrace offers a compact and traceable token representation for efficient and robust Video LLM inference. Code is available at \href{this https URL}{\texttt{Code}}.

58. 【2607.09078】oward Active Object Detection for UAVs in the Wild: A Large-Scale Dataset, Benchmark and Method

链接：https://arxiv.org/abs/2607.09078

作者：Tianpeng Liu,Xinhua Jiang,Li Liu,Qinmu Shen,Siwei Tang,Zhen Liu,Yongxiang Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Active Object Detection, numerous Unmanned Aerial, Unmanned Aerial Vehicle, Object detection, numerous Unmanned

备注： 18 pages, 19 figures, 5 tables

点击查看摘要

Abstract:Object detection is a fundamental component in numerous Unmanned Aerial Vehicle (UAV) applications, yet it has long been plagued by hindrances like occlusion or target pixel scarcity. Active Object Detection (AOD) provides a novel paradigm to address these challenges via active vision, while UAV-based AOD research remains scarce due to the lack of high-quality datasets and benchmarks for algorithm development and evaluation. To fill this gap, this paper presents ATRNet-LUDO, the first large-scale real-world dataset for UAV-Ground Active Object Detection (UGAOD). It contains 121,000 multi-view panoramic multi-target aerial images and 1.21 million local single-target slices, covering 10 vehicle targets across 40 scenarios. It enables the construction of diverse training and testing environments for UAV agent interaction and active observation policy learning. Based on this dataset, we establish a comprehensive evaluation benchmark for AOD policy learning methods. Most existing AOD policies rely on Deep Reinforcement Learning (DRL) but suffer from poor generalization. Evaluations on our benchmark reveal a significant generalization gap between training and testing performance, highlighting an urgent need for solutions. To this end, we leverage the Joint Embedding Predictive Architecture (JEPA) to construct a world model that enhances state representation learning, and propose AOD-JEPA by incorporating AOD-specific prior knowledge. Extensive experiments validate its effectiveness and superiority. We hope ATRNet-LUDO and the benchmark will advance research in the UGAOD field. The dataset and code are soon available at this https URL.

59. 【2607.09068】OmniMapBench: Benchmarking Visual-Centric Reasoning on Diverse Map Documents

链接：https://arxiv.org/abs/2607.09068

作者：Yang Chen,Yunwen Li,Yufan Shen,Minghao Liu,Tianyu Zheng,Bin Fu,Qunshu Lin,Zhi Yu,Botian Shi

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Recent advancements, visually grounded reasoning, necessitate robust benchmarks, LVLMs necessitate robust, visually grounded

备注：

点击查看摘要

Abstract:Recent advancements in LVLMs necessitate robust benchmarks for complex, visually grounded reasoning. A critical limitation is identified in many document understanding benchmarks: visual content is often reducible to text, enabling high performance without genuine visual grounding. To address this limitation, OmniMapBench is introduced to foster visual-centric reasoning for map documents. The benchmark comprises 2,096 manually annotated question-answer pairs across 1,603 map documents from nine categories. It is designed to probe a hierarchy of skills, ranging from perception to multi-step visual reasoning. To quantify benchmark properties, a simple yet effective benchmark-level metric is proposed: the Visual Dependency Index (VDI), defined as the accuracy drop when images are replaced with question-agnostic descriptions. OmniMapBench exhibits higher VDI than established benchmarks, which quantitatively validates its focus on irreducible visual reasoning. Comprehensive evaluations of 25 leading LVLMs are conducted on OmniMapBench. A significant performance gap is observed, with the top-performing model achieving only 75.03\% accuracy. This result underscores the challenges posed by OmniMapBench to current LVLMs. This work aims to catalyze progress in visual-centric reasoning for document understanding of LVLMs. The dataset and code are publicly available at this https URL.

60. 【2607.09067】Probing Diffusion Denoising Dynamics for Contrastive Representation Learning

链接：https://arxiv.org/abs/2607.09067

作者：Yasong Dai,Zeeshan Hayder,David Ahmedt-Aristizabal,Hongdong Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：rich intermediate representations, models exhibit unprecedented, unprecedented generative capability, exhibit unprecedented generative, exhibit unprecedented

备注：

点击查看摘要

Abstract:Text-to-image diffusion models exhibit unprecedented generative capability and contain rich intermediate representations that can be useful for discriminative vision tasks. Motivated by this observation, we study a focused question: how can the denoising dynamics of a pretrained diffusion model be adapted to support discriminative representation learning while preserving its generative behavior under parameter-efficient updates? We present D$^3$CL as an investigation of this question. Our key observation is that noisy latents at different diffusion timesteps can be interpreted as stochastic views of the same underlying image, enabling a contrastive objective to be coupled with the standard denoising reconstruction loss. This formulation provides a simple way to probe the interaction between generative denoising and discriminative representation learning without training from scratch. To keep the adaptation lightweight, we apply LoRA updates to a pretrained Stable Diffusion backbone while freezing the original model parameters. D$^3$CL provides strong empirical evidence that reconstruction and noise-level contrastive objectives can be complementary: on ImageNet-1K, it obtains 80.1% linear-probing accuracy and an FID of 5.56 for $256 \times 256$ unconditional generation. Additional ablations on the design space suggest that the usefulness of diffusion features depends on where and how denoising states are sampled. These results establish D$^3$CL as a parameter-efficient adaptation framework for pretrained diffusion models, showing that noise-level contrastive learning can structure denoising representations for discriminative tasks while maintaining generative performance.

61. 【2607.09061】On Locality and Length Generalization in Visual Reasoning

链接：https://arxiv.org/abs/2607.09061

作者：Pulkit Madan,Sanjay Haresh,Reza Ebrahimi,Sunny Panchal,Apratim Bhattacharyya,Roland Memisevic

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：local foveated glimpses, single global computation, foveated glimpses, human visual system, striking feature

备注： Accepted at ECCV 2026

点击查看摘要

Abstract:A striking feature of the human visual system is that it ingests visual information through a series of local foveated glimpses, rather than a single global computation. This makes human vision distinctly different from most popular computer vision models in use today, which input images globally and in a single shot. A natural question therefore is whether local, sequential vision models may provide any fundamental computational benefits in addition to being biologically more plausible than global models. In this work, we investigate this question from the perspective of visual state tracking and length generalization. Inspired by recent studies of length generalization in language models, we study the behavior of vision models trained on simple vision tasks that require the aggregation of local information across an image. Our experiments reveal that, similar to language models, vision models can learn to exploit global shortcuts and thereby fail to generalize over task length or complexity. We also show that recurrent vision policies based on strictly local perception can mitigate these failures, thereby allowing models to generalize on these tasks. Our results show that local attention may be an essential overlooked requirement for robust compositional generalization.

62. 【2607.09057】STEAM: Stable Self-Training with Elastic Matching and Adaptive Purification

链接：https://arxiv.org/abs/2607.09057

作者：Shaoxiang Wang,Kejia Zhang,Haiwei Pan,Lan Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieve GPS-free localization, matching drone-view images, GPS-free localization, Adaptive Purification, Elastic Matching

备注：

点击查看摘要

Abstract:Cross-view geo-localization (CVGL) aims to achieve GPS-free localization by matching drone-view images with corresponding satellite-view images. Existing supervised methods rely on large-scale manually annotated cross-view image pairs, making them costly and difficult to scale. In contrast, existing unsupervised approaches typically depend on generative models or clustering-based stage-wise optimization, which are prone to distribution bias and the accumulation of noisy pseudo-labels. To address these limitations, we propose STEAM (Stable Self-Training with Elastic Matching and Adaptive Purification), an end-to-end unsupervised cross-view geo-localization framework that performs self-training directly on real drone and satellite images. Specifically, the proposed Stable Spatial-Aware Module enhances the stability of feature representations, Elastic Matching discovers high-quality cross-view pseudo-labels, and Adaptive Purification dynamically maintains a reliable pseudo-label repository throughout the self-training process. Extensive experiments on the University-1652 and SUES-200 benchmarks demonstrate that STEAM achieves state-of-the-art performance among all existing unsupervised methods and delivers performance comparable to supervised approaches, validating the effectiveness and superiority of the proposed framework. The source code is available at this https URL.

63. 【2607.09029】MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models

链接：https://arxiv.org/abs/2607.09029

作者：Yuncheng Yang,Feiyang Ye,Shixian Luo,Yinna Zhu,Lianlei Shan,Wangcai Zhao,Kuo Zhang,Yan Chen,Yong Wu,Yan Xie

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：process multimedia data, homogeneous Transformers, multimedia data, achieved success, Adaptive Inter-layer Composition

备注： 17 pages, 7 figures

点击查看摘要

Abstract:Vision-Language Models (VLMs) have achieved success using homogeneous Transformers to process multimedia data. Recent studies show that heterogeneous structures interleaving efficient mechanisms, like linear attention, improve both performance and inference latency over homogeneous designs. However, these efforts rely on handcrafted static mixing patterns, which are sub-optimal and difficult to adapt to specific hardware. To bridge this gap, we propose Multi-Objective Search for Adaptive Inter-layer Composition (MOSAIC), a hardware-aware search method that automatically transforms homogeneous models into optimized heterogeneous architectures. MOSAIC integrates diverse efficiency mechanisms--including linear, sparse, and low-rank operators--into a unified search space. By formulating the selection as a multi-objective Mixed Integer Programming (MIP) problem, our method identifies optimal configurations that maximize downstream performance under strict hardware latency constraints. To mitigate performance degradation from structural transitions, we introduce a two-stage parameter recovery process: global off-policy distillation to stabilize internal representations, followed by a dual-teacher on-policy distillation leveraging a 235B oracle for knowledge expansion and the original 4B teacher for distributional stability. We validate MOSAIC through MOSAIC-4B, derived from Qwen3-VL-4B-Instruct. Results demonstrate that MOSAIC-4B matches the baseline's performance across multiple benchmarks while requiring less than 2% of the original training cost. Furthermore, it substantially improves inference efficiency, achieving 1.76x prefilling and 2.54x decoding speedups.

64. 【2607.09024】Video Generation Models are General-Purpose Vision Learners

链接：https://arxiv.org/abs/2607.09024

作者：Letian Wang,Chuhan Zhang,Rishabh Kabra,Jasper Uijlings,Steven Waslander,Andrew Zisserman,Joao Carreira,Kaiming He,Misha Andriluka,Eduard Gabriel Bazavan,Andrei Zanfir,Cristian Sminchisescu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Driven by next-token, NLP shifted, powerful generalist foundation, shifted from task-specific, Driven

备注： ECCV 2026

点击查看摘要

Abstract:Driven by next-token prediction, NLP shifted from task-specific models into powerful generalist foundation models. What, then, is the equivalent catalyst needed to achieve a general-purpose model in computer vision? In this paper, we contend that large-scale text-to-video generation serves as a strong pre-training paradigm for computer vision, providing the necessary spatiotemporal priors, vision-language alignment, and scalability required for general visual intelligence. We introduce GenCeption, which leverages a pre-trained video generative diffusion backbone to define a feed-forward perception model, capable of performing various vision tasks steered by text instructions. Empirical results demonstrate that GenCeption achieves state-of-the-art performance across a diverse suite of tasks, including depth, surface normal, and camera pose estimation, expression-referring segmentation, and 3D keypoint prediction, often matching or surpassing specialized models (e.g. DepthAnything3, SAM3, D4RT, VGGT-Omega, Sapiens, David, Genmo, and Lotus-2). Furthermore, the video generative pretrained backbone outperforms alternative pretraining paradigms (e.g., V-JEPA, and Video MAE) under comparable settings. Importantly, GenCeption exhibits preliminary data and model scaling properties along with exceptional data efficiency, where it achieves comparable performance with leading models like D4RT and VGGT-Omega with 7 to 500 less training data. Finally, GenCeption also exhibits intriguing emergent behaviors: a model trained exclusively on synthetic human videos generalizes to real-world footage and out-of-distribution object categories (e.g., animals and robots). These findings suggest that video generation is not merely a synthesis tool, but a foundational path toward generalist vision intelligence for the physical world. Project page: this https URL

65. 【2607.09008】C-GAP: Class-Aware and Online Prompting Improves Vision-Language Models on Imbalanced Classes

链接：https://arxiv.org/abs/2607.09008

作者：Francis Fernandez,Arash Jahangiri,Salimeh Sekeh

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Safety-critical perception systems, small label spaces, rare object classes, reliably detect rare, detect rare object

备注：

点击查看摘要

Abstract:Safety-critical perception systems must reliably detect rare object classes within small label spaces, a setting that long-tailed detection methods, designed for hundreds of classes with dense annotation, fundamentally do not address. Open-vocabulary detectors offer a promising alternative, as they use natural language queries at inference time, making prompt quality a first-class lever for detection performance. We exploit this property to address class imbalance: rather than retraining models or collecting additional annotations, we ask whether iteratively refining the language prompts, fed to frozen detectors, can improve minority class detection. We introduce C-GAP Caption-Guided Augmentation and Prompting), a detector-agnostic, annotation-free framework that operates in two phases. First, we establish a composite caption baseline combining per-image scene descriptions with class-quantity context, which we show outperforms scene-description only or class-quantity-only prompts across multiple open-vocabulary architectures and benchmarks. Second, an LLM iteratively refines each image's caption individually, with trials triaged into accept, tentative, or regenerate buckets based on minority-class AP@0.5 against a dynamic threshold derived from the composite baseline. Refinement terminates early once sufficient AP@0.5 gain is achieved. No detector weights are updated at any stage. Our experiments shows that C-GAP improves minority-class average precision up to 53% over the baselines. On COCO, C-GAP improves minority-class AP@0.5 by ~81% relative over the composite baseline (17.69 - 32.09). Experiments confirm that composite captions provide the critical foundation for effective refinement: using scene-description-only or class-quantity-only prompts as the refinement starting point yields diminishing returns, supporting both stages of C-GAP as necessary contributions.

66. 【2607.08970】MultiView-Bench: A Diagnostic Benchmark for World-Centric Multi-View Integration in VLMs

链接：https://arxiv.org/abs/2607.08970

作者：Hantao Zhang,Jinru Sui,Ed Li,Dirk Bergemann,Zhuoran Yang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：core cognitive ability, largely assess single, VLMs largely assess, Recent benchmarks, limited-view perception

备注：

点击查看摘要

Abstract:Recent benchmarks for VLMs largely assess single- or limited-view perception, leaving untested the core cognitive ability to integrate observations across viewpoints into a coherent, world-centric (allocentric) 3D mental model. We introduce MultiView-Bench, a diagnostic benchmark expressly designed to evaluate multi-view integration for holistic 3D scene comprehension. Unlike existing datasets that focus on pixel-level mapping or camera-relative navigation, MultiView-Bench requires models to decouple object positioning from transient perspectives and ground them in a fixed global coordinate system. This capability serves as a prerequisite for VLMs before being deployed for downstream tasks such as mechanical part assembly. Our systematic evaluation of frontier VLMs reveals consistent failure modes: strong performance on 2D planar relations from a single image, but marked difficulty with 3D spatial relations and with aggregating information across views. We further identify biases in VLMs, such as struggles with unconventional axis directions and sensitivity to object colorways and texture variations. Acknowledging these limitations, we propose ViewNavigator, a multi-agent framework that actively selects informative viewpoints, perceives, and fuses multi-view evidence, improving diverse base models on MultiView-Bench even under a strict budget-matched comparison (and by 3-5x for the full agent).

67. 【2607.08948】SplatCtrl: Perception-Action Coupling via Gaussian Scene Representations and Reactive Robot Control

链接：https://arxiv.org/abs/2607.08948

作者：Siddarth Jain,Ho Jin Choi

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：face substantial challenges, Robotic manipulators excel, manipulators excel, excel in structured, face substantial

备注： Published in 2026 International Conference on Robotics and Automation (ICRA). 8 pages, 8 figures

点击查看摘要

Abstract:Robotic manipulators excel in structured environments but face substantial challenges in unstructured and dynamic settings. This paper presents SplatCtrl, a unified framework for real-time scene reconstruction and reactive robot motion generation to enable collision-free robotic arm control in previously unseen and continuously changing environments. Building on 3D Gaussian Splatting (3D-GS), we introduce a hybrid voxel-based filtering and dynamic Gaussian relocation strategy that supports efficient scene reconstruction from RGB-D streams while accommodating environmental changes. For safe and reactive control, we further propose a method for deriving continuous signed distance functions from isotropic Gaussians, providing stable and differentiable collision probability estimates that bridge classical distance fields with the modern implicit representation. These continuous distance metrics are incorporated into control barrier functions, resulting in a unified perception-action coupling framework that supports smooth and reliable real-time motion generation in response to scene changes. Experimental validation in simulation, on physical robot, and within shared human-robot workspace demonstrates the framework's effectiveness, achieving integrated scene reconstruction and reactive control in uncertain, and dynamic environments.

68. 【2607.08945】Is sub-metre resolution necessary for cocoa mapping? A landscape-stratified evaluation of very high resolution imagery, decametric Earth Observation inputs, and operational products in Cote d'Ivoire

链接：https://arxiv.org/abs/2607.08945

作者：Kasimir Orlowski,Filip Sabo,Michele Meroni,Astrid Verhegghen,Mariana Belgiu,Felix Rembold

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Accurate cocoa mapping, Accurate cocoa, supply-chain transparency, deforestation monitoring, regulatory applications

备注：

点击查看摘要

Abstract:Accurate cocoa mapping is increasingly important for deforestation monitoring, supply-chain transparency, and regulatory applications. Spatial aggregation in conventional medium-resolution Earth observation (EO) imagery may limit cocoa detection in heterogeneous smallholder landscapes. In Cote d'Ivoire, we therefore evaluated how mapping performance varies across landscape conditions, whether very high resolution (VHR) imagery provides a meaningful advantage, and whether foundation-model embeddings improve decametric cocoa mapping. We developed models using 0.5 m Pleiades VHR imagery, a 10 m Sentinel-2 annual composite, and embeddings from TESSERA and AlphaEarth Foundations (AEF), and additionally assessed four publicly available cocoa mapping products. Performance was evaluated through a landscape-stratified accuracy assessment using 2,821 independently interpreted reference points distributed across gradients of tree cover density and landscape fragmentation. The VHR model achieved the highest performance (F1 = 0.92) and maintained F1-scores above 0.90 across all strata. Among the decametric inputs, TESSERA performed best (F1 = 0.86), followed by AEF (F1 = 0.82) and Sentinel-2 (F1 = 0.76). Of the existing cocoa products, the Kalischek product performed best (F1 = 0.83), comparable to the internally trained AEF model. Performance differences between VHR and decametric approaches increased with fragmentation and under low and high tree cover density conditions. Targeted VHR acquisition may therefore be particularly beneficial in complex cocoa landscapes, while foundation-model embeddings offer a scalable alternative for large-area mapping.

69. 【2607.08932】Vision Transformers Learn Gestalt-Like Figure-Ground Cues from Natural Images

链接：https://arxiv.org/abs/2607.08932

作者：Matthias Tangemann,Benjamin Lo,Zygmunt Pizlo,Kaleem Siddiqi,Dirk B. Walther,Sven Dickinson

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：visual system relies, human visual system, Figure-ground, human visual, cues

备注：

点击查看摘要

Abstract:Figure-ground organization in the human visual system relies on several shape-based cues, including surroundedness, convexity, and symmetry. While these cues have been extensively studied using abstract stimuli, little is known about how they operate under natural conditions or how they arise from the statistics of natural scenes. Deep neural networks offer a promising path forward: a model that relies on the same figure-ground cues as humans would provide tractable experimental access to the underlying mechanisms. In this study, we evaluate shape-based figure-ground organization in Vision Transformers (ViTs), for which prior work has demonstrated the emergence of object-based grouping. We test 25 ViTs spanning supervised and self-supervised training objectives, by fitting linear probes to predict figure-ground assignment from intermediate patch representations using both natural images and controlled artificial stimuli that isolate individual cues. Our results show that ViTs robustly encode surroundedness and convexity, and that probes trained on natural images generalize zero-shot to artificial stimuli across several models. For symmetry we observe mixed results: the cue is encoded for uniformly colored but not for textured regions. Taken together, our findings demonstrate that Gestalt-like figure-ground cues can be learned from natural scene statistics and position ViTs as a compelling model system for studying the computational mechanisms of perceptual organization. Code and data is available at this https URL

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.08932 [cs.CV]

(or
arXiv:2607.08932v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.08932

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

70. 【2607.08896】HAT Super-Resolution and a PARSeq+CLIP4STR Voting Ensemble for Extreme In-the-Wild License Plate Recognition

链接：https://arxiv.org/abs/2607.08896

作者：Karthik Sivarama Krishnan,Koushik Sivarama Krishnan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：License Plate Super-Resolution, public validation leaderboard, Grand Challenge, Challenge on Extreme, License Plate

备注： 2 pages, 1 figure, 1 table. Accepted at the IEEE ICIP 2026 Grand Challenge on Extreme In-the-Wild License Plate Super-Resolution (XLPSR). Top-8 finalist

点击查看摘要

Abstract:We describe our entry to the ICIP 2026 Grand Challenge on Extreme In-the-Wild License Plate Super-Resolution (XLPSR), which scored 9.73 wECR on the public validation leaderboard. The system pairs a Hybrid Attention Transformer super-resolution (HAT) front-end with an ensemble of two scene-text recognisers (PARSeq-S and CLIP4STR-B) and a confidence-weighted character-voting scheme that abstains on uncertain positions. We treat XLPSR as a recognition task gated by image legibility: the SR step exists to lift characters out of sub-pixel territory, and the asymmetric scoring rule (+2 / -1 / 0) is exploited explicitly through abstention. Our pipeline runs in 1.7 s per sequence on RTX 3090 (max 2.7 s, p99 2.4 s), well under the 60 s/sequence Docker budget.

71. 【2607.08879】Decoupled Illumination Priors for Spatially Controllable Multi-View Indoor Scene Relighting

链接：https://arxiv.org/abs/2607.08879

作者：Chenjian Gao,Linning Xu,Tianfan Xue

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：precise spatial control, relighting demands photorealism, strict multi-view consistency, demands photorealism, precise spatial

备注：

点击查看摘要

Abstract:Indoor scene relighting demands photorealism, precise spatial control, and strict multi-view consistency. While diffusion-based image editing models enable semantic lighting manipulation via text prompts, enforcing exact 3D light placement often disrupts their generative priors. We propose Lume-Palette, a progressive framework that leverages semantic lighting priors for spatially controllable multi-view indoor relighting. The approach decouples relighting into two stages: (1) illumination distillation, which extracts canonical illumination palettes from a pretrained diffusion model to preserve realistic material-light interactions, and (2) illumination casting, which explicitly maps target spatial lighting conditions defined from coarse 3D geometry. To efficiently handle dense multi-view and multi-modal inputs, we introduce an asymmetric multi-view conditioning strategy that selectively injects essential spatial context. Experiments on diverse synthetic scenes and real-world scenes demonstrate that Lume-Palette produces photorealistic, spatially controllable, and multi-view consistent relighting results. Project Page: this https URL

72. 【2607.08867】Secure-by-Disguise: A Systematic Evaluation of Image Disguising for Confidential Medical Image Modeling

链接：https://arxiv.org/abs/2607.08867

作者：Jason Rojas,Jiajie He,Yash Patel,Yuechun Gu,Zeyun Yu,Keke Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Cloud-based deep learning, raises significant privacy, significant privacy concerns, Cloud-based deep, deep learning enables

备注：

点击查看摘要

Abstract:Cloud-based deep learning enables large-scale medical image analysis but raises significant privacy concerns when sensitive patient images are outsourced for model development. Image disguising has recently emerged as a promising privacy-enhancing technology (PET) that transforms images into visually unintelligible representations while preserving information for downstream learning. We established a unified framework to evaluate representative methods, DisguisedNets and NeuraCrypt, across four datasets involving classification and semantic segmentation tasks. Our analysis assessed predictive utility, efficiency, and robustness against reconstruction attacks. Results showed that image disguising performance varies significantly between tasks; while methods preserved utility for medical image classification, they caused substantial degradation in dense semantic segmentation. Specifically, Randomized Multidimensional Transformation (RMT) offered the optimal balance of performance and security, whereas AES-based disguising severely impacted utility. Furthermore, regression-based reconstruction attacks effective on natural images proved considerably less successful on realistic medical images. These findings provide a systematic assessment of PET suitability for confidential medical AI applications.

73. 【2607.08839】Mixture of Probes: Learning from Privileged Modalities in Multimodal LLMs Through Probing

链接：https://arxiv.org/abs/2607.08839

作者：Dominick Reilly,Qiyu Wu,Hiromi Wakaki,Srijan Das,Yuki Mistufuji

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, Language Models

备注： Preprint (16 pages)

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) are typically designed under the assumption that all modalities available during training will also be accessible at inference. However, many real-world settings violate this assumption, requiring models to operate under a privileged modality setting, where auxiliary modalities are available only during training. While these modalities contain valuable information, existing MLLMs largely fail to leverage them effectively, as they treat modalities as interchangeable inputs rather than sources of complementary supervision. We propose Mixture of Probes (MoP), a novel framework that disentangles modality-specific and modality-general signals within the MLLM, allowing the model to preserve modality-dependent structure while learning transferable representations across modalities. At its core, MoP achieves this through a structured probing mechanism that extracts and organizes information from intermediate representations of a shared modality encoder, rather than relying only on final-layer alignment as done in existing MLLMs. To support this disentanglement, we further introduce MoP Cross-modal Training (MoP-X), a training strategy for MoP centered around a probe disentanglement loss that prevents probe collapse and encourages cross-modal learning. We evaluate MoP across two domains spanning eight tasks and four modalities under a comprehensive evaluation protocol tailored to the privileged modality setting, where each modality is independently treated as the sole input at inference time. MoP consistently outperforms strong MLLM baselines, achieving up to 65% relative improvement, demonstrating that auxiliary modalities, even when unavailable at inference, can provide substantial gains when effectively leveraged during training. Code, model checkpoints, and evaluation protocols will be made available at this https URL.

74. 【2607.08808】StereoSplat+: Feed-Forward Stereo Gaussian Splatting with Diffusion-Assisted Progressive Inference

链接：https://arxiv.org/abs/2607.08808

作者：Zihua Liu,Masatoshi Okutomi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Gaussian Splatting, render-ready scene representations, stereo, Splatting, render-ready scene

备注： 8 pages, accepted as a conference paper for IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS2026)

点击查看摘要

Abstract:Recent advances in 3D Gaussian Splatting (3DGS) have enabled high-quality, render-ready scene representations for novel-view synthesis. However, most existing 3DGS pipelines rely on multi-view observations (or non-causal access to future frames) to achieve sufficient coverage, which is often unavailable in on-device robotics and AR settings where sensing is restricted to a single stereo rig. Recovering a high-quality 3DGS scene from one stereo observation, therefore, remains challenging due to occlusions, limited field of view, and missing geometry. We present StereoSplat+, a diffusion-enhanced feed-forward framework that enables causal reconstruction from a single stereo pair. Our method builds on two key components. First, we propose StereoSplat, an input-invariant feed-forward 3D Gaussian estimator that takes a variable number of posed stereo pairs as input and predicts high-quality 3D Gaussians. StereoSplat fuses complementary geometry cues via a cost-volume branch and a triplane-based 3D volume branch and leverages continuous pose encoding to generalize across view counts and camera configurations. Second, since multiple posed stereo pairs are typically unavailable at inference time, we introduce a diffusion-enhanced one-shot progressive inference scheme called StereoSplat+: starting from one stereo pair, we render novel stereo views from the predicted 3DGS, refine them with a one-step diffusion enhancer, and feed them back as additional inputs to update the 3DGS. Experiments on the KITTI-360 dataset show that StereoSplat+ improves novel-view rendering quality and geometry accuracy, especially in occluded regions and under strong view extrapolation, outperforming recent feed-forward 3DGS baselines.

75. 【2607.08798】GReFEM: Multimodal LLMs as Zero-Shot Semantic Assistants for Physics-Guided 3D Mesh Refinement

链接：https://arxiv.org/abs/2607.08798

作者：Kartik Bali,Mahish K. Guru,Christian J Cyron,Roland Aydin

类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词：Adaptive volumetric finite, Adaptive volumetric, finite element meshing, volumetric finite element, Multimodal Large Language

备注：

点击查看摘要

Abstract:Adaptive volumetric finite element meshing is a critical step in computer-aided engineering and analysis that dictates the computational budget of a given problem. It traditionally requires iterative PDE solvers or heavily supervised, data-driven surrogates trained on large-scale simulation data. While Multimodal Large Language Models (MLLMs) excel in 2D visual tasks, their zero-shot capability to semantically ground regions based on geometric understanding and physics remains an open question. Overall, this study explores a significant question: can the high-level semantic understanding of off-the-shelf MLLMs serve as a viable, zero-shot geometric proxy for finite element mesh refinement? To investigate this, we introduce GReFEM (Geometric Reasoning Enhanced Multimodal LLMs for Finite Element Meshing), a framework that utilizes MLLMs to visually localize stress-critical regions based on physics-guided textual prompts. To bridge the gap between 2D MLLM pre-training and 3D geometries, we introduce orthoViews, a view-selection module that maximizes the observability of key geometric features. We conduct an in-depth empirical evaluation across diverse CAD geometries, loading cases, and SOTA MLLMs, comparing them against a tuned geometric heuristic under a strict, matched refinement budget. Our findings reveal that MLLMs demonstrate robust zero-shot capacity to accurately follow complex spatial-physical instructions, isolating stress-relevant features with higher precision than blind heuristics. By mapping both the successes and current limitations of MLLMs in physical grounding, this study defines the frontier of foundation models as semantic assistants in automated simulation workflows.

76. 【2607.09205】Joint-Embedding Predictive Architecture for Solar PV Panel Fault Classification

链接：https://arxiv.org/abs/2607.09205

作者：Seyyedhamid Azimidokht,Mehdi Monemi,Abdelhak Kharbouch,Farid Hamzehaghdam,Mehdi Rasti,Jamshid Aghaei,Emil Kurvinen

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：scalable fault classification, fault classification, solar photovoltaic, systems has increased, impractical at scale

备注：

点击查看摘要

Abstract:The rapid expansion of solar photovoltaic (PV) systems has increased the need for reliable and scalable fault classification, as manual inspection is impractical at scale. Thermal infrared (IR) imaging provides a non-contact solution for identifying PV faults; however, accurate classification remains challenging due to class imbalance, limited texture information, and subtle thermal differences. In this work, we investigate the applicability of Joint-Embedding Predictive Architecture (JEPA) for thermal IR PV fault classification across various scenarios and propose JEFFNet (JEPA-EFFicientNet), a multibranch architecture that combines JEPA-based self-supervised representation learning with EfficientNetV2-S-based supervised convolutional feature extraction. JEFFNet fuses semantic representations from a JEPA-pretrained Vision Transformer with convolutional features from EfficientNetV2-S, enabling complementary feature learning. JEFFNet is evaluated on two public thermal IR datasets, PVF-10 and InfraredSolarModules (ISM), for both multiclass and derived binary (healthy/faulty) classification. On PVF-10, JEFFNet achieves an F1-score of $93.21$ and an accuracy of $94.33$ in the 10-class task, and an F1-score of $97.53$ and an accuracy of $96.41$ in the derived 2-class task. On ISM, JEFFNet achieves an F1-score of $72.60$ and an accuracy of $83.88$ in the 12-class task, and an F1-score of $94.69$ and an accuracy of $94.78$ in the derived 2-class task. JEFFNet also uses only 108.6M parameters versus 205.91M for GEPFNet, a 47.2\% reduction. These results demonstrate that combining self-supervised semantic and supervised convolutional features provides an effective, parameter-efficient solution for thermal IR PV fault classification. The source code is publicly available at this https URL

77. 【2607.09102】Beyond Metadata: CAPRA for Hidden Subgroup Analysis under Missing Metadata in Medical Imaging

链接：https://arxiv.org/abs/2607.09102

作者：Yawen Li,Yan Li,Zhe Xue,Yingxia Shao,Meiyu Liang,Guanhua Ye

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：Medical imaging models, Medical imaging, quality metadata needed, imaging models, Medical

备注：

点击查看摘要

Abstract:Medical imaging models are often deployed without the demographic, acquisition, and quality metadata needed for subgroup auditing. Once those metadata disappear, clinically critical failure modes can be masked by strong aggregate performance, and many robust-learning methods lose the group structure they rely on. We present CAPRA, a calibrated proxy-axis framework for hidden subgroup analysis under missing metadata. CAPRA predicts image-derived semantic axes, calibrates axis posteriors on a small metadata-labeled split via patient-level cross-fitting, and organizes those posteriors into a calibrated subgroup interface that supports both deployment-time failure analysis and downstream robust learning without requiring subgroup labels at deployment. Across fundus, dermoscopy, and chest radiography, CAPRA reveals disparity patterns missed by metadata-only slicing, remains informative under dataset shift, and produces subgroup partitions that align more closely with explicit failure axes than image-only or latent-slice baselines. The same interface can also be reused by downstream robust learners, although those gains are domain-dependent. Overall, CAPRA turns hidden subgroup analysis under missing metadata into a calibrated, interpretable, and reusable subgroup interface for deployment-time analysis and robust transfer.