本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新549篇论文，其中：
- 自然语言处理54篇
- 信息检索10篇
- 计算机视觉102篇
自然语言处理
1. 【2607.14051】Hindcast: Replaying Prediction Markets to Evaluate LLM Forecasters
链接：https://arxiv.org/abs/2607.14051
作者：Xiao Ye,Jacob Dineen,Evan Zhu,Shijie Lu,Kevin Song,Ben Zhou
类目：Computation and Language (cs.CL)
关键词：Forecasters are evaluated, evaluated by backtesting, probability the system, Forecasters, replays resolved questions
备注：
点击查看摘要
Abstract:Forecasters are evaluated by backtesting, which replays resolved questions and grades the probability the system would have assigned before the outcome was known. For LLMs, two channels leak the answer into this test. A model that retrieves can surface reports written after the event, turning forecasting into a lookup, and each new model is trained on data closer to the event, so a question that lay in the future for last year's models sits inside this year's training data. Either way, the test grades recall while claiming to grade foresight. We introduce Hindcast, which closes both leaks by grading a model as if it stood at a chosen past date $t_0$, before the outcome existed in either channel. Hindcast replays resolved Polymarket prediction markets against a frozen snapshot of public Reddit, lets the model read only posts written before $t_0$, and scores each forecast against both what happened and the market's own price at $t_0$, itself a human forecast made from the same past information. Because the cutoff is set per market and the snapshot never changes, the evaluation re-runs on new markets as models improve, without going stale. Once the leak is closed, retrieval still helps most models, but only where Reddit discussed the event beforehand. Where the archive carried only speculation, retrieval hurts.
2. 【2607.14040】Can an Old Dog Be Taught New Tricks? Taking LLMs Beyond Sentence Level Translation
链接：https://arxiv.org/abs/2607.14040
作者：Alaina Brandt
类目：Computation and Language (cs.CL)
关键词：CAT tools, overwhelmingly treat translation, Latin American Spanish, overwhelmingly treat, CAT
备注： Accepted for publication in HCI International 2026, Late Breaking Papers Proceedings, Springer LNCS
点击查看摘要
Abstract:Automatic translation systems, from CAT tools to MT, overwhelmingly treat translation as a sentence-by-sentence act. This paper asks whether LLMs can be moved beyond that paradigm through whole-document, corpus-informed translation. We present PAT (Pragmatic Auto-Translator), a RAG-based system that pairs user-configured specifications with context from a comparable corpus of authentic longform texts in U.S. English and Latin American Spanish, passing retrieved paragraph-, section-, and document-level examples to an LLM for whole-document generation. The goal is draft translation for professional verification: target texts reformulated to fit their Spanish-language context, where discourse organization, rhetorical style, and pragmatic norms differ meaningfully from English. We evaluated six automatic translations of essays on generative AI across three projects using a customized MQM typology, assessed by two trained evaluators working from U.S. English into LATAM and Mexican Spanish. Results show that a limited prompt produced no meaningful reformulation, and specifications and corpus-informed translations at times showed substantial reformulation, though not always to effect. We find that LLMs can be moved toward reformulation and away from the sentence-by-sentence paradigm, though more work is needed to improve the effectiveness of those reformulations. In this paper, we discuss considerations related to automatic translation system design, corpus construction, and translation quality evaluation methodology and results.
3. 【2607.14004】Do Agent Optimizers Compound? A Continual-Learning Evaluation on Terminal-Bench 2.0
链接：https://arxiv.org/abs/2607.14004
作者：Wenxiao Wang,Priyatham Kattakinda,Soheil Feizi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Meta Harness, fixed benchmark, resulting improvement, stable property, Verifiable Continual Learning
备注： Technical Report by RELAI ( [this http URL](http://relai.ai) )
点击查看摘要
Abstract:Most reported gains from agent-optimization methods are one-shot: an agent is optimized against a fixed benchmark and the resulting improvement is reported as if it were a stable property of the method. This does not test the setting that matters for deployed agents, where optimization is applied recursively as new failures and new tasks appear over time. The central question this raises is whether optimizer-driven gains compound: after an agent has been optimized once, can it be optimized again on newly arrived tasks without eroding the gains the first round produced? We study this question with a two-phase continual-learning evaluation built from hard tasks in Terminal-Bench 2.0, comparing three approaches to agent-harness optimization (GEPA, Meta Harness, and RELAI's Verifiable Continual Learning, RELAI-VCL) under identical optimization budgets. All three methods improve over the baseline agent in the conventional, static, single-phase setting. However, once new tasks are introduced, the methods diverge sharply: GEPA's optimized agent transfers below the unoptimized baseline, Meta Harness transfers well but fails to improve further once given a second optimization budget, and RELAI-VCL is the only method that both transfers positively to unseen tasks and continues improving after those tasks are folded into the optimization objective, reaching the highest pass rate at every evaluated stage and the highest lifelong average pass rate overall (76.4% vs. 66.0% for GEPA, 64.6% for Meta Harness, and 58.7% for the baseline). Our key observation was that optimization gains compounded only when regression control was built into the optimization loop, providing an inductive bias against shortcut solutions that fail to generalize.
4. 【2607.13977】Constraint-Aware Counterfactual Editing for Aspect-Based Sentiment Analysis
链接：https://arxiv.org/abs/2607.13977
作者：S M Rafiuddin,Vamsi Krishna Pavuluri,Atriya Sen
类目：Computation and Language (cs.CL)
关键词：Aspect-Based Sentiment Analysis, Sentiment Analysis, global polarity, Aspect-Based Sentiment, Sentiment
备注： 15 pages, 1 figure, and 5 tables. Accepted for presentation at the 2nd International Workshop on Informing ML with Knowledge Engineering for Hybrid Intelligent Systems (HHAI-KEML 2026), Brussels, Belgium
点击查看摘要
Abstract:Aspect-Based Sentiment Analysis (ABSA) requires models to identify sentiment toward specific aspects rather than relying on the global polarity of a sentence. This makes counterfactual evaluation especially challenging: a valid counterfactual should flip the sentiment of one target aspect while preserving the sentiment of all non-target aspects, semantic meaning, fluency, and factual consistency. Existing counterfactual generation methods often focus on sentence-level label flipping and may produce edits that are fluent but aspect-invalid, semantically drifting, or contradictory. To address this limitation, we propose CAVE-ABSA, a Constraint-Aware Validated Editing framework for generating and validating aspect-level counterfactuals. CAVE-ABSA localizes the opinion span associated with the target aspect, performs controlled counterfactual rewriting, refines candidates through a repair module, and filters them using aspect-level verification, semantic similarity, AMR-guided structural preservation, edit minimality, fluency, and contradiction detection. The framework is designed to construct validated counterfactual ABSA datasets for robustness evaluation and data augmentation. By explicitly separating generation from validation, CAVE-ABSA provides a principled approach for producing meaningful aspect-local counterfactuals and for testing whether ABSA models truly rely on aspect-grounded sentiment reasoning.
5. 【2607.13967】DeltaMerge-LowRes: Composing Language and Task Deltas for Low-Resource Adaptation
链接：https://arxiv.org/abs/2607.13967
作者：Son Ha Xuan,Xuan-Bach Le,Phat T. Tran-Truong
类目：Computation and Language (cs.CL)
关键词：low-resource NLP setting, common low-resource NLP, NLP setting, Adapting a multilingual, low-resource NLP
备注：
点击查看摘要
Abstract:Adapting a multilingual encoder to a new language \emph{and} a new task with only a few hundred gold examples is a common low-resource NLP setting, yet the two axes are usually fused via an expensive language--task fine-tuning run. We ask whether they can instead be trained separately and recombined in weight space. \DeltaMergeLowRes{} learns a language delta $\Delta_L$ from unlabeled monolingual text and a task delta $\Delta_T$ from labeled English data, then composes them at inference under one of four rules: additive, activation-guided, sparsity-aware, and a novel \emph{cross-axis TIES}. The new rule adapts the TIES-Merging steps of trimming, sign election, and merging to the language and task axes rather than to two task axes. Holding $(\Delta_L,\Delta_T)$ fixed across rules on four task families and four African languages ($158$ evaluated cells, $10{,}000$-sample paired bootstrap per cell), we find: (i) cross-axis TIES wins summarisation on $3/4$ languages by $+4$ to $+7$ chrF (chrF $18.59$ vs.\ $13.80$ task-only); (ii) it improves QA F1 by $+2.32$ and EM by $+2.91$; and (iii) sparsity-aware merging cuts classification ECE by $36\%$ at parity macro-F1. The composition rule materially changes what the merged model preserves, suppresses, and calibrates. We release all JSON traces and a claim ledger.
6. 【2607.13920】DeepStress: Stress-Testing Deep Search Agents
链接：https://arxiv.org/abs/2607.13920
作者：Ismael Rousseau,Geraldine Damnati,Frederic Bechet
类目：Computation and Language (cs.CL)
关键词：multi-step question answering, evidence remains under-explored, poor-quality evidence remains, demonstrate impressive capabilities, question answering
备注： 9 pages preprint
点击查看摘要
Abstract:While search agents demonstrate impressive capabilities in multi-step question answering, their robustness to poor-quality evidence remains under-explored. This phenomenon occurs rarely in realistic benchmarks but can lead to dramatic failure in real life applications. Therefore in this study we propose DeepStress, a stress testing framework that controls the frequency of challenging evidence by replacing the retrieval module of search agents with a controlled synthetic environment. We use this framework to control three dimensions that can affect document reliability: trustworthiness, relevance, and factuality. Testing several search agents on HotpotQA and BrowseCompPlus, we demonstrate that agents exhibit substantial differences in their ability to handle unreliable information and propose new metrics that better document systems outcomes as well as the interactions between conflicting parametric and retrieved knowledge.
7. 【2607.13901】High-Order Question Generation in a Multilingual Educational Context
链接：https://arxiv.org/abs/2607.13901
作者：Suna-Şeyma Uçar,Itziar Aldabe,Nora Aranberri,Orphée De Clercq
类目：Computation and Language (cs.CL)
关键词：Critical thinking, simple memorization, learners move, move beyond simple, Bloom Taxonomy
备注： This paper was accepted at the 15th edition of the Language Resources and Evaluation Conference (LREC 2026)
点击查看摘要
Abstract:Critical thinking is a fundamental skill that helps learners move beyond simple memorization. One way to develop this skill is through high-order questioning. However, crafting such questions remains a challenge for educators, and classroom practices tend to rely on low-order questions. Large Language Models have demonstrated strong capabilities in generating high-order questions, especially when guided by prompts based on Bloom's Taxonomy. Yet, existing research has largely centered on this framework and focused only on English. This study addresses these gaps by introducing prompts grounded in two alternative frameworks: Claim-Evidence-Reasoning and Divergent Questioning within a multilingual context using Basque, Spanish, and English. Results indicate that while both an open-source and a proprietary model rather effectively generate questions in all three languages, only about half of the answerable questions are recognized by teachers as high-order. A positive finding is that the alternative frameworks produce structurally and conceptually varied questions, suggesting they could complement each other and provide viable alternatives to Bloom's Taxonomy.
8. 【2607.13854】SPyCE: Skill-Policy Co-evolution for Multimodal Agents
链接：https://arxiv.org/abs/2607.13854
作者：Ru Zhang,Weijie Qiu
类目：Computation and Language (cs.CL)
关键词：images iteratively manipulate, iteratively manipulate visual, manipulate visual evidence, images iteratively, iteratively manipulate
备注：
点击查看摘要
Abstract:Multimodal agents that think with images iteratively manipulate visual evidence and invoke tools across many steps. Existing reinforcement learning methods reduce trajectories to scalar rewards, forcing the policy to discover reusable tool-use patterns from scratch on every new task; memory-based alternatives retain past experience, yet they rely on test-time retrieval, without updating the policy to absorb reusable patterns from that experience. Our key insight is that multimodal reasoning trajectories should be distilled into reusable skills that co-evolve with the policy during training, rather than being consumed as rewards or retrieved from a static store. To this end, we propose SPyCE (Skill-Policy Co-evolution), a framework that distills trajectories into a hierarchical skill library and updates it throughout reinforcement learning. Execution skills capture local visual operations, while workflow skills encode high-level priors that orchestrate tool use. During training, the policy model conditions on retrieved skills to guide its rollouts, while the skill library evolves using valuable rollouts generated by the policy. This creates a closed loop in which improved policies yield better skills, and the evolving skill library, in turn, provides stronger priors for policy rollouts. Experiments across eight benchmarks demonstrate that SPyCE consistently outperforms both RL-based and memory-based baselines. Further analysis reveals that both the hierarchical skill design and the co-evolution mechanism are critical to our design. These results suggest joint skill-policy optimization as a promising paradigm for building capable multimodal agents.
9. 【2607.13782】Regularity as seen by Alice and Bob
链接：https://arxiv.org/abs/2607.13782
作者：Omid Yaghoubi,Mikołaj Bojańczyk,Aliaume Lopez,Rafał Stefański
类目：Formal Languages and Automata Theory (cs.FL); Computational Complexity (cs.CC); Computation and Language (cs.CL)
关键词：propose a unifying, output domains, non-Boolean output domains, output, allowing non-Boolean output
备注：
点击查看摘要
Abstract:The goal of this paper is to propose a unifying model for Nerode-style characterizations of regularity across functions with different output domains. Building on Hauser's work in communication complexity, we generalize the setting by relaxing the computability assumptions and allowing non-Boolean output domains. We consider functions of type $\Sigma^* \to \domain$, where $\Sigma$ is a finite alphabet and $\domain$ is an arbitrary domain. For several domains, we show that the model coincides with known models of computation. We further conjecture that an analogous correspondence holds for other domains that currently lack a Nerode-style characterization of regularity, and we provide ample supporting evidence. In the model, an input string $w$ is split as $w = w_1 w_2$ and distributed between two cooperating parties, Alice and Bob, who exchange a constant number of messages to compute the value of the function. Each message is either an element of the output domain or a signal drawn from a finite set of signals, and the parties must produce the correct output for every admissible split $w = w_1 w_2$. We further extend the framework to infinite alphabets in the setting of nominal sets, and investigate its expressiveness on languages of words with atoms.
10. 【2607.13753】Post-Training Shifts Confidence: A Three-Stage Analysis of How SFT, RL, and OPD Shape Pre-, Intra-, and Post-CoT Calibration
链接：https://arxiv.org/abs/2607.13753
作者：Shuhao Li,Guodong Du,Anhao Zhao,Wanyu Lin,Tianyu Yuan,Xiaoyu Shen
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, made strong reasoning, reinforcement learning, supervised fine-tuning
备注：
点击查看摘要
Abstract:Large language models have made strong reasoning gains through supervised fine-tuning, reinforcement learning, and on-policy distillation, yet these post-training methods are usually evaluated only by final-answer accuracy. We study how they reshape confidence during reasoning. We introduce a three-stage calibration framework that evaluates confidence before, during, and after chain-of-thought generation, corresponding to difficulty estimation, early termination, and answer aggregation. Through a controlled comparison on mathematical reasoning benchmarks, we find that OPD provides the most useful pre-reasoning confidence, SFT gives the strongest online signal for early stopping, and RL produces the most reliable trace-level signal for aggregation. We further show that confidence reliability is position-dependent: RL confidence becomes informative after a path-commitment phase, while OPD confidence is useful early but can become inversely calibrated later. Based on this observation, we propose PosConf, a position-aware confidence strategy that uses confidence only from reliable relative-position intervals. PosConf improves RL answer aggregation by 6.1 points over majority voting and consistently improves OPD early stopping under tight token budgets, with gains up to 4.3 points by avoiding its later inverse-calibration region, showing that \emph{confidence in reasoning models should be used both stage-wise and position-awarely}. Our code is available at this https URL.
11. 【2607.13721】Self-supervised Speech Comparison for L2 Phone, Rhythm, and Intonation Scoring
链接：https://arxiv.org/abs/2607.13721
作者：Stephen McIntosh,Reuben Smit,Daisuke Saito,Nobuaki Minematsu,Herman Kamper
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：traditionally focused, English and Japanese, intonation underexplored, assessment, Abstract
备注：
点击查看摘要
Abstract:L2 speech assessment has traditionally focused on phonetic assessment, leaving the scoring of suprasegmental features such as rhythm and intonation underexplored. Moreover, assessment methods often require training with labeled L2 speech data, making them difficult to apply in low-resource settings. We investigate whether DTW over self-supervised WavLM representations can provide a text-free framework for assessing phonetic accuracy, rhythm, and intonation in English and Japanese L2 speech. Results show that a basic DTW-based approach that compares learner speech to native templates exceeds human agreement on holistic and sentence-level phonetic scoring. For rhythm, we introduce methods that measure the degree of warping in the DTW alignment path; our best method approaches human-level performance. For intonation, we combine DTW distance over prosodic residuals with pitch and intensity features, but performance remains more modest on some tasks. Our results point to self-supervised representations as a promising, text-free basis for multi-aspect pronunciation assessment.
12. 【2607.13712】Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs
链接：https://arxiv.org/abs/2607.13712
作者：Zhixiao Zheng,Zheren Fu,Zhiyuan Yao,Chunxiao Liu,Dongming Zhang,Zhendong Mao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：Large Language Models, Multimodal Large Language, Language Models, Large Language, Multimodal Large
备注： Accepted by ACM-MM 2026
点击查看摘要
Abstract:Despite the rapid progress of Multimodal Large Language Models (MLLMs), they still suffer from untruthfulness issues, such as visual hallucinations, content fabrication, and unfaithful reasoning, which substantially undermine their faithfulness and practical utility. Alignment methods based on human preference, such as Direct Preference Optimization (DPO), have been widely adopted to address these issues. However, multimodal reasoning errors often propagate across stages, and final-answer errors can often be traced to mistakes in early grounding stages, yet standard DPO typically applies preference optimization at the final-answer level. This credit-assignment challenge means that supervision for early grounding stages is indirect rather than stage-specific, making it difficult to suppress error propagation arising from grounding drift and context inconsistency. To address this, we propose Grounded Context Preference Optimization (Groc-PO), a grounded preference optimization framework for MLLMs. We further construct the Grounded Context Preference Dataset (GCPD), organizing multi-stage preference samples around three stages of Object Grounding, Contextual Grounding, and Grounded Reasoning, to capture the formation, integration, and utilization of grounded context. By introducing more explicit preference supervision over multiple grounded stages, Groc-PO strengthens context-dependent reasoning and mitigates cross-stage error propagation. Extensive experiments show that, compared with standard DPO and other strong baselines, Groc-PO achieves improved performance in hallucination mitigation, faithful reasoning, and overall reliability, supporting the value of more explicit grounded supervision for trustworthy multimodal reasoning.
13. 【2607.13707】he Test Oracle Problem in Synthetic LLM-as-Judge Corpora: Disappearance, Distortion and a Validation Protocol
链接：https://arxiv.org/abs/2607.13707
作者：Serkan Ballı(Department of Software Engineering, Mehmet Akif Ersoy University, Burdur, Türkiye)
类目：Computation and Language (cs.CL)
关键词：systems typically build, typically build synthetic, prompting an LLM, LLM to generate, build synthetic corpora
备注： 23 pages, 1 figure, 3 tables
点击查看摘要
Abstract:Studies of bias in LLM-as-judge systems typically build synthetic corpora by prompting an LLM to generate a hallucinated answer to pair with a factual one, then presenting both to a judge. We report a case in which this generation step silently failed, and use it to argue that the failure mode is structural rather than incidental. In a multilingual (Turkish/English) faithfulness-judgment corpus, a decoding-budget parameter shared between judging and generation calls truncated one producer's hallucinated answers to a few words. The resulting items produced a large, statistically robust effect: a 32-point cross-lingual collapse in one judge's selection accuracy, replicated from N=50 to N=500, explained by a three-layer mechanistic account, and confirmed by a controlled producer-swap experiment, none of which was real. The effect vanished to ceiling once the shared parameter was corrected, and only manual reading of the raw generations, not any aggregate statistical check, exposed the fault. A second measured bias (Markdown-formatting preference) was not fabricated but distorted by the same fault, its magnitude and in one case its sign shifting with stimulus length, a mode aggregate metrics cannot distinguish from the first. We frame the underlying vulnerability using the test oracle problem: corpora whose negative examples are LLM-generated carry no mechanical way to verify item integrity, while corpora built by deterministic perturbation of a gold answer carry an item-level oracle for free. A positive control supports this claim directly: an analogous fault injected into a minimal perturbation-based corpus is caught with 100% accuracy by a zero-cost, zero-human gold-to-negative string comparison. We close with a validation protocol, derived from our own case, for analysts working in the oracle-less regime that we argue describes most contemporary multilingual LLM-as-judge corpora.
14. 【2607.13683】Self-Evolving Agent Harnesses via Gated Semantic Quality-Diversity
链接：https://arxiv.org/abs/2607.13683
作者：Xiaotian Luo,Fengxingyu Wang,Chuanrui Hu,Dizhan Xue,Yafeng Deng
类目：Computation and Language (cs.CL)
关键词：LLM agent real-task, agent real-task performance, LLM agent, injected knowledge, runtime control
备注： 13 pages, 4 figures
点击查看摘要
Abstract:An LLM agent's real-task performance is shaped as much by the harness around its model as by the frozen model itself: its prompts, injected knowledge, runtime control, and configuration. In deployment the harness is often the only lever available, so improving it automatically is the natural way to raise performance without touching the weights. The hard part is not generating changes but knowing which one truly helped. Self-generated feedback is noisy, and an apparent gain can be a measurement artifact or an edit that merely overfits the tasks it was tuned on. We present a self-evolving agent-harness framework that separates proposing changes from crediting them: a language model diagnoses failures and proposes patches, while all sampling, measurement, and significance testing are owned by deterministic code, so every credited improvement is trustworthy by construction. Patches populate a gated, categorical quality-diversity archive (GSME) keyed on the (WHERE x WHY) pathology an edit addresses rather than the tasks it fixes, an anti-overfitting inductive bias; generalization is measured on a sealed test scored only after evolution. Across seven domains with a frozen open-weight model, the harness is train-selected and scored once on a sealed test; its credited gains there are +9 to +15.5pp and retain 86-147% of the training gain, evidence they generalize rather than overfit. The winning patch tracks the model's dominant pathology, not its size or family: changing the model can change the pathology and the patch, while the same pathology-to-patch match recurs across two model families. What transfers is the diagnose-and-credit loop, not any specific harness.
15. 【2607.13643】Consensus as Privileged Context for Label-Free Self-Distillation
链接：https://arxiv.org/abs/2607.13643
作者：John Gkountouras,Josip Jukić,Ivan Titov
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Sampling multiple solutions, large language models, Sampling multiple, accuracy of large, large language
备注：
点击查看摘要
Abstract:Sampling multiple solutions and returning the majority answer is among the most reliable ways to improve the reasoning accuracy of large language models without labels, and a growing family of methods converts this consensus signal into training supervision. However, existing approaches use consensus only in restricted forms: as a filter that selects solutions for fine-tuning, as a preference between answers, or as a scalar reward for reinforcement learning, discarding most of the information that the agreeing solutions contain. We present CANON (Consensus-ANchored self-distillatiON), a label-free training method that turns consensus into dense, token-level supervision. For each unlabeled prompt, CANON samples multiple solutions, extracts the majority answer, and conditions a frozen snapshot of the model on a solution that reaches it; this consensus-anchored teacher then supervises the model on its own rollouts at every token. Experiments on mathematical and scientific reasoning benchmarks show that CANON improves pass@1 by up to 12 points, outperforming label-free reinforcement learning by 6 points at a seventh of its compute and approaching a teacher conditioned on gold solutions; trained on pooled unlabeled data, it transfers to held-out benchmarks, matching training methods that use gold labels. Analysis suggests that the improvements are not pure distribution sharpening: after training, the model solves problems it previously never solved in 32 attempts, and its majority vote itself becomes more accurate.
16. 【2607.13602】Analogical Deep Research: Retrieving and Integrating Historical Analogies for Foresight Analysis
链接：https://arxiv.org/abs/2607.13602
作者：Yongqiang Chen,Guangyi Chen,Yuewen Sun,Kun Zhang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：Large Language Model, structurally similar past, Systematic comparisons, similar past events, foresight analysis
备注： Ongoing project
点击查看摘要
Abstract:Systematic comparisons between current situations and structurally similar past events in the historical, i.e., historical analogies, is among the most powerful tools for foresight analysis. In this work, we present a new task called Analogical Deep Research (ADR) to Large Language Model (LLM) agents and construct the first ADR benchmark ADR-bench to study whether LLM agents are able to find and leverage historical analogies when doing foresight analysis. Our investigation reveals a key obstacle: LLM agents are poor at finding analogies because they match on surface features rather than underlying mechanisms. We argue that ADR is inherently a causal question as it requires understanding why the event occurred. Based on our theoretical analysis, we propose two principles required for ADR, including the mechanism alignment and cross-analogy confirmation. Built upon our theoretical results, we propose a new agentic framework called Causal Analogical Researcher (CANA) that guides LLMs to find and integrate historical analogies. CANA incorporates a simple yet effective structural decomposition representation, and integrates structural feedback for reflective improvements of historical analogy identification and integration. We show that CANA brings up to 10% improvements in historical analogy generation, and surpasses the state-of-the-art deep research agents in the ADR-bench. Case studies with the ongoing events confirm the effectiveness of CANA in leveraging historical analogies.
17. 【2607.13591】Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
链接：https://arxiv.org/abs/2607.13591
作者：Eric Hanchen Jiang,Zhi Zhang,Yuchen Wu,Levina Li,Dong Liu,Xiao Liang,Rui Sun,Yubei Li,Edward Sun,Haozheng Luo,Zhaolu Kang,Aylin Caliskan,Kai-Wei Chang,Ying Nian Wu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Model, Large Language, external memory systems, agents increasingly rely, Language Model
备注：
点击查看摘要
Abstract:Large Language Model (LLM) agents increasingly rely on external memory systems to accumulate experience across tasks. Yet nearly all existing approaches, from graph-structured memories to reflective insight stores, access memory through fixed, hand-designed heuristics. We argue that this static view of memory is a core bottleneck for agentic learning because optimal memory behavior is fundamentally context-dependent. The early stages of the tasks, benefit from minimal retrieval because memory is sparse; recurring goal types benefit from plan reuse rather than generic nearest-neighbor lookup; stuck agents benefit from re-retrieval with alternative queries; and across long task streams, the memory store itself must be consolidated and pruned to remain useful. We present Memory as a Controlled Process (MemCon), a framework that models memory operations as a Markov Decision Process and learns an online policy that adaptively decides when, what, and how much to retrieve, when to inject a distilled plan, and when to consolidate or forget. MemCon is backend-agnostic: it wraps any existing memory implementation, learns from task-by-task binary feedback with no pretraining and no additional LLM calls, and uses a lightweight tabular contextual bandit with UCB exploration that converges within tens of tasks. Across 6 benchmarks, 3 agent frameworks, and 3 LLM backbones, MemCon consistently outperforms multiple memory baselines by up to 15.2 points in task success while reducing token consumption by 5--20%.
18. 【2607.13568】Graded Entity-Familiarity Readouts in Language Models: Polish Adaptation, Cross-Language Robustness, and Refusal Steering
链接：https://arxiv.org/abs/2607.13568
作者：Grzegorz Brzezinka
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：generating an answer, language model estimate, ten Wikipedia-pageview deciles, Polish entities spanning, Polish-adapted Bielik
备注： 16 pages, 8 figures, 5 tables. Code and data: [this https URL](https://github.com/agentGreg/bielik-entity-familiarity)
点击查看摘要
Abstract:Can a language model estimate its familiarity with an entity before generating an answer? We study activations at the final prompt token in twelve instruction-tuned models from the Bielik, PLLuM, Gemma-4, and Qwen3 families, using a new dataset of 1,440 Polish entities spanning four domains and ten Wikipedia-pageview deciles, plus fabricated controls. Familiarity-probe scores separate real from fabricated entities in every family; in the Polish-adapted Bielik and PLLuM families they additionally track entity popularity (model-mean Spearman $\rho$ 0.28-0.57, versus at most 0.11 in Gemma-4 and Qwen3), a pattern more strongly associated with Polish adaptation than with parameter count in this model sample. In a paired experiment on two families, probes retain 96-101% of within-language AUROC when the Polish question stem is replaced with an English one around unchanged entity names, showing robustness to prompt language in this setting. In Gemma-4-12B, the only model that natively refuses, adding a one-dimensional familiarity direction at a single layer moves refusal rates monotonically in both directions (0.24 to 1.00 on well-known entities; 0.73 to 0.00 on unknown ones). Finally, a calibrated familiarity probe is competitive among pre-generation abstention gates, although post-generation detectors better predict behavioral error on average. These results support a graded pre-generation entity-familiarity readout, and a separation between representational familiarity and the policy that converts it into abstention.
19. 【2607.13565】UTS at ELOQUENT 2026 Voight-Kampff: structural shifts in AI writing bypass state-of-the-art detectors
链接：https://arxiv.org/abs/2607.13565
作者：Dima Galat,Marian-Andrei Rizoiu
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：language model evasion, evasion attacks survive, model evasion attacks, Voight-Kampff leaderboard, sweep the top
备注： CLEF2026, ELOQUENT2026
点击查看摘要
Abstract:We investigate which language model evasion attacks survive state-of-the-art adversarial fine-tuning, developing strategies that sweep the top 5 positions on the ELOQUENT 2026 Voight-Kampff leaderboard. While adversarial fine-tuning trivially closes the 2025 winning evasion recipes, we uncover a fundamental asymmetry in detector vulnerability: pushing generated text out of the detector's training distribution reliably defeats adversarial detection, whereas pulling it into the distribution (e.g., mimicking human training data) fails completely. Exploiting this, we introduce two novel out-of-distribution attack families - cross-decade register attacks and modernist stream-of-consciousness form. Both strategies easily bypass adversarial closure, achieving up to approximately 50x higher fool rates than previous methods while preserving naturalness. Furthermore, experiments show that the obvious deployer countermeasure (augmenting training data with period prose) fails to close the vulnerability. Our findings show that the tested detector families, including adversarially fine-tuned ones, exhibit persistent vulnerabilities under structural out-of-distribution shifts, a mechanism that directly powers our leading competition performance.
20. 【2607.13551】Cost-Pragmatic Quality Gating and Selection-Fusion Multi-Model Combiners for BioASQ Phases A+ and B
链接：https://arxiv.org/abs/2607.13551
作者：Dima Galat,Marian-Andrei Rizoiu
类目：Computation and Language (cs.CL)
关键词：describe our BioASQ, BioASQ Task, Task, Europe PMC, list
备注： CLEF2026, BioASQ2026
点击查看摘要
Abstract:We describe our BioASQ Task 14B 2026 system. The work centers on two design decisions: how aggressively to re-retrieve when first-stage retrieval is weak, and how to combine multiple language-model answers. Retrieval unions two parallel pipelines - a hybrid first stage (dense BGE + BM25 + RRF, reaching R@200 = 99.3% on the BioASQ-13b historical archive) and an agent-driven pipeline that decomposes the question over PubMed, Europe PMC, and iCite - with a BGE cross-encoder quality gate flagging weakly-supported questions for selective re-retrieval. On Task 12B 2024 validation, a cost-pragmatic re-retrieval policy beats a skill-strict baseline significantly on list F1 and list precision, at 12% lower re-retrieval cost. Holding prompt and model fixed across val and test 13B (different question sets), list F1 rises by +0.132 absolute on the BioASQ-released gold-input pool, consistent with substantial retrieval-side headroom. For Phase B answering we decompose multi-model ensemble lift into a selection component bounded by the per-question oracle and a fusion component that aggregators can exceed. The decomposition predicts before any experiment that LLM-as-judge wins on selection-dominated metrics (yes/no, multi-reference ROUGE) but is structurally insufficient on the recall component of fusion-friendly metrics (factoid rank-1, list recall). On Task 13B 2025 our synonym-union resolver wins list recall on every head, while GPT-5.5 solo retains the list-F1 lead because the resolver's wider item set costs precision. On the Task 14B 2026 preliminary leaderboard our team places first on the combined-exact aggregate on three of the eight (phase x batch) leaderboards, wins four individual question-type cells, and takes #1 on Phase B b3 ideal.
21. 【2607.13477】Auditing Protocol-Level Shortcuts in Large Audio Language Model Judges for Speech Evaluation
链接：https://arxiv.org/abs/2607.13477
作者：Joonyong Park,David M. Chan,Yuki Saito,Hiroshi Saruwatari
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Large audio-language models, Large audio-language, Large, speech evaluation, LALM judges
备注：
点击查看摘要
Abstract:Large audio-language models (LALMs) are increasingly used as automatic judges for speech evaluation. However, high agreement with human ratings does not guarantee that their verdicts are grounded in the audio. A judge may instead rely on specialist labels or reference data supplied by the evaluation protocol itself, taking a shortcut in place of listening to the audio. In this paper, we audit such protocol-level ``shortcuts'' in LALM judges across three common deployment protocols: feature-blueprint judging, where the audio is replaced by a structured text description of acoustic features, reference-conditioned judging, and pairwise A/B comparison. Across six judges and four attributes, we find that several LALMs rely on protocol-level shortcuts. For example, in feature-blueprint judging, incorrect specialist labels reduce five judges' emotion accuracy to 0.10 or below, and in concatenated A/B comparisons, Qwen3-Omni-Thinking often picks the same slot regardless of order swaps. These results indicate that aggregate agreement can overstate the validity of LALM judges unless the model and the evaluation protocol are assessed jointly, and that each model-protocol pair should be evaluated with a matched shortcut probe.
22. 【2607.13474】MyAG: A Graph-Based Framework for Designing and Analyzing Composable LLM Agent Systems
链接：https://arxiv.org/abs/2607.13474
作者：Zhisong Zhang
类目：Computation and Language (cs.CL)
关键词：analyzing composable LLM, composable LLM agent, composable LLM, LLM agent systems, LLM agent
备注：
点击查看摘要
Abstract:We present MyAG, a graph-based framework for designing and analyzing composable LLM agent systems. Our framework separates agent system construction into three graph abstractions: a component graph for agents, environments, and modules; a workflow graph for execution control; and a search graph for runtime execution. This separation allows users to flexibly reuse the same components with different strategies. We further support hierarchical composition through recursive system nodes and provide monitoring and visualization tools for inspecting agent execution. Experiments on representative agent applications show that our framework supports flexible agent system design and helps analyze performance-efficiency tradeoffs. Our framework is publicly available and fully open-source.
23. 【2607.13465】DevicesWorld: Benchmarking Cross-Device Agents in Heterogeneous Environments
链接：https://arxiv.org/abs/2607.13465
作者：Huatao Li,Xinwei Geng,Yuheng Wang,Yutong Li,Runde Yang,Hantao Chen,Shu Yao,Jingru Fan,Xuhui Ren,Yuanyuan Zhao,Fei Huang,Chen Qian
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：operating individual digital, individual digital environments, smart homes, rapidly improved, improved at operating
备注： [this https URL](https://github.com/AgenticOrgLab/DevicesWorld)
点击查看摘要
Abstract:LLM-based agents have rapidly improved at operating individual digital environments such as mobile applications, desktop systems, and smart homes. However, real-world user goals often span multiple devices: information may come from a phone, be processed on a desktop, and the result may need to appear on another device. Most existing benchmarks center on a single dominant execution environment, making it difficult to evaluate whether agents can acquire and integrate information across heterogeneous devices and complete end-to-end tasks with cross-device dependencies. We introduce DevicesWorld, a large-scale executable benchmark for cross-device collaborative operation. DevicesWorld contains 6,140 tasks and integrates three classes of device environments -- mobile, desktop, and IoT -- into a unified cross-device interaction and evaluation framework. Each task defines a natural-language user goal, participating devices and initial states, executable actions, rule-based verifiers, and a cleanup procedure. A multi-stage construction and quality-control pipeline keeps tasks close to realistic user needs while allowing final outcomes to be automatically verified from device states and generated files. We evaluate five frontier LLM-agent systems on a fixed evaluation set. All methods achieve low success rates, with the best reaching only 12.5%. Among failed runs, about 28.7% satisfy at least one scoring condition yet still fail the full task. Trajectories show that agents become stuck acquiring information or manipulating interfaces, confuse source and output devices, or terminate before all conditions are jointly satisfied. DevicesWorld turns cross-device collaborative operation into an executable, reproducible, and diagnostically useful evaluation problem for research on reliable cross-device agents.
24. 【2607.13457】Live Gurbani Tracking: A Benchmark and Reference System for Captioning Sikh Kirtan
链接：https://arxiv.org/abs/2607.13457
作者：Karanbir Singh
类目：Computation and Language (cs.CL)
关键词：Sri Guru Granth, Guru Granth Sahib, Sri Guru, Guru Granth, Granth Sahib
备注： 11 pages, 3 figures, 6 tables. Benchmark, scorer, and reference system released. Live deployment and on-device iOS app available; see paper for links
点击查看摘要
Abstract:We present a benchmark and reference system for live captioning of Sikh Kirtan - the continuous, sung recitation of verses from the Sri Guru Granth Sahib Ji (SGGS). Unlike open-vocabulary lyrics transcription, Kirtan captioning is a closed-vocabulary problem: every displayed line must be an exact, word-for-word line from the canonical scripture, because displaying misspelled Gurmukhi is considered religiously inappropriate. We formalize the task as predicting, at every time t, a pair (shabad_id, line_idx) or null, and organize the problem space into a 2x2 matrix along two orthogonal axes: live vs. offline (causal vs. full-audio access) and blind vs. oracle (shabad identity discovered vs. given). We release v1 of the benchmark - 4 hand-annotated Kirtan recordings x 3 cold-start offsets = 12 evaluation cases, ~57 minutes of scored audio - together with a scorer that computes frame accuracy at 1s resolution over a scored region, with a 1s collar and gap-tolerant scoring at segment boundaries. We describe a reference system (fine-tuned 120M IndicConformer - fuzzy matcher - state machine; INT8 ONNX; RTF ~0.05 on one Apple Silicon core) that achieves 57.9% overall frame accuracy across all 12 cases (10/12 correct shabad locks) on the hardest variant (live x blind). We compare against three trivial baselines (empty, shifted-5s, perfect) and discuss why standard ASR metrics (WER/CER) measure transcription accuracy rather than the display accuracy this task requires. The benchmark, reference system, and a live deployment are released under permissive licenses to facilitate further improvements.
25. 【2607.13433】When Rubrics Change: Cross-Rubric Generalization for Critical Thinking Essay Scoring
链接：https://arxiv.org/abs/2607.13433
作者：Nischal Ashok Kumar,Payu Wittawatolarn,Sana Kang,Marisa C. Peczuh,Blair Lehman,Ryan Baker,Caitlin Mills,Sherry Lachman,Ruochen Sun,Andrew Lan
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：typically held constant, Automated essay scoring, Automated essay, research has largely, held constant
备注： Published in AI for Education Day at SIGKDD 2026
点击查看摘要
Abstract:Automated essay scoring (AES) research has largely focused on cross-prompt generalization, where essays from unseen prompts are scored while the scoring criteria are typically held constant. In practice, however, educators may revise or even introduce new rubrics in their scoring task, to evaluate different aspects of essays. We study cross-rubric generalization: training on essays labeled under one set of rubrics and evaluating on previously unseen rubrics, which target different aspects of the essay. We use a Large Language Model (LLM) fine-tuning framework with two components: rubric-agnostic intermediate representations, called traits, and target-essay supervision under seen rubrics during training. On an AES dataset augmented with multiple rubric-defined labels of student critical thinking skills, we find that traits improve macro F1 by 5.0% over a baseline without traits in the hardest setting, where both target rubrics and target essays are unseen during training. We further find that increasing target-essay supervision improves performance, with our best fine-tuned open-source Llama-based model outperforming GPT-5-mini prompting by 2.1% macro F1 and trailing GPT-5 by 1.9%. These results show that trait-based intermediate structure and controlled supervision improve generalization to unseen rubrics.
26. 【2607.13431】Discrete Diffusion Models: A Unified Framework from Tokenization to Generation
链接：https://arxiv.org/abs/2607.13431
作者：Ye Yuan,Weien Li,Rui Song,Zeyu Li,Haochen Liu,Xiangyu Kong,Zixuan Dong,Linfeng Du,Zipeng Sun,Weixu Zhang,Jiaxin Huang,Changjiang Han,Yonghan Yang,Zichen Zhao,Xiuyuan Hu,Haolun Wu,Yankai Chen,Fengran Mo,Jikun Kang,Bowei He,Philip S. Yu,Xue Liu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：offering parallel generation, global refinement capabilities, iterative global refinement, discrete state space, Discrete denoising diffusion
备注：
点击查看摘要
Abstract:Discrete denoising diffusion models (DDMs) have recently emerged as a compelling alternative to autoregressive (AR) modeling for discrete data, offering parallel generation and iterative global refinement capabilities. Unlike continuous diffusion, where the state space is fixed, DDMs are fundamentally shaped by how the discrete state space is constructed: the tokenization scheme, the vocabulary topology, and domain-specific structural alphabets. This work introduces a unified conceptual framework that views discrete diffusion models through the construction of the underlying discrete state space. Within this framework, existing formulations, including transition-matrix, masking/absorbing-state, and score/ratio-based approaches, emerge as different instantiations of a common design space. The framework further exposes common design trade-offs across training objectives, inference algorithms, scaling behavior, systems optimization, and evaluation protocols, suggesting several promising directions for future research.
27. 【2607.13430】Exploring Post-Training Alignment of Small Language Models for Biomedical Data-to-Text Generation: A Case Study of Medication Leaflet
链接：https://arxiv.org/abs/2607.13430
作者：Xi Yang,Guodong Liu,Chuqin Li,Fan Wu,Ergin Soysal,Min Jiang,Xing He,Jiang Bian,Yi Guo,Shams Zaman,Thomas Fuchs,Todd Sanger,Yonghui Wu
类目：Computation and Language (cs.CL)
关键词：Translating complex biomedical, modern biomedical informatics, Translating complex, patient-friendly narratives, narratives is central
备注： 10 pages, 1 figures
点击查看摘要
Abstract:Translating complex biomedical data into patient-friendly narratives is central to modern biomedical informatics. This study presents a comparative analysis of training small language models (SLMs) in specialized biomedical datato-text generation tasks. We explore widely adopted post-training methods including supervised fine-tuning (SFT), direct preference optimization (DPO), odds ratio preference optimization (ORPO), and group relative policy optimization (GRPO) with Qwen-based SLMs on a medicine package leaflets dataset. To assess cross-dataset generalizability, we also curated drug label data from openFDA. We evaluate models using both standard lexical overlap metrics like ROUGE as well as semantic similarity measures. Across our experiments, the results show that (1) the aligned SLMs outperform proprietary models like GPT-5; (2) ORPO outperforms the SFTbaselines; (3) GRPO yields the most robust cross-dataset performance among the alignment methods tested as well as GPT-5.
28. 【2607.13425】Data-Efficient Adaptation of LLMs via Attention Head Reweighting
链接：https://arxiv.org/abs/2607.13425
作者：Tuomas Oikarinen,Zixiao Chen,Charlotte Siska,Tsui-Wei Weng,Chandan Singh,Jianfeng Gao
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：data is critical, critical in domains, domains like security, security where labeled, Attention Head Reweighting
备注： Published in COLM 2026
点击查看摘要
Abstract:Learning effectively from limited data is critical in domains like security where labeled examples are scarce. Large language models (LLMs) have demonstrated some capabilities for data-efficient learning, especially through parameter-efficient adaptation methods, but continue to struggle when faced with few samples for difficult tasks. To meet this challenge, we propose Attention Head Reweighting (AHR), a data-efficient method that adapts LLMs to new text-classification tasks by learning only a single scalar per attention head. This drastically reduces the number of parameters that need to be learned by making use of the functional specialization of individual attention heads. Experiments on diverse open-source text classification datasets show that AHR can outperform standard baselines like LoRA when learning from limited samples, despite having 200-1000x fewer trainable parameters, as our AHR only modifies ~0.0001% of the model's parameters. In addition, our learned weights are easy to interpret and can be analyzed to better understand the mechanisms and attention heads responsible for in-context learning abilities in LLMs.
29. 【2607.13399】Demystifying On-Policy Distillation: Roles, Pathologies, and Regulations
链接：https://arxiv.org/abs/2607.13399
作者：Rui Wang,Hongru Wang,Yi Chen,Boyang Xue,Tianqing Fang,Wenhao Yu,Kam-Fai Wong
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：remain poorly understood, training dynamics remain, dynamics remain poorly, LLM post-training, paradigm in LLM
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) has become a key paradigm in LLM post-training, yet its training dynamics remain poorly understood. We present a systematic study examining the role, pathologies, and regulations of OPD. We first clarify the role of OPD as an exploration catalyst: it steers the student toward correct reasoning paths via dense token-level guidance, without expanding capability ceiling. We confirm this by showing that prompt diversity matters more than per-problem sampling numbers, and critically, that the effectiveness of OPD hinges entirely on the quality of its guiding signal. This dependency exposes two pathologies that derail exploration. The Student-Teacher Mismatch occurs when a large teacher-student distributional gap causes the guiding signal to misalign with task correctness, steering exploration in counterproductive directions. Length Exploitation arises when the aggregated token-level objective creates length-dependent shortcuts, allowing the student to game the reward landscape through response truncation or redundant padding, exploring degenerate length modes rather than reasoning strategies. To tame these pathologies, we investigate lightweight signal regulations: advantage clipping and log-scale compression, ensuring exploration is guided by faithful signals. Experiments across seven benchmarks demonstrate that these regulations alleviate length exploitation and enable effective distillation, stably surpassing OPD variants and RLVR baselines, thereby confirming that well-regulated signal quality, rather than mere teacher scale, governs successful exploration in OPD.
30. 【2607.13396】Set-shifting Behavioral Test for Harnessed Agents
链接：https://arxiv.org/abs/2607.13396
作者：Ziwei Ye
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：reliable tool silently, ongoing session, agent tool choice, hidden reliability shifts, hidden reliability
备注：
点击查看摘要
Abstract:What happens to an LLM agent's tool choice when the reliable tool silently changes within an ongoing session? We borrow set-shifting from cognitive psychology to study how well agents adapt to hidden reliability shifts. Our benchmark mounts tool-skill libraries with redundancies, where many tools solve the same task but differ in hidden reliability. In our evaluation framework, a branched schedule shifts the reliable tool group at hidden boundaries and pairs every shift with a no-shift control. We find that agents, by default, settle on a small recurring routine within a few turns of each boundary, with call shares concentrating on a few discrete values after each reliability shift. We score the set-shifting accuracy for each agent trajectory: the joint probability of routing to the target tool group in every post-shift window. We test open-weight LLMs in an open-source agentic harness and find qualitatively distinct failure modes across the same set of routines. We also find that set framing, how the toolset presents the alternatives as competing or complementary, shifts the routing dynamics.
31. 【2607.13394】GFlowRL: Scaling Distribution-Matching RL to Large Language Models
链接：https://arxiv.org/abs/2607.13394
作者：Xiaodong Liu,Michael Xu,Jack W. Stokes,Paul Smolensky,Doug Burger,Jianfeng Gao
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Generative Flow Networks, encouraging diverse reasoning, diverse reasoning paths, reward-maximizing reinforcement learning, Generative Flow
备注： 31 pages, 8 figures, 17 tables
点击查看摘要
Abstract:Generative Flow Networks (GFlowNets) offer a promising alternative to reward-maximizing reinforcement learning (RL) for large reasoning models, encouraging diverse reasoning paths by matching reward distributions rather than collapsing to dominant modes. Recent work shows promise on math and code, but scaling GFlowNet-style RL to modern post-training pipelines remains difficult: as model size, rollout horizon, reward noise, and distributed-systems complexity grow together, a learned prompt-conditional partition function becomes a source of gradient instability and engineering overhead rather than a useful normalizer. Through systematic analysis, we find that the learned partition function, previously treated as essential, can be replaced by an in-batch Monte Carlo estimate computed from the rollout group already required for training. We propose GFlowRL, a streamlined GFlowNet-style RL algorithm that removes the auxiliary partition network entirely while preserving the reward-distribution-matching objective, completed by two stabilizers: importance-sampling correction for rollout/trainer drift and asymmetric flow-gap clipping for outlier residuals. GFlowRL exceeds all counterparts on math, code, and adversarial red-teaming benchmarks, reaching a Codeforces rating of 2048 at the 14B scale (within 25 Elo of o3-mini) and attaining the highest average ASR@1 on AdvBench and HarmBench, outperforming the previous SOTA multi-turn attacker in a regime where FlowRL, a prior GFlowNet-style method, diverges. The same recipe transfers to all evaluated MoE configurations up to 235B parameters, where FlowRL again fails to converge. To our knowledge, GFlowRL is the first GFlowNet-style RL algorithm to scale stably across both dense and sparse architectures. Code will be at: this https URL
32. 【2607.13389】Where Should RL Post-Training Compute Go? Model Size, Search, Learning, and Feedback
链接：https://arxiv.org/abs/2607.13389
作者：Patrick Wilhelm,Odej Kao
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：feedback-driven robot-learning pipelines, Reinforcement Learning, constrained post-training resources, adapt foundation models, robot-learning pipelines
备注：
点击查看摘要
Abstract:Reinforcement Learning (RL) post-training is increasingly used to adapt foundation models for reasoning, planning, and feedback-driven robot-learning pipelines, but constrained post-training resources are often summarized by a single total FLOP budget. We study the fixed-budget decision problem behind this practice: under the same post-training budget, should one use a larger policy, train a smaller policy longer, generate more rollout search, or spend compute on stronger reward feedback? We introduce a FLOP-accounting framework for GRPO post-training that decomposes compute into rollout/search, policy-update/learning, and reward- or feedback-model evaluation. Across LoRA-adapted Qwen2.5 policies, we find conditional allocation frontiers: the best observed allocation changes with model size, compute budget, reward system, and evaluation target. Same-FLOP model-size comparisons show that model choice and training allocation are coupled because larger policies consume more per-token compute and therefore buy fewer updates or rollouts under the same budget. Reward systems also change the accounting: rule-based rewards spend nearly all non-update compute on policy rollouts, while PRM-style feedback allocates a visible part of the budget to reward-model inference. We present RACE as a diagnostic pilot-grid protocol, not a guarantee of held-out improvement, for identifying allocation regimes before expensive validation runs; our results suggest that RL post-training papers should report total FLOPs together with how compute is divided among model size, search, learning, and feedback.
33. 【2607.13372】A POS Tier Is the Key to Automated Annotation for Low-Resource Language Documentation: Neural Interlinear Glossing for Irabu, a Southern Ryukyuan Language
链接：https://arxiv.org/abs/2607.13372
作者：Michinori Shimoji(Kyushu University)
类目：Computation and Language (cs.CL)
关键词：primary empirical basis, producing interlinearized text, POS, field linguistics, notoriously expensive
备注： 15 pages, 9 figures, 8 tables. Code, corpus, and complete per-sentence test outputs: [this https URL](https://github.com/MichinoriShimoji/ML_autogloss)
点击查看摘要
Abstract:Discourse data are the primary empirical basis of grammar writing in field linguistics, but producing interlinearized text is notoriously expensive - on the order of one hour of work per minute of recording. For endangered languages, where the time remaining to verify analyses with native speakers is itself limited, automating parts of the interlinearization workflow has direct documentary value. We implement a full neural annotation pipeline (morpheme segmentation, POS tagging, glossing) for Irabu Ryukyuan using deliberately small, transparent BiLSTM-CRF models, and evaluate it under a realistic hard constraint: approximately one hour of fully annotated discourse as the entire supervised resource. Two factors of the annotation itself are manipulated: its richness (with or without a POS tier) and its quantity (training budgets from 6 to 47 minutes). Gold POS improves grammatical glossing by +4.4 (SD 0.7) points (significant in all 5 seeds), and the gain grows as data shrink (+11.6 points at a quarter of the data); a POS tier more than halves the amount of glossed data needed to reach a given accuracy. In a fully automatic pipeline this gain is not yet realized: the tagger still errs on 12% of morphemes, and an incorrect POS misleads the glossing model more than no POS at all. The value is latent rather than lost: degrading gold POS with controlled noise shows the gain returning as tagger accuracy rises, with break-even near our tagger's current 88% and +1.6 to +3.2 points recovered at 92-96%. We conclude with a concrete recommendation for documentation practice: annotate quadrilinearly - text, POS, gloss, translation.
34. 【2607.13347】Evaluation Ability Does Not Imply Optimization Utility: LLM-as-a-Judge Signals in Closed-Loop Table Recognition
链接：https://arxiv.org/abs/2607.13347
作者：Donghwan Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：remains insufficiently validated, insufficiently validated, remains insufficiently, TEDS evaluation provides, judge
备注： 31 pages, 9 figures, appendix included
点击查看摘要
Abstract:LLM-as-a-judge is widely used to provide feedback and selection signals in closedloop regeneration, but this use remains insufficiently validated. We study it in table recognition, where deterministic TEDS evaluation provides a controlled testbed, using FinTabNet and OmniDocBench. Three findings emerge. First, judge signals were weak on both datasets: scores frequently tied, rankings were not reproducible, and the only selection policy that beat random on both datasets depended on an earliest-iteration tie rule, so its advantage cannot be attributed to the judge scores alone. Iteration produced better candidates, but the judge failed to recover them. Second, severe losses occurred even without specific judge feedback. A structurepreserving instruction significantly reduced the severe-loss rate on FinTabNet and was directionally consistent on OmniDocBench. The contrasts support target-preservation failure under unconstrained regeneration as a proximate mechanism of the observed severe losses. Third, the structure-preservation constraint reduced the severe-loss tail but produced no improvement. In an exploratory 2x2 analysis, the same protection was not stably observed when judge feedback was retained. These results do not dispute the value of LLMs as evaluators. Instead, they show that evaluation ability does not imply optimization utility. Iterative refinement requires, at minimum, a verification signal that deterministically detects structural change, rather than judge scores alone.
35. 【2607.13346】he Refusal Residue: When Probes Catch Alignment Faking and When They Don't
链接：https://arxiv.org/abs/2607.13346
作者：Aman Mehta
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Alignment faking, monitoring while preserving, preserving behavior, Alignment, AUROC
备注： Accepted to the Mechanistic Interpretability Workshop at ICML 2026. 12 pages, 4 figures
点击查看摘要
Abstract:Alignment faking is dangerous because a model can appear compliant under monitoring while preserving behavior it would reveal when unmonitored. When no scratchpad is visible, behavior alone cannot distinguish strategic from genuine compliance. We ask whether hidden states reveal what outputs hide. We run a 13-model sweep for naturally-emerging faking, then probe and steer hidden states on the two models that fake. Natural faking appears only in Qwen3-32B (+18.2pp) and Llama-3.1-8B (+24.4pp at n=10, p10^-15), while explicit scratchpad self-reports are rare (a Claude Opus 4 judge flags faking reasoning in 1.4% of Qwen and 0.0% of Llama compliant scratchpads). Both fakers show an asymmetric refusal residue: monitored compliance shifts toward refusal (d=0.32 Qwen, d=0.33 Llama, both p0.0001), while refusal representations do not move (p=1.00). Per-sample detection is model-conditional. Under leakage-free leave-one-query-out probing, detection survives on Llama (AUROC 0.87) but collapses to chance on Qwen (0.43), and cross-model transfer is null. Steering over 2,000 runs barely changes compliance (|h|0.08), so the detected direction can flag faking but does not by itself control it. Standard residualized probing leaks across folds and reaches AUROC 0.63 on a control where no faking can occur; naive linear probes reach a meaningless AUROC 1.0; and conventional MLPs overstate detectability by 0.2-0.3 AUROC. For future alignment-faking detection work, we release a five-control measurement framework: multi-token extraction, refuse-vs-refuse confound checks, per-fold residualization, leave-one-query-out evaluation, and orthogonality-constrained probing.
Comments:
Accepted to the Mechanistic Interpretability Workshop at ICML 2026. 12 pages, 4 figures
Subjects:
Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2607.13346 [cs.CR]
(or
arXiv:2607.13346v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2607.13346
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Aman Mehta [view email] [v1]
Wed, 15 Jul 2026 00:11:42 UTC (485 KB)
36. 【2607.13315】Meta-Learning Preferences for Multilingual LLM Alignment
链接：https://arxiv.org/abs/2607.13315
作者：Jiaying Lin,Seongho Son,Nam Phuong Tran,Long Tran-thanh,Ilija Bogunovic,Debmalya Mandal
类目：Computation and Language (cs.CL)
关键词：Unequal availability, aligning large language, human preference data, Direct Preference Optimization, poses a significant
备注：
点击查看摘要
Abstract:Unequal availability of human preference data across languages poses a significant challenge for aligning large language models in multilingual settings. To address the lack of sufficient data in low-resource language alignment, we propose a meta-learning framework for Reinforcement Learning from Human Feedback and Direct Preference Optimization. By leveraging preference data from other languages, our framework learns a transferable initialization that enables effective adaptation to a target language with minimal data. We provide theoretical guarantees for both the meta-reward modeling and meta-policy optimization settings, and empirically demonstrate the effectiveness of our approach on multilingual benchmarks. In an extremely low-resource setting with only 100 target-language preference samples, our approach achieves up to $28\%$ win-rate improvements over baseline methods, and consistently outperforms baselines across multiple target languages and model scales. Our approaches retain these advantages across different combinations of meta-training languages and varying linguistic distances from the target languages.
37. 【2607.13311】Finding the Right Tables and Columns: A Benchmark and Corpus-Adaptive Embeddings for SQL Schema Retrieval
链接：https://arxiv.org/abs/2607.13311
作者：Qingcheng Zeng,Puxuan Yu,Aman Mehta,Fuheng Zhao,Rajhans Samdani
类目：Computation and Language (cs.CL)
关键词：SQL statements, SQL setting, collection of SQL, largely been studied, large collection
备注：
点击查看摘要
Abstract:Retrieval in the SQL setting has largely been studied as the task of finding, within a large collection of SQL statements, the statement that answers a natural-language question. At scale, however, a more fundamental retrieval problem precedes generation: schema retrieval, identifying the tables and columns a question requires in a database that may contain thousands of them, far more than fit in a model's context. We argue that this step warrants first-class evaluation. To this end, we recast five text-to-SQL datasets (Spider, BIRD, BEAVER, and two LiveSQLBench variants) as retrieval tasks at both table and column granularity, covering realistic and enterprise-scale schemas under two document representations, and we show that off-the-shelf text and code embedders transfer poorly to this setting. We then propose corpus-adaptive fine-tuning: natural-language queries are synthesized directly from the target schema corpus, granularity-aware hard negatives are mined, and a 305M-parameter embedder is fine-tuned contrastively. This procedure raises average recall@10 from 60.4 to 75.6 (nDCG@10 from 51.9 to 68.0), making the 305M model the strongest retriever under one billion parameters and competitive with state-of-the-art embedders of 4-8B parameters, more than an order of magnitude larger. The same recipe improves an 8B state-of-the-art embedder from 77.8 to 78.4 recall@10, matching the best result on the benchmark and indicating that the adaptation is backbone-agnostic. Leave-one-corpus-out experiments and a leakage audit show that these gains reflect a transferable schema-retrieval ability rather than memorization of the evaluation data. Our results establish schema linking as a standalone retrieval task and lightweight, label-free corpus adaptation as a practical route to deploying it at enterprise scale.
38. 【2607.13304】Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answers
链接：https://arxiv.org/abs/2607.13304
作者：Dmitrij Żatuchin
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Teams measuring, large language models, reproducibility problem, measuring whether large, face a reproducibility
备注： 18 pages, 6 tables, 3 code listings
点击查看摘要
Abstract:Teams measuring whether large language models (LLMs) recommend a brand face a reproducibility problem: ask the same question twice and the answer moves. Practice resamples each prompt a few times (commonly five) and averages, treating within-prompt resampling as the source of the noise. But a measured brand score moves for at least four separable reasons: within-prompt resampling, prompt paraphrase, model identity, and query language. We specify a crossed random-effects (generalizability-theory) decomposition that partitions the total variance of a response-level brand outcome into these four sources, and embed the components in a decision-study allocation that returns how many repeats, paraphrases, models, and languages to buy for a target reliability. We apply it to a fully crossed corpus of 12,933 LLM responses on 20 Central and Eastern European brands, 8 languages, and 3 models (GPT-5.2 and Gemini 3 Flash in parametric mode, Perplexity in grounded retrieval), with a stability subset of 1,435 cells resampled about five times. The outcome is per-response multilingual sentiment polarity. Query language is the largest systematic facet (26.5% of the variance of one response) against 1.5% for brand identity (ICC 0.0146), so a single AI answer carries almost no brand-discriminating signal. Once a cell term isolates pure resampling, resampling is 34.8% of variance and the brand-in-context interaction 29.6%; brand-by-language is 8.6% (a bilingual penalty) while brand-by-model and brand-by-prompt are near zero. Per unit of query budget, adding languages and models reduces relative-error variance far more than adding repeats: a repeat past the fifth reduces it by only 0.0003. Brand-ranking reliability stays low, near 0.01 for a single answer and about 0.36 at the full crossed design, so reliability is bought by spreading across languages and models, not by repeating one prompt.
39. 【2607.13292】heory-Level Autoformalization: From Isolated Statements to Unified Formal Knowledge Bases
链接：https://arxiv.org/abs/2607.13292
作者：Marcus J. Min,Mike He,Zhaoyu Li,Zixuan Yi,Sharad Malik,Aarti Gupta,Xujie Si,Osbert Bastani
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Programming Languages (cs.PL)
关键词：translates informal natural, informal natural language, Autoformalization translates informal, machine-verifiable languages, translates informal
备注： ICML 2026 Spotlight
点击查看摘要
Abstract:Autoformalization translates informal natural language into formal, machine-verifiable languages. While most work focuses on individual statements, real formalization efforts are inherently theory-level: they require an entire web of axioms, definitions, and lemmas before target theorems can even be stated. In this position paper, we argue for theory-level autoformalization: formalizing complete theories, including all their inter-dependencies, as structured libraries. We examine the significance of this shift, address alternative views, identify open challenges, and propose three promising paths forward. Our survey of autoformalization is available at this https URL.
40. 【2607.13260】Discourse-Aware Policy Analysis with Argumentation: A Hybrid LLM-Symbolic Framework for Disaster Governance
链接：https://arxiv.org/abs/2607.13260
作者：Stylianos Loukas Vasileiou,Olga Derendiaeva
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：shape governance outcomes, documents shape governance, Policy documents shape, governance outcomes, documents shape
备注：
点击查看摘要
Abstract:Policy documents shape governance outcomes, but their reasoning is often implicit. Participatory commitments and managerial control routinely coexist in the same text, and the tensions between them are rarely stated directly. Existing computational approaches to policy discourse cannot express the frame-mediated relations that drive these tensions, where one argument narrows or instrumentalizes another rather than rejecting it. End-to-end summarization by large language models produces fluent text but offers little structure that domain experts can inspect or contest. We present Apaf, a hybrid LLM--symbolic pipeline that operationalizes critical discourse analysis as a quantitative bipolar argumentation framework over policy text. Arguments are first classified into deliberative or managerial frames. Four frame-mediated relation subtypes (agency reduction, agenda shift, instrumental support, and normative support) are then produced by deterministic rules over LLM-extracted features. We release a novel dataset of 100 sub-documents of disaster-risk-reduction policy from the USA, UK, Canada, and Australia, and show that the resulting argument graphs are accurate, interpretable, and stable across jurisdictions.
41. 【2607.13248】GSM-Plus-BN: A Perturbation-Based Benchmark for Bangla Mathematical Reasoning in Large Language Models
链接：https://arxiv.org/abs/2607.13248
作者：Bidyarthi Paul,Nahida Jannat Mayouree,Md. Asif Karim,Sagar Chandra Nath,Swastika Kundu
类目：Computation and Language (cs.CL)
关键词：large language models, perturbated Bengali mathematical, Bengali mathematical dataset, Bengali mathematical, Standard Prompting
备注：
点击查看摘要
Abstract:The evaluation of mathematical reasoning in large language models (LLMs) has predominantly focused on high-resource languages like English. This has created a significant barrier to the equitable development and deployment of AI in linguistically diverse regions such as Bangladesh, where over 230 million people speak Bengali. Despite this global significance, there has been minimal prior work on mathematical reasoning in Bengali and no existing research that systematically benchmarks a perturbated Bengali mathematical dataset, leaving a critical void in assessing model robustness and true comprehension beyond pattern recognition. This study addresses this gap by introducing GSM-Plus-BN, a novel perturbated Bengali mathematical dataset derived from the English GSM-Plus benchmark and verified by human translators. We evaluate six open-source LLMs Qwen3-32B, Llama-3.1-8B-Instant, Llama-3.3-70B-Versatile, Llama-4-Scout-17B-16E-Instruct, GPT-OSS-120B, and GPT-OSS-20B using a benchmark of 9,000 evaluation samples comprising 1,000 seed questions and 8,000 perturbed variants under both Standard Prompting and Chain-of-Thought (CoT) Prompting. Experimental results show that GPT-OSS-20B achieves the highest seed question accuracy of 96.08% under Standard Prompting, while larger models such as Llama-3.3-70B and GPT-OSS-120B demonstrate superior robustness across perturbation types. Furthermore, CoT prompting substantially improves reasoning for most models compared to Standard Prompting, yet a notable performance gap persists across all models relative to their English benchmarks, underscoring the inherent difficulty of perturbed Bengali text. This research makes a foundational contribution by providing GSM-PLUS-BN as a new resource and baseline for future Bengali mathematical reasoning research.
42. 【2607.13205】Adaptive Filtering of the KV Cache: Diagnosing and Correcting Structural-Role Bias in LLM Inference
链接：https://arxiv.org/abs/2607.13205
作者：Soumil Mandal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：accumulated attention mass, Attention-based KV cache, cache eviction, compresses the memory-constrained, attention mass
备注： 6 pages, 2 figures, 5 tables
点击查看摘要
Abstract:Attention-based KV cache eviction (H2O and its descendants) compresses the memory-constrained state of a long-context model by ranking tokens on accumulated attention mass, treated here as signal energy, and keeping the heaviest. On schema-dense input streams such as nested JSON, this score acts as a non-stationary filter that disproportionately retains noise: a non-content sink role (delimiters or whitespace) carries an order of magnitude more energy than any content role, and structural KEY tokens are over-retained at roughly 1.8x the rate of the answer-carrying VALUE tokens, collapsing exact-match accuracy from 88% to 0% at a 5% budget as the signal-to-noise ratio of the retained state degrades. A counterfactual experiment establishes that suppressing KEY tokens is the best deployable filter. Our retraining-free, role-conditional allocation over SnapKV's windowed score, governed by a single tuned hyperparameter, closes 63-98% of the H2O gap at sub-20% budgets and, at higher budgets, modestly matches or exceeds full-cache accuracy -- a small, seed-sensitive denoising effect (borderline significant at B=0.50; not distinguishable from zero at B=0.30 over four seeds). A 15 MB linear role probe supplies these labels at negligible inference cost, though matching parser-level downstream accuracy remains open.
43. 【2607.13189】RAGthoven at SemEval-2026 Task 1: A Multi-Stage Pipeline Walks Into a Benchmark and Barely Clears the Bar
链接：https://arxiv.org/abs/2607.13189
作者：Marek Šuppa,Viktória Ondrejová,Lucia Ganajová,Gregor Karetka,Daniel Skala
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：multilingual constrained humor, Benign Violation Theory, Script-based Semantic Theory, constrained humor generation, computational humor theory
备注： SemEval-2026 Task 1
点击查看摘要
Abstract:We present RAGthoven, our system for SemEval-2026 Task 1 (MWAHAHA), Subtask A (multilingual constrained humor generation in English, Spanish, and Chinese). RAGthoven decomposes creative text generation into a multi-stage large language model (LLM) pipeline (Planner, Best-of-N Writer, Reflector for self-critique, LLM-as-a-judge Judge) grounded in computational humor theory (Benign Violation Theory, Script-based Semantic Theory of Humor) and refined across ten experiments. In our final configuration, we augment the Planner with retrieval-augmented generation (RAG) from a curated joke corpus, seeding generation with diverse joke mechanisms. We also evaluate two agentic variants -- ReAct-style sequential tool-calling (Exp09) and autonomous multi-branch orchestration (Exp10) -- that expose the same four stages with a deterministic ConstraintAudit checker. Across four frontier models on a held-out 12-instance English sample, neither agentic variant produced outputs we judged superior to the non-agentic pipeline despite substantially higher tool-call budgets. RAGthoven shares Rank 1 with the Gemini 2.5 Flash baseline in all three languages, with overlapping organizer-reported confidence intervals. In Spanish, it leads the baseline by 42 raw Elo points (1182 vs. 1140), while in English (1045 vs. 1081) and Chinese (1045 vs. 1053) the baseline holds the higher raw rating within the same statistical tie. Together, these results suggest language-dependent diminishing returns from elaborate multi-stage prompt engineering and agentic scaffolding once a strong frontier model is in the loop.
Comments:
SemEval-2026 Task 1
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2607.13189 [cs.CL]
(or
arXiv:2607.13189v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.13189
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Marek Šuppa [view email] [v1]
Tue, 14 Jul 2026 18:39:33 UTC (372 KB)
44. 【2607.13164】xt2Sign: A Single-GPU Diffusion Baseline for Text-to-Sign Language Video Generation
链接：https://arxiv.org/abs/2607.13164
作者：Ruize Xia
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：primary communication channel, video diffusion models, video generation remains, millions of Deaf, generation remains costly
备注：
点击查看摘要
Abstract:Sign language is a primary communication channel for millions of Deaf and hard-of-hearing people, yet text-to-signer video generation remains costly because video diffusion models are expensive to train and evaluate. This paper presents Text2Sign, a text-conditioned diffusion model for short sign-language clips that runs on a single NVIDIA L4 GPU. It combines a frozen vision-language text encoder with a 3D encoder-decoder and factorized spatiotemporal attention to reduce the cost of full-video attention while preserving motion coherence. We compare convolution-only and transformer-style backbones, frozen pretrained and task-specific text encoders, and factorized versus full attention. On a signer-disjoint How2Sign split, the best short-run ablation reaches a validation loss of 0.0648, while a longer-run checkpoint reaches 0.00999. On a compact evaluation slice, the latter achieves an SSIM of $0.2403 \pm 0.0238$, a PSNR of $15.11 \pm 0.42$ dB, and temporal consistency of $1.0000 \pm 0.0000$ using 8-step DDIM sampling with a guidance scale of 5.0. It generates a 32-frame, $64 \times 64$ clip in 12.60 seconds, or 2.54 frames per second, with peak inference memory of 3.12 GB. A held-out denoising audit shows only weak prompt sensitivity: removing text increases late-timestep loss from 0.9875 to 0.9891, while shuffled prompts perform similarly to correct prompts. Frozen text conditioning therefore improves short-budget validation loss, but prompt-specific separation remains limited. The system is restricted to low-resolution, short clips and lacks expert linguistic evaluation, so it should be viewed as a single-GPU research baseline rather than a complete sign-language production system. Code is available at this https URL.
Subjects:
Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2607.13164 [cs.CL]
(or
arXiv:2607.13164v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.13164
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
IEEE Access, vol. 14, pp. 64003-64017, 2026
Related DOI:
https://doi.org/10.1109/ACCESS.2026.3686260
Focus to learn more
DOI(s) linking to related resources</p>
45. 【2607.13162】What Models Express, Suppress, and Resist: Auditing Open-Weight LLMs with Persona Vectors
链接：https://arxiv.org/abs/2607.13162
作者：Winston Zeng,Ali Emami,Jinho Choi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：revealed by prompting, Persona vectors, language model, traits, largely set
备注：
点击查看摘要
Abstract:What a language model will and will not do is largely set during post-training, but which behaviors it expresses, hides, or resists is not revealed by prompting alone. Persona vectors, behavioral directions in activation space, can probe this organization, but prior work covers only a handful of traits. We present the first systematic application of persona vectors at this scale, compiling a 53-trait inventory across four behaviorally distinct domains and labeling every trait in two open-weight models as natural (expressed at baseline), steerable latent but amplifiable, or intractable (resistant to standard extraction). Both models default to helpful, task-oriented behavior: all nine agentic traits are natural, and their default clinician behavior matches a board-certified psychologist's independent desirability judgments on 16 of 17 traits. Steering produces its largest gains on traits these defaults exclude: hyperbole, hallucination, and sycophancy. The same asymmetry holds across all 171 generic-trait pairs: two steerable traits can collapse the composition, but pairs involving a default never do. Where standard extraction fails on a trait like "evil," a vector transferred from a fine-tuned variant still recovers it, with the residual refusals appearing inside the model's chain-of-thought. Persona vectors are most informative not as a set of controls but as a probe of behavioral organization.
46. 【2607.13158】Do LLMs Need Architectural Changes for Simultaneous Speech Translation? A Prefix-to-Prefix Data Driven Approach
链接：https://arxiv.org/abs/2607.13158
作者：Junkun Chen,Jian Xue,Ming Tang,Abdel Heba,Hoda Gholami,Ruchao Fan,Jinyu Li
类目：Computation and Language (cs.CL)
关键词：requires incremental translation, Simultaneous speech translation, decoder-only LLM systems, LLM systems due, strict latency constraints
备注：
点击查看摘要
Abstract:Simultaneous speech translation (SimulST) requires incremental translation under strict latency constraints, yet remains challenging for decoder-only LLM systems due to limited context and cross-lingual reordering. Recent approaches often introduce architectural changes or explicit read/write policies to control output timing, which can be brittle in conversational speech where segmentation boundaries are ambiguous. We present a simple data-driven alternative: fixed-length chunks for cumulative streaming decoding with a rewind-based committed prefix, and teacher-labeled prefix-to-prefix (P2P) targets with bounded waiting for fine-tuning, yielding CSSEL-P2P, where CSSEL is our proposed chunked streaming speech encoder LLM. In our in-house conversational speech evaluation, CSSEL-P2P improves streaming quality by +1.54 COMETKiwi over the CSSEL streaming baseline at comparable latency (+0.15s Average Lagging), suggesting effective SimulST without architectural changes via P2P supervision.
47. 【2607.13124】ShortOPD: Recovering Pruned LLMs with Short-to-Long On-Policy Distillation
链接：https://arxiv.org/abs/2607.13124
作者：Qingyu Zhang,Qianhao Yuan,Hongyu Lin,Yaojie Lu,Xianpei Han,Le Sun,Xiang Li,Ming Xu,Jiarui Li,Xiuyin Zhao
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：multiple-choice recognition tasks, compress LLMs, recognition tasks, deployment actually requires, checkpoints can collapse
备注：
点击查看摘要
Abstract:Structured pruning is a hardware-friendly way to compress LLMs, but it is mostly validated on multiple-choice recognition tasks, while the same compressed checkpoints can collapse on the free-form generation that deployment actually requires. Two observations trace this gap. First, greedy \textsc{pass}@$1$ nearly vanishes after compression, yet \textsc{pass}@$k$ recovers substantially under repeated sampling: useful generations are demoted, not erased. Second, the recoverable regime fails mainly through suffix repetition. Recovery should therefore train on the compressed model's own on-policy states with dense token-level supervision, which On-Policy Distillation (OPD) provides by reusing the pre-compression model as a frozen teacher. However, long on-policy rollouts spend early recovery budget on low-information repetitive suffixes, delaying loss descent. To mitigate this waste, we propose \textbf{\shortopd}, a short-to-long OPD schedule that detects teacher-confirmed repetitive suffixes, treats the surviving prefix as each rollout's effective length, and allocates future rollout budgets to the effective lengths the policy can currently use. Across math, code, and open-ended generation, \shortopd\ raises the compressed model's score to about $9\times$ its unrecovered value and $1.6$--$4.4\times$ standard recovery recipes (SFT w/o KD, KD, and SeqKD), and it matches a fixed $8192$-token rollout horizon within two points using a quarter of the training time ($8.5$ vs.\ $35.9$ hours) and $71\%$ fewer rollout tokens. We hope this recipe helps move structured pruning beyond marginal gains on perplexity and multiple-choice benchmarks, a step closer to deployment-ready generation quality.
48. 【2607.13104】Self-Improvements in Modern Agentic Systems: A Survey
链接：https://arxiv.org/abs/2607.13104
作者：Zhe Ren,Yimeng Chen,Dandan Guo,Guowei Rong,Tonghui Li,R. B. Xiong,Qingfeng Lan,Wenyi Wang,Li Nanbo,Yibo Yang,Mingchen Zhuge,Jürgen Schmidhuber
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Self-improving autonomous agents, moving from research, research prototypes, prototypes to deployed, Self-improving autonomous
备注： 97 pages, 12 figures. Project page: [this https URL](https://selfimproving-agent.github.io/) Repository: [this https URL](https://github.com/selfimproving-agent/awesome-Self-Improving-Agents)
点击查看摘要
Abstract:Self-improving autonomous agents are moving from research prototypes to deployed systems. The primary goal is controllable evolution, or adaptation, from experience with minimal or even no human input. This survey frames modern self-improving agents as adaptive systems that convert experience into accumulated capability gains. We offer a system-level framework that represents a modern agent as a configuration coupling a foundation model with an operational scaffold of prompts, memory, tools, and control logic. Within this framework, self-improvement is formalized as a self-induced update operator that obtains and commits updates to model parameters or scaffold components. We organize prior work by update target and by the signals that drive change, then review applications and discuss evaluation, before closing with open problems and future directions. For convenience, we track technical updates on this https URL.
49. 【2607.13081】SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification
链接：https://arxiv.org/abs/2607.13081
作者：SingGuard Team
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：sensitive information extraction, malicious code requests, dangerous tool misuse, present nsfaguard, prompt injection
备注：
点击查看摘要
Abstract:We present nsfaguard, a guardrail framework for securing agentic AI systems against operational threats, such as prompt injection, sensitive information extraction, malicious code requests, dangerous tool misuse, and resource exhaustion. We first introduce the NSFA taxonomy, which organizes 185 risk variants into a CIA-triad-grounded hierarchy and is cross-validated against three well-established OWASP guidelines. Based on this taxonomy, we construct a benchmark suite spanning 133 languages, comprising over 93K purpose-built samples targeting both user queries and agent responses, along with 3,435 cross-source samples adapted from five public agent-security datasets. To detect these operational threats in practice, we develop a dual-mode approach combining SFT-based generative reasoning for interpretable offline auditing with discriminative classification heads on the frozen backbone, enabling real-time detection at approximately 50,ms. We release four models with 0.8B, 2B, 4B, and 9B parameters, all achieving $\geq$94% F1 on purpose-built benchmarks and surpassing the strongest competing guardrails by 6 to 12 absolute points. On cross-source evaluation, the 9B model attains 91.29% F1 with a more balanced precision--recall trade-off. Moreover, ablation experiments show that classification heads can equip a guardrail with risk detection capabilities beyond its original scope and achieve state-of-the-art performance. These results demonstrate the extensibility of the approach and its generality as a plug-in enhancement.
50. 【2607.13069】Interventional Grounding Audits: Black-Box Premise-Dependency Tests for LLM Chain-of-Thought via Predicate Substitution
链接：https://arxiv.org/abs/2607.13069
作者：Hironao Nakamura
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Logic in Computer Science (cs.LO)
关键词：Large language models, language models produce, Large language, logically sound, genuinely depend
备注： Accepted at the ICLR 2026 Workshop on Logical Reasoning of Large Language Models ( [this https URL](https://iclr.cc/virtual/2026/10017466) )
点击查看摘要
Abstract:Large language models produce chain-of-thought (CoT) reasoning that appears logically sound yet may not genuinely depend on its stated premises. We introduce interventional grounding audits, a black-box, step-level test of premise dependency: we intervene on a single premise by substituting its target predicate with a fresh symbol, re-run the model, and check whether each reasoning step's normalized conclusion (canonical predicate form) changes. We evaluate on ProntoQA, a synthetic multi-hop deductive reasoning benchmark with gold proof trees, where step-level premise dependencies are known. Applied to 50 ProntoQA problems with GPT-4o, our method achieves F1 = 0.806 on detecting proof-tree dependencies (F1 = 0.885 on predicate-determining dependencies; Recall = 100%), significantly outperforming a self-consistency baseline (F1 = 0.343; 95% bootstrap CIs non-overlapping). We further identify that 66% of correctly-solved problems contain at least one aligned step insensitive to a direct proof-tree dependency under consistent substitution -- all involving entity-introduction premises, a documented blind spot of the consistent-substitution evaluator -- a "right answer, wrong reasoning" signal invisible to passive methods. All audit certificates, raw outputs, and reproduction scripts are available in a public GitHub repository, and we discuss scope limits beyond formal, parsable benchmarks.
51. 【2607.13044】he Perplexity Trap: When Patent Law Makes Human Writing Look Like AI
链接：https://arxiv.org/abs/2607.13044
作者：Anubhab Banerjee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Guidelines hold applicants, EPO Guidelines hold, European Patent Office, reported record filings, hold applicants strictly
备注：
点击查看摘要
Abstract:The European Patent Office (EPO) reported record filings in 2025, and the 2026 EPO Guidelines hold applicants strictly responsible for LLM-assisted content under Article 83 and Rule 42, creating pressure to triage suspected AI-generated patent text. Two constraints make this hard. First, realistic prosecution settings often have only consumer GPUs with about 8 GB VRAM, not datacenter-class scoring stacks. Second, Article 84 of the European Patent Convention requires claims to be clear and concise, pushing human drafting onto the same low-perplexity, low-burstiness manifold that LLMs occupy. We benchmark three open-source zero-shot detectors on 500 granted EPO H04 telecom patents versus 500 LLM-generated counterparts using five prompting strategies, all under the consumer hardware envelope. At claim level, all detectors exceed 60 percent false-positive rate: Binoculars 78.3 percent, Fast-DetectGPT 61.3 percent, DetectGPT 80.5 percent. The failure persists under Qwen2.5-3B-Instruct regeneration, LoRA-adapted Pythia-2.8B scoring heads, cross-IPC replication on A61K, C07D, and F03D (mean FPR 84.6 percent), and H100 re-evaluation with published Falcon-7B and GPT-J-6B heads, arguing the issue is structural rather than substitute-model capacity. A seven-feature linguistic-complexity logistic regression reaches 74.0 percent accuracy at 28.1 percent FPR, a 13 percentage-point gain over a perplexity-only baseline at a comparable operating point, without using likelihood at inference and within the same hardware budget.
52. 【2607.13036】Ask Before You Diagnose: Safe-Psych, a Sequential Evaluation Benchmark for LLMs in Psychiatry
链接：https://arxiv.org/abs/2607.13036
作者：Oriana Presacan,Andreea Grama,Larisa Irimină,Alireza Nik,Jaya Ojha,Vajira Thambawita,Ciprian I. Băcilă,Bogdan Ionescu,Michael A. Riegler
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, Large, decision support, models
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for decision support in healthcare, but clinical evidence is often incomplete or evolving. When the available information is insufficient to support a reliable answer, models should request clarification or abstain rather than provide unsupported responses. Existing medical benchmarks, however, typically assume that complete information is available upfront. We introduce Safe-Psych, a sequential benchmark for evaluating how LLMs handle evolving diagnostic uncertainty in clinical psychiatry. Safe-Psych contains over 1,000 real-world psychiatric clinical notes segmented to simulate incremental evidence disclosure, with psychiatrist-derived action labels at each stage: DIAGNOSE, CLARIFY, or ABSTAIN. We evaluate multiple state-of-the-art LLMs in full-information and sequential settings. Our findings show that capability does not ensure calibration: even strong models struggle under incomplete clinical information, with under-abstention exceeding 60% for most models and safety-aware prompting reducing premature commitment only by shifting errors toward excessive abstention. In sequential evaluation, models frequently diagnose before sufficient evidence is available and rarely seek clarification unless explicitly prompted; these premature diagnoses are less accurate than on-time diagnoses. Overall, Safe-Psych reveals a limitation across the evaluated models: recognizing when clinical evidence is incomplete and additional information is needed. We release Safe-Psych to support research on improving LLM safety in healthcare.
53. 【2607.13035】FixItFlow: Automated Troubleshooting Guide Generation from Cloud Incidents
链接：https://arxiv.org/abs/2607.13035
作者：Srihari Unnikrishnan,Jaskaran Singh Walia,Drishti Goel,Supriyo Ghosh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Software Engineering (cs.SE)
关键词：Cloud services experience, services experience frequent, require rapid diagnosis, Cloud services, experience frequent incidents
备注：
点击查看摘要
Abstract:Cloud services experience frequent incidents that require rapid diagnosis and resolution. Troubleshooting guides help engineers respond consistently, but creating them manually is labor-intensive, resulting in incomplete coverage and outdated documentation. We present FixItFlow, an automated system that generates troubleshooting guides from historical incident data using large language models. The system extracts diagnostic patterns from engineer actions, synthesizes structured guides with verified commands, and enforces strict validation to prevent fabricated content. In our evaluation with 26 engineers, generated guides achieved 61.5\% positive ratings for clarity and demonstrated a 2.3x reduction in mitigation time for incidents with associated guides. These results indicate that automated guide generation can improve incident response while reducing documentation burden on engineering teams.
54. 【2607.13408】Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models
链接：https://arxiv.org/abs/2607.13408
作者：Chun-Yi Kuan,Siwon Kim,Byeonggeun Kim,Suyoun Kim,Bo-Ru Lu,Qinming Tang,Ankur Gandhe,Hung-yi Lee,Chieh-Chi Kao,Chao Wang
类目：Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
关键词：involving multiple sound, models generate high-quality, generate high-quality audio, multiple sound events, follow instructions involving
备注： Accepted to the Long Paper Track at Interspeech 2026
点击查看摘要
Abstract:Recent text-to-audio models generate high-quality audio, but often fail to follow instructions involving multiple sound events and temporal order. This gap arises because existing evaluation and training signals mainly emphasize global similarity or perceptual quality, with limited supervision on instruction-level correctness. We propose an instruction-level framework that uses audio-aware large language models (ALLMs) as fine-grained judges to verify target event presence and temporal relations in generated audio. After validating ALLM judgments on benchmarks and through human verification, we use their feedback to construct preference pairs for direct preference optimization. We further introduce S3Bench, a narrative benchmark for evaluating multi-event temporal instruction following. Experiments show that our method improves event completeness, temporal ordering, and joint instruction-following accuracy across existing benchmarks and S3Bench, while maintaining audio quality.
信息检索
1. 【2607.14035】Optimizing Visibility in Generative Engines: A Critical Survey of Generative Engine Optimization (2023-2026)
链接：https://arxiv.org/abs/2607.14035
作者：Olivier Martinez
类目：Information Retrieval (cs.IR); Digital Libraries (cs.DL)
关键词：Generative Engine Optimization, Engine Optimization, Generative Engine, generative engines, increase content presence
备注： 18 pages, 8 tables, 1 figure; critical survey of 45 studies; ancillary literature matrix and search protocol included
点击查看摘要
Abstract:Generative Engine Optimization (GEO) seeks to increase content's presence, likelihood of citation, or influence in answers produced by generative engines. Since the foundational GEO paper, the field has expanded rapidly, but terminology, metrics, and evidence standards remain heterogeneous. This critical survey reviews 45 studies selected under a November 2023-July 2026 publication window, including one earlier preprint published at EMNLP after the window opened, plus relevant RAG and evaluation work. We argue that GEO is not a single ranking task but a stochastic, partially observable pipeline spanning search activation, crawling and indexing, retrieval, reranking and context allocation, citation, prominence, factual absorption, fidelity, and user behavior. The foundational paper's widely cited gains are valid within its experimental setting but conditional on a source already being present in a fixed context; they establish neither organic discoverability nor durable traffic effects. Reviewed work indicates that topical relevance and context position are the most reproducible levers, generic heuristics transfer poorly, competition can erode individual gains, and citation-oriented rewrites can impair retrieval. Commercial audits further reveal low source overlap, substantial run-to-run variability, and persistent fidelity gaps. We contribute a multistage formal model, a visibility vector separating discoverability, citation, absorption, and economic outcomes, an evidence hierarchy, and a reproducible protocol based on repeated measurements, paraphrases, controls, human validation, and multi-actor interference. Within this corpus, the evidence is narrow: already-retrieved content can causally alter its citation or use, but no reviewed technique shows a stable, longitudinal, cross-platform causal effect on organic discoverability or downstream behavior.
2. 【2607.13826】Multimodal Assessment of Pancreatic Cancer Resectability Using Deep Learning
链接：https://arxiv.org/abs/2607.13826
作者：Vincent Ochs,Christoph Kuemmerli,Florentin Bieder,Julia Wolleb,Joel L. Lavanchy,Julia Ruppel,Jan Liechti,Stephanie Taha-Mehlitz,Christian Andreas Nebiker,Beat Mueller,Giuseppe Kito Fusai,Joerg-Matthias Pollok,Anas Taha,Philippe C. Cattin,Sebastian Staubli
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：pancreatic ductal adenocarcinoma, shows substantial variability, major peripancreatic vessels, Comprehensive Cancer Network, Accurate determination
备注：
点击查看摘要
Abstract:Accurate determination of pancreatic ductal adenocarcinoma (PDAC) resectability relies on evaluating how the tumor interacts with major peripancreatic vessels on CT imaging, yet expert assessment often shows substantial variability. We introduce a fully automated multimodal deep learning framework that jointly analyzes 3D contrast enhanced CT and structured clinical information to classify patients into the three National Comprehensive Cancer Network (NCCN) resectability categories (upfront resectable, borderline resectable, locally advanced). The approach uses a Swin-UNETR backbone to obtain anatomy aware image representations through auxiliary segmentation of pancreas, tumor, and vascular structures. These features are fused with a compact clinical embedding derived from 17 routinely collected variables and processed by a lightweight classification head. Model training is guided by a dynamic multitask objective that adapts the balance between segmentation and classification based on current tumor Dice performance, promoting feature representations that remain both anatomically informed and discriminative.
3. 【2607.13728】Cluster with Auctions for Vector Search
链接：https://arxiv.org/abs/2607.13728
作者：Swann Bessa,Pierre Fernandez,Gergely Szilvasy,Matthijs Douze,Hervé Jégou
类目：Information Retrieval (cs.IR); Machine Learning (stat.ML)
关键词：approximate nearest neighbor, Large-scale approximate nearest, probing function, probing function selects, nearest neighbor search
备注： 10 pages, 6 figures. Under review at NeurIPS 2026
点击查看摘要
Abstract:Large-scale approximate nearest neighbor search commonly relies on partitions for indexing: database vectors are partitioned into clusters, and for each query a probing function selects the clusters to be scanned. The query probing function and the database partition are rarely treated as separate entities: most techniques assign queries with the same assignment function as the database vectors, which is suboptimal especially when database and query distributions differ. This paper introduces CwA (Cluster with Auctions), which addresses this limitation by jointly learning a balanced database partition and a neural probing function. CwA optimizes search performance directly for the query distribution. It minimizes its objective by alternating two steps: (i) gradient descent on the neural network of the probing function, and (ii) a large-scale combinatorial optimization of the cluster assignment for the database vectors. We solve the latter with a parallelizable auction algorithm that balances the partition by design. To further scale CwA, we extend the method to a Cartesian product of clusters that increases the partition's granularity. When database and query distributions differ, CwA achieves up to 4.7$\times$ throughput over the state-of-the-art at equal recall. In the in-distribution (ID) setting, even a simple linear probing function trained with CwA outperforms competing deep neural methods.
4. 【2607.13609】Gauge-Invariant, Parameter-Insensitive Regularization for Potential Recovery from Flow on Directed Graphs
链接：https://arxiv.org/abs/2607.13609
作者：Mohammad Forouhesh
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR); Signal Processing (eess.SP); Machine Learning (stat.ML)
关键词：standard fix backfires, planted ground truth, ridge regularization shrinks, Recovering a latent, discrete Poisson problem
备注： 17 pages, 6 figures, submitted to LoG 2026
点击查看摘要
Abstract:Recovering a latent potential from observed flow on a directed graph (a discrete Poisson problem with Dirichlet boundaries) is ill-posed, and the standard fix backfires: ridge regularization shrinks toward a gauge-meaningless origin, collapsing and reversing the recovered ordering ($+0.81\to-0.42$ rank correlation against a planted ground truth). The gauge-invariant graph Dirichlet energy removes the hazard and delivers parameter-insensitivity: the estimate is stable across four orders of magnitude in $\lambda$, whereas ridge inverts the ordering for every $\lambda0$. We prove the reduced solve is SPD and preserves dynamic range exactly where ridge collapses it, and localize absorbing boundaries from flow alone via a Poisson residual. The $H^1$ seminorm is classical; what is new is the gauge diagnosis, the parameter-insensitivity it buys, and an ablation showing the result is robust to the extraction method. On three public clickstream corpora the gauge-invariant estimate retains $28$--$41\%$ of the interior dynamic range while ridge collapses to as little as $0.2\%$. The same gauge invariance carries into graph neural networks -- neutralizing the constant mode per layer prevents the oversmoothing that collapses a deep directed GCN -- linking this classical inverse problem to a central question in graph learning.
5. 【2607.13493】Personalizing Incremental Video Search with Hybrid Text and ID Embeddings
链接：https://arxiv.org/abs/2607.13493
作者：Vivek Kanojiya,Vishalaksh Aggarwal,Daeho Baek,Lyndon Kennedy,Xuetao Yin
类目：Information Retrieval (cs.IR)
关键词：video search requires, search requires high-quality, requires high-quality ranking, Incremental video search, requires high-quality
备注： Accepted to the Industry Track of the 20th ACM Conference on Recommender Systems (RecSys 2026)
点击查看摘要
Abstract:Incremental video search requires high-quality ranking after each keystroke, where intent is often underspecified (e.g., 1-3 character prefixes). We present a personalization system for Apple TV search that combines complementary semantic and collaborative signals at ranking time. Our approach learns two item embedding spaces: (i) a text-based multilingual encoder (TextEmb) fine-tuned on co-engagement triplets via contrastive learning, and (ii) an ID-based collaborative embedding model (IdEmb) trained on interaction-derived positives. At serving time, we construct user representations from recent watch history and inject text- and ID-based user-item cosine similarities into a pairwise XGBoost ranker. We evaluate with temporally held-out offline datasets and a three-week online controlled experiment. Offline, for sessions with user history, the personalized ranker improves NDCG@10 by 2.99% and MRR by 3.30% over the non-personalized baseline. Slice analyses show that personalization is most needed in incremental search, where intent is still forming: on ambiguous prefix queries (1-3 characters), NDCG@10 lift is +8.63%, versus +1.46% on longer, fully specified queries. Longer-history users benefit more: NDCG lift rises from +2.13% for users with 1-5 history items to +4.37% for users with 51-100, even though baseline relevance is lower for these cohorts (NDCG@10 drops from 0.733 to 0.680), indicating that personalization adds the most value where default ranking underperforms. Online, treatment yields statistically significant gains of +1.14% tap-through rate and +1.23% conversion rate, with a 2.91% improvement in converted-item rank position. We further analyze coverage-precision trade-offs between semantic and collaborative embeddings via ablations isolating each signal, and evaluate embedding quality on a held-out corpus with LLM-judged similarity labels to reduce click/exposure bias.
Comments:
Accepted to the Industry Track of the 20th ACM Conference on Recommender Systems (RecSys 2026)
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2607.13493 [cs.IR]
(or
arXiv:2607.13493v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2607.13493
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
6. 【2607.13418】Can We Steer the Black-Box? Towards Controllability-Centric Evaluation of Recommender Systems with Collaborative Agents
链接：https://arxiv.org/abs/2607.13418
作者：Jiwen Zhou,Xiang Liu,Mingming Li,Pengbo Mo,Jiao Dai,Honglei Lv,Jizhong Han,Songlin Hu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Recommender systems operate, Recommender systems, operate as Black-Boxes, audit their behavior, regulators unable
备注：
点击查看摘要
Abstract:Recommender systems operate as Black-Boxes, leaving users and regulators unable to steer their outputs toward specific intentions or audit their behavior. This lack of controllability, defined as the system's ability to respond to explicit guidance, remains an unaddressed dimension in existing evaluation paradigms. To fill this gap, we propose CtrlBench-Rec, a collaborative multi-agent framework for systematic assessment of controllability. We formalize three fundamental tasks: target content discovery, interest profile shaping, and popularity bias mitigation, which together measure steerability from explicit commands to implicit representation steering and finally to overcoming algorithmic this http URL experiments on real-world datasets and multiple recommendation models demonstrate that our framework effectively quantifies controllability and exposes critical system bottlenecks, most notably persistent resistance to guiding long tail content. CtrlBench-Rec provides the first standardized toolkit for controllable recommendation research, algorithmic auditing, and user empowerment. Our code is released on this https URL.
7. 【2607.13398】MallGS: Scaling Unified Feature and Sequence Modeling for Generative E-commerce Search
链接：https://arxiv.org/abs/2607.13398
作者：Zhentao Song,Yufeng Gao,Xing Fang,Jing Wang,Guangxin Song,Bokang Wang,Yipin Dai,He Guo
类目：Information Retrieval (cs.IR)
关键词：Deep Learning Recommendation, traditional Deep Learning, Learning Recommendation Models, Click-Through Rate, traditional Deep
备注：
点击查看摘要
Abstract:In industrial search and ranking systems, Click-Through Rate (CTR) prediction is shifting from traditional Deep Learning Recommendation Models (DLRM) toward unified, compute-intensive Transformer architectures. This transition is driven by the need to improve Model FLOPs Utilization (MFU) and achieve predictable gains through scaling laws. However, existing approaches such as OneTrans and Climber often adopt an all-in-tokenization strategy when adapting Large Language Model (LLM) architectures, overlooking the heterogeneous nature of ranking features. We propose TmallGS, a scalable ranking architecture for Tmall search. TmallGS includes five key components: (1) Hierarchical Distribution-Calibrated Tokenization, which combines Field-wise Saliency Reweighting (FSR) and Distribution-Calibrated Projection (DCP) to map diverse features into optimized subspaces; (2) a Field-Adaptive Gated Transformer Backbone with per-field QKV projections and noise-adaptive gating for refined semantic interaction; (3) Decoupled FiLM Late Fusion to preserve explicit high-frequency signals; (4) a Context-Aware Bias Net to decouple systemic bias from user intent; and (5) Error-Aware Progressive Training with dynamically weighted losses for robust learning. Extensive offline experiments and online A/B tests on Tmall Search show that TmallGS improves training throughput and achieves substantial gains in UCTCVR and GMV.
8. 【2607.13304】Where Does the Noise Come From? A Variance-Components Decomposition of Non-Determinism in LLM Brand Answers
链接：https://arxiv.org/abs/2607.13304
作者：Dmitrij Żatuchin
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Teams measuring, large language models, reproducibility problem, measuring whether large, face a reproducibility
备注： 18 pages, 6 tables, 3 code listings
点击查看摘要
Abstract:Teams measuring whether large language models (LLMs) recommend a brand face a reproducibility problem: ask the same question twice and the answer moves. Practice resamples each prompt a few times (commonly five) and averages, treating within-prompt resampling as the source of the noise. But a measured brand score moves for at least four separable reasons: within-prompt resampling, prompt paraphrase, model identity, and query language. We specify a crossed random-effects (generalizability-theory) decomposition that partitions the total variance of a response-level brand outcome into these four sources, and embed the components in a decision-study allocation that returns how many repeats, paraphrases, models, and languages to buy for a target reliability. We apply it to a fully crossed corpus of 12,933 LLM responses on 20 Central and Eastern European brands, 8 languages, and 3 models (GPT-5.2 and Gemini 3 Flash in parametric mode, Perplexity in grounded retrieval), with a stability subset of 1,435 cells resampled about five times. The outcome is per-response multilingual sentiment polarity. Query language is the largest systematic facet (26.5% of the variance of one response) against 1.5% for brand identity (ICC 0.0146), so a single AI answer carries almost no brand-discriminating signal. Once a cell term isolates pure resampling, resampling is 34.8% of variance and the brand-in-context interaction 29.6%; brand-by-language is 8.6% (a bilingual penalty) while brand-by-model and brand-by-prompt are near zero. Per unit of query budget, adding languages and models reduces relative-error variance far more than adding repeats: a repeat past the fifth reduces it by only 0.0003. Brand-ranking reliability stays low, near 0.01 for a single answer and about 0.36 at the full crossed design, so reliability is bought by spreading across languages and models, not by repeating one prompt.
9. 【2607.13636】Measuring What the Crawler Sees: Discovery Curves, Core Persistence, and Shell Dynamics in Longitudinal Web Crawls
链接：https://arxiv.org/abs/2607.13636
作者：Michael Paris,Hande Celikkanat,Luca Foppiano
类目：Physics and Society (physics.soc-ph); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：evolving URL population, longitudinal web crawl, evolving URL, alpha, URL
备注： 16 pages, 4 figures, web metrics
点击查看摘要
Abstract:A longitudinal web crawl is a sequence of partial samples of an evolving URL population. Pairwise containment between two crawls is the standard probe; under a simple \emph{urn} model of the crawl -- each round samples a fraction of the URLs and replaces a fraction -- it recovers two interpretable rates, per-round survival $\alpha$ and coverage $c$, but treats the population as uniform and consumes one pair at a time. In this work, we define a formal language for talking about a crawl. We extend this analysis with the \emph{discovery curve} $U(s, T)$, the cumulative URL footprint over a sliding window of $T$ crawls starting at $s$, which under the same urn model is also a closed-form function of $(\alpha, c)$. Containment and the discovery curve are then two projections of one process: independent fits agree on $(\alpha, c)$ when the urn is homogeneous, so any disagreement is itself a measurement. Applied to Common Crawl (2020--2025, domain granularity) and to the German Academic Web (GAW, URL granularity), the two projections disagree on both archives, and a two-component urn with a persistent core fraction $\kappa$ alongside shell parameters $(\alpha_\partial, c_\partial)$ reconciles the disagreement. A residual on $c_\partial$ remains, signaling that the shell itself is not homogeneous; $\kappa$ is recorded as the scalar entry point to a rank-resolved generalization, which is left to follow-up work. \keywords{web archive \and crawl coverage \and discovery curve \and urn model \and two-component model \and URL lifetime}
10. 【2607.13216】Classifying daily activities needs posture, reconstructing them needs motion
链接：https://arxiv.org/abs/2607.13216
作者：Arefeh Farahmandi,Gunnar Blohm
类目：Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Humans recognize movements, recognize movements effortlessly, complex visual input, Humans recognize, noisy and complex
备注：
点击查看摘要
Abstract:Humans recognize movements effortlessly, even from noisy and complex visual input. But what information in the stimulus allows humans to rapidly classify movements? No framework has systematically compared different strategies of movement analysis to address this question. Here, we used videos of 16 daily activities from the MoVi dataset and compared three strategies: Temporal Movement Primitives (TMPs), which decompose movements into weighted sums of temporally smooth basis functions; Legendre polynomial coefficients, which project joint-coordinate trajectories onto an orthogonal polynomial basis; and Autoencoder latent embeddings. Legendre coefficients and TMPs achieved the highest classifier accuracy, followed by autoencoders. We found two discriminative features for movement classification. The most informative is the general posture of the body, the average spatial configuration that distinguishes one activity from another. Additionally, we identified 9 critical joints that are most predictive for movement classification. Interestingly, good classification accuracy did not automatically lead to good movement generation: when we reconstructed movements for each activity, TMPs preserved the temporal dynamics and produced perceptually natural motion, whereas reconstructions from Legendre coefficients retained only the average posture and appeared frozen. These results reveal a dissociation in how movement information is organized: the static configuration of the body suffices to classify what activity is performed, but the temporal dynamics of movement are required to reconstruct how it unfolds. This distinction clarifies which features the visual system may rely upon for rapid action recognition, and suggests that postural features could enable efficient movement screening in clinical applications, while dynamic information remain essential wherever movement generation is the goal.
计算机视觉
1. 【2607.14088】VideoRAE: Taming Video Foundation Models for Generative Modeling via Representation Autoencoders
链接：https://arxiv.org/abs/2607.14088
作者：Zhihao Xie,Junfeng Wu,Xinting Hu,Junchao Huang,Li Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：latent spaces learned, generative models commonly, models commonly rely, Variational Autoencoders, Video generative models
备注： Home page: [this https URL](https://zhxie0117.github.io/VideoRAE)
点击查看摘要
Abstract:Video generative models commonly rely on latent spaces learned by 3D Variational Autoencoders (3D-VAEs). However, conventional 3D-VAEs are mainly optimized for pixel-level reconstruction, which can limit the semantic and spatio-temporal structure captured by their latents. Meanwhile, Video Foundation Models (VFMs) such as V-JEPA 2 and VideoMAEv2 show strong video understanding capabilities, yet whether their frozen representations can be transformed into compact, reconstruction-capable, and generation-friendly video latents remains largely unexplored. We answer this question with VideoRAE, a representation autoencoder that leverages multi-scale hierarchical features from a frozen video foundation encoder and compresses them with a lightweight 1D self-attention projector. VideoRAE supports both continuous latents for Diffusion Transformers and discrete tokens for autoregressive models via multi-codebook high-dimensional quantization. During decoding, a local-and-global representation alignment objective with the frozen VFM teacher improves semantic preservation and enables training without KL regularization. Experiments show that VideoRAE achieves strong reconstruction in both continuous and discrete regimes. On UCF-101, it obtains state-of-the-art class-to-video gFVDs of 40 and 93 with AR and DiT generators, respectively, while converging approximately 5x faster than competing autoencoder baselines. In a controlled 2B-scale text-to-video study, replacing LTX-VAE with VideoRAE leads to faster convergence under comparable settings. These results validate frozen VFM representations as versatile and generation-friendly video latents. The model and code will be released on this https URL.
2. 【2607.14076】From Pixels to States: Rethinking Interactive World Models as Game Engines
链接：https://arxiv.org/abs/2607.14076
作者：Zhen Li,Zian Meng,Shuwei Shi,Mingliang Zhai,Jiaming Tan,Chuanhao Li,Kaipeng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Building interactive worlds, interactive game world, Building interactive, game, game world
备注：
点击查看摘要
Abstract:Building interactive worlds that respond coherently to player actions has long been a shared goal of computer graphics, games, and artificial intelligence. Recent video generative models provide a data-driven route toward this goal by predicting future observations conditioned on user actions, and are increasingly regarded as potential next-generation game engines. Realizing a genuinely interactive game world, however, requires interaction outcomes that follow rules over evolving game conditions, consequences that persist over long horizons, and a generation loop that operates in real time. Conventional game engines realize these properties through a recurrent action-state-observation loop, in which player actions update an explicit game state according to predefined rules and observations are rendered from the resulting state. Taking this loop as an organizing lens, this paper examines interactive game world modeling along four dimensions: player action control, game state dynamics, state-observation persistence, and real-time interactive generation. For each dimension, we start from the capabilities required by an interactive game world, group existing approaches into representative families, and discuss the strengths and trade-offs of each family. Complementing this analysis, we present a scalable data engine for Black Myth: Wukong that collects over 90 hours of gameplay with frame-aligned player actions, ground-truth game states, and visual observations, together with structured and semantic annotations, as a resource for state-aware game world modeling. We hope this paper offers a clear picture of where the field stands and fosters progress toward interactive game worlds.
3. 【2607.14041】Multi-Expert Routing for Multi-Domain Low-Resource OCR: A Manchu Case Study
链接：https://arxiv.org/abs/2607.14041
作者：Zhan Chen,Jiqiao Ma,Chih-wen Kuo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Historical Manchu OCR, Historical Manchu, Manchu OCR, limited labeled data, visually distinct writing
备注： 14 pages, 6 figures, 3 tables
点击查看摘要
Abstract:Historical Manchu OCR must accommodate various visually distinct writing styles, including regular script, running script, and the semi-cursive chancery hand used in palace memorials, despite limited labeled data. We study a multi-expert system that reuses checkpoints from an iterative fine-tuning process as domain specialists and uses a lightweight page-level image classifier to dispatch pages by visual style. When the checkpoint pool lacks a suitable specialist, we train an additional expert for that domain. On three frozen test sets, the routed system matches the selected specialist for each style at two-decimal precision: 0.30 percent CER on regular script, 1.57 percent on memorials, and 4.83 percent on running script. The router achieves 99.3 percent page-level domain accuracy and matches the domain-label oracle at the same precision. Two of the three selected specialists were not trained specifically for their final domain; only the running-script expert was trained with that domain as its target. We report the evaluation protocol, router design, and per-page predictions to make the comparison reproducible.
4. 【2607.14005】M$^\text{4}$World: A Multi-view Multimodal Driving World Model for Interactive Object Manipulation and Minute-long Streaming
链接：https://arxiv.org/abs/2607.14005
作者：Ke Cheng,Hanqiao Ye,Lei Shi,Yahui Liu,Yunhan Shen,Jingtao Dong,Zhenke Wang,Wenxuan Ao,Weixiang Xu,Kaining Huang,Shuhan Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：existing methods remain, methods remain limited, stable Minute-long streaming, Minute-long streaming, long-horizon stability
备注： 24 pages, 13 figures
点击查看摘要
Abstract:Driving-world generation has emerged as a core capability for scalable autonomous-driving simulation, yet existing methods remain limited in object-level controllability and long-horizon stability. We present M$^\text{4}$World, a Multi-view and Multimodal generative driving world model that synthesizes future surround-view video streams and synchronized LiDAR scans while supporting interactive object Manipulation and stable Minute-long streaming. Fine-grained object manipulation is realized through a flexible conditioning interface that supports explicit control over both the spatial layout and visual appearance of individual objects. Stable minute-long streaming, on the other hand, is achieved through a multi-stage training framework that enables online causal generation in only four denoising steps while maintaining coherent world dynamics throughout extended rollouts. Building on these components, we introduce an efficient few-clip post-training as well as a suite of visual reference-conditioned generation models, preserving general generation ability while allowing rare-case customization for long-tail controllability. To assess controllability beyond realism, we further introduce an automated VLM-based judging pipeline that evaluates scene-level condition adherence, view-wise object controllability, and cross-view object consistency. Comprehensive experiments show that M$^\text{4}$World consistently delivers high generation quality, precise controllability, and stable minute-long streaming. Together with downstream long-tail augmentation and scene editing, these results demonstrate the potential of M$^\text{4}$World for controllable, scalable driving simulation.
5. 【2607.13986】ask-Specific Feature Fusion Method for Multi-Task Affective Behavior Analysis
链接：https://arxiv.org/abs/2607.13986
作者：Jiajun Sun,Zhe Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Learning Challenge requires, Multi-Task Learning Challenge, Affective Behavior Analysis, Learning Challenge, Challenge requires
备注： Extended arXiv version with an appendix. Code will be made publicly available
点击查看摘要
Abstract:The 11th Affective Behavior Analysis in-the-wild (ABAW11) Multi-Task Learning Challenge requires a unified system to predict valence-arousal, categorical expressions, and facial action units from the official s-Aff-Wild2 images. Although these tasks are naturally related through facial behavior, our validation experiments show that they benefit from different visual features, temporal processing strategies, fusion mechanisms, and calibration procedures. In this paper, we study task-adaptive feature fusion for ABAW11 multi-task affective behavior analysis. We first adapt two pretrained visual backbones, DINOv2 ViT-L and DINOv3 ConvNeXt-base, on an external expression-oriented facial image set and then freeze them to extract complementary frame-level features from the official ABAW11 data. On top of these frozen features, we systematically compare frame-level prediction heads, temporal convolutional heads, post-hoc temporal smoothing, LightGBM models, feature concatenation, gated fusion, residual fusion, late logit fusion, threshold calibration, and shared MTL structures. The final system selects task-specific fusion and prediction strategies rather than forcing all tasks to share a single architecture. On the ABAW11 validation set, the selected system achieves an EXPR macro-F1 of 0.4222, an AU macro-F1 of 0.5402, and a mean VA CCC of 0.6717, resulting in an overall validation score of 1.6341. The results suggest that task-adaptive fusion of frozen visual features is a simple and effective strategy for ABAW-style multi-task affective behavior analysis.
6. 【2607.13983】Screening Is Effective for Visual Recognition
链接：https://arxiv.org/abs/2607.13983
作者：Shunya Shimomura,Kazuhiro Hotta
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Transformer, modeling global dependencies, powerful framework, global dependencies, patches
备注： Exploratory research
点击查看摘要
Abstract:Vision Transformer (ViT) has been widely used as a powerful framework for modeling global dependencies among image patches. However, its core component, self-attention assigns softmax-normalized relative weights to all patches, making it difficult to evaluate the relevance between patches independently. In visual recognition, images often contain many background or redundant patches, yet self-attention cannot explicitly reject such irrelevant patches, which may introduce unnecessary information into feature aggregation. To address this limitation, Screening has been proposed in the field of language modeling, where the relevance of each token is independently evaluated based on query-key similarity and low-relevance tokens are explicitly excluded through thresholding. In this work, we propose VisionScreen, a new vision model that extends Screening mechanism to visual recognition. VisionScreen treats image patches as tokens arranged on a two-dimensional grid and extends absolute relevance estimation based on query-key similarity to the two-dimensional spatial domain. This allows each patch to selectively aggregate only content-wise and spatially relevant patches without relying on competition among patches. Experiments on image classification benchmarks demonstrate that the proposed method outperforms conventional ViT. These results suggest that Screening can be effective for visual recognition, offering an alternative to relative feature aggregation based on softmax attention.
7. 【2607.13978】Music-to-Dance Generation via Atomic Movements
链接：https://arxiv.org/abs/2607.13978
作者：Xinhao Cai,Yixuan Sun,Minghang Zheng,Qingchao Chen,Xin Jin,Song-chun Zhu,Yang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Music-driven dance generation, Music-driven dance, rhythmically synchronized, atomic movement, atomic
备注：
点击查看摘要
Abstract:Music-driven dance generation aims to produce human motion that is both rhythmically synchronized and semantically consistent with music. While recent neural approaches have achieved impressive visual realism, they typically model motion as a continuous signal and neglect its compositional nature, making generated dances structurally incoherent and difficult to control. In this work, we introduce a structure-aware framework that models choreography as a sequence of atomic movements-semantically interpretable motion events that serve as the building blocks of dance. To construct this atomic movement vocabulary, we first segment large-scale dance data and cluster them into atomic movement groups. We then employ a large language model to semantically relabel and refine the clusters, yielding a set of interpretable and reusable atomic movements. Based on these atomic movement annotations, we design a two-stage generation framework that mirrors the human choreography process. In the atomic movement planning stage, the model predicts the type, duration, and timing of atomic movements conditioned on the input music, forming a symbolic dance allocation. In the completion stage, a transition-aware generator synthesizes smooth and stylistically coherent motion conditioned on the planned structure. Extensive experiments demonstrate that our method produces dances with significantly improved structural coherence, rhythmic alignment, and perceptual naturalness compared to existing baselines, while providing enhanced interpretability and controllable editing through explicit structural representation.
8. 【2607.13976】CF-Net: Conflict Fusion with Speaker Normalisation and Certainty Weighting for Ambivalence/Hesitancy Recognition
链接：https://arxiv.org/abs/2607.13976
作者：Tung Hung Bui,Hong Hai Nguyen,Van Thong Huynh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Detecting ambivalence, subtle cross-modal incongruence, Video Recognition Challenge, ambivalence and hesitancy, prototypical affect
备注： 6 pages, 3 figues, 3 tables, 26 references
点击查看摘要
Abstract:Detecting ambivalence and hesitancy (AH) in unconstrained video is challenging because the target signal is inherently ambiguous and expressed through subtle cross-modal incongruence rather than prototypical affect. We present CF-Net, a deep multimodal network submitted to the 3rd Edition of the AH Video Recognition Challenge (ABAW 11th, ECCV 2026), targeting the BAH dataset. CF-Net encodes visual, audio, and transcript streams with frozen SigLIP2, HuBERT, and DistilBERT backbones, normalises backbone features per speaker to reduce identity leakage, and fuses them via a ConflictFusion module that explicitly computes pairwise cross-modal incongruence. Training combines certainty-weighted focal loss, manifold mixup, and modality dropout; an auxiliary certainty-regression head leverages ambiguity annotations to stabilise learning on genuinely borderline samples. CF-Net achieves a Macro F1 of 0.7155 on the BAH validation set and 0.7364 (AP = 0.7492) on the private challenge test set.
9. 【2607.13945】PlumeQuant: Uncertainty-aware consistency assessment of methane plume masks and emission-rate estimates
链接：https://arxiv.org/abs/2607.13945
作者：Parisa Masnadi Khiabani,Wolfgang Jentner,Alireza Rangrazjeddi,Michael C. Wimberly,Binbin Weng,David Ebert,Charles Nicholson
类目：Computer Vision and Pattern Recognition (cs.CV); Instrumentation and Methods for Astrophysics (astro-ph.IM)
关键词：Imaging spectrometers increasingly, integrated mass enhancement, spectrometers increasingly distribute, increasingly distribute source-resolved, distribute source-resolved methane
备注： 50 pages, 9 figures. Supplementary material provided as an ancillary file. Code and derived data archived at [this https URL](https://doi.org/10.5281/zenodo.21282534)
点击查看摘要
Abstract:Imaging spectrometers increasingly distribute source-resolved methane plume products in which the plume mask, integrated mass enhancement (IME), plume length, emission rate, and uncertainty are physically and algorithmically linked. Using 63 EMIT-derived Carbon Mapper plume records from 27 scenes, we show that these published scalar quantities do not uniquely constrain the plume boundary: substantially different yet plausible masks reproduce the same IME, plume length, and emission rate. Genetic-algorithm (GA) ensembles conditioned on the published IME and plume length make this equifinality explicit: the high-confidence core selected by nearly all target-consistent masks covers a median of 13% of the plausible footprint envelope, and ambiguity is largest for weak, low-overlap plumes. The diagnostics come from PlumeQuant, which recomputes IME, plume length, emission rate, and five-term uncertainty from distributed product components under stated conventions and evaluates four mask representations: the distributed reference mask, a transparent Carbon Mapper-informed analogue (CM-like), the GA ensemble, and optional expert edits. The CM-like mask is generated per plume without access to the reference mask or published quantities, with settings fixed once on a scene-disjoint 44-plume development split. It reproduced published IME with +0.72% median difference and emission rate with +0.16% (6.98% mean absolute), reached 0.843 median intersection-over-union against the reference masks, and matched the published uncertainty scale (median ratio 1.01). Holdout mean absolute errors were 7.6% (IME), 9.5% (length), and 6.1% (rate). These are product-level consistency diagnostics, not independent validation. They flag weak, offset, or ambiguous plumes for expert review.
10. 【2607.13941】Peak-End-Net: A Peak-End Rule Inspired Framework for Generalizable Video Aesthetic Assessment
链接：https://arxiv.org/abs/2607.13941
作者：Geng Li,Haiwen Li,Rui Chen,Jing Tang,Lei Sun,Xiangxiang Chu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual assessment tasks, aims to predict, VAA, peak-end rule, assessment tasks
备注： Accepted to ACM MM 2026, Code: [this https URL](https://github.com/AMAP-ML/Peak-End-Net)
点击查看摘要
Abstract:Video aesthetic assessment (VAA) aims to predict how aesthetically pleasing a video is, yet remains far less explored than other visual assessment tasks. Its progress is hindered not only by the scarcity of large-scale benchmarks, but also by the intrinsic subjectivity of aesthetic judgment, which is shaped by human perception. In this paper, we revisit VAA from a psychological perspective and propose \textit{Peak-End-Net}, a lightweight and interpretable framework inspired by the \textit{peak-end rule}, which suggests that people tend to judge a temporal experience mainly according to its salient moments and the ending. Building on this intuition, we first transfer knowledge from image aesthetic assessment (IAA) to VAA by introducing a pretrained IAA head to produce frame-wise aesthetic priors, which serve as surrogate signals for identifying aesthetically salient moments and guiding \textit{peak-end rule}-based temporal aggregation. To further capture how a video evolves aesthetically over time, we design an aesthetic rhythm encoder that models temporal progression beyond isolated moments. Additionally, we refine the overall assessment through a dynamic gated fusion mechanism to improve robustness under distribution shift. Our method is built on a frozen vision transformer (ViT) and requires only a small number of trainable parameters, making it scalable and parameter-efficient. Extensive experiments on two existing VAA benchmarks, including in-domain evaluation on VADB and cross-domain testing on DIVIDE-3K, demonstrate that our approach achieves state-of-the-art performance, affirming the value of psychologically grounded modeling for VAA. Our code and models are available at this https URL.
11. 【2607.13936】A novel unsupervised machine learning strategy to handle multimodal cardiac PET/MRI data
链接：https://arxiv.org/abs/2607.13936
作者：Brunnhilde Ponsi(1 and 2),Thomas Carlier(1 and 2),Lara Marteau(1 and 3),Aurélien Monnet(4),Thomas Eugène(1 and 2),Jean-Michel Serfaty(1 and 5),Nicolas Piriou(1 and 3),Hatem Necib(1 and 2) ((1) Nantes Université, CHU Nantes, Nantes, France, (2) CRCI2NA, INSERM UMR 1307, Nantes, France, (3) Cardiology Department, INSERM UMR 1307, CIC 1413, l'institut du Thorax, Nantes, France, (4) Siemens Healthineers France, Courbevoie, France, (5) Radiology Department, l'institut du Thorax, Nantes, France)
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Medical Physics (physics.med-ph)
关键词：gold standard criteria, Arrhythmogenic left ventricular, left ventricular cardiomyopathy, standard criteria, difficult to diagnose
备注： 11 pages, 6 figures
点击查看摘要
Abstract:Arrhythmogenic left ventricular cardiomyopathy is a genetic myocardial disease difficult to diagnose due to the lack of gold standard criteria. Simultaneous PET/MR imaging, combined with multiparametric quantitative analysis, could facilitate the identification of different profiles related to the phenotype and progression of cardiomyopathy. This preliminary study focuses on a methodological strategy for dealing with PET/MRI data, including inter-patient data linkage and regional analysis. Two-step clustering was applied to T1 and T2 maps, LGE, and 18F-FDG-PET images of 99 patients genetically diagnosed with arrhythmogenic left ventricular cardiomyopathy. Each patient's images were independently z-scored and summed into a single volume, which was clustered into supervoxels. Thirty-two inter-patient groups of supervoxels were obtained by spectral clustering. An "abnormality" score was assigned to each cluster and modality, and used to visualise abnormal regions likely associated with disease. They enabled the generation of automated textual and bullseye health reports for each patient, which were compared with cardiac imager assessments using balanced accuracy in repeated nested cross-validation. This approach was further validated on a larger cohort of 167 numerical phantoms. The reports generated by clustering accurately identified most of the cardiac physicians' observations (BA = 0.76 $\pm$ 0.04 in repeated nested cross-validation on patients, and BA $\ge$ 0.8 on phantoms). Furthermore, the identified abnormal clusters closely matched their visual observations, facilitating the identification of varying degrees of fibrosis or inflammation on the images. This approach enables a more systematic handling of multimodal PET/MRI data to characterise myocardial heterogeneity in arrhythmogenic left ventricular cardiomyopathy patients.
12. 【2607.13931】SIVA-RL: Sensitivity-Invariance Visual Alignment for Multimodal Reinforcement Learning
链接：https://arxiv.org/abs/2607.13931
作者：Cheng Tang,Junzhi Ning,Min Cen,Wei Li,Xinyi Zeng,Pinxian Zeng,Rongbin Li,Qiming Zhu,Yuqiang Li,Junjun He,Yirong Chen,Ming Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reinforcement learning, vision-language model grounds, learning with verifiable, answer-level correctness, grounds its predictions
备注： 27 pages, 11 figures
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) drives multimodal reasoning, but answer-level correctness does not guarantee that a vision-language model grounds its predictions in visual evidence. Existing visual-intervention methods contrast policy behavior on original and modified images, yet assign supervision by the type of intervention rather than its observed effect. This assumption fails: identical operators produce heterogeneous outcomes across samples. We propose SIVA-RL, a Sensitivity-Invariance Visual Alignment framework that replaces operator-conditioned regularization with sample-wise, outcome-conditioned supervision. SIVA-RL constructs localized interventions through token-aligned, distance-constrained within-image PatchSwap. A frozen audit policy then scores each clean-intervention pair, and the observed reward drop becomes soft routing weights. Large-drop pairs drive sensitivity alignment, low-drop pairs drive clean-anchored invariance alignment, and ambiguous pairs are down-weighted. This design decouples intervention construction from supervision assignment and is compatible with both GRPO and DAPO backbones. Across nine multimodal reasoning benchmarks spanning mathematical, logical, and vision-dependent tasks, SIVA-RL improves 3B and 7B models over matched RL baselines in every setting. It yields an 8.79 percentage-point gain on vision-dependent reasoning and up to 14.9% relative overall improvement across all four GRPO- and DAPO-based configurations.
13. 【2607.13927】Cyclone: Diffusion Model for Cycle-Consistent Weather Editing from Unpaired Driving Data
链接：https://arxiv.org/abs/2607.13927
作者：Thang-Anh-Quan Nguyen,Moussab Bennehar,Luis Guillermo Roldao Jimenez,Nathan Piasco,Dzmitry Tsishkou,Laurent Caraffa,Jean-Philippe Tarel,Roland Brémond
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous driving systems, Reliable perception, weather conditions remains, remains a major, major challenge
备注： Project page: [this https URL](https://ntaquan0125.github.io/weather-cyclone/)
点击查看摘要
Abstract:Reliable perception under diverse weather conditions remains a major challenge for autonomous driving systems. A common strategy to improve robustness is either to synthesize adverse weather conditions for training perception models or to apply weather-removal techniques to recover clean inputs. However, existing approaches typically rely on synthetic data augmentation or physics-based, task-specific models that require paired training data and often struggle to generate realistic weather effects or generalize robustly to out-of-domain scenarios. Toward this problem, we present Cyclone, a unified framework for weather editing based on latent diffusion, equipped with cycle-consistent constraints and knowledge from image-text models. Cyclone enables the generation of multiple weather conditions across diverse scenes while eliminating the need for paired data. Experimental results show that our approach produces more realistic, structure-preserving outputs than existing baselines and leads to consistent improvements across several downstream driving perception tasks. Furthermore, we demonstrate that Cyclone can be distilled to a video diffusion model for temporally consistent weather editing.
14. 【2607.13925】hresholded Cross-Attention for Reliable Intensity-Chromaticity Fusion in Low-Light Image Enhancement
链接：https://arxiv.org/abs/2607.13925
作者：Yanyi Wu,Xu Zhang,Junkai Chen,Laibin Chang,Jiaqi Ma,Shi Chen,Linwei Zhu,Jianglei Di,Huan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Low-Light Image Enhancement, Image Enhancement, Low-Light Image, requires a careful, noise suppression
备注：
点击查看摘要
Abstract:Low-Light Image Enhancement (LLIE) requires a careful balance among noise suppression, color fidelity, and efficiency. Recent HVI-based methods alleviate color entanglement by decoupling intensity and chromaticity, yet how reliably the two streams are fused again is an overlooked factor that largely determines the final quality. We observe that the confidence of cross-stream attention is strongly layer-dependent, so the fixed-quota selection of Top-K sparse attention is mismatched to it, discarding informative dependencies in some layers while retaining noisy ones in others. Motivated by this observation, we propose TCA-Net, a network built around Thresholded Cross-Attention that targets reliable intensity-chromaticity fusion in the HVI space rather than introducing yet another color representation. At its core, TCA replaces the rigid Top-K quota with a fixed confidence threshold whose retained cardinality is input- and layer-adaptive, retaining only high-confidence cross-stream interactions while suppressing unreliable ones. Around this core, two complementary designs clean up the fusion before and after it: a Phase-guided Fourier Interaction Module provides a structure-aware brightness initialization for the intensity stream prior to fusion, and a Decoupled Dual-Stream Guidance Module constructs residual intensity features to suppress chromaticity leakage during reconstruction. A Scale-Aware Consistency Regularization further improves structural robustness under scale perturbations during training. Extensive experiments on LOL-v1, LOL-v2, Sony-Total-Dark, and LSRW-Huawei demonstrate that TCA-Net delivers competitive restoration accuracy, improved color fidelity, and a compact parameter size.
15. 【2607.13905】he 2nd International StepUP Competition for Biometric Footstep Recognition: From Steps to Strides
链接：https://arxiv.org/abs/2607.13905
作者：Robyn Larracy,Anant Gupta,Gourav Gupta,Ethan Eddy,Maxime Devanne,Cyril Meyer,Jin-Chern Chiou,Yueh-Shan Lee,Zong-Han Lu,Aaron Tabor,Erik Scheme
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：International StepUP Competition, StepUP Competition Series, challenging evaluation framework, pressure-based footstep biometrics, International StepUP
备注： Accepted to the 2026 IEEE International Joint Conference on Biometrics (IJCB)
点击查看摘要
Abstract:The International StepUP Competition Series was launched to advance research in pressure-based footstep biometrics through a standardized and challenging evaluation framework. Using the large-scale StepUP-P150 dataset (with more than 200,000 high-resolution dynamic footsteps from 150 individuals) and a previously unreleased test set, the 2nd edition of the competition addressed three key challenges: (1) generalization to unseen users with limited enrollment data, (2) robustness to domain shift caused by variations in footwear and walking speed and (3) effective fusion of paired left-right footsteps. While the first two challenges built on the inaugural competition, this edition introduced more extreme cross-domain conditions and moved beyond isolated footsteps to stride-level verification, enabling new opportunities for representation learning and inter-step information fusion. The competition attracted 26 registrants from academia and industry, with a best equal error rate of 8.00% achieved by the ArogyaPandit Research Team using a spatiotemporal CNN combined with an ensemble-based scoring strategy. The top solutions showcase the value of harnessing temporal patterns and of incorporating inference-time normalization and calibration strategies to improve scoring. However, the results also reveal that recognizing users in unseen personal footwear remains a challenge, especially in the presence of distractors with similar characteristics.
16. 【2607.13892】Fine-Grained Vision-Language Pretraining with Organ-Conditioned Pattern Tokens for CT Understanding
链接：https://arxiv.org/abs/2607.13892
作者：Guoliang You,Xiaomeng Chu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Computed tomography, challenging task, volumes and radiology, radiology reports, Computed
备注： 9 pages, 4 figures
点击查看摘要
Abstract:Computed tomography (CT) vision-language pretraining from paired volumes and radiology reports is a scalable yet challenging task. Existing methods commonly adopt global scan-report contrast, which is scalable but obscures heterogeneous organ evidence. Meanwhile, direct organ-level alignment remains coarse, since the same anatomy can exhibit multiple distinct radiological appearances. Therefore, pretraining requires a finer alignment unit: the organ-conditioned radiological pattern. In this work, we propose OCP-CT, an organ-conditioned pattern-token alignment framework for CT vision-language pretraining. Specifically, OCP-CT preserves a stable global CT-report contrastive branch and introduces an organ pattern interface: sparse Mixture-of-Experts (MoE) routes image and text tokens according to latent radiological patterns, learnable slots query the routed tokens into continuous pattern tokens, and paired token contrast aligns image-text pattern tokens with structured soft targets built from report-derived clinical similarity. On the publicly available CT-RATE and RAD-ChestCT benchmarks, OCP-CT achieves average AUROCs of 84.5% and 69.9% for zero-shot abnormality diagnosis, respectively. Compared with the strongest prior reported results, these results yield absolute AUROC gains of 6.7 and 0.8 percentage points.
17. 【2607.13891】PiVoT: A Variational Solution for Real-time Large-scale Multi-object Detection and Tracking under Heavy Clutter
链接：https://arxiv.org/abs/2607.13891
作者：Runze Gan,Qing Li,Simon J. Godsill,Mike E. Davies,James R. Hopgood
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：noisy point clouds, point clouds remain, Doppler point clouds, data-scarce radar applications, clouds remain challenging
备注：
点击查看摘要
Abstract:Multi-object detection and tracking from noisy point clouds remain challenging in many data-scarce radar applications. Current Bayesian trackers based on Poisson measurement models offer a training-free solution but struggle to achieve accuracy and efficiency under severe clutter, large object populations, and full-resolution Doppler point clouds. We address this with PiVoT, a fast, clutter-resilient multi-object tracker for both positional and Doppler measurements. PiVoT performs end-to-end detection and tracking of a large and time-varying number of objects without external clustering or detectors, through joint inference of object states, shapes, existence probabilities, data association, and measurement rates. Its efficiency is driven by several variational inference innovations, such as theoretically justified birth pruning, quadratic-to-linear complexity reductions for exact updates, and a computationally efficient Doppler Poisson model. Experiments show that PiVoT substantially outperforms existing Bayesian trackers in challenging scenes, while also demonstrating exceptional scalability to a thousand objects, robustness to clutter visually inseparable from objects, and real-time operation on full-scale modern automotive radar datasets, where it attains performance comparable to a deep-learning detection benchmark as a training-free joint detector and tracker.
18. 【2607.13881】Unleashing Multimodal Large Language Models for Training-free HOI Detection in the Wild
链接：https://arxiv.org/abs/2607.13881
作者：Ting Lei,Jialin Liu,Zhu Xu,Yuxin Peng,Yang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：predefined interaction categories, Human-object interaction detection, Human-object interaction, traditionally been formulated, problem over predefined
备注：
点击查看摘要
Abstract:Human-object interaction detection (HOID) has traditionally been formulated as a supervised detection problem over predefined interaction categories. While such paradigms achieve strong performance on closed-set benchmarks, they fundamentally entangle interaction understanding with dataset-specific supervision, limiting their ability to generalize to open-world and compositional scenarios. Recent HOI detectors attempt to leverage MLLMs through prompting strategies to transfer interaction-specific knowledge. However, such prompt-based approaches primarily focus on extracting discriminative representations from pretrained models, while underexploring their inherent multimodal reasoning capabilities. As a result, they struggle to provide informative contextual reasoning for ambiguous and open-world interaction scenarios. In this work, we present AgentHOI, a training-free, agentic framework that transfers the generalist multimodal reasoning capabilities of foundation models to HOI detection in the wild. Instead of learning interaction classifiers, AgentHOI modularly orchestrates complementary vision foundation modules to perform open-ended semantic reasoning and spatial grounding in a coordinated manner. To address the challenges of incomplete interaction discovery and ambiguous localization in complex scenes, we introduce two key mechanisms: (1) Context-aware Multi-round Reasoning, which progressively refines interaction hypotheses to ensure exhaustive and compositional HOI discovery, and (2) Multifaceted Interaction Localization, which enhances grounding precision by generating instance-specific descriptions that integrate semantic, spatial, and appearance cues. Extensive experiments demonstrate that AgentHOI achieves superior performance over state-of-the-art supervised and weakly supervised methods in real-world settings, despite requiring no HOID data for training.
19. 【2607.13860】owards Enhancing 3D Spatial Reasoning in Medical Multimodal Large Language Models
链接：https://arxiv.org/abs/2607.13860
作者：Zhuoyuan Fu,Zeshang Li,Yiqiong Zhang,Hangui Lin,Yan Shu,Yan Li,Binyang Li,Yaru Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, demonstrated remarkable success
备注：
点击查看摘要
Abstract:While Multimodal Large Language Models (MLLMs) have demonstrated remarkable success in 2D medical image understanding, their extension to 3D volumetric imaging remains hindered by prohibitive annotation costs and dataset opacity. Current data formats, predominantly consisting of rigid Visual Question Answering (VQA) pairs or unstructured final clinical reports, typically fail to capture explicit clinical reasoning. To address this limitation, we introduce a large-scale structured reasoning dataset constructed via a novel slice-wise data synthesis paradigm. Inspired by the genuine diagnostic workflow of radiologists, this paradigm models visual cognition by decomposing the complex 3D reading process, translating global clinical priors into fine-grained, per-slice observations that are subsequently synthesized into an interpretable Chain-of-Thought (CoT). Crucially, this synthesized reasoning framework enforces essential clinical principles: sequential spatial tracking, multi-slice spatial awareness for artifact mitigation, and differential exclusion. To validate this approach, we instruction-tune a standard 2D-pretrained MLLM baseline using the synthesized data to enhance its volumetric comprehension. Comprehensive evaluations across multiple 3D medical benchmarks demonstrate that our method yields significant performance improvements over the 2D baseline. Furthermore, the resulting model exhibits robust spatial reasoning capabilities and rivals resource-intensive native 3D architectures, effectively bridging the performance gap. Ultimately, this data-centric strategy unlocks deep volumetric understanding and highly interpretable clinical logic without requiring computationally expensive 3D-specific pre-training. The complete repository, including datasets and training workflows, is publicly available at this https URL.
20. 【2607.13830】Recursive ArUco Markers: A Scalable Fiducial Marker Design for Unmanned Aerial Vehicle Landing Pads
链接：https://arxiv.org/abs/2607.13830
作者：Rafael Munoz-Salinas,Francisco Jose Romero-Ramirez,Sergio Garrido-Jurado
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned Aerial Vehicles, Unmanned Aerial, Aerial Vehicles, autonomous navigation, navigation and precision
备注：
点击查看摘要
Abstract:Unmanned Aerial Vehicles (UAVs) increasingly rely on visual fiducial markers for autonomous navigation and precision landing. However, standard markers suffer from limited operational ranges, becoming undetectable when the camera is either too far or too close. While recursive and fractal markers have been proposed to address this issue, existing approaches either require the marker's center to remain visible, making them vulnerable to occlusion, or are limited in their recursion depth and placement. We propose a novel Recursive ArUco marker design. Our method allows any standard fiducial marker to be transformed into a recursive marker with an arbitrary depth. By employing a modified bit-sampling strategy during detection, we embed complete markers within both the black and white bits of the parent marker. This approach guarantees unlimited recursion depth and robust detection even with partial occlusion, as it does not rely on the marker's center being visible. Furthermore, by maintaining a single, unique identifier across all recursive scales, our proposal provides an extensive dictionary of multiple unique landing pads. This capability allows fleets of UAVs to operate simultaneously, with each drone landing at its designated location -- a feature not supported by existing Fractal and Harco markers due to their structural and dictionary constraints.
21. 【2607.13826】Multimodal Assessment of Pancreatic Cancer Resectability Using Deep Learning
链接：https://arxiv.org/abs/2607.13826
作者：Vincent Ochs,Christoph Kuemmerli,Florentin Bieder,Julia Wolleb,Joel L. Lavanchy,Julia Ruppel,Jan Liechti,Stephanie Taha-Mehlitz,Christian Andreas Nebiker,Beat Mueller,Giuseppe Kito Fusai,Joerg-Matthias Pollok,Anas Taha,Philippe C. Cattin,Sebastian Staubli
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：pancreatic ductal adenocarcinoma, shows substantial variability, major peripancreatic vessels, Comprehensive Cancer Network, Accurate determination
备注：
点击查看摘要
Abstract:Accurate determination of pancreatic ductal adenocarcinoma (PDAC) resectability relies on evaluating how the tumor interacts with major peripancreatic vessels on CT imaging, yet expert assessment often shows substantial variability. We introduce a fully automated multimodal deep learning framework that jointly analyzes 3D contrast enhanced CT and structured clinical information to classify patients into the three National Comprehensive Cancer Network (NCCN) resectability categories (upfront resectable, borderline resectable, locally advanced). The approach uses a Swin-UNETR backbone to obtain anatomy aware image representations through auxiliary segmentation of pancreas, tumor, and vascular structures. These features are fused with a compact clinical embedding derived from 17 routinely collected variables and processed by a lightweight classification head. Model training is guided by a dynamic multitask objective that adapts the balance between segmentation and classification based on current tumor Dice performance, promoting feature representations that remain both anatomically informed and discriminative.
22. 【2607.13808】Bake It Till You Make It: Ultrafast Spatial Texture-Atlas Splatting
链接：https://arxiv.org/abs/2607.13808
作者：Neel Kelkar,Simon Niedermayr,Kaloian Petkov,Klaus Engel,Rüdiger Westermann
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：capture fine color, Gaussian Splatting, fine color details, incur high computational, high computational cost
备注： 12 pages, 6 figures. Project page with videos and interactive demos: [this https URL](https://nilkel.github.io/bitymi/)
点击查看摘要
Abstract:Recent extensions of 3D Gaussian Splatting (3DGS) capture fine color details using hash-grid-based appearance parameterization but incur high computational cost during fragment rendering. We introduce a decoupled radiance representation that models low-frequency geometry and view dependent appearance features with 2D surfels while representing high-frequency textures via a view-independent spatial hash grid that is baked into a compact texture atlas. By including sparsity-enhancing optimizations that penalize semi-transparency and per-primitive falloff, our method aggressively prunes insignificant surfels and achieves significantly faster and sparser reconstructions than prior work. Exploiting geometric sparsity and efficient GPU texture mapping, our approach achieves up to a fivefold speedup over 3DGS while preserving state-of-the-art visual fidelity, enabling real-time 4K rendering at 60 FPS on consumer hardware.
23. 【2607.13805】AspectCLIP: Optimizing CLIP Representation Space via Aspect-Guided Consistency Regularization
链接：https://arxiv.org/abs/2607.13805
作者：Yiyang Yao,Shanglin Liu,Jianming Lv,Chengjun Wang,Jinyi Li,Yuchan Jie,Zhihua Jin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contrastive Language-Image Pretraining, Language-Image Pretraining learns, large-scale contrastive learning, Language-Image Pretraining, Pretraining learns
备注： PRCV 2026
点击查看摘要
Abstract:Contrastive Language-Image Pretraining learns a shared representation space through large-scale contrastive learning. However, existing methods that enforce global consistency regularization overlook a key challenge: the inherent information asymmetry between images and text: captions typically describe only one specific aspect of an image, thus images with similar visual content can be paired with completely divergent textual content and semantic information. Consequently, global regularizers inadvertently impose constraints between visually similar images whose captions describe divergent aspects, introducing semantic distortion into the representation space. We propose AspectCLIP, a framework that reformulates consistency regularization to respect this one-to-many structure. AspectCLIP first partitions training samples into attribute clusters based on textual similarity to identify aspect-coherent groups, then applies full cyclic consistency within each cluster while restricting cross-cluster regularization to prototype-level comparisons. This aspect-guided regularization enforces strict geometric alignment only when images and texts describe a consistent facet, while allowing flexibility across divergent aspects. Extensive experiments on downstream tasks demonstrate that AspectCLIP consistently outperforms traditional methods and achieves a more structured representation space.
24. 【2607.13802】RainDancer: RGB-Event Video Deraining with Rain-Oriented Spiking Dynamics
链接：https://arxiv.org/abs/2607.13802
作者：Kui Jiang,Runzhe Li,Zhaocheng Yu,Guanglu Sun,Junjun Jiang,Xianming Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover clean visual, clean visual content, Video deraining aims, adverse weather, aims to recover
备注：
点击查看摘要
Abstract:Video deraining aims to recover clean visual content from rainy videos for reliable perception under adverse weather. Existing methods mainly rely on RGB sequences and temporal redundancy, but RGB-only restoration remains ambiguous in dynamic rainy scenes, where rain streaks, textures, boundaries, motion, and occlusions may share similar visual patterns. Event cameras provide complementary motion-sensitive cues with high temporal resolution, but event streams also contain sensor noise and background-triggered responses, so direct RGB-Event fusion may introduce cross-modal interference. To address this issue, we propose RainDancer, a progressive RGB-Event video deraining framework based on a decompose-before-interact paradigm. The core idea is to separate rain and background components within each modality before cross-modal interaction. In the RGB branch, frame features are progressively decomposed into rain and background representations. In the event branch, a rain-oriented spiking neural network module captures sparse and bursty event dynamics associated with rain motion. Component-level fusion is then performed between semantically aligned representations for structure preservation and rain suppression. We further introduce event-domain supervision to regularize sparse event reconstruction, structural consistency, and gradient orientation. Experiments on synthetic and real RGB-Event video deraining datasets demonstrate superior quantitative performance, visual quality, and downstream perception robustness. Code is available at this https URL.
25. 【2607.13800】Prospective clinical indication, post-hoc report leakage, and fusion design in multi-image chest radiograph classification: a patient-clustered evaluation
链接：https://arxiv.org/abs/2607.13800
作者：Kamran Shahid,Muhammad Munwar Iqbal
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Chest radiograph datasets, Chest radiograph, combine multiple images, Clinical Indication, stages of care
备注： 19 pages, 7 figures, 5 tables
点击查看摘要
Abstract:Chest radiograph datasets often combine multiple images with Clinical Indication, Findings, and Impression, although these inputs are produced at different stages of care. We evaluated 15,000 ReXGradient-160K studies with two readable images and five CheXbert-derived report observations. Frozen DenseNet-121 and Bio+ClinicalBERT encoders were used to compare image-only, Indication-only, fixed-order multimodal, random-swap, DeepSets, and SectionGuard-MI models. Findings and Impression were evaluated only as post-hoc leakage controls. Models were trained with five seeds, and public-test uncertainty was estimated with 2,000 patient-cluster bootstrap replicates. Under U-Ones, macro AUROC was 0.643 for the primary image, 0.694 for two images, 0.749 for Indication, and 0.780 for ordinary two-image-plus-Indication fusion. SectionGuard-MI achieved AUROC 0.783 and AUPRC 0.260. Relative to ordinary fusion, its paired AUROC difference was 0.0031 (95% CI, -0.0042 to 0.0104; adjusted p=0.374), while its AUPRC difference was 0.0289 (95% CI, 0.0095 to 0.0413; adjusted p=0.004). DeepSets had the highest prospective AUROC point estimate (0.787), and random-swap fusion had the highest prospective AUPRC point estimate (0.265) with better calibration than SectionGuard-MI. Full report text alone reached AUROC 0.979 and AUPRC 0.836; AUROC remained above 0.973 after exact or expanded masking. These results show that prospective Indication is strongly associated with report-derived targets, permutation-aware fusion is competitive, and post-hoc report text creates substantial report-label circularity.
26. 【2607.13792】EgoProceVQA: A Novel Egocentric Procedural Understanding Task with Self-Skill-Exploration Agent
链接：https://arxiv.org/abs/2607.13792
作者：Junlong Li,Junxi Li,Yuxiang Yang,Wenbin Zou,Lap-Pui Chau,Yi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：procedural, procedural understanding, daily activities, activities are inherently, Procedural Understanding VQA
备注：
点击查看摘要
Abstract:Most daily activities are inherently procedural. However, existing evaluations for egocentric video understanding seldom address procedural understanding and largely overlook complex key-step-level reasoning under the widely used video question answering (VQA) paradigm for MLLMs. Such capabilities are crucial for building procedural AI assistants deployable on wearable devices. To bridge this gap, we introduce the Egocentric Procedural Understanding VQA task (EgoProceVQA), which systematically evaluates egocentric procedural reasoning abilities of current MLLMs and agents through six types of key-step-centric questions. Furthermore, we develop EgoProceGen, a data generation platform that efficiently constructs QA data tailored to different question types. Based on this platform, we build a benchmark with 3,600 questions, four common procedural scenarios, and 31 everyday procedural tasks. Evaluations on EgoProceVQA show that existing MLLMs and agents still have substantial room for improvement in procedural understanding. Therefore, we further propose EgoProceAgent, a self-skill-exploration agentic framework. We design a generic tool library for procedural understanding and a standardized sub-skill library shared across tools and models, enabling self-exploration without ground-truth supervision. By exploring how to compose and select sub-skills, the agent discovers effective skill strategies for diverse problems, and attains state-of-the-art performance among open-source models on multiple tasks. Together, our benchmark, generation platform, and agentic framework establish a unified foundation for EgoProceVQA. Project page: this https URL.
27. 【2607.13738】Anatomically Faithful but Temporally Blind: Auditing Attribution for Left-Ventricular Ejection-Fraction Estimation from Echocardiography
链接：https://arxiv.org/abs/2607.13738
作者：Hyunkyung Han,Min Jung Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Background and Objective, left-ventricular ejection fraction, estimate left-ventricular ejection, Chefer relevance, models estimate left-ventricular
备注：
点击查看摘要
Abstract:Background and Objective: Deep video models estimate left-ventricular ejection fraction (EF) from echocardiography with near-expert accuracy, and post-hoc attribution (Chefer relevance for transformers, Grad-CAM for CNNs) is increasingly used to certify that models "look at the right place." Yet whether these explanations are faithful both spatially and temporally is unaudited. Because EF is defined by the end-systolic (ES) and end-diastolic (ED) frames, a faithful explanation must localize the left ventricle (space) and the decisive frames (time). Methods: We fine-tune two distinct EF regressors on EchoNet-Dynamic -- a self-supervised VideoMAE transformer and a Kinetics-pretrained R(2+1)D CNN -- and audit each with architecture-matched attribution along three axes: intersection-over-relevance (IoR) against LV masks, deletion AUC, and a temporal localization index on ES/ED frames, each relative to chance with per-case 95% CIs over 50 studies. A tubelet-occlusion probe separates attribution failure from model behavior. Results: Both models are anatomically faithful -- IoR 2.91x (VideoMAE) and 1.98x (R(2+1)D) above chance -- yet temporally blind: temporal localization is indistinguishable from chance (0.97--1.00) and no better than random attribution. Occlusion shows the models do not preferentially rely on ES/ED (0.90x chance), so temporal blindness reflects model behavior, not an attribution artifact. Conclusions: Spatial faithfulness does not imply temporal faithfulness. Attribution can certify anatomical grounding while masking that a model ignores the clinically decisive frames -- a caution for XAI-based validation of video diagnostic models and a call for temporally-aware training and evaluation.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2607.13738 [cs.CV]
(or
arXiv:2607.13738v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.13738
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Hyunkyung Han [view email] [v1]
Wed, 15 Jul 2026 11:54:09 UTC (402 KB)
28. 【2607.13712】Groc-PO: Grounded Context Preference Optimization for Truthful Multimodal LLMs
链接：https://arxiv.org/abs/2607.13712
作者：Zhixiao Zheng,Zheren Fu,Zhiyuan Yao,Chunxiao Liu,Dongming Zhang,Zhendong Mao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：Large Language Models, Multimodal Large Language, Language Models, Large Language, Multimodal Large
备注： Accepted by ACM-MM 2026
点击查看摘要
Abstract:Despite the rapid progress of Multimodal Large Language Models (MLLMs), they still suffer from untruthfulness issues, such as visual hallucinations, content fabrication, and unfaithful reasoning, which substantially undermine their faithfulness and practical utility. Alignment methods based on human preference, such as Direct Preference Optimization (DPO), have been widely adopted to address these issues. However, multimodal reasoning errors often propagate across stages, and final-answer errors can often be traced to mistakes in early grounding stages, yet standard DPO typically applies preference optimization at the final-answer level. This credit-assignment challenge means that supervision for early grounding stages is indirect rather than stage-specific, making it difficult to suppress error propagation arising from grounding drift and context inconsistency. To address this, we propose Grounded Context Preference Optimization (Groc-PO), a grounded preference optimization framework for MLLMs. We further construct the Grounded Context Preference Dataset (GCPD), organizing multi-stage preference samples around three stages of Object Grounding, Contextual Grounding, and Grounded Reasoning, to capture the formation, integration, and utilization of grounded context. By introducing more explicit preference supervision over multiple grounded stages, Groc-PO strengthens context-dependent reasoning and mitigates cross-stage error propagation. Extensive experiments show that, compared with standard DPO and other strong baselines, Groc-PO achieves improved performance in hallucination mitigation, faithful reasoning, and overall reliability, supporting the value of more explicit grounded supervision for trustworthy multimodal reasoning.
29. 【2607.13698】owards a Modular Bin-picking Framework for Handling Object Pose Uncertainties
链接：https://arxiv.org/abs/2607.13698
作者：Frederik Hagelskjær
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：precise bin-picking applications, recent years, bin-picking applications, pose, growing interest
备注： 7 pages, 5 figures, 1 table, keywords: bin picking; object manipulation; grasping strategies; object pose distribution estimation
点击查看摘要
Abstract:In recent years, there has been growing interest in robust robotic systems for precise bin-picking applications. To achieve reliable performance, such systems must address errors arising from both the object pose estimation and the grasping process. Although various approaches have been proposed, they typically target specific challenges and do not offer general solutions. In this paper, we present a modular framework that jointly handles both error types. The framework incorporates object pose distribution estimation to account for pose uncertainty, which frequently arises in situations with ambiguous observations where a single correct pose cannot be determined. To further reduce uncertainty, we introduce a second-viewpoint module that computes complementary pose distributions, which are subsequently fused. This fusion decreases overall uncertainty and improves system efficiency. Additionally, two independent modules are included to compensate for grasping errors. The modular design allows the components to be combined for optimal performance or used individually, depending on the physical setup. The proposed method is evaluated in a real-world setup with three different objects, with no errors, and all modules are shown to improve efficiency. These results suggest that incorporating pose distributions with grasping pose errors is a promising direction for developing more flexible and reliable robotic production systems. To the best of our knowledge, this is the first framework that jointly addresses both grasping and object pose uncertainties using interchangeable modules. We believe there is ample opportunity to integrate additional modules, resulting in improved performance and flexibility. The current framework is limited to pose uncertainties in SO(2), but it could be extended to SE(3), enabling additional modules to improve the system.
Comments:
7 pages, 5 figures, 1 table, keywords: bin picking; object manipulation; grasping strategies; object pose distribution estimation
Subjects:
Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.13698 [cs.RO]
(or
arXiv:2607.13698v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2607.13698
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
30. 【2607.13689】Barnamala: Parameter-Efficient Handwritten Devanagari Recognition at Benchmark Saturation
链接：https://arxiv.org/abs/2607.13689
作者：Ashish Thapa,Samrat Karki
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：DHCD Devanagari recognition, compact convolutional network, Devanagari recognition, smaller than prior, DHCD Devanagari
备注： 14 pages, 2 figures, 7 tables. Code and artifacts available at [this https URL](https://github.com/Ampixa/barnamala)
点击查看摘要
Abstract:We built a compact convolutional network (1.11 M parameters) for 46-class DHCD Devanagari recognition and reached 99.73%, the highest reported at 15.6x smaller than prior state-of-the-art. We have effectively reached the saturation point: every model tested, large teacher ensembles included, hits the same 11-error intrinsic floor. No configuration achieves a statistically clear win under exact McNemar tests with Wilson confidence intervals. Even without knowledge distillation, our student matches the nearest large-model baseline (17.32 M parameters; McNemar $p = 0.345$). Outside of DHCD, zero-shot on CMATERdb digits gives 76.6% and fine-tuning reaches 97.8%; corruption robustness is also far better than large baselines (mean corruption accuracy 75.7% vs. 38.7%). All artifacts are at this https URL.
31. 【2607.13685】DNA: Dual-stage Native Attribution for Generated Image Source Tracing
链接：https://arxiv.org/abs/2607.13685
作者：Chao Wang,Kejiang Chen,Zijin Yang,Yaofei Wang,Yuang Qi,Weiming Zhang,Nenghai Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：making source-model attribution, produced numerous within-family, making source-model, digital forensics, suspect images increasingly
备注： 18 pages
点击查看摘要
Abstract:The rapid evolution of image generation has produced numerous within-family variants, making source-model attribution of suspect images increasingly important for digital forensics. Existing proactive methods rely on watermark embedding or model modification, which may degrade visual quality and limit deployment flexibility. Passive methods often rely on large-scale supervised training or a single reconstruction signal, limiting their ability to handle unknown sources and distinguish highly similar within-family variants. We observe that attribution signals in latent generative models are naturally stratified across architectural levels: VAE-level cues reflect family-shared information, whereas backbone-level cues capture variant-specific behaviors. Motivated by this insight, we propose Dual-stage Native Attribution (DNA), a coarse-to-fine framework that follows this hierarchy without additional neural-network training. The coarse-grained stage uses Autoencoder Double-Reconstruction (AEDR) for efficient open-set family-level screening. The fine-grained stage performs closed-set model-level attribution with Native Prediction Consistency (NPC), which compares native prediction errors of within-family variants across multiple noise levels under semantic conditioning and attributes the source via normalized calibrated scores. To enable systematic evaluation, we construct DNA-30K, a benchmark for within-family variant attribution under open-set family-level evaluation. It comprises 30,000 images generated by 24 candidate models across six families spanning both denoising diffusion and flow matching, plus non-candidate generated and natural images as unknown sources. Experiments show that DNA achieves 89.11% end-to-end attribution accuracy on a task where random guessing accuracy is below 1% and outperforms the strongest baseline by 33.81% even when AEDR is used as the coarse-grained stage.
32. 【2607.13682】Calibrated Closed-Form Uncertainty for Radiative Gaussian Splatting in Sparse-View CT
链接：https://arxiv.org/abs/2607.13682
作者：Chulin Zhao,Yiran Xu,Shu Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing methods output, Radiative Gaussian splatting, equip radiative Gaussians, methods output point, output point estimates
备注： 19 pages, 6 figures. Equal contribution: Chulin Zhao and Yiran Xu.(Co-first authors) Corresponding author: Yiran Xu (2617300@dundee. [this http URL](http://ac.uk) )
点击查看摘要
Abstract:Radiative Gaussian splatting has made sparse-view CT reconstruction fast, but existing methods output point estimates with no notion of where the reconstruction can be trusted. We exploit a property of transmissive X-ray imaging that RGB splatting cannot claim -- projection and voxelization are strictly linear in the per-Gaussian densities -- to equip radiative Gaussians with a variational density posterior whose predictive variance propagates in closed form, exactly, in a single forward pass, in both volume space ($\sigma^2(x)=\sum_i g_i(x)^2 s_i^2$) and projection space ($\mathrm{Var}[I_p]=\sum_i w_{i,p}^2 s_i^2$). We present the first systematic calibration study for Gaussian-splatting CT (Spearman / AUSE / ECE with temperature scaling), showing that the resulting per-voxel uncertainty ranks true reconstruction error on 14 of 15 scenes of the official benchmark across three view budgets -- 9 of 15 additionally meeting our magnitude-calibration target after a single temperature -- while the perturbation-ensemble heuristic of concurrent work, transplanted to voxel space under the same protocol on our development scenes, does not (rank correlation as low as $-0.08$). We then dissect why uncalibrated acquisition scores can nevertheless select acceptable views, identifying three regimes -- flat (isotropic, balanced), pathological (degenerate coverage), and anisotropic -- and showing, in controlled single-scene testbeds, that principled uncertainty earns a measurable premium only in the last, motivating a coverage-gated, maturity-scheduled acquisition policy; the same calibrated posterior further points toward a dose-adaptive stopping rule, whose experimental validation we leave to future work.
33. 【2607.13681】owards Spatial Supersensing in the Wild
链接：https://arxiv.org/abs/2607.13681
作者：Tianjun Gu,Tianyu Xin,Kuan Zhang,Bowen Yang,Kok-Chung Chua,Peize Li,Xinran Zhang,Yupeng Chen,Qiyue Zhao,Qinlei Xie,Jianhang Liu,Yucheng Lu,Yinan Han,Marco Pavone,Yiming Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：continuous sensory streams, efficiently parse continuous, parse continuous sensory, grounds spatial reasoning, sensory streams
备注： Accepted to ECCV 2026. Project page: [this https URL](https://vsi-super-wild.github.io/)
点击查看摘要
Abstract:Humans can efficiently parse continuous sensory streams, from hours to years, scaffolding an internal world model that grounds spatial reasoning and prediction. To mimic this capacity, spatial supersensing challenges multimodal models to move beyond linguistic understanding toward true world modeling. However, their benchmark relies on synthetic long videos, formed by concatenating random short clips, and is mostly limited to household scenes, leaving real-world continuity and diversity underexplored. To address the gap, we introduce $\textbf{VSI-Super-Wild}$, a large-scale benchmark for evaluating spatial supersensing over long temporal horizons in diverse in-the-wild scenes. Notably, inspired by cognitive studies on how humans structure experience, we systematically probe the full triad of world state: the agent (observer), objects (scene items), and the environment (places and global layout). In total, VSI-Super-Wild contains $\textbf{6,980}$ human-verified question-answer pairs derived from $\textbf{442}$ real-world videos spanning 8 scene categories, including long-form recordings exceeding 4 hours. Results on VSI-Super-Wild expose a fundamental disconnect: despite advances in static image understanding, models consistently fail at tasks that require coherent world-state tracking over time. We characterize how performance degrades with world-state complexity and temporal horizon, and diagnose four failure modes: spatial collapse, semantic shortcuts, insufficient update, and instance confusion. This taxonomy reveals that models lack mechanisms to bind objects, agents, and environments into a unified spatial world model, a fundamental gap that defines the path forward for spatial supersensing.
34. 【2607.13674】WAVE-Stereo: Warp-Aligned Volume Encoding for Stereo Matching
链接：https://arxiv.org/abs/2607.13674
作者：Zehan Liu,Yage He,Xianwu Gong
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Existing iterative stereo, remain separately modeled, methods primarily adopt, Existing iterative, local residual refinement
备注：
点击查看摘要
Abstract:Existing iterative stereo matching methods primarily adopt two types of correspondence representation: explicit matching search via correlation volumes and local residual refinement via warped features, yet the two remain separately modeled. We propose WAVE-Stereo, built on a core insight: correlation volumes and feature warping provide complementary matching cues. \textbf{GeoWarp Correspondence Encoder (GWCE)} encodes matching search, residual alignment, and disparity prior in parallel at the ConvGRU input. To mitigate matching degradation in textureless regions, we propose \textbf{Periodic Global Context Propagation (PGCP)}, which propagates global spatial information in a periodic manner. On five real-world benchmarks -- Middlebury, ETH3D, KITTI 2012, KITTI 2015, and Booster -- WAVE-Stereo achieves competitive zero-shot generalization accuracy without any external foundation model prior, achieving 3.18\% D1-all on KITTI 2015, 4.42\% Bad-2.0 on Booster, and 66ms real-time inference, striking a favorable balance between accuracy and efficiency. Our code is available at this https URL.
35. 【2607.13669】Learning Speaker Identity Beyond Language and Modality Constraints: Insights from the POLY-SIM 2026 Challenge
链接：https://arxiv.org/abs/2607.13669
作者：Marta Moscati,Muhammad Saad Saeed,Marina Zanoni,Mubashir Noman,Rohan Kumar Das,Monorama Swain,Yassin Terraf,Yufang Hou,Elisabeth Andre,Khalid Mahmood Malik,Markus Schedl,Shah Nawaz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：homogeneous audio-visual modalities, systems typically assume, training and testing, typically assume, availability of complete
备注： Accepted at ACM MM 2026
点击查看摘要
Abstract:Multimodal speaker identification systems typically assume the availability of complete and homogeneous audio-visual modalities during both training and testing, and assume each speaker only speaks a single language. However, in real-world applications, such assumptions often do not hold. Visual or audio information may be missing due to occlusions, camera or microphone failures, or privacy constraints. Multilingual speakers introduce additional complexity due to linguistic variability across languages. These situations constitute substantial challenges for the robustness and generalization capabilities of multimodal speaker identification systems. Aim of the POLY-SIM 2026 challenge is to address these aspects of speaker identification and to provide a standardized setup for the comparison of the proposed solutions.
36. 【2607.13661】Fine-grained CLIP fine-tuning with self-annotated region alignment
链接：https://arxiv.org/abs/2607.13661
作者：Chenyang Zhao,Wei Lin,Antoni B. Chan,Janet H. Hsiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contrastive Language-Image Pre-training, Contrastive Language-Image, text description, fine-grained dense feature, Self-annotated Fine-grained Fine-tuning
备注：
点击查看摘要
Abstract:Contrastive Language-Image Pre-training (CLIP) has been shown to have limitations in its fine-grained dense feature representation, due to its pre-training focusing on matching the whole image to a text description. Considering the large data and computational burden in pre-training a vision-language model from scratch, a series of works aim to enhance the fine-grained ability of CLIP through a fine-tuning scheme. However, existing works suffer from a variety of limitations: additional region annotations are usually required, which limits the semantic diversity due to the predefined categories and leads to a large effort to process the training data; and they usually sacrifice CLIP's original ability for global visual representation. To bypass these limitations, we propose SFF-CLIP (Self-annotated Fine-grained Fine-tuning for CLIP), which only uses image-text pairs as input to boost the fine-grained representation ability in the CLIP fine-tuning, while maintaining the global visual-semantic consistency. Concretely, a run-time region-phrase alignment scheme is designed, which obtains concept phrases from the input sentence, and aligns them with corresponding extracted region-based features using text-specific heat maps. Extensive experiments demonstrate that SFF-CLIP leads to significant performance improvements on fine-grained dense feature representation, as well as maintaining the performance of the original CLIP on image-level tasks. Code will be released later.
37. 【2607.13656】FreeLit: Paired-Free Indoor Relighting via Physics-Guided Diffusion
链接：https://arxiv.org/abs/2607.13656
作者：Chi-En Yen,Duy-Khanh Ngo,Wen-Wei Tang,Huu-Phu Do,Wen-Hsiao Peng,Ching-Chun Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, Image-based indoor scene, requiring precise modeling, Image-based indoor, light position
备注： Accepted to ACM Multimedia (ACM MM) 2026. This is the accepted manuscript prior to publication
点击查看摘要
Abstract:Image-based indoor scene relighting remains challenging due to the complex interplay between cluttered geometry and local illumination, requiring precise modeling of light position, color, and intensity. Existing data-driven methods implicitly learn this relationship via paired multi-illumination datasets. Nevertheless, this data is costly and fails to scale, which is essential for accurate light-source-level control. Conversely, inverse-rendering methods reduce the data dependency by incorporating physical priors; however, they lack the robustness of intrinsic estimation in challenging conditions. In this paper, we present FreeLit, a paired-free framework for controllable indoor relighting that explicitly manipulates light-source location, color, and intensity. Instead of relying on paired supervision, we construct a physics-guided illumination prior from intrinsic scene properties, generating a structured lightmap along with a pseudo-relit image to guide diffusion-based synthesis. To address instability in intrinsic estimation, especially in low-light scenes, we introduce a relighting-guided intrinsic stabilization strategy that enforces illumination-invariant reflectance through structure-aware distillation and consistency constraints. Furthermore, we propose controllability-oriented evaluation metrics to quantify alignment with user-specified illumination color and intensity. Experimental results demonstrate that FreeLit achieves stable, physically consistent, and controllable relighting, with improved robustness in low-light indoor scenes, without requiring paired supervision.
Comments:
Accepted to ACM Multimedia (ACM MM) 2026. This is the accepted manuscript prior to publication
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.13656 [cs.CV]
(or
arXiv:2607.13656v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.13656
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
38. 【2607.13654】3HG-Editor: Text-driven 3D Human Garment Editing with Body Priors Embedded in SMPL-X
链接：https://arxiv.org/abs/2607.13654
作者：Shaoru Sun,Xingtao Wang,Zihan Ma,Wenrui Li,Jiantao Zhou,Debin Zhao,Xiaopeng Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains largely underexplored, editing remains largely, garment, Gaussians, substantial progress
备注： 9 pages, 7 figures, 2 tables
点击查看摘要
Abstract:While 3D Gaussian Editing (3DGE) has seen substantial progress, text-driven 3D human garment editing remains largely underexplored. Existing 3DGE works typically follow a paradigm that applies 2D editing techniques to multi-view rendered images and updates 3D Gaussians based on the modified images. Extending such methods to 3D human garment editing suffers from low-fidelity outcomes, caused by introduced distortions and garment inconsistencies. A promising breakthrough opportunity arises from the SMPL eXpressive (SMPL-X) model that embodies rich prior information for virtual humans. Motivated by this insight, we propose a text-driven 3D human garment editor termed T3HG-Editor, which delivers high-fidelity and garment consistent results by leveraging geometry and joint priors embedded in SMPL-X. Specifically, T3HG-Editor contains three stages, namely obtainment of editable Gaussians, garment consistent editing, and Gaussian updating with overflow pruning. The obtainment of editable Gaussians begins with seeding Gaussians along SMPL-X normals to generate sufficient near surface Gaussians, followed by a 2D mask constraint that precisely localizes the target Gaussians to be edited. The garment consistent editing aggregates tokens corresponding to the same SMPL-X vertex across multiple views and propagates them to their original views, enforcing garment consistency without requiring additional training. Gaussian updating with overflow pruning employs a Signed Distance Function (SDF) defined on SMPL-X to construct a human distance field, which is then integrated with a 2D semantic mask to prune overflowing Gaussians, thus preventing contamination of non-target regions. Experiments on multiple subjects and diverse garment types demonstrate that T3HG-Editor outperforms state-of-the-art methods in both editing quality and garment consistency.
39. 【2607.13653】Exploratory, Communicative, and Deployable: Vision-Driven Embodied Agents for Open-World Mobile Manipulation
链接：https://arxiv.org/abs/2607.13653
作者：Boyu Mi,Mengchen Ma,Yifei Yao,Xing Gao,Junting Chen,Yangzi Li,Zihou Zhu,Guohao Li,Zhenfei Yin,Tai Wang,Yao Mu,Jiangmiao Pang,Hanqing Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：embodied agents requires, interactive intent disambiguation, visual grounding, requires active exploration, agents requires active
备注： Accepted to ECCV 2026. 57 pages. Code available at [this https URL](https://github.com/InternRobotics/REAL)
点击查看摘要
Abstract:Real-world deployment of embodied agents requires active exploration, visual grounding, and interactive intent disambiguation. However, existing frameworks often rely on privileged simulator states or assume complete instructions, bypassing realistic deployment challenges. To bridge this gap, we present REAL, an agentic framework for open-world mobile manipulation. REAL establishes sim-to-real-consistent environment APIs without oracle perception and integrates a simulated user to enable human-in-the-loop interaction. Within this environment, we design diverse task compositions to drive data collection, supervised fine-tuning, and online reinforcement learning, systematically optimizing agent performance. To comprehensively evaluate this approach, we introduce REAL-Bench, a benchmark spanning 241 tasks across active exploration, visual distraction, articulated manipulation, and interactive disambiguation. Experimental results demonstrate that our trained agent outperforms leading commercial closed-source VLMs on interactive tasks with a 56.9% success rate. Further empirical analysis reveals that our hierarchical training pipeline successfully aligns the model's tool-use capabilities while maintaining robust open-vocabulary reasoning under extended exploration horizons. Finally, we deploy and evaluate our framework on a physical dual-arm mobile robot, where it achieves a 78.3% end-to-end success rate over 60 real-world episodes. These physical trials demonstrate robust zero-shot transferability to unseen household scenarios, validating that our sim-to-real-consistent design successfully bridges the reality gap for long-horizon mobile manipulation. Code is available at this https URL.
Comments:
Accepted to ECCV 2026. 57 pages. Code available at this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
Cite as:
arXiv:2607.13653 [cs.CV]
(or
arXiv:2607.13653v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.13653
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
40. 【2607.13651】From Surface Forecasting to Observability Forecasting: A Latent World Model for Cloud-Aware EO Monitoring
链接：https://arxiv.org/abs/2607.13651
作者：Mohanad Albughdadi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Observation processing chains, Earth Observation processing, Earth Observation, Earth Observation sequences, cloud-aware Earth Observation
备注：
点击查看摘要
Abstract:The bottleneck of Earth Observation processing chains is not the arrival of new imagery but whether the surface is actually visible when the image arrives. We study this as an observability forecasting problem on EarthNet2021. Given recent multispectral imagery and exogenous weather drivers, the goal is to predict whether the next acquisition will be usable and, if not, when a usable view is likely to return. To do this, we adapt LeWorldModel, a joint-embedding predictive architecture world model, to cloud-aware Earth Observation sequences. The final pipeline converts raw minicubes into episodic HDF5 sequences with five image channels (blue, green, red, near-infrared, cloud mask) and eight meteorological and calendar covariates. The resulting model has 18.0M trainable parameters and is trained from scratch on 23,904 training episodes. The trained leWorldModel is evaluated under a locked protocol: linear probes are fit on train only, calibration choices are set on an internal validation split, and the fitted heads are then frozen for valsplit, IID, OOD, and extreme evaluation. On the full frozen-bundle observability benchmark, LeWorldModel consistently outperforms persistence. For next-step usability, balanced accuracy ranges from 0.769 to 0.887, compared with 0.493 to 0.556 for persistence. For exact first-usable-horizon prediction, accuracy ranges from 0.602 to 0.806, compared with 0.120 to 0.369 for persistence. Against a frozen LightGBM baseline fit on the same training windows, LeWorldModel is better on continuous clear/cloud regression and on exact recovery timing on valsplit, IID, and extreme, while LightGBM is stronger on the simpler binary any-usable-within-six task and is more robust on OOD. In separate sampled diagnostic analyses, LeWM also produces strong ranking-based anomaly signals under synthetic temporal inconsistencies.
41. 【2607.13647】Beyond Color Geometry: Evaluating Human-Like Color Representations in Vision Models
链接：https://arxiv.org/abs/2607.13647
作者：Ayan Igali,Pakizar Shamoi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：color, graded, Vision Transformer encoders, Abstract, Vision Transformer
备注： 6 pages, 5 figures, 2 tables submitted to 2026 Joint 14th International Conference on Soft Computing and Intelligent Systems and 27th International Symposium on Advanced Intelligent Systems (SCISISIS 2026)
点击查看摘要
Abstract:Do vision models see colors the way humans do? Existing evaluations of color representations usually compare them with geometric spaces such as CIELAB or with discrete color labels. These references capture perceptual distance or category membership, but not the graded way in which people organize colors. We evaluate color grounding against a fuzzy perceptual model with 86 graded categories fitted to human survey data. The framework can be applied to any image encoder and measures three complementary properties: category boundaries, category compactness, and graded alignment beyond what color geometry alone can explain. Across eleven Vision Transformer encoders, the category-level results are broadly similar, whereas graded alignment differs substantially. Masked Autoencoders achieve the strongest beyond-geometry alignment, with confidence intervals that do not overlap those of the other encoders. A layer-wise analysis further shows that masked reconstruction preserves this structure toward the output. On natural images, MAE represents surface color globally, while language-supervised models encode color more strongly in relation to the foreground object. These results show that human-like color grounding has several distinct aspects that should not be reduced to a single score.
42. 【2607.13646】Human4K: A Large-Scale 4K Multi-View Mocap Dataset for Whole-Body 3D Human Reconstruction
链接：https://arxiv.org/abs/2607.13646
作者：Tianshun Han,Ziyu Shi,Lijian Liu,Ajian Liu,Benjia Zhou,Hugo Jair Escalante,Yanyan Liang,Sergio Escalera,Zhen Lei,Jun Wan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：challenging real-world scenarios, Recent advances, improved overall performance, real-world scenarios, current models
备注：
点击查看摘要
Abstract:Recent advances in 3D human reconstruction have improved overall performance, yet current models still fail in the most challenging real-world scenarios. They often produce unstable geometry, inaccurate limb articulation and unreliable predictions under depth ambiguity or self-occlusion. A key reason is that existing datasets still lack the combination of high-resolution images, high-precision annotations and diverse whole-body motions required to support robust reconstruction. To address this gap, we present Human4K, a large-scale 4K multi-view whole-body human reconstruction dataset with mocap-accurate SMPL-X annotations. Human4K contains over six million 4K images captured by an eight-view high-resolution camera system synchronized with a professional Vicon motion capture setup, covering 11 subjects performing complex, highly articulated and strongly self-occluded full-body motions. All sequences are processed by a Motion-Retargeting and Refinement Module (MRRM) to ensure precise alignment for the full body and extremities. Experimental results show that training with Human4K consistently improves whole-body reconstruction on standard benchmarks, with particularly large gains for hands, feet and depth-ambiguous limb configurations.
43. 【2607.13639】OvisOCR2 Technical Report
链接：https://arxiv.org/abs/2607.13639
作者：Shiyin Lu,Yinglun Li,Yu Xia,Yuhui Chen,An-Yang Ji,Jun-Peng Jiang,Qing-Guo Chen,Jianshan Zhao,En Lin,Haijun Li,Cheng Qin,Zhao Xu,Weihua Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：document parsing, document page image, document, document parsing model, Markdown
备注：
点击查看摘要
Abstract:We introduce OvisOCR2, a 0.8B document parsing model. OvisOCR2 is designed as an end-to-end parser: given a document page image, it generates a Markdown representation in natural reading order, covering text, formulas, tables, and visual regions. We build a data engine that combines filtered real-document annotations with synthetic pages whose rendered images and Markdown targets are derived from the same HTML source. The training recipe includes supervised fine-tuning, reinforcement learning on a 4B branch with a multi-component reward design, on-policy distillation into the 0.8B model, and model fusion. On OmniDocBench v1.6, OvisOCR2 achieves a state-of-the-art overall score of 96.58, placing an end-to-end model at the top of this leaderboard previously dominated by pipeline methods and highlighting the potential of end-to-end document parsing. On PureDocBench, OvisOCR2 also achieves the highest Avg3 score of 75.06. Beyond these two public benchmarks, we evaluate OvisOCR2 on an in-house benchmark designed to cover a broader set of long-tail and challenging scenarios. OvisOCR2 obtains the best overall performance among the compared methods, providing further evidence of its generalization and robustness. OvisOCR2 is available at this https URL.
44. 【2607.13613】FastCentNN: Accelerating Centroid Neural Network with Entropy Proxy
链接：https://arxiv.org/abs/2607.13613
作者：Le-Anh Tran
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：strict local stabilization, Centroid neural network, prolonged low-movement training, low-movement training phases, unsupervised competitive learning
备注： 4 pages, 2 figures
点击查看摘要
Abstract:Centroid neural network (CentNN) is an unsupervised competitive learning algorithm in which centroid splitting is triggered only after strict local stabilization, often leading to prolonged low-movement training phases before model expansion. This report proposes FastCentNN, an accelerated variant that addresses this inefficiency by introducing an early splitting strategy based on the total centroid movement per epoch, which serves as a training entropy proxy. As a result, FastCentNN reduces unnecessary reassignment epochs while preserving the original winner-loser learning dynamics. FastCentNN supports both absolute and stage-relative movement thresholds, allowing the splitting criterion to remain either fixed or adaptive throughout training. Experiments on some benchmark datasets show that FastCentNN consistently achieves clustering quality comparable to CentNN while reducing runtime by up to 16% on synthetic 2D datasets and about 5% on high-dimensional datasets. FastCentNN therefore provides a practical and efficient drop-in replacement for CentNN, retaining its online adaptive learning behavior while offering a simple and interpretable speed-stability trade-off through configurable splitting thresholds.
45. 【2607.13597】Semantic Anchoring for Robotic Action Representations
链接：https://arxiv.org/abs/2607.13597
作者：Yuan Xu,Youheng Shi,Chengyang Li,Wentao Zhu,Yizhou Wang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：models inherit rich, limited robot demonstrations, robot demonstrations degrades, inherit rich semantic, pretrained Vision-Language Models
备注：
点击查看摘要
Abstract:Vision-Language-Action (VLA) models inherit rich semantic representations from pretrained Vision-Language Models, yet fine-tuning on limited robot demonstrations degrades this structure and undermines generalization. A fundamental question therefore arises: what constitutes a good action representation? Inspired by the mirror neuron theory's insight that observation and execution share an intention-level encoding, we examine whether a robot's action representations preserve the semantic structure captured by pretrained encoders. Systematic probing confirms that this structure erodes during finetuning, and that its quality synchronizes with both task success and out-of-distribution generalization. We further introduce a plug-and-play method that anchors action representations to a semantic manifold while decomposing representations into a shared semantic channel and a private channel, all discarded at inference, leaving the deployed model unchanged. Validated on different VLA backbones across simulation and real-world benchmarks, our method yields up to +18.7% on real-world in-distribution tasks and +21.5% on out-of-distribution generalization.
46. 【2607.13586】UniPhysGen: Unified Physical Grounding for Simulation-Ready 3D Assets
链接：https://arxiv.org/abs/2607.13586
作者：Xian Li,Rong Wei,Lujie Yang,Haolin Huang,Junyuan Fang,Siliang Tang,Jun Xiao,Rui Tang,Juncheng Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：physical, increasingly important, important for embodied, unified physical, intrinsic physical properties
备注： 39 pages, 12 figures
点击查看摘要
Abstract:Physically grounded 3D assets are increasingly important for embodied AI and robotic simulation. However, most existing 3D assets lack unified physical semantics, including articulation semantics and intrinsic physical properties, required for realistic interaction. Current approaches either treat these semantics independently or rely on canonicalized object structures, limiting robustness across heterogeneous 3D assets. We present UniPhys, a scalable framework for automatically transforming raw 3D assets into simulation-ready assets with unified physical semantics. Based on UniPhys, we construct UniPhys-40K, a large-scale physically grounded dataset, together with UniPhys-Bench, a carefully verified benchmark for unified physical grounding evaluation. We further introduce UniPhysGen, a unified physical grounding model that jointly reasons over articulation semantics and intrinsic physical properties. UniPhysGen incorporates geometry-robust articulation grounding to mitigate geometric shortcut bias under heterogeneous part decompositions. Extensive experiments demonstrate state-of-the-art performance across articulation grounding and intrinsic physical property estimation tasks, while the resulting assets can be directly deployed in robotic simulation environments for realistic physical interaction. Our code and dataset will be available at this https URL.
47. 【2607.13584】Visual Place Recognition Using Rate-Encoded Spiking Neural Networks with Discrete STDP Learning
链接：https://arxiv.org/abs/2607.13584
作者：Altzi Tsanko,Oikonomou Katerina Maria,Antonios Gasteratos
类目：Neural and Evolutionary Computing (cs.NE); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Spiking Neural Networks, Spiking Neural, loop closure problems, visual loop closure, Neural Networks
备注：
点击查看摘要
Abstract:Spiking Neural Networks (SNNs) trained through unsupervised Spike-Timing-Dependent Plasticity (STDP) have been explored as solutions to visual loop closure problems, driven by the prospect of efficient on-device inference on neuromorphic devices. State-of-the-art STDP-based models deliver high classification accuracy but fail to reach the high Recall at 100% Precision (R@100P) needed for reliable autonomous navigation. We present a discrete, tensor-native implementation of the STDP-based SNN-VPR pipeline using PyTorch with snnTorch and evaluate it on a 100-place Nordland dataset using 15 independently-trained networks. The contribution of three decisions in the implementation is investigated. First, we show how to perform neuron assignment with a closed-form, deterministic tensor pipeline and show that it provides significantly higher R@100P than a standard argmax procedure. However, some of this gain comes from implementation differences compared to prior continuous-time models, which we measure independently. Second, ablation in isolation shows that state reset after each query helps improve R@100P regardless of the way neurons are assigned. Third, velocity-compensated sliding window aggregation over k consecutive frames reaches R@100P = 100.00% at k = 5 for constant-velocity traversal and an additional 0.20 ms latency. Taken together, these findings show the impact of inference stage design decisions in STDP-based SNN-VPR on recall precision, although the separate contribution of each mechanism and implementation differences is only partially disentangled and needs further examination.
48. 【2607.13569】GHR-VLM: Making Zero-Shot Transit Video Analytics Realizable with Grounded Hybrid Reasoning
链接：https://arxiv.org/abs/2607.13569
作者：Kaicong Huang,Weiheng Oh,Ruimin Ke
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Transit video understanding, provide valuable fine-grained, valuable fine-grained data, conventional passenger counters, Transit video
备注：
点击查看摘要
Abstract:Transit video understanding can provide valuable fine-grained data that conventional passenger counters and fare systems cannot capture. However, supervised video models require task-specific annotations, while applying vision-language models (VLMs) directly to long onboard videos is unreliable and costly. To leverage the complementary strengths of both approaches, we propose GHR-VLM, a visual grounded hybrid reasoning framework for zero-shot transit-bus video analytics. It is motivated by the observation that explicit visual grounding can improve VLM reasoning by converting long surveillance streams into compact, passenger-centered spatiotemporal evidence. Specifically, we propose an edge-cloud design in which a lightweight edge-based monitor continuously tracks door status and segments passenger clips. A backend VLM then identifies boarding passengers and classifies payment behavior through a two-stage coarse-to-fine refinement of spatiotemporal evidence. By invoking the VLM only on grounded passenger clips and contact sheets, GHR-VLM reduces cloud inference, avoids payment-specific training data, and supplies the localized evidence that VLMs otherwise struggle to identify. Evaluation on 486 minutes of real-world bus surveillance video demonstrates the potential of grounded edge-cloud reasoning for passenger-level payment analytics while highlighting the challenges posed by degraded video conditions.
49. 【2607.13563】Nexus: Native Mesh Generation with Diffusion
链接：https://arxiv.org/abs/2607.13563
作者：Hanxiao Wang,Ying-Tian Liu,Yuan-Chen Guo,Qi-Yuan Feng,Zi-Xin Zou,Ding Liang,Biao Zhang,Yan-Pei Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating high-quality triangle, high-quality triangle meshes, Generating high-quality, essential for film, high-quality triangle
备注：
点击查看摘要
Abstract:Generating high-quality triangle meshes is essential for film, gaming, and interactive 3D applications. Mainstream methods rely on mesh serialization and autoregressive processes, which stuggles in effective inference and is sensitive to error accumulation. In this paper, we present Nexus, a diffusion method that achieves holistic mesh generation via decoupled vertex and topology generation. First, we view mesh vertices as sparse voxels organized as an octree and adopt a diffusion model to generate the vertices in a coarse-to-fine manner. Second, for topology modeling, we propose Spacetime Interval, as an extension of Spacetime Distance to encode arbitrary edge and face topology into continuous per-vertex embeddings. It allows for a global and efficient recovery of complex topology. We then employ a diffusion model to generate the continuous embeddings on the generated vertices. Extensive experiments on the Objaverse and Toys4K datasets and in-the-wild images demonstrate that our method outperforms state-of-the-art autoregressive and two-stage baselines, effectively circumventing the inherent limitations of sequential mesh modeling. A blind user study from 3D practitioners confirms strong perceptual preference for our results.
50. 【2607.13539】hinkBLOX: 3D Indoor Scene Generation with Progressive Reasoning
链接：https://arxiv.org/abs/2607.13539
作者：Yuan Xiao,Can Wang,Xiangyu Kong,Jing Liao
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：based generators predominantly, traditional graphics methods, generators predominantly adopt, indoor scenes autoregressively, recent vision-language model
备注： 20 pages
点击查看摘要
Abstract:While traditional graphics methods often synthesize 3D indoor scenes autoregressively or hierarchically, recent vision-language model (VLM)-based generators predominantly adopt a one-shot paradigm where the full layout is planned at once. This one-shot approach often requires global re-optimization or complete reconstruction during interactive editing (e.g., inserting or moving objects) and can lead to physically or semantically poorly organized arrangements. To address these challenges, we propose ThinkBLOX, a VLM-based progressive reasoning framework that iteratively designs and refines 3D scenes. ThinkBLOX treats layout generation as a state-conditioned, step-by-step reasoningand-action process. To power this, we construct the ThinkBLOX-Data-200K dataset, containing 224,757 procedural placement pairs annotated with multi-view scene context, explicit Chain-of-Thought (CoT) rationales, and structured JSON layouts. Through supervised fine-tuning (SFT) on this dataset, the VLM learns to bridge the reasoning-action gap under incremental updates. Furthermore, recognizing that scene synthesis is inherently a multisolution task where SFT suffers from reward conflict, we introduce Tier-Decoupled GDPO. This reinforcement learning scheme organizes heterogeneous rewards into distinct tiers, stabilizing policy optimization across physical validity, semantic plausibility, and reasoning-action consistency. Extensive experiments show that ThinkBLOX significantly outperforms recent one-shot and iterative baselines in physical plausibility, semantic alignment, and interactive editability. Additionally, we show that it supports diverse applications, including both global and local generation and rearrangement of 3D scenes.
51. 【2607.13527】VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generation
链接：https://arxiv.org/abs/2607.13527
作者：Songyu Xu,Xin Wang,Qiang Chen,Xinran Wang,Muxi Diao,Yuxuan Zhang,Kongming Liang,Rui Lin,Zhanyu Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains insufficiently evaluated, made substantial progress, Recent video generation, compositional instructions remains, instructions remains insufficiently
备注： Accepted by PRCV2026
点击查看摘要
Abstract:Recent video generation models (VGMs) have made substantial progress in visual fidelity, yet their ability to follow long, compositional instructions remains insufficiently evaluated. Existing evaluation protocols often rely on prompts that are short and semantically shallow, with limited atomic constraints and weak spatio-temporal dependencies. They also frequently depend on costly human evaluation or handcrafted vision pipelines, while providing little diagnostic insight into which instruction constraints succeed or fail. To address this gap, we propose VGIF-Score, a highly automated and interpretable framework for evaluating instruction following in video generation. VGIF-Score consists of two complementary components: an objective completion branch that parses prompts into a Spatio-Temporal Directed Acyclic Graph (ST-DAG) and performs dependency-aware QA with short-circuit diagnostics, and a subjective satisfaction branch that uses instruction-conditioned AutoRubric to assess cinematography, visual purity, motion smoothness, and physics adherence. Together, these components produce a unified score that captures both objective completion and perceptual satisfaction. We instantiate this framework on VGIF-Bench, a benchmark of 223 long, structurally entangled prompts paired with approximately 4.3K fine-grained evaluation items. Experiments on 14 proprietary and open-source VGMs across more than 3K generated videos show that VGIF-Score provides reliable, interpretable, and diagnostically useful evaluation of video generation instruction following. The code will be available at this https URL.
52. 【2607.13522】Kepler-Encoder-v0.1: Towards a Multimodal Embedding Model for Robots
链接：https://arxiv.org/abs/2607.13522
作者：Ishneet Sukhvinder Singh,Dhanoosh Pooranakumaran,Alex Nguyen,Jia Qi Yip
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Force, state, latent, robot, single
备注： 33 pages
点击查看摘要
Abstract:A robot must understand the state of its own body, but a camera sees only part of it. Force and contact leave almost no trace in a single frame, and raw vision features read force at $R^2$ at or below $0.10$ on every robot we test. We present Kepler-Encoder-v0.1, a robot-first multimodal encoder that treats robot state as a modality and fuses vision, proprioception, and force/torque into a single shared latent with a learned-query cross-attention layer, trained self-supervised by masked cross-modal prediction under the LeJEPA/SIGReg objective. At evaluation only vision enters, which poses a sharp question. Does fusing state into training make the vision-only latent carry anything the pixels do not already contain? On the RH20T corpus the answer is yes, precisely where the camera is weakest. On held-out scenes, the vision-only latent recovers end-effector state, and force in particular, significantly above both raw frozen-ViT features and a compute-matched vision-only control on every sensored robot, though absolute force recovery at a single timestep is modest; on motor state, which the camera largely sees, it is statistically tied with the strongest vision baselines, and it is the only feature whose latent geometry tracks state. A single embodiment-agnostic encoder covers four robots, and a data-matched control shows this breadth reflects embodiment diversity rather than data volume. The frozen latent is directly useful. Its own cross-modal prediction error is a training-free invalid-state monitor (AUROC $0.90$ on out-of-range states, $0.69$ on scene-swapped states), and a diffusion decoder (PixNerd) reconstructs the camera frame from the latent, confirming the spatial compression preserves world-state. This report validates the single-timestep case; native-rate temporal fusion is the next step.
53. 【2607.13515】DriveFace: A Cross-Spectral Through-Glass Face Dataset for On-the-Move Vehicular Border Control
链接：https://arxiv.org/abs/2607.13515
作者：Anjith George,Luis Luevano,Alain Komaty,Zeina Al Amine,Vidit Vidit,Sebastien Marcel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：border control infrastructures, cross-border mobility places, mobility places increasing, places increasing pressure, identified directly inside
备注： Accepted in IJCB 2026
点击查看摘要
Abstract:The continuous growth in cross-border mobility places increasing pressure on existing border control infrastructures, motivating on-the-move biometric authentication, in which travellers are identified directly inside their vehicles at checkpoints. Face recognition is well-suited to this setting, as it can be acquired passively and at a distance. Its development, however, is hindered by the lack of representative datasets: existing benchmarks are collected in controlled environments and do not capture the challenges inherent to vehicular acquisition, including motion blur, variable illumination, occlusions, and cross-spectral enrollment. To address this gap, we introduce a dataset for on-the-move face recognition in border-control scenarios, comprising NIR vehicle-crossing videos paired with smartphone-based pre-enrollment data. Baseline evaluations with state-of-the-art models show clear performance limitations under these realistic conditions, highlighting the need for dedicated methods to advance the field.
54. 【2607.13506】RACE-PCa: Predicting Prostate Cancer Progression from Longitudinal MRI During Active Surveillance
链接：https://arxiv.org/abs/2607.13506
作者：Hongye Zeng,Shreeram Athreya,Dingyuan Dai,Steve Raman,Leonard Marks,William Speier,Corey Arnold
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：favorable-risk prostate cancer, current protocols rely, Active surveillance, scheduled repeat biopsies, prostate cancer
备注： 7 pages, 4 figures
点击查看摘要
Abstract:Active surveillance (AS) is the preferred strategy for favorable-risk prostate cancer, yet current protocols rely on scheduled repeat biopsies, most of which reveal no progression and are unnecessary. Existing risk-stratification tools operate on single time-point imaging or depend on explicit lesion segmentation, limiting their ability to capture longitudinal change and excluding patients without an MRI-visible lesion. In this study, we propose an end-to-end temporal and multimodal model for predicting pathological progression during AS without lesion segmentation. We encode each serial scan with a pretrained 3D MRI foundation model and introduce a temporal attention gate that recalibrates the multi-visit features to amplify focal imaging changes associated with progression. The gated imaging representation is then fused with clinical variables in a multimodal framework to estimate the probability of progression. Validated on a longitudinal AS cohort, our approach consistently outperforms competing baselines and performs comparably to the radiologist assessment representing current clinical practice. It maintains high negative predictive value while achieving higher positive predictive value, demonstrating its potential to safely reduce unnecessary biopsies during surveillance.
55. 【2607.13504】DP-BOA: Dirichlet-Process Birth-or-Assign for On-the-Fly Category Discovery
链接：https://arxiv.org/abs/2607.13504
作者：Peiyan Gu,Zixin Teng,Xuming He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：discovery requires deciding, requires deciding, category, existing, online Dirichlet-process Gaussian
备注： Accepted at ECCV 2026
点击查看摘要
Abstract:On-the-fly category discovery requires deciding for each incoming test sample whether to assign it to an existing category or spawn a new one. Existing methods typically implement this decision through matching-based heuristics, such as radius- or hash-based rules. While effective in practice, these methods usually treat category birth implicitly as a fallback when no existing category matches confidently, rather than as an explicit alternative supported by its own statistical evidence. To address this, we propose DP-BOA, a posterior-predictive decision framework based on an online Dirichlet-process Gaussian mixture model with a Normal-Inverse-Wishart prior. During training, we use labeled data to calibrate a shared NIW prior over category Gaussians and warm-start the known-category posteriors. At test time, for each incoming sample, DP-BOA compares the posterior predictive evidence for assignment to existing categories against the evidence for spawning a new category induced by the DP prior, and then updates category statistics online after the decision. The method captures anisotropic category geometry and naturally adapts decision confidence as evidence accumulates. Across standard OCD benchmarks, DP-BOA consistently outperforms strong baselines and delivers particularly strong novel-class discovery performance while maintaining competitive known-class accuracy.
56. 【2607.13500】Attention-Free and Lightweight Token Reduction for Efficient Vision-Language Models
链接：https://arxiv.org/abs/2607.13500
作者：Xuanyi Hao,Zuoyuan Zhang,Zhibo Wang,Xiaoyi Pang,Jiahui Hu,Jiacheng Du,Shuguo Zhuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：resource-constrained edge devices, edge devices due, substantial computational overhead, Vision-Language Models, processing numerous visual
备注： This work has been submitted to the IEEE for possible publication
点击查看摘要
Abstract:Vision-Language Models (VLMs) have achieved strong performance in multimodal understanding, yet remain challenging to deploy on resource-constrained edge devices due to the substantial computational overhead of processing numerous visual tokens. Token reduction is a promising direction for accelerating VLMs inference, but existing approaches either rely on attention maps that are incompatible with modern acceleration frameworks or depend on computationally intensive pairwise similarity comparisons, which undermine scalability and negate their practical benefits in deployment. In this paper, we propose an attention-free and lightweight token reduction framework as a plug-and-play module for VLMs, which preserves both important and diverse tokens to produce a compact visual representation. First, to enable attention-free importance estimation, we adopt an information-theoretic perspective and quantify token information using a novel entropy-based criterion, retaining those with more expressive and less degenerate feature representations. Second, to ensure diverse visual coverage in a lightweight manner, we introduce a transformation-induced consistency signal where similar tokens yield similar signals, such that sorting by this signal places similar tokens close to each other and enables stride-based selection to produce a diverse token set. Extensive experiments across multiple VLMs benchmarks demonstrate that our framework achieves a favorable accuracy-efficiency trade-off, maintaining competitive performance under aggressive compression.
57. 【2607.13499】M2P-AD: Memory-to-Prototype Learning with Boundary-aware Score Refinement for 3D Anomaly Detection
链接：https://arxiv.org/abs/2607.13499
作者：Seyoung Jeong,Jong Pil Yun,Sang Jun Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：important research topic, anomaly detection, anomaly, false positives, object boundaries
备注： 16 pages, 6 figures
点击查看摘要
Abstract:3D anomaly detection has recently emerged as an important research topic in computer vision. Although existing methods have achieved high performance, excessive anomaly responses in normal regions and false positives near object boundaries remain unresolved challenges. To address these challenges, we propose a novel 3D anomaly detection model, Memory-to-Prototype Anomaly Detection (M2P-AD), which effectively models the distribution of normal features while suppressing excessive anomaly scores in normal regions and false positives near object boundaries. Specifically, we introduce a Memory-to-Prototype (M2P) module that learns representative prototypes from normal feature embeddings to preserve important structural information of objects. In addition, a Boundary extraction (BE) module is integrated to identify object boundaries, and a Boundary-aware score refinement (BSR) strategy is applied to recalibrate anomaly scores by incorporating boundary characteristics. The proposed method is evaluated on Real3D-AD, Anomaly-ShapeNet, and MulSen-AD, achieving state-of-the-art performance. Qualitative results demonstrate that excessive anomaly scores in normal regions are reduced and false positives near object boundaries are suppressed, resulting in more accurate and stable anomaly localization. The results indicate that the proposed approach enables more reliable 3D anomaly detection and provides a robust solution applicable to real-world industrial environments.
58. 【2607.13492】CASA-SDF: Curriculum-Aware Spatial Adaptation with Curvature-Guided Density for Neural Implicit Surface Reconstruction
链接：https://arxiv.org/abs/2607.13492
作者：Lei Yang,Weiqing Li,Zhiyong Su,Liang Xiao
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Neural implicit representations, Neural implicit, powerful paradigm, Neural, Adaptive Density Transformation
备注：
点击查看摘要
Abstract:Neural implicit representations have emerged as a powerful paradigm for 3D reconstruction. However, high-fidelity indoor surface reconstruction remains a significant challenge, primarily due to the pronounced \emph{geometric heterogeneity} of indoor scenes. Large texture-less planar regions typically require stronger regularization to suppress high-frequency artifacts, while thin structures demand sharper, more adaptive representations to mitigate the spectral bias of multi-layer perceptrons (MLPs) and prevent over-smoothing. Existing approaches often rely on spatially indiscriminate prior supervision and a scene-global SDF-to-density transformation, which constrains their ability to balance planar smoothness and detail preservation. In this paper, we propose CASA-SDF (Curriculum-Aware Spatial Adaptation for SDF), a unified framework that addresses this challenge via complementary adaptations of supervision and representation capacity. Specifically, Hybrid Spatially-Adaptive Uncertainty Annealing (SAUA) fuses semantic and photometric uncertainties to construct a pixel-wise curriculum for monocular prior supervision. This strategy maintains regularization in reliable regions while attenuating unreliable supervision early in training to enable data-driven photometric refinement. Meanwhile, Curvature-Aware Locally Adaptive Density Transformation (CALADT) progressively modulates the sharpness of the SDF-to-density mapping via a curvature proxy to enhance the representation of thin structures. Extensive experiments on benchmark indoor datasets demonstrate that CASA-SDF improves surface completeness and detail recovery on high-frequency structures, without compromising the stability of planar surfaces.
59. 【2607.13481】GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors
链接：https://arxiv.org/abs/2607.13481
作者：Changqing Zhou,Yueru Luo,Yulan Guo,Bing Wang,Jie Qin,Changhao Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous driving, understanding is fundamental, fundamental to embodied, embodied intelligence, intelligence and autonomous
备注：
点击查看摘要
Abstract:Accurate 3D scene understanding is fundamental to embodied intelligence and autonomous driving, where 3D occupancy provides a unified representation of objects, structures, and free space. However, recovering such a complete volumetric representation from visual observations remains challenging, particularly in occluded and unobserved regions. Visual geometry priors offer strong and generalizable geometric cues for addressing this challenge, but their outputs are inherently surface-centric, whereas occupancy prediction requires reasoning about volumetric interiors and free space. To bridge this gap, we introduce GPOcc, which transforms visual geometry priors into occupancy-aware sparse Gaussian representations for efficient and expressive volumetric scene modeling. Building on GPOcc, GPOcc++ models multi-view observations and temporal sequences within a unified framework, allowing spatial and temporal evidence to be handled through the same representation. We further extend GPOcc++ from indoor scenes to outdoor occupancy prediction. Extensive experiments on both indoor and outdoor benchmarks demonstrate consistently strong performance across both multi-view and temporal settings, together with favorable efficiency and generalization. Code will be released at this https URL.
60. 【2607.13472】EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal
链接：https://arxiv.org/abs/2607.13472
作者：Alex Brandes,Haig Conti Georges Sajelian,Manthan Patel,Dominik Hollidt,Chenhao Li,Matthias Heyrman,Oliver Hausdoerfer,Manuel Kaufmann,Xi Wang,Jonas Frey,Angela P. Schoellig,Christian Holz,Marc Pollefeys,Marco Hutter
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deploying humanoid robots, Deploying humanoid, unstructured terrain remains, Deploying, priors remain limited
备注： Project webpage: [this https URL](https://egohtr.github.io)
点击查看摘要
Abstract:Deploying humanoid robots in unstructured terrain remains an open problem. While classic reinforcement learning struggles with the sheer complexity of real-world interactions, more promising methods leveraging human priors remain limited to models lacking contextual awareness. The restricted motion synthesis is a direct consequence of existing dataset pipelines failing to capture human-scene sequences in challenging environments. To bridge this gap between humanoid learning and scene reconstruction, we introduce the Egocentric Human-Terrain Reconstruction (EgoHTR) dataset. We develop and open-source a reconstruction pipeline capturing 55 scene-aligned 4D human motion sequences in diverse, complex environments using a multi-sensor setup of egocentric wearables and a portable 3D scanner. The resulting dataset comprises over 150k frames, which we evaluate against motion-capture ground truth, demonstrating state-of-the-art accuracy and establishing a rigorous benchmark for human motion analysis and synthesis. Further, we leverage this data to train perceptive locomotion policies, demonstrating hardware deployment on a Unitree G1 for reconstructed reference motions. Our pipeline enables community-driven dataset extensions and factors the problem to help researchers build foundational, context-aware robots that reliably traverse uneven terrain.
61. 【2607.13471】Bring Music The Horizon: Music-Driven 360$^\circ$ Video Generation
链接：https://arxiv.org/abs/2607.13471
作者：Kai Hsu Tsai,Yong Wei Fu,Hung I Yang,Yu-Chih Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS); Image and Video Processing (eess.IV)
关键词：enhance listeners' understanding, translating auditory signals, offers a powerful, enhance listeners', listeners' understanding
备注： 5 pages, 1 figure
点击查看摘要
Abstract:Music visualization offers a powerful way to enhance listeners' understanding and experience of music by translating auditory signals into visual forms. However, most existing approaches either rely heavily on lyrics or generate flat, non-immersive videos similar to conventional music videos, which limits their ability to convey the emotional dynamics of music and provide an immersive listening experience. We propose Bring Music The Horizon, an emotion-aware pipeline for music-driven 360$^\circ$ video generation. Given an input song, our work first estimates its emotional trajectory by predicting valence-arousal values at the level of every four bars. These values are then converted into emotion-aware visual guidance using EmotiCrafter, and these guidance vectors can be manipulated by the SEGA framework, which provides fine-grained semantic control for keyframe generation. Finally, image-to-video models are applied to the generated keyframes to synthesize temporally continuous 360$^\circ$ videos for immersive music visualization. Our pipeline generates 360$^\circ$ music visualization videos that reflect the emotional progression and temporal structure of the input song. We demonstrate its capability using songs from different genres and provide qualitative comparisons with From-Sound-To-Sight, a representative audio-to-visual generation baseline, on our project page at this https URL.
62. 【2607.13468】HIVE-3D: Hierarchical Voxel Enhancement for High-Quality 3D Scene Generation
链接：https://arxiv.org/abs/2607.13468
作者：Bin Zang,Wenting Zheng,Xiaoliang Luo,Zhiyuan Fang,Shi Li,Lvchun Wang,Wei Yu,Yi Zhao,Tian Xie,Yuchi Huo,Rengan Xie
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：restricted representation resolution, representation resolution, making them unsuitable, limited by restricted, restricted representation
备注： Accepted at the 43rd International Conference on Machine Learning (ICML 2026). Project page: [this https URL](https://xbdff.github.io/HIVE-3D/)
点击查看摘要
Abstract:Recently, a line of works can generate impressive 3D objects from a single image, but they are limited by restricted representation resolution, making them unsuitable for 3D scene generation. In this work, we introduce HIVE-3D, a novel method for high-quality 3D scene generation based on hierarchical voxel enhancement framework. Specifically, given a single scene image as input, we first produce a coarse initial scene, then introduce image segmentation and attention-based retrieval to align 2D image components with 3D scene components. Subsequently, we organize these scene relations into a hierarchical component tree, where nodes closer to the leaves denote finer-grained components. Finally, we propose a voxel super-resolution model that generates refined voxels for the target instance while maintaining strong consistency with the coarse voxels. Equipped with this model, we perform coarse-to-fine hierarchical super-resolution on images and voxels for each component, producing a high-resolution and high-quality 3D scene. Extensive experiments demonstrate that our method significantly outperforms previous approaches, achieving state-of-the-art performance.
63. 【2607.13460】LPM: Industrial-Scale Generative Video Restoration
链接：https://arxiv.org/abs/2607.13460
作者：Bichuan Zhu,Fulin Li,Jiachao Gong,Jinhua Hao,Kai Zhao,Kun Yuan,Pengcheng Xu,Qiang Wang,Qiao Mo,Yanlong Yuan,Yizhen Shao,Yuxiao Hu,Zixi Tuo,Ming Sun,Chao Zhou,Bin Chen,Bin Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Processing Model, present the Large, diffusion-based generative framework, Large Processing, LPM
备注： 21 pages, 7 figures
点击查看摘要
Abstract:We present the Large Processing Model (LPM), a diffusion-based generative framework for photorealistic video restoration under complex, in-the-wild degradations. To our knowledge, LPM is the first generative video restoration model deployed at industrial scale. LPM addresses the diverse degradations in user-generated content (UGC) through a unified system encompassing large-scale data engineering, foundation-model training, and efficient inference. Its enhanced architecture, progressive training strategy, and temporal-pyramid inference mechanism jointly enable high-fidelity, temporally consistent restoration of arbitrarily long videos across the broad content distribution encountered on UGC platforms. LPM has been deployed in production at Kuaishou, where videos processed by the model account for approximately 45% of total viewing time, delivering consistent improvements across key quality-of-experience metrics. Beyond perceptual enhancement, LPM delivers substantial system-level benefits: at comparable perceptual quality, it reduces bitrate by 20% relative to Kuaishou's in-house codec, yielding annual bandwidth cost savings on the order of hundreds of millions. Its low serving cost also enables integration into products such as Kling, demonstrating that generative restoration can be practical, scalable, and cost-effective for large-scale video processing.
64. 【2607.13458】2D Rotary Position Embedding for Scene Text Recognition with Transformers
链接：https://arxiv.org/abs/2607.13458
作者：Zobeir Raisi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scene Text Recognition, remains challenging due, Text Recognition, including curvature, remains challenging
备注： 17 pages, 3 figures. Under review at the International Journal on Document Analysis and Recognition (IJDAR)
点击查看摘要
Abstract:Scene Text Recognition (STR) remains challenging due to the diversity of text appearances, including curvature, rotation, and perspective distortion. Recent Transformer-based approaches perform well but usually rely on one-dimensional positional encodings that ignore the 2D spatial structure of text images. Axial 2D extensions of Rotary Position Embedding (RoPE) exist for vision Transformers, but they assume roughly square, isotropic image content and apply the rotation only within encoder self-attention. Scene text violates both assumptions: crops are markedly anisotropic, and STR models are encoder-decoder, so the decoder must relate its queries to the encoder's 2D layout through cross-attention. We introduce 2D-RoPE-STR, which adapts axial 2D-RoPE to this setting through (1) an anisotropic row/column dimension allocation matched to the aspect ratio of text, and (2) an extension of the rotary coupling into encoder-decoder cross-attention, letting autoregressive decoding steps attend to encoder tokens by their 2D layout, a setting not addressed by prior encoder-only formulations. Both changes are essentially parameter-free and require no architectural redesign beyond the positional-encoding module. We further introduce a diagnostic protocol (a controlled ablation pair isolating only the positional encoding, an image-level net-win disagreement analysis, and encoder attention visualization) that identifies where and why relative 2D position helps: curved, rotated, and perspective-distorted layouts where reading order departs from a straight horizontal line. On six standard benchmarks (IIIT5K, SVT, ICDAR 2013, ICDAR 2015, CUTE80, SVTP), gains concentrate on exactly these irregular layouts, with ablations isolating each design choice against 1D RoPE and 2D sinusoidal and learnable alternatives.
65. 【2607.13456】reeSRNF: Square-Root Normal Fields for Generative Modelling of the Geometric and Structural Variability in Tree-like 3D Objects
链接：https://arxiv.org/abs/2607.13456
作者：Tahmina Khanam,Hamid Laga,Mohammed Bennamoun,Guanjin Wang,Ferdous Sohel,Farid Boussaid,Anuj Srivastava
类目：Computer Vision and Pattern Recognition (cs.CV); Computational Geometry (cs.CG); Graphics (cs.GR)
关键词：Root Normal Fields, generating complex tree-shaped, Square Root Normal, analyzing and generating, tree-shaped
备注： ECCV 2026
点击查看摘要
Abstract:We introduce a novel mathematical framework for analyzing and generating complex tree-shaped 3D objects, such as botanical trees and plants, which deform both in their 3D geometry and branching structure. Unlike previous works, which either consider only the skeletal structure of tree-like objects or approximate their 3D geometry using branch thickness, the proposed framework accurately models both the 3D geometry of the tree branches and the way they are interconnected. In this paper, we first generalize the Square Root Normal Fields (SRNF) representation, originally proposed for the statistical analysis of genus-0 surfaces, to tree-shaped 3D objects. We then treat tree-shaped 3D objects as points on a novel Riemannian tree-shape space equipped with a novel Riemannian metric that measures the amount of surface bending and stretching, and structural changes one needs to apply to one 3D tree-shape to align it with another. This way, deformations become trajectories in this novel tree-shape space. We analyze the theoretical properties of this novel tree-shape space and the corresponding metric and develop algorithms for computing point-wise and branch-wise correspondences and geodesic paths between complex 3D trees. We finally show how to use these building blocks for (1) computing statistical summaries, \ie means and modes of variation, of collections of tree-shaped 3D objects, and (2) synthesizing novel tree-shaped 3D objects by sampling from probability distributions fitted to a population of tree-shaped 3D objects. We demonstrate the performance and utility of the proposed framework on real and synthetic plants and botanical trees and show that it significantly outperforms the state-of-the-art.
66. 【2607.13454】GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding
链接：https://arxiv.org/abs/2607.13454
作者：Hao Li,Han Fang,Zixin Pan,Xin Wei,Hongbo Sun,Jinglin Xu,Zhiyu Lin,Ye Yuan,Zhongjiang He,Yu Yu,Hao Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：achieved remarkable progress, multimodal large language, large language models, remarkable progress, images remains
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:Although multimodal large language models (MLLMs) have achieved remarkable progress, understanding 3D spatial relationships from 2D images remains a critical challenge. Existing methods primarily rely on symbolic text tokens, which inherently lack the fidelity to represent continuous geometric information. While recent methods use latent representations to enhance reasoning, relying on a single latent type cannot adapt to the diversity of spatial tasks, leading to misalignment in complex geometric scenarios. To address these limitations, we propose GeoAnchor, an interleaved text-latent reasoning framework. GeoAnchor decomposes 3D spatial information into three complementary components: position latents for object grounding, direction latents for relational orientation, and geometry latents for scene structure. These components are recombined in a structured space to construct local evidence while capturing global context, enabling dynamic and interpretable reasoning. Furthermore, we introduce a collaborative training strategy that guides the model from local spatial perception to comprehensive 3D understanding. Extensive experiments on diverse and complex 3D reasoning tasks demonstrate that GeoAnchor outperforms the state of the art, validating its effectiveness and generalization capabilities.
67. 【2607.13452】Symbiosis-Inspired Knowledge Distillation for Incremental Object Detection
链接：https://arxiv.org/abs/2607.13452
作者：Mingyue Zeng,De Cheng,Zhipeng Xu,Huaijie Wang,Nannan Wang,Xinbo Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：retaining previously acquired, previously acquired knowledge, Incremental object detection, aims to extend, extend detectors
备注： 16 pages, 8 figures, Accepted by ICML 2026
点击查看摘要
Abstract:Incremental object detection (IOD) aims to extend detectors to new categories while retaining previously acquired knowledge. Existing methods often adopt a class incremental learning perspective, separating feature spaces to sharpen decision boundaries. However, this separation-oriented paradigm may overlook object symbiosis in detection, where co-occurrence and occlusion introduce spatial and semantic dependencies that benefit from shared representations. Ignoring these dependencies distorts the shared representations, exacerbates confusion between old and new classes, and accelerates catastrophic forgetting. To address this, we propose Symbiosis-Inspired Knowledge Distillation (SIKD), which explicitly leverages object symbiosis at two complementary levels. Spatial Symbiosis Distillation (SpSD) focuses on symbiotic regions where the old model responds with high overlap to objects in the new task. It preserves generalizable old class cues, suppresses class-specific bias and redundancy, and distills the refined evidence to the new model at matched spatial locations with slot-aligned supervision. Semantic Symbiosis Distillation (SeSD) maintains class level structure by forming confidence weighted prototypes for old classes and aligning their inter class soft ranks over the old class logits, which stabilizes the semantic topology during adaptation. Extensive experiments demonstrate the effectiveness and superiority of the proposed method.
68. 【2607.13451】Learning Physics-Guided Residual Dynamics for Deformable Object Simulation
链接：https://arxiv.org/abs/2607.13451
作者：Shivansh Patel,Kaifeng Zhang,Sanjay Pokkali,Svetlana Lazebnik,Yunzhu Li
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：dynamics remains challenging, Simulating deformable objects, Physics-Guided Residual Dynamics, Simulating deformable, remains challenging
备注： Website: [this https URL](https://pgrd-robot.github.io/)
点击查看摘要
Abstract:Simulating deformable objects is essential for a wide range of robotic manipulation applications, yet accurately predicting their dynamics remains challenging. We propose Physics-Guided Residual Dynamics (PGRD), a hybrid simulation framework that combines the advantages of physics-based and learning-based approaches. Specifically, PGRD combines an optimizable spring-mass simulator as a backbone with a learned neural network that predicts residual corrections to the physics-based predictions. We adopt a velocity-based formulation to ensure stable simulation and a sliding-window transformer architecture to capture temporal dependencies. We show that PGRD produces more accurate results than both purely physics-based and learning-based methods on a set of diverse real-world deformable objects. We further demonstrate the utility of PGRD in two applications: manipulation planning via Model Predictive Control, including a language-conditioned setting with a generated goal image; and interactive simulation via action-conditioned video prediction by 3D Gaussian Splatting.
69. 【2607.13449】DreamSat-Pose: Spacecraft Pose Estimation from Single-View 3D Reconstructions and Learned 2D-3D Feature Matching
链接：https://arxiv.org/abs/2607.13449
作者：Josiane Uwumukiza,Jocelyn Zhao,Giovanni Lavezzi,Giacomo Battaglia,Paolo Panicucci,Minduli C. Wijayatunga,Victor Rodriguez-Fernandez,Richard Linares
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：proximity operations, autonomous rendezvous, rendezvous and proximity, critical task, pose estimation
备注：
点击查看摘要
Abstract:6-DoF pose estimation is a critical task in autonomous rendezvous and proximity operations. In the case of an unknown target, this task becomes challenging as it shall be paired with the reconstruction of the target shape model. In this article, we propose a novel framework for single-shot shape and pose estimation of unknown spacecraft objects. Given a single image, we first reconstruct a 3D shape model of the target, then estimate the relative six-degrees-of-freedom pose by learning dense 2D-3D correspondences. The image features are extracted using a frozen DINOv3 vision transformer, while the geometric features are computed from the reconstructed point cloud using a trainable dynamic graph convolutional neural network encoder. A dual-stream transformer matcher refines descriptors through alternating self- and cross-attention, producing soft correspondences that are passed to a Perspective-$n$-Point solver for pose recovery. We evaluate the method on the SPE3R dataset and consider FoundationPose as a representative baseline for current state-of-the-art capabilities. Results show reliable pose estimates achieving 0.157 degrees mean pointing error using only a single image and reconstructed geometry, demonstrating strong generalization to unseen spacecraft.
70. 【2607.13437】CLIP-Guided Label-Free Discriminative Region Scoring for Fine-Grained Classification
链接：https://arxiv.org/abs/2607.13437
作者：Yujie Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent vision models, enable training-free segmentation, Recent vision, SAM enable training-free, fine-grained classification
备注：
点击查看摘要
Abstract:Recent vision models such as CLIP and SAM enable training-free segmentation and semantic encoding for fine-grained classification. A common approach is to compare the representations of segmented image regions with the text prompt embeddings of the corresponding labels. However, it remains unclear how different local regions and CLIP-based scoring strategies affect the selection of discriminative evidence, especially when ground-truth labels are unavailable. In this paper, we propose a unified CLIP-guided label-free region scoring framework for fine-grained classification. The framework evaluates cosine similarity-based, margin-based, and entropy-based scoring strategies using both SAM-generated masks and random crops, and introduces two label-free pseudo-label variants based on global image embeddings and local region embeddings. We conduct experiments on five fine-grained classification datasets to systematically compare different region generation methods and scoring strategies. The results show that Soft Negative Margin scoring achieves the strongest performance, and pseudo-label scoring closely approximates true-label performance. Although SAM produces semantically meaningful masks, random-crop-based pseudo-label scoring consistently outperforms SAM-based scoring across all datasets, suggesting that random crops preserve surrounding information and provide more stable semantic context when pseudo-labels are noisy. In addition, SAM masks benefit from aggregating embeddings from all regions, whereas random crops tend to perform better with a smaller top-k subset. These findings provide new insights for fine-grained classification.
71. 【2607.13429】Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
链接：https://arxiv.org/abs/2607.13429
作者：Dwip Dalal,Shivansh Patel,Chahit Jain,Jeonghwan Kim,Utkarsh Mishra,Alex Baratian,Hyeonjeong Ha,Heng Ji,Svetlana Lazebnik,Unnat Jain
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：pretrained vision-language model, behavior cloning, demonstrations via behavior, finetuning progressively overwrites, vision-language model
备注： Code: [this https URL](https://github.com/dwipddalal/Anchor-Align)
点击查看摘要
Abstract:Finetuning a pretrained vision-language model (VLM) on robot demonstrations via behavior cloning (BC) has become the standard recipe for vision-language-action (VLA) policies. However, BC finetuning progressively overwrites the pretrained representations that support visual and semantic generalization. Co-training on web image-text data, a common remedy, does not prevent this; it applies language and action losses to separate observations, leaving VLAs with language-action misalignment that standard manipulation benchmarks do not expose. We propose Anchor-Align, which augments BC with two objectives: Vision-Language Anchoring distills layer-wise representations from a frozen VLM copy to prevent this drift, while Language-Action Alignment converts each action target into a discrete motion-direction label and jointly trains language and action prediction on the same robot observation. On a physical xArm7 robot, across two widely used VLA architectures, Anchor-Align improves real-robot success on both (28% to 54% and 37% to 60%). At scale in simulation, we demonstrate consistent improvements on OOD perturbations, perceptual robustness, and long-horizon control across LIBERO-PRO, LIBERO-Plus, and CALVIN, respectively, suggesting that preserving pretrained representations and effective action learning are not fundamentally at odds. Project page: this http URL
72. 【2607.13421】ScanFocus: A Coarse-to-Fine Framework for Spatio-Temporal Video Grounding
链接：https://arxiv.org/abs/2607.13421
作者：Kai Chen,Ming Dai,Wenxuan Cheng,Wankou Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：natural language expression, Spatio-Temporal Video Grounding, Video Grounding, aims to retrieve, language expression
备注： this paper has already been accepted by ECCV 2026
点击查看摘要
Abstract:Spatio-Temporal Video Grounding (STVG) aims to retrieve the visual trajectory of a specific object from a video stream as described by a natural language expression. However, most advanced methods struggle to balance global context modeling with precise boundary localization. Due to the prohibitive computational costs of processing long videos, these approaches typically resort to low-rate temporal downsampling and implicit motion modeling. This inevitably suppresses high-frequency boundary cues and neglects the explicit inter-frame dependencies required for precise boundary delineation. To address these limitations, we present \textbf{ScanFocus}, a novel coarse-to-fine framework that decouples the STVG task into a global spatio-temporal scan and a local boundary focus. Specifically, we utilize a unified vision-language fusion encoder combined with a lightweight Deformable Semantic-Motion Fusion module to efficiently align multimodal features and generate coarse proposals. To recover the suppressed fine-grained details, we introduce the Semantic-Guided Temporal Aggregator (SGTA) in the refinement stage. By densely sampling around coarse boundaries, SGTA explicitly models short-term temporal interactions under semantic guidance, capturing rapid motion changes for precise timestamp regression. Extensive experiments on three widely used benchmarks demonstrate the performance superiority of our proposed method over previous approaches. Code will be released at this https URL.
73. 【2607.13415】MultiAnimate: A Unified Framework for Controllable Multi-Character Animation
链接：https://arxiv.org/abs/2607.13415
作者：Zhongyi Zhang,Guangyuan Wang,Li Hu,Wenbo Zhou,Peng Zhang,Tianyi Wei,Weiming Zhang,Bang Zhang,Nenghai Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, advances in generative, generative models, models and technological, technological innovations
备注： Preprint, under review
点击查看摘要
Abstract:Recent advances in generative models and technological innovations have significantly addressed the fundamental challenges of character image animation. However, existing approaches predominantly focus on character animation from a single reference image, substantially limiting their applicability in scenarios such as multiple character interaction animation. To fill this gap, this paper introduces MultiAnimate, a comprehensive framework that enables concurrent animation of multiple characters within a shared environment while preserving both identity consistency and spatial relationships. The framework achieves these objectives through multiple well-designed mechanisms. First, we incorporate an identity-specific reference net that enables appearance extraction from multiple reference images, distinguishing MultiAnimate from existing approaches constrained to single reference inputs. Second, we implement an identity-aware pose encoder to address the character-pose binding challenge, wherein an attention mechanism enables the network to accurately differentiate and process multiple pose sequences during generation. Third, we introduce an interaction guider module that enhances the framework's capability to handle complex inter-character interactions by leveraging character-specific mask information, serving as an optional component that refines the pose sequences. Extensive experiments and ablation analyses demonstrate our framework's superiority in multiple character animation, particularly in scenarios involving complex motion sequences.
74. 【2607.13409】AnomExpert: Identifying and Selecting Anatomical Planes for Prenatal Ultrasound Anomaly Diagnosis
链接：https://arxiv.org/abs/2607.13409
作者：Jian Wang,Yang Yang,Ziheng Pan,Xiliang Zhu,Yuhan Zhang,Yanfeng Zhou,Dong Ni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Life-limiting congenital anomalies, congenital anomalies require, anomalies require accurate, Life-limiting congenital, require accurate prenatal
备注： It has been accepted early by MICCAI2026
点击查看摘要
Abstract:Life-limiting congenital anomalies require accurate prenatal diagnosis for appropriate clinical decision-making. Prenatal ultrasound (US) examinations involve multiple anatomical planes, and diagnosis depends on identifying anatomical planes and selecting diagnostically relevant planes for each anomaly. Existing automated methods either rely on plane-level annotations or aggregate heterogeneous images without explicitly modeling these diagnostic capabilities. We propose AnomExpert, a prototype-driven framework for prenatal US anomaly diagnosis using only case-level supervision. AnomExpert introduces learnable plane prototypes to organize unordered images into latent representations corresponding to anatomical planes without requiring plane annotations. A disease-aware sparse selection mechanism further selects diagnostically relevant planes for each anomaly. Experiments on a multi-center dataset of 3,654 cases show that AnomExpert consistently outperforms nine representative multi-instance learning methods. Using a ViT-small backbone, it achieves 86.9% accuracy and 84.2% F1-score while maintaining parameter efficiency. These findings indicate that modeling anatomical plane identification and disease-specific plane selection improves weakly supervised multi-plane prenatal US anomaly classification. The code is available at this https URL.
75. 【2607.13386】FM$^2$: Unified Federated Foundation Models for Heterogeneous Multimodal Medical Imaging
链接：https://arxiv.org/abs/2607.13386
作者：Shengchao Chen,Ting Shu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Building foundation models, prohibit centralized aggregation, requires pooling data, privacy regulations prohibit, regulations prohibit centralized
备注： Accepted by ACM MM 2026 (Main Track): the 34th ACM International Conference on Multimedia
点击查看摘要
Abstract:Building foundation models for medical imaging requires pooling data across institutions, yet privacy regulations prohibit centralized aggregation. Existing Federated Foundation Models either fine-tune natural-image models with poor medical-domain transfer, or train from scratch within a single modality, lacking the flexibility to unify tasks. We identify an under-explored challenge, Imaging Modality Heterogeneity, where clients operate under two structural regimes: Overlapped (shared modalities with heterogeneous label distributions) and Non-overlapped (fully disjoint modalities per client). We propose FM$^2$, a unified framework that trains the core backbone from scratch to preserve medical domain fidelity while optionally incorporating biomedical pretrained encoders for vision-language alignment. FM$^2$ equips each client with dual Mixture-of-Experts modules (a Class-wise MoE for personalized category knowledge and a Domain-wise MoE for shared cross-modality representations), coupled with a Heterogeneous Modality Alignment (HMA) regularizer that explicitly aligns modality-specific expert parameters, admitting provable $O(1/\sqrt{T})$ convergence and generalization guarantees. FM$^2$ further incorporates Caption-Enhanced Learning (CEL), where locally retained GPT-4o-generated captions serve as a textual semantic bridge enabling representation transfer across clients with disjoint modalities, and demonstrates extensibility to Federated Medical VQA. Experiments on our MIMH benchmark (classification and CEL) and real-world medical VQA datasets confirm consistent superiority over state-of-the-art federated baselines and strong out-of-modality generalization across all three tasks.
76. 【2607.13371】RoughNet: Mapping Arctic Sea Ice Roughness Using Diffusion-Based Super-Resolution of Satellite Imagery
链接：https://arxiv.org/abs/2607.13371
作者：Tessa Cannon,Michel Tsamados,Petru Manescu,Thomas Newman,Christian Haas,Veit Helm,Weibin Chen,Randall Scharien
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sparse in-situ measurements, limiting spatial coverage, Arctic over-ice travel, existing approaches rely, safe Arctic over-ice
备注： Code available at [this https URL](https://github.com/tessacannon48/RoughNet)
点击查看摘要
Abstract:Accurate estimation of landfast sea ice roughness is critical for climate modeling and safe Arctic over-ice travel, yet existing approaches rely on costly airborne surveys or sparse in-situ measurements, limiting spatial coverage and operational scalability. Here we show that high-resolution sea ice topography can be reconstructed directly from optical satellite imagery using a conditional diffusion framework. Our approach, RoughNet, learns to map 10 m Sentinel-2 multispectral images to locally normalized 1 m surface elevation residual fields, enabling fine-scale roughness characterization from widely available satellite data. Trained on airborne LiDAR data from two Arctic regions and evaluated on an unseen third Arctic region, the model generalizes across diverse ice conditions and partially reproduces small-scale topographic structure. The best-performing model achieves an out-of-domain root mean squared error of 9 cm while preserving the statistical and spectral properties of the underlying roughness field. These results demonstrate that generative diffusion models can recover physically meaningful surface structure from optical imagery alone, providing a scalable pathway for high-resolution sea ice mapping and roughness estimation in data-sparse environments.
77. 【2607.13365】DiffGI: Differentiable Geometry Images for High-Fidelity Thin-Shell 3D Generation
链接：https://arxiv.org/abs/2607.13365
作者：Eungjune Shim,Hansol Lee,Eunjung Ju
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enforce watertight topology, implicit volumetric representations, generative models predominantly, models predominantly rely, existing methods rely
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Existing 3D generative models predominantly rely on implicit volumetric representations, which enforce watertight topology and struggle to represent thin-shell and non-manifold geometries such as garments. Geometry image-based approaches offer a surface-centric alternative, but existing methods rely on discrete binary occupancy maps whose resolution-dependent boundary encoding causes staircase artifacts and information loss upon downsampling, while surface reconstruction remains a non-differentiable post-processing step disconnected from the learning pipeline. To address this, we propose Differentiable Geometry Image (DiffGI), an end-to-end 3D-to-2D mapping framework that seamlessly integrates surface representation and geometric optimization. DiffGI replaces binary maps with a continuous 2D Truncated Signed Distance Function (TSDF), which encodes boundary position at subpixel precision within a fixed grid resolution, eliminating resolution-dependent staircase artifacts even under aggressive downsampling. Building on this continuous field, we introduce a differentiable Marching Squares algorithm based on analytical linear interpolation, allowing gradients from 3D surface losses to propagate back to the 2D latent space. Leveraging this differentiable pipeline, we train a DiffGI-VAE augmented with a geometry-aware normal rendering loss to compress complex 3D surfaces into an ultra-compact 32X32 latent space, and instantiate a transformer-based latent diffusion model with a flow-matching objective on top of this space for conditional 3D generation. Extensive experiments on garment and object datasets demonstrate that our method achieves superior reconstruction fidelity and boundary precision compared to prior geometry-image and voxel-based approaches, while requiring significantly fewer computational resources.
78. 【2607.13361】Detector Confidence Signals Presence Rather Than Occlusion in Cluttered Manipulation
链接：https://arxiv.org/abs/2607.13361
作者：Yuanzhi He
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Occlude a named, open-vocabulary detector confidence, present barely, object, present
备注： 12 pages, 3 figure, 6 tables
点击查看摘要
Abstract:Occlude a named object until about an eighth of it remains visible, and an open-vocabulary detector's confidence that the object is present barely changes; as the clutter around it grows the confidence can even rise. On real video the detector still reports the object present in 99% of occluded frames, on another instance of the same category. This matters because that confidence is widely read as a visibility signal, used to threshold detections, evaluate open-vocabulary detectors, ground language, retrieve instances, and gate active perception. We audit whether it reflects occlusion by pairing every view with a geometry-segmentation oracle that gives detector-free ground-truth visibility. As true visibility falls from every scene to one in eight, the confidence stays nearly constant and uncorrelated with visibility, and the detector reports the target present in about nine of ten scenes, firing on same-category distractors: it signals that the category is present somewhere, not that the specific target is visible. The failure holds across three detectors (Grounding DINO, OWLv2, and Segment Anything Model 3), nine object categories, two simulators with different renderers and object sets, built and natural occlusion, and real video. Two consequences follow: a confidence-based metric understates the value of resolving occlusion by about ten times (8 against 88 points in our active-perception setting), and a confidence-based gate fires exactly when the object is hidden. No single-view signal we tried, including a realizable localization check, flags the occlusion, because the occluders sit where the target is. We connect the effect to detector miscalibration and object hallucination, release the controlled benchmark, and recommend target-grounded signals for gating and evaluation.
79. 【2607.13345】Audio-Text Cross-Attention with Psycholinguistic Support Features for Ambivalence/Hesitancy Recognition
链接：https://arxiv.org/abs/2607.13345
作者：Luiz F. B. F. Martins,Rodrigo W. Pisaia,Matheus M. Girardi,Isabella Berkembrock,João A. Almeida,André G. Hochuli,Rayson Laroca,Alceu S. Britto Jr
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Hesitancy Video Recognition, Video Recognition Challenge, ABAW Competition, Recognition Challenge, Hesitancy Video
备注：
点击查看摘要
Abstract:We present an audio-text system for the Ambivalence/Hesitancy Video Recognition Challenge of the 11th ABAW Competition. The method excludes visual frames and represents each video as overlapping 5-second windows aligned with transcript timestamps. Each window combines a 320-dimensional prosodic audio descriptor, a 768-dimensional emotion-oriented RoBERTa embedding, and 74 handcrafted features capturing uncertainty, hedging, and attitudinal conflict. Audio and text are fused via temporal cross-attention, while support features are injected prior to gated multiple-instance learning (MIL) pooling to modulate the window's importance. Predictions from five independently initialized models are averaged. On the labeled public development set, the ensemble achieved an average precision of 0.875 and a macro-F1 of 0.72. Our source code is publicly available at this https URL.
80. 【2607.13343】Marker-free deformable registration and fusion for augmented reality-guided positive margin localization during tumor resection surgery
链接：https://arxiv.org/abs/2607.13343
作者：Yue Yang,Annie Benson,Matthieu Chabanas,Jason Slagle,Thomas Myles,Matthew B. Weinger,Jon S. Heiselman,Michael I. Miga,Michael Topf,Jie Ying Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET); Human-Computer Interaction (cs.HC)
关键词：neck oncologic surgery, specimen-side pathology findings, mapping specimen-side pathology, patient resection bed, oncologic surgery require
备注：
点击查看摘要
Abstract:Positive margins in head and neck oncologic surgery require mapping specimen-side pathology findings to the patient resection bed. This is challenging because pathologists identify the positive margin on slices of the resected, deformed specimen, while surgeons must relocate the corresponding site on the resection bed using only verbal descriptions and no visual guidance. We present a marker-free augmented reality (AR) workflow for mapping a margin label from a three-dimensional specimen scan to the resection bed. The method combines contour-constrained deformation, residual alignment to a depth scan, surface-based fusion to a head-mounted display, and target projection onto the reconstructed bed. Bead-suture correspondences estimate specimen deformation, whereas patient-to-display fusion does not require external fiducial markers. Following formative experiments, five residents and surgeons performed cadaveric cheek and scalp re-resection tasks under verbal guidance, verbal guidance with specimen examination, and AR guidance. Deformation target errors were $7.63 \pm 3.74$ mm for the cheek and $3.72 \pm 1.02$ mm for the scalp; residual specimen-to-bed distances were $2.43 \pm 2.15$ mm and $2.19 \pm 1.06$ mm, respectively. Fusion error did not differ significantly between marker-free and marker-based methods on either cadaver; overall marker-free fusion error was $2.15 \pm 0.87$ mm. End-to-end margin localization error decreased from $21.40 \pm 3.84$ mm with verbal guidance and $16.09 \pm 4.30$ mm with specimen examination to $6.19 \pm 1.79$ mm with AR guidance ($p 0.001$). Online fusion required $5.23 \pm 0.34$ s. These results demonstrate effective marker-free AR guidance for positive-margin localization and support more precise tumor resection.
81. 【2607.13336】Delving into the Temporal Challenges of Unified Video Protection Against Image-to-Video and Fine-Tuning-based Customization
链接：https://arxiv.org/abs/2607.13336
作者：Yuxin Huang,Ziming Hong,Mingming Gong,Wanyu Wang,Jing Zhang,Tongliang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Recent diffusion-based video, enabled high-quality personalized, Recent diffusion-based, video generation models, diffusion-based video generation
备注： This work provides a basis for the ECCV 2026 LifeGenIP Challenge on Unlearnable Videos against Diffusion-based Customization. Challenge page: [this https URL](https://lifegenip.cc/competition) . Evaluation code: [this https URL](https://github.com/tmllab/ECCV26_LifeGenIP_starting_kit) . Project page: [this https URL](https://saythe17.github.io/TC-UAP/)
点击查看摘要
Abstract:Recent diffusion-based video generation models have enabled high-quality personalized video customization through both tuning-based pipelines, which fine-tune a video diffusion model, and reference-based pipelines such as image-to-video generation. However, these capabilities raise serious concerns about personal privacy, identity ownership and intellectual property protection. Existing anti-customization works focus on protecting images, while protection for videos against both reference- and tuning-based customization remains largely underexplored. Protecting videos in this setting raises three challenges: (i) Image-level perturbations, optimized frame by frame, cannot survive temporal compression by 3D video VAE. (ii) A video-level perturbation optimized on a single video is vulnerable to temporal editing and fails to protect unseen videos. (iii) Temporally inconsistent perturbations are not robust to temporal attacks. To address these challenges, we propose Temporally Consistent Universal Adversarial Perturbations (TC-UAP), the first protection method against both reference- and tuning-based video customization. TC-UAP optimizes an identity-level multi-frame UAP over sliding windows from multiple videos, accounting for local temporal dependencies induced by temporal compression in video VAE and enabling a single perturbation to protect unseen videos of varying lengths. Moreover, we introduce intrinsic temporal modeling and an extrinsic surrogate temporal-attack loss, which make the perturbation temporally consistent and robust to unseen temporal attacks. Empirically, quantitative and qualitative results show that TC-UAP achieves the strongest identity protection compared with existing methods under both reference- and tuning-based video customization, and remains robust under multiple unseen temporal attacks.
82. 【2607.13323】SARFA: Segment Anything with Radiomic Feature Alignment
链接：https://arxiv.org/abs/2607.13323
作者：Tyler Ward,Abdullah Imran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated strong generalizability, Segment Anything Model, Radiomic Feature Alignment, demonstrated strong, strong generalizability
备注： 15 pages, 9 figures, 5 tables, 1 algorithm
点击查看摘要
Abstract:The Segment Anything Model (SAM) has demonstrated strong generalizability across a variety of segmentation tasks. However, SAM often struggles in situations where the target to be segmented is ambiguous. This poses a problem in medical imaging, where accurate delineation of targets such as tumors is vital, but even expert radiologists can disagree on the appropriate boundary for a target. Addressing this, we propose SARFA (Segment Anything with Radiomic Feature Alignment), a novel framework for improved medical image segmentation. Via probabilistic prompting, SARFA generates a diverse set of plausible masks for each input image and optimizes them with a radiomics-driven training objective based on Fréchet Radiomic Distance (FRD) and Direct Preference Optimization (DPO). By minimizing the FRD between masked predicted and ground truth regions within each image, SARFA encourages segmentation outputs whose anatomical and textural characteristics align with clinically meaningful ground truth representations, without relying solely on pixel-level overlap. Evaluated on computed tomography (CT) and magnetic resonance imaging (MRI) benchmarks, SARFA outperforms existing ambiguous segmentation methods, demonstrating the effectiveness of radiomic feature alignment and DPO-style candidate mask ranking as a training objective. Our code is available at this https URL.
83. 【2607.13318】Reflecting Process Expertise in Procedural Material Generation
链接：https://arxiv.org/abs/2607.13318
作者：Kunal Gupta,Gaurav Joshi,Yen-Ru Chen,Seemandhar Jain,Ishit Mehta,Manmohan Chandraker
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：creation underpins applications, digital content creation, material creation underpins, visual effects, creation underpins
备注： Accepted to ECCV 2026. Project page: [this https URL](https://materialapprentice.github.io)
点击查看摘要
Abstract:Procedural material creation underpins applications in digital content creation, visual effects, and 3D asset design. Achieving high-quality results requires more than reproducing node graphs -- it demands understanding the process by which experts construct materials. We formulate procedural material generation as retrieval-time process reasoning over expert demonstrations, elevating process to a first-class representation beyond graph-only synthesis. Concretely, we represent expert workflows as process traces: textual records of construction steps, parameters, and design intent. To instantiate this idea, we use a pretrained LLM-based ProcessSynthesizer to synthesize a process trace aligned with a user's intent and a pretrained LLM-based Compiler to ground the process trace into an executable Blender material graph. Because procedural expertise is most naturally conveyed through demonstrations, we leverage tutorial videos as a source of process knowledge and extract textual, LLM-compatible traces using automated video analysis tools. In an expert study with five Blender artists (avg. 7.5 years of experience), materials generated by reflecting expert demonstrations were found to produce workflows requiring fewer edits, and more closely match professional design strategies than methods operating solely on static artifacts. A user study with 150 participants further shows that our approach achieves superior generation and editing performance compared to prior procedural systems. All code, models, and data will be available at this https URL
84. 【2607.13305】Accuracy Without Grounding: Diagnosing Visual Dependency Dissociation in Video LLM Benchmarks
链接：https://arxiv.org/abs/2607.13305
作者：Jae Joong Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：video large language, large language models, large language, treated as evidence, Visual Dependency Gap
备注： Accepted, ACM International Conference on Multimedia 2026 (ACM MM)
点击查看摘要
Abstract:Benchmark accuracy in video large language models (LLMs) is often treated as evidence of visual understanding. We audit this assumption across twenty models spanning 2-78B parameters and ten architecture families. We introduce the Visual Dependency Gap (VDG), the difference in per-question correctness between original-video and black-screen conditions. Paired McNemar tests on MVBench show that accuracy and visual dependency are separable: models differ on original video (p = 0.0003) but not on black screens (p = 0.53). Across models, task-type rankings are stable: Attribute Perception is strongly visual, whereas Temporal Reasoning approaches the language-only baseline. A diagnostic ladder from black screen to single frame, shuffled frames, and original video reveals that frame diversity supplies most of the visual benefit, while temporal order contributes near-zero accuracy across sixteen open-weight models. An ablation from 0.5 to 24 FPS rules out sparse sampling as the cause. H.264 experiments further show that stable aggregate accuracy conceals bidirectional question-level answer flips. The diagnostic also generalizes to four API-accessed models, whose VDG values range from 0.025 to 0.315. These results motivate VDG as a standard audit for whether video benchmarks measure visually grounded capability. Code is available at this https URL.
85. 【2607.13300】Improving Medical Image Generative Models with Fréchet Distance Loss
链接：https://arxiv.org/abs/2607.13300
作者：Andrew Marshall,Xuanang Xu,Xiaoran Zhang,Rui Wang,Lawrence Staib,James Duncan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated immense potential, Diffusion generative models, Diffusion generative, demonstrated immense, immense potential
备注：
点击查看摘要
Abstract:Diffusion generative models have demonstrated immense potential for synthetic medical image generation. However, these models often struggle to capture complex morphological characteristics of heterogeneous tumors with irregular boundaries, limiting their utility for downstream clinical tasks such as segmentation. This limitation stems from the standard denoising objective: minimizing a per-pixel error, which smooths high-variance irregular structures characteristic of tumors. To address this, we propose finetuning these generative models with Fréchet Distance loss (FD-loss). FD-loss aligns the first and second order feature statistics of real and generated images in a pretrained encoder space, encouraging the generator to capture complex structural variations characteristic of heterogeneous tumors. We integrate FD-loss across diverse architectural settings, using both natural- and medical-image encoders on multiple liver and brain cancer datasets spanning CT and MRI modalities. Downstream segmentation networks trained on our FD-regularized synthetic data consistently achieve superior performance, improving tumor DSC by $$$5\%$ over unregularized synthetic augmentation alone. Qualitative analysis suggests these gains are associated with more faithful tumor synthesis and fewer segmentation hallucinations. Our results show FD-loss as an effective regularizer for medical image generative models to improve clinical workflows.
86. 【2607.13298】FOLIO: Focused Semantic Memory for Streaming Video Understanding
链接：https://arxiv.org/abs/2607.13298
作者：Haoyang Fan,Dhruv Parikh,Anvitha Ramachandran,Sameh Gobriel,Nilesh Jain,Rajgopal Kannan,Viktor Prasanna
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：streaming video understanding, online streaming video, video stream continues, video understanding, online streaming
备注： 28 pages, 5 figures
点击查看摘要
Abstract:In online streaming video understanding, a video stream continues to arrive and queries may be issued at any time. Because streaming frames grow without bound, the system must continuously compress and retain information from the observed video prefix while future frames and future queries remain unknown. The core challenge is deciding what information to retain and how to organize the maintained history: as this history grows with the stream, memory cost increases and many redundant visual details are retained, whereas later queries often depend on specific entities, actions, and their temporal changes. To address this challenge, we introduce FOLIO, a training-free focused semantic memory system that records important parts of the stream in higher detail while keeping surrounding context compact. As the stream arrives, FOLIO updates memory at the segment level, guided by a dynamic focus state, combining a short-term visual buffer with a long-term semantic memory organized around observed entities and linked to a visual-evidence cache. At query time, lightweight hybrid retrieval combines direct matching over the structured memory with semantic query expansion. FOLIO achieves state-of-the-art performance, reaching 82.0/69.1 Perception/Backward accuracy on OVO-Bench with Qwen3-VL-8B and 74.5 overall accuracy on StreamingBench, while substantially reducing the cost of maintaining streaming memory by reserving detailed records for focused entities and storing surrounding context compactly.
87. 【2607.13265】Differentiable Polarized Path Tracing
链接：https://arxiv.org/abs/2607.13265
作者：Pramod Rao,Jérémy Riviere,Xilong Zhou,Abhijeet Ghosh,Abhimitra Meka,Thabo Beeler,Marc Habermann,Christian Theobalt,Delio Vicini
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reflectance estimation, powerful tool, inverse rendering problems, estimation, lighting estimation
备注： Accepted at ECCV 2026
点击查看摘要
Abstract:Physically based differentiable rendering has proven to be a powerful tool for inverse rendering problems (e.g., 3D reconstruction, reflectance estimation, lighting estimation). However, most existing methods operate solely on radiometric intensity, discarding valuable polarization cues that constrain scene geometry and material properties. While forward simulation of polarized light is well-defined via Mueller-Stokes calculus, extending reverse-mode differentiation to this domain presents significant challenges. The rank-deficient nature of common polarimetric operators, such as linear polarizers and diffuse reflections, violates the invertibility assumptions of standard gradient estimators like path replay backpropagation and results in numerical instability. We address this by proposing a robust, polarization-aware differentiable path tracing method. Our approach estimates unbiased gradients through a combination of path replay and local caching. This formulation enables efficient and stable optimization of material and lighting parameters in complex scenes, broadening the applicability of physically based inverse rendering. Project page: this https URL
88. 【2607.13250】AffectFlow-DINO: Uncertainty-Aware Multi-Task Affect Estimation via Conditional Rectified Flow
链接：https://arxiv.org/abs/2607.13250
作者：Salah Eddine Bekhouche,Abdellah Zakaria Sellam,Fadi Dornaika,Abdenour Hadid
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-task learning system, standard deterministic architecture, Monte Carlo sampling, conditional rectified-flow head, ABAW challenge
备注：
点击查看摘要
Abstract:We present \textbf{AffectFlow-DINO}, a multi-task learning system for the 11th ABAW challenge that extends a standard deterministic architecture with a conditional rectified-flow head to model the inherent ambiguity of in-the-wild facial behavior. Instead of predicting a single affect estimate, the model learns a conditional generative distribution, enabling uncertainty-aware one-to-many predictions through Monte Carlo sampling. The system jointly estimates continuous valence-arousal, classifies eight facial expressions, and detects twelve Action Units from static face images. Built on a frozen DINOv3 ViT-S/16 backbone, extensive ablation studies show that rectified-flow decoding consistently improves deterministic prediction, particularly for valence-arousal estimation (CCC-V $+0.058$). We further show that post-hoc threshold calibration effectively recovers performance on severely imbalanced rare classes (e.g., Fear: $3.8\% \rightarrow 33.1\%$) without retraining. Combined with backbone fine-tuning and flow retuning, the final model achieves $\mathbf{P_{MTL}=1.177}$, substantially outperforming the official challenge baseline of $P_{MTL}=0.45$.
89. 【2607.13245】Just-In-Time Scene Graph Growth: Combating Perceptual Saturation in Long-Horizon Robotics
链接：https://arxiv.org/abs/2607.13245
作者：Yue Chang,Rufeng Chen,Yifan Tian,Dazhi Huang,Zhaofan Zhang,Yi Chen,Wenze Zhang,Li Chen,Hui Xiong,Sihong Xie
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：provide crucial structured, crucial structured representations, severe observation redundancy, On-demand Memory Activation, Scene Graphs
备注：
点击查看摘要
Abstract:While 3D Scene Graphs (3DSGs) provide crucial structured representations for embodied agents, conventional Ahead-of-Time, build-everything-then-filter pipelines conflict with the real-time, low-latency demands of edge platforms, inducing a perceptual saturation effect via severe observation redundancy. To resolve this, we present JITOMA (Just-In-Time On-demand Memory Activation), a closed-loop framework that unifies task reasoning, perception, and memory into a just-in-time growth process. Instead of exhaustively mapping the entire environment, JITOMA leverages a top-down task heatmap at the frontend to filter continuous observations, routing minimal streams to maintain a global foundation of low-cost, dormant anchors. Upon a cognitive query, the backend Large Language Model (LLM) parses the robotic intent to dynamically awaken task-relevant anchors, triggering resource-intensive operations -- such as dense node captioning and functional inference -- exclusively within the activated local subgraph. To evaluate these dynamic capabilities and study perceptual saturation trade-offs, we introduce JITOMA-Bench, a comprehensive suite for long-horizon multi-tasking and complex multi-step reasoning. Extensive experiments demonstrate that JITOMA substantially reduces active graph size and captioning latency, while maintaining stable processing time under long-horizon task switching.
90. 【2607.13237】Active Learning for Efficient Annotation of Surgical Videos with Weak Supervision
链接：https://arxiv.org/abs/2607.13237
作者：Manasa Dendukuri,Matjaz Jogan,Daniel A. Hashimoto,Guiqiu Liao
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Precise spatial-temporal annotation, Precise spatial-temporal, time-consuming and requires, requires expert knowledge, Precise
备注： Accepted to IPCAI 2026
点击查看摘要
Abstract:Precise spatial-temporal annotation of laparoscopic videos is time-consuming and requires expert knowledge. We propose a human-in-the-loop knowledge acquisition framework that combines active learning with dual-loss optimization to significantly reduce the annotation effort needed for automatic localization and segmentation of objects in the surgical field. Our method employs a foundation model to generate temporally consistent class activation maps (CAMs) from video using two complementary training objectives: a weak supervision loss on video-level tool presence labels for weakly annotated data, and an image-level mask loss on human-corrected annotations obtained through active learning. Rather than requiring dense pixel-level annotation upfront, our pipeline iteratively proposes pseudo-masks that guide the expert annotator to refine the knowledge previously captured by the model. We demonstrate that our framework reduces the effort of surgical video annotation by 50% by the end of training in comparison to fully manual annotation. Through eliminating the need for large, fully annotated datasets from the start, this framework enables scalability to the development of surgical tool segmentation models. This iterative human-in-the-loop refinement supports efficient knowledge acquisition with minimal expert input, providing a practical and deployable strategy for expanding tool segmentation to larger, more diverse datasets and real-world clinical settings.
91. 【2607.13234】Continuously Evolving Deepfake Detection: An Architecture and Public-Benchmark Evaluation of a Dynamic Detection System
链接：https://arxiv.org/abs/2607.13234
作者：Ken Jon Miyachi,Dylan Uys
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：achieve near-perfect scores, report AUC drops, academic benchmarks collapse, Deepfake detectors, real-world content
备注： 16 pages, 1 figure
点击查看摘要
Abstract:Deepfake detectors that achieve near-perfect scores on academic benchmarks collapse on real-world content: recent in-the-wild evaluations report AUC drops of 45-50% for state-of-the-art open-source models. We argue this gap is structural: static detectors are trained once against a moving generative frontier. We present BitMind Forensics (BMF), trained through Bittensor SN34, an open adversarial competition that continually refreshes the training distribution. We evaluate one dated export comprising image, general-video, and human-video checkpoints across nineteen public datasets: the canonical face-swap suites (FaceForensics++, Celeb-DF v1/v2/++, DFDC, DFD, UADFV, DF40) and recent in-the-wild and AI-generated-media benchmarks (Sumsub, Deepfake-Eval-2024, WildRF, Community Forensics, AIGCDetectBench, GenImage, AI-GenBench, AIGIBench, RAID, GenVidBench, GenVideo-100K). BMF reaches 0.936 AUC on Sumsub's original images and 0.872 pooled AUC over its full four-condition manipulation battery (1.4M images), staying robust under perturbation (0.855 JPEG, 0.799 downscaled), while GPEN enhancement improves detection (0.996). On Deepfake-Eval-2024, it matches the best commercial detector on images (0.915 vs 0.90) and exceeds it on video (0.822 vs 0.79), far above the best open-source detectors (0.56 and 0.63). It reaches 0.991 AUC on a 21-generator AI-image panel and 0.918 on GenVidBench, and exceeds the FF++-trained frontier on DFDC (0.947 vs 0.843) and Celeb-DF v2 (0.9985 vs 0.956), both contamination-audited, with statistical parity on Celeb-DF++. In a temporal study, successive dated exports improve on held-out media from generators absent from the static baseline's training (image 0.842 to 0.902; video 0.864 to 0.936). Our evaluation harness is public, and at publication the production API serves the exact evaluated snapshot for independent verification.
92. 【2607.13192】Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?
链接：https://arxiv.org/abs/2607.13192
作者：Nusrat Munia,Tyler Ward,Nishat Nayla,Matthew A. Massey,Abdullah-Al-Zubaer Imran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：self-supervised and supervised, learning visual representations, powerful technique, unlabeled data, data
备注：
点击查看摘要
Abstract:Self-supervision is a powerful technique for learning visual representations from unlabeled data. Existing techniques primarily adopt a two-stage approach for self-supervised learning (SSL): a pretraining stage on unlabeled data followed by a finetuning stage on labeled data. While this pipeline has demonstrated extreme effectiveness, the interaction between self-supervised and supervised learning objectives remains insufficiently understood. In this work, we systematically investigate whether jointly optimizing the self-supervised and supervised objectives during training provides a better alternative. We compare two training paradigms: (1) the aforementioned pretraining followed by finetuning (PFT) and (2) joint training (JT), where self-supervised and supervised losses are optimized simultaneously in the same network. Across eight representative SSL methods and diverse computer vision tasks on natural, medical, crisis response, and remote sensing data, we evaluate performance under varying percentages of labeled data. Our results reveal that the relative effectiveness of PFT and JT depends strongly on the task at hand, the availability of labeled data, and the complexity of the domain. We find that JT consistently improves data and training efficiency while being robust in low-label settings, while PFT is more reliable in more specialized domains. We further analyze representation quality, robustness, and cross-domain generalization, providing new insights into how self-supervised and supervised objectives interact during optimization. We establish a comprehensive empirical benchmark for hybrid SSL-based semi-supervised learning and offer practical guidance for selecting appropriate training strategies across diverse vision applications.
93. 【2607.13187】MGFace: Mask-Gated Face Matching via Conditional Similarity Routing
链接：https://arxiv.org/abs/2607.13187
作者：Huy Che,Hoang-Minh Trinh,Dinh-Duy Phan,Duc-Lung Vu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable performance, normal conditions, achieved remarkable, Face, Face identification
备注：
点击查看摘要
Abstract:Face identification has achieved remarkable performance under normal conditions. Yet, its accuracy often degrades significantly when query faces are partially occluded, especially by facial masks. Existing re-ranking approaches improve robustness by exploiting patch-level similarities. Still, they often rely on costly, fine-grained matching mechanisms, which limit their efficiency in large-scale retrieval scenarios. In this paper, we propose MGFace, a mask-gated face identification pipeline that predicts the mask status of a query face and conditionally routes the similarity computation accordingly. Specifically, MGFace distinguishes between masked and unmasked queries, applies global embedding matching to unmasked queries, and activates mask-aware patch-level re-ranking only for masked queries. This design focuses on reliable upper-face regions while avoiding unnecessary fine-grained computation. Experiments on the extended LFW-Mask dataset show that MGFace achieves over 80% identification accuracy with the FaceNet backbone and over 90% with the ArcFace backbone. Compared with a previous EMD-based re-ranking method, MGFace achieves better identification performance while reducing query time by approximately 20x. These results demonstrate the effectiveness of MGFace in improving masked-face identification accuracy with low computational overhead. The source code is available at this https URL.
94. 【2607.13178】A Masked Autoencoder Approach to Unsupervised Steel Surface Defect Recognition
链接：https://arxiv.org/abs/2607.13178
作者：Shrey Patel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated visual inspection, recurring quality control, quality control task, steel surface defects, Automated visual
备注：
点击查看摘要
Abstract:Automated visual inspection of steel surface defects is a recurring quality control task in which labeled defect data is scarce and costly to obtain, while unlabeled surface images are abundant, which motivates self supervised methods that learn useful representations without class labels. A Transformer based Masked Autoencoder is used here to learn representations of steel surface defects for unsupervised grouping. During pretraining, 75% of the input image patches are randomly masked, and a lightweight decoder reconstructs the masked regions from the visible 25%. The encoder is trained jointly with an auxiliary defect localization objective, used only as a training signal and not evaluated as a detector. The decoder reaches a structural similarity score of 0.92 and a mean squared error of 0.47. Features from the pretrained encoder are then clustered using UMAP for dimensionality reduction and Agglomerative clustering, reaching a Hungarian matched accuracy of 91.3% against the six known defect categories.
95. 【2607.13164】xt2Sign: A Single-GPU Diffusion Baseline for Text-to-Sign Language Video Generation
链接：https://arxiv.org/abs/2607.13164
作者：Ruize Xia
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：primary communication channel, video diffusion models, video generation remains, millions of Deaf, generation remains costly
备注：
点击查看摘要
Abstract:Sign language is a primary communication channel for millions of Deaf and hard-of-hearing people, yet text-to-signer video generation remains costly because video diffusion models are expensive to train and evaluate. This paper presents Text2Sign, a text-conditioned diffusion model for short sign-language clips that runs on a single NVIDIA L4 GPU. It combines a frozen vision-language text encoder with a 3D encoder-decoder and factorized spatiotemporal attention to reduce the cost of full-video attention while preserving motion coherence. We compare convolution-only and transformer-style backbones, frozen pretrained and task-specific text encoders, and factorized versus full attention. On a signer-disjoint How2Sign split, the best short-run ablation reaches a validation loss of 0.0648, while a longer-run checkpoint reaches 0.00999. On a compact evaluation slice, the latter achieves an SSIM of $0.2403 \pm 0.0238$, a PSNR of $15.11 \pm 0.42$ dB, and temporal consistency of $1.0000 \pm 0.0000$ using 8-step DDIM sampling with a guidance scale of 5.0. It generates a 32-frame, $64 \times 64$ clip in 12.60 seconds, or 2.54 frames per second, with peak inference memory of 3.12 GB. A held-out denoising audit shows only weak prompt sensitivity: removing text increases late-timestep loss from 0.9875 to 0.9891, while shuffled prompts perform similarly to correct prompts. Frozen text conditioning therefore improves short-budget validation loss, but prompt-specific separation remains limited. The system is restricted to low-resolution, short clips and lacks expert linguistic evaluation, so it should be viewed as a single-GPU research baseline rather than a complete sign-language production system. Code is available at this https URL.
Subjects:
Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2607.13164 [cs.CL]
(or
arXiv:2607.13164v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.13164
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
IEEE Access, vol. 14, pp. 64003-64017, 2026
Related DOI:
https://doi.org/10.1109/ACCESS.2026.3686260
Focus to learn more
DOI(s) linking to related resources</p>
96. 【2607.13125】Boogu-Image-0.1: Boosting Open-Source Unified Multimodal Understanding and Generation
链接：https://arxiv.org/abs/2607.13125
作者：Guoxuan Chen,Chufeng Xiao,Haoran Yang,Siyue Xie,Binxiao Huang,Ming Zhang,Cheuk Him Chau,Xinyu Fu,Yingzhao Lian,Tom S.Y. Li,Jintao Lin,Bowen Dong,Zian Qian,Yuhao Liu,Yuxuan Hu,Weikang Shi,Bin Zou,Bowen Zheng,Haoxuan Che,Chang Chen,Yuyang He,Heyang Sun,Tianyu Huang,Chong Hou Choi,Cheng Gong,Han Shi,Haoli Bai,Xihui Liu,Hongsheng Li,Qifeng Chen,Chao Huang,Rui Liu,Chenyang Lei
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：
备注：
点击查看摘要
None
97. 【2607.13116】C-Norm: Cell-Distribution Normalization Enables Precision Recognition of Medical-Cell Image
链接：https://arxiv.org/abs/2607.13116
作者：Yang Qianl,Liu Xiany,Dai Daw,Chen Jing,Shen Xiaoj,Fu Kaiw,Tang Ming,Zou Dongl
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ThinPrep Cytologic Test, Cytologic Test, enables early cervical, cervical cancer screening, early cervical cancer
备注： 33;11
点击查看摘要
Abstract:ThinPrep Cytologic Test (TCT) enables early cervical cancer screening, but manual reading is time-consuming and yields inconsistent diagnostic results among cytopathologists. Existing AI detection models perform poorly under real clinical conditions, primarily restricted by two key constraints: unbalanced spatial distribution of cell populations in TCT slides, and limited high-quality annotated cytology data relying on professional pathologist labeling. To address these limitations, we propose a Cell-Distribution Normalization (C-Norm) method. By decoupling abnormal and normal cells from the original TCT images and re-synthesizing them, this method ensures a uniform distribution of cell populations, thereby mitigating generalization degradation caused by distribution bias. Building upon this, we integrate the YOLOv12 framework with a DINOv3 module. This hybrid architecture leverages the advanced detection capability of YOLO models and the superior feature representations of DINOv3 to capture subtle morphological nuances essential for precise recognition of TCT images. Extensive experiments demonstrate that our proposed method achieves state-of-the-art performance, significantly outperforming mainstream detection algorithms. The complete implementation is available at: this https URL
98. 【2607.13043】Beyond Backbone Backpropagation: A Decoupled Strategy for Efficient Transfer Learning
链接：https://arxiv.org/abs/2607.13043
作者：Daniel Vila-Cruz,Laura Morán-Fernández,Verónica Bolón-Canedo
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning models, face deployment challenges, deployment challenges due, learning models achieve, Deep learning
备注：
点击查看摘要
Abstract:Deep learning models achieve state-of-the-art image classification but face deployment challenges due to computational costs and energy demands. We propose a lightweight training strategy that adapts normalization layers of the model to the new domain and decouples feature extraction from classifier optimization, reducing overhead by precomputing features only once. A redesigned classifier head with margin-based weighted loss further minimizes ambiguity without end-to-end backpropagation. Evaluated across four CNN architectures (ResNet18, ResNet50, MobileNet, DenseNet121), three Transformer models (ViT, Swin and DeiT) and three medical datasets (Brain Cancer MRI, BreakHis and PatchCamelyon), our approach significantly reduces the required training time with only a marginal accuracy trade-off, often matching or surpassing baseline performance. This efficiency translates to reducing CO2 by orders of magnitude, offering a practical and environmentally sustainable solution for resource-constrained clinical or prototyping environments.
99. 【2607.13812】CAM-Diff: Triplane-Aware Cross-Attention Medical Diffusion Model
链接：https://arxiv.org/abs/2607.13812
作者：Zhenkai Zhang,Krista A. Ehinger,Tom Drummond
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：introduce TCAM-Diff, generate high-resolution, reduces the memory, memory requirements, requirements to encode
备注： Accepted at AAAI 2025. Code is available at [this https URL](https://github.com/Fredy-Zhang/TCAM-Diff)
点击查看摘要
Abstract:We introduce TCAM-Diff, a novel 3D medical image generation model that reduces the memory requirements to encode and generate high-resolution 3D data. This model utilizes a decoder-only autoencoder method to learn triplane representation from dense volume and leverages generalization operations to prevent overfitting. Subsequently, it uses a triplane-aware cross-attention diffusion model to learn and integrate these features effectively. Furthermore, the features generated by the diffusion model can be rapidly transformed into 3D volumes using a pre-trained decoder module. Our experiments on three different scales of medical datasets, BrainTumour 128 x 128 x 128, Pancreas 256 x 256 x 256, and Colon 512 x 512 x 512, demonstrate outstanding results. We utilized MSE and SSIM to assess reconstruction quality and leveraged the Wasserstein Generative Adversarial Network (W-GAN) critic to assess generative quality. Comparisons with existing approaches show that our method gives better reconstruction and generation results than other encoder-decoder methods with similar-sized latent spaces.
100. 【2607.13601】Video to All-in-focus Image Reconstruction Algorithm for Automated Microscopic Urinalysis
链接：https://arxiv.org/abs/2607.13601
作者：Chinmay Nema,Hari Om Aggrawal,Dipam Goswami,Rajiv Gupta,Vinti Agarwal
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：
备注：
点击查看摘要
None
101. 【2607.13204】Efficient Computing for Medical Image Acquisition and Reconstruction
链接：https://arxiv.org/abs/2607.13204
作者：Xiao Wang,Jayasai Rajagopal,Md Safaiat Hossain,Peng Chen,Mohamed Wahib,Enzhi Zhang,Emma J. Reid
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Mathematical Physics (math-ph)
关键词：Medical imaging systems, reconstruction, Medical imaging, imaging, Medical
备注： book chapter for textbook "Medical Image Vision Handbook"
点击查看摘要
Abstract:Medical imaging systems such as CT, MRI, PET, and SPECT do not directly acquire images. Instead, they measure physical signals that encode anatomical or physiological information, and image reconstruction recovers the underlying image by solving an inverse problem. Although these imaging modalities are governed by different imaging physics, they share a common computational framework that naturally connects medical physics, linear algebra, probability, numerical optimization, and efficient computing. As medical imaging systems acquire increasingly large and higher-dimensional datasets, image reconstruction has become one of the primary computational bottlenecks in modern medical imaging. Advanced reconstruction methods, including analytical reconstruction, iterative optimization, and statistical model-based reconstruction, substantially improve image quality while reducing radiation dose or scan time, but at significantly increased computational cost. Efficient computing has therefore become essential for achieving clinically practical reconstruction times. This chapter presents a unified computational perspective on medical image acquisition and reconstruction across CT, MRI, PET, and SPECT. It first reviews the imaging physics and data acquisition process for each modality and derives a generalized mathematical framework for image reconstruction. Building on this framework, the chapter discusses analytical, iterative, and statistical reconstruction methods together with their computational characteristics. Finally, it examines efficient computing considerations, including optimization algorithms, physics-aware forward operators, memory-efficient implementations, and parallel computing strategies. Together, these topics demonstrate how the integration of imaging physics, mathematical modeling, and efficient computing enables accurate and scalable medical image reconstruction.
102. 【2607.10057】Quantum Circuit Vision: Cost-Aware Evaluation of Visual AI Agents for Quantum Code Generation
链接：https://arxiv.org/abs/2607.10057
作者：Dongping Liu,Aoyu Zhang,Luyao Zhang
类目：Quantum Physics (quant-ph); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：visually comprehend quantum, agents visually comprehend, Quantum Circuit Vision, comprehend quantum circuit, generate verified executable
备注：
点击查看摘要
Abstract:Can AI agents visually comprehend quantum circuit diagrams and generate verified executable code--and at what cost? We present Quantum Circuit Vision, a cost-aware evaluation framework for multimodal AI agents on quantum circuit visual understanding. We construct a 132-circuit benchmark spanning 13 categories ($1$--$10$ qubits) with executable Amazon Braket code and unitary-fidelity verification. Evaluating three frontier Claude-family models at different capability-cost tiers with $n=5$ repeated trials, we find that the mid-tier model (Sonnet 4.6, $1.30\times$ credits) offers the most favorable balance on the cost-accuracy frontier: 91% pass rate on the core subset at 18% of the per-call cost of the strongest model (Opus 4.6), whose accuracy advantage is not statistically significant (paired $t$: $p=0.083$). Logistic regression confirms that circuit depth--not qubit count--is the primary predictor of failure ($p0.001$). Chain-of-thought prompting shows no statistically significant effect (all $p0.18$, $n=5$), suggesting that visual pattern recognition outweighs explicit reasoning strategy for structurally coupled diagrams. We propose a cascade routing strategy (cheap $\rightarrow$ expensive models) that achieves 84% accuracy at 38% of single-model cost, demonstrating that model routing dominates prompt engineering as a cost lever. We release QCV-Dataset (132 circuits, 5 modalities, 1,931 files) on Hugging Face Hub as an open evaluation infrastructure with structured metadata for discoverability, interoperability, and responsible AI documentation, and all evaluation code, cost logs, and verification scripts on GitHub for full reproducibility.
