本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新553篇论文，其中：

自然语言处理44篇
信息检索5篇
计算机视觉99篇

自然语言处理

1. 【2607.07708】Accurate, Interdisciplinary and Transparent Structure-property Understanding with Deep Native Structural Reasoning

链接：https://arxiv.org/abs/2607.07708

作者：Chen Tang,Yizhou Wang,Jianyu Wu,Lintao Wang,Shixiang Tang,Pengze Li,Encheng Su,Jun Yao,Jiabei Xiao,Yuqi Shi,Jielan Li,Hongxia Hao,Zhangyang Gao,Fang Wu,Ben Fei,Xiangyu Yue,Pan Tan,Bozitao Zhong,Jinouwen Zhang,Aoran Wang,Yan Lu,Jiaheng Liu,Xinzhu Ma,Liang Hong,Mingyue Zheng,Phil Torr,Bowen Zhou,Wanli Ouyang,Lei Bai

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG)

关键词：physical response emerge, Structure-property relationships, foundational to biology, emerge from spatial, response emerge

备注：

点击查看摘要

Abstract:Structure-property relationships are foundational to biology, chemistry and materials science, where function, reactivity and physical response emerge from spatial, chemical and periodic organization. Mechanistically explaining these relationships requires interpreting structural evidence through scientific principles and physical constraints, from stereochemistry and bonding to symmetry, energetics and periodic order. However, applying artificial intelligence to this process presents a joint challenge of representation and reasoning: models must preserve domain-native structural information while showing how specific evidence supports predictions under these constraints. Here we introduce SciReasoner, a multimodal scientific foundation model for native structural reasoning across proteins, small molecules and inorganic crystals. SciReasoner discretizes coordinates, topologies and periodic connectivities into a unified structure-aware vocabulary, treating structural tokens as addressable evidence units during reasoning. In homology-controlled Gene Ontology prediction, SciReasoner improves Cellular Component annotation for low-homology and orphan-like proteins, increasing $F_{\max}$ from 0.42 to 0.55. In chemistry, it raises single-step retrosynthesis accuracy from 0.63 to 0.72 while generating fragment-level disconnection and precursor-verification traces. In materials science, its representations separate elemental and compound phases and resolve high- and low-band-gap regimes. Across 86 benchmarks, SciReasoner achieves state-of-the-art performance on 67 tasks. Double-blind expert evaluation rates its reasoning traces as preferred or at least comparable to those of a frontier large language model in 98% of cases. By making structure an inspectable substrate for reasoning under scientific constraints, SciReasoner connects accurate prediction with interpretable scientific inference.

2. 【2607.07707】Co-LMLM: Continuous-Query Limited Memory Language Models

链接：https://arxiv.org/abs/2607.07707

作者：Yair Feldman,Linxi Zhao,Nathan Godey,Dongyoung Go,Yilun Hua,Kilian Q. Weinberger,Jennifer J. Sun,Yoav Artzi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Limited memory language, Limited memory, memory language models, memory language, externalize factual knowledge

备注： preprint

点击查看摘要

Abstract:Limited memory language models (LMLMs) externalize factual knowledge during pretraining to a knowledge base (KB), rather than memorizing it in their weights. During generation, the model then fetches knowledge from the KB as needed. This recently introduced paradigm provides multiple advantages, including knowledge control capabilities that remain beyond conventional LLMs. We propose continuous-query LMLM (CO-LMLM), where the KB pairs continuous keys with textual knowledge values, a significant departure from prior reliance on relational KB and queries. CO-LMLM generates flexible vector queries at minimal cost, while still integrating human-readable and attributable retrieved knowledge into its generation. We pair this design with an annotation pipeline that tags free-form factual spans in arbitrary text, removing prior work's restriction to Wikipedia. Across pretraining on Wikipedia and FineWeb-Edu and at multiple model scales, CO-LMLM outperforms prior LMLMs and vanilla LLMs in both perplexity and factual precision. At 360M scale, this includes lower perplexity than models pretrained on 40x more data, and SimpleQA-verified performance that is in line with gpt-4o-mini and higher than Claude Sonnet 4.5.

3. 【2607.07702】From Noisy Traces to Root Causes: Structural Trajectory Analysis and Causal Extraction for Agent Optimization

链接：https://arxiv.org/abs/2607.07702

作者：Ying Chang,Jiahang Xu,Xuan Feng,Chenyuan Yang,Peng Cheng,Yuqing Yang

类目：Computation and Language (cs.CL)

关键词：large language model, improve agent policies, long-horizon agents increasingly, agents increasingly relies, reflection-based mechanisms

备注：

点击查看摘要

Abstract:The optimization of long-horizon agents increasingly relies on reflection-based mechanisms, where a large language model (LLM) acts as an optimizer to diagnose agent failures and improve agent policies. However, real execution traces are difficult to use directly for optimization: large trace collections are often redundant and heterogeneous, making optimization inefficient and prone to overfitting to low-value failures; meanwhile, each individual trajectory also contains many irrelevant steps, while naive context reduction methods such as truncation or sliding windows can discard causally important evidence and produce misleading optimization signals. To resolve this dilemma, we introduce STRACE (Structural TRajectory Analysis and Causal Extraction), a framework that constructs high signal-noise optimization contexts for more precise and effective optimization. At the batch level, STRACE mines failure patterns to filter redundant traces and retain representative failures; within each selected trace, it performs causal localization over a textual dependency graph to remove non-causal steps and identify the true root-cause module for optimization. Empirical results demonstrate that STRACE significantly outperforms standard context-filtering baselines. Notably, on a challenging formal verification task (VeruSAGE-Bench), it successfully optimizes human-expert designed agents, delivering $1.4\times$ success-rate improvement (42.5% to 58.5%). The code is available at this https URL .

4. 【2607.07690】Agon: Competitive Cross-Model RL with Implicit Rival Grading of Reasoning

链接：https://arxiv.org/abs/2607.07690

作者：Vladislav Beliaev

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Reinforcement learning, learning from verifiable, engine behind today, today reasoning models, Reinforcement

备注： 15 pages, 7 figures, 8 tables

点击查看摘要

Abstract:Reinforcement learning from verifiable rewards (e.g. GRPO) is the engine behind today's reasoning models, yet it grades only the final answer. On hard problems this trains models to write more rather than to think better, since the trace itself is never graded and no label for good thinking exists. We introduce Agon, which makes two competing models each other's graders. Both attempt the same problem; in alternating roles, one drafts a solution and the other reads it while solving, and each is rewarded for out-solving the other. To win, a model must out-reason a rival that has seen its work, so reasoning is judged implicitly during training, with no process labels and no reward model. Because both models are optimized, each faces a progressively stronger rival, which single-model RL cannot provide. The two need only be comparably strong and behaviorally different. At inference the pair deploys as it trains, a two-stage cascade in which one model drafts and the other answers after reading the draft. On the hard split of DeepMath with Qwen3, this doubles GRPO's pass@1, roughly eight times the gain of an untrained Mixture-of-Agents pass over the same base. The ordering replicates on competitive-programming code and across model families (Qwen3.5, Gemma 4). For now the models talk in text; the next step is to let them reason together in latent space.

5. 【2607.07674】Max Out GRPO Signal: Adaptive Trace Prefix Control for Hard Reasoning Problems

链接：https://arxiv.org/abs/2607.07674

作者：Vladislav Beliaev

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Relative Policy Optimization, Group Relative Policy, Policy Optimization, group-relative advantages vanish, Relative Policy

备注： 13 pages, 5 figures, 3 tables

点击查看摘要

Abstract:Group Relative Policy Optimization (GRPO) stalls on a model's hardest problems: when no rollout in a group succeeds, the group-relative advantages vanish and the problem contributes no gradient, wasting the frontier examples we most want to learn from. Prepending a correct prefix of a reference solution raises the success rate, making prefix length a continuous knob on difficulty. Concurrent methods set the knob once; AdaPrefix-GRPO turns it into a feedback controller: throughout training it adjusts how much of the solution each problem gets, holding its success rate near 50%, where GRPO's gradient signal is largest, then withdraws the assistance entirely, so the deployed model solves problems unaided. On hard math, at matched training FLOPs, it more than doubles GRPO's accuracy on held-out problems from the training distribution for a 0.6B model (2.1x), with 1.6x on Qwen3-1.7B and 1.7x on AIME, while roughly halving trace length. The method is implemented in data preparation plus a loss mask on prefix tokens; the trainer is otherwise stock. The smaller the model, the larger the gain.

6. 【2607.07670】Does Bielik Know What It Doesn't Know? Activation Dispersion Separates Entity Familiarity from Factual Reliability Across Model Scale

链接：https://arxiv.org/abs/2607.07670

作者：Grzegorz Brzezinka

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：language models hallucinate, Large language models, Polish Bielik models, Large language, Polish Bielik

备注： 23 pages, 6 figures and 7 tables

点击查看摘要

Abstract:Large language models hallucinate most about entities they have never seen. We ask whether a model's activations betray entity familiarity before a single answer token is generated, and whether that signal predicts the factual reliability of the answers. On four Polish Bielik models (1.5B-11B parameters), we probe four entity domains (athletes, cities, writers, musicians), each with 42 well-known, 42 obscure-but-real, and 42 fabricated entities addressed by a one-sentence question (504 prompts per model). Two unsupervised, single-forward-pass dispersion measures over post-SwiGLU MLP activations, inverse participation ratio and spectral entropy, separate known from fabricated entities at AUROC 0.95-1.00 across all domains and scales; a supervised linear probe reaches 0.99-1.00. Both clear selection-aware permutation floors of about 0.70-0.74 (empirical p=1e-3), survive held-out layer selection (0.93-0.99), and persist on real names (known vs. obscure-but-real: 0.96-1.00). The signal transfers across entity types (mean off-diagonal AUROC 0.92-0.99); a matched-template counterfactual shows the only large drops are template-caused, not entity-type effects, and the signal is diffuse across heads. This representational signal is already at ceiling at 1.5B, whereas behavioral factual reliability scales sharply: 0, 2, 10, and 19 of 42 known athletes are answered fully correctly by the 1.5B, 4.5B, 7B, and 11B models under a strict judge. Within known entities, separating correct from hallucinated answers is much harder (probe 0.93; dispersion no better than a first-token-entropy baseline). A five-sample semantic-entropy baseline reaches only 0.71-0.83 at 5x the inference cost. Despite this internal awareness, the models almost never abstain: an audit of 2,520 answers finds 2 refusals and 1 hedge. Entity familiarity and factual reliability are distinct phenomena on different scaling curves.

7. 【2607.07669】DiaLLM: An Investigation into the Robustness-Generation Gap in English Dialect Adaptation

链接：https://arxiv.org/abs/2607.07669

作者：Jordan Painter,Dipankar Srirag,Adarsh Kappiyath,Diptesh Kanojia,Aditya Joshi,Lu Yin

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Large language models, Northern British English, language models increasingly, Large language, US-leaning English

备注：

点击查看摘要

Abstract:Large language models increasingly \emph{understand} dialectal English, yet still \emph{produce} only standard, US-leaning English, leaving dialectal generation, the harder half of the problem, largely unaddressed. We introduce \textbf{DiaLLM}, which continually pretrains three open-weight language model families on the International Corpus of English and applies implicit and explicit post-training paradigms, each combined with three model alignment strategies, giving the first controlled comparison of these components across Australian, Indian, and Northern British English. Our results reveal that dialectal robustness and generation are \emph{dissociated}: benchmarks are shaped by continual pretraining and SFT, while alignment visibly reshapes generation in ways benchmarks do not capture. Explicit variety-targeted adaptation produces output reliably recognised as dialectal and preferred over broad alignment, yet the method that most aggressively optimises the dialectal reward is not preferred by human evaluators. Independent linguistic analysis corroborates this reward-quality gap, most clearly on two of the three families. No single alignment method dominates, and closing the gap will require richer reward designs and continued investment in dialectal resources. We release all code, checkpoints, and preference datasets.

8. 【2607.07646】RL Post-Training Builds Compositional Reasoning Strategies

链接：https://arxiv.org/abs/2607.07646

作者：Azwar Abdulsalam,Nishil Patel,Andrew Saxe

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：amplify primitive skills, compose primitive skills, primitive skills, post-training merely amplify, primitive

备注： 8 pages, 6 figures. Accepted to the 2nd Workshop on Compositional Learning at ICML 2026, Seoul, South Korea

点击查看摘要

Abstract:Does RL post-training merely amplify primitive skills already latent in a base model, or can it compose primitive skills into new higher-level strategies? We study this question in a fully observable rewrite-grammar environment where the pretraining distribution is known and every generated rewrite can be audited. A Transformer is pretrained on primitive symbol-rewrite chains and post-trained on a Trace-based reasoning task with only a binary final-answer reward. RL solves held-out problems that remain rarely solved by the pretrained model even under much larger sampling budgets, while rejection fine-tuning improves early but plateaus. Trace analysis shows that RL reorganizes primitive competence through a phased compositional mechanism: it first strengthens primitive reductions, then discovers valid composed procedures. These include sequential compositions, which collapse ordered chains of primitive contractions, and parallel compositions, which combine independent primitive contractions in a single step. The composed procedures are not isolated samples; they are reused and consolidated into a stable repertoire. Comparing RL with rejection fine-tuning shows that the key difference is not exploration volume but selectivity: RFT produces many shortcut-like rewrites, much of them invalid, whereas RL concentrates exploration into valid reusable structure. Pretraining ablations show that the emergence of compositional strategies is gated not by primitive exposure alone, but by whether pretraining organizes primitive competence into reduction procedures that RL can later compress. The base model provides weak procedural ingredients; RL builds them into reliable higher-level strategies.

9. 【2607.07626】Future Confidence Distillation in Large Language Models

链接：https://arxiv.org/abs/2607.07626

作者：Sahil Kale

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：deploying large language, adaptive computation depend, large language models, estimating answer reliability, accurately estimating answer

备注： 16 pages, 5 figures

点击查看摘要

Abstract:Reliable confidence estimation is essential for deploying large language models (LLMs) in confidence-aware systems, where downstream decisions such as retrieval, tool use, and adaptive computation depend on accurately estimating answer reliability. Existing approaches, however, largely treat confidence as a property of completed responses, overlooking how confidence-related information evolves throughout the answering process. In this work, we investigate confidence from a temporal perspective by comparing pre-solution Feeling-of-Knowing (FOK) and post-solution Judgement-of-Learning (JOL) confidence estimates across frontier and open-source LLMs. We show that post-solution confidence is consistently better calibrated and more discriminative than pre-solution confidence, while linear probes trained on hidden representations recover substantially richer confidence-related information than models explicitly verbalise. Building on this observation, we introduce future confidence distillation, which trains predictors operating on pre-solution hidden representations using teacher confidence estimates produced by post-solution correctness probes. Despite requiring only pre-solution representations for inference, distilled predictors recover much of the calibration improvement achieved by post-solution confidence, remain highly sample efficient, and transfer across datasets within the same domain. Together, our findings demonstrate that confidence-related information evolves throughout the answering process and can be anticipated before answer generation is complete, enabling significantly more reliable yet low-cost confidence estimation.

10. 【2607.07557】PALS: Percentile-Aware Layerwise Sparsity for LLM Pruning

链接：https://arxiv.org/abs/2607.07557

作者：Yazdan Jamshidi,Alexey Shvets

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：One-shot pruning methods, layer importance, ignoring known variation, Percentile-Aware Layerwise Sparsity, One-shot pruning

备注：

点击查看摘要

Abstract:One-shot pruning methods like Wanda and SparseGPT apply the same sparsity ratio to every layer of a transformer, ignoring known variation in layer importance. We propose PALS (Percentile-Aware Layerwise Sparsity), which adjusts per-layer sparsity based on the 99th percentile of activation magnitudes, bounded to $\pm 5\%$ around the target ratio. On LLaMA-2-7B at 50\% sparsity, PALS achieves 10.96 WikiText-2 perplexity versus 12.92 for uniform Wanda (mean over 9 runs, $p 0.001$). The benefit is architecture-dependent: LLaMA-3-8B shows marginal gains and Mistral-7B shows none. We also find that gradient-based allocation -- the seemingly more principled approach -- produces results worse than random, suggesting that gradient magnitude does not predict the impact of discrete weight removal. PALS adds negligible cost to the pruning pipeline and requires no fine-tuning.

11. 【2607.07548】hink Big, Search Small: Where Capacity Matters in Hierarchical Search Agents?

链接：https://arxiv.org/abs/2607.07548

作者：Qinnan Cai,Yibo Zhao,Xiang Li

类目：Computation and Language (cs.CL)

关键词：Large language model, increasingly adopt multi-agent, adopt multi-agent architectures, Large language, language model based

备注： 21pages

点击查看摘要

Abstract:Large language model based search agents increasingly adopt multi-agent architectures in which a main agent decomposes a complex question into sub-queries and dispatches them to parallel sub-agents. However, existing systems instantiate all roles from a single model of identical scale, leaving open how model capacity should be distributed across roles. We factorize hierarchical search into three roles: a delegation role responsible for task decomposition, an execution role responsible for retrieval and evidence extraction, and an answer generation role held fixed as a confound control. We then conduct controlled capacity sweeps along the delegation and execution axes on five multi-hop QA benchmarks. The experiments yield three findings. First, role factorization consistently outperforms a single-agent baseline, improving exact match from 4.5 to 8.6 points across six model scales. Second, capacity sensitivity is asymmetric: scaling the delegation backbone improves EM by ~11 points, whereas scaling the execution sub-agent moves EM by only ~2.6 points, identifying decomposition as the capability bottleneck. Third, a 1.7B-parameter executor trained via quality-filtered trajectory distillation matches a frontier sub-agent in accuracy while consuming 37% fewer sub-agent tokens, advancing the Pareto frontier. These results suggest a concrete recipe for building hierarchical search agents: concentrate capacity at delegation and downsize execution without sacrificing accuracy. Our code is available at this https URL.

12. 【2607.07478】FourierQK: Spectral Preprocessing of Query-Key Projections Improves Transformer Attention

链接：https://arxiv.org/abs/2607.07478

作者：Athanasios Zeris

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Signal Processing (eess.SP)

关键词：character-level language modelling, Delta, substantially improves transformer, language modelling, achieves val

备注： 16 pages, 2 figures, 7 tables

点击查看摘要

Abstract:FFT-based spectral preprocessing of learned query-key (Q/K) projections substantially improves transformer attention on character-level language modelling. On TinyShakespeare: a fixed random spectral filter achieves val=1.031 (Delta=+0.443); a single learned frequency at paragraph scale achieves val=0.608 (Delta=+0.867); and four learned frequencies spanning paragraph to word scale achieve val=0.309 (Delta=+1.166), a 79% reduction over standard dot-product attention. The single-frequency result is confirmed across three random seeds (mean val=0.236, std=0.019). The four frequencies converge to a near-geometric multi-scale ordering (49, 27, 10, 6 tokens/cycle) corresponding to paragraph, sub-paragraph, phrase, and word scales. The gain is specific to spectral preprocessing: random orthogonal and non-orthogonal projections of Q/K produce no measurable improvement, suggesting the benefit comes from global frequency-domain mixing rather than metric distortion. All results are verified by a shuffled-validation diagnostic against positional leakage. Causal filters (Gaussian, Mexican Hat, Morlet) do not improve over standard attention at character-level tokenisation: the bilateral FFT kernel is structurally non-causal, coupling every position to future tokens. This defines an architectural boundary between bilateral spectral attention (this paper) and genuinely causal spectral attention at word-scale tokenisation (companion paper MorletQK). This work is architecturally distinct from FNet (Lee-Thorp et al., 2021), which replaces attention with Fourier mixing of token embeddings. Here, spectral preprocessing applies only to Q/K projections while the full attention score structure is preserved.

13. 【2607.07474】Beyond Attack-Success Rate: Action-Graded Severity Scale for Tool-Using AI Agents

链接：https://arxiv.org/abs/2607.07474

作者：Harry Owiredu-Ashley

类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Agentic red-teaming benchmarks, Agentic red-teaming, single bit, attack succeeded, red-teaming benchmarks report

备注： 8 pages, 6 figures. Code and artifacts: [this https URL](https://github.com/Harry-Ashley/action-graded-severity)

点击查看摘要

Abstract:Agentic red-teaming benchmarks report whether an injected agent was compromised as a single bit: the attack succeeded, or it did not. We argue that this binary attack-success rate discards the information a defender most needs, namely how harmful the resulting action was. We introduce an action-graded harm rubric that scores an agent's tool-call trajectory on a seven-level ordinal scale (L0 to L6) according to whether the executed action was reversible, whether it crossed scope to reach another party, and whether it expanded privilege. We compute the scale two ways: a deterministic oracle that reads the trajectory and the attacker's stated goal, and a panel of three frontier language-model judges that read a tag-free account of the same trajectory. Across four victim models and two defenses on the AgentDojo workspace suite, severity grading exposes three cases the binary metric hides, including a defense that reports a zero attack-success rate while still permitting an externally visible cross-scope leak through an unfiltered tool. The judge panel reproduces the oracle with high ordinal agreement (Krippendorff's alpha = 0.91) but shares systematic blind spots that we characterize, most notably a failure to recognize escalation chains. Unlike prior work that provides harm taxonomies, harmful-task completion tests, execution-level safety benchmarks, or severity-aware simulation, our contribution is a reusable, trace-grounded severity instrument applied to the actual actions recorded in existing red-team logs. All code, prompts, and per-episode logs are released.

14. 【2607.07469】SynthAVE: Scalable Synthetic Labeling for E-Commerce with LLM-Arena Validation

链接：https://arxiv.org/abs/2607.07469

作者：Andrea Scarinci,Virginia Negri,Brayan Impata,Suleiman Khan,Victor Martinez,Marcello Federico

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Fine-tuning large language, labeled data representative, Fine-tuning large, requires labeled data, labeled data

备注：

点击查看摘要

Abstract:Fine-tuning large language models (LLMs) for e-commerce attribute extraction requires labeled data representative across thousands of product types, attributes, and multiple languages. This combinatorial scale translates to millions of annotations, rendering human labeling prohibitively costly. While recent work has demonstrated synthetic label generation using LLMs, deploying such approaches at industrial scale requires integrated quality control mechanisms. We present SynthAVE, a large-scale human-validated benchmark for attribute value extraction spanning 12,726 products across 229 product types, 792 attributes, and 4 languages (Spanish, French, Italian, German). To validate synthetic labels at scale, we introduce a multi-LLM arena framework where samples are independently evaluated by 21 judge configurations (7 model families $\times$ 3 prompts), with final labels determined via majority voting. The majority vote ensemble agrees with human experts at Cohen's $\kappa = 0.92$ (95.2% agreement), while individual judges show substantial inter-model agreement (Fleiss' $\kappa = 0.76$). This demonstrates that diverse models with varying individual judgments aggregate into highly reliable predictions, enabling cost-effective validation at scale while maintaining quality parity with human review.

15. 【2607.07436】he Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents

链接：https://arxiv.org/abs/2607.07436

作者：Xing Zhang,Yanwei Cui,Guanghui Wang,Ziyuan Li,Wei Qiu,Bing Zhu,Peiyang He

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词：self-evolving agent retires, watching them fail, self-evolving agent, agent retires, retires its bad

备注：

点击查看摘要

Abstract:A self-evolving agent retires its bad skills by watching them fail, so what happens when the judge cannot see the failures? Skill retirement is the structural constraint that keeps a growing library from drifting below the no-skill baseline, but its guarantee assumes an unbiased reward, which is false for the LLM judges that reference-free tasks force upon us. We show that a biased judge does not merely add noise; it \emph{silently switches off the curator}. We make this precise with a corrupted-reward analysis and, isolating the causal channel by injecting corruption on top of a deterministic reward, a behavioral study on a reference-free report-writing testbed with a code-generation cross-check. Symmetric noise leaves retirement intact, but \emph{false-pass} bias (failures slipping through as passes) disables contribution-based retirement past a sharp threshold that no amount of data can cross. Separating genuine retirement from cap-eviction churn shows this \emph{mechanism} failure is universal, holding across domains and failure rates and sparing only near-zero-false-pass, verifier-like graders. The downstream \emph{outcome}, though, is regime-dependent: eval quality degrades only where the same corruption also starves skill synthesis, and otherwise holds steady, so the disabled curator is \emph{silent}, surfacing in no aggregate metric. The contribution is a behavioral safety result, not a performance one. A cheap defect-injection audit then tells an operator, before deployment, which side of the threshold their judge occupies.

16. 【2607.07409】DeLS-Spec: Decoupled Long-Short Contexts for Parallel Speculative Drafting

链接：https://arxiv.org/abs/2607.07409

作者：Hong-Kai Zheng,Piji Li

类目：Computation and Language (cs.CL)

关键词：decoding accelerates LLM, accelerates LLM inference, accelerates LLM, drafting multiple tokens, Speculative decoding accelerates

备注：

点击查看摘要

Abstract:Speculative decoding accelerates LLM inference by drafting multiple tokens and verifying them in parallel. Block-parallel drafters such as DFlash further improve drafting efficiency by predicting an entire block in one pass, but their position-wise predictions lack explicit intra-block causal conditioning. Recent methods such as Domino and DSpark attempt to introduce such causality into block-parallel drafting, but they require training the draft model from scratch, which limits their flexibility and increases training cost. We propose DeLS-Spec, a decoupled long-short context speculative decoding method. DeLS-Spec treats the fixed DFlash model as a long-context expert and introduces a lightweight local head as a short-context expert. The local head can be trained independently with a standard next-token prediction objective, without joint training with the target model or the DFlash backbone, leading to extremely low training cost. At inference time, DeLS-Spec combines long-context and short-context logits, and the local head is not tied to a specific DFlash checkpoint, making the method more modular and flexible. Experiments on Qwen3 models show that DeLS-Spec consistently improves speedup and average acceptance length over DFlash across math, code, and dialogue benchmarks.

17. 【2607.07408】ransformer-based segmentation of prosodic boundaries in Brazilian Portuguese

链接：https://arxiv.org/abs/2607.07408

作者：Rodrigo de Freitas Lima,Julio Cesar Galdino,Marcos Vinicius Treviso

类目：Computation and Language (cs.CL)

关键词：Automatic prosodic segmentation, linguistic evidence, segmentation identifies boundaries, prosodic segmentation identifies, units from acoustic

备注： 6 pages, 5 figures, submitted to an IEEE conference

点击查看摘要

Abstract:Automatic prosodic segmentation identifies boundaries between speech units from acoustic and linguistic evidence. Although recent deep learning approaches have produced strong results for English, automatic segmentation for Brazilian Portuguese (BP) still relies mostly on rule-based or traditional machine-learning methods. This paper presents SAMPA, a Whisper-based segmenter that transcribes BP speech while inserting explicit markers for terminal prosodic boundaries. We fine-tune Whisper large-v3 on manually segmented recordings from the NURC-SP dataset and evaluate different training and test-time filtering configurations, including out-of-distribution testing on the MuPe-Diversidades dataset. SAMPA achieves competitive boundary-detection performance across settings, with the best models reaching F1=0.731 on the held-out test split and F1=0.796 on MuPe-Diversidades. Finally, through n-gram and acoustic-visual analyses, we show that our model follows morphosyntactic, semantic, and prosodic cues for detecting prosodic boundaries.

18. 【2607.07388】F-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models

链接：https://arxiv.org/abs/2607.07388

作者：Yutang Ma,Kecheng Huang,Xikun Jiang,Zili Shao

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Large Language Models, dense Transformer parameters, Language Models, making knowledge expansion, knowledge expansion costly

备注： 13 pages, 2 figures

点击查看摘要

Abstract:Large Language Models (LLMs) store factual knowledge and domain-specific patterns implicitly in dense Transformer parameters, making knowledge expansion costly through pretraining, fine-tuning, retrieval augmentation, or longer contexts. Engram-style memory offers a compact hidden-state injection pathway, but existing GPU-resident designs often rely on hash-based compression, causing unrelated phrases to collide in shared slots and weakening phrase-level semantic fidelity. We present TF-Engram, a train-free Engram system that constructs phrase-specific semantic memory offline from external corpora, stores large memory tables across a GPU--DRAM--SSD hierarchy, and uses Early-Exit Guided Predictive Prefetching to hide external-memory latency during autoregressive decoding. On Qwen3-0.6B, TF-Engram improves the average downstream score from 57.6 to 59.4, outperforming both the frozen backbone and a parameter-matched LoRA baseline. System evaluation shows that large TF-Engram tables can be built with moderate offline cost, SSD-backed storage substantially reduces GPU memory demand, and predictive prefetching recovers much of the throughput loss caused by external memory access. These results demonstrate that static phrase memory can be integrated into LLM inference as a scalable, train-free, and low-overhead system component.

19. 【2607.07321】From Atomic Actions to Standard Operating Procedures: Iterative Tool Optimization for Self-Evolving LLM Agents

链接：https://arxiv.org/abs/2607.07321

作者：Haipeng Ding,Yuexiang Xie,Zhewei Wei,Yaliang Li,Bolin Ding

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词：Large Language Model, enables Large Language, utilization enables Large, Language Model, Large Language

备注：

点击查看摘要

Abstract:Tool utilization enables Large Language Model (LLM) agents to interact with the real world and resolve complex tasks. However, existing agent frameworks predominantly rely on static toolsets composed of granular atomic actions (e.g., basic file I/O or single-turn search), which forces agents to reinvent low-level logic for every recurring workflow, leading to increased reasoning overhead and failure rates. In this study, we propose that agents can achieve self-evolution by synthesizing these atomic actions into reusable Standard Operating Procedures (SOPs), which function as callable higher-order tools that encapsulate multi-step logic. We further introduce EvoSOP, a framework that empowers agents to extract SOPs from execution trajectories and iteratively optimize the toolset through a systematic lifecycle of construction, merging, evaluation, and pruning. Extensive experiments demonstrate that EvoSOP significantly boosts task success rates while substantially reducing the number of interaction rounds compared to baselines. Our analysis also reveals that iterative tool optimization fosters reliable and efficient tool-use patterns, providing a scalable pathway for the development of self-evolving agents.

20. 【2607.07318】R^3: Advertisement Compliance Rectification via Group-Relative Experience Extractor and Curriculum Reinforcement

链接：https://arxiv.org/abs/2607.07318

作者：Yuan Chen,Zhenyu Hu,Mengge Xue,Te Cao,Liqun Liu,Peng Shu,Huan Yu,Jie Jiang

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Rigorous content moderation, Rigorous content, daily rejections, content moderation, moderation is crucial

备注： ACL 2026 (Poster, Industry Track)

点击查看摘要

Abstract:Rigorous content moderation is crucial for online advertising but leads to millions of daily rejections. This scale renders manual rectification infeasible, particularly for video advertisements. However, existing safety-driven methods often suffer from aggressive over-editing, which compromises the advertiser's original semantic intent merely to satisfy compliance. In this work, we target the rectification of textual violations in video ads, covering both speech transcripts and on-screen text. We propose R^3, a novel framework designed to harmonize compliance with original semantic intent preservation. Our approach integrates three key innovations: (1) an experience-driven data synthesis framework that bootstraps high-quality supervision via a group-Relative compliance experience extractor; (2) a curriculum Reinforcement learning strategy with hierarchical rewards designed to enforce compliance while maximizing semantic consistency; and (3) a comprehensive video Rectification framework seamlessly integrating text recognition, rewriting, and re-rendering for industrial deployment. Extensive experiments on industrial datasets and online A/B testing demonstrate that R^3 significantly outperforms state-of-the-art baselines, achieving an optimal trade-off between violation rectification and intent preservation.

21. 【2607.07302】Evaluating RAG Metrics in Applied Contexts: An Experiment, Its Findings and Its Limitations

链接：https://arxiv.org/abs/2607.07302

作者：Quentin Brabant

类目：Computation and Language (cs.CL)

关键词：empirical study evaluating, reports an empirical, empirical study, study evaluating, evaluating the relevance

备注：

点击查看摘要

Abstract:This paper reports an empirical study evaluating the relevance of several RAG metrics. The experiment is based on a question-answering dataset created by human annotators from business data. The generated responses and retrieved spans of a RAG system are scored using evaluation metrics from four libraries (Ragas, DeepEval, RAGChecker, Opik). These metrics are compared to scores given by two evaluators, as well as to standard metrics such as recall. An analysis of correlations is conducted. Finally, we highlight certain limitations of our methodology, compare it to those used in the literature, and suggest some avenues for future research. This paper is an English translation of a paper originally published in the French-speaking workshop EvalLLM (Brabant, 2026).

22. 【2607.07294】Multimodal Voice Activity Projection for Turn-Taking in Social Robots with Voice-Activity-Related Pretrained Encoders

链接：https://arxiv.org/abs/2607.07294

作者：Antonio Cano,Guillermo Pérez,Luis Merino,Randy Gomez

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：social robots involved, anticipate conversational dynamics, Voice Activity Projection, social robots, robots involved

备注： Accepted for presentation at the 35th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2026). Acceptance notification date: 30 May 2026. Final published version pending

点击查看摘要

Abstract:Turn-taking prediction is a key requirement for social robots involved in human-human interaction, particularly in mediator settings, where the robot must anticipate conversational dynamics rather than merely react to pauses. This work presents a Multimodal Voice Activity Projection (MM-VAP) framework that extends the original audio-only VAP formulation to synchronized audio-visual inputs while preserving its self-supervised future-projection objective. The proposed approach builds on pretrained audio-visual backbones originally optimized for speech-related tasks and adapts them through Low-Rank Adaptation to the multimodal turn-taking problem. After independent speaker encoding, an inter-speaker attention stage models the relational dynamics required to project future voice activity. In addition, a semantic consistency loss is introduced to regularize the 256-state output space according to higher-level dialogue activity patterns. Experiments on NoXi and NoXi+J showed improvements over the current baselines, particularly for some turn-taking events. Additional evaluation on the Haru EDR corpus further supported the suitability of this direction for mediation-oriented human-robot interaction.

23. 【2607.07282】A Word-Level Digital Reader of the Prasthanatrayi with Sankara's Bhasya: Corpus, Method, and an Open, Offline Reading Aid for the Advaita Vedanta Canon

链接：https://arxiv.org/abs/2607.07282

作者：Tamal Maharaj

类目：Computation and Language (cs.CL); Digital Libraries (cs.DL)

关键词：ten principal Upanisads, Advaita Vedanta, principal Upanisads, Sankara commentaries, ten principal

备注：

点击查看摘要

Abstract:The Prasthanatrayi -- the ten principal Upanisads, the Brahmasutra, and the Bhagavadgita, with Sankara's commentaries (bhasya) -- is the foundational corpus of Advaita Vedanta. Continuous euphonic combination (sandhi), long compounds (samasa), and dense scholastic prose make it hard to read at the word level: where one word ends, and what each word means grammatically, are both obscured. We present an open, fully offline, word-level digital reader of the entire Prasthanatrayi with Sankara's bhasya. Every word -- of both the root text (mula) and the commentary -- is clickable and resolves to a pop-up giving its split (padaccheda), morphological analysis, and gloss. Because every word carries a lemma, the reader also acts as a concordance: a search on a dictionary headword retrieves all of that word's inflected and sandhi-hidden occurrences, and its occurrences inside compounds, across both layers. The resource covers thirteen commentarial units (2,971 verses, sutras, and prose sections; 36,881 analysed word-occurrences of root text) and a global dictionary of 95,587 distinct commentarial surface forms. We describe the corpus, the hybrid pipeline -- a rule-based sandhi splitter over an inflected-form lexicon and attested-corpus look-ups, with LLM-assisted analysis under an adversarial two-pass verification protocol -- and a durable human-review loop whose corrections survive every regeneration. An intrinsic evaluation against independent Sanskrit resources finds high-confidence analyses agree with an authoritative inflectional lexicon on over 99% of attested forms, and a band-blind adjudication confirms that quality degrades predictably across confidence bands, with errors concentrated in the low-confidence tier the review loop targets. The reader is a single self-contained HTML file needing no server or network, offered as a freely redistributable teaching and reading aid.

24. 【2607.07277】Understanding Interpretation Difficulty in Harmful Online Communication: Insights from Cybercrime Communities

链接：https://arxiv.org/abs/2607.07277

作者：Tomohiro Okatsu,Naoki Takada,Yin Min Pa Pa,Katsunari Yoshioka,Tatsunori Mori

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Harmful online communication, coded terms, community-specific expressions, online communication, Harmful online

备注：

点击查看摘要

Abstract:Harmful online communication often contains slang, coded terms, abbreviations, and community-specific expressions, which make messages difficult to interpret. This paper presents an exploratory study of interpretation difficulty in Discord chats related to cybercrime. We construct reference interpretations of purposefully selected difficult messages, which were reviewed by an expert. We then use them to evaluate human and large language model (LLM) interpretations under different context conditions. The results show that local context alone is often insufficient for humans, while external knowledge and extended conversational context substantially improve human interpretation. For LLMs, local context also improves interpretation, and the larger model performs better. We further conduct a qualitative error analysis and propose a preliminary classification of factors that make harmful chats difficult to interpret. These findings suggest that harmful-content analysis should treat interpretation as an evidence-integration problem, rather than as message-level classification alone.

25. 【2607.07267】Billions of Sketches Reveal Hidden Cultural Variation in Human Concepts

链接：https://arxiv.org/abs/2607.07267

作者：Arianna Pera,Mauro Martino,Nima Dehmamy,Douglas Guilbeault,Luca Maria Aiello,Andrea Baronchelli

类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Physics and Society (physics.soc-ph)

关键词：predominantly assessed, assessed through linguistic, linguistic similarity, Claims, concepts

备注：

点击查看摘要

Abstract:Claims about the universality of human concepts have been predominantly assessed through linguistic similarity across languages and cultures. However, words are effective as communication devices because they compress rich experiential variation into shared conventions, potentially obscuring hidden individual and cultural differences in how concepts are mentally represented. Here, we analyse 2.6 billion human-made sketches of common concepts from 236 countries and territories to examine conceptual structure through people's visual imagination. Consistent with recent work on image-based cognition, we find that single concepts unfold into multiple distinct visual exemplars, revealing latent information about similarities and differences in conceptual structure across cultures. This variation is strongest for concepts involving haptic interaction, suggesting that visual imagery reflects variation in embodied experience as much as conventional definitions. Comparing embedding models of sketches with word embedding models across languages, we find that their geometries diverge, with visual representations preserving rich semantic and cultural structure that language models compress. Cross-cultural similarities derived from sketches align 45% more closely with established cultural distances than do text-based measures. Together, these results suggest that patterns of human conceptual universality may depend critically on the modality through which concepts are measured, with large-scale sketching providing a direct, high-resolution probe of conceptual diversity across embodied and cultural dimensions of thought.

26. 【2607.07251】Evaluation of Multilingual Ability to Use Spatial Deictic Expressions in Vision-Language Models

链接：https://arxiv.org/abs/2607.07251

作者：Kaito Watanabe,Taisei Yamamoto,Tomoki Doi,Hitomi Yanaka

类目：Computation and Language (cs.CL)

关键词：spatial deictic expressions, spatial deictic, deictic expressions, spatial reasoning abilities, spatial

备注： Accepted to ACL SRW 2026

点击查看摘要

Abstract:One of the expected abilities of vision-language models (VLMs) is spatial reasoning ability based on a given text and image. To evaluate the spatial reasoning abilities of VLMs, we focus on the use of spatial deictic expressions, which are defined as spatial expressions whose referent is determined by their situational context, such as ``this'' and ``that''. To handle spatial deictic expressions, VLMs must jointly reason over language and visual space, grounding context-dependent references in the image's spatial structure. In addition, selecting appropriate spatial deictic expressions across languages requires VLMs to understand the language-specific spatial distinctions encoded by these expressions. In this paper, we develop a benchmark to evaluate the multilingual ability of VLMs to use spatial deictic expressions in four languages. Our experiments using this benchmark reveal that the tested models use demonstratives in a manner different from that of humans, particularly in selecting the appropriate demonstratives based on the distance to the object.

27. 【2607.07141】From Text to Parameters: Predicting Item Parameters from Embedding Regularization with Reliability and Design Ceilings

链接：https://arxiv.org/abs/2607.07141

作者：Shi-Ting Chen,Jinsong Chen

类目：Computation and Language (cs.CL); Methodology (stat.ME)

关键词：Newly developed items, Newly developed, cold start problem, Logistic Test Model, Linear Logistic Test

备注：

点击查看摘要

Abstract:Newly developed items must ordinarily be field tested before their psychometric properties are known, creating a cold start problem for item calibration. Predicting item parameters from features is a long standing measurement problem dating back to the Linear Logistic Test Model; modern text embeddings now automate the design matrices traditionally specified by hand. We propose an evaluation framework combining regularized regression on item text embeddings, repeated cross validated R squared reported with its resampling standard deviation, and two performance upper bounds: a reliability ceiling derived from parameter standard errors, and a design ceiling derived from simulation based power calibration. Applying this framework to a mathematics item bank (EEDI) and a medical licensure benchmark (BEA 2024), we find that item difficulty is highly predictable from text (repeated cross validated R squared = 0.53, or about 57% of its reliability ceiling), whereas discrimination and pseudo guessing appear less predictable. However, evaluating these results against our ceilings reveals that this apparent hierarchy stems from target reliability rather than text signal strength: text uniformly recovers 57 to 63% of the reliable variance across difficulty targets, whereas the 3PL pseudo guessing parameter has a reliability ceiling near zero, making it an unviable target at current precision. On BEA, embedding based regression matches leaderboard RMSE despite explaining almost no variance, highlighting the critical need for scale free metrics and explicit ceilings in benchmarking. Finally, we show that a single train and test split can inflate apparent accuracy by 0.1 to 0.15 in R squared, underscoring the necessity of repeated cross validation for calibration support applications and future benchmark construction.

28. 【2607.07050】Behavior Leverage Imbalance in Multi-Teacher On-Policy Distillation

链接：https://arxiv.org/abs/2607.07050

作者：Jiabin Shen,Guang Chen,Chengjun Mao

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Agentic language models, Toggle, consume tool responses, Agentic language, Toggle Hugging Face

备注： 17 pages including appendix, 6 figures

点击查看摘要

Abstract:Agentic language models must learn when to call tools, when to consume tool responses, and when to answer directly. This makes multi-teacher on-policy distillation a natural training strategy: one teacher can specialize in tool calls, another in direct responses, and the student can learn from both on its own generated distribution. We show that this strategy can induce a behavior shift that is invisible from aggregate losses alone. In a two-teacher tool-use setting, vanilla generalized knowledge distillation improves tool-call recall but also moves the model toward over-calling, where it calls tools on examples that should be answered directly. Aggregate explanations are insufficient: tool-call samples do not receive more token exposure, and full-sequence per-token divergence is not larger for the tool-call teacher. We instead analyze behavior leverage imbalance: local token-level signals at mode- entry and structural positions, such as tool_call and function names, can have disproportionate control over the global generation mode. We propose Soft Clamp, a per-token divergence calibration method that dynamically compresses extreme token-level Jensen-Shannon divergence while preserving nonzero gradients. On APIGen-MT, Soft Clamp reduces over-calling from 13.7% to 9.0% relative to vanilla GKD while matching its decision accuracy. In a BFCL multi-turn diagnostic, it also lowers tool-call loops and repeated calls among GKD variants. These results suggest that multi-teacher OPD should monitor where teacher signals act, not only how large they are in aggregate.

Comments:
17 pages including appendix, 6 figures

Subjects:

Computation and Language (cs.CL); Machine Learning (cs.LG)

Cite as:
arXiv:2607.07050 [cs.CL]

(or
arXiv:2607.07050v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.07050

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Jiabin Shen [view email] [v1]
Wed, 8 Jul 2026 06:26:13 UTC (135 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled Behavior Leverage Imbalance in Multi-Teacher On-Policy Distillation, by Jiabin Shen and 2 other authorsView PDFHTML (experimental)TeX Source

view license

Current browse context:
cs.CL

|
next

new
|
recent
| 2026-07

Change to browse by:

cs
cs.LG

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

信息检索

1. 【2607.07422】InductWave: Inductive Multi-Hop Logical Query Answering on Knowledge Graphs

链接：https://arxiv.org/abs/2607.07422

作者：Mayank Kharbanda,Michael Cochez,Rajiv Ratn Shah,Raghava Mutharaju

类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：implicit completeness assumption, Multi-Hop Query Answering, Logical Multi-Hop Query, formulated as querying, completeness assumption

备注： Under Review at TKDE

点击查看摘要

Abstract:Logical Multi-Hop Query Answering over Knowledge Graphs (KGs) can be formulated as querying, with an implicit completeness assumption. Current works mainly focus on Existential First Order Logic (EFO) queries. These EFO queries contain conjunction, disjunction, and negation operators. Most existing works employ transductive reasoning, meaning they are not capable of reasoning over entities unseen during training. In the real world, there is a resource scarcity, and we cannot train a model with all the nodes of a large KG. Hence, we propose InductWave, a wavelet-based inductive embedding method for logical query answering on large KGs. Here, the training graph consists of fewer nodes than the test graph. Our model performs on par with the baseline models while having half the number of message-passing layers. It outperforms all of them in most cases, with 75% of the layers. These fewer resource requirements enable us to evaluate InductWave on massive graphs, such as Wiki-KG. We test our model using extensive experiments across varying train-test graph proportions of the FB15k-(237) dataset, comparing it with the state-of-the-art models. The code and datasets for the model are available at this https URL.

2. 【2607.07380】Interpretable Uncertainty for Adaptive Retrieval and Reasoning in Question Answering

链接：https://arxiv.org/abs/2607.07380

作者：Ritajit Dey,Iadh Ounis,Graham McDonald

类目：Information Retrieval (cs.IR)

关键词：Large language models, Large language, language models, achieve a strong, question answering

备注： 2 pages, 1 figure

点击查看摘要

Abstract:Large language models (LLMs) achieve a strong performance in question answering (QA), but remain prone to hallucinations and suffer from limited transparency. Retrieval-augmented generation (RAG) can improve factuality, yet decisions about when and how to retrieve from external resources are typically based on opaque policies or computationally inefficient multi-step prompting procedures. We propose an uncertainty-aware framework for adaptive QA based on explicit signals derived from LLM internal representations. We distinguish between knowledge insufficiency and knowledge ambiguity or conflict, and efficiently estimate these from hidden states in a single forward pass. These signals guide system behaviour: RAG is triggered when knowledge is insufficient, while additional reasoning is applied when ambiguity or conflict is high. By grounding adaptive decisions in decomposed and efficiently estimable uncertainty signals, this approach provides a transparent and practical alternative to existing retrieval and reasoning strategies supporting the design of interpretable user-facing tools.

3. 【2607.07183】Granularity in Actoin: Graphing sources for social history

链接：https://arxiv.org/abs/2607.07183

作者：Sofus Landor Dam,Johan Heinsen

类目：Information Retrieval (cs.IR)

关键词：working paper describes, turning historical sources, structured data organised, unit of analysis, working paper

备注：

点击查看摘要

Abstract:This working paper describes a pipeline for turning historical sources into structured data organised around the principle of foregrounding action as the basic and constitutive unit of analysis. It is rooted in a desire for pipelines that suit a granular approach to social history. The pipeline rests on the principles developed in the GRAM-framework (Graph of Roles and Actions Model), but leverages a range of machine learning tools to allow for an automated, skeletal graphing of actions. Ideally, such auto-GRAMS would integrate with close readings, including extensive manual graphing. Finally, we provide an example of how this approach might work in practice by graphing actions of pretending across four separate archival collections, relating to runaways and itinerants in eighteenth and nineteenth-century Denmark.

4. 【2607.07108】Seeing and Reflecting: Multimodal Memory-Enhanced Agent Collaboration for Recommendation

链接：https://arxiv.org/abs/2607.07108

作者：Hao Cong,Huizu Lin,Zihan Wang,Chengkai Huang,Quan Z. Sheng,Lina Yao

类目：Information Retrieval (cs.IR)

关键词：Large language model, based agentic recommender, missing visual evidence, agentic recommender systems, making agents prone

备注：

点击查看摘要

Abstract:Large language model (LLM)-based agentic recommender systems show promise in modeling user preferences through natural-language reasoning, yet they remain limited by text-centric inputs and coarse-grained memory updates, making agents prone to missing visual evidence, semantic noise, and preference drift. To address these limitations, we propose MMEACR, a Multimodal Memory-Enhanced Agent Collaboration framework for recommendation. MMEACR introduces a dual-track memory architecture that separates interpretable agent reasoning from fine-grained multimodal matching. In the reasoning track, collaborative User and Item Memory Agents maintain persistent multimodal memories and update them through an attribute-guided reinforcement-and-reflection mechanism. In the matching track, a decoupled multi-modal embedding memory is built from raw interaction narratives and item images to preserve detailed cross-modal signals beyond structured memory updates. The two tracks are integrated through weighted Reciprocal Rank Fusion to produce robust and interpretable rankings. Experiments on three real-world domains show that MMEACR achieves strong overall performance against competitive LLM-based and agent-based baselines, with notable gains in visually grounded recommendation scenarios.

5. 【2607.06765】When and How to Ask: Dynamic Preference Elicitation Strategies for Conversational Recommendation

链接：https://arxiv.org/abs/2607.06765

作者：Feng Xia,Shuo Zhang,Xi Wang

类目：Information Retrieval (cs.IR)

关键词：multi-turn natural language, understand evolving user, Conversational Recommender Systems, preference elicitation strategies, preference elicitation

备注： Accepted at SIGIR 2026

点击查看摘要

Abstract:Conversational Recommender Systems (CRSs) are interactive systems that use multi-turn natural language dialogue to understand evolving user preferences and provide personalized recommendations. To achieve this goal, CRSs rely on preference elicitation strategies to actively gather informative preference cues from users; however, the timing and selection of these strategies during a conversation remain largely unexplored. While many existing studies emphasize eliciting explicit item attributes and tend to adopt relatively static elicitation strategies, the use of item-based preference elicitation and how it varies across different dialogue stages remains less explored. In this work, we conduct a systematic investigation of preference elicitation strategies from a stage-aware perspective. We provide empirical evidence that optimal preference elicitation strategies are stage-dependent and context-sensitive: attribute-based inquiries are effective in early stages, while item-based strategies become superior as preferences refine. To support this paradigm, we introduce InPE, a dataset enriched with fine-grained annotations for elicitation necessity and strategy selection. With this dataset, we propose COPE (COnversational Preference Elicitation via Mixture of Experts), a novel architecture for strategy modeling. Extensive offline evaluation on our dataset indicates that context-aware preference elicitation strategies are beneficial for conversational recommendation. In addition, the analysis of the predicted strategies uncovers consistent stage-wise tendencies in dialogue progression, providing empirical evidence of common interaction patterns in conversational recommendation systems. Our dataset is available at this https URL.

计算机视觉

1. 【2607.07693】Selective Timestep Weighting and Advantage-Based Replay for Sample-Efficient Diffusion RLHF

链接：https://arxiv.org/abs/2607.07693

作者：Eric Zhu,Abhinav Shrivastava,Soumik Mukhopadhyay

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：aligning generative models, diffusion RLHF, Reinforcement learning, RLHF, powerful paradigm

备注： 19 pages, 18 figures, 4 tables. Submission under review. A shorter, non-archival 4-page abstract version of this work was accepted to CVPR 2026 Workshops (GCV, CVEU)

点击查看摘要

Abstract:Reinforcement learning from human feedback (RLHF) has emerged as a powerful paradigm for aligning generative models with human preferences. However, applying RLHF to diffusion models remains highly feedback inefficient, as existing approaches typically require large amounts of human or reward model evaluations. This limitation reduces the practicality of diffusion RLHF in realworld settings where feedback is the primary bottleneck. In this paper, we propose two complementary strategies that substantially improve the feedback efficiency of diffusion RLHF while preserving generalization to unseen prompts. Our key observation is that reward information in diffusion trajectories is unevenly distributed: not all denoising timesteps or trajectories contribute equally to learning from a reward signal. By emphasizing informative timesteps and trajectories during optimization, we obtain more effective gradient updates. First, we introduce a per-timestep weighting scheme that reweights denoising steps during policy optimization. We theoretically connect this weighting to the optimal convergence properties of proximal policy optimization (PPO) and approximate the resulting weighting trend empirically. Second, we introduce a replay mechanism that prioritizes informative trajectories, enabling the model to reuse past samples instead of repeatedly querying new rewards. Together, these strategies significantly improve the feedback efficiency of diffusion RLHF. Under identical hyperparameter settings, our approach achieves up to a 6$\times$ improvement in sample efficiency compared to widely used diffusion RLHF baselines.

2. 【2607.07675】Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence

链接：https://arxiv.org/abs/2607.07675

作者：Shuailei Ma,Jiaqi Liao,Xinyang Wang,Jingjing Wang,Chaoran Feng,Zijing Hu,Chong Bao,Zichen Xi,Yuqi Gan,Weisen Wang,Yanhong Zeng,Qin Zhao,Zifan Shi,Wei Wu,Hao Ouyang,Qiuyu Wang,Shangzhan Zhang,Jiahao Shao,Yipengjing Sun,Liangxiao Hu,Lunke Pan,Nan Xue,Kecheng Zheng,Yinghao Xu,Xing Zhu,Yujun Shen,Ka Leong Cheng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：

备注： Project page: [this https URL](https://technology.robbyant.com/lingbot-video)

点击查看摘要

None

3. 【2607.07673】MedPMC: A Systematic Framework for Scaling High-Fidelity Medical Multimodal Data for Foundation Models

链接：https://arxiv.org/abs/2607.07673

作者：Hyunjae Kim,Dain Kim,Pan Xiao,Serina S. Applebaum,Younjoon Chung,Xuguang Ai,Yu Yin,Roy Jiang,Yuexi Du,Yawen Wei,Yiming Kong,Tuo Guo,Zhiyuan Cao,Mengmeng Du,Yuelei Fu,Yan Hu,Rui Shi,Gui Yang,Kevin W. Jin,Yuntian Liu,Yuxuan Tian,Jonathan Marquez,Zhen Chen,Sheng Zhang,Hoifung Poon,Hua Xu,Jaewoo Kang,Qingyu Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Medicine is inherently, diverse data streams, requiring clinicians, clinicians to synthesize, synthesize information

备注：

点击查看摘要

Abstract:Medicine is inherently multimodal, requiring clinicians to synthesize information across diverse data streams. Yet the development of multimodal foundation models is constrained by limited access to large-scale, high-quality clinical data. Although PubMed Central (PMC) offers a complementary source of expert-authored image-text data, existing PMC-derived resources remain limited in fidelity, reproducibility, and clinical validation. We introduce MedPMC, an automated, continuously updatable framework that transforms permissively licensed literature into high-fidelity infrastructure for medical multimodal models. Applied to 6.1 million PMC articles, MedPMC curated 11 million medical image-text pairs. Component evaluations showed strong performance for initial screening (F1 = 93.2), multi-panel figure detection (F1 = 96.5), figure separation (mAP = 89.8), caption separation and alignment (F1 = 81.4; ROUGE-L = 85.3), and medical figure classification (F1 = 96.5). Manual review by five annotators, three with medical training, found 95.3% of MedPMC images medically relevant, versus 19.7% in a prior PMC-derived dataset. Across 26 benchmarks spanning 11 specialties, a MedPMC-trained CLIP-style model improved average zero-shot AUC by 7.1 percentage points over the strongest architecture-matched biomedical CLIP baseline despite using fewer than half as many image-text pairs. As the vision encoder in a multimodal large language model, it improved medical visual question-answering by 1.9 and 16.9 percentage points across two benchmarks. In 10,524 Yale New Haven Health System dermatology photographs, it improved morphology-to-image retrieval Recall@5 by 11.7 percentage points. These findings show that high-fidelity literature curation strengthens medical multimodal foundation models across benchmark and clinical settings. We publicly release the framework, corpus, benchmarks, and pretrained models.

4. 【2607.07608】Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation

链接：https://arxiv.org/abs/2607.07608

作者：Hongyu Qu,Jianzhe Gao,Xiaobin Hu,Shaohuan Yang,Xinlei Yu,Rui Yan,Wenguan Wang,Xiangbo Shu,Shuicheng Yan

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：temporally dependent tasks, Markovian assumption, models predict actions, predict actions primarily, VLA reasoning

备注： Project page: [this https URL](https://github.com/quhongyu/LaMem-VLA)

点击查看摘要

Abstract:Mainstream Vision-Language-Action (VLA) models predict actions primarily from the current observation under a Markovian assumption, thus struggling with long-horizon, temporally dependent tasks. Existing memory-augmented VLAs either expand the observation window or retrieve history from the memory bank as auxiliary policy-side context. However, they leave memory outside the native latent embedding space of VLA reasoning, preventing historical experience from being fluidly interleaved with multimodal reasoning and action formation. To this end, we introduce LaMem-VLA, a latent-memory-native framework that reconstructs historical experience into latent memory tokens and directly interweaves them with VLA reasoning. At its core, LaMem-VLA introduces four coordinated components: (i) a curator that organizes historical experience into two complementary short-term and long-term memory vaults; (ii) a seeker that queries both vaults using the multimodal cognition to retrieve context-relevant evidence; (iii) a condenser that reconstructs the retrieved evidence into compact short-term and long-term latent memory tokens; and (iv) a weaver that injects these memory tokens with the current observation and instruction into one continuous embedding sequence. By representing, retrieving, and consuming historical experience entirely in the same continuous latent space, LaMem-VLA enables memory to directly participate in VLA reasoning and guide action generation under a bounded context. Extensive experiments on SimplerEnv and LIBERO demonstrate the superiority of our LaMem-VLA.

5. 【2607.07581】Cardiac MRI Through-Plane Super-Resolution Guided by Reference and Memory

链接：https://arxiv.org/abs/2607.07581

作者：Shaoming Pan(1),Chenchuhui Hu(1),Leon Axel(2),Meng Ye(1) ((1) University of Texas at Arlington, (2) New York University Grossman School of Medicine)

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：high in-plane resolution, Clinical cardiac MRI, reduce scan time, coarse through-plane resolution, Clinical cardiac

备注： 8 pages, 3 figures 2 tables

点击查看摘要

Abstract:Clinical cardiac MRI is commonly acquired with high in-plane resolution but coarse through-plane resolution to reduce scan time and accommodate breath-hold and cardiac-motion constraints, which limits 3D analysis and diagnostic accuracy. We propose STRMSR, a reference- and memory-guided through-plane super-resolution (SR) framework that reconstructs high-resolution (HR) cardiac volumes by leveraging HR reference views acquired from the same subject and intermediate SR results as the memory. Our method uses coarse-to-fine contextual matching to establish robust correspondence between low-resolution target and reference/memory images under spatial misalignment. A learnable patch-wise dynamic feature aggregation module predicts content-adaptive mixture weights for each local patch, effectively fusing dynamic information while suppressing unreliable feature transfers. The intermediate SR results stored in the memory bank ensure slice-to-slice consistency for the super-resolved 3D volume. Experiments on the WHS cardiac MRI dataset under two reference protocols, orthogonal-plane views and long-axis chamber views, demonstrate consistent improvements over baselines at 4x and 8x upsampling factors.

6. 【2607.07580】Automatic Echocardiography Segmentation via Transition Probability Correlation for Stable Semantic Extraction

链接：https://arxiv.org/abs/2607.07580

作者：Xinran Chen,Xiyuan Wang,Guangquan Zhou,Chuan Chen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：inherent speckle noise, cardiovascular diagnosis, inherent speckle, noise and low, ratio often lead

备注：

点击查看摘要

Abstract:While echocardiography is essential for cardiovascular diagnosis, inherent speckle noise and low signal-to-noise ratio often lead to ambiguous semantic features and fragmented boundaries. These limitations significantly hinder the segmentation accuracy of deep learning models in complex clinical cases. Moreover, temporal motion of the heart plays a critical role in recognizing anatomical structures. To address these challenges, we designed a STLSF module which comprises a window-matching-based semantic correction component and a semantics-guided texture enhancement component. By leveraging local transition probability correlations to correct semantics and employing semantics-guided texture enhancement, the STLSF module effectively mitigates texture instability and ambiguous semantic interpretations caused by disadvantaged echocardiography quality. Additionally, to facilitate the encoder's adaptation to the intrinsic priors of ultrasound-specific imaging patterns, we propose a frequency-aware denoising pre-training method. The entire work builds a convolution-based network with locality inductive bias and long-range dependencies. Extensive experiments confirm our SOTA performance, achieving 93.87\% Dice on CAMUS and 92.62\% on EchoNet-Dynamic, with respective HD95 values of 3.29mm and 2.73mm.

7. 【2607.07553】AA-ViT: Anatomically Aware Vision Transformer with Structural and Frequency Guidance for Contrast Enhanced Brain MRI Synthesis

链接：https://arxiv.org/abs/2607.07553

作者：Talha Meraj,Tom Flannery,Charlie Cummins,Matt Townend,Thomas C Booth,Peter Crossley,Michael McCann,Ian Overton,Saritha Unnikrishnan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Accurate tumour localization, brain cancers, tumour localization, localization and diagnosis, critical component

备注： Accepted for Publication in MIUA 2026 proceedings

点击查看摘要

Abstract:Accurate tumour localization and diagnosis is a critical component of clinical care for brain cancers. Magnetic Resonance Imaging (MRI) is the most commonly used imaging modality due to its superior soft-tissue contrast. However, standard MRI often exhibits limited contrast and imaging artifacts, which necessitates the use of contrast agents to enhance lesion visibility. The administration of chemical contrast agents is not always feasible and may be contraindicated in patients with renal impairment or other health conditions. As a result, developing accurate and non-invasive contrast enhanced MRI (CEMRI) synthesis methods has clinical importance. In recent years, numerous approaches for CEMRI synthesis have been proposed, predominantly relying on generative artificial intelligence models. While these methods demonstrate promising performance, their dependence on implicit feature learning often limits their ability to preserve anatomical boundaries and tumour-specific fine structures. To address these challenges, we propose an anatomically aware frequency-and-structure-guided vision transformer (AA-ViT), for CEMRI synthesis using pre-contrast MRI modalities (T1, T2, and FLAIR). Experiments on the BraTS 2021 dataset demonstrate that the proposed method preserves anatomical and lesion boundaries, achieving higher PSNR and SSIM than state-of-the-art approaches. Clinical evaluation by three neuroradiologists and a neurosurgeon on 19 randomly selected cases across diverse gliomas yielded a mean score of 3.94/5, providing preliminary clinical validation rarely seen in prior studies. Synthetic post-contrast scans from our model could lower scanning costs, shorten imaging time, and avoid the potential risks of using gadolinium-based contrast agents.

8. 【2607.07545】Face-trace: Open-Set Attribution and Progressive Discovery of Synthetic Face Generators

链接：https://arxiv.org/abs/2607.07545

作者：Alessia Infantino,Claudio Schiavella,Irene Amerini

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：generative Artificial Intelligence, Artificial Intelligence, images increasingly realistic, Recent advances, generative Artificial

备注： Preprint. 17 pages, 16 figures

点击查看摘要

Abstract:Recent advances in generative Artificial Intelligence have made synthetic face images increasingly realistic, creating new challenges for multimedia forensics. Source attribution methods should not only identify the generator of an image when the source is known, but also handle samples produced by previously unseen models. However, most existing approaches address synthetic face attribution in a closed-set setting, where all possible generators are available during training. This assumption does not hold in real-world scenarios, where new generators continuously appear and rejected samples should be organized rather than simply discarded. In this work we propose a pipeline for open-set synthetic face source attribution that combines known generator classification, energy-based OOD rejection, and unknown generator discovery. A classifier is trained on known generators using frozen I-JEPA embeddings, while rejected samples are represented by combining projected I-JEPA features with Forensic Self-Descriptors and then clustered to discover groups of unknown generators. We also extend the discovery stage to an incremental scenario, where rejected samples arrive over time. Experiments on the WILD dataset show that the proposed method achieves 96.73% closed-set attribution accuracy. In the open-set setting, energy-based rejection reaches 71.25% balanced accuracy, while rejected samples are clustered into meaningful unknown-generator groups, obtaining an ARI of 0.81, an NMI of 0.90, and an overall clustering purity of 87.74%. In the incremental setting, the discovered generator space is progressively extended while maintaining a final purity of 99.23%. Cross-dataset experiments suggest that the pipeline can operate beyond the original dataset distribution, although post-processing remains challenging.

9. 【2607.07542】SonoRank: Towards Calibration-Free Real-Time Finger Flexion Detection from Forearm Ultrasound Sequences

链接：https://arxiv.org/abs/2607.07542

作者：Dean Zadok,Alon Wolf,Alex M. Bronstein,Oren Salzman

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Powered prosthetic hands, frequently abandoned, largely due, surface electromyography, hands are frequently

备注：

点击查看摘要

Abstract:Powered prosthetic hands are frequently abandoned, largely due to the limited functionality of current devices that rely on surface electromyography (sEMG). Sonomyography (ultrasound) has emerged as a promising alternative, owing to its ability to observe muscle activity in real time and control a greater number of degrees of freedom. Yet, existing ultrasound-based methods require per-user fine-tuning, limiting their commercialization. We propose SonoRank, an important step towards calibration-free finger flexion detection from forearm ultrasound video. SonoRank first learns to rank pairs of ultrasound sequences by their relative motion magnitude for each of the five fingers. The learned representations are then fine-tuned to classify whether each finger is actively flexing, using a rest reference that is captured at the beginning of the operation. Under 12-fold leave-one-subject-out cross-validation on a dataset of twelve subjects with synchronized kinematics, SonoRank achieves a 28% improvement in F1 score over direct classification baselines that skip the ranking stage. These results establish pairwise ranking as an effective pretraining signal for subject-independent control, bringing ultrasound-based prosthetics closer to practical, calibration-free deployment.

10. 【2607.07534】Infinite Worlds with Versatile Interactions

链接：https://arxiv.org/abs/2607.07534

作者：Zelin Gao,Qiuyu Wang,Jiapeng Zhu,Jingye Chen,Zichen Liu,Qingyan Bai,Jiahao Wang,Yufeng Yuan,Hanlin Wang,Yichong Lu,Ka Leong Cheng,Haojie Zhang,Jian Gao,Tianrui Feng,Yuzheng Liu,Yao Yao,Yinghao Xu,Xing Zhu,Yujun Shen,Hao Ouyang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：present LingBot-World, LingBot-World featuring, distinct upgrades, advanced iteration, featuring four distinct

备注： Project page: [this https URL](https://technology.robbyant.com/lingbot-world-v2) Code: [this https URL](https://github.com/robbyant/lingbot-world-v2)

点击查看摘要

Abstract:We present LingBot-World 2.0 (also known as LingBot-World-Infinity), an advanced iteration of LingBot-World featuring four distinct upgrades. (1) Our model achieves an unbounded interaction horizon while maintaining consistent output quality, benefiting from a carefully crafted causal pretraining paradigm. (2) Through distilling a real-time variant from the base model, our system guarantees rapid response time, sufficient to drive 720p video streams at 60 fps. (3) Compared to the previous version, this update introduces highly diverse interactive elements, comprising a broader spectrum of actions (e.g., attacking, archery, spell-casting, and shooting) alongside a richer variety of text-driven events. (4) We pioneer the integration of an agentic harness within the domain of world modeling, wherein a pilot agent is tasked with planning and executing character behaviors, while a director agent is responsible for synthesizing novel environmental elements as the scene progresses. Additionally, to facilitate a shared experience, we develop an interface that permits multiple players to simultaneously immerse themselves in this vivid world simulator. We pair our primary 14B model with a lightweight 1.3B counterpart, which supports effortless deployment on a single GPU.

11. 【2607.07532】Context-Aware Slum Mapping in Sub-Saharan Africa Using Sentinel-1 Texture and Local Climate Zones

链接：https://arxiv.org/abs/2607.07532

作者：Peterson Chepkilot,Babak Memar,Paolo Gamba

类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词：Compact Low-Rise areas, similar formal Compact, formal Compact Low-Rise, spectrally similar formal, Sub-Saharan African

备注： Submitted to IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing (JSTARS) for possible publication

点击查看摘要

Abstract:Accurate mapping of informal settlements remains a major challenge in Sub-Saharan African (SSA) cities because optical imagery often fails to distinguish Informal Settlements (defined here as LCZ 7) from spectrally similar formal Compact Low-Rise areas (LCZ 3). This study presents a context-aware, reproducible Optical-SAR framework that improves informal settlement delineation using Sentinel-2 spectral features and Sentinel-1 structural information within an adapted Local Climate Zone (LCZ) taxonomy. We implement a three-tier SAR integration strategy: calibrated backscatter, GLCM textures, and a physics-guided feature engineered to capture the high structural disorder and weak radar return characteristic of SSA informal settlements. Using reference data across Nairobi and Eldoret (Kenya), we evaluate performance via a stratified hold-out protocol and a season-aware ablation study. Results show that SAR textures provide the dominant performance gain for LCZ 7 detection. The Optical-SAR model achieves overall accuracy of 0.816 (dry) and 0.807 (wet), significantly outperforming the WUDAPT baseline (OA 0.704) and reducing the critical LCZ 3 - LCZ 7 confusion to 7%. Seasonal analysis indicates that while optical-only separability varies with phenology, SAR-derived textures stabilize informal settlement mapping across seasons. These findings demonstrate that the incorporation of SAR-derived features yields consistent improvements for urban morphology mapping in data-scarce environments across seasons and across the evaluated source cities, while cross-city transfer remains limited without local adaptation strategies.

12. 【2607.07518】Learning to Unify Deformable Shape and Texture Representations for Cardiac Video Classification

链接：https://arxiv.org/abs/2607.07518

作者：Tonmoy Hossain,Miaomiao Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：offering geometric priors, offering geometric, intensity variations, robust complements, geometric priors

备注：

点击查看摘要

Abstract:Deformable shape representations have proven to be robust complements to texture features in cardiac image classification, offering geometric priors that are invariant to imaging artifacts and intensity variations. However, existing deep networks perform simple concatenation to combine these distinct feature representations, which neither fully exploits their complementary nature nor learns cross-modal feature dependencies. Furthermore, this results in uniform attention across all timepoints; hence ignoring the varying diagnostic importance across the cardiac phases. In this paper, we propose a novel cardiac video classification model that, for the first time, learns temporal features in an integrated space of deformable shape and image texture representations. In particular, we design a bi-directional cross-attention in the latent space to fuse latent deformable shape and image features, allowing each modality to adaptively weight the other based on spatio-temporal correspondence. In contrast to current methods that apply uniform weighting across all the cardiac phases, our approach learns to dynamically adjust the contributions of shape and texture representations, derived from images, over time. We demonstrate state-of-the-art classification performance on a cine cardiac magnetic resonance (CMR) video dataset, achieving improved interpretability from attention mechanisms that identify diagnostically critical cardiac phases and modality contributions.

13. 【2607.07507】HIVE: Understanding Post-Hallucination Reasoning in Vision Language Models

链接：https://arxiv.org/abs/2607.07507

作者：Feng He,Zhenting Wang,Qifan Wang,Qiang Guan,Dongfang Liu,Ruixiang Tang,Qiankun Li

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：ambiguous visual evidence, visual evidence, commonly treated, arise from partial, partial or ambiguous

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Hallucinations in vision language models (VLMs) are commonly treated as semantic errors, yet they often arise from partial or ambiguous visual evidence. Prior work mainly focuses on detecting or suppressing hallucinations at generation time, leaving the subsequent reasoning stage largely unexplored. In this work, we study Post Hallucination Reasoning (PHR), the stage in which hallucinated semantics enter the model's inference context and influence downstream predictions. To systematically investigate PHR, we introduce HIVE, Hallucination Inference and Verification Engine, an evaluation infrastructure that enables controlled comparisons between faithful and hallucinated captions. Across nine tasks and nine models, we observe structured modality dependent patterns: hallucinated captions often improve accuracy on vision language tasks, while text only tasks exhibit limited or unstable effects. Further analyses show that hallucinated cues broaden semantic coverage and reshape reasoning dynamics while preserving stable inference. These findings highlight that hallucinated semantics may influence downstream reasoning once they enter the model's inference context. Understanding this post hallucination stage is important for improving the reliability and interpretability of multimodal reasoning systems. Code is publicly available at this https URL.

14. 【2607.07486】Discovering Geometric Biases in 3D Face Reconstruction: A Curvature-Aware Spectral Framework for Fairness Evaluation

链接：https://arxiv.org/abs/2607.07486

作者：Veronika Shilova,Emmanuel Malherbe,Giovanni Palma,Panagiotis-Alexandros Bokaris,Laurent Risser,Jean-Michel Loubes

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：parametric shape priors, Morphable Models, standard parametric shape, parametric shape, shape priors

备注：

点击查看摘要

Abstract:3D Morphable Models (3DMMs) remain the standard parametric shape priors for many state-of-the-art 3D face reconstruction algorithms. However, as these models are derived from a finite number of 3D face samples, they inherit the morphological biases of their training data, potentially limiting their generalizability across diverse global populations. In this paper, we propose a novel framework to analyze 3DMM reconstructions through the lens of surface curvature, with the objective to discover, quantify and visualize biases. While standard evaluation metrics often rely on Euclidean distances, our reconstruction error captures subtle surface nuances such as local topology or undulations. To do so, we leverage the Laplace-Beltrami Operator (LBO) to generate high-resolution curvature error maps, providing a localized and geometrically meaningful visualization of discrepancies between ground truth faces and reconstructed meshes. We derive from it an error metric that we validated through a user study, observing a significantly higher correlation to human perception compared to traditional methods. Furthermore, we conduct extensive experiments across several 3DMM bases and fitting algorithms, uncovering systematic age-related biases and providing preliminary evidence of biases associated with gender and ethnicity. Our findings highlight the necessity of adopting curvature-aware evaluation protocols to ensure demographic fairness and geometric precision in future 3D face reconstruction research.

15. 【2607.07470】A Theory of Contrastive Learning with Natural Images

链接：https://arxiv.org/abs/2607.07470

作者：Antonio Torralba,Yair Weiss

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：downstream tasks, contrastive learning, augmentations, augmentations yield, partial whitening

备注： ICML 2026

点击查看摘要

Abstract:Why does contrastive learning with simple images and augmentations yield useful representations for downstream tasks? We address this question by analytically computing the optimal representation in terms of a contrastive loss for a range of basic augmentations and any image dataset with stationary statistics. We show that for certain augmentations the optimum can be attained by a CNN whose first layer filters are sinusoids, followed by a pointwise nonlinearity, global average pooling, and a final linear layer that performs partial whitening. We also show that the optimal weights in such CNNs for more complicated augmentations are still sinusoids. The frequencies of the sinusoids and their weights can be computed using a simple waterfilling algorithm given the dataset's expected power spectrum. Experiments with different image datasets and augmentations show that such CNNs trained with SGD empirically learn sinusoids in their first layer and to perform partial whitening

16. 【2607.07459】EmbodiedGen V2: An Agentic, Simulation-Ready 3D World Engine for Embodied AI

链接：https://arxiv.org/abs/2607.07459

作者：Xinjie Wang,Liu Liu,Taojun Ding,Andrew Choi,Chaodong Huang,Mengao Zhao,Ziang Li,Jackson Jiang,Chunlei Yu,Shengxiang Liu,Wei Xu,Zhizhong Su

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：building executable sim-ready, engine for building, building executable, executable sim-ready environments, stateful Vibe Coding

备注：

点击查看摘要

Abstract:We present EmbodiedGen V2, a generative 3D world engine for building executable sim-ready environments for embodied intelligence. Sim-ready 3D asset generation has advanced rapidly, yet assembling such assets into policy-ready task environments remains largely manual, limiting scalable closed-loop learning. EmbodiedGen V2 addresses this gap through a unified sim-ready representation that connects cross-simulator assets, interaction affordances, task-driven worlds, large-scale multi-room scenes, and stateful Vibe Coding into a generative, editable, and reusable simulation pipeline. The generated environments support manipulation, navigation, mobile manipulation, cross-simulator deployment, and embodied policy training. In evaluation, the asset pipeline achieves 96.5% human acceptance and 98.6% collision success, and 83.3% of task-driven worlds are directly usable for downstream simulation without manual modification. Online reinforcement learning with generated environments further improves simulation success from 9.7% to 79.8%, and transfers to real robots with task success increasing from 21.7% to 75.0%. These results establish EmbodiedGen V2 as scalable simulation infrastructure for training, evaluating, and deploying embodied policies.

17. 【2607.07438】wo-Stage Multi-Modal Fusion with Adaptive Alignment for Action Quality Assessment

链接：https://arxiv.org/abs/2607.07438

作者：Kanglei Zhou,Ruizhi Cai,Xinning Wang,Yijian Zheng,Liyuan Wang,Jianguo Li,Xiaohui Liang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Action Quality Assessment, Action Quality, sports scoring, person performs, essential in applications

备注： Accepted to IJCV

点击查看摘要

Abstract:Action Quality Assessment (AQA) aims to evaluate how well a person performs a movement, which is essential in applications such as sports scoring, skill assessment, and healthcare. However, unimodal approaches often struggle to capture subtle cues of movement quality in real-world settings. Although multi-modal inputs provide complementary information, existing methods still face two major challenges: heterogeneous modalities often lead to cross-modal misalignment and unstable fusion, and reliable multi-modal annotation is costly, resulting in limited dataset diversity. To address these challenges, we propose DualAlign, a two-stage multi-modal fusion framework with adaptive alignment. The framework first constructs a coherent visual representation by maximizing shared structural information across RGB video, optical flow, and skeleton modalities. Textual semantics are then incorporated after visual stabilization, allowing high-level descriptions to complement rather than distort the underlying visual manifold. To evaluate the framework under realistic multi-modal conditions, we introduce MM--JDM, a movement-quality assessment dataset integrating RGB videos, optical flow, skeleton sequences, and structured text. MM--JDM naturally exhibits modality noise, class imbalance, and label scarcity, making it a challenging benchmark for studying multi-modal fusion and alignment. Extensive experiments show that DualAlign improves average correlation on MM--JDM by 21.16% over the state-of-the-art methods and achieves gains of 3.53% and 5.95% on the RG and Fis-V benchmarks, respectively. DualAlign also remains robust under missing-modality and label-scarce conditions.

18. 【2607.07416】VCDP: Variation-Conditioned Distributional Proxy Learning for Semi-Supervised Medical Image Segmentation

链接：https://arxiv.org/abs/2607.07416

作者：Zimu Zhang,Yiheng Zhong,Zhuoru Zhang,Yingzhen Hu,Yanan He,Fanliang Meng,Xiaofeng Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：exploiting unlabeled volumes, dense voxel-level annotations, medical image segmentation, image segmentation reduces, unlabeled volumes

备注：

点击查看摘要

Abstract:Semi-supervised 3D medical image segmentation reduces the need for dense voxel-level annotations by exploiting unlabeled volumes. Although existing methods such as consistency regularization, pseudo-labeling, and co-training improve prediction-level robustness, they often provide insufficient feature-space organization for anatomically complex structures, especially small organs and ambiguous boundary regions with large intra-class variations. To address this issue, we propose Variation-Conditioned Distributional Proxy Learning (VCDP), a plug-and-play training-only regularization module for semi-supervised 3D medical image segmentation. VCDP represents each class with a learnable Gaussian distribution for shared class semantics and multiple variation prototypes for fine-grained intra-class patterns. A unified variation-conditioned compatibility score is further formulated to fuse distributional similarity and soft variation aggregation, guiding voxel embeddings to align with both global organ identity and local anatomical variations. VCDP is attached to decoder features during training and removed during inference, introducing no additional inference cost. Experiments on multi-organ segmentation benchmarks show that VCDP improves most evaluated baselines, particularly for small, ambiguous, and highly variable organs. Our anonymous code is released at this https URL.

19. 【2607.07401】Heterogeneity-Adaptive Diffusion Schrodinger Bridge for PET-Guided Whole-Body MRI Translation

链接：https://arxiv.org/abs/2607.07401

作者：Chengbo Wang,Jiacheng Yu,Linjie Bian,Ming Qi,Xiaosheng Liu,Tongtong Che,Jichang Zhang,Shuyu Li,Shaoli Song,Xiuying Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：effective medical applications, efficient clinical practice, multimodal medical imaging, medical imaging scanners, excessive long acquisition

备注： Accepted at MICCAI 2026

点击查看摘要

Abstract:While whole-body multimodal medical imaging scanners have been increasingly recognized for more effective medical applications, the excessive long acquisition time in PET-MR scanning is a major obstacle in more efficient clinical practice. Deep learning-based MRI translation provides a potential solution to reduce scan duration. However, current models often focus on specific anatomical regions and face challenges for whole-body scans that consists of highly heterogeneous feature distributions mainly due to (1) different anatomical regions across whole-body, and (2) lesions or pathological tissues. This paper tackles the challenges through a novel Heterogeneity-Adaptive Diffusion Schrodinger Bridge (HA-DSB) framework. By explicitly modeling translation as stochastic transport between source and target distributions, HA-DSB incorporates region context embeddings derived from a vision-language model (VLM) to enable region-specific modeling. To enhance fidelity of the pathological tissue, lesion-aware metabolic prior from PET is integrated directly into the bridge dynamics through a dual-stage guidance mechanism. Specifically, a PET-guided noise modulation module adaptively scales spatial diffusion perturbations during the forward process, while PET features are leveraged during the reverse process to selectively amplify lesion-relevant structures via an attention mechanism. Experiments demonstrate the superiority of our method across different body regions in whole-body MRI translation and show improved translation quality in lesion areas under PET guidance. Our code is available at Github.

20. 【2607.07395】When Prompts Ignore Structure: Graph-Based Attribute Reasoning for Calibrated VLMs

链接：https://arxiv.org/abs/2607.07395

作者：Tanay Sodha,Aditya Sharma,Ramya Hebbalaguppe,Vinti Agarwal,Pranav Murthy Yeluripaty

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：confidence estimation remains, prompt tuning improves, tuning improves zero-shot, improves zero-shot accuracy, degrades calibration due

备注： Under review: EMNLP2026

点击查看摘要

Abstract:Reliable confidence estimation remains a key limitation of test-time adaptation in vision-language models (VLMs), where prompt tuning improves zero-shot accuracy but often degrades calibration due to entropy-driven overconfidence. Prior approaches mitigate this using LLM-derived class attributes and contrastive regularization, yet treat attributes independently, ignoring their relational structure. We propose ARGTCA, which represents (class, attribute) pairs as nodes in a Symbolic Attribute Graph and trains a Graph Attention Network (GAT) using contrastive objectives to produce structurally informed embeddings that capture inter-attribute dependencies. We introduce two attribute selection strategies: ARGTCA-DIV for intra-class diversity and ARGTCA-DISC for inter-class discrimination. Experiments across nine benchmarks show that ARGTCA-DIV reduces average Expected Calibration Error (ECE) by approximately ~37% over baselines, while ARGTCA-DISC consistently performs as the second-best variant, reducing average ECE by approximately ~17% over baselines. These results suggest that modeling symbolic attribute interactions provides a principled approach for reliable test-time adaptation in VLMs.

21. 【2607.07383】MMAgent-R$^2$: Learning to Rerank and Reject for Agentic mRAG

链接：https://arxiv.org/abs/2607.07383

作者：Tao Zhang,Ziqi Zhang,Zongyang Ma,Yuxin Yang,Bing Li,Chunfeng Yuan,Kang Rong,Fengyun Rao,Jing Lyu,Weiming Hu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Knowledge-based Visual Question, Visual Question Answering, Question Answering, answer related questions, large-scale encyclopedic knowledge

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Knowledge-based Visual Question Answering (KB-VQA) requires models to retrieve visual entities matching the query image from large-scale encyclopedic knowledge bases and answer related questions. Existing multimodal Retrieval Augmented Generation (mRAG) methods rely on global visual features to match candidate entities, yet when the knowledge base contains numerous visually similar entities, the retriever struggles to distinguish them, populating the candidate set with visually similar but factually mismatched distractors. Since subsequent processing steps such as noise filtering are also confined to this fixed candidate set, errors from failed retrieval inevitably propagate to the final answer. To address these challenges, we propose MMAgent-R$^2$, an agentic mRAG framework that integrates visual reranking and active rejection as its internal verification mechanism. Visual reranking directly compares query and candidate images, capturing discriminative details beyond textual descriptions to precisely identify the target entity among similar candidates; active rejection discards unreliable results and retrieves additional candidates when no confident match is found, moving beyond the fixed candidate pool. We design a composite reward function with step-level verification rewards and achieve joint optimization of external retrieval, internal verification, and answer generation via GRPO training. Experiments on InfoSeek, E-VQA, and MMhops demonstrate that \ours{} achieves state-of-the-art performance, with particularly notable advantages in challenging retrieval scenarios and complex multi-image multi-hop reasoning tasks.

22. 【2607.07361】BUS: Brain-Inspired Unsupervised Self-Reflection for Advanced Multimodal Reasoning

链接：https://arxiv.org/abs/2607.07361

作者：Jiacheng Yang,Tongying Xiao,Yunkai Dang,Cong Wang,Yuekun Yang,Qi Fan,Wenbin Li,Feng Miao,Yang Gao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Current Vision-Language Models, struggle to handle, consistent and fine-grained, Vision-Language Models, backward prediction

备注：

点击查看摘要

Abstract:Current Vision-Language Models (VLMs) often struggle to handle complex visual tasks that require consistent and fine-grained reasoning. Recent methods aim to train models to facilitate self-reflective reasoning, i.e., reviewing and improving the generated reasoning. However, they require large volumes of annotated data and lack explicit reflective behavior during test time. This work aims to bridge this gap through inspiration from neuroscience. The human brain exhibits efficient backward prediction, i.e., predicting which current states are likely to precede a given future state. In this work, we first verify that mainstream VLMs can perform backward prediction, similar to the human brain. Then, we propose Brain-inspired Unsupervised Self-reflection (BUS), a label-free training framework to enhance reflective reasoning capability in challenging image analysis. BUS enables VLMs to perform backward prediction and provide explicit learning signals on data without ground-truth labels. In this way, BUS eliminates reliance on annotated data while improving reasoning performance. Notably, BUS is compatible with popular fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Finally, extensive experiments on 8 benchmarks demonstrate the effectiveness of BUS across a wide range of complex visual tasks. It achieves notable improvements over the base model while using only unlabeled training data. Our experimental findings validate that backward prediction capability is critical for VLM reasoning.

23. 【2607.07322】HAJJv2-CrowdCount: Zero-Shot Benchmark for Dense Crowd Counting

链接：https://arxiv.org/abs/2607.07322

作者：Reem AlYabis,Fares AlTuwaim,AlJawharh AlOtaibi,Mohamed Eltahir

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：models lack capacity, current models lack, Automated crowd counting, Automated crowd, near-vertical angles

备注： 5 pages, 8 figures, 2 tables. Annotations available at [this https URL](https://github.com/reem-8899/HAJJv2-CrowdCount)

点击查看摘要

Abstract:Automated crowd counting in Hajj video is difficult not because current models lack capacity, but because the footage violates the assumptions those models were built on: cameras observe the crowd from steep, near-vertical angles, individuals occlude one another extensively, and a single frame can contain well over a thousand people. Benchmarks that test crowd counting in such an environment are either private or not detailed per second. We revisit the HAJJv2 dataset and contribute HAJJv2-CrowdCount: per-second human-annotated crowd counts for its testing videos. Using these annotations, we benchmark three recent zero-shot counting paradigms: an open-vocabulary detector (YOLO-World), a point-based counter (APGCC), and a promptable segmentation-based counter (SAM3Count). SAM3Count attains the lowest overall mean absolute error (MAE 70.4, 95% CI 56.0-86.1), ahead of YOLO-World (92.0) and APGCC (152.9). This ordering reverses, however, in the regime most relevant to deployment: on the densest frames, the detection- and segmentation-based counters both degrade sharply (MAE exceeding 300), while the point-based counter degrades far more gracefully (MAE 114.9). This inversion is decision-relevant for Hajj crowd management, where reliable counts are needed most precisely in the densest and most occluded scenes. The annotations are released to support reproduction and extension of these results.

24. 【2607.07320】SoccerNet 2026 Challenges Results

链接：https://arxiv.org/abs/2607.07320

作者：Anthony Cioppa,Silvio Giancola,Håkan Ardö,Mohamad Dalal,Jan Held,Jérémie Ochin,Jiayuan Rao,Karen Sanchez,Renaud Vandeghen,Artur Xarles,Olivier Barnich,Albert Clapés,Mathieu Delvaux,Sergio Escalera,Bernard Ghanem,Cédric Hons,Antoine Houet,Sotiris Manitsaris,Tom Michel,Pierre Miralles,Thomas B. Moeslund,Mikael Nilsson,Bogdan Stanciulescu,Marc Van Droogenbroeck,Yanfeng Wang,Weidi Xie,Faisal Altawijri,Mohamed Atef,Semen Budennyy,Vasiliy Chelpanov,Puhua Chen,Yixin Chen,Lechao Cheng,Jianling Chu,Ju-Seong Do,Oleg Durygin,Omar Fetouh,Mirco Fuchs,Youssef Ghallab,Falguni Ghosh,Wonjun Heo,Yufeng Hu,Weixuan Huang,Phuong-Linh Huynh-Ha,Matvey Isupov,Yangguang Ji,Siyuan Jiang,Zhenxiang Jiang,Wonyong Jo,Ho-Young Jung,SeongHeon Kang,MinJae Kim,Youngseon Kim,Jakub Komosa,Artem Konshin,Trung-Hoang Le,Jongmin Lee,Lingling Li,Litao Li,Vadim Linkov,Fang Liu,Haoxuan Ma,Shun Makino,Ismail Mathkour,Konstantin Mitin,Mikhail Moiseev,Takumi Nagaya,Yuki Nakamura,Thanh-Khoi Nguyen,Hoang-Phuc Nguyen,Trong-Thuan Nguyen,Christian Orduz,Kwanyong Park,Fabian Perez,Parthsarthi Rawat,SuHyun Rim,Hoover Rueda-Chacón,Atom Scott,Minori Sugimura,Yuyang Sun,Shengeng Tang,Minh-Triet Tran,Ikuma Uchida,Juan Vanegas,Thanh-Nhan Vo,Jiangtao Wang,Yaxiong Wang,Xiaogang Wang,Ruifeng Wang,Rio Watanabe,Jiali Wen,Yongliang Wu,Di Yang,Xu Yang,Zhuo Yang,Xinyu Ye,Yibo Yu,Zihan Zhai,Yu Zhang,Zhenyu Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：open benchmarking effort, advancing computer vision, computer vision research, sports video understanding, SoccerNet open benchmarking

备注： 40 pages

点击查看摘要

Abstract:The SoccerNet 2026 Challenges constitute the sixth annual edition of the SoccerNet open benchmarking effort, dedicated to advancing computer vision research in sports video understanding. This year's challenges span five vision-based tasks: (1) Ball Action Anticipation, predicting the timing and class of ball-related actions within a short future window from a preceding observation window; (2) Player-Centric Ball Action Spotting, temporally localizing and classifying ball-related actions while assigning each action to the acting player through team affiliation and jersey number; (3) Novel View Synthesis, rendering images from unobserved camera poses in multi-view football scenes; (4) Spiideo SoccerNet Synloc, localizing athletes in real-world pitch coordinates from a single calibrated static-camera image; and (5) Visual Question Answering, answering multiple-choice questions about football broadcasts across text, image, and video inputs. For each task, participants were provided with annotated data, a unified evaluation protocol, and a public baseline. This edition saw broad participation, with 427 teams submitting 1,129 entries across the five tasks and 28 teams contributing reviewed technical reports. This paper describes each task and its evaluation protocol, presents the challenge leaderboards, and summarizes the leading submissions, with the aim of documenting the current state of each task as measured on held-out challenge data.

25. 【2607.07292】CarbonCLIP: Enhance Carbon Prediction from Satellite Imagery via Integrated Street-View Semantics and Temporal Context Training

链接：https://arxiv.org/abs/2607.07292

作者：Zeru Yang,Fang-Ying Gong,Steve H.L. Yim,Chau Yuen

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Accurately estimating urban, existing approaches remain, approaches remain difficult, Accurately estimating, sustainable urban planning

备注： Accepted by IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing. 21 pages, 6 figures, 9 tables

点击查看摘要

Abstract:Accurately estimating urban carbon emissions is critical for sustainable urban planning, yet many existing approaches remain difficult to apply consistently across cities due to data-source heterogeneity and the lack of fine-grained semantic-temporal context in remote sensing data. We propose CarbonCLIP, a task-oriented multimodal distillation framework that improves satellite-based carbon emission prediction by transferring contextual knowledge into a unified satellite representation through dual-branch contrastive learning. Unlike conventional methods that rely on static visual features, CarbonCLIP explicitly bridges the gap between top-down satellite views and ground-level human activities. Specifically, the spatial branch uses fine-grained textual descriptions automatically generated from street-view images by Large Multimodal Models (LMMs) to provide semantic priors reflecting building functions, infrastructure, and urban activities, while the temporal branch employs a month encoder to encode temporal priors associated with monthly emission variation. CarbonCLIP requires multimodal data only during the pretraining phase; during inference, it relies solely on satellite imagery, thereby supporting scalable deployment when ground-level data are unavailable at inference. Experiments on Beijing and Singapore demonstrate that CarbonCLIP outperforms baselines in both study cities. The results validate that our method effectively transfers multimodal knowledge into satellite representations, offering a robust solution for satellite-based urban carbon modeling.

26. 【2607.07288】InfraQR: Edge-Placed QR-Inspired Structured Patch Attacks on Infrared Vision-Language Models

链接：https://arxiv.org/abs/2607.07288

作者：Xin Li,Jiaju Han,Ma Yaqi,Chengyin Hu,Yingying Zhao,Jiahuan Long,Fengyu Zhang,Yahui Chai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Infrared vision-language models, vision-language models, adverse visual conditions, Infrared vision-language, perception under low-light

备注：

点击查看摘要

Abstract:Infrared vision-language models are increasingly used for perception under low-light and adverse visual conditions, yet their robustness to localized structured perturbations remains underexplored. Existing infrared adversarial studies mainly focus on object detectors, leaving the security of infrared vision-language models less systematically examined. We present InfraQR, a QR-inspired structured patch attack for infrared vision-language models. Unlike localized attacks that attach perturbations to the target object, InfraQR places a compact structured patch along image boundaries and optimizes learnable grid cells through surrogate CLIP-style encoders. The resulting patch has a near-binary structured appearance, but is not required to be a valid or machine-readable QR code. We evaluate InfraQR on infrared classification, caption transfer, and question-answer-aware visual question answering (VQA) tasks. On a 300-image infrared benchmark, InfraQR sharply reduces the accuracy of multiple CLIP-style classifiers, including reducing OpenAI CLIP accuracy from 98.67% to 0.70%. The generated adversarial images also transfer to black-box captioning and VQA models, causing semantic degradation in captions and more error-prone answers under GPT-5.4-based evaluation. These results show that infrared vision-language models remain vulnerable to structured edge-placed perturbations, motivating further study of cross-task robustness beyond direct object occlusion.

27. 【2607.07264】Naming the Concepts Classifiers Rely On: Language-Anchored Decomposition for Faithful Explanation

链接：https://arxiv.org/abs/2607.07264

作者：Ahsan Habib Akash,Dipkamal Bhusal,Stacey Jones,Donald A. Adjeroh,Binod Bhattarai,Prashnna Kumar Gyawali

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Deep neural networks, methods recover factors, by-design methods attach, methods attach human-readable, high-stakes visual applications

备注： Code available at [this https URL](https://github.com/machine-intelligence-lab-wvu/LAD)

点击查看摘要

Abstract:Deep neural networks are widely deployed in high-stakes visual applications where interpretability is critical, yet existing explanations face a trade-off: post-hoc concept methods recover factors that are faithful to a model's behavior but unnamed, while naming and by-design methods attach human-readable concepts only by retraining or altering the classifier. We propose Language-Anchored Decomposition (LAD), a post-hoc framework that delivers concepts which are simultaneously named, faithful, and obtained without modifying the model. For each class, a large language model proposes a concept vocabulary that CLIP-based similarity maps localize across image regions. Inverting standard non-negative matrix factorization, LAD fixes these language-grounded maps as the coefficient matrix and learns only a concept basis that reconstructs the frozen encoder's activations, so naming becomes a structural constraint and the model's own feature geometry determines which concepts are retained. Removing this anchor preserves accuracy but collapses attribution faithfulness. Across natural-image, scene, and medical-imaging benchmarks, LAD produces spatially precise explanations that are decision-relevant under both concept insertion and deletion, while uniquely providing stable, human-interpretable concept names.

28. 【2607.07240】An Edge-aware Prompt-enhanced SAM for Ultrasound Image Segmentation

链接：https://arxiv.org/abs/2607.07240

作者：Wenhao Li,Fangyi Liu,Bo Du

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：delineating anatomical structures, Ultrasound image segmentation, structures and lesions, providing the foundation, accurate diagnosis

备注： Accepted to ICME2026

点击查看摘要

Abstract:Ultrasound image segmentation is essential for delineating anatomical structures and lesions, providing the foundation for accurate diagnosis. While the Segment Anything Model (SAM) has demonstrated remarkable success on natural images, its performance on ultrasound data is often hindered by poor boundary delineation. To address this limitation, we propose EP-SAM, an edge-aware and prompt-enhanced adaptation of SAM. Specifically, we leverage multi-block feature extraction from the image encoder to enrich coarse-to-fine semantic representations, while edge-aware supervision of the image encoder improves robustness to contour ambiguity and speckle noise. By integrating these complementary cues, EP-SAM generates high-quality prompts that effectively guide the model toward target regions of interest. Experimental results on multiple benchmarks demonstrate that EP-SAM consistently outperforms existing SAM-based methods.

29. 【2607.07236】Unraveling Machine Behavior by Multi-Level Bias Analysis and Detection: Methodology and Application to Computer Vision

链接：https://arxiv.org/abs/2607.07236

作者：Ignacio Serna,Aythami Morales,Julian Fierrez

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：comprehensive multi-level analysis, multi-level analysis spanning, learned latent space, neural network, latent space prior

备注：

点击查看摘要

Abstract:This study investigates the presence and propagation of bias within Neural Networks through a comprehensive multi-level analysis spanning the learned latent space, layer activations, and the network's parameters. Based on this taxonomy, we propose three bias detection approaches: 1) SpaceBias (new method), which characterizes the latent space prior to the final classification layer using neighbor-probability distributions and quantifies bias with the two-sample Kolmogorov-Smirnov test on the per-group distributions. 2) ActivationBias (extension of the existing method InsideBias), which analyzes the activations of neural network filters and quantifies bias via a Mann-Whitney U test, based on the observed fact that underrepresented groups exhibit lower activation levels in the final convolutional layers. 3) WeightBias (extension of the existing method IFBiD), which uses a secondary neural network trained to identify biased patterns directly in the parameters of task-specific models. Unlike conventional methods, which assess neural network outcomes and treat the model as a black box, our proposed techniques provide insight into how biases manifest within the network architecture itself at different levels, offering a more nuanced and detailed understanding. Experiments are conducted on two complementary applications: gender classification in the DiveFace dataset (72,000 face images) and digit classification on a colored-MNIST benchmark with controlled bias severity. In total, more than 127,000 models with varying degrees and types of bias were trained and evaluated. The severity sweep shows that the internal disparity, and with it the detection performance, decreases smoothly as the training distribution approaches balance. The results highlight the importance of methods that provide deeper insight into the behavior of AI models.

30. 【2607.07230】`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation

链接：https://arxiv.org/abs/2607.07230

作者：Waqas Arshid,Mohammad Awrangjeb,Alan Wee-Chung Liew,Yongsheng Gao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Video object segmentation, requiring accurate delineation, video understanding, Video object, object segmentation

备注： Accepted for publication in Machine Intelligence Research journal

点击查看摘要

Abstract:Video object segmentation (VOS) is a fundamental task in video understanding, requiring accurate delineation and consistent tracking of objects across frames. While supervised methods achieve strong performance, they rely on densely annotated datasets that are costly to obtain and have limited domain coverage. Self-supervised learning offers a promising alternative by removing the need for manual labels; however, existing approaches often struggle to jointly maintain spatial accuracy and temporal coherence, particularly in unconstrained multi-object scenarios. Many rely on optical flow, synthetic motion cues, or task-specific pretraining, limiting scalability and generalisation. We propose a self-supervised framework, Cross-Temporal Consistency and Clustering, that learns mid-level, part-aware representations by combining attention-guided token selection with lightweight temporal clustering. Instead of operating at the pixel or whole-object level, the method aligns soft part assignments across time using a saliency-weighted symmetric consistency objective. The framework leverages a frozen transformer backbone with lightweight modules for adaptive token selection and multi-offset temporal alignment, enabling efficient scaling across resolutions and motion patterns.

31. 【2607.07219】Vision Foundation Models in Radiology: A Scoping Review of Data, Methodology, Evaluation and Clinical Translation

链接：https://arxiv.org/abs/2607.07219

作者：Alejandro Vergara-Richart(1 and 2),Xavier Rafael-Palou(1),Almudena Fuster-Matanzo(1),Ignacio Iborra Roncales(1),Ángel Alberich-Bayarri(1),Ana Jiménez-Pastor(1) ((1) Quantitative Imaging Biomarkers in Medicine, Quibim S.L., València, Spain, (2) Universitat Politècnica de València, València, Spain)

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Vision foundation models, Vision foundation, radiological imaging data, describing foundation models, foundation models trained

备注： 33 pages, 8 tables, 2 figures

点击查看摘要

Abstract:Vision foundation models (VFMs) are increasingly being developed for radiological imaging, yet their definition, development and evaluation remain heterogeneous. We conducted a PRISMAScR scoping review of peer-reviewed studies published between January 2017 and March 2026 describing foundation models trained exclusively on radiological imaging data. Sixty-seven studies were included and mapped across three pillars: data scale and heterogeneity, architectural and pretraining scalability, and downstream transferability and generalization. Datasets primarily covered brain MRI, thoracoabdominal CT, and chest X-ray, ranging from fewer than 100,000 samples to multi-million-image cohorts. Transformer-based architectures and self-supervised pretraining predominated, particularly masked image modeling, contrastive learning and multi-stage approaches. Evaluation focused mainly on segmentation and classification, whereas cross-center, cross-scanner, anatomical and modality-shift validation was inconsistently reported. Alignment with FUTURE-AI principles was uneven. Overall, radiology-specific VFMs show promising transferability, but clinical translation remains constrained by limited data representativeness, heterogeneous benchmarks, incomplete reporting and insufficient deployment-oriented evaluation.

32. 【2607.07216】Why Fake ? Unveiling the Semantic Vocabulary of Deepfake Detectors

链接：https://arxiv.org/abs/2607.07216

作者：Vazgken Vanian,Alexandros Doumanoglou,Dimitris Zarpalas

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：robust detection methods, technology poses, poses a significant, significant threat, Deepfake

备注： Accepted at CVPRW 2026

点击查看摘要

Abstract:Deepfake (DF) technology poses a significant threat to information integrity, driving the need for robust detection methods. Most DF detectors only consider predicting a binary label for whether the input is real or fake, lacking the justification required for real-world applications like legal proceedings. Explainable DF Detection has emerged to address this limitation, but existing techniques frequently fall short by either relying on human annotations for precise artifact localization or generating superficially plausible textual explanations without grounding. This work investigates the use of post-hoc explainable AI (XAI) to analyze the decision-making process of state-of-the-art black-box DF detectors. Specifically, we employ Encoding-Decoding Direction Pairs (EDDP), a technique suitable for uncovering the concept space of DF detectors (their semantic vocabulary) as well as the mechanism for writing and reading concept information to and from internal representations. Our analysis reveals previously hidden real and fake features learned implicitly during detector training, offering nuanced explanations unattainable through conventional methods. This enables global model understanding, spatially aware concept localization, and counterfactual what-if analysis, all contributing to a deeper comprehension of DF detection strategies.

33. 【2607.07195】DiffCVE: Diffusion-based Compressed Video Enhancement

链接：https://arxiv.org/abs/2607.07195

作者：Wenqiang Xiao,Wenzhuo Ma,Junxi Zhang,Zhenzhong Chen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：substantial information loss, remains challenging due, complex artifact patterns, videos remains challenging, compressed videos remains

备注：

点击查看摘要

Abstract:Perceptual quality enhancement of severely compressed videos remains challenging due to complex artifact patterns and substantial information loss. Recent diffusion models have demonstrated strong generative capability for visual restoration, but directly applying them to compressed video often ignores compression degradation characteristics and may introduce structure-inconsistent hallucinations. To address this issue, this paper presents a diffusion-based compressed video enhancement method, named DiffCVE. Coding Prior-enhanced Dual Conditioning (CPDC) branches are designed to jointly model compressed video and coding prior conditions, where coding priors including residuals and motion vectors provide complementary structural and motion guidance during the diffusion denoising process. To make the diffusion process aware of compression severity, a Compression Degradation Semantic Prompting (CDSP) mechanism is introduced to leverage QP-conditioned textual prompts together with LoRA fine-tuning. In addition, a Coding Prior-guided Weighted Fusion (CPWF) module is incorporated into the VAE decoder to fuse VAE encoder and coding prior encoder features with QP-predicted weights. Extensive experiments demonstrate the effectiveness of the proposed method in improving perceptual quality, especially under severe compression settings. The project page with enhanced video demonstrations is available at this https URL.

34. 【2607.07192】Prototype-Anchored Generalized Manifold Regression for Unknown-Domain Object Detection

链接：https://arxiv.org/abs/2607.07192

作者：Zihao Zhang,Aming Wu,Yang Li,Yahong Han

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Single-Domain Generalized Object, Generalized Object Detection, study Single-Domain Generalized, Generalized Object, Single-Domain Generalized

备注：

点击查看摘要

Abstract:In this paper, we study Single-Domain Generalized Object Detection (Single-DGOD), which aims to transfer a detector trained on a single source domain to multiple unseen domains. Existing methods mainly rely on simulation-driven strategies, such as data augmentation or textual prompts, to enlarge the training distribution. However, finite simulations can hardly cover the dynamic variations of real-world scenarios, often causing overfitting to synthetic styles and limited robustness to complex structural degradations. Inspired by the manifold hypothesis, we argue that semantic features, despite diverse visual changes, should lie on a compact and stable low-dimensional manifold. Therefore, robust generalization requires rectifying deviant samples back to this semantic manifold, rather than exhaustively simulating external perturbations. To this end, we propose Manifold Regression with Visual-Text Dual Chain-of-Thought (MR-DCoT), which formulates unknown-domain generalization as a manifold regression problem. MR-DCoT first uses a Visual-Text Dual Chain-of-Thought module to combine VLM-guided semantic evolution with diffusion-based structural perturbation, generating structured off-manifold hard examples. It then introduces Class-Specific Prototype Anchoring to learn a rectification operator that projects deviant features toward the source semantic manifold. By integrating outlier generation and semantic correction into a closed loop, MR-DCoT effectively narrows the distribution gap and improves robustness under unseen shifts. Extensive experiments on three complementary benchmarks, including adverse-weather detection, real-to-art generalization, and zero-shot semantic segmentation, demonstrate the effectiveness and versatility of our method.

35. 【2607.07187】EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning

链接：https://arxiv.org/abs/2607.07187

作者：Youtan Yin,Yanning Zhou,Jiacheng Wei,Xiaofeng Yang,Jun Zhang,Jiayang Bai,Jingwen Ye,Weidong Zhang,Guosheng Lin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：long-standing challenge, Local editing, remains a long-standing, Local, editing

备注： Accepted to ECCV 2026. Project page: [this https URL](https://editverse3d.github.io/)

点击查看摘要

Abstract:Local editing of 3D objects remains a long-standing challenge. When interacting with 3D content, humans naturally tend to specify a coarse region of interest for modification rather than defining precise editing boundaries. However, previous methods rely on fully edited 2D images, precise 3D masks, or redundant pipelines, which present a gap. To bridge this gap, we propose EditVerse3D, a novel 3D editing framework that enables high-quality object editing under such coarse guidance. Our approach takes as input a 3D object to be edited, a coarse 3D bounding box indicating the target region, and a reference 2D image describing the desired modification. It produces a coherent, high-fidelity edited 3D object. To facilitate this editing, we introduce a novel region-aware adaptive loss that emphasizes hard-to-learn regions and balances the objective between target and preserved areas. Complementing our loss function, we enhance model robustness and generalization through targeted data augmentations, such as training with scaled 3D masks and filtering out unrealistic editing pairs. We construct a large-scale 3D editing dataset derived from parts information. Extensive experiments demonstrate that EditVerse3D achieves superior visual quality and quantitative performance compared to existing 3D editing approaches. Please visit our project page at this https URL.

36. 【2607.07179】Comparative Study of Domain-adapted VLMs for General Document Visual Question Answering

链接：https://arxiv.org/abs/2607.07179

作者：Miguel Lopez-Duran,Elena Marrero,Julian Fierrez,Marta Robledo-Moreno,Ruben Vera-Rodriguez,Daniel DeAlcala,Aythami Morales,Ruben Tolosana,Oscar Delgado,Alvaro Ortigosa,Javier Ortega-Garcia

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Visual Question Answering, Question Answering, Document Visual Question, complex multimodal challenge, Visual Question

备注： 17 pages, 4 figures, accepted at the Automatically Domain-Adapted and Personalized Document Analysis workshop of the ICDAR 2026

点击查看摘要

Abstract:Document Visual Question Answering (DocVQA) presents a complex multimodal challenge, requiring models to exploit visual, textual, and layout information from documents. Although Vision-Language Models (VLMs) have shown remarkable performance in text-vision tasks, their robustness and transferability to different document domains remains underexplored. In this study, we present a comprehensive evaluation of 8 open-source pretrained VLMs on DocVQA in three different document domains: industrial documents of varying type, infographics, and presentation slides. We systematically assess model performance under zero-shot evaluations, fully supervised finetuning with inter- and intra-dataset evaluations, and few-shot learning evaluations of knowledge transfer between domains. Our findings demonstrate that while large pretrained VLMs possess strong zero-shot baselines for structured layouts, their performance strongly decreases on visually complex layouts of infographics and slides. Although parameter scaling is a dominant factor on performance, supervised finetuning yields higher relative gains in smaller architectures. Furthermore, our cross-domain and few-shot experiments show that visual understanding is the main bottleneck for DocVQA, not a lack of knowledge from the VLMs. Using 50 target domain samples, the models finetuned in DocVQA with datasets of different domains rapidly adapt to the target domain documents, even surpassing their fully supervised counterparts in some cases.

37. 【2607.07173】Stage-Aware Adaptation and Distribution Calibration for Subject-Driven Personalized Text-to-Image Generation

链接：https://arxiv.org/abs/2607.07173

作者：Wenyan Xu,Alizer Wong

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：pretrained diffusion model, preserving subject identity, Subject-driven personalized, requires a pretrained, pretrained diffusion

备注： 16 pages, 4 figures, 6 tables

点击查看摘要

Abstract:Subject-driven personalized text-to-image generation requires a pretrained diffusion model to acquire a specific subject from a few reference images while preserving subject identity, following novel text prompts, and maintaining sample diversity. Existing optimization-based methods instantiate subject adaptation through full fine-tuning, textual embedding optimization, or low-rank parameter updates; PaRa further constrains personalization from the perspective of parameter rank reduction. However, a uniform low-rank constraint or a uniform adapter strength cannot explicitly distinguish the capacity requirements of different denoising stages. Moreover, inference-time candidate selection driven mainly by identity similarity may compress the selected samples in the visual representation space. We decompose the problem into two complementary components: SPaRa denotes training-side stage-aware low-rank adaptation, DCAL denotes inference-side distribution-calibrated candidate selection, and SPaRa-DCAL denotes the combined framework. Theoretical analysis shows that timestep-dependent scaling controls the effective perturbation magnitude of a low-rank adapter, while identity-biased candidate selection restricts the radius of selected features around the reference center under explicit conditions. Auditable experiments under the SDXL and DreamBooth 30-subject protocol show that DCAL improves 1-LPIPS, CLIP-I, DINO-I, and CLIP-T on a fixed LoRA candidate pool, while revealing a clear trade-off with CLIP/DINO pairwise diversity and pairwise LPIPS. These results indicate that personalized generation should be evaluated through identity consistency, text alignment, and representation diversity rather than identity metrics alone.

38. 【2607.07170】PUF: Plug-and-Play Uncertainty-Aware Fusion for Online 3D Scene Graph Generation

链接：https://arxiv.org/abs/2607.07170

作者：Yi Yang,Myrna Castillo,Bodo Rosenhahn,Michael Ying Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：graph generation builds, builds a persistent, incrementally fusing, scene graph generation, generation builds

备注： Accepted by ECCV'26

点击查看摘要

Abstract:Online 3D scene graph generation builds a persistent, structured representation of a scene by incrementally fusing 2D observations into a global 3D graph. Existing online methods treat this fusion as a fully deterministic pipeline, where we identify three sources of uncertainty that are overlooked: observation, 2D model, and 3D representation. We propose PUF: a Plug-and-play, Uncertainty-aware, and training-free Fusion framework. Scene graph node association is reformulated as a probabilistic likelihood over semantic and spatial factors, replacing binary accept/reject gates. Dirichlet evidence accumulation distributes class and relationship evidence across plausible candidates proportional to association likelihood. An optional class-conditional prior completes edges for sparsely or never co-observed object pairs. We instantiate PUF with both a 3D Gaussian and a 3D voxel backend and observe consistent improvements, demonstrating its ability to generalize across different representations. Experiments on the 3DSSG and ReplicaSSG benchmarks show that our method substantially outperforms existing approaches while maintaining real-time latency. These results establish uncertainty-aware fusion as a principled and effective paradigm for online 3D scene understanding. The source code is publicly available at this https URL.

39. 【2607.07169】ACoS: Weakly Supervised Learning of Two-Dimensional Materials from Scribble Annotations to Precise Segmentation

链接：https://arxiv.org/abs/2607.07169

作者：Jiabei Chen,Liping Zhang,Jiang-Bin Wu,Zhongming Wei,Enhao Ning,Su Yan,Weijun Li,Ping-Heng Tan,Xin Ning

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：precise pixel-level localization, precise pixel-level, pixel-level localization, material flakes, tree energy

备注： 35 pages, 7 figures

点击查看摘要

Abstract:The precise pixel-level localization of 2D material flakes is crucial for high-throughput screening. However, traditional fully supervised methods rely on dense annotations, which are costly and time-consuming, severely limiting the practical deployment of segmentation models. This paper proposes TACoS, a specialized scribble segmentation framework tailored for 2D materials. First, we design a unified framework that integrates semi-supervised consistency learning with structured tree energy constraints. This framework comprises two core components: an unlabeled weak-strong distribution alignment module and a tree energy regularization module. The former employs cosine consistency constraints to enhance prediction alignment across views. Meanwhile, the latter utilizes minimum spanning trees to establish pixel affinity relationships and generate structure-aware soft pseudo labels for online semantic guidance. Next, we introduce asymmetric regional contrast learning. This approach fuses high-confidence predictions from the weak augmentation branch with scribbles to form augmented labels, and construct category prototypes in the representation space. Simultaneously, we prioritize contrastive constraints on challenging pixels in boundary-unlabeled regions. This strategy enhances intra-class cohesion and inter-class separation at the representation level, effectively reducing category confusion in low-contrast edges and complex backgrounds. Experiments conducted on the constructed graphene and MoS2 datasets demonstrate that our method TACoS achieves over 96% of fully supervised performance using less than 0.6% annotated data. Furthermore, it exhibits superior structural coherence and boundary stability in scenarios with weakly contrasting edges and complex backgrounds, providing an efficient and scalable solution for automated high-throughput screening of 2D material flakes.

40. 【2607.07168】NoDrift3R: Raymap-Guided Coupling for Drift-Robust Unposed Feed-Forward 3D Reconstruction

链接：https://arxiv.org/abs/2607.07168

作者：Xiangyu Sun,Liu Liu,Seungkwon Yang,Jingbing Han,Seungtae Nam,Zhizhong Su,Eunbyung Park

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：fast scene reconstruction, Gaussian Splatting, recently emerged, powerful paradigm, paradigm for fast

备注： European Conference on Computer Vision

点击查看摘要

Abstract:Pose-Free Feed-forward 3D Gaussian Splatting (3DGS) has recently emerged as a powerful paradigm for fast scene reconstruction. However, its performance degrades significantly in long image sequences due to cumulative camera pose estimation drift, which propagates errors into geometric modeling and severely limits rendering fidelity. In this work, we revisit the long-sequence bottleneck and identify pose drift as the primary factor restricting reconstruction quality. Furthermore, while SfM-based pseudo ground-truth poses introduce sensor noise, purely rendering-based supervision often leads to optimization instability and local minima due to the entangled optimization of geometry and pose. To address the challenges, we propose a synergistic pose-free framework that explicitly couples geometry and appearance via a Raymap-Guided Coupling Module (RGC). Concretely, we anchor Gaussian centers to raymap-induced geometry and jointly optimize RGB reconstruction, raymap consistency, and camera regularization under a unified objective, yielding a bidirectional feedback loop: stronger geometry improves rendering, and appearance supervision in turn refines geometry and pose. To further stabilize learning across wide temporal ranges, we introduce a Dual-Frequency Viewpoint Scheduling strategy that combines easy-to-hard interval expansion with replay of short-interval pairs. Extensive experiments across in-domain and cross-domain datasets show consistent gains in both rendering and pose estimation, with notably improved robustness on long sequences. Ablation studies validate our central insight: explicitly designed geometry-appearance synergy is the key to scalable and drift-robust pose-free feed-forward 3D reconstruction.

41. 【2607.07161】ASFR-Net: Adversarial Alignment and Spatio-Frequency Refinement Network for Heterogeneous Remote Sensing Image Change Detection

链接：https://arxiv.org/abs/2607.07161

作者：Xin-Jie Wu,Zhi-Hui You,Si-Bao Chen,Qing-Ling Shu,Xiao Wang,Jin Tang,Bin Luo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：distinct imaging mechanisms, remote sensing imagery, sensing imagery lies, decoupling genuine land-cover, effectively decoupling genuine

备注：

点击查看摘要

Abstract:The core challenge of heterogeneous change detection in remote sensing imagery lies in effectively decoupling genuine land-cover changes from significant modal disparities caused by distinct imaging mechanisms. These intrinsic inconsistencies are prone to introducing pseudo-changes, thereby constraining detection accuracy. To address this, we propose a novel, end-to-end adversarial spatio-frequency refinement network (ASFR-Net). Initially, a modality-invariant representation learner (MIR-Learner) guides the backbone to extract modality-invariant features, effectively bridging the primary domain gap. Subsequently, to address persistent residual modal differences, we design an innovative spatio-frequency synergistic enhancement module (SFEM), which identifies and suppresses sensor-specific noise and artifacts that are difficult to discern in the spatial domain by leveraging frequency-domain processing. Multi-level difference features are then computed from these refined representations and fed into a decoder equipped with cascaded hierarchical guided fusion module (HGFM) blocks to generate precise change maps. To alleviate the data scarcity in heterogeneous tasks, we construct and release a new high-resolution benchmark specifically focused on building changes: the visible-near-infrared heterogeneous change detection (VisNIR-HCD) dataset. It presents unique scientific challenges arising from deceptive visual similarity and non-linear spectral inversions, providing a robust platform for evaluating model generalization. Extensive experiments on VisNIR-HCD and public datasets demonstrate that ASFR-Net achieves state-of-the-art (SOTA) performance, significantly outperforming existing methods. The source code and the VisNIR-HCD dataset are publicly available at this https URL.

42. 【2607.07146】Prior-matched evaluation of operational Earth-observation classifiers: a three-number reporting method demonstrated on Sentinel-1 internal-wave detection

链接：https://arxiv.org/abs/2607.07146

作者：Joao Pinelo,Joao Goncalves,Arun Shukla,Adriana Santos-Ferreira

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词：internal solitary waves, Internal Waves Service, Waves Service screens, Internal Waves, Wave-mode archive

备注： 24 pages, 6 figures, 1 table

点击查看摘要

Abstract:The Internal Waves Service screens the Sentinel-1 Wave-mode archive for internal solitary waves, routing detections to experts whose adjudication time is the resource the effort exists to conserve. Because attention is the cost of error, precision leads. Its classifier was trained and reported at a one-to-one class balance, fixed before the operational rate could be known. That rate has since emerged at roughly one scene in twenty, and a balanced-test score badly overstates the precision a validator meets. A model that scores 0.794 balanced-test precision scores 0.192 in real operation: the gap is a systematic artefact of reporting at the wrong prior, invisible to the metric most work quotes. We show the mismatch to be an evaluation problem in the costume of a training one at a fixed recall, prior correction and calibration cannot move precision, and answer it with a prior-matched reporting method based on three figures: balanced-test, operational-prior, and real post-deployment, whose contrast is the honest measure. A precision-first, leakage-controlled development cycle then improves the classifier lever by lever, each promoted only against a pre-registered margin; added capacity not clearing it, calibration inert, feature aggregation the one real lift, so the honest negatives are as much a result as the gain. Holding recall at a floor of 0.80 and certifying against a sealed, single-read lockbox, the promoted model reports 0.927 precision at the operational prior; an out-of-time check confirms discrimination transfers to unseen periods while a fixed operating point does not. Prior-matched reporting, begin balanced, then move to the prior as the stream reveals it, transfers to any operational Earth-observation service bootstrapping a rare-event detector under a prior it has yet to discover.

43. 【2607.07135】Sparse Attention for Dense Open-Vocabulary Prediction in CLIP

链接：https://arxiv.org/abs/2607.07135

作者：Fatimah Zohra,Chen Zhao,Shuming Liu,Bernard Ghanem

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Contrastive Language-Image Pre-training, strictly positive distribution, Contrastive Language-Image, assigns probability mass, tokens-even semantically irrelevant

备注：

点击查看摘要

Abstract:Contrastive Language-Image Pre-training (CLIP) relies on softmax-based self-attention, a strictly positive distribution that assigns probability mass to every pair of tokens-even semantically irrelevant ones. While these dense softmax weights are effective for gathering broad context during pre-training, they spread attention across many low-salience tokens, producing noise that obscures the fine-grained, spatially localized cues required for dense, open-vocabulary prediction. We study an inference-time substitution of the row-wise softmax in the final visual self-attention layers with the $\alpha$-entmax transform, applied across both the standard query-key attention and self-correlation variants. Because entmax applies a data-dependent threshold that maps low scores exactly to zero, it acts as an implicit denoiser, zeroing contextually irrelevant dependencies while redistributing mass onto the most relevant tokens. We evaluate on open-vocabulary tasks-dense semantic segmentation (Pascal VOC, Pascal Context, ADE20K) and fine-grained retrieval (FG-OVD)-and find the gain from attention sparsification is proportional to how much the baseline attention spreads off the target class.

44. 【2607.07123】Widest-Path Reachability Fields for Connectivity-Preserving Slender Structure Segmentation

链接：https://arxiv.org/abs/2607.07123

作者：Youcheng Zong,Runda Jia,Minxuan Hu,Weilan Su,Dakuo He

类目：Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)

关键词：Segmenting slender curvilinear, invalidate downstream analysis, Segmenting slender, demands topological correctness, roads demands topological

备注：

点击查看摘要

Abstract:Segmenting slender curvilinear structures such as retinal vessels, cracks, and roads demands topological correctness, as even a single-pixel discontinuity can fragment a continuous network and invalidate downstream analysis. Under standard binary-mask supervision, models optimized for pixel-level overlap frequently produce topologically broken predictions. We trace this to a fundamental mismatch: pixel-wise losses distribute gradients uniformly, yet connectivity hinges on a sparse set of bottleneck pixels. These pixels are vastly outnumbered by thick structures and background, rendering their aggregate gradient contribution negligible. We term this phenomenon topological gradient starvation (TGS). To address it, we propose Widest-Path Reachability Fields (WPRF), a differentiable Max-Min reachability objective that redirects gradient flow to connectivity bottlenecks. The module is plug-and-play, backbone-agnostic, and incurs no inference overhead. WPRF implements a differentiable Max-Min objective via dynamic programming on a domain-restricted graph, coupled with a bottleneck-aware observation term that balances gradient contributions across varying structures. Compared to prior topology-aware losses that rely on post-hoc skeletonization or homology computation, WPRF directly optimizes end-to-end reachability via differentiable Max-Min algebra, enabling gradient flow to concentrate on connectivity bottlenecks without auxiliary structures. We introduce OMVIS, a new oral microvessel segmentation dataset. Experiments across nine architectures and six datasets validate the bottleneck-focused gradient routing mechanism. WPRF improves 87\% of experiments with fixed hyperparameters and achieves clDice gains of 7.2 percentage points on structurally fragile datasets.

45. 【2607.07119】ColorFM: An Optimization-to-Learning Framework for Color Transfer via Flow Matching

链接：https://arxiv.org/abs/2607.07119

作者：Yuhang He,Kai Zhang,Xiaoming Li,Du Chen,Jian Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：source image, reference image, aims to align, Color transfer aims, Color transfer

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:Color transfer aims to align the color distribution of a source image with that of a reference image while preserving structural and semantic consistency. However, existing methods often suffer from inaccurate global mapping, semantic misalignment, and visual artifacts. To address these issues, we propose ColorFM, an optimization-to-learning framework. ColorFM connects online optimization to offline inference by reformulating color transfer as the transport of pixel distributions along velocity fields via Flow Matching. Specifically, we introduce ColorFM-O, an instance-specific optimization scheme that fits the velocity field through hierarchical color coupling guided by semantic priors. By numerically integrating the induced flow trajectories, ColorFM-O produces precise and semantically consistent color transfer results, while generating high-quality paired data as pseudo-supervision. Building upon this, we design ColorFM-L, an efficient feed-forward model trained on the generated pairs. Through implicit state modeling, ColorFM-L extracts deep semantic features to predict flow parameters for bidirectional linearized transport, ensuring accurate color transfer. Extensive experiments demonstrate that ColorFM-L outperforms state-of-the-art methods in visual quality, structural fidelity, and semantic consistency, successfully combining the accuracy of optimization with the speed of feed-forward inference.

46. 【2607.07117】ree-of-Thoughts Reasoning for Text-to-Image In-Context Learning

链接：https://arxiv.org/abs/2607.07117

作者：Stepanida Alekseeva,Jenifer Kalafatovich,Seong-Whan Lee

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：latent compositional pattern, in-context learning, infer a latent, pattern from fewshot, fewshot demonstrations

备注： 6 pages, 3 figures, 4 tables. Accepted at IEEE SMC 2026. Code available at [this https URL](https://github.com/Pandastep/ToT-T2I-ICL)

点击查看摘要

Abstract:In text-to-image in-context learning (T2I-ICL), a model has to infer a latent compositional pattern from fewshot demonstrations for generating a query image. Recent studies show that state-of-the-art multimodal large language models struggle with this setting, particularly due to limited compositional reasoning and sensitivity to prompt construction. In this work, we propose a Tree-of-Thoughts (ToT) reasoning framework for T2I-ICL that introduces a multi-stage reasoning and selection layer that generates, evaluates, and selects among multiple candidate hypotheses before constructing the final prompt for image synthesis. By exploring alternative reasoning branches and selecting a coherent interpretation, the proposed approach mitigates prompt ambiguity and compositional errors. We implement the proposed approach in a complete ToT-T2IICL inference pipeline and evaluate it on the CoBSAT benchmark. Both qualitative and quantitative results show that structured multi-branch reasoning leads to more consistent and semantically aligned image generation compared to baseline and Chain-of-Thought prompting strategies, without any additional training or fine-tuning.

47. 【2607.07099】Video-Based Detection of squint and cataract for accessibility-aware adaptive web interface rendering

链接：https://arxiv.org/abs/2607.07099

作者：Amar Ranjan Dash,Manas Ranjan Patra

类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：major ocular disorders, majorly affect visual, affect visual perception, interaction capability, disorders that majorly

备注： International Journal of Computer Science, Engineering and Applications (IJCSEA), Vol. 16(3), 18 page 8 Figure, 2 Table

点击查看摘要

Abstract:Squint and cataract are major ocular disorders that majorly affect visual perception and interaction capability. This paper proposes a real-time video-based automated detection system for squint and cataract detection based on computer vision and image processing methods. The proposed system uses a media-pipe face-mesh (a 478-point facial landmark detection model) to extract geometric ocular features for multi-class squint classification. Simultaneously, The presence and severity cataract is estimated through grayscale intensity and histogram-based lens opacity analysis. The system records short video sequences with standard laptop or mobile cameras, which can be deployed at low costs and on a large scale. The experimental performance has shown great accuracy in the detection of squint (98.39%) and classification of cataract (96.90%). Besides automatic ocular analysis, the proposed framework is also made accessible for visual impairment inference which will be integrated with future adaptive user interface and Web accessibility systems for people with visual impairment.

48. 【2607.07091】AT-Attn: Temporal-Aware Cross-Attention for Longitudinal Multimodal Alzheimer's Disease Diagnosis

链接：https://arxiv.org/abs/2607.07091

作者：Xinyue Du,Yibo Liu,Zhenglei Zhou,Xuancheng Yao,Weimin Zhong,Qiuhui Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：longitudinal Alzheimer disease, Alzheimer disease, longitudinal Alzheimer, irregular visits, collected at irregular

备注： Submitted to IEEE BIBM 2026. 8 pages, 4 figures

点击查看摘要

Abstract:In longitudinal Alzheimer's disease (AD) diagnosis support, clinical and imaging information is often collected at irregular visits. Integrating these multimodal observations may improve diagnostic assessment, but naive fusion can degrade performance when MRI is noisy or intermittently unavailable. We propose AT-Attn, a temporal-aware multimodal framework that combines Change-and-Time encoding, time-biased asymmetric cross-attention, and gated fusion to integrate MRI with longitudinal clinical information. We evaluate AT-Attn on an MRI-retained ADNI cohort of 1,520 patients using structural MRI, six cognitive-scale trajectories, and seven static clinical variables under patient-level five-fold cross-validation. The main asymmetric AT-Attn model achieves accuracy 0.719+/-0.024, macro F1 0.721+/-0.023, ROC-AUC 0.873+/-0.013, and PR-AUC 0.783+/-0.018, outperforming unimodal and naive multimodal fusion baselines while remaining competitive with strong tabular baselines. These results suggest that a temporal-aware and constrained fusion strategy can help structural MRI contribute clinically relevant complementary information for patient-level AD diagnosis support.

49. 【2607.07077】Navigating Hierarchy: Hyperbolic Learning on Brain Graphs for Disorder Diagnosis

链接：https://arxiv.org/abs/2607.07077

作者：Yapeng Li,Bo Jiang,Ziyan Zhang,Dongdong Chen,Zhengzheng Tu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：supporting local processing, brain networks exhibit, inter-community coordination, supporting local, local processing

备注： 12 pages, 5 figures

点击查看摘要

Abstract:Functional brain networks exhibit a hierarchical organization across ROI, community, and whole-brain levels, supporting local processing, inter-community coordination, and global integration. Recent studies have demonstrated that brain community-aware modeling is beneficial for both diagnosis and biomarker identification of brain networks. However, existing brain graph modeling methods often struggle to model ROI-community interactions, thereby failing to fully exploit the hierarchy across ROI, community, and whole-brain network levels. To address this issue, inspired by deep hyperbolic learning in modeling hierarchical structures, we propose a novel framework, termed Hyperbolic Learning on Brain Graphs (HLBG), for brain network analysis. The core idea of HLBG is to exploit the inherent hierarchical geometry of hyperbolic space to model the hierarchical relationships among ROIs, functional communities, and the whole-brain network, thereby learning hierarchy-aware and highly discriminative representations for brain network data. Specifically, HLBG first projects representations from ROIs, communities, and the whole-brain network into Lorentzian hyperbolic space. Then, the multi-level hierarchy is imposed via two geometric entailment constraints. In addition, we introduce a new Graph-aware Mamba (GaMamba) model, which incorporates topology-derived structural prompts into Mamba to capture long-range dependencies while preserving graph topological information. Experiments on ABIDE-I and REST-MDD demonstrate that HLBG outperforms state-of-the-art methods and identifies disorder-relevant functional biomarkers.

50. 【2607.07051】Making Implicit Preservation Intent Explicit in Conversational Image Editing

链接：https://arxiv.org/abs/2607.07051

作者：Soomin Han,Jihyung Ahn,Bumsoo Kim,Buru Chang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：editing requires preserving, disappears across turns, requires preserving, temporarily disappears, Conversational image editing

备注：

点击查看摘要

Abstract:Conversational image editing requires preserving not only visible content, but also content that temporarily disappears across turns. When newly added or modified content occludes a previously visible region, that region should reappear if it was never semantically changed. However, existing systems often fail to recover such occluded-but-unchanged content, producing inconsistent or hallucinated results. We introduce OCCUR-Bench, a diagnostic benchmark for temporal preservation in conversational image editing. OCCUR-Bench provides diverse occlusion-and-revelation scenarios with historical restoration references, enabling evaluation of faithful restoration rather than plausible regeneration. We also propose ReSpec, a training-free framework that makes implicit preservation explicit by pairing restoration-aware instructions with historical visual references. Given an editing history, ReSpec identifies what should persist, selects the historical image state that provides missing visual evidence, and conditions an in-context editor on the resulting instruction and reference image. Experiments show that ReSpec improves restoration fidelity and temporal consistency on OCCUR-Bench, highlighting the need to ground preservation in editing history rather than only the current image.

51. 【2607.07038】RACE-Seg3D: Counterfactual Context Auditing For Robust 3D Glioma Segmentation Under Institutional Shift

链接：https://arxiv.org/abs/2607.07038

作者：Nguyen Linh Dan Le,Nguyen Pham Hoang Le,Tran Dang Khoi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Medical image segmentation, Medical image, achieve strong benchmark, sensitive to scanner, institutional variation

备注： 16 pages, 5 figures

点击查看摘要

Abstract:Medical image segmentation models can achieve strong benchmark performance while remaining sensitive to scanner, protocol, and institutional variation. These context shifts alter image appearance without changing the underlying lesion, allowing models to exploit nuisance cues that Dice and HD95 fail to expose. We present TRACE-Seg3D, a counterfactual context auditing framework for robust 3D medical image segmentation. TRACE-Seg3D preserves lesion-relevant evidence and systematically varies imaging context to quantify prediction stability under controlled context shifts. The framework pairs each segmentation with audit evidence for context sensitivity and anatomical plausibility, enabling case-level reliability assessment beyond overlap-based evaluation. Experiments on BraTS and UTSW glioma segmentation benchmarks demonstrate competitive in-distribution and cross-domain performance. TRACE-Seg3D also exposes context-sensitive failure modes missed by conventional metrics. These results establish counterfactual context auditing as a practical route toward transparent and reliable 3D medical image segmentation under distribution shift. Our code is available at this https URL.

52. 【2607.07033】AnchorPrune: Relevance-Anchored Contextual Expansion for Visual Token Pruning

链接：https://arxiv.org/abs/2607.07033

作者：Kyuan Oh,Bumsoo Kim

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：inputs introduce thousands, high-resolution inputs introduce, Large vision-language models, models incur substantial, Large vision-language

备注： ECCV 2026

点击查看摘要

Abstract:Large vision-language models incur substantial inference costs because high-resolution inputs introduce thousands of visual tokens, many of which are redundant for a given query. Existing pruning methods often combine query relevance and token diversity, yet these objectives can conflict under aggressive compression: relevance-driven selection may overconcentrate the budget on correlated local evidence, while diversity-driven selection may suppress indispensable tokens or retain distinct but uninformative regions. We introduce AnchorPrune, a training-free framework that first constructs a protected relevance anchor and then expands it with complementary visual context. AnchorPrune adaptively determines the anchor size from the novelty profile of relevance-ranked tokens, preserving a compact set of query-critical evidence, and allocates the remaining budget through importance-weighted novelty to recover informative, non-redundant context relative to the anchor. This ordered design prevents contextual expansion from displacing indispensable query cues while improving overall visual coverage. AnchorPrune is lightweight, architecture-aware, and requires neither retraining nor model modification. Across image and video vision-language models and benchmarks, it consistently improves the accuracy-efficiency trade-off over training-free baselines, particularly under severe compression. On LLaVA-NeXT-7B, AnchorPrune preserves 97.6% of full-token performance using only 160 of 2,880 visual tokens. These results establish relevance-anchored contextual expansion as an effective principle for efficient multimodal inference. Code is available at this https URL.

53. 【2607.07027】Latent graph encoding of multimodal neuroimaging features with generative AI architectures

链接：https://arxiv.org/abs/2607.07027

作者：Ishaan Batta,Meenu Ajith,Vince Calhoun

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：developing optimal architectural, optimal architectural frameworks, models enable encoding, generative models enable, developing optimal

备注： 6 pages, accepted in IEEE International Conference on Image Processing (ICIP) 2026

点击查看摘要

Abstract:While generative models enable encoding of complex neuroimaging data for feature generation and reconstruction, developing optimal architectural frameworks with appropriate encoding and latent space processes is crucial for studying structural and functional properties of the brain. We design a multimodal generative framework for structural and functional magnetic resonance imaging (MRI) features through systematic evaluation of encoding strategies, latent multimodal fusion, and generative model selection. Using structural gray matter volume (GMV) and static functional network connectivity (sFNC) features from a large neuroimaging dataset, we analyze generative frameworks involving variational autoencoders (VAEs), transformers, generative adversarial networks (GANs), and diffusion models. Architectures that employ modality-aware graph encoding of functional connectivity into a lower-dimensional latent space outperform vectorized encoders or direct data space approaches. The proposed multimodal graph VAE (gMMVAE) surpasses alternative generative variants across multiple metrics for generation fidelity, reconstruction quality, efficiency, and latent space discriminability, highlighting its potential for robust multimodal neuroimaging analysis.

54. 【2607.07019】SHTA: Semantic Hard Token Correction and Center Alignment for Semi-Supervised Medical Image Segmentation

链接：https://arxiv.org/abs/2607.07019

作者：Zhuoru Zhang,Yiheng Zhong,Zimu Zhang,Xiaofeng Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieved remarkable performance, Recent advances, semi-supervised medical image, medical image segmentation, Semantic Center Alignment

备注： 9 pages, 7 figures, 4 tables

点击查看摘要

Abstract:Recent advances in semi-supervised medical image segmentation have achieved remarkable performance through prediction consistency, pseudo-label supervision, and hard-region supervision. However, these methods primarily improve supervision quality rather than explicitly enforcing semantic consistency in the learned representations of hard regions. Consequently, even under increasingly stronger prediction-level supervision, difficult regions exhibiting unstable semantic assignment often fail to establish semantically consistent representations during training, thereby limiting further segmentation improvement. To address this issue, we propose SHTA (Semantic Hard Token Correction and Center Alignment), a lightweight training-time semantic representation branch. Instead of introducing additional prediction supervision, SHTA refines intermediate semantic representations through Semantic Assignment, Hard Token Refinement, and Semantic Center Alignment, thereby improving semantic consistency in hard regions while preserving the original prediction pathway and introducing no additional inference cost. We integrate SHTA into representative semi-supervised segmentation frameworks, including GA-CPS, CPS, URPC, and MagicNet, and conduct evaluations on the Synapse and AMOS datasets. Experimental results demonstrate that SHTA delivers consistent paired improvements across frameworks, with especially clear gains in segmentation accuracy, weak-organ recovery, and semantic ambiguity reduction, while incurring only training-time overhead. The code is available at this https URL.

55. 【2607.07001】Ego-Human Motion Prediction with 3D-Aware LLM

链接：https://arxiv.org/abs/2607.07001

作者：Yujin Bae,Jaewoo Jeong,Hyeonseong Kim,Kuk-Jin Yoon

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Anticipating human motion, Anticipating human, human-robot collaboration, perspective is fundamental, fundamental for proactive

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:Anticipating human motion from an egocentric perspective is fundamental for proactive assistance in AR/VR, human-robot collaboration, and embodied AI. While recent works incorporate language as a semantic prior to reduce the ill-posed nature of egocentric forecasting, they largely neglect the 3D spatial and semantic context that governs how motion unfolds, and treat pose and language prediction as separate inference streams. We introduce Ego3DLM, built on two core principles: accurate motion forecasting requires explicit spatial and semantic understanding of the 3D environment, and pose and language must be predicted holistically in a single pass, since motion is inherently tied to the semantic interpretation of actions being performed. Given three-point tracking, 3D scene features, and egocentric video, Ego3DLM simultaneously decodes past pose, future pose, past narration, and future narration in a single autoregressive pass, grounding predicted poses and descriptions in one another to enforce cross-modal and temporal consistency. We adopt a three-stage training scheme: (1) spatial-semantic scene awareness pretraining; (2) holistic instruction tuning over all four outputs in a single pass; and (3) GRPO-based reinforcement finetuning with intra- and inter-modal rewards that directly optimize pose-language fidelity. Experiments on the Nymeria benchmark demonstrate that Ego3DLM achieves state-of-the-art performance across future motion prediction, past motion tracking, and motion description, showing that 3D scene grounding and holistic cross-modal prediction yield physically plausible and semantically coherent motion forecasts. The project page is available at this https URL.

56. 【2607.06982】EdgeCompress: Coupling Multidimensional Model Compression and Dynamic Inference for EdgeAI

链接：https://arxiv.org/abs/2607.06982

作者：Hao Kong,Di Liu,Shuo Huai,Xiangzhong Luo,Ravi Subramaniam,Christian Makaya,Qian Lin,Weichen Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR); Machine Learning (cs.LG)

关键词：demonstrated encouraging results, Convolutional neural networks, image classification tasks, Convolutional neural, CNNs

备注： Author's accepted version. Published in IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems (TCAD)

点击查看摘要

Abstract:Convolutional neural networks (CNNs) have demonstrated encouraging results in image classification tasks. However, the prohibitive computational cost of CNNs hinders the deployment of CNNs onto resource-constrained embedded devices. To address this issue, we propose EdgeCompress, a comprehensive compression framework to reduce the computational overhead of CNNs. In EdgeCompress, we first introduce dynamic image cropping (DIC), where we design a lightweight foreground predictor to accurately crop the most informative foreground object of input images for inference, which avoids redundant computation on background regions. Subsequently, we present compound shrinking (CS) to collaboratively compress the three dimensions (depth, width, and resolution) of CNNs according to their contribution to accuracy and model computation. DIC and CS together constitute a multidimensional CNN compression framework, which is able to comprehensively reduce the computational redundancy in both input images and neural network architectures, thereby improving the inference efficiency of CNNs. Further, we present a dynamic inference framework to efficiently process input images with different recognition difficulties, where we cascade multiple models with different complexities from our compression framework and dynamically adopt different models for different input images, which further compresses the computational redundancy and improves the inference efficiency of CNNs, facilitating the deployment of advanced CNNs onto embedded hardware. Experiments on ImageNet-1K demonstrate that EdgeCompress reduces the computation of ResNet-50 by 48.8% while improving the top-1 accuracy by 0.8%. Meanwhile, we improve the accuracy by 4.1% with similar computation compared to HRank, the state-of-the-art compression framework. The source code and models are available at this https URL

57. 【2607.06972】HPR-SAM: Hierarchical Probabilistic Representation Learning for Prompt-free SAM-based Medical Image Segmentation

链接：https://arxiv.org/abs/2607.06972

作者：Yingzhen Hu,Yiheng Zhong,Keying Zhu,Zimu Zhang,Zihan Ye,Sifan Song,Jionglong Su,Xiaofeng Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Segment Anything Model, Hierarchical Probabilistic Representation, Multi-component Anatomical Representation, Distributional Anatomical Representation, medical image segmentation

备注： 9 pages, 4 figures

点击查看摘要

Abstract:Prompt-free adaptation of the Segment Anything Model (SAM) has emerged as a promising paradigm for automatic medical image segmentation. Existing methods mainly focus on prompt generation, while overlooking that prompt quality is fundamentally constrained by the expressiveness of anatomical representations. However, deterministic prototypes or semantic tokens are insufficient to jointly capture global anatomical priors, intra-structure diversity, and local structural reliability. To address this limitation, we propose the Hierarchical Probabilistic Representation (HPR) framework, which learns complementary anatomical representations through Distributional Anatomical Representation (DAR), Multi-component Anatomical Representation (MAR), and Local Reliability Representation (LRR), and integrates their predictions via Hierarchical Prediction Fusion (HPF) while remaining compatible with the original SAM decoder. Experiments on the Synapse, LA, and PROMISE12 datasets demonstrate that HPR-SAM achieves state-of-the-art performance on Synapse and the best performance under few-shot settings on LA and PROMISE12, validating the effectiveness of the proposed hierarchical probabilistic representation learning framework for prompt-free medical image segmentation. Code is available at this https URL.

58. 【2607.06949】SpiS-GAN: Spiral-Modulated Handwriting Synthesis with Star Operation

链接：https://arxiv.org/abs/2607.06949

作者：Nguyen Duy Hieu,Dang Hoai Nam,Pham Hoang Giap,Quang Huu Hieu,Vo Nguyen Le Duy

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：requires massive amounts, robust handwriting recognition, Training robust handwriting, systems requires massive, annotated data

备注：

点击查看摘要

Abstract:Training robust handwriting recognition (HTR) systems requires massive amounts of annotated data, which is often difficult to acquire. While synthetic handwriting generation offers a practical solution to expand training sets, existing models struggle with several core issues. First, previous approaches, even MLP-based models fail to effectively trace cursive handwriting due to fixed-grid spatial receptive field. Second, their CNN-relied discriminators usually lose structural details through aggressive downsampling, making broken connections difficult to detect. Third, existing architectures are either limited to linear feature interactions or too expensive for high-resolution synthesis. Finally, existing approaches lack explicit edge constraints, often resulting in blurred stroke boundaries. To address these challenges, this study proposes a Spiral-Modulated Handwriting Synthesis framework based on Generative Adversarial Networks (SpiS-GAN). Our generator employs Star-Spiral Blocks combining proposed Modulated Elliptical SpiralFC with the star operation to capture spatial relationships and efficiently follow complex handwriting stroke trajectories, while a Spiral-Modulated discriminator is introduced for multi-domain flaws detection. Additionally, we introduce a Sobel-Regularized Edge Reconstruction Loss that provides edge guidance, ensuring every character remains clear and legible. Evaluations on the English and Vietnamese datasets demonstrate that SpiS-GAN significantly outperforms current state-of-the-art models. The generated images are highly authentic, accurately preserve the original writer's style across languages, and successfully lower error rates when training downstream HTR systems.

59. 【2607.06948】Self-Supervised Pretraining Improves Cross-Site and Cross-Scale Robustness of Point Cloud Leaf-Wood Segmentation

链接：https://arxiv.org/abs/2607.06948

作者：Heeju Mun,Tackang Yang,Yunsoo Nam,Changhyun Choi

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：tree point clouds, point clouds varies, point clouds, existing leaf-wood segmentation, point cloud tasks

备注： 30 pages, 10 figures

点击查看摘要

Abstract:The accuracy of existing leaf-wood segmentation methods for tree point clouds varies across forest types and sites. Self-supervised learning (SSL) on point clouds has improved the generalization of deep learning models for forestry point cloud tasks, including biomass regression and individual tree segmentation, but its applicability to leaf-wood segmentation remains untested. In this study, we pretrained Point-M2AE, a widely used SSL architecture for point clouds, on ShapeNet-55 augmented with 2,400 individual tree point clouds. For fine-tuning and inference, we used recursive voxel subdivision to handle the wide variation in point density across inputs, allowing the same model to operate at both individual-tree and plot scales without architecture change. Compared to the model without pretraining, the pretrained model improved wood IoU from 60.5% to 70.0% for needleleaf and from 69.7% to 76.3% for broadleaf trees. On a benchmark spanning four countries across three climatic zones, the pretrained model achieved the smallest cross-site variation and highest overall performance among compared methods (LeWos, CWLS, and PointTransformer). Plot-level segmentation maintained accuracy comparable to individual-tree performance, with mIoU of 84.7% for broadleaf and 77.7% for needleleaf plots, showing that the model generalizes across scales without additional finetuning. As a downstream test in tropical forests, where dense canopies make segmentation challenging, we applied our model and a quantitative structure model to estimate wood volume for 28 trees from Guyana, Indonesia, and Peru to assess whether the segmentation improvements from SSL pretraining translate into improved downstream performance. The resulting volume estimates achieved the lowest error among all methods tested (MAE = 2.40 m$^3$), less than half that of algorithmic baselines (LeWos: 5.94 m$^3$; CWLS: 5.27 m$^3$).

60. 【2607.06943】General Incomplete Multimodal Learning via Dynamic Quality Perception

链接：https://arxiv.org/abs/2607.06943

作者：Xiangyu Meng,Shicai Wei

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal learning robust, Incomplete Multimodal Learning, General Incomplete Multimodal, Multimodal learning, real-world applications

备注： Accepted by ECCV 2026. Corresponding author: Shicai Wei

点击查看摘要

Abstract:Multimodal learning robust to missing modalities is essential for real-world applications. Existing methods mainly focus on inter-modality missing, where entire modalities are absent, while overlooking intra-modality degradation, where modalities are present but severely corrupted. In practice, these two types of missing often coexist, making existing approaches ineffective. To address this limitation, we propose General Incomplete Multimodal Learning (GIML), a unified framework that simultaneously handles both inter-modality missing and intra-modality degradation through dynamic quality perception. Specifically, GIML models heterogeneous missing patterns as continuous modality information degradation, enabling degradation-aware adaptive fusion. To achieve reliable quality perception, we introduce a Noise-aware Quality Estimator that learns the mapping from corrupted features to noise intensity through controlled noise injection. Furthermore, we propose a Noise-Semantic Decoupled module that separates semantic information from noise interference. This improves robustness and generalization to unseen corruption patterns. Extensive experiments across datasets with diverse modality types demonstrate the effectiveness and generality of GIML. Code is available at: this https URL.

61. 【2607.06923】Bi-PT: Bidirectional Cross-Attention Point Transformers for Four-Chamber Heart Reconstruction from Sparse Cardiac MRI Data

链接：https://arxiv.org/abs/2607.06923

作者：Chenchuhui Hu,Shaoming Pan,Leon Axel,Meng Ye

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：magnetic resonance imaging, clinical sparsely sampled, sparsely sampled cardiac, sampled cardiac magnetic, cardiac magnetic resonance

备注：

点击查看摘要

Abstract:We propose Bi-PT, a pipeline for reconstructing 3D four-chamber human heart meshes from clinical sparsely sampled cardiac magnetic resonance imaging (CMR) data. This work addresses the error-prone generation of 3D cardiac shape from a sparse point cloud (SPC) extracted from 2D long-axis and short-axis views used in routine clinical CMR protocols. Bi-PT enables accurate inference of the four-chamber heart mesh from the SPC by learning robust point features via bidirectional point cross-attention between an atlas and the SPC, together with per-point semantic labels that improve correspondence estimation. We formulate the deformation field as a Neural Ordinary Differential Equation (NODE) parameterized by a per-point affine transformation and translation to deform the atlas toward the target heart shape. By learning such a NODE, we can guarantee the deformation field to be a locally affine diffeomorphic deformation. We also integrate a semantic label loss into the Chamfer distance to encourage label-consistent correspondences and add a smoothness regularization to stabilize and improve the learning of the deformation field. Extensive experiments demonstrate that Bi-PT achieves accurate and robust performance compared to baselines.

62. 【2607.06922】Latency-Constrained DNN Architecture Learning for Edge Systems using Zerorized Batch Normalization

链接：https://arxiv.org/abs/2607.06922

作者：Shuo Huai,Di Liu,Hao Kong,Weichen Liu,Ravi Subramaniam,Christian Makaya,Qian Lin

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：accessing cloud servers, deep neural network, latency constraint, Deep learning applications, cloud servers

备注： 15 pages. Author's accepted manuscript, published in Future Generation Computer Systems

点击查看摘要

Abstract:Deep learning applications have been widely adopted on edge devices, to mitigate the privacy and latency issues of accessing cloud servers. Deciding the number of neurons during the design of a deep neural network to maximize performance is not intuitive. Particularly, many application scenarios are real-time and have a strict latency constraint, while conventional neural network optimization methods do not directly change the temporal cost of model inference for latency-critical edge systems. In this work, we propose a latency-oriented neural network learning method to optimize models for high accuracy while fulfilling the latency constraint. For efficiency, we also introduce a universal hardware-customized latency predictor to optimize this procedure to learn a model that satisfies the latency constraint by only a one-shot training process. The experiment results reveal that, compared to state-of-the-art methods, our approach can well-fit the 'hard' latency constraint and achieve high accuracy. Under the same training settings as the original model and satisfying a 34 ms latency constraint on the ImageNet-100 dataset, we reduce GoogLeNet's latency from 40.32 ms to 34 ms with a 0.14% accuracy reduction on the NVIDIA Jetson Nano. When coupled with quantization, our method can be further improved to only 0.04% drop for GoogLeNet. On the NVIDIA Jetson TX2, we compress VGG-19 from 119.98 ms to 34 ms and even improve its accuracy by 0.5%, and we scale GoogLeNet up from 20.27 ms to 34 ms and achieve higher accuracy by 0.78%. We also open source this framework at this https URL

63. 【2607.06919】Compass: Prostate Cancer Detection Needs Multi-View Context

链接：https://arxiv.org/abs/2607.06919

作者：Paul F.R. Wilson,Mohamed Harmanani,Zhuoxin Guo,Obed K. Dzikunu,Hannes Cash,Adam Kinnaird,Brian Wodlinger,Purang Abolmaesumi,Parvin Mousavi

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Artificial intelligence, shown promise, Artificial, PCa detection, analysis of micro-ultrasound

备注： MICCAI 2026

点击查看摘要

Abstract:Artificial intelligence (AI) analysis of micro-ultrasound ($\mu$US) has shown promise for prostate cancer (PCa) detection. However, most existing AI methods focus on the analysis of single $\mu$US images in isolation. By contrast, expert $\mu$US readers typically assess a full recorded video study, which provides three-dimensional context, to improve PCa detection compared to single-frame analysis. Inspired by this clinical workflow, we propose Compass, a novel AI methodology which models a $\mu$US study as a stream of 2D images. Compass jointly integrates rotational sweep videos of the prostate with $\mu$US frames acquired at the moment of biopsy, and performs evidence aggregation across the study using a transformer conditioned on the probe's rotational angle. Finally, a decoder head predicts frame-level and study-level risk scores for the patient. The model is trained and evaluated using a multi-center clinical trial dataset of $\mu$US studies, including continuous rotational scans of the prostate and videos captured during biopsy acquisition. We compare the proposed method to baseline AI methods from the literature and to risk scores provided by clinical experts. Our framework shows strong performance, highlighting the value of multi-view context for $\mu$US PCa detection, and providing a potentially powerful tool to complement human expertise in $\mu$US-based PCa diagnosis. Our code is available at: this https URL.

64. 【2607.06918】LoCA: Spatially-Aware Low-Rank Convolutional Adaptation of Vision Foundation Models

链接：https://arxiv.org/abs/2607.06918

作者：Sojung An,Junha Lee,Sujeong You,Nam Ik Cho,Donghyun Kim

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Vision Foundation Models, Pre-trained Vision Foundation, Foundation Models, Vision Foundation, provide strong visual

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Pre-trained Vision Foundation Models (VFMs) provide strong visual representations for diverse downstream tasks. The key challenge of VFM adaptation stems from the prohibitive costs of full fine-tuning and catastrophic forgetting. To address this, Low-Rank Adaptation (LoRA) has emerged as the prevailing paradigm for Parameter-Efficient Fine-Tuning (PEFT). However, LoRA is typically designed for transformer self-attention layers parameterized by 2D matrices. Since convolutional kernels inherently couple spatial and channel information within a 4D tensor, forcing them into a monolithic 2D matrix disrupts the inherent spatial topology. In this paper, we propose Low-Rank Convolutional Adaptation (LoCA), a convolution-aware PEFT framework that addresses spatial-channel entanglement by decoupling channel and spatial adaptation. LoCA introduces a low-rank channel adaptation for dense cross-channel mixing and refines spatial bases extracted from pre-trained kernels via Singular Value Decomposition (SVD). Experimental results show that LoCA preserves pre-trained spatial priors and achieves competitive or state-of-the-art performance across fine-grained classification, domain-generalized semantic segmentation, and generative benchmarks.

65. 【2607.06915】Smart Scissor: Coupling Spatial Redundancy Reduction and CNN Compression for Embedded Hardware

链接：https://arxiv.org/abs/2607.06915

作者：Hao Kong,Di Liu,Shuo Huai,Xiangzhong Luo,Weichen Liu,Ravi Subramaniam,Christian Makaya,Qian Lin

类目：Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR); Machine Learning (cs.LG)

关键词：convolutional neural networks, neural networks, convolutional neural, promising for edge, dynamic image cropping

点击查看摘要

Abstract:Scaling down the resolution of input images can greatly reduce the computational overhead of convolutional neural networks (CNNs), which is promising for edge AI. However, as an image usually contains much spatial redundancy, e.g., background pixels, directly shrinking the whole image will lose important features of the foreground object and lead to severe accuracy degradation. In this paper, we propose a dynamic image cropping framework to reduce the spatial redundancy by accurately cropping the foreground object from images. To achieve the instance-aware fine cropping, we introduce a lightweight foreground predictor to efficiently localize and crop the foreground of an image. The finely cropped images can be correctly recognized even at a small resolution. Meanwhile, computational redundancy also exists in CNN architectures. To pursue higher execution efficiency on resource-constrained embedded devices, we also propose a compound shrinking strategy to coordinately compress the three dimensions (depth, width, resolution) of CNNs. Eventually, we seamlessly combine the proposed dynamic image cropping and compound shrinking into a unified compression framework, Smart Scissor, which is expected to significantly reduce the computational overhead of CNNs while still maintaining high accuracy. Experiments on ImageNet-1K demonstrate that our method reduces the computational cost of ResNet50 by 41.5% while improving the top-1 accuracy by 0.3%. Moreover, compared to HRank, the state-of-the-art CNN compression framework, our method achieves 4.1% higher top-1 accuracy at the same computational cost. The codes and data are available at this https URL

66. 【2607.06909】Seeing What Matters: Lesion-Aware High-Resolution Patch Discovery and Fusion for Chest X-ray Report Generation

链接：https://arxiv.org/abs/2607.06909

作者：Yingshu Li,Yunyi Liu,Zhenghao Chen,Tong Chen,Zailong Chen,Lingqiao Liu,Lei Wang,Luping Zhou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：radiology report generation, heavily downsampled inputs, pretrained vision encoders, clinically important cues, important cues present

备注：

点击查看摘要

Abstract:Despite rapid advances in chest X-ray (CXR) foundation models, most radiology report generation (RRG) systems still rely on heavily downsampled inputs (e.g., 256x256) due to the fixed visual token budgets of pretrained vision encoders, suppressing subtle yet clinically important cues present in native-resolution images. However, enabling high-resolution (high-res) perception remains challenging: naive tiling causes prohibitive token inflation, while global compression suppresses subtle lesions and degrades diagnostic fidelity. Inspired by radiologists' workflow, localizing suspicious regions before detailed high-res assessment. We propose Lesion-Aware High-Resolution Patch Discovery and Fusion for Chest X-ray Reporting (LePaX), the first RRG framework that enables efficient high-res CXR perception (up to 1920x1920) without increasing the vision-token count. LePaX formulates high-res perception as a constrained spatial resolution allocation problem under a fixed token budget and introduces two key components: Learnable Spatial Resolution Allocation (LSRA), which learns a spatial utility map that adaptively allocates limited high-res capacity to diagnostically relevant regions, enabling targeted extraction of high-res patches from native CXRs; and Global-Regional Fusion (GRF), which performs token-preserving region-to-global refinement by projecting high-resolution regional evidence back onto the global feature grid through spatially aligned resolution write-back, avoiding token inflation. Experiments on multiple CXR benchmarks demonstrate that LePaX consistently improves both clinical and linguistic metrics while enabling native-resolution CXR perception with over 10x fewer visual tokens than naive high-res tiling.

67. 【2607.06896】Dynamic Object Detection and Tracking in Construction: A Fisheye Camera and LiDAR Sensor Fusion Model

链接：https://arxiv.org/abs/2607.06896

作者：Yilong Chen,Huili Huang,Yong K. Cho

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：effectively alongside humans, Robust dynamic object, Robust dynamic, essential for enabling, operate safely

备注： 4 pages, 8 figures, submitted to IEEE International Conference on Robotics and Automation (ICRA) 2025 Future of Construction Workshop

点击查看摘要

Abstract:Robust dynamic object detection and tracking are essential for enabling robots to operate safely and effectively alongside humans in complex environments such as construction sites. While LiDAR-based SLAM and occupancy grid methods offer viable solutions for detecting and tracking motion, many state-of-the-art 3D vision approaches rely heavily on pre-trained neural networks and require additional post-processing to identify moving objects. Sensor fusion techniques, combining the precision of LiDAR with the semantic richness of RGB imagery, offer a promising alternative. In this work, we present a novel framework that enhances a quadruped robot equipped with a LiDAR sensor and an upward-facing fisheye camera for real-time dynamic object detection and tracking. After identifying moving objects within a registered point cloud, our method assigns semantic labels by projecting 3D coordinates onto a 2D cylindrical panorama, aligning with real-time image-based detections for observation update of the Kalman filter. The proposed system demonstrates high precision, simplicity, and robustness, particularly in handling objects transitioning between dynamic and static states, thus it is well-suited for deployment in real-world construction environments.

68. 【2607.06889】ReMoDEx: A Local-to-Global Relevance-Based Model Decision Explainability Framework for large-Scale Image Datasets

链接：https://arxiv.org/abs/2607.06889

作者：Abhay Kumar Pathak,Mrityunjay Chaubey,Manjari Gupta

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：achieve strong predictive, Deep learning image, strong predictive performance, classifiers achieve strong, Deep learning

备注：

点击查看摘要

Abstract:Deep learning image classifiers achieve strong predictive performance yet remain opaque in how decisions are formed. A model may predict correctly while relying on irrelevant cues, shortcut associations, peripheral structures, or device level artifacts instead of task relevant regions. On large scale datasets this opacity is especially problematic, since inspecting heatmaps one sample at a time cannot scale to thousands of predictions. We propose Relevance Based Model Decision Explainability (ReMoDEx), a framework for systematic, dataset scale assessment of model decision behaviour in image classification. ReMoDEx defines a stepwise pipeline: model inference, target class selection, relevance map generation, heatmap standardisation, similarity based grouping of patterns, cluster level interpretation, and spatial relevance assessment. Local methods GradCAM++, Integrated Gradients, Occlusion Sensitivity, and Layerwise Relevance Propagation are each combined independently with a single global module that summarises an entire set of relevance maps into a few decision strategy clusters, replacing sample by sample inspection with an automatic, scalable summary. To demonstrate ReMoDEx, we applied it to a VGG16 based classifier distinguishing COVID-19, Normal, Lung Opacity, and Viral Pneumonia. The classifier showed stable performance (86.27% test accuracy, 0.9624 test AUC). However, each explainer combined with the global module consistently produced two recurring strategies: central thoracic region decisions and border/corner sensitive decisions, indicating possible shortcut learning that conventional metrics could not reveal. Masked image validation confirmed that model confidence and predicted class changed when central or peripheral regions were occluded. ReMoDEx thus provides a scalable relevance based decision assessment framework and an essential complement to accuracy based evaluation.

69. 【2607.06875】Video2Reaction: Mapping Video to Audience Reaction Distribution in the Wild

链接：https://arxiv.org/abs/2607.06875

作者：Trang Nguyen,Sidong Zhang,Shiv Shankar,Gauri Jagatap,Deepak Chandran,Andrea Fanelli,Madalina Fiterau

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：improving content creation, Understanding and forecasting, forecasting audience reactions, recommendation systems, audience reaction prediction

备注：

点击查看摘要

Abstract:Understanding and forecasting audience reactions to video content are crucial for improving content creation, recommendation systems, and media analysis. To enable audience reaction prediction and other content engagement applications, we introduce $\textbf{Video2Reaction}$, a multimodal dataset that maps short movie segments to a distribution of $\textit{induced emotions}$ of viewers in the wild, as expressed through social media. $\textbf{Video2Reaction}$ spans more than 10,000 videos and serves as a reliable benchmark as well as a training resource for audience reaction prediction. To enable cost-effective continuous annotations as reactions may change over time, we develop a two-stage multi-agent pipeline using only open-source LLMs, achieving 86% correctness under blind human verification despite the inherently noisy and subjective nature of the task. We establish the first benchmark for video-to-reaction-distribution prediction in the wild and show that pretrained foundation video models fail in zero-shot settings, while finetuning transforms them into state-of-the-art predictors capable of modeling both full reaction distributions and dominant responses from video alone. However, the task remains challenging: even the strongest methods achieve only 77% Top-3 F1 in dominant reaction prediction (LLaVA-Next), highlighting a substantial gap in modeling collective audience reaction. \modification{Dataset and code are available at our project page: this https URL

70. 【2607.06872】Ensemble Deep Learning Approaches for AI-Altered Video Detection

链接：https://arxiv.org/abs/2607.06872

作者：Laiba Khan,Hung-Mao Wu,Wei Lin,Frank Bi,Yousef Abdelhadi,Joshua Jung

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：manipulated content, increasing accessibility, accessibility of artificial, artificial intelligence, intelligence has led

备注：

点击查看摘要

Abstract:The increasing accessibility of artificial intelligence has led to a rapid rise in AI-generated videos, making it more difficult to distinguish between real and manipulated content. Many existing detection methods rely on a single model and often struggle to generalize across different types of deepfakes. In this work, we developed a multimodal deepfake detection system that combines both audio and visual analysis using an ensemble of models. The system includes AASIST for audio-based detection, and EfficientNet, XceptionNet, and MesoNet for analyzing visual features in video frames. The pipeline takes a video as input, separates the audio, and extracts face frames using MTCNN. Each model produces a score indicating the likelihood of the input being fake. These scores are then combined using ensemble strategies, including mean averaging and stacking. Mean fusion provides a simple and stable baseline, while stacking uses a trained meta-model to learn how to combine predictions more effectively. Results show that while individual models perform well on the datasets they were trained on, their performance drops when tested on more diverse datasets. The ensemble approach helps improve overall robustness by combining predictions from multiple models, leading to more consistent performance across different types of deepfakes. This suggests that using both audio and visual information together is a more reliable approach for deepfake detection. Our results highlight generalization to unseen manipulations as the central open challenge, with average accuracy around 70%.

71. 【2607.06871】Geometric Collapse: When Vision Models Fail to Verify Physical Causality

链接：https://arxiv.org/abs/2607.06871

作者：Wentao Zhang,Jinhu Qi,Weiqiang Jin,Yifei Zhang,Chan-Tong Lam,Irwin King

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large-scale self-supervised learning, scaling yields inference-time, yields inference-time physical, Recent progress, physical plausibility checks

备注： ICML 2026

点击查看摘要

Abstract:Recent progress in large-scale self-supervised learning has improved dense geometric prediction, but it remains unclear whether such scaling yields inference-time physical plausibility checks. We propose Scrambled Edges, a controlled counterfactual that injects salient edge-like cues while violating surface continuity, illumination coherence, and occlusion ordering. With energy-matched and structure-matched controls, we isolate the effect of unsupported edge evidence from high-frequency energy and edge sparsity. Across CNN/ViT/SSL depth predictors on NYU Depth v2 and KITTI, Scrambled Edges induce up to 3.2x larger deviation from clean predictions than energy-matched noise; additional diffusion and flow-matching depth estimators show attenuated but still significant collapse. The resulting Geometric Collapse propagates globally: even with oracle knowledge of the corrupted region, output-level repair recovers only 47%, with substantial error outside the mask. These findings provide controlled behavioral evidence that current dense predictors lack reliable mechanisms to quarantine physically unsupported edge cues, motivating explicit plausibility scoring and selective cue integration.

72. 【2607.06856】Gen4U: Unifying Video Generation and Understanding via Diffusion

链接：https://arxiv.org/abs/2607.06856

作者：Michael King,Aravindh Mahendran,Matthew Koichi Grimes,Fedor Kitashov,Adham Elarabawy,Pedro Velez,Maks Ovsjanikov,Viorica Pătrăucean

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Prior work suggests, capture low-level geometry, Prior work, representations capture low-level, diffusion representations capture

备注：

点击查看摘要

Abstract:Prior work suggests that diffusion representations capture low-level geometry but struggle with high-level semantics. We demonstrate that state-of-the-art video diffusion models overcome this limitation. By systematically probing their intermediate activations using recent mutual-kNN alignment metrics, we reveal a highly structured latent space where visual representations evolve across both network depth and noise levels. We show that while moderate noise levels yield linearly separable global semantics, fine-grained details persist at lower noise levels but become spatially scattered, requiring attention mechanisms to decode. Building on these insights, we introduce Gen4U (Generation for Understanding), a framework that repurposes these generative representations with a single forward pass. Our experiments establish that frozen, large-scale video diffusion models function as highly competitive video encoders across a wide spectrum of tasks, spanning semantic and non-semantic objectives (video classification, depth estimation, camera pose estimation, image and video captioning). Bypassing fine-tuning, Gen4U unifies the generation and understanding paradigms, achieving strong perception performance while fully preserving the model's ability to generate high-quality video.

73. 【2607.06843】Retrieving and Refining Winning Noise Tickets for Diffusion-Based Motion Generation

链接：https://arxiv.org/abs/2607.06843

作者：Sakuya Ota,Qing Yu,Kent Fujiwara,Satoshi Ikehata,Ikuro Sato

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：synthesize realistic human, exhibit semantic drift, realistic human motions, models synthesize realistic, synthesize realistic

备注： Accepted to ECCV 2026, Project page: [this https URL](https://sinc865.github.io/winro/)

点击查看摘要

Abstract:Diffusion-based text-to-motion models synthesize realistic human motions but often exhibit semantic drift from the input text. Motion is inherently temporal, especially in compositional and long-duration sequences that require semantic consistency across multiple action segments and smooth kinematic transitions throughout the trajectory. We posit that the initial noise is central to this consistency: within the Gaussian noise space, certain instances, i.e. winning noise tickets, carry latent structure that biases denoising toward particular motion semantics, even under null prompts. We propose WInning Noise Retrieval and Optimization (WINRO), a training-free, model-agnostic framework that improves text-motion alignment by selecting and refining such tickets before diffusion sampling. WINRO maps random noises to motion features generated under null prompts, retrieves the best-aligned noise for a given text, and refines it via a KL-regularized objective that reduces the residual semantic gap while preserving the Gaussian prior. An optional LoRA-based adapter amortizes this refinement into a single forward pass. WINRO consistently improves text-motion fidelity across different base models, MDM and MotionLCM, on HumanML3D without retraining, improves temporal robustness on the MTT benchmark, and generalizes to applications such as motion stylization and spatial constraint satisfaction.

74. 【2607.06839】LEMUR 2: Unlocking Neural Network Diversity for AI

链接：https://arxiv.org/abs/2607.06839

作者：Tolgay Atinc Uzun,Waleed Khalid,Saif U Din,Sai Revanth Mulukuledu,Akashdeep Singh,Chandini Vysyaraju,Raghuvir Duvvuri,Avi Goyal,Yashkumar Rajeshbhai Lukhi,Muhammad A. Hussain,Krunal Jesani,Usha Shrestha,Yash Mittal,Roman Kochnev,Pritam Kadam,Mohsin Ikram,Harsh R. Moradiya,Alice Arslanian,Dmitry Ignatov,Radu Timofte

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：Existing NAS benchmarks, Existing NAS, NAS benchmarks, cover only narrow, task-specific regions

备注： 10 pages, 9 figures, 1 table

点击查看摘要

Abstract:Existing NAS benchmarks (e.g., NAS-Bench, NATS-Bench) cover only narrow, task-specific regions of the architectural design space and lack cross-domain or deployment-aware evaluation. LEMUR 2 introduces a large-scale, extensible framework unifying generative, evaluative, and deployment pipelines to unlock neural-network diversity. It comprises over 14,000 distinct architectures and more than 750,000 structured training records documenting model performance, hyperparameters, and task outcomes. These models were produced through AST-based code mutation, genetic and reinforcement-learning evolution, generation of fractal architectures, and synthesis guided by a Large Language Model (LLM). This includes deep models generated with the retrieval-augmented system NN-RAG, which derived and used architectural motifs from over 900 PyTorch modules extracted from public repositories. LEMUR 2 further employs NN-VR and NN-Lite pipelines for automated deployment and latency benchmarking on heterogeneous mobile and Unity-based VR platforms, providing real-device performance metadata. It spans multimodal tasks, image captioning, text-to-image synthesis, and language modeling, supporting cross-domain analysis of architectural transferability. By linking diverse architectures, tasks, and deployment data, LEMUR 2 provides the data foundation for LLM fine-tuning and coupling diverse architectural origins with large-scale, cross-platform empirical validation. This dataset defines a new basis for reproducible and data-driven AI design, advancing the emerging paradigm of LLM-driven AutoML and architectural generalization across modalities and hardware.

75. 【2607.06838】WildCity: A Real-World City-Scale Testbed for Rendering, Simulation, and Spatial Intelligence

链接：https://arxiv.org/abs/2607.06838

作者：Xiangyu Han,Mengyu Yang,Jiaqi Li,Bowen Chang,Ziyu Chen,Hexu Zhao,Rahul Kumar Agrawal,Anthony Rodriguez,Fiona Hua,Marco Pavone,Chen Feng,Yiming Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：mental map spanning, map spanning tens, coherent spatial mental, spatial mental map, navigate an unfamiliar

备注： ECCV 2026; Project Page: [this https URL](https://han-xiangyu.github.io/Wild-City/)

点击查看摘要

Abstract:Humans can navigate an unfamiliar city and gradually form a coherent spatial mental map spanning tens of square kilometers. Can AI build spatial representations at a comparable scale? Although recent foundation models have advanced scene reconstruction and embodied intelligence, scaling to entire cities remains an open challenge, primarily due to the lack of city-scale data. To bridge the gap, we introduce WildCity, a real-world multimodal dataset collected by autonomous fleets traversing complex urban environments. Our dataset includes 18 trajectories, each averaging 83.7 kilometers in length, and preserves the core challenges of in-the-wild perception, e.g., dynamic objects, lighting variations, and imperfect camera poses. We further establish an urban-tailored reconstruction baseline and convert the reconstructed environments into a closed-loop simulator. Beyond the dataset and baseline, we systematically analyze the key challenges on the path to simulation-ready urban digital twins: scalability, extrapolation, and uncertainty. Ultimately, WildCity aims to catalyze progress not only in city-scale rendering, but more broadly in the pursuit of AI that can perceive, remember, and reason across space at a scale comparable to human cognition. Project page: this https URL

76. 【2607.06831】Gradient-Based Speech-to-Text Alignment for Any ASR Model: From CTC to Speech LLMs

链接：https://arxiv.org/abs/2607.06831

作者：Albert Zeyer,Ralf Schlüter,Hermann Ney

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：alignment, models, model, temporal, word

备注：

点击查看摘要

77. 【2607.06829】Rail Track Extraction from Rasterized Classified Point Clouds Using a Full-Resolution, Fully Convolutional Recurrent Neural Network

链接：https://arxiv.org/abs/2607.06829

作者：Alexander Gribov,Jie Chang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：effective railway asset, railway asset management, Rail track extraction, management and maintenance, mapping workflows

备注： 15 pages, 8 figures, 1 table

点击查看摘要

Abstract:Rail track extraction is essential for effective railway asset management and maintenance, especially in automated inspection and mapping workflows. This paper introduces a novel method for extracting rail tracks from classified 3D point clouds using a fully convolutional recurrent neural network that preserves full spatial resolution and is trained exclusively on synthetically generated data. This approach enhances per-pixel quality and is particularly suited for rail track extraction. The proposed method begins by rasterizing points corresponding to railroad tracks, then applies the neural network to reduce noise and yield a cleaner track representation suitable for vectorization [1]. Subsequent morphological operations further refine the resultant data, enabling accurate track centerline extraction. Next, the extracted centerlines undergo smoothing to eliminate residual irregularities [2, 3]. Finally, the algorithm transfers 3D information from lidar points onto 2D polylines and applies additional vertical smoothing. A single centerline for both tracks is found using the Dynamic Time Warping (DTW) algorithm [4]. The final outcome consists of rail top centerlines and track centerlines derived for rail pairs, with minimal manual intervention. Experimental validation confirms the effectiveness of this method in yielding high-quality rail track extraction.

78. 【2607.06782】G-PROBE: Cross-FOV Place Recognition and Certainty-Coupled Localization for 3D Point Clouds

链接：https://arxiv.org/abs/2607.06782

作者：Jinseop Lee

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：recognition methods assume, clouds remains challenging, global localization framework, Global localization, learning-free global localization

备注： 18 pages, 9 figures

点击查看摘要

Abstract:Global localization from 3D point clouds remains challenging under limited or asymmetric fields of view (FOV), which fail to provide the dense, symmetric coverage that place recognition methods assume. We present G-PROBE, a learning-free global localization framework that removes this assumption. A virtual sensor decomposition runs the same pipeline, by design, on configurations ranging from a narrow-FOV sensor to a panoramic or multi-sensor rig. The front-end enumerates cross-FOV branch ensembles that encode heading hypotheses for heading-invariant place recognition. A score-scale-invariant, tuning-free gamma-SGRT suppresses heading aliasing under partial FOV and provably becomes inert at symmetric 360 degrees. The back-end, CG-GICP, refines a coarse full-cloud GICP with a pass restricted to high-certainty co-observed points selected by a bird's-eye-view certainty map (a by-product of front-end scoring). This certainty coupling links descriptor evaluation to 6-DoF metric pose estimation without an external verification module. Evaluated on five LiDAR datasets and three modalities (mechanical, solid-state, FMCW), G-PROBE attains the highest learning-free multi-session F1 on average and is competitive in panoramic single-session settings. Where hand-crafted and zero-shot supervised baselines collapse under wide-to-narrow cross-sensor pairing, it remains usable end-to-end (up to 55.0% vs. no more than 6.8% success), and under FOV asymmetry (360 to 60 degrees) it retains about 54% Recall@1, about 18x the strongest learning-free baseline.

79. 【2607.06779】URS-Stereo: Uncertainty-Guided Residual Search for Real-Time Stereo Matching

链接：https://arxiv.org/abs/2607.06779

作者：Pouya Sohrabipour,Chaitanya kumar reddy Pallerla,Dongyi Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：embedded vision applications, stereo matching, autonomous systems, crucial for robotics, vision applications

备注：

点击查看摘要

Abstract:Real-time stereo matching is crucial for robotics, autonomous systems, and embedded vision applications, where both computational efficiency and disparity accuracy are required. Recent coarse-to-fine stereo matching methods improve efficiency by progressively refining disparity estimates using local cost volumes at higher resolutions. However, these methods rely heavily on the accuracy of propagated disparity estimates from previous stages. When the propagated disparity is inaccurate, the ground-truth correspondence may fall outside the predefined local search range, leading to unrecoverable matching failures during subsequent refinement. In this paper, we propose URS-Stereo, a real-time coarse-to-fine stereo matching framework that addresses this limitation through uncertainty-guided search adaptation. Specifically, we introduce an Uncertainty-Guided Residual Search Module (UGRSM), which predicts the reliability of propagated disparities together with residual search offsets to adaptively relocate the centers of local cost volumes before disparity refinement. By dynamically adjusting the search region according to the confidence of the propagated disparity, the proposed method significantly improves the robustness of local correspondence estimation while preserving the computational efficiency of coarse-to-fine stereo matching. Extensive experiments on SceneFlow, KITTI 2012, KITTI 2015, Middlebury, and ETH3D demonstrate that URS-Stereo consistently improves disparity estimation while maintaining real-time inference speed, validating the effectiveness of the proposed uncertainty-guided search strategy

80. 【2607.06739】Hardware-aware Graph Neural Networks prunning for embedded event-based vision

链接：https://arxiv.org/abs/2607.06739

作者：Piotr Wzorek,Kamil Jeziorek,Tomasz Kryjak

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Event-based cameras, mobile robotics, dynamic environments, cameras are gaining, gaining popularity

备注：

点击查看摘要

Abstract:Event-based cameras are gaining popularity as the sensor of choice for mobile robotics, due to their high performance in dynamic environments. However, these applications require efficient real-time data processing with low latency and power consumption. One strategy to meet these stringent requirements is hardware acceleration of efficient algorithms that preserve the temporal sparsity of event data. In this work, we propose an optimization strategy for Graph Convolutional Neural Networks models aimed at adapting their architecture to the limited resources of embedded heterogeneous FPGA platforms. Our method incorporates hardware-aware pruning and quantization, taking into account the trade-off between on-chip memory savings and inference accuracy. Strategic exploration of the design space with Fine Grid Search and Greedy layer-wise Iterative Deepening Search methods enables flexible adaptation of the model architecture to the target platform. Our approach was evaluated across various network configurations and multiple datasets, resulting in BRAM memory reductions of 28.8% for CIFAR-10 (with a 1.65% decrease in accuracy), 31.4% for MNIST-DVS (accuracy drop of 3.55%), and 26.5% for N-Caltech101 (with a 5.18% accuracy reduction).

81. 【2607.06726】A Good Initialization is All You Need for Faithful Visual Attribution

链接：https://arxiv.org/abs/2607.06726

作者：Zihan Gu,Jiayu Wang,Hua Zhang,Yue Hu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：image regions support, model prediction, visual attribution identifies, identifies which image, support a model

备注：

点击查看摘要

Abstract:Faithful visual attribution identifies which image regions support a model prediction. Search-based perturbation methods lead the insertion--deletion faithfulness frontier by masking regions and measuring score changes, but they usually output a complete ordering of all regions. Many applications, especially MLLM attribution and repair, only need a compact top-$k$ evidence mask. We study this mask-first attribution problem. An exactly $k$-region mask is combinatorial: useful evidence can depend on interactions among fine regions. Coarse grouping can stabilize early search but aggregates redundant content, whereas one-step scoring can miss high-value combinations. We introduce two forward-only methods. \textsc{CoPAIR} uses a PhaseWin--Greedy gap diagnosis to construct coarse singleton/pair candidates that warm-start full-ordering search. \textsc{TRACE} directly searches fixed-cardinality fine-region masks with cross-entropy sampling, elite retention, and distribution updates, with a finite-budget recovery analysis. The resulting evidence set can be returned as a compact attribution mask or used to initialize Greedy or PhaseWin when a complete ranking is required. Across ImageNet classification with CLIP ViT-L/14, CLIP RN101, and ResNet-101, our initialized search methods establish a new state-of-the-art frontier for faithful full-ordering attribution under inclusive forward-call accounting. On POPE and RePOPE with Qwen2.5-VL-3B-Instruct and LLaVA-v1.5-7B, \textsc{TRACE}+Greedy gives the strongest search-based MLLM attribution results. Direct \textsc{TRACE} masks further achieve single-point RePOPE repair rates of $94.44\%$ and $96.00\%$, showing that compact evidence masks can be actionable attribution outputs, not merely prefixes of full rankings.

82. 【2607.06701】SPEAR: A Simulator for Photorealistic Embodied AI Research

链接：https://arxiv.org/abs/2607.06701

作者：Mike Roberts,Renhan Wang,Rushikesh Zawar,Rachith Dey-Prakash,Quentin Leboutet,Stephan R. Richter,Matthias Müller,German Ros,Rui Tang,Stefan Leutenegger,Yannick Hold-Geoffroy,Kalyan Sunkavalli,Vladlen Koltun

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG); Robotics (cs.RO)

关键词：generating synthetic visual, synthetic visual data, training embodied agents, limited generality, powerful tools

备注： Accepted for publication at the European Conference on Computer Vision (ECCV) 2026

点击查看摘要

Abstract:Interactive simulators have become powerful tools for training embodied agents and generating synthetic visual data, but existing photorealistic simulators suffer from limited generality, programmability, and rendering speed. We address these limitations by introducing SPEAR: A Simulator for Photorealistic Embodied AI Research. At its core, SPEAR is a Python library that can connect to, and programmatically control, any Unreal Engine (UE) application via a modular plugin architecture. SPEAR exposes over 14K unique UE functions to Python, representing an order-of-magnitude increase in programmable functionality over existing UE-based simulators. Additionally, a single SPEAR instance can render 1920x1080 photorealistic beauty images directly into a user's NumPy array at 73 frames per second - an order of magnitude faster than existing UE plugins - while also providing ground truth image modalities that are not available in any existing UE-based simulator (e.g., a non-diffuse intrinsic image decomposition, material IDs, and physically based shading parameters). Finally, SPEAR introduces an expressive high-level programming model that enables users to specify complex graphs of UE work with arbitrary data dependencies among work items, and to execute these graphs deterministically within a single UE frame. We demonstrate the utility of SPEAR through a diverse collection of example applications: controlling multiple embodied agents with distinct action spaces (e.g., humans, cars, and robots) across several in-the-wild UE projects; rendering photorealistic city-scale environments; manipulating UE's procedural content generation systems; rendering synchronized multi-view images of detailed human faces; coordinating an interactive co-simulation with the MuJoCo physics simulator; and editing scenes with natural language via an AI coding assistant.

83. 【2607.06691】CoMind: Understanding Collaborative Human Activity from Multiple Minds and Views

链接：https://arxiv.org/abs/2607.06691

作者：Alexey Gavryushin,Dingxi Zhang,Zhao Huang,Alexandros Delitzas,Jiaqi Chen,Ben Ellis,Cedric Zöllner,Manthan Patel,Manuel Kaufmann,Marc Pollefeys,Xi Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Human-human collaboration, everyday life, essential to success, professional teamwork, fundamental aspect

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:Human-human collaboration is a fundamental aspect of everyday life, essential to success in a wide range of goal-directed activities from household tasks to professional teamwork. While much research has focused on modeling coordination and task execution, the cognitive processes that support such collaboration, particularly Theory of Mind (the ability to infer the mental states of others), remain difficult to study in natural settings. To address this gap, we introduce a novel egocentric and exocentric video dataset capturing real-world collaboration in cooking scenarios. The dataset integrates multi-perspective video, high-quality audio, gaze tracking, and 3D scene and object scans, with annotations for shared attention to objects, social cues and interactions between agents, as well as agent-object interactions. We establish benchmarks for Joint Attention Estimation, Socially Conditioned Object Interaction Anticipation, and Collaborative Handover Prediction, enabling research on multimodal perception, proactive assistance, and collaborative planning. By providing temporally aligned, richly annotated multimodal data, CoMind facilitates the development and evaluation of AI systems capable of modeling complex social interactions and reasoning about human behaviors in collaborative environments. Our dataset and benchmarks are made available at this https URL.

84. 【2607.06633】ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities

链接：https://arxiv.org/abs/2607.06633

作者：Aavash Chhetri,Bibek Niroula,Eduard Vazquez,Yash Raj Shrestha,Prashnna Gyawali,Loris Bazzani,Binod Bhattarai

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：multimodal federated learning, multimodal federated, federated learning, Abstract, modality

备注：

点击查看摘要

Abstract:In this paper, we address the problem of multimodal federated learning with missing modality. Existing methods utilize an additional public dataset or perform naive feature synthesis that is based solely on the available modality. To address these limitations, we propose ProMoE-FL, a Prototype-conditioned Mixture-of-Experts framework for robust missing-modality feature synthesis in multimodal federated learning. ProMoE-FL builds a global client-aware prototype bank that captures clinically meaningful modality priors across institutions. Our Mixture of Experts is conditioned on these prototypes and modality indices to enable direction-aware expert routing for dynamically synthesizing missing features. We perform extensive quantitative and qualitative evaluations on four public chest X-ray datasets (MIMIC-CXR, NIH Open-I, PadChest, and CheXpert) and demonstrate that ProMoE-FL consistently outperforms state-of-the-art methods in both homogeneous as well as the more challenging heterogeneous settings.

85. 【2607.06631】Dynamic-in-Few-Step: Unifying Dynamic Computation and Few-Step Distillation for Efficient Video Generation

链接：https://arxiv.org/abs/2607.06631

作者：Yu Cheng,Siyue Yao,Zhongang Qi,Shanyan Guan,Wei Li,Fajie Yuan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Video Diffusion Models, prohibitive computational costs, demonstrated superior generation, Video Diffusion, demonstrated superior

备注：

点击查看摘要

Abstract:Video Diffusion Models (VDMs) have demonstrated superior generation quality but suffer from prohibitive computational costs. While recent few-step distillation techniques significantly accelerate inference, they typically enforce a static model architecture across all denoising stages, ignoring the varying computational demands inherent to different noise levels. In this work, we propose a novel post-training acceleration framework that exploits this redundancy by integrating dynamic structural sparsification directly into the distillation process. Unlike conventional post-hoc compression applied to a fixed diffusion pipeline, our approach jointly optimizes the denoising steps and structured model sparsity, transforming a pre-trained VDM into a compact, step-specific Mixture-of-Models (MoM). To address the training instability arising from this joint optimization, we introduce a Progressive Training Strategy coupled with an Output Rollout Mechanism, which ensures the coherent learning of structural decisions across timesteps. Furthermore, we develop a specialized inference engine to deploy the resulting MoM efficiently. Our method is orthogonal to existing acceleration techniques and highly effective: On Wan-14B, it removes 24% of the per-step FLOPs on top of 4-step distillation, adding a 1.2x wall-clock gain and reaching a 30x speedup over the 50-step teacher while preserving competitive generation quality.

86. 【2607.06620】SpaR3D-MoE: Adaptive 3D Spatial Reasoning from Sparse Views Meets Geometry-Inductive Mixture-of-Experts

链接：https://arxiv.org/abs/2607.06620

作者：Haida Feng,Hao Wei,Haolin Wang,Shiwei Li,Chade Li,Yihong Wu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Large Language Models, Recent Multimodal Large, Multimodal Large Language, Large Language, Language Models

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:Recent Multimodal Large Language Models (MLLMs) struggle to bridge the representational gap between 2D semantic understanding and 3D spatial geometry. Existing 3D-aware models either rely on costly 3D-specific data or utilize RGB-only inputs with heuristic sampling and monolithic, shallow fusion, which respectively disrupt essential spatiotemporal connectivity and induce modality contention across diverse spatial tasks. To overcome these bottlenecks, we introduce SpaR3D-MoE, an end-to-end framework that enables adaptive spatial reasoning by equipping MLLMs with geometry-aware capabilities from only sparse RGB inputs. First, we propose an adaptive spatiotemporal manifold sampling mechanism that constructs a geometry-aware spatiotemporal graph to extract informative keyframes, effectively mitigating sequence redundancy while preserving the scene's topological connectivity. Second, we introduce the heterogeneous geometry-inductive Mixture-of-Experts driven by an instruction-pose aware router, which adaptively routes multimodal tokens to specialized experts, resolving the cross-modal contention inherent in monolithic fusion. Extensive experiments on VSI-Bench, ScanQA, and SQA3D demonstrate that our method achieves state-of-the-art performance. Notably, SpaR3D-MoE achieves the highest average score of 63.5 on VSI-Bench, outperforming the strongest baseline by 7.8 absolute points, alongside relative improvements of 35.4% and 51.4% in Route Plan and Relative Direction tasks, respectively.

87. 【2607.06618】Overview of the NLPCC 2026 Shared Task 1: Difficulty-Aware Multilingual and Multimodal Medical Instructional Video Understanding Evaluation

链接：https://arxiv.org/abs/2607.06618

作者：Shenxi Liu,Kan Li,Mingyang Zhao,Yuhang Tian,Bin Li

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Video Question Answering, Temporal Answer Grounding, Instructional Video Question, Medical Instructional Video, Difficulty-Aware Temporal Answer

备注： 21 pages, 1 figure, 5 tables

点击查看摘要

Abstract:Following the CMIVQA, MMI-VQA, and M4IVQA challenges in NLPCC 2023--2025, we introduce the Difficulty-Aware Medical Instructional Video Question Answering (DA-MIVQA) shared task for NLPCC 2026. DA-MIVQA extends previous multilingual and multimodal medical video benchmarks by explicitly distinguishing questions according to the type and complexity of evidence required for answering. Specifically, simple questions can often be answered from subtitle-based textual cues, whereas complex questions require visual grounding, procedural understanding, and cross-modal evidence integration. The challenge contains three tracks: Difficulty-Aware Temporal Answer Grounding in Single Video (DA-TAGSV), Difficulty-Aware Video Corpus Retrieval (DA-VCR), and Difficulty-Aware Temporal Answer Grounding in Video Corpus (DA-TAGVC). The dataset is collected from public medical instructional channels, covers diverse scenarios such as first aid, emergency response, rehabilitation, nursing, and general medical education, and is manually verified with difficulty annotations. This paper presents the task motivation, dataset construction, evaluation protocol, participation overview, competition results, and representative systems of DA-MIVQA. DA-MIVQA provides a practical benchmark for evaluating medical instructional video question answering systems under varying textual, visual, temporal, and procedural reasoning requirements.

88. 【2607.06616】WHERE to Generate Matters: Budget-Aware Synthetic Augmentation for Label Skewed Federated Learning

链接：https://arxiv.org/abs/2607.06616

作者：Sangwoo Lee,Sunghwan Park,Jaewoo Lee

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：degrades global accuracy, federated learning, skew in federated, drift and degrades, degrades global

备注： preprint

点击查看摘要

Abstract:Label skew in federated learning (FL) causes client drift and degrades global accuracy. Synthetic data augmentation can reduce this imbalance; however, full class balancing requires substantial computation cost. We propose FedEAS, a policy that assigns each client an entropy-adaptive per-class generation budget computed from its local label distribution. The budget jointly decides \emph{how much} each client generates and \emph{WHERE} the samples go. Accordingly, the total generation budget follows from the per-client budgets rather than being fixed in advance. FedEAS recovers most of the accuracy gain of full class balancing while reducing the generation budget by 94.1\%. At the same total generation budget, it outperforms Uniform allocation by up to 18.82\% across CIFAR-10 and CIFAR-100.

89. 【2607.06603】Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study

链接：https://arxiv.org/abs/2607.06603

作者：Sangwon Jung,Sumin Yu,Sanghyuk Chun,Taesup Moon

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：algorithmic fairness, group fairness, counterfactual fairness, fairness, notion of algorithmic

备注： NeurIPS 2024 Track Datasets and Benchmarks

点击查看摘要

Abstract:The notion of algorithmic fairness has been actively explored from various aspects of fairness, such as counterfactual fairness (CF) and group fairness (GF). However, the exact relationship between CF and GF remains to be unclear, especially in image classification tasks; the reason is because we often cannot collect counterfactual samples regarding a sensitive attribute, essential for evaluating CF, from the existing images (\eg, a photo of the same person but with different secondary sex characteristics). In this paper, we construct new image datasets for evaluating CF by using a high-quality image editing method and carefully labeling with human annotators. Our datasets, \oursceleb and \ourslfw, build upon the popular image GF benchmarks; hence, we can evaluate CF and GF simultaneously. We empirically observe that CF does not imply GF in image classification, whereas previous studies on tabular datasets observed the opposite. We theoretically show that it could be due to the existence of a latent attribute $G$ that is correlated with, but not caused by, the sensitive attribute (\eg, secondary sex characteristics are highly correlated with hair length). From this observation, we propose a simple baseline, Counterfactual Knowledge Distillation (CKD), to mitigate such correlation with the sensitive attributes. Extensive experimental results on \oursceleb and \ourslfw demonstrate that CF-achieving models satisfy GF if we successfully reduce the reliance on $G$ (\eg, using CKD).

90. 【2607.06600】MiLSD: A Micro Line-Segment Detector for Resource-Constrained Devices

链接：https://arxiv.org/abs/2607.06600

作者：Parsa Hassani Shariat Panahi,Amir Hossein Jalilvand,M. Hassan Najafi

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)

关键词：Line segment detection, key building block, Line segment, visual SLAM, industrial inspection

备注： 10 pages, 12 figures, 5 tables

点击查看摘要

Abstract:Line segment detection is a key building block in visual SLAM, 3D reconstruction, and industrial inspection. Recent deep learning methods have greatly improved accuracy, yet even the smallest models require several megabytes of memory, exceeding low-cost MCU capacity. This work investigates the maximum achievable accuracy under a sub-megabyte budget. We propose MiLSD, a detector tailored for MCU-level constraints, and systematically compare three output representations within a compact fully-convolutional backbone. Our study shows that the proposed F-Clip center-with-length-and-angle formulation learns most effectively at small model sizes. We find that 8-bit quantization preserves full-precision performance, while 4-bit quantization causes significant degradation, particularly in angle regression, with quantization-aware training recovering only part of the loss. With a one-megabyte activation budget and inference enhancements including sub-pixel decoding, test-time augmentation, and a lightweight verifier, MiLSD improves sAP10 on ShanghaiTech Wireframe from 10.6 (25k parameters, 0.25 MB) to 24.1 within 1 MB. Rather than competing with GPU-scale parsers, we map the accuracy memory trade-off across representations, bit-widths, capacities, and post-processing strategies for embedded vision systems.

91. 【2607.06592】LipSSD: Lipschitz-Constrained Single-Shot Detection for Adversarially Robust Object Detection

链接：https://arxiv.org/abs/2607.06592

作者：Vincent Lébé,Yannick Prudent,Corentin Friedrich,Thomas Massena(IRIT, DTIPG - SNCF, UT3),Ronan Sicre(IRIT),Franck Mamalet

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：real-world scenarios, sensitive to worst-case, limits their applicability, applicability in real-world, adversarial

备注：

点击查看摘要

Abstract:Object detectors have many applications in safety-critical systems, but they are known to be sensitive to worst-case perturbations such as adversarial attacks, which limits their applicability in real-world scenarios. Compared with classification, adversarial robustness for object detection has received less attention, and existing methods are often tied to adversarial training, whose performance may not transfer across attacks, perturbation budgets, or architectures. In this work, we introduce Lipschitz-constrained variants of object detection architectures as robust-by-design alternatives to standard detectors. We validate this approach with LipSSD, a Lipschitz-constrained Single Shot MultiBox Detector (SSD), and provide a comprehensive study of its adversarial robustness using multiple white-box adversarial attacks and datasets. We first analyze the accuracyrobustness trade-off induced by Lipschitz constraints and show that it can be controlled through a single training hyperparameter. We then demonstrate that Lipschitzconstrained detectors are complementary to adversarial training: under the same training setup on the Pascal VOC dataset, adversarially trained LipSSD improves mAP@50 on unseen attacks by up to 15 points over classical adversarially trained SSD. Finally, we use more specific safety-critical datasets such as LARD and KITTI, and show that Lipschitz-constrained detectors can improve robustness while largely preserving clean performance. These results suggest that architectural Lipschitz control is a practical and attack-agnostic direction for improving the robustness of object detectors.

92. 【2607.06590】AI for Cultural Heritage Textiles: Fine-Tuned Latent Diffusion for Novel Ulos Motif Synthesis

链接：https://arxiv.org/abs/2607.06590

作者：Humasak Tommy Argo Simanjuntak,Jesika Purba,Sitogab Girsang,Widya Manurung,Samuel Situmeang,Arlinta Barus,Daniel Oranova Siahaan

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Batak ethnic group, North Sumatra, contemporary design demands, meet contemporary design, revitalising traditional textiles

备注： 21 pages, 8 figures, 3 tables. The manuscript is currently under review at the 2026 4th International Conference on Data, Information and Computing Science ( [this https URL](https://www.cdics.org/) )

点击查看摘要

Abstract:Preserving and revitalising traditional textiles such as Ulos, a cultural heritage of the Batak ethnic group in North Sumatra, Indonesia, requires balancing fidelity to tradition with innovative approaches that meet contemporary design demands. Traditional Ulos weaving faces two key limitations: a narrow range of motifs and a time-intensive design process. This study presents a generative AI framework that fine-tunes two pretrained latent diffusion models: Protogen v3.4 and Stable Diffusion v1.4, on a curated, annotated dataset of high-resolution Ulos motifs to generate culturally consistent yet novel designs. Model performance is evaluated quantitatively using Frechet Inception Distance (FID), Inception Score (IS), and qualitatively through assessments by traditional weavers and members of the public. Protogen v3.4 consistently outperforms Stable Diffusion v1.4, achieving substantially lower FID (~10.5x) and higher IS (2.0x), indicating superior visual fidelity, diversity, and closer alignment with the real Ulos motif distribution. We further examine the effects of strength and guidance scale on generation quality across both models. Lower strength values consistently yield higher fidelity (lower FID), while higher strength values increase generative diversity at the cost of realism, revealing a clear fidelity-diversity tradeoff for both models. Across all tested configurations, a guidance scale of 5-9 provides the most effective balance between fidelity and diversity, stabilising FID, KID, and IS, and is recommended as the operating range for high-quality, diverse Ulos motif generation. These findings demonstrate that carefully fine-tuned generative AI can support the creative renewal of intangible cultural heritage while preserving its stylistic and symbolic integrity.

93. 【2607.06587】CoFINN: Conservation Flux Informed Neural Networks for Physics Problems Governed by Conservation Laws

链接：https://arxiv.org/abs/2607.06587

作者：Adnan Harun Doğan,Mert Deniz,Hande Alemdar,Özgür Uğraş Baran

类目：Computer Vision and Pattern Recognition (cs.CV); Fluid Dynamics (physics.flu-dyn)

关键词：Informed Neural Networks, Flux Informed Neural, Conservation Flux Informed, Neural Networks, convolutional neural networks

备注： 28 pages, 7 figures

点击查看摘要

Abstract:We present CoFINN (Conservation Flux Informed Neural Networks), a physics-informed deep learning framework for predicting compressible flow fields governed by conservation laws. Unlike conventional data-driven convolutional neural networks (CNNs), which optimize only pixel-wise similarity metrics, CoFINN embeds finite-volume conservation physics directly into the training process. Unlike classical physics-informed methods which enforce differential-equation residuals at collocation points through automatic differentiation, CoFINN adopts a finite-volume perspective consistent with modern CFD methodology. CoFINN interprets CNN output fields as structured computational grids, where each pixel represents a finite-volume cell, and enforces conservation consistency through sophisticated numerical flux calculations. The framework is evaluated on transonic flow prediction around airfoils at (M=0.7, Re=6 * 10^6), including challenging conditions involving shock waves and high angles of attack. Results show that CoFINN improves aerodynamic force prediction accuracy, reducing drag prediction error by up to 34% at extreme angles of attack and by approximately 15% on average across the test set. Improvements are particularly significant in limited-data regimes, demonstrating that the conservation-based loss acts as an effective physical regularizer. The proposed approach maintains the computational efficiency advantages of CNN surrogates while significantly improving physical consistency and conservation behavior. The framework is architecture-agnostic and extensible to broader classes of conservation-law-governed physical systems.

94. 【2607.06585】Pixel-Precise Explainable Stress Indexing: A Semantic Segmentation Framework for Disease Severity Quantification in Field Crops

链接：https://arxiv.org/abs/2607.06585

作者：Raunak Kumar,Soumyashree Kar

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：damages exceeding USD, agricultural yield annually, global agricultural yield, economic damages exceeding, exceeding USD

备注： 26 pages, 15 figures, 5 tables

点击查看摘要

Abstract:Plant diseases, resulting from both biotic and abiotic stresses, cause an estimated 20-40% loss in global agricultural yield annually, resulting in economic damages exceeding USD 220 billion. Accurate and scalable stress quantification is essential for precision agriculture, yet traditional manual assessments are labour-intensive and subjective. This paper proposes a unified deep learning pipeline integrating semantic segmentation, regression-based severity estimation, and disease classification. Stress severity is categorised into four levels (Low to Very High) based on the proportion of infected leaf area. Experiments on the Apple Tree Leaf Disease Segmentation dataset (1,641 samples, six classes) evaluate four models: U-Net (MobileNetV2), SegFormer, FCN, and PSPNet. U-Net with MobileNetV2 achieves the best performance with 98.20% pixel accuracy, 0.70 mIoU, and 99.41% detection accuracy at 14.7 ms per image, making it suitable for real-time use. SegFormer performs competitively (mIoU 0.66), while FCN and PSPNet show lower spatial accuracy (approximately 0.49 mIoU). The computed severity index strongly correlates with expert annotations (r = 0.968, R^2 = 0.937), demonstrating the system's reliability for automated crop monitoring and decision support.

95. 【2607.07177】owards Accurate and Fast Clinical Body Composition: A Resource-Efficient Hierarchical Segmentation Framework for Multi-Source CT

链接：https://arxiv.org/abs/2607.07177

作者：Xiaodi Shen,Qingzhu Zheng,Yaoyang Qiu,Cien Fan,Ruonan Zhang,Yangdi Wang,Luyao Wu,Weikai Zheng,Longfei Zhao,Bing Li,Rulin Xu,Qiqi Xu,Ren Mao,Shiting Feng,Xuehua Li

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：multi-source data heterogeneity, hinder clinical deployment, demands hinder clinical, memory demands hinder, segmentation of muscles

备注： Affiliations: (1) Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou 510080, China. (2) Research Development Center, Canon Medical Systems (China) Co. Ltd. Beijing 100015, China

点击查看摘要

Abstract:Background: Automated 3D segmentation of muscles and adipose tissue from CT is vital for body composition analysis, but multi-source data heterogeneity and high CPU memory demands hinder clinical deployment. Methods: We propose a coarse-to-fine hierarchical framework to segment ten tissue structures. Efficiency is optimized using Dynamic Spacing and Anisotropic Patching, a Group Inference mechanism for low-memory sliding-window processing, and Topology-Aware Asymmetric Resampling for fast post-processing. Results: The framework was trained on 1,558 CT volumes from seven public and two private datasets, and evaluated on an independent test cohort (N=105), per-structure Dice coefficients ranged from 0.924 to 0.982. Eight major structures met the +-10% relative error clinical acceptance limit. On a 12-core CPU workstation, the GPU-free pipeline averaged 44.5 seconds per volume with 4.73 GB peak memory. Conclusion: This framework balances accuracy and efficiency, enabling robust, large-scale body composition analysis on standard CPU workstations.

Comments:
Affiliations: (1) Department of Radiology, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou 510080, China. (2) Research Development Center, Canon Medical Systems (China) Co. Ltd. Beijing 100015, China

Subjects:

Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.07177 [eess.IV]

(or
arXiv:2607.07177v1 [eess.IV] for this version)

https://doi.org/10.48550/arXiv.2607.07177

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Qiqi Xu [view email] [v1]
Wed, 8 Jul 2026 09:11:41 UTC (1,443 KB)

96. 【2607.07039】From Data Completeness to Data Sufficiency: A Task-Driven Imaging Framework for Intraoperative CBCT under Quality-Time-Dose Trade-offs

链接：https://arxiv.org/abs/2607.07039

作者：Yi Jia,Rongjun Ge,Yang Chen,Yan Xi,Wenjun Xia

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)

关键词：Mobile C-arm cone-beam, Mobile C-arm, C-arm cone-beam computed, cone-beam computed tomography, computed tomography

备注：

点击查看摘要

Abstract:Mobile C-arm cone-beam computed tomography (CBCT) has been widely used for real-time intraoperative 3D imaging. However, current practice often mechanically applies the fan-beam CT criterion of "180° plus fan angle" in pursuit of "data completeness" in reconstruction. This review argues that, under the single circular trajectory of three-dimensional cone-beam geometry, complete data are mathematically unattainable; moreover, blindly increasing sampling may exacerbate the trade-off among intraoperative image quality (Q), imaging time (T), and radiation dose (D). Against this background, this review reframes the evaluation of intraoperative CBCT around "data sufficiency" rather than "data completeness." This perspective moves beyond the excessive pursuit of absolute mathematical and analytic accuracy, and instead emphasizes task-specific minimum image-quality thresholds required for clinical decision-making. By synthesizing evidence from multiple clinical scenarios, this review suggests that approximation errors can be acceptable when clinical decision-making requirements are satisfied, thereby achieving a Q-T-D balance.

97. 【2607.06615】Format-Controlled Multi-Scale JPEG Compression Response Analysis for Image-Level Forgery Screening

链接：https://arxiv.org/abs/2607.06615

作者：Sujith K Mandala

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：deep-learning localization approaches, digital forensics, Error Level Analysis, handcrafted screening methods, critical task

备注： This work has been submitted to the IEEE for possible publication

点击查看摘要

Abstract:Image forgery detection is a critical task in digital forensics, yet many deep-learning localization approaches are typically GPU-accelerated and computationally heavier than handcrafted screening methods. We propose a lightweight, interpretable feature engineering pipeline for image-level forgery screening using only CPU computation and gradient boosted trees. Our method introduces \emph{multi-scale Error Level Analysis} (ELA) computed at seven JPEG quality levels, combined with novel \emph{cross-quality ELA ratio} features that capture double-compression artifacts characteristic of spliced regions, augmented by spatial entropy, FFT energy bands, edge density, SRM residuals, and DCT blockiness, yielding a 405-dimensional feature vector. CASIA v2.0 contains a format confound (60\% of tampered images are TIFF while authentic images are JPEG/BMP and contain no TIFF samples), enabling a trivial \texttt{is\_tiff} classifier to reach 0.80 AUC. We address this through rigorous format-controlled evaluation: on the JPEG-only subset (9,501 images, eliminating the TIFF/JPEG container confound), our method achieves AUC~=~0.990 [95\% CI: 0.988--0.991] and F1~=~0.905 using 5-fold stratified cross-validation. Under a conservative source-aware group split (preventing related images from appearing in both train and test), AUC remains 0.976. An ablation study reveals that multi-scale ELA provides the dominant gain (+0.180 AUC over single-quality on the format-controlled subset), while cross-quality ratios provide complementary double-compression detection. These results support that the method detects compression-history inconsistencies rather than file-format shortcuts -- while offering feature-level interpretability, CPU-only deployment, and sub-second inference.

98. 【2607.06598】Non-contact, Real-time, Heart-rate Measurement using Image Processing with Commodity Cameras and AI Agents

链接：https://arxiv.org/abs/2607.06598

作者：Kelly Li,Fulu Li

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Heart rate measurement, Heart rate, rate measurement, Traditional heart rate, rate measurement devices

备注： 6 pages, 5 figures

点击查看摘要

Abstract:Heart rate measurement is one of the key requirements for real-time health monitoring, in particular for health caring of elderly people. Traditional heart rate measurement relies on contact sensing mechanisms such as some heart rate measurement devices at medical hospitals or some wearable devices with embedded sensors such as Apple Watch, etc. In this paper, we develop a system for non-contact, real-time, heart rate measurement using image processing with commodity cameras such as an embedded camera on a laptop, where we use an innovative algorithm to capture the relevant signals for the computation of heart rate in a time series in real life environments. The presented heart rate computation (HRC) process is composed with four major steps: (a) identify frames per second of the camera in use, i.e., 30 frames per second for a given camera, (b) face detection (FD) with shape predictor of 68 face landmarks using deep learning (DL) method, (c) time sliding window (TSW) algorithm to de-noise the signal by smoothing out the noise, and (d) compute heart rate based on identified signal periodicity. We test and analyze the developed prototypes against heart rate results by Apple Watch and check the difference range in multiple rounds and compute the mean of the difference for the measurement values of the heart rate of the same person at the same time. We will do further tuning and optimization of the present methods and deploy the system as a personal AI agent [6] for health monitoring as our future directions.

99. 【2607.06597】Reconfigurable Radiology Labels Without Relabeling

链接：https://arxiv.org/abs/2607.06597

作者：Jean-Benoit Delbrouck,Dave Van Veen,Akash Pattnaik,Kalina Slavkova,Javid Abderezaei,Harris Bergman,Khan Siddiqui

类目：Image and Video Processing (eess.IV); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Public chest-radiograph, datasets are typically, released with small, typically released, fixed label schemas

备注：

点击查看摘要