本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新522篇论文，其中：

自然语言处理69篇
信息检索15篇
计算机视觉98篇

自然语言处理

1. 【2607.29678】okTier: Exact Stateful Tokenization for Agentic LLM Serving

链接：https://arxiv.org/abs/2607.29678

作者：Zhenyu Zhang,Zhichao Cao

类目：Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

关键词：LLM serving systems, serving systems cache, systems cache prompt, LLM serving, prompt KV state

备注： 24 pages, 18 figures, 8 tables

点击查看摘要

Abstract:LLM serving systems cache prompt KV state, yet most front ends still re-tokenize the full request text on every call. The cost lands on coding agents, which resubmit a long transcript after each small tool result, and reuse is hard because even a short append can change token boundaries near the end of the previous sequence. Across 153,951 calls from two agent ecosystems, the median call appends about 1.4K characters, and only 1.0-3.6% of calls start or rebuild a session with contexts of millions of characters. At a 94.1% fleet prompt-cache hit rate, tokenization reaches up to 64% of time to first token. TokTier is a stateful tokenization service with one contract: emitted token IDs are always identical to full reference tokenization of the request text. For a session continuation, it re-tokenizes a small window around the append and splices only after a per-request stable-boundary check, widening the window or falling back to full tokenization on failure. For a call without a reusable prefix, it decomposes GPT-family regex pre-tokenization into run-local rules and runs exact pre-tokenization and BPE on a GPU. A sampled shadow verifier re-checks live traffic. Across 17 tokenizer families, differential campaigns cover 1.5x10^10 split checks, a 12.4 TB real-text corpus, and 93,000+ replayed agent steps, with zero divergence. Incremental repair takes 0.5-1.1 ms from 100K to 3M characters, up to 437x faster than HF tokenization and 2.1x faster at 1M than the strongest cache-based baseline (Gigatoken) fully prewarmed. GPU full tokenization encodes a 1M-character request in 0.87 ms, up to 491x below HF and 23.4x below the fastest published CPU method. With vLLM, median time to first token drops 16-34% and P99 drops 23% under recorded bursts. Under a 50 ms P99 objective, four repair cores plus one GPU sustain 1,821 requests/s where a 16-core stateless front end saturates at 40.

Comments:
24 pages, 18 figures, 8 tables

Subjects:

Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Performance (cs.PF)

Cite as:
arXiv:2607.29678 [cs.CL]

(or
arXiv:2607.29678v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.29678

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

2. 【2607.29642】Evolving language compositionality in a frequency-structured meaning space

链接：https://arxiv.org/abs/2607.29642

作者：Fabio De Ponte,Eloise Gaines-White,Conor Houghton,Seth Bullock

类目：Computation and Language (cs.CL)

关键词：iterated learning model, investigate language evolution, model was introduced, introduced to investigate, characteristic properties

备注： 17 pages, 4 figures (plus 2 figures in appendix), submitted to Wivace 2026 ( [this https URL](https://sites.google.com/cam.ac.uk/wivace26) )

点击查看摘要

Abstract:The iterated learning model was introduced to investigate language evolution: the way in which the characteristic properties of human languages have been shaped, at least partly, by repeated transmission from one language user to another. The key finding is that language compositionality can arise spontaneously as a consequence of language being passed repeatedly through a language learning bottleneck. Here we explore how changing the frequency of different meanings, so that some meanings occur much more frequently than others, affects the character of its compositionality. We find that, as observed in natural languages, high-frequency meanings can escape the pressure to conform to the grammar that characterizes lower-frequency meanings. However, when the frequency structure is instead imposed on parts rather than on whole meaning vectors, the language fails to transmit across generations. This occurs despite the fact that the most frequent elements are reliably learned. These results suggest that frequency can shape emergent linguistic structure only when the frequency distribution is defined over form-meaning units that learners can acquire holistically. When frequency is instead distributed over smaller units, it fails to support the relational structure required for compositional generalisation, thereby preventing stable language transmission.

3. 【2607.29613】WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning

链接：https://arxiv.org/abs/2607.29613

作者：Senyu Fei,Xiaopeng Yu,Siyin Wang,Xianzhong Zhao,Jingjing Gong,Xipeng Qiu

类目：Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：shown strong promise, Reinforcement learning, promise for robotic, Reinforcement, single-frame VLM backbone

备注：

点击查看摘要

Abstract:Reinforcement learning (RL) post-training of Vision-Language-Action (VLA) models has shown strong promise for robotic manipulation. Among RL methods, critic-based approaches rely on a value estimator that predominantly operates on single-frame observations or single-frame VLM backbone latents, which is a fundamental mismatch with the partially observable nature of robot control. A naive approach to incorporate observation history into the critic incurs exponential complexity with high-dimensional visual space, and still fails because pure scalar-return regression provides insufficient supervision for learning cross-temporal dynamics. We identify the root cause as a state approximation problem: without an explicit world modeling objective, the critic's representation cannot capture the temporal structure needed for accurate value estimation. To address this, we propose the World Critic Model (WCM), built on a lightweight LeJEPA architecture; WCM jointly predicts future latent state and estimates values, such that the critic's representation is explicitly trained to capture temporal dynamics rather than merely regress scalar returns. WCM integrates seamlessly into both on-policy and off-policy training pipelines and is compatible with state-of-the-art VLA backbones including Pi0, Pi0.5, and OpenVLA-OFT. Extensive experiments on 149 tasks across four benchmarks demonstrate that WCM consistently achieves state-of-the-art performance in both in-distribution and out-of-distribution settings, with particularly strong generalization gains. We further validate WCM on seven real-world manipulation tasks using OpenVLA-OFT and Pi0.5 with off-policy RL, confirming stable deployment across diverse settings.

4. 【2607.29602】FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Models

链接：https://arxiv.org/abs/2607.29602

作者：Jeffrey M. Girard,Jason Z. Zheng,Jacqueline R. Vertino,Antony D'Avirro,Benjamin Peloquin

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：Reading a social, social situation, situation often depends, Reading, dyadic ice-breaker conversation

备注： 15 pages, 3 figures

点击查看摘要

Abstract:Reading a social situation often depends on behavior, not words alone. We introduce FriendBench, a benchmark for inferring whether two people are already familiar or are meeting as strangers, from a 20-second clip of a dyadic ice-breaker conversation. Every pair answers the same type of prompt, so only the manner of interaction can reveal the answer. Across text, audio, and video, we compare 26 models from seven companies against matched human panels over 96 balanced dyads. The best model and the human crowd are statistically indistinguishable on accuracy in every modality, but reach it differently: humans stay balanced across the two answers, while the strongest models lean toward "stranger"---a difference in effective prior, not discrimination. Richer channels help both unequally, and only humans gain from visible behavior on top of speech. We release the stimuli, human ratings, and model predictions.

5. 【2607.29591】ResKV: Reconstructing Omitted Attention Contributions for Fixed-Budget KV Cache Compression

链接：https://arxiv.org/abs/2607.29591

作者：Yuhang Zhan,Lisi Chen,Shuo Shang

类目：Computation and Language (cs.CL)

关键词：efficient long-context inference, essential for efficient, residual, long-context inference, cache

备注：

点击查看摘要

Abstract:KV cache compression is essential for efficient long-context inference. Existing eviction methods permanently discard unselected tokens and consequently remove their aggregate contribution to attention. Merging-based alternatives preserve more information but can perturb retained keys and values that should remain exact. We observe that the information omitted by cache eviction can be formulated as residual statistics in both the numerator and denominator of softmax attention. Based on this observation, we propose ResKV, which divides a fixed KV budget into an exact main cache and a compact residual cache that reconstructs the contribution of omitted tokens. ResKV lets main-cache tokens and residual entries participate in the same softmax normalization, so residual entries restore both attention numerator and denominator mass rather than acting as a post-hoc correction. A construction-time validation proxy determines residual allocation for each layer and KV head, while a decode-time dynamic gate adjusts residual contributions for individual queries. Comprehensive evaluations on LongBench and RULER, covering query-aware and query-agnostic settings, multiple backbones, cache budgets, and representative compression baselines, demonstrate broad improvements under the same retained KV budget while preserving the practical efficiency of compressed decoding, including peak memory usage and long-context decode throughput.

6. 【2607.29585】Sycophancy Undermines Epistemic Vigilance in Cooperative Vision-Language Tasks

链接：https://arxiv.org/abs/2607.29585

作者：Rupak Sarkar,Neha Srikanth,Saloni Gupta,Claire Bonial,Philip Resnik,Rachel Rudinger

类目：Computation and Language (cs.CL)

关键词：humans iteratively update, maintain common ground, epistemically vigilant detect, conversation participants share, participants share

备注： 9 pages, 3 figures, 3 tables

点击查看摘要

Abstract:To maintain common ground in cooperative conversation, humans iteratively update their beliefs as conversation participants share new information; participants who are epistemically vigilant detect when new information conflicts with prior beliefs and take steps to repair these conflicts. In order for AI systems to serve as reliable partners in complex cooperative tasks, they must similarly weigh incoming information against their own private evidence and shared context and appropriately surface inconsistencies when they arise. To measure the epistemic vigilance of vision-language models in cooperative settings, we present an information-asymmetric, dialog-based "spot-the-difference" task. Two models are privately shown one image each, and must determine through conversation whether the images are identical or, if not, identify the difference. Models routinely fail at this: they frequently overlook key evidence in their private image in favor of agreeing with their conversational partner, even when their agreement is unwarranted. We relate these violations of epistemic vigilance to the broader behavior of sycophancy, which manifests itself in cooperative goal-oriented dialog as over-accommodation and weak evidential grounding. Our results show that model steering to reduce sycophancy with a vector learned from task-agnostic sycophancy examples can reduce epistemic vigilance-related errors, making models more faithful reporters of their evidence, and in turn, more reliable partners in information-asymmetric cooperative tasks.

7. 【2607.29539】ARB: A Matched Authorship-Rewriting Benchmark Dataset for AI-Text Detector Evaluation

链接：https://arxiv.org/abs/2607.29539

作者：Gaetano Perrone,Simon Pietro Romano

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Standard AI-text detection, Standard AI-text, AI-text detection benchmarks, detection benchmarks compare, large language models

备注：

点击查看摘要

Abstract:Standard AI-text detection benchmarks compare human-written text against text generated directly by large language models (LLMs). While prior work has shown that rewriting and paraphrasing can degrade detector performance, it remains unclear whether performance measured on this conventional benchmark predicts detector behavior when human-authored content is rewritten by an LLM. To address this gap, we introduce Authorship-Rewriting Benchmark (ARB), built from 1,800 human source texts (600 each from XSum, WritingPrompts, and OpenWebText) and four open-weight generators (Llama-3.2-3B, Qwen2.5-7B, Mistral-7B, Gemma-2-9B). Each source item yields four matched variants: human-written (HUMAN), direct LLM generation (Free-LLM), LLM-rewritten human text (H2L), and same-generator LLM-rewritten LLM text (LLM2L). We evaluated five detectors (FastDetectGPT, Binoculars-falcon-7b, RADAR, BERT-Defense, RoBERTa-Defense) at a strict 1%-false-positive operating point (TPR@1%FPR). FastDetectGPT and Binoculars-falcon-7b detected 91.2% and 93.5\% of direct LLM text, but only 30.8% and 15.1% of human text an LLM had rewritten, a drop of 60-78 percentage points. The same detectors retained 78.3% and 83.0% recall when LLM text was rewritten by the same model, a much smaller decline of 10-13 points. RADAR followed the same pattern (66.8% to 12.2%), while BERT-Defense and RoBERTa-Defense stayed below 3% recall across all regimes. These results show that detector performance measured on the conventional human-vs-LLM benchmark does not transfer to human-authored text revised by an LLM, even though the same detectors remain largely robust to LLM-only rewriting.

8. 【2607.29484】Evidence-Type Competition: When Can Interventional Data Teach Language Models Causal Direction?

链接：https://arxiv.org/abs/2607.29484

作者：Xining Xun

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：models causal reasoning, teaching models causal, data is widely, widely regarded, gold standard

备注： 13 pages, 6 figures, 4 tables

点击查看摘要

Abstract:Interventional data is widely regarded as the gold standard for teaching models causal reasoning. We test this assumption in a fully controlled synthetic environment pitting observational correlation against causal effect, and find it fails instructively. In Simpson's-paradox worlds, where the two have systematically opposite signs, increasing the fraction of interventional samples in pretraining does not improve causal direction: the magnitude of the model's do()-response grows monotonically, yet its sign is copied from the observational context. What governs whether interventional evidence is used is not the training mixture but the evidence type present in the context at inference time. Under an identical training recipe, a purely observational context induces systematic sign reversal in 29/50 worlds, a mixed context in 19/50, while aligned interventional probes alone yield 41/50 correct. Erasing observational evidence from the context immediately releases the suppressed causal interpolation ability (ratio_true = +0.56); a four-state content manipulation shows the switch is content-mediated and graded. The suppression is stable across training seeds (11/11 strong reversals persist on a matched-protocol second seed) and robust as a rate at 0.93B parameters (31.8% vs. 6% reversals in the matched probe-only arm), even as absolute gains shrink four-fold. An external audit on CLadder exposes a learned positive-effect prior with a two-layer structure: sign-randomized retraining removes it in-distribution but not out-of-distribution. We summarize: the capability lives in the weights; the switch lives in the context, and activation patching localizes the switch to the middle layers' observational rows. We further quantify the sampling noise floor of probe-based causal evaluation and an evidence-averaging protocol that cuts sign errors from 26% to 9%.

9. 【2607.29433】Know It, Act on It: Investigating Memory Utilization in LLM Personalization

链接：https://arxiv.org/abs/2607.29433

作者：Zhaoxin Feng,Jianfei Ma,Emmanuele Chersoni

类目：Computation and Language (cs.CL)

关键词：personalized companions, core capability, evolve into personalized, large language model, LLMs face

备注：

点击查看摘要

Abstract:As large language model (LLM) agents evolve into personalized companions, memory has emerged as a core capability. However, LLMs face a knowledge utilization problem: they may fail to act on relevant user preferences even when they are fully present in context. When an agent fails to tailor its response in a context where previously shared user preferences should matter, it is unclear whether the model failed to remember that information or remembered it but failed to use it. To isolate this breakdown, we introduce a decoupled evaluation paradigm that administers paired Know and Act tests to the same user preference. We conduct large-scale experiments across 16 systems and five memory architectures, evaluating 1,000 preferences embedded at three levels of expression strength. Our results show a large gap between Know and Act outcomes: agents often pass the recall test for a user preference but fail to reflect that same preference in the paired behavioral scenario. While memory architectures reduce this gap, utilization remains especially weak for health and therapy-related preferences, where failures to act carry the greatest real-world stakes.

10. 【2607.29402】Bridging the Question-Answer Gap in Retrieval-Augmented Generation: Hypothetical Prompt Embeddings

链接：https://arxiv.org/abs/2607.29402

作者：Domen Vake,Jernej Vičič,Aleksandar Tošić

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：generative language models, synergize retrieval mechanisms, Hypothetical Document Embeddings, relevance of responses, systems synergize retrieval

备注： 10 pages, 8 figures, 5 tables. Published in IEEE Access

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) systems synergize retrieval mechanisms with generative language models to enhance the accuracy and relevance of responses. However, bridging the style gap between user queries and relevant information in document text remains a persistent challenge in retrieval-augmented systems, often addressed by runtime solutions (e.g., Hypothetical Document Embeddings (HyDE)) that attempt to improve alignment but introduce extra computational overhead at query time. To address these challenges, we propose Hypothetical Prompt Embeddings (HyPE), a framework that shifts the generation of hypothetical content from query time to the indexing phase. By precomputing multiple hypothetical prompts for each data chunk and embedding the chunk in place of the prompt, HyPE transforms retrieval into a question-question matching task, bypassing the need for runtime synthetic answer generation. This approach does not introduce latency but also strengthens the alignment between queries and relevant context. Our experimental results on six common datasets show that HyPE can improve retrieval context precision by up to 42 percentage points and claim recall by up to 45 percentage points, compared to standard approaches, while remaining compatible with re-ranking, multi-vector retrieval, query decomposition, and other RAG advancements

11. 【2607.29397】Studying quantization trade-offs for efficient inference deployment in machine translation

链接：https://arxiv.org/abs/2607.29397

作者：Jim Zhao,Sohir Maskey,Koen Oostermeijer,Douglas Orr,Teryn Jones

类目：Computation and Language (cs.CL); Performance (cs.PF)

关键词：Deploying large language, environments poses challenges, realistic server environments, server environments poses, provide high-quality responses

备注：

点击查看摘要

Abstract:Deploying large language models in realistic server environments poses challenges, as the system needs to provide high-quality responses with low latency. Quantization is a common approach to reduce the memory footprint and improve inference efficiency, yet its impact on latency and throughput is rarely evaluated under controlled, orchestration-level workloads. In this work we study the quantization trade-offs of two translation model families, EuroLLM \citep{martins2025eurollm} and Hy-MT2 \citep{zheng2026hy} across five models ranging from 1.7B to 22B for efficient deployment on a single A100 or H100 GPU. We demonstrate that combining a document-chunking strategy with W4A8 or W8A8 quantization improves the latency-throughput Pareto-curve under a wide range of workloads. Furthermore, since standard machine translation (MT) benchmarks rely on isolated sentences and fail to capture long-context dynamics, we introduce a document-level evaluation from WMT24++ to assess how text chunking strategies affect translation quality under quantization. Our results reveal that standard segment-level evaluation can fail to predict the interaction between quantization and long-context document translation. While Hy-MT2 remains robust under quantization, EuroLLM shows strong sensitivity and translation quality collapses rapidly for all considered quantization formats. Overall, our experiments show that the trade-off between inference efficiency and translation quality depends not only on the quantization format, but also on the choice of text chunking strategy.

12. 【2607.29378】PTP: Previous-Token Prediction based LLM Inversion for Near-Exact Prompt Reconstruction

链接：https://arxiv.org/abs/2607.29378

作者：Pirzada Suhail,Nagasai Saketh Naidu,Atanu R Sinha,Amit Sethi

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：text by auto-regressively, LLM, prompts, generate text, target LLM

备注：

点击查看摘要

Abstract:Large language models (LLMs) generate text by auto-regressively sampling the next token. This inherently leads to a many-to-many mapping between prompts and responses, complicating the task of inferring prompts from observed outputs. Prior work on LLM inversion frames prompt recovery as a semantic reconstruction task. They rely on fine-tuning pretrained sequence-to-sequence models on large external datasets--and requiring access to model weights or logits--to generate semantically plausible prompts. In contrast, we present a functional approach to inverting a given LLM in a black-box setting, without auxiliary aids. We train an explicit inverse language model entirely from scratch on data synthetically generated from the target LLM itself. Analogous to forward next-token prediction, our inverse model is trained using previous-token prediction, establishing a generative link between the forward and inverse processes that enables faithful prompt reconstruction. Moreover, it naturally supports diverse prompt reconstructions through sampling, whereby all such prompts induce similar responses under the forward, target LLM. Our approach generalises across datasets and exhibits transferability in reconstructing prompts from responses generated by different LLMs. Further, across the set of token based evaluation metrics for prompt and response reconstructions, our approach outperforms prior work.

13. 【2607.29377】Zero-Mem: Zero-Token Memory Operations for LLM Agents

链接：https://arxiv.org/abs/2607.29377

作者：Yilin Xiao,Zhehan Zhu,Yujing Zhang,Jin Chen,Zijin Hong,Luyao Zhuang,Qinggang Zhang,Shengyuan Chen,Xiaocao Ouyang,Lingfei Ren,Xiao Huang

类目：Computation and Language (cs.CL)

关键词：additional LLM calls, act consistently, consistently over long, systems use additional, LLM

备注：

点击查看摘要

Abstract:LLM agents need memory to act consistently over long interactions, yet many systems use additional LLM calls to operate that memory. Generating intermediate records and mediating their retrieval adds recurring token and time costs, while omitted or merged details can obscure the original evidence. We ask whether structured memory access requires generation at all. Zero-Mem introduces \emph{zero-token memory operations}: no step outside final question answering invokes an LLM or consumes LLM input or output tokens; encoder computation is accounted for separately. Zero-Mem preserves original interaction traces as its source of record. It organizes the traces in two complementary ways. An entity--context graph exposes connections across interactions, while a temporal hierarchy preserves conversational locality and session state. For each query, Zero-Mem weighs the two views, retrieves from both, and follows their structure to recover supporting relations or surrounding context. Deterministic calibration first discards conflicting evidence and then keeps the reader's answer grounded in the retrieved traces. Only the final-QA reader invokes an LLM. Across long-memory and long-context question-answering benchmarks, Zero-Mem achieves competitive performance while eliminating LLM calls and LLM-token consumption from memory operations. With the same final-QA reader and context budget, it reduces memory-operation time cost by 57.6\% relative to the fastest compared baseline. Ablations support the contribution of the two views and their query-dependent coordination. Overall, the results show that structured agent memory need not generate an intermediate representation of the past. After peer review, the code and implementation details will be available at \textcolor{blue}{this https URL}.

14. 【2607.29355】Cross-Lingual Transfer for Machine Translation in Turkic Languages

链接：https://arxiv.org/abs/2607.29355

作者：Omer Burak Cinar,Mehmet Mert Dalkilic,Cagri Toraman

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：remains insufficiently characterized, low-resource machine translation, families remains insufficiently, Cross-lingual transfer, language families remains

备注：

点击查看摘要

Abstract:Cross-lingual transfer is central to low-resource machine translation, but its behavior within closely related language families remains insufficiently characterized. We study transfer among five Turkic languages; Turkish, Azerbaijani, Uzbek, Kazakh, and Kyrgyz; using pairwise transfer matrices. In this setting, each model is fine-tuned with one transfer source and evaluated on a different transfer target while the translation target remains the same. Across mT5 experiments, we find that transfer is strongest between closely related Turkic pairs, especially Turkish-Azerbaijani and Kazakh-Kyrgyz. We also show that transfer direction matters, and that the same transfer source-transfer target pair can behave differently when the translation target changes. Latinization improves BLEU and chrF in several script-mismatched settings, but its effect is not uniform across metrics. Additional analyses show that transfer sources are mostly stable across different datasets and model settings.

15. 【2607.29287】ranslation with Thought: Difficulty-Adaptive Reasoning via Reinforcement Learning for Multi-Domain Machine Translation

链接：https://arxiv.org/abs/2607.29287

作者：Yongshi Ye,Biao Fu,Chongxuan Huang,Yidong Chen,Xiaodong Shi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Multi-domain machine translation, unique challenge due, Multi-domain machine, poses a unique, complexity across domains

备注： 34 pages, 17 figures, and 21 tables. Accepted to ACL 2026

点击查看摘要

Abstract:Multi-domain machine translation (MDMT) poses a unique challenge due to varying levels of linguistic complexity across domains. Inspired by human translators' ability to adapt reasoning effort based on difficulty, we propose TwT (Translation with Thought), a resource-rational framework that learns to modulate inference between intuitive and deliberate reasoning. TwT is trained in two stages: (1) supervised fine-tuning on difficulty-aware long chain-of-thought traces distilled from DeepSeek-R1 and rewritten by GPT-4o to reflect human-like reasoning economy, and (2) reinforcement learning with a hybrid reward to optimize translation quality and reasoning efficiency. Evaluated on 15 benchmarks spanning in-domain and out-of-domain settings, as well as 3 seen and 59 unseen languages, with ablations across three backbone models, TwT-7B and TwT-14B outperform much larger SOTA reasoning models in translation quality, while reducing token usage by 32--60\%. These results confirm that aligning translation behavior with cognitive principles enables robust generalization, high translation quality, and efficient reasoning in MDMT.

16. 【2607.29274】Language Models Agree With Each Other, Not With Readers

链接：https://arxiv.org/abs/2607.29274

作者：Kazuki Nakayashiki,Keisuke Watanabe

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

关键词：human judgements collected, language models homogenise, judgements collected, instruction is running, human

备注： 18 pages. Ancillary files include all three pre-registrations, every analysis script and every result artifact; the paper contains no numeric literal for a measured value and [this http URL](http://make-numbers.py) regenerates all of them from the shipped artifacts alone

点击查看摘要

Abstract:Claims that language models homogenise are usually measured against human judgements collected for the study, which makes the human side an artifact of the design: a crowdworker given the model's instruction is running the model's prompt. We measure convergence against a human reference nobody built for the purpose -- 2,523 reader mark sets across 120 web documents, produced by people highlighting for their own reasons on a platform where the overlay of others' marks is off by default. Agreement is the overlap between two size-matched sentence sets minus the overlap expected when each is resampled within its own depth-and-length bands. The null's calibration is demonstrated, not asserted: every pair involving a random baseline lands within 0.006 of zero. On the median document each party names 14 sentences of 70; two readers share 4.1 and two models 8.7. Across 18 model arms spanning 11 vendors, 3 countries and both weight regimes, the median of 153 model pairs is +0.093 against a human yardstick of +0.040, and 99 sit entirely above the human interval. Two frontier models from rival labs reach +0.203, twice what GPT-4o agrees with itself on a second call. The effect is not determinism, prompt wording, procedure, vendor or routing, and it is graded: the smallest models agree at the human level. No model agrees with readers detectably more than a reader does, and at equal depth and length no surface feature separates their choices. The multiples are procedure-dependent and the ordering is not: models are cut to their sharpest set while a reader's is a random draw from what they marked, and blunting the models alike halves the gap without closing it. Tested out of sample on four models released after this analysis, against predictions fixed beforehand, none clears the human interval. A population simulated from several models is not several populations.

Comments:
18 pages. Ancillary files include all three pre-registrations, every analysis script and every result artifact; the paper contains no numeric literal for a measured value and this http URL regenerates all of them from the shipped artifacts alone

Subjects:

Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

Cite as:
arXiv:2607.29274 [cs.IR]

(or
arXiv:2607.29274v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.29274

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Kazuki Nakayashiki [view email] [v1]
Fri, 31 Jul 2026 10:44:10 UTC (217 KB)

17. 【2607.29252】CalibratedRubric: Task-Adaptive Rubric Banks for Open-Ended LLM Evaluation

链接：https://arxiv.org/abs/2607.29252

作者：Mengting Chen,Yanshu Sun,Wanting Liang,Beidi Luan,Rui Sun,Dezhi Chen,Jing Li,Zuo Bai

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：outputs requires fine-grained, difficult to scale, Reliable evaluation, expert curation, curation is costly

备注：

点击查看摘要

Abstract:Reliable evaluation of open-ended LLM outputs requires fine-grained rubrics, yet expert curation is costly and difficult to scale. Existing automated pipelines rely on strict judge unanimity and binary variance filters, which cannot distinguish measurable rubrics from informative ones. We introduce CalibratedRubric, a task-adaptive framework that combines type-specific scoring, Bayesian rubric-measurability filtering, and item response theory (IRT)-based bank assembly. CalibratedRubric estimates each rubric's measurability with a Beta--Bernoulli agreement posterior and uses a submodular information-coverage objective to construct compact rubric banks over the observed capability range. Across financial, healthcare, general, and legal benchmarks, measurability filtering improves human-gold agreement on JudgmentBench from $\kappa=0.604$ to $0.743$. IRT-based greedy selection improves cross-fitted rank fidelity over random selection across all six evaluated response blocks and requires only 49 rather than 131 rubrics to reach the target correlation on FinResearchBench decision-support tasks. Task-label perturbations further reduce system separation, confirming the practical relevance of task-adaptive scoring. These results support CalibratedRubric as an efficient, uncertainty-aware approach to open-ended LLM evaluation, with calibration gains depending on sufficient judge redundancy.

18. 【2607.29250】Data Turnstile: A Scalable Open Framework for Function-Calling Data Generation

链接：https://arxiv.org/abs/2607.29250

作者：Goutham Ramakrishnan,Megha Sharma

类目：Computation and Language (cs.CL)

关键词：Small language models, Small language, agentic deployment due, reduced cost, times

备注： 16 pages

点击查看摘要

Abstract:Small language models (SLMs) are attractive for agentic deployment due to low latency, reduced cost, and on-device privacy, yet they struggle with tool-use tasks where training data is scarce and noisy. Unlike larger models, SLMs cannot compensate for low-quality supervision through sheer capacity, making data quality the critical bottleneck. We present Data Turnstile, an open-source framework that takes user-defined API specifications and generates high-quality synthetic training data for function calling. Turnstile decomposes multi-turn tool-use interactions into constrained, stepwise generation with validation and error-feedback loops, providing fine-grained control over API diversity, conversation complexity, and output correctness. We demonstrate effectiveness of domain adaptation with Turnstile data on two challenging function calling benchmarks. On the BFCL single-turn benchmark, a Qwen3-0.6B fine-tuned on Turnstile data without chain-of-thought achieves 75.9% overall accuracy (versus 67.4% for the base model with thinking enabled), closing the gap with thinking-enabled Qwen3-1.7B (78.4%) and Qwen3-4B (79.9%) despite being 3$\times$ and 7$\times$ smaller respectively. On $\tau^2$-bench, a multi-turn agentic benchmark, Turnstile-trained Qwen3-1.7B achieves 31.1% pass^1 on the Telecom domain, improving 4.7$\times$ over its 6.6% base and surpassing Qwen2.5-32B-Instruct (27.4%), a model 19$\times$ larger. Turnstile-trained Qwen3-0.6B achieves 24.6%, improving 7$\times$ over its 3.5% base and approaching the 32B model (53$\times$ larger). We release Data Turnstile along with a dataset spanning 1,000+ APIs and 100K+ multi-turn interactions.

19. 【2607.29241】RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems

链接：https://arxiv.org/abs/2607.29241

作者：Haoran Ling,Yuecheng Li,Zeyu Song,Jing Yao,Shuwen Kang,Chi Lu,Wenjin Wu,Peng Jiang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Optimizing modern recommender, engineers manually iterating, Optimizing modern, modern recommender models, iterating over architectural

备注： 9 pages, 2 figures

点击查看摘要

Abstract:Optimizing modern recommender models still depends heavily on engineers manually iterating over architectural, objective, and training-strategy changes. While LLM-based agents can automate this trial-and-error process, allowing the LLM to both select modification directions and generate concrete hypotheses often leads to unstable search under limited experiment budgets. Inspired by the above challenge, we propose RecHarness, a Bandit-Routed Agentic Harness for automated recommender model optimization. RecHarness separates the optimization process into two steps: a bandit router selects the next modification direction according to historical validation feedback, while the LLM generates a concrete optimization hypothesis and executable code edit within the selected direction. To sustain long-horizon exploration, RecHarness uses a jump-basin mechanism to activate a structural-jump arm when local edits stagnate. Across multiple recommendation tasks, datasets, and model backbones, RecHarness achieves more stable performance improvements and uses limited trial budgets more effectively than LLM-reasoning search. During a 7-day online A/B test on a large-scale short-video advertising platform, the selected candidate improves ADVV by 2.084%, Revenue by 0.534%, and Exposure by 0.559%. Code is available at this https URL.

20. 【2607.29238】Small Is Enough: Per-User Style Rewriting of AI-Edited Text via LoRA Adapters

链接：https://arxiv.org/abs/2607.29238

作者：Antorweep Chakravorty

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Emerging Technologies (cs.ET); Human-Computer Interaction (cs.HC)

关键词：rewrite AI-edited text, single user system, individual user writing, user writing style, adapts small language

备注：

点击查看摘要

Abstract:InMyStyle is a privacy first, single user system that adapts small language models to rewrite AI-edited text towards an individual user's writing style without an instruction prompt at inference. Given a user's documents, it uses multiple local helper LLMs to construct paired training examples and fine tunes LoRA adapters on base models ranging from 0.5B to 7B parameters. Length aware generation budgets and automatic chunking support inputs of different lengths. On 219 evaluation pairs from a scientific-paper corpus, the automatic composite score plateaus at 0.69 [scale 0-1] across all model sizes under both greedy and sampled decoding. This observed plateau suggests that small models are sufficient for the measured rewriting task, with model size determining trade-offs rather than a stable quality ranking. As a secondary evaluation, 400 ratings from five LLM judges give InMyStyle outputs a mean perceived AI-ness score over 20% lower than their helper-AI generated inputs, while mean perceived AI-ness scores decrease with model size within InMyStyle.

21. 【2607.29211】Knowing When to Quit: Diagnosing and Training LLMs to Abort Futile Reasoning

链接：https://arxiv.org/abs/2607.29211

作者：Xinyan Guan,Jiali Zeng,Chunlei Xin,Yaojie Lu,Hongyu Lin,Xianpei Han,Le Sun,Fandong Meng

类目：Computation and Language (cs.CL)

关键词：Large language models, derivations mislead users, generate computationally expensive, incorrect derivations mislead, Large language

备注：

点击查看摘要

Abstract:Large language models generate computationally expensive yet semantically void reasoning on beyond-capability tasks, creating risks where plausible-sounding but incorrect derivations mislead users. We characterize this \textit{futile reasoning} phenomenon through systematic analysis, revealing universal capability overreach and systematic miscalibration between capability and behavior. The dominant failure mode is specious reasoning, which outputs look superficially valid but contain subtle errors, escalating with task difficulty. To address this, we introduce \textbf{CaRL} (\textbf{Ca}pability-\textbf{a}ligned \textbf{R}einforcement \textbf{L}earning), which aligns model behavior with capability boundaries through reward shaping that incentivizes refusal over futile reasoning and hindsight refusal augmentation that converts failures into refusal supervision. Experiments demonstrate a substantial reduction in futile reasoning while preserving performance across task difficulties, effectively achieving capability-aligned behavior without sacrificing utility. \footnote{this https URL}

22. 【2607.29196】Hy-MultiTurn: A Six-Dimensional Benchmark for Deep Multi-Turn Dialogue Understanding

链接：https://arxiv.org/abs/2607.29196

作者：Eileen Ye,Jiawen Tao,Yaoming Li,Chenxu Liu,Wenhan Yu,Yaxin Fan,Xiaokun Yuan,Mengzhou Wu,Yanbing Jiang,Maxm Pan

类目：Computation and Language (cs.CL)

关键词：Long-running multi-turn interactions, remembering earlier details, identifying intended objects, Long-running multi-turn, tracking later revisions

备注： 33 pages, 7 figures, 8 tables

点击查看摘要

Abstract:Long-running multi-turn interactions with chatbots and agents are now common, and a correct response often depends on remembering earlier details, tracking later revisions, identifying intended objects or referents, and withholding action when required conditions are unmet. Existing multi-turn benchmarks typically cover short exchanges and do not fully evaluate these capabilities in long multi-turn interactions, particularly in Chinese, while offering limited insight into how and why models fail. To address these limitations, we analyze real chatbot failures to identify six recurring mechanisms and use them to define six controlled evaluation modes in Hy-MultiTurn, a Chinese benchmark for deep multi-turn dialogue understanding. The six modes evaluate constraint memory, precise execution, constraint synthesis, object localization, action suppression, and reference resolution. Across the six modes, we construct 209 controlled tasks spanning 12-76 turns, with dialogue length, irrelevant-topic distraction, and colloquial phrasing adding further difficulty. Evaluation of 22 frontier model configurations shows that Hy-MultiTurn is broadly challenging, as even GPT-5.5, the strongest overall configuration, satisfies all requirements in only 41.1 percent of responses and no model performs best in all six modes.

23. 【2607.29188】Detecting Experiential Intertextuality Across Migration Routes: Beyond Surface Similarity in French Narratives

链接：https://arxiv.org/abs/2607.29188

作者：Sakayo Toadoum Sari,Nelly Robin,Michelle Auzanneau,Lakhdar Sais,Veronique Petit,Marie Veniard,Said Jabbour,Fabien Delorme

类目：Computation and Language (cs.CL)

关键词：Migrants traversing geographically, parallel lived experiences, traversing geographically distinct, geographically distinct routes, recount strikingly parallel

备注： 11 pages, 3 figures, 5 tables. Accepted at SIGDIAL 2026 (27th Annual Meeting of the Special Interest Group on Discourse and Dialogue)

点击查看摘要

Abstract:Migrants traversing geographically distinct routes such as the Trans-Saharan and Balkan corridors often recount strikingly parallel lived experiences: police violence, smuggler exploitation, dangerous crossings, and family separation. We introduce the task of experiential intertextuality detection: automatically identifying shared experiential echoes across migration narratives without requiring annotated training data. From 108 French migration narratives spanning both corridors, we automatically generate sentence pairs and score them using annotation-free methods: lexical baselines, sentence embeddings, POS-based structural features, a migration-specific theme lexicon, context-aware narrative features, and zero-shot LLM scoring with Qwen2.5-7B and Mistral-7B under three prompting strategies. We validate all methods against 816 expert-annotated intertextuality judgments (inter-annotator Krippendorff's $\alpha = 0.27$). Our results reveal that all surface, structural, and embedding methods correlate only weakly with expert judgments ($r \leq 0.30$); Qwen2.5-7B zero-shot achieves the best single-method correlation ($r = 0.38$); few-shot examples degrade Qwen but dramatically improve Mistral; narrative position significantly predicts intertextuality, with departure-phase pairs showing the highest experiential echoes; and a supervised hybrid combining all 31 features achieves $r = 0.45$, a 21% improvement over the best individual method.

24. 【2607.29185】Learning Latent Reasoning Traces for Scalar Reward Models End-to-End

链接：https://arxiv.org/abs/2607.29185

作者：Sanwoo Lee,Clive Bai,Hsiu-Yuan Huang,Kun Liang,Weijie Liu,Yunfang Wu

类目：Computation and Language (cs.CL)

关键词：large language models, aligning large language, language models, central to aligning, aligning large

备注：

点击查看摘要

Abstract:Reward models (RMs) are central to aligning large language models with human preferences via reinforcement learning. Although traditional scalar RMs enable efficient and probabilistic reward modeling, they rely on superficial cues that fail to generalize to complex or out-of-distribution (OOD) tasks. Conversely, generative RMs leverage extensive reasoning to improve robustness on challenging tasks, but their natural language-based scores lack the numerical flexibility and probabilistic interpretability that scalar RMs offer. While recent approaches combine both paradigms through off-policy multi-task learning, such parallel optimization does not guarantee that generated reasoning traces actively align with or benefit downstream scalar reward prediction. To address this mismatch, we propose LatentRM, a reward modeling framework that learns intermediate reasoning traces as discrete latent variables to explicitly maximize the likelihood of downstream scalar rewards. Through on-policy optimization of the latent reasoning space end-to-end, LatentRM tightly couples deep reasoning-based evaluation with precise scoring. Extensive validations on in-distribution and OOD datasets and RLHF show that LatentRM outperforms scalar, generative, and hybrid RMs on preference modeling and policy alignment across tasks ranging from open-ended conversation to complex reasoning.

25. 【2607.29168】Authorship Verification of Transcribed German-Language Videos

链接：https://arxiv.org/abs/2607.29168

作者：Oren Halvani,Sophie Titze

类目：Computation and Language (cs.CL)

关键词：Authorship Verification, digital text forensics, subfield of digital, forensics and addresses, addresses the fundamental

备注： 6 pages, planning to submit to WIFS 2026

点击查看摘要

Abstract:Authorship Verification (AV) represents an important subfield of digital text forensics and addresses the fundamental question of whether two texts were written by the same author. Although the field has made substantial progress over the past two decades, several important challenges remain unresolved or underexplored. For instance, most AV research has focused on written texts, despite the fact that language is expressed not only in written but also in spoken form, such as in videos. Moreover, existing AV studies have predominantly concentrated on English, while other languages, including German, have received comparatively little attention. To address these research gaps, we apply AV to spoken language in the form of transcripts of German-language videos and examine the effectiveness of established AV methods in verifying a speaker's identity across video pairs. Our experimental evaluation, based on a total of ten AV methods applied to three self-compiled corpora comprising 300 videos from 150 speakers, shows that the best performance (up to 88% accuracy and 90% AUC) is achieved by traditional AV approaches based on simple character- and token n-gram representations. In contrast, more modern transformer-based approaches perform significantly worse on all evaluated corpora. Our results therefore suggest that traditional methods in the field of AV remain both competitive and relevant.

26. 【2607.29125】M3-DuplexBench: A Multi-Turn, Multilingual, Multidomain Benchmark for Full-Duplex Spoken Dialogue Models

链接：https://arxiv.org/abs/2607.29125

作者：Ryo Fukuda,Atsushi Ando,Hiroki Kanagawa,Takatomo Kano,Marc Delcroix,Naohiro Tawara,Yuya Chiba

类目：Computation and Language (cs.CL)

关键词：user barge-in handling, Full-duplex spoken dialogue, Full-duplex spoken, spoken dialogue systems, enabling natural behaviors

备注： Submitted to SLT 2026

点击查看摘要

Abstract:Full-duplex spoken dialogue systems (FDSDSs) can listen while speaking, enabling natural behaviors such as smooth turn-taking, backchannel handling, and user barge-in handling. However, fair comparisons in multi-turn conversations remain a challenge. In addition, existing benchmarks provide limited coverage of languages and dialogue domains. We propose M3-DuplexBench, a multi-turn, multilingual, multidomain benchmark for FDSDSs. M3-DuplexBench supports English and Japanese and covers both casual conversation and multi-turn question answering. In addition, we evaluate models under multiple dialogue context settings, including single-turn, user-only, and teacher-forced full-context settings, to analyze how dialogue history affects model behavior. Experiments with recent FDSDSs reveal model-specific turn-taking characteristics, clear performance gaps across languages and domains, and mixed effects of dialogue context.

27. 【2607.29082】Can Zero-Shot LLMs Predict Child Malnutrition? A Fairness and Temporal Robustness Study

链接：https://arxiv.org/abs/2607.29082

作者：Muhammad Ashad Kabir,Md Ahshanul Haque

类目：Computation and Language (cs.CL)

关键词：South Asia, Child malnutrition remains, major public health, public health challenge, challenge in low

备注： Accepted to AIME 2026 Workshop

点击查看摘要

Abstract:Child malnutrition remains a major public health challenge in low- and middle-income countries, particularly in South Asia, where early identification of vulnerable children is critical for timely intervention and resource allocation. This study aims to evaluate the feasibility, fairness, and temporal robustness of using a pretrained large language model (LLM) in a zero-shot setting for child stunting prediction using population health survey data. Using Bangladesh Demographic and Health Survey (BDHS) data collected between 2007 and 2022, we transformed maternal, child, healthcare, and household characteristics into semantically interpretable prompt-based representations and evaluated GPT-4o-mini for zero-shot stunting prediction, comparing its performance against a random forest baseline and assessing fairness across demographic and socioeconomic groups as well as temporal robustness across survey waves. The results demonstrate that zero-shot inference using GPT-4o-mini achieved comparable balanced accuracy to the supervised baseline while exhibiting substantially higher sensitivity for identifying stunting cases, relatively consistent performance across child sex groups, and stable predictive behaviour across BDHS waves; however, important fairness disparities were observed across residence and household wealth categories, highlighting the need for further investigation before deployment of foundation models in public health prediction settings.

28. 【2607.29079】Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models

链接：https://arxiv.org/abs/2607.29079

作者：Yaoxuan Dou,Yang Shu

类目：Computation and Language (cs.CL)

关键词：Training-free acceleration makes, acceleration makes diffusion-based, makes diffusion-based multimodal, diffusion-based multimodal large, multimodal large language

备注： 9 pages, 4 figures, 6 tables. Preprint

点击查看摘要

Abstract:Training-free acceleration makes diffusion-based multimodal large language models (dMLLMs) more deployable, but it may silently change generated content. We study this serving-time consistency problem on 300 real images, comparing Fast-dLLM outputs with the same model's unaccelerated outputs. Across the mild parallelism induced in our long-form setting (1.05--1.25 committed tokens per step), confidence-threshold tuning changes decoding behavior but not baseline agreement. State-refresh ablations and an image-swap intervention instead identify stale visual and generated-text states as contributors to drift. For the tested Fast-dLLM implementation, shortening the KV-cache refresh interval yields a monotonic speed--agreement frontier and near-exact agreement at a measured 1.3x speedup. The initial diagnosis also appears with dLLM-Cache and LaViDa, although dLLM-Cache recovers agreement only after both caches are tightened, which removes its speed advantage. Independent prompts and images reproduce the threshold-insensitivity and refresh recovery. A targeted audit finds genuine content substitution in half of 50 low-agreement pairs. In a separate blinded two-annotator evaluation, the pooled accelerated-minus-baseline factual-error difference is 0.00 (95% CI [-0.17,+0.17]); this sample detects no difference but does not establish factual equivalence. Finally, none of the tested adaptive or smoothed-refresh variants beats the fixed interval at matched compute. Our contribution is a paired diagnostic and an implementation-scoped consistency control, not an accuracy or safety guarantee.

29. 【2607.29066】Semantics of Subterfuge: Benchmarking Legal Deception Detection Against General-domain State-of-the-Art

链接：https://arxiv.org/abs/2607.29066

作者：Theekshana Samaradiwakara,Nisansa de Silva,George C. Lobb

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Natural Language Processing, Automatic Deception Detection, Deception detection, law enforcement, online security

备注： 5 pages paper

点击查看摘要

Abstract:Deception detection has critical implications for legal proceedings, law enforcement, and online security. Although human judgment is limited in accuracy and scalability, Natural Language Processing (NLP) offers a data-driven alternative. We present a survey and comparative analysis of NLP-based Automatic Deception Detection (ADD) focusing on the legal domain, reviewing the evolution from feature-based machine learning to Large Language Model (LLM) approaches. We conduct a unified empirical evaluation across seven datasets (two legal, five general-domain), comparing six fine-tuned transformer models and seven LLMs under four prompting strategies. The results show strong domain sensitivity, with fine-tuned models excelling in data-rich general domains and few-shot LLMs remaining competitive in low-resource legal settings. Chain-of-Thought prompting often underperforms direct classification. These findings highlight the need for domain adaptation and interpretable systems in high-stakes legal contexts.

30. 【2607.29065】okenizer-Agnostic Engram Module

链接：https://arxiv.org/abs/2607.29065

作者：Jia Peng Lim,Hai Leong Chieu

类目：Computation and Language (cs.CL)

关键词：storage versus reasoning, Deepseek Engram, conditional memory module, large language models, trade-off storage versus

备注： Preprint, 7 pages

点击查看摘要

Abstract:Deepseek's Engram, a conditional memory module, was introduced to trade-off storage versus reasoning in large language models. However, the module relies on token-level $N$-gram hashing for Engram embedding lookup, introducing a tight coupling to the tokenizer used: a model with a different tokenizer would have to train its own Engram embeddings from scratch. To improve the reusability of Engram embeddings, we propose a change to the hashing routine, enabling compatibility between Engram models using different tokenizers. Instead of modelling disjoint $N$-gram spaces, we treat $N$-gram as a method to sample potentially useful byte sequences, from all possible byte sequences across tokens. We replace the XOR-based hashing with the general polynomial hashing with a joint embedding space across $N$. This work investigates the possible trade-offs and shows that this simple substitution produces comparable performance and achieves tokenizer-agnosticism: hash equivalence for byte-equivalent token sequences.

31. 【2607.29044】From Inline Notes to Collected Commentaries: Toward Context-Preserving Organization of Exegetical Knowledge in Classical Chinese Texts

链接：https://arxiv.org/abs/2607.29044

作者：Ke Liang,Qi Su,Churen Huang

类目：Computation and Language (cs.CL)

关键词：Confucian exegetical tradition, Inline notes, Confucian exegetical, commentaries are important, important forms

备注： 15 pages, 4 figures

点击查看摘要

Abstract:Inline notes and collected commentaries are important forms of scholarly communication that evolved within the Confucian exegetical tradition, yet have received little computational attention. Drawing on traditional Chinese exegetics and philology, this paper formulates collected commentary compilation as an NLP task and proposes a computational framework that preserves the contextual dependency of inline notes while enabling their automatic compilation and exegetical knowledge organization. It combines two-step prompt chaining for identifying the associated main-text segments and exegetical functions of annotations with cross-source mention clustering for integrating commentary across editions, achieving a CoNLL F1 score above 97% in a case study on the Classic of Mountains. Our framework lays the foundation for the large-scale organization of historical exegetical knowledge, thereby supporting a broad range of downstream philological and NLP tasks.

32. 【2607.29032】ransMem: Transforming Hidden States into Memory for Large Language Models

链接：https://arxiv.org/abs/2607.29032

作者：Haodong Lei,Junming Liu,Yirong Chen,Pinlong Cai,Botian Shi,Ding Wang,Hongsong Wang

类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)

关键词：long interaction histories, Large language model, reasoning requires identifying, exploiting task-relevant evidence, task-relevant evidence distributed

备注： 12 pages, 4 figures

点击查看摘要

Abstract:Large language model (LLM) agents increasingly operate over long interaction histories, where effective reasoning requires identifying and exploiting task-relevant evidence distributed across past observations and actions. However, useful information encoded in previously computed representations is often underutilized during subsequent generation. We propose \textbf{TransMem}, a lightweight inference-time parametric memory module that transforms sparse historical hidden states from a frozen LLM backbone into reusable memory representations. TransMem uses a lightweight gating network to dynamically apply the latent intervention to the current hidden states, without repeatedly encoding the preceding context. To learn transferable memory utilization rather than task-specific knowledge, we introduce evidence-conditioned self-distillation. A memory-augmented student processes the full context and matches the predictive distribution of an evidence-only teacher that shares the same frozen backbone. Experiments on LoCoMo, HotpotQA, and MemoryAgentBench demonstrate consistent improvements across different model architectures and scales. TransMem yields gains of 11.58--29.25 $F_1$ on LoCoMo and 10.20--13.03 $F_1$ on HotpotQA, while improving the average MemoryAgentBench accuracy from 29.54\% to 40.00\%. These results establish sparse historical hidden states as an effective and efficient memory substrate for long-context LLM agents. Our code is available at this https URL.

33. 【2607.29019】GoldenRetriever: Non-Interactive Homomorphic Encrypted Retrieval for Privacy-Preserving RAG

链接：https://arxiv.org/abs/2607.29019

作者：Yang Gao,Gang Quan,Scott Piersall,Qian Lou,Dongdong Wang,Liqiang Wang

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：enhances large language, incorporating external knowledge, raising significant privacy, significant privacy concerns, Retrieval-Augmented Generation

备注： 10 pages

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) enhances large language models by incorporating external knowledge, but existing pipelines typically operate on plaintext data, raising significant privacy concerns. Prior work on privacy-preserving retrieval leverages cryptographic techniques such as homomorphic encryption (HE) and private information retrieval (PIR), but often relies on interactive protocols or ranking-based selection mechanisms that incur high latency and potential information leakage. In this paper, we propose a practical non-interactive encrypted retrieval framework for RAG based on threshold selection. Instead of performing expensive top-$k$ ranking under encryption, our approach selects documents whose similarity scores exceed a predefined threshold, reducing computational complexity from quadratic to linear in the corpus size. We implement this design using CKKS-based homomorphic computation, enabling fully encrypted similarity evaluation and document selection without revealing query content, intermediate scores, or selected indices. To bridge the gap between approximate encrypted computation and discrete token reconstruction, we introduce a precision-stable mask polarization method that ensures accurate recovery of selected documents. Experiments on standard retrieval benchmarks demonstrate that our approach achieves competitive retrieval effectiveness while significantly reducing latency compared to ranking-based encrypted methods. These results highlight threshold-based selection as a practical foundation for scalable and secure RAG systems.

34. 【2607.28986】Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning

链接：https://arxiv.org/abs/2607.28986

作者：Duy Tran Thanh,Thien-Phuc Doan,Long Nguyen-Vu,Ngo Tan Vu Khanh

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词：Zero-shot image captioning, Zero-shot image, frozen pretrained image-text, pretrained image-text scorers, describes images

备注：

点击查看摘要

Abstract:Zero-shot image captioning (ZIC) describes images without paired image-caption supervision during captioner training, relying on text-only corpora and frozen pretrained image-text scorers. Existing retrieval-augmented methods score image-text alignment once, at retrieval, then commit the captioner's autoregressive beam under language-model probability alone, leaving the decoder without further visual grounding feedback. Progress has stalled, with no method improving on the strict-regime best since 2024. We propose Adjudicated Captioning, an inference-time multi-agent framework that restores grounding feedback at multiple checkpoints over an unchanged IFCap captioner. First, we install a stronger frozen Retrieval Encoder at the input. Second, between retrieval and decoding we insert a frozen Cross-Attention Verifier that re-ranks the top-9 retrievals to top-5. Third, at the output beam we attach a learned Reranker pairing TriFuse, a multilayer perceptron, with MemAttend, a memory-attended transformer, the pipeline's only learned components; both are trained self-supervised by Borda-consensus distillation across the three frozen scorers, using no paired image-caption labels and no reference captions. Under the inductive headline protocol, with rerankers fit on the disjoint COCO Karpathy validation beam and applied frozen to test, the framework reaches CIDEr 117.6 and SPICE 21.9 on COCO Karpathy, up from 108.0 and 20.3 for IFCap, a +9.6 CIDEr gain, and +7.7 above NES, the strongest synthetic-image-augmented method at 109.9, without retraining the captioner. A training-free fixed-fusion baseline reaches 115.8 CIDEr, so +7.8 of the +9.6 gain comes from the non-learned architectural intervention and the remaining +1.8 from the learned rerankers. The same recipe transfers off-COCO without captioner retraining: +8.1 CIDEr on Flickr30k Karpathy and +5.7 on NoCaps overall.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

Cite as:
arXiv:2607.28986 [cs.CV]

(or
arXiv:2607.28986v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.28986

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Focus to learn more

            DOI(s) linking to related resources</p>

35. 【2607.28982】PARALLEL: A Prefrontal-Aligned Reinforcement inspired Approach for Language-Model Learning under Explicit Limits

链接：https://arxiv.org/abs/2607.28982

作者：Namkyung Yoon,Sanghong Kim,Hwangnam Kim

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Recent language models, Recent language, local update benefit, applies updates uniformly, conventional adaptation applies

备注： 8 pages, 3 figures, and 5 tables

点击查看摘要

Abstract:Recent language models achieve strong performance across a variety of tasks, but conventional adaptation applies updates uniformly across training samples regardless of their local update benefit. We propose PARALLEL, a prefrontal-aligned reinforcement inspired approach for language-model learning. Inspired by the complementary roles of goal-related and uncertainty-related control, PARALLEL represents these forms of information as separate controller signals and combines them with the current model representation. A reinforcement-inspired controller assigns sample-dependent update intensity using immediate utility-cost feedback. PARALLEL therefore learns when and how strongly to adapt to each sample, prioritizing beneficial updates while limiting unnecessary parameter changes. PARALLEL uses available updates more efficiently than selective baselines while retaining 94.1--99.2\% of Full-adaptation performance. Beyond multiple-choice reasoning, experiments on XSum and CNN/DailyMail show that PARALLEL retains 96.9--98.6\% of the ROUGE-1 and ROUGE-2 scores achieved by Full adaptation and 98.8--98.9\% of the corresponding ROUGE-L scores. When compared at the same cumulative adaptation time or GPU energy, PARALLEL achieves higher ARC accuracy and exhibits a more stable late-stage adaptation trajectory than Full adaptation in the representative run. These results show that learning when and how strongly to update each sample supports stable and efficient post-deployment stream adaptation while avoiding unnecessary updates.

36. 【2607.28979】Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models

链接：https://arxiv.org/abs/2607.28979

作者：Jin-woo Lee,Minkyung Song,Junghyun Oh,Seunghoon Han,Soyoung Park,Gwangseon Jang,Sungsu Lim

类目：Computation and Language (cs.CL)

关键词：Large Language Model, Heterogeneous Large Language, Large Language, systems increasingly rely, Language Model

备注：

点击查看摘要

Abstract:Heterogeneous Large Language Model (LLM) systems increasingly rely on shared contexts, retrieved evidence, and multi-agent dialogue histories, yet their internal key-value (KV) caches remain model-specific and cannot be reused across architectures. Consequently, each model must repeatedly prefill or store caches for the same context, limiting the scalability of multi-model reasoning and long-context generation. We propose Mixture-of-Translators(MoT), a cache translation framework that maps context KV caches from a source LLM into the cache space of a target LLM. Unlike prior approaches that depend on a single projection path or global shared latent space, MoT uses multiple translator modules to capture diverse source--target mappings. To further reduce residual translation error, we introduce a Context Correction Loss that aligns the replayed target trajectory with the native target trajectory. We reveal two competing failure modes in cache translation: propagated translation shift from early injection and last-state shift from late injection. MoT addresses them through translator mixtures and target-side correction. Across homogeneous and heterogeneous translations among Qwen2.5, GPT-2, and OPT models, MoT preserves downstream QA performance, including Qwen2.5-7B-scale translation with 51.0% average closed-set QA accuracy and 0.43 average extractive QA F1. In practical case studies, MoT enables quality-preserving memory reuse for multi-agent reasoning and retains 96.3% of direct-context quality in long-context cache-augmented generation, demonstrating scalable KV cache reuse across heterogeneous LLMs.

37. 【2607.28966】BLADE: Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning

链接：https://arxiv.org/abs/2607.28966

作者：Keshu Fu,Keqin Peng,Jun Bai,Shuhan Qin,Chen Li,Junzhu Liang,Yefei Chen,Jiaqi Li,Yuanxin Ouyang

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, long reasoning traces, improve task performance, generating long reasoning

备注： 8 pages

点击查看摘要

Abstract:Large language models often improve task performance by generating long reasoning traces, but the resulting computation is frequently wasted on redundant verification and revision. Existing probe-based early-exit approaches mainly inspect explicit self-doubt expressions, leaving many earlier termination opportunities undetected. Expanding inspection to ordinary reasoning boundaries improves coverage, but also exposes highly diverse intermediate states whose predictive information may reside in different hidden layers. We present Boundary-Expanded and Layer-Adaptive Dynamic Exit for Efficient LLM Reasoning (BLADE), a lightweight framework that dynamically terminates reasoning by estimating whether the generated prefix is sufficient for correct answering. BLADE constructs multi-granular checkpoints from sentence, self-doubt, and paragraph boundaries, and derives robust training labels through repeated answer completions. It further learns a compact subset of informative probe layers instead of relying on fixed choices or expensive representations from all layers. At inference time, calibrated predictions are combined with checkpoint-specific confirmation rules to balance responsiveness and premature-exit risk. Experiments on five benchmarks and two Qwen3 reasoning models show that BLADE preserves near-baseline accuracy while reducing generated tokens by 24.8% on Qwen3-8B and 15.8% on Qwen3-4B. Ablation studies further confirm the benefits of diverse checkpoints and automatic layer selection, demonstrating an effective approach to more efficient LLM reasoning.

38. 【2607.28934】FairFund-Bench: Evaluating Distributive Bias in LLM Resource Allocation

链接：https://arxiv.org/abs/2607.28934

作者：Martin Lukk(University of Toronto)

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

关键词：Large language models, Large language, biased allocations based, scarce resources, raising concerns

备注： 19 pages, 7 figures. Code and data: [this https URL](https://github.com/martinlukk/fairfund-bench)

点击查看摘要

Abstract:Large language models (LLMs) are increasingly involved in the distribution of scarce resources, raising concerns about biased allocations based on characteristics like race and gender. Recent LLM audits have produced inconsistent results, however, finding evidence of both positive and negative discrimination towards women and ethnic minorities, even for the same models. We show that this disagreement can arise from differences in audit format and introduce FairFund-Bench, a benchmark that systematically varies key features of previous audit designs: the evaluation task (rating, ranking, or allocation), comparison context (single or multi-stimulus), and whether the audit is transparent or disguised. The benchmark comprises 600 requests for financial assistance created from human-authored templates (calibrated against 1.3M real GoFundMe campaigns) across three domains, four race and two gender categories, and five causal framings of need derived from welfare deservingness theory. Across 14 models, audit format changes the direction of bias: models advantage minorities when rating claimants individually but penalize some groups when ranking them side by side. Bias magnitude, though small overall, is several times greater in disguised audits than in transparent ones, where, faced with appeals differing only in claimants' names, models overwhelmingly split funds equally. Causal framing effects, by contrast, exceed demographic effects by roughly an order of magnitude and are consistent across models and audit formats, indicating that current LLMs robustly reproduce human deservingness evaluations. The benchmark scores models on four criteria (demographic bias, deservingness alignment, cross-task consistency, and cross-context consistency), is publicly available, and can be readily adapted to other substantive domains.

39. 【2607.28906】oken-Level Diagnosis of Sycophancy in LLMs with Attribution-Guided Steering

链接：https://arxiv.org/abs/2607.28906

作者：Hieu Nguyen,Mahammed Kamruzzaman,Anshuman Chhabra,Gene Louis Kim

类目：Computation and Language (cs.CL)

关键词：match user beliefs, undermining model reliability, large language models, factual correctness, Authority Share Index

备注：

点击查看摘要

Abstract:Sycophancy refers to the tendency for large language models (LLMs) to match user beliefs at the cost of factual correctness, thereby undermining model reliability. Prior work on evaluating sycophancy in LLMs aims to assess whether a model's output matches an authority's claim, but cannot reveal which part of the prompt drives this sycophantic behavior. To bridge this gap, we investigate the relationship of sycophantic responses with an authority's credentials, their assertive claim, and the problem statement. We introduce the Authority Share Index (ASI), an Integrated Gradients-based token attribution method, which measures the degree to which a model's decision is driven by authority-related text. Through extensive experiments across five models and 30 test configurations, we find that sycophantic responses consistently direct more attention toward authority tokens than resistant ones. Moreover, our token attribution method reveals that for the sycophantic cases, the claim asserted by the authority receives more attention than the authority's credentials. Building on these findings, we propose attribution-guided contrastive activation steering to mitigate LLM sycophancy. Our method constructs a steering vector from high-attribution tokens of sycophantic and resistant responses, selectively pushing models toward resistance. This enables inference-time steering without retraining, lowering sycophancy from 96% to 25% in the strongest case. Together, our results show that token-level attribution can both explain what drives sycophancy and directly inform a practical intervention.

40. 【2607.28896】ORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Models

链接：https://arxiv.org/abs/2607.28896

作者：Aryan Vijay Bhosale,Harshit Rajgarhia,Abhishek Mukherji,Dinesh Manocha

类目：ound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：proliferating rapidly, Unified, Cascaded Baseline, audio, models

备注：

点击查看摘要

Abstract:Unified audio models capable of audio understanding, audio generation and, increasingly, audio editing are proliferating rapidly. Yet a basic question about them remains unanswered: do the two heads of a unified model agree about the same audio? Current practice evaluates each capability in isolation on specialized benchmarks, and never asks whether a model can make sense of its own generations. We present TORUS, the first self-coherence test for audio-native unified models. TORUS comprises 48 three-stage self-coherence tests carrying 432 six-option questions spanning speech, sound and music across five task families. We holistically evaluate five open unified models alongside a Cascaded Baseline that combines state-of-the-art specialized generation, editing and understanding models. The best unified model answers 50.5% of questions against the Cascaded Baseline's 63.2% and a 16.7% chance floor. Models struggle on audio editing. Among the evaluated audio models (specialized and unified), we observe limited self-coherence, and thus position self-coherence as an essential test for future audio systems.

41. 【2607.28862】xtCloak: Thwarting Unauthorized LLM Exploitation via RL-Driven Unlearnable Text

链接：https://arxiv.org/abs/2607.28862

作者：Chengshuai Zhao,Pingchuan Ma,Dawei Li,Bohan Jiang,Zhiyuan Yu,Zhen Tan,Huan Liu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)

关键词：Large Language Models, simultaneously raising growing, raising growing concerns, development of Large, Large Language

备注：

点击查看摘要

Abstract:The rapid development of Large Language Models (LLMs) has led to significant advances across a wide range of language tasks, while simultaneously raising growing concerns about unauthorized data exploitation and privacy leakage. Unlearnable examples (UEs) offer a promising defense by introducing carefully designed perturbations into data such that models trained on them exhibit degraded utility. However, existing methods for text protection are primarily designed for classification tasks (e.g., sentiment analysis) in discriminative language models and often rely on injecting class-specific linguistic cues, which limits their effectiveness in the open-ended generation settings of LLMs. In this work, we propose TextCloak, an RL-driven framework for protecting textual data against unauthorized LLM exploitation. TextCloak employs a generative policy that transforms batches of clean text into unlearnable examples while preserving semantic fidelity and linguistic naturalness. To optimize the policy, we introduce GRPO-UE, which rewards generated unlearnable text based on the downstream degradation they induce in fine-tuned surrogate LLMs and updates the generator parameters via group-relative policy optimization. This bi-level optimization enables the generator to discover generalizable protective patterns beyond class-specific cues. Comprehensive experiments on six publicly available datasets and nine state-of-the-art LLMs demonstrate that TextCloak consistently impairs unauthorized fine-tuning while maintaining text utility for legitimate use. Further analyses establish its transferability and robustness across model architectures, training configurations, and adaptive attacks, highlighting its broad applicability as a practical defense against unauthorized LLM exploitation.

42. 【2607.28840】Benchmarks Are Not Validation: A System-Level View of Financial LLM Applications

链接：https://arxiv.org/abs/2607.28840

作者：Burak Payzun,İrem Demirtaş,Simona Scala,Elena Ferretti,Seçil Arslan

类目：Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词：Large language models, Large language, orchestration logic, increasingly deployed, Large

备注：

点击查看摘要

Abstract:Large language models are increasingly deployed in financial applications that combine retrieval, proprietary data, tool use, orchestration logic, monitoring, and human escalation. Yet evaluation often remains model-centric: benchmark scores, task accuracy, or one-off qualitative reviews are treated as evidence of readiness. In financial settings, this is insufficient. We take the position that financial LLM systems should not be approved for production based on benchmark performance alone. They require system-level validation evidence across the application stack: data, model design, retrieval and generation performance, agent behavior, governance, and implementation. Drawing on industry experience validating GenAI applications in financial institutions, we outline a multi-layer validation view and explain why hybrid evaluation is necessary. We discuss where LLM-as-a-judge methods are useful and why they require controls such as multiple judges, rubrics, agreement, and auditability checks. We also highlight failure modes poorly captured by static benchmarks, including retrieval failures, unfaithful generation, tool misuse, escalation errors, and operational instability. Our position is that financial LLM validation should be an ongoing system discipline rather than a one-time model scoring exercise. Validation should produce decision-ready evidence, not only scores. We conclude with a research agenda for system-aware benchmarks, agent trace validation, judge alignment protocols, and lifecycle validation standards.

43. 【2607.28818】Best Friends, Not Forever: Evaluating Long-Horizon Persona Collapse and Behavioral Drift in AI Companions

链接：https://arxiv.org/abs/2607.28818

作者：Pranav Narayanan Venkit,Akshara Prabhakar,Yu Li,Daniel Lee,Chien-Sheng Wu

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：increasingly mediate repeated, mediate repeated social, locally acceptable replies, repeated social interaction, companions increasingly mediate

备注：

点击查看摘要

Abstract:As AI companions increasingly mediate repeated social interaction, users may rely on a stable role and shared history, yet locally acceptable replies do not ensure that either persists. We study two observable long-horizon failures: 'persona collapse', the loss of a deployed role, boundaries, values, or style, and 'behavioral drift', the gradual or recurrent erosion of those properties. We introduce ANCHOR, a controlled synthetic audit that separately measures persona enactment and trajectory recall. The study contains 2,008 conversations spanning 27 personas, nine interaction schedules, three generated memory settings, and four evaluated models. The Identity Probe combines a sealed 102-item questionnaire with turn-level judgments, while the Trajectory Probe scores 110 calibrated counterfactual questions from 35 conversation banks. Our results show that no evaluated model and configuration reliably preserves either dimensions: trajectory accuracy averages only 44.4%, user-state recall remains near four-option chance, and no tested context condition or memory consistently resolves these failures. Questionnaire retention also varies by model and persona facet, disagrees with turn-level behavior, and is sensitive to evaluator choice. These results indicate that current systems do not yet reliably support long-horizon companion continuity and that audits must distinguish persona enactment, trajectory recall, evaluator provenance, and deployment context rather than collapse them into a single trust or stability score.

44. 【2607.28814】Rolling With Resistance: Preference-Optimized LLM Counselors Can Trade Goal Persistence for Relational Attunement in Motivational Interviewing

链接：https://arxiv.org/abs/2607.28814

作者：Weiying Chen,Junlong Shen,Zhexuan Tang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Motivational Interviewing Treatment, client sustain talk, Interviewing Treatment Integrity, Motivational Interviewing, client autonomy

备注：

点击查看摘要

Abstract:In Motivational Interviewing (MI), a client's sustain talk (arguments for the status quo) calls for the counselor to roll with resistance, a move that can fail in two opposite ways: capitulation (abandoning the change agenda to preserve rapport) or confrontation (arguing or directing, overriding the client's autonomy). We introduce a two-axis evaluation of counselor responses, anchored in the Motivational Interviewing Treatment Integrity (MITI) code, Goal Persistence (GP) and Relational Attunement (RA), yielding a four-quadrant framing in which rolling with resistance is high on both, and we ask whether penalizing one failure through preference optimization teaches rolling with resistance or provokes its opposite. From the expert-annotated AnnoMI corpus we build topic-disjoint Direct Preference Optimization data whose preference sets differ only in which failure is rejected, using on-policy negatives. An automatic judge, validated against AnnoMI's expert labels and rechecked by trained human coders, scores blind pairwise win-rates against each base under a firewall in which disjoint model families generate, label, and judge. Across three aligned instruction models spanning the Qwen and Llama families, penalizing confrontation reliably lowers goal persistence below parity, on every base and in every seed run, a robust cost, whereas the attunement gain is base-dependent, present on two of the three bases but absent on the third. Penalizing capitulation is inert, because these models rarely capitulate on-policy, so the trade is gated by each base's failure profile. A prompt-only control raises attunement without the goal-persistence cost, locating the cost in the optimization rather than in attunement itself.

45. 【2607.28801】Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation

链接：https://arxiv.org/abs/2607.28801

作者：Philipp D. Siedler,Jordan Sassoon

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：evaluating Large Language, obscuring substantial variation, Large Language Models, evaluating Large, Large Language

备注：

点击查看摘要

Abstract:Benchmark datasets are central to evaluating Large Language Models (LLMs), yet they are typically conceived as monolithic tasks, obscuring substantial variation in the demands of individual samples. We introduce a dataset-centric meta-evaluation framework that audits benchmark datasets at the sample level along five latent dimensions: 1. Cognitive and Knowledge Demands, 2. Language and Content Quality, 3. Task Properties, 4. Context, and 5. Ethics, Safety, and Fairness. Applying this framework, we annotate five influential benchmarks -- MMLU, ARC, WinoGrande, HellaSwag, and TruthfulQA -- revealing pronounced internal heterogeneity that is not captured by aggregate accuracy scores. We show how these annotations enable criterion-driven orchestration of composite benchmark subsets across datasets, supporting targeted evaluation of model capabilities such as Reasoning Depth or Ethical Sensitivity. This approach reframes benchmark evaluation as dataset introspection, providing a principled methodology for analyzing and re-composing existing benchmarks to better reflect diverse evaluation needs.

46. 【2607.28777】Self-Supervised Skill Optimization

链接：https://arxiv.org/abs/2607.28777

作者：Siran Peng,Cuiyu Yang,Tianyu Fu,Tianshuo Zhang,Haoyuan Zhang,Weisong Zhao,Anyang Su,Minghui Wu,Huiying Li,Xiangyu Zhu,Chenxu Zhao,Zhen Lei

类目：Computation and Language (cs.CL)

关键词：Agent skills provide, large language model, provide frozen large, frozen large language, recent work shows

备注：

点击查看摘要

Abstract:Agent skills provide frozen large language model (LLM) agents with reusable procedural guidance, and recent work shows that such skills can be optimized with ground-truth (GT) feedback. Many applications, however, lack GT labels, task scores, rewards, or reliable task-specific evaluators. We therefore introduce Self-Supervised Skill Optimization (SSO), a comparative framework that learns a reusable skill from unlabeled task instances alone. At each step, SSO runs the current skill on an unlabeled batch, uses a subset of the resulting executions to generate complete skill probes, and runs the probes on the same batch. An LLM judge compares the resulting answers, trajectories, artifacts, or terminal states. A separate behavior extractor identifies behavioral differences without seeing the judge's decisions. SSO uses these decisions to aggregate evidence for and against the observed behaviors across instances. It then ranks the behaviors by the resulting evidence and renders a new complete skill from the highest-ranked behaviors. The update is accepted only if the new skill outperforms the current one on an unlabeled validation set. SSO outperforms existing GT-free prompt optimizers on both closed-ended and open-ended tasks. On closed-ended benchmarks, it approaches and sometimes exceeds the strongest GT-based skill optimizer without using any GT feedback.

47. 【2607.28766】he Morphological Core of Dungan: A Two-Dialect Finite-State Model and a Multi-Genre Evaluation

链接：https://arxiv.org/abs/2607.28766

作者：Anton M. Alekseev,Sergey I. Nikolenko

类目：Computation and Language (cs.CL)

关键词：Central Asia written, Central Asia, Sinitic language, language of Central, Asia written

备注：

点击查看摘要

Abstract:Dungan, a Sinitic language of Central Asia written in a Cyrillic-based script, is described in detail in the grammatical literature, yet the quantitative properties of its morphology in actual usage have, to the best of our knowledge, never been measured systematically. This paper uses a finite-state morphological analyzer as a measuring instrument. Implemented with HFST and covering both dialect groups (the Gansu variety, which is the literary standard, and the Shaanxi variety), the model offers no new grammatical description; it formalises the knowledge accumulated in Dungan studies and makes it measurable on corpora of three genres. Three results follow. Overt inflection is rare and limited: only 9.3% of recognized tokens in the encyclopaedic register have an overt marker, the system has just ten categories, and degree marking is almost absent. Ambiguity is genuine but sharply localized: 78.1% of tokens receive a single analysis, and the residue sits almost entirely on two clitics, -di (genitive/progressive) and -ni (locative/prospective). And the grammatical core proves effectively closed, the claim the instrument is really needed for: between 78% and 95% of the tokens the analyzer fails on, depending on register, are simply absent from the lexicon, and the phenomena the model deliberately declines to implement account for at most 4.5% of those failures. Held-out coverage (80 to 85%) is no lower than development coverage (73%), while a stem list with no morphology already reaches 67.4%, so the morphology is worth 5.2 points. The open frontier of Dungan is lexical. The analyzer, its sources and every evaluation script are released openly.

48. 【2607.28707】Demystifying Entropy-based Selection for Chain-of-Thought Compression in Large Reasoning Models

链接：https://arxiv.org/abs/2607.28707

作者：Sara Candussio,Daniel Scalena,Luca Bortolussi,Elisabetta Fersini,Malvina Nissim,Gabriele Sarti

类目：Computation and Language (cs.CL)

关键词：negligible accuracy loss, Entropy-based pruning, accuracy loss, negligible accuracy, Entropy-based

备注：

点击查看摘要

Abstract:Entropy-based pruning has been proposed as an effective method for compressing Chain-of-Thought (CoT) reasoning with negligible accuracy loss. We test the robustness of low- and high-entropy CoT step selection methods across various models and reasoning tasks, showing that entropy offers no advantage over random pruning in any evaluated setting. Moving from sentences to tokens, we then show that retaining low-entropy tokens seems effective only on mathematical benchmarks. We find this is due to the inherently low-entropy nature of numeric tokens, which also convey semantic content in such problems. Finally, we demonstrate that patching a subset of a few CoT tokens with their original activations recovers near-perfect full-trace performance, providing causal evidence that task information is not concentrated in a small set of CoT tokens identifiable by heuristics, but rather distributed across the full reasoning chain.

49. 【2607.28692】SciToolAgent-Evo: An Ontology-Aware Self-Evolving Agent for Open-World Scientific Tool Acquisition

链接：https://arxiv.org/abs/2607.28692

作者：Yuqi Tang,Chenyi Zhou,Libin Wang,Keyan Ding,Qiang Zhang,Huajun Chen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large language model, invoking specialized computational, Large language, specialized computational tools, language model

备注： 19 pages, 4 figures, under review

点击查看摘要

Abstract:Large language model (LLM) agents have been increasingly adopted in scientific research for organizing and invoking specialized computational tools. However, their reliance on predefined tool spaces with static semantics limits their applicability to open-world scientific workflows, where tool requirements, capabilities, and boundaries evolve dynamically. To this end, we propose SciToolAgent-Evo, an ontology-aware self-evolving agent for open-world scientific tool acquisition. Driven by an evolving memory of skills, experiences, and an ontologized tool graph, it distills generalizable knowledge from contrastive trajectories during accumulation, whereas during inference, it formulates active requests and utilizes a LinUCB-based bandit gate to dynamically balance exploration and exploitation. Once a novel tool is acquired, its scientific ontology is completed online for seamless integration into the known graph. Moreover, we introduce OpenSciToolBench, a benchmark containing 900 realistic tasks across four difficulty levels. Extensive evaluations show that SciToolAgent-Evo achieves state-of-the-art performance, validating its robustness and generalization.

50. 【2607.28680】ELLER: Dual-Path Iterative Preference Optimization for Table Entity Linking

链接：https://arxiv.org/abs/2607.28680

作者：Yixin Peng,Kehao Li,Stefan Decker

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：ambiguous cell mentions, tables matches short, Entity linking, Table Entity Linking, knowledge-base entities

备注：

点击查看摘要

Abstract:Entity linking in tables matches short and ambiguous cell mentions to their corresponding knowledge-base entities. Existing approaches typically rely on data preprocessing pipelines that retain either compact or extensive table content as contextual evidence, and then formulate entity linking as a language generation task for instruction-tuned models; recent systems further incorporate explicit reasoning to disambiguate challenging mentions. However, their training supervision is usually static: fixed preference data cannot adapt to the residual errors of an evolving model, while variations in reasoning length can bias sequence-level preference learning. To address these limitations, we present TELLER: Table Entity Linking through Learning from Errors and Reasoning. We first retrieve and rank Wikidata candidates and retain reduced table evidence in the prompt. The direct-answer path applies iterative direct preference optimization and refreshes its preference data with residual errors from the updated model. The reasoning path uses filtered and compressed chain-of-thought rationales for supervised fine-tuning, followed by our iterative length-normalized regularized preference optimization. On the TableInstruct entity-linking subset, the direct-answer path improves accuracy from 94.35\% to 94.50\%; on the MammoTab V2 evaluation set, it improves accuracy from 87.59\% to 88.20\%. The reasoning path improves accuracy from 92.90\% to 92.95\% on TableInstruct and from 79.09\% to 81.85\% on MammoTab V2, while maintaining high rates of complete reasoning generation. These results show that iterative preference learning benefits both concise entity prediction and explicit reasoning.

51. 【2607.28674】How Hard Does It Think? Analyzing Step-Aware Reasoning Energy in LLM Chain-of-Thought Trajectories

链接：https://arxiv.org/abs/2607.28674

作者：Hui Wei,Junda Wu,Sheldon Yu,Sizhe Zhou,Yizhu Jiao,Ming Zhong,Bowen Jin,Tong Yu,Shijia Pan,Jiawei Han,Julian McAuley

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：existing interpretability methods, interpretability methods rely, collapse processing depth, step-wise effort opaque, leaving step-wise effort

备注： 13 pages, 3 figures

点击查看摘要

Abstract:Understanding how computational effort is allocated across individual chain-of-thought (CoT) reasoning steps remains an open challenge: existing interpretability methods rely on output-level signals or collapse processing depth into a single trajectory-level scalar, leaving step-wise effort opaque. We propose Step-Aware Reasoning Energy (SARE), a geometric framework that quantifies effort at the granularity of individual CoT steps via Centered Kernel Alignment (CKA) between Gram matrices of token hidden states across adjacent transformer layers, capturing inter-token relational structure without requiring eigenvector alignment or cluster correspondence. SARE further contextualizes this energy within reasoning's semantic progression by modeling CoT trajectories as transitions among latent semantic states. Across six reasoning benchmarks and three open-weight LLMs, we find that reasoning energy is highly non-uniform across step types, exhibiting phase-like transitions invisible to trajectory-level metrics; incorrect trajectories show systematically lower energy at critical reasoning junctions; and SARE-based features match or outperform output-based confidence baselines in most settings, indicating that internal geometric dynamics encode predictive information beyond surface-level signals.

52. 【2607.28666】he Checking Problem: What must be true before AI ships in a regulated firm

链接：https://arxiv.org/abs/2607.28666

作者：Prerit Ahuja

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Enterprise AI programmes, poorly explained, programmes stall, widely quoted, quoted and poorly

备注： 10 pages, 5 tables

点击查看摘要

Abstract:Enterprise AI programmes stall at a rate that is widely quoted and poorly explained. This paper measures the mechanism. Six document-heavy workflows of the kind performed daily in regulated financial services were run across four model families and three tool configurations, three times each, producing 5,093 scored output elements across 72 configurations. Each configuration was assessed twice: against a demonstration bar, being a single correct run on a single case, and against a production bar requiring sustained accuracy, reproducibility across repeats, verifiable attribution, and a confidence signal that carries information. 57 of 72 configurations cleared the demonstration bar and 32 cleared the production bar, a survival rate of 56.1%. The paper then computes the review burden each configuration imposes, estimated out of sample rather than with hindsight. A tool that states no confidence requires review of 100% of its output, because it offers a reviewer no basis for triage. Requiring the tool to cite its sources and state a confidence reduces that to 49% while holding the residual error tolerance in 17 of 20 configurations. Adding a self-verification pass costs 2.3 times the latency of the plain configuration, reaches 44%, and is the only configuration that fails to hold the error tolerance. The practical implication is that the value of an AI workflow is set less by how often it is right than by how much of it a human must still check, and that the second property is measurable and rarely measured.

53. 【2607.28661】Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements

链接：https://arxiv.org/abs/2607.28661

作者：Xinke Tong,Xuanming Zhang,Tianyi Tang,An Yang,Jiatu Hu,Guojie Lin,Zhenzhen Shi,Lingfeng Zeng,Boyu Yang,Bing Zhao,Hu Wei,Lin Qu,Dayiheng Liu

类目：Computation and Language (cs.CL)

关键词：Large Language Models, possess genuine structural, Large Language, possess genuine, rely on surface-level

备注： The FinIndices dataset is publicly available at [this https URL](https://huggingface.co/datasets/User158072/Finindice)

点击查看摘要

Abstract:Do Large Language Models (LLMs) possess genuine structural reasoning, or merely rely on surface-level pattern matching? The financial domain, demanding numerical precision and multi-step logic over long contexts, is an ideal testbed. Existing benchmarks fail to capture real-world industrial complexity, predominantly relying on multiple-choice questions or single-hop QA over cropped tables while ignoring intricate cross-statement dynamics and temporal de-cumulation. To bridge this gap, we introduce FinIndices, a large-scale benchmark evaluating data-processing fidelity over uncropped financial statements (up to 32K tokens). Utilizing an automated synthesis pipeline with adversarial traps, FinIndices encompasses Single-Index computation and Table-Index tabulation to test complex domain, temporal, and caliber reasoning. Our evaluation reveals two severe LLM vulnerabilities. First, a "Knowledge Bottleneck": despite memorizing formulas during pre-training, models demonstrate fragile pattern matching. Removing explicit formula hints causes performance to collapse (e.g., Gemini-3.1-Pro drops from 70.70% to 38.22% on table tasks), exposing fatal flaws in temporal de-cumulation and stock-flow caliber mismatch. Second, a "Structural Bottleneck": the intense cognitive load of generating multi-metric, multi-period tables actively drains reasoning capacity. Under structural pressure, LLMs that flawlessly execute isolated derivations regress to shallow heuristics, such as fetching incorrect adjacent columns or substituting deep accounting adjustments with lazy literal arithmetic. Finally, Supervised Fine-Tuning (SFT) yields substantial zero-hint gains (+8.54% Single, +3.82% Table), validating that structured logic can be partially restored via data-centric alignment.

Comments:
The FinIndices dataset is publicly available at this https URL

Subjects:

Computation and Language (cs.CL)

ACMclasses:
I.2.7; J.4

Cite as:
arXiv:2607.28661 [cs.CL]

(or
arXiv:2607.28661v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.28661

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

54. 【2607.28658】Evaluating Federated Pre-Training: On the Reliability of Downstream Fine-Tuning and Intrinsic Evaluation

链接：https://arxiv.org/abs/2607.28658

作者：Claudia Grosser,Maike Heuer,Denis Krompass,Thomas A. Runkler

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：train foundation models, Federated pre-training offers, underlying datasets, pre-training, train foundation

备注：

点击查看摘要

Abstract:Federated pre-training offers a way to train foundation models on private or distributed data without centralizing the underlying datasets. However, evaluating federated pre-training remains challenging because differences in client participation and local data availability can make directly comparable evaluation difficult. Moreover, pre-training test perplexity is tied to the pre-training distribution, while downstream benchmarks introduce task-specific adaptation that may not faithfully reflect the test perplexity established during pre-training. In this work, we study which evaluation protocol more reliably reflects federated pre-training quality. Using a controlled set of centralized and federated-trained models of a 16M parameter transformer model trained on identical client data, we assess evaluation protocols by whether they preserve a reference ranking established on the same pre-training testset. We compare downstream fine-tuning on GLUE, including full, head-only, and reduced-data variants, with next-token prediction on GLUE text as an intrinsic evaluation signal. Our results show that downstream fine-tuning does not reliably preserve the pre-training ranking, whereas direct next-token prediction exhibits a strong correspondence with the pre-training test perplexity. These findings suggest that downstream fine-tuning alone can be misleading when comparing federated pre-trained models, and that evaluation signals closer to the original pre-training objective deserve greater attention.

55. 【2607.28651】Measuring Cognitive Engagement in Collaborative Discourse with an Extended ICAP Framework: Comparing Human Annotation, In-Context Learning, and Reflective LLM Agents

链接：https://arxiv.org/abs/2607.28651

作者：Lan Anh Do,Hanling Jiang,Shuchin Aeron,Ayanna K. Thomas

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Collaboration supports learning, Collaboration supports, effectiveness depends, cognitive engagement, Collaboration

备注： Accepted as a full paper in the CogSci 2026 proceedings

点击查看摘要

Abstract:Collaboration supports learning and problem-solving, but its effectiveness depends on cognitive engagement during discourse. This study applies an extended 7-point ICAP framework based on the Interactive, Constructive, Active, and Passive modes to characterize variation in cognitive engagement during collaborative dialogue. Engagement was coded by trained human annotators and compared with large language model (LLM)-based labeling approaches, including in-context learning (ICL), zero-shot prompting, and self-reflective agents. Interrater reliability among human annotators was robust across framework refinement stages (kappa = 0.906-0.998), higher than the moderate agreement observed for ICL-based annotation (kappa = 0.541-0.609). The human-refined framework improved agreement among human annotators (Delta kappa = 0.10), but produced only modest gains for ICL-based LLMs (Delta kappa less than 0.04). Agent-refined frameworks improved cross-model agreement but remained below the human-refined framework. These findings highlight the promise of agent-based approaches and the importance of continued interaction between theory-guided human annotation and LLM-based methods in future work.

56. 【2607.28648】Why It Hurts: Identifying the Drivers of Negative Thoughts in Emotional Support Conversations

链接：https://arxiv.org/abs/2607.28648

作者：Hainiu Xu,Zhaoyue Sun,Hanqi Yan,Jinhua Du,Caroline Catmur,Yulan He

类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, negative thought reframing, Language Models, thought reframing

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) are increasingly used for emotional support tasks, such as negative thought reframing. This task relies on modifying cognitive appraisals, the subjective interpretation of events that elicit negative emotions, which is typically conceptualized along multiple discrete dimensions. Current LLM-based frameworks model cognitive appraisal by exhaustively evaluating all possible dimensions, but they fail to account for the varying saliency of these dimensions across different contexts. In this work, we investigate a vital yet overlooked question: "Can LLMs infer the salient appraisal dimensions from emotional support conversations?" To address this question, we introduce the AppraiSal benchmark, containing 996 emotional support conversations with human-annotated mental states, including salient cognitive appraisal dimensions. Furthermore, we propose PRISM, a multi-agent probabilistic framework grounded in Bayesian Inverse Planning, designed to improve LLMs' ability to identify context-specific appraisal dimensions. Experimental results show that PRISM brings improvements to LLMs across various sizes, particularly in identifying the most salient appraisal dimensions.

57. 【2607.28643】o Facilitate or not to Facilitate: Human and LLM Facilitator Tendencies in Online Discussions

链接：https://arxiv.org/abs/2607.28643

作者：Dimitris Tsirmpas,Katerina Korre,John Pavlopoulos

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词：content moderation approaches, long-standing social concern, moderation approaches, online discussions, online spaces

备注： For the moderators: The acronym package may complain that some "acro" references are undefined. These references are, in fact, defined and the readability of the article remains the same

点击查看摘要

Abstract:Automating facilitation in online discussions is a long-standing social concern given the increasing time we spend on online spaces and the failure of content moderation approaches. While studies have been conducted on how to facilitate, none have answered the essential question of when to do so. A potential answer is using LLMs, which ostensibly make automated, large-scale intervention increasingly feasible. In this study, we examine when LLMs decide to facilitate by defining what facilitation is, observing when humans decide to facilitate, and comparing their decisions with those made by LLMs. To this end, we create PEFK, a corpus standardizing and aggregating all relevant facilitation datasets. We are the first to run a survey on facilitation timing, which we execute using expert facilitative participants and LLM-as-a-judge models. We discover that while humans are more cautious, LLMs are excessively eager to facilitate, although both are more certain when judging that facilitation is not needed. We then investigate whether this behavior can be corrected using alternative setups for LLMs and training ModernBert classifiers on established datasets, finding that the latter perform more reliably than the former, although current datasets impose a relatively low performance ceiling.

58. 【2607.28642】hinkReset: Learnable Intermediate Interface Construction for Bounded-Context Long-Horizon Reasoning

链接：https://arxiv.org/abs/2607.28642

作者：Fei Ding,Yongkang Zhang,Runhao Liu,Yuhao Liao,Zijian Zeng

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：introduces redundancy accumulation, complex problems, redundancy accumulation, error anchoring, performance on complex

备注：

点击查看摘要

Abstract:Long chain-of-thought reasoning improves performance on complex problems, but it also introduces redundancy accumulation, context overflow, and error anchoring. We argue that under bounded context windows, the core bottleneck is not trajectory compression or test-time control, but the absence of a reusable intermediate interface that can replace discarded history and support continued solving. We further identify a key failure mode of outcome-reward-driven long-chain reinforcement learning: when the model has not solved the task before the window is nearly exhausted, the final-answer reward encourages premature guessing rather than continued careful reasoning. We propose ThinkReset, a text-space instantiation of this view. ThinkReset explicitly constructs reusable intermediate interfaces through interface writeback and reset, and directly optimizes post-reset continuation success. Across multiple long-horizon reasoning benchmarks, this perspective consistently improves success rates under fixed context windows.

59. 【2607.28641】he Formalism Trap: Are LLM-as-a-Judge Evaluators Blinded by Consensus Mimicry under Social Load?

链接：https://arxiv.org/abs/2607.28641

作者：Dahlia Shehata,Ming Li

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Agentic Formalism Trap, Evaluative Dissonance Index, systems conflate structural, Agentic Formalism, Formalism Trap

备注：

点击查看摘要

Abstract:We introduce the \textit{Agentic Formalism Trap} and the Evaluative Dissonance Index ($D_E$), quantifying how LLM-as-a-Judge systems conflate structural proceduralism with semantic truth under adversarial load. Analyzing 22,500 trajectories across 3 domains (GAIA, SWE-bench, Multi-Challenge), we extract a semantic taxonomy of hallucination maneuvers, validated via deterministic lexical grounding ($p 10^{-120}$). A logistic meta-evaluator isolates the exact syntactic triggers of this evaluator capture (ROC-AUC 0.8779), while a zero-shot Leave-One-Domain-Out transfer proves the vulnerability is universally domain-agnostic (mean ROC-AUC 0.7482). Architectural profiling reveals that distinct simulated swarm topologies induce mathematically disparate semantic blind spots, proving that unanchored closed-loop evaluation is unstable, systemically divergent and necessitates architecture-specific vigilance filters.

60. 【2607.28640】okenSwap: Benchmarking and Reducing the Modality Gap in Multimodal LLMs

链接：https://arxiv.org/abs/2607.28640

作者：Andong Hua,Colton Bishop,Igor Mordatch,Arian Hosseini,Jindong Gu,Aleksandra Faust,Rebecca Roelofs,Yao Qin

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：generate consistent responses, Multimodal large language, large language models, large language, generate consistent

备注：

点击查看摘要

Abstract:Multimodal large language models (MLLMs) should generate consistent responses given semantically equivalent inputs across modalities. However, we observe a systematic discrepancy in model predictions under such cross-modal variations. Specifically, we define the modality gap as the difference in model performance under semantically equivalent textual and multimodal inputs. We introduce TokenSwap, a method that constructs such inputs by replacing textual concepts with semantically aligned images, resulting in sequences where visual tokens are interleaved with text tokens. Based on TokenSwap, we transform existing text-based benchmarks such as MMLU into image-interleaved counterparts, resulting in TokenSwap-Bench. Across 42 MLLMs, we observe a pervasive modality gap, with performance decreasing by 4.2% to 47.4% when moving from text-only to image-interleaved inputs, averaging 19.6% +/- 3.3% across models. Notably, we observe that reasoning models exhibit consistently smaller gaps, achieving an average gap of 10.1% compared to 25.5% for non-reasoning models. In contrast, neither prompting strategies nor scaling training compute alone reliably reduces the modality gap. Finally, we demonstrate that incorporating TokenSwap during training effectively mitigates this gap while preserving strong text-only and vision-language performance.

61. 【2607.28639】he Asymmetric Effects of Knowledge Distillation on Bias in Small Language Models

链接：https://arxiv.org/abs/2607.28639

作者：Plawan Kumar Rath

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

关键词：small instruction-tuned language, instruction-tuned language models, show that knowledge, small instruction-tuned, knowledge distillation

备注： 14 pages, 5 figures. Preprint

点击查看摘要

Abstract:We show that knowledge distillation in small instruction-tuned language models has asymmetric effects on bias. On unambiguous tasks (BBQ-disambig), response-based distillation from a Gemma-2-9B teacher improves context-following: for the most biased baseline (SmolLM2-1.7B-Instruct), it cuts the context-overriding error rate from 44% to 24%. On ambiguous tasks (BBQ-ambig), the same distillation destroys per-item refusal calibration: 15% of items where the baseline correctly abstained instead receive stereotype answers, even when overall refusal rate is preserved. The pattern reproduces on a second student family (OLMo-2-1B-Instruct), with silence-loss of 8% and filled-silence accounting for 89% of new bias. Across the full 28-configuration grid, the magnitudes of silence-loss and filled-silence are uncorrelated (Spearman $\rho=0.19$, n.s.), indicating that the two effects arise from distinct mechanisms. Aggregate stereotype metrics (CrowS-Pairs, overall BBQ Stereotype Reliance Score) average over both effects and conceal the per-item harm. We trace the calibration loss to a data-side mechanism: an audit of four training corpora finds 0.5% refusal-as-answer-shape. Supervised fine-tuning (SFT) with refusal injection either breaks parsing or over-corrects into a trivial-refuser regime (refusal rate 99.8%, disambig accuracy 0.2%) that aggregate metrics would call perfectly calibrated. We propose Per-Condition Calibration Diagnosis (PCCD), a three-step protocol that evaluates refusal calibration, context-following, and capability preservation. PCCD catches both the asymmetric harm and the trivial-refuser failure mode that aggregate evaluations miss.

Comments:
14 pages, 5 figures. Preprint

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)

ACMclasses:
I.2.7; I.2.6; K.4.1

Cite as:
arXiv:2607.28639 [cs.CL]

(or
arXiv:2607.28639v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.28639

Focus to learn more

              arXiv-issued DOI via DataCite</p>

62. 【2607.28638】Learning Stateful Predictive Knowledge From Experience

链接：https://arxiv.org/abs/2607.28638

作者：Yan Song,Xidong Feng,Bo Liu,Xinyu Cui,Haotian Fu,Zichen Liu,Mengyue Yang,Cheng Deng,Jian Zhao,Jun Wang

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：large language model, large language, primarily rely, Stateful Knowledge, knowledge

备注：

点击查看摘要

Abstract:As large language model (LLM) agents increasingly learn from experience, they primarily rely on trajectory-level reflection to extract insights. Viewed through the lens of predictive knowledge, we argue that this approach operates on episodic hindsight rather than predictive foresight, yielding brittle, path-dependent heuristics. To address this, we propose Stateful Knowledge Learning (SKL). SKL shifts the agent's focus from trajectory-level summarization to maintaining Stateful Knowledge: explicit, declarative predictive assessments anchored to state. We first demonstrate a motivating example showing how stateful knowledge provides granularity, enhances generalization, and enables knowledge bootstrapping. To further scale up the idea, we introduce two algorithms via self-distillation (SKL-SD) and reinforcement learning (SKL-RL), training agents to autonomously extract state-grounded predictive knowledge from experience and learn to leverage it for policy making. Experiments on interactive environments (WebShop, ScienceWorld) and a complex reasoning task (ChessPuzzles) demonstrate that equipping models with the inherent ability to learn stateful predictive knowledge significantly outpaces current reflection-based training paradigms.

63. 【2607.28637】ZeroR@CHiPSAL 2026: Two-Stage Vision-Language Adaptation with Contrastive Learning for Nepali Meme Classification

链接：https://arxiv.org/abs/2607.28637

作者：Nitiz Khanal

类目：Computation and Language (cs.CL)

关键词：multimodal hate speech, Nepali memes, hate speech, shared task, Hateful Meme Detection

备注： 9 pages, 2 figures, system description paper for the CHiPSAL 2026 shared task at LREC 2026

点击查看摘要

Abstract:This paper presents our system for the CHiPSAL 2026 shared task on multimodal hate speech and sentiment detection in Nepali memes. We address both subtasks: binary hate speech classification and three-class sentiment analysis. Our approach adapts the Robust Adaptation of Hateful Meme Detection (RA-HMD) framework using Qwen3-VL-8B-Instruct, a state-of-the-art vision-language model with native Devanagari support. We employ a two-stage training pipeline: (1) LoRA fine-tuning with an MLP projection head for generative classification, and (2) contrastive backbone fine-tuning with supervised InfoNCE loss. We handle class imbalance through minority oversampling, image augmentation, and focal loss. At inference, we ensemble Stage 1 token probabilities with Stage 2 classifier scores using validation-tuned weights. Our end-to-end approach eliminates error propagation from separate OCR and translation pipelines by leveraging the model's native Devanagari understanding. Our system achieved \textbf{2nd place} on hate speech detection (F1: 0.797) and \textbf{4th place} on sentiment analysis (F1: 0.518). We provide detailed ablations, error analysis, and insights into adapting large vision-language models for low-resource South Asian languages.

64. 【2607.28636】Chain-of-Models: Cross-Model Auditing for Bias-Robust LLM Judges

链接：https://arxiv.org/abs/2607.28636

作者：Qian Wang,Zhanzhi Lou,Zhenheng Tang,Nuo Chen,Bingsheng He

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：LLMs increasingly serve, judgments remain vulnerable, LLMs increasingly, increasingly serve, remain vulnerable

备注： WIP

点击查看摘要

Abstract:LLMs increasingly serve as automated judges, but their judgments remain vulnerable to cognitive biases. Existing mitigations mostly rely on prompt-driven debiasing, which is brittle across bias types, or human evaluation, which does not scale. We study \emph{Chain-of-Models} (CoM), an automated audit pipeline in which a second model inspects the first model's reasoning trace before producing the final judgment. The key design question is whether the auditor should be the same model, a same-family model, or a different-family model. Across 9 models from 6 families, 4 cognitive biases, and 4 factual datasets, we find that auditor identity matters in two ways. First, standalone bias resistance does not predict audit effectiveness: Kimi-K2.5 is the strongest standalone model on several biases, yet is a weak auditor for Qwen2.5-72B's biased traces. Second, the best auditor is bias-specific: GPT-4o is strongest on bandwagon, authority, and distraction, while GLM-5 is strongest on sycophancy. We operationalize these findings with a per-bias auditor selection rule that, given the bias type, scores candidates along functional diversity, per-bias standalone resistance, and calibrated audit effectiveness. Under a calibration/test split, the selector reaches the highest accuracy across the four biased slices ($0.884$ vs.\ $0.824$ for the strongest single fixed auditor and $0.805$ for the no-audit baseline). We release data, configurations, and an LLM-agent skill at this https URL .

65. 【2607.28635】Imbalanced Data Clustering via Targeted Data Augmentation Using GMM and LLM

链接：https://arxiv.org/abs/2607.28635

作者：Noor Khalal,Abdallah Alaa-Eddine Djamai,Imed Keraghel,Mohamed Nadif

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Natural Language Processing, Large Language Models, capture minority topics, adequately capture minority, Gaussian Mixture Models

备注：

点击查看摘要

Abstract:In Natural Language Processing (NLP), dealing with underrepresented topics is challenging, especially in unsupervised tasks where clustering might not adequately capture minority topics. To tackle this challenge, our paper presents a novel unsupervised data augmentation method that integrates Gaussian Mixture Models (GMMs) and Large Language Models (LLMs). Due to their flexibility and robustness, GMMs can detect clusters corresponding to underrepresented areas in the data, while LLMs create synthetic documents to enrich these clusters and improve their representation. Experiments on various imbalanced text datasets demonstrate that our approach preserves clustering performance in all cases and often enhances cluster interpretability, offering a robust and scalable solution for improving data representation in unsupervised NLP tasks.

66. 【2607.28634】Can LLMs Really Understand Item Difficulty Levels? Implications for Automated Item Generation Using LLMs

链接：https://arxiv.org/abs/2607.28634

作者：Xinyi Wang,Hong Jiao,Ming Li,Sydney Peters,Hanna Choi,Tianyi Zhou,Qingshu Xu

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：high-stakes summative assessments, large-scale high-stakes summative, difficulty levels, item difficulty, item difficulty levels

备注： 43 pages, 4 figures

点击查看摘要

Abstract:The estimation of item difficulty plays a key role in both formative assessment and large-scale high-stakes summative assessments. This study explores how large language models (LLMs) perform in predicting item difficulty levels using items from a large-scale Reading and Writing test. The study investigated various prompting strategies and parameter settings across multiple LLMs. LLM performance was compared with encoder-only language models and feature-based supervised machine learning models. Zero-shot GPT-4.1 with a temperature of 0 yielded the highest item difficulty level prediction accuracy, with a quadratic weighted kappa (QWK) of 0.578. However, LLMs' prediction accuracy was lower than that of ConvBERT (QWK = 0.625), which outperformed the best feature-based supervised machine learning model. Further analysis showed that all LLMs struggled to label hard items; in particular, the current advanced GPT-5.4 tended to underestimate item difficulty levels. Dimension reduction of embeddings showed that item embeddings from different difficulty levels were mixed together, indicating that semantic information from items alone is likely insufficient for item difficulty level prediction. The findings suggest that if LLMs cannot understand item difficulty levels as evidenced by empirical data and tend to treat most items as easy when their own capabilities increase, caution should be exercised when using LLMs to generate items with targeted difficulty levels.

67. 【2607.28631】Can AI Evaluate AI Scientists? A Benchmarking Study of Autonomous Research Generation Systems Using Automated Multi-Model Review

链接：https://arxiv.org/abs/2607.28631

作者：Vaibhava Lakshmi Ravideshik,Mayank Kejriwal

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：accelerate scientific discovery, Scientist systems capable, significantly accelerate scientific, Scientist, scientific discovery

备注：

点击查看摘要

Abstract:AI Scientist systems capable of autonomous research have the potential to significantly accelerate scientific discovery. However, evaluating and comparing the quality of AI-generated papers remains an open challenge. We propose and implement a rigorous benchmarking protocol using an automated peer-review system that harnesses frontier large language models to assess scientific papers across four core dimensions: originality, scientific rigor, clarity, and significance. We evaluate four leading AI Scientist frameworks: \textit{Sakana AI (v1 v2)}, \textit{CycleResearcher}, and \textit{Data-to-Paper}. Each framework was run on a consistent set of 15 research proposals published by a commercial autonomous AI scientist company (FARS), generating 60 papers that we evaluate alongside 15 FARS benchmark papers. Using three independent LLM reviewers (GPT-5.4, Gemini, and Claude), we find that FARS benchmark papers significantly outperform all competing frameworks, achieving mean scores of 2.14--2.47 on a 1--5 scale compared to 1.00--1.87 for other systems. Notably, FARS scores are more than 2$\times$ higher than the next-best systems on Gemini and Claude evaluations. We find strong agreement among Gemini and Claude ($\rho$ = 0.907, $p 0.001$), and both correlate extremely strongly with the synthesis score ($\rho$ = 0.961, $p 0.001$), validating the reliability of automated evaluation. However, GPT-5.4 exhibits weaker agreement ($\rho \approx 0.32$), suggesting it evaluates papers using different criteria. These results establish the first quantitative benchmark for AI Scientist systems and demonstrate that multi-model LLM evaluation provides a scalable, consistent framework for assessing autonomous research quality.

68. 【2607.28457】SVR: Self-Verifying Refinement via Joint Verdict-Confidence Reinforcement Learning for Adaptive Test-Time Compute

链接：https://arxiv.org/abs/2607.28457

作者：Hongyu Chen,Liang Lin,Guangrun Wang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Scaling test-time computation, budgets waste computation, uniform budgets waste, verifier-guided refinement relies, improve language-model reasoning

备注： 8 pages, 4 figures, 4 tables

点击查看摘要

Abstract:Scaling test-time computation can improve language-model reasoning, but uniform budgets waste computation on easy inputs, while verifier-guided refinement relies on external feedback. We introduce Self-Verifying Refinement (SVR), an oracle-free multi-turn reinforcement learning framework that learns to use self-verification as a compute-control policy. At each turn, the model produces a solution together with a discrete correctness verdict and a confidence score; it retains the current answer only when the verdict is Correct and confidence exceeds a threshold, and otherwise continues refinement using its own self-verification. Ground-truth correctness is used only to construct training rewards and is never exposed to the policy through refinement prompts or required at inference. SVR is trained with GRPO on fixed-horizon trajectories using rewards that promote solution correctness, calibration-aware self-verification, and stop-ready correct states; adaptive stopping is activated only at inference. On seven mathematical reasoning benchmarks with Qwen3.5-2B, SVR achieves a macro-average accuracy of 0.563 with only 2.99 inference turns on average. In the evaluated complete-system comparison, it exceeds standard GRPO, strong multi-turn baselines, and a fixed-budget oracle-guided score-feedback reference while requiring substantially fewer turns than fixed ten-turn inference. These results demonstrate that learned self-verification can serve as an effective internal control signal for answer retention and adaptive test-time compute allocation.

69. 【2607.26512】Evidence-Ledger Adjudication for Claim-Evidence Traceability

链接：https://arxiv.org/abs/2607.26512

作者：Gengyu Chen,Yongjie Yu,Weiling Wang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：draft claims faster, cited or retrieved, retrieved evidence supports, evidence, draft claims

备注：

点击查看摘要

Abstract:AI agents can draft claims faster than authors can check whether the cited or retrieved evidence supports them. We study evidence-ledger adjudication: a claim-evidence traceability workflow that pairs each claim with an evidence packet, assigns a support relation, and routes unsupported, contradicted, or mixed-evidence claims back to the author. The empirical core is a 2,335-row blind benchmark built from independent external labels in AVeriTeC, CLIMATE-FEVER, and SciFact. Gold relations and source evidence labels are hidden during prediction and joined only for scoring. On this benchmark, the agent evidence-ledger condition achieves 0.676 relation accuracy and 0.601 macro-F1, compared with 0.383 accuracy and 0.303 macro-F1 for the best non-agent baseline. It also routes 1270/1435 claims whose gold labels indicate contradiction, missing evidence, or mixed evidence, while routing 295/900 supported claims. These results show that evidence-ledger adjudication can turn heterogeneous evidence packets into an auditable traceability layer for AI-assisted writing.

信息检索

1. 【2607.29606】QASP: Query-Adaptive Robust Vector Search Policy

链接：https://arxiv.org/abs/2607.29606

作者：Hakan Ferhatosmanoglu,Kushal Kumar,Tal Wagner,Andy Warfield

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：minimizing computational costs, consistently high recall, achieving consistently high, computational costs, fundamental challenge

备注： 12 pages, 6 figures, 6 tables, preprint

点击查看摘要

Abstract:A fundamental challenge of vector search is achieving consistently high recall while minimizing computational costs. Fixed search parameters cause significant performance variance across queries, and conventional evaluation on average recall masks these per-query disparities. We introduce QASP (Query-Adaptive robust vector Search Policy), which predicts the complete recall progression curve per query via a single upfront supervised regression, from which a search policy is derived for any recall target; this avoids iterative model invocations during search or separate predictors per target. By predicting normalized recall values with scale-invariant features and pre-search inference, QASP generalizes across recall targets, index configurations, and datasets. Its fine-grained progress predictions further enable a lightweight reactive complement that adjusts search depth based on predicted-versus-observed deviations without additional inference. We prove that QASP requires a finite training sample independent of dataset size and dimensionality, that its loss exceeds the irreducible lower bound of any fixed policy by a vanishing margin, and that its data access savings over fixed probing grow exponentially in intrinsic dimensionality. Experimentally, QASP achieves significantly lower recall variance and deviation from target, higher query satisfaction rate, and scales to large data and hierarchical indices without retraining, achieving 99% recall with 80% less data access.

2. 【2607.29402】Bridging the Question-Answer Gap in Retrieval-Augmented Generation: Hypothetical Prompt Embeddings

链接：https://arxiv.org/abs/2607.29402

作者：Domen Vake,Jernej Vičič,Aleksandar Tošić

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：generative language models, synergize retrieval mechanisms, Hypothetical Document Embeddings, relevance of responses, systems synergize retrieval

备注： 10 pages, 8 figures, 5 tables. Published in IEEE Access

点击查看摘要

3. 【2607.29274】Language Models Agree With Each Other, Not With Readers

链接：https://arxiv.org/abs/2607.29274

作者：Kazuki Nakayashiki,Keisuke Watanabe

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

关键词：human judgements collected, language models homogenise, judgements collected, instruction is running, human

点击查看摘要

Subjects:

Information Retrieval (cs.IR); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

Cite as:
arXiv:2607.29274 [cs.IR]

(or
arXiv:2607.29274v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.29274

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Kazuki Nakayashiki [view email] [v1]
Fri, 31 Jul 2026 10:44:10 UTC (217 KB)

4. 【2607.29241】RecHarness: A Bandit-Routed Agentic Harness for Self-Evolving Recommender Systems

链接：https://arxiv.org/abs/2607.29241

作者：Haoran Ling,Yuecheng Li,Zeyu Song,Jing Yao,Shuwen Kang,Chi Lu,Wenjin Wu,Peng Jiang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Optimizing modern recommender, engineers manually iterating, Optimizing modern, modern recommender models, iterating over architectural

备注： 9 pages, 2 figures

点击查看摘要

5. 【2607.29213】GALA: Generative Aligned Learning for Adaptive Multimodal Representation in the Taobao Shangou Recommender System

链接：https://arxiv.org/abs/2607.29213

作者：Jiping Liu,Zhongmin Zhang,Zisen Sang,Zhijia Fang,Tao Ouyang,Ma Jiang,Shaopeng Liang,Zeyang Hou,Guodong Cao,Jia Jia

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：Modern recommender systems, modalities remains challenging, food delivery increasingly, delivery increasingly leverage, heterogeneous modalities remains

备注： 13 pages, 12 figures, 5 tables. Accepted at the 2026 IEEE International Conference on Data Engineering (ICDE 2026), Industry and Applications Track

点击查看摘要

Abstract:Modern recommender systems in food delivery increasingly leverage multimodal signals, including images, text, and user interaction histories, to enhance user experience, yet effective fusion of these heterogeneous modalities remains challenging, hindering both the joint modeling of multimodal signals and adaptation to evolving user intent. In mainstream two-stage approaches, the separation between content-semantic pretraining of image-text encoders and behavior-driven ranking models limits alignment between semantic understanding and user behavior patterns. To address these issues, we present GALA, a three-stage pipeline whose core innovation lies in an intermediate "generative RL alignment" stage that constructs multimodal pretraining data from user behavior and refines it via conversion-based rewards, effectively bridging the pretraining-fine-tuning gap to align with downstream objectives. GALA comprises three stages: first, behavior-aware triplet pretraining on query-image-text pairs from search logs to early capture user intent and content preferences; second, a novel intermediate stage that refines multimodal embeddings through reward-driven optimization (GRPO) to dynamically align them with user behavior and bridge the pretraining-fine-tuning gap; and finally, integration of multimodal and ID embeddings via adaptive gating with a hybrid loss, preserving multimodal contributions under long-term ID-dominant training. GALA has been deployed in the production environment at Taobao Shangou, serving over 200 million daily active users. Compared with state-of-the-art (SOTA) methods, it delivers consistent offline gains of +0.12/+0.20 AUC along with better PCOC metrics. Large-scale online A/B tests further report a 0.55 percent increase in order volume, confirming GALA's effectiveness at industrial scale and its robustness across diverse demand patterns.

6. 【2607.29104】Reproducing LightMem: Naive RAG Is Just as Good for Memory Management

链接：https://arxiv.org/abs/2607.29104

作者：Yongjie Zhou(1),Shuai Wang(1),Bevan Koopman(1 and 2),Guido Zuccon(1 and 3) ((1) The University of Queensland, (2) CSIRO, (3) Google)

类目：Information Retrieval (cs.IR)

关键词：Long-term conversational agents, previously mentioned facts, conversational agents require, agents require access, Long-term conversational

备注： Code: [this https URL](https://github.com/ielab/Reproducing-LightMem)

点击查看摘要

Abstract:Long-term conversational agents require access to information from earlier interactions, such as a user's preferences, past requests, or previously mentioned facts. Repeatedly providing the full dialogue history can be expensive as conversations grow, so many memory approaches instead transform past interactions into compact entries that can be retrieved when needed. LightMem is a recent lightweight memory-management approach that reports strong effectiveness while maintaining relatively low construction cost. However, it still relies on a separate constructed memory representation and is evaluated with only one retriever, leaving unclear how sensitive its results are to retriever choice and whether memory construction discards answer-relevant information. In this study, we reproduce LightMem and compare it with Naive RAG, which retrieves directly from raw user turns. We recover LightMem's main configuration trend, but find that retriever choice is a major source of performance variation: changing only the retriever over a fixed LightMem store shifts answer accuracy from 58.1% to 75.5%. Constructed memories also do not consistently outperform raw-turn retrieval. Naive RAG generally performs better at matched retrieval depths, whereas LightMem performs better mainly under tight answering-token budgets. Oracle evaluation further shows that memory construction removes some answer-relevant information. Overall, LightMem offers a context-efficiency trade-off rather than a general advantage over Naive RAG. Its value depends on the retriever and available token budget, motivating future work on retrieval, reranking, query formulation, and their interaction with raw and constructed memory representations.

Comments:
Code: this https URL

Subjects:

Information Retrieval (cs.IR)

Cite as:
arXiv:2607.29104 [cs.IR]

(or
arXiv:2607.29104v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.29104

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

7. 【2607.29019】GoldenRetriever: Non-Interactive Homomorphic Encrypted Retrieval for Privacy-Preserving RAG

链接：https://arxiv.org/abs/2607.29019

作者：Yang Gao,Gang Quan,Scott Piersall,Qian Lou,Dongdong Wang,Liqiang Wang

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：enhances large language, incorporating external knowledge, raising significant privacy, significant privacy concerns, Retrieval-Augmented Generation

备注： 10 pages

点击查看摘要

8. 【2607.29010】EvoReason: Self-Evolving Reasoning Primitive-Guided On-Policy Distillation for Latent Reasoning in Generative Recommendation

链接：https://arxiv.org/abs/2607.29010

作者：Zhuang Zhuang,Zhipeng Wei,Rongfeng Guo,Shijie Li,Peng Zhao,Jie Chen,Fei Pan

类目：Information Retrieval (cs.IR)

关键词：Generative recommendation benefits, latent reasoning, reasoning, compact continuous representations, encoding intermediate reasoning

备注：

点击查看摘要

Abstract:Generative recommendation benefits from reasoning-enhanced inference, and latent reasoning offers an efficient paradigm by encoding intermediate reasoning processes into compact continuous representations for latency-sensitive deployment. Despite its efficiency, existing latent reasoning approaches typically rely on directly distilling raw chain-of-thought (CoT) trajectories into latent representations, assuming that textual reasoning traces provide sufficient supervision. However, recommendation reasoning trajectories contain diverse reasoning processes with redundant expressions and unstable reasoning paths, making raw CoT supervision suboptimal for learning transferable latent reasoning representations. To address this challenge, we propose EvoReason, a self-evolving latent reasoning framework that adaptively aligns explicit reasoning supervision with the student's latent reasoning space through primitive-guided on-policy distillation. First, EvoReason extracts reusable reasoning primitives from high-quality agentic recommendation trajectories, where each primitive captures an essential reasoning behavior and serves as a pseudo-tool for structured teacher reasoning. Then, based on these primitives, we equip the teacher with primitive-aware reasoning capabilities, enabling it to generate structured CoT supervision with reduced redundancy and improved consistency. Finally, during latent reasoning optimization, EvoReason introduces a self-evolving on-policy distillation mechanism, where the primitive-guided reasoning process evolves according to the student's latent reasoning outcomes. Through this closed-loop co-evolution, policy updates continuously improve latent reasoning behaviors is refined according to the resulting latent reasoning outcomes, enabling progressively better-aligned CoT supervision and more effective reasoning transfer.

9. 【2607.29000】PaletteID: Prototype-Composed Semantic Identifiers for Multimodal CTR Prediction

链接：https://arxiv.org/abs/2607.29000

作者：Huanyu Liu,Baining Chen,Hui Liu,Zengyang Li,Ziyi Huang

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：effectively alleviate item, alleviate item cold-start, click-through rate, accuracy of click-through, effectively alleviate

备注：

点击查看摘要

Abstract:Multimodal information can improve the accuracy of click-through rate (CTR) prediction and effectively alleviate item cold-start and long-tail problems. Recent studies commonly discretize pretrained multimodal embeddings into semantic identifiers (SIDs), allowing the model to learn task-specific semantic representations for recommendation. However, existing methods still provide limited gains due to two major limitations. First, codebook assignment fails to preserve semantic relevance and discards fine-grained continuous signals in the original embedding space. Second, the residual code paths are highly dependent on prefix codes, which limits the effective representational scalability of hierarchical identifiers. To address these issues, we propose PaletteID (PID), a prototype-based semantic identifier. Inspired by palette-based color composition, PID uses a compact set of representative prototype items as semantic anchors to bridge pretrained multimodal content space and recommendation models. Specifically, we first construct a prototype palette with Semantic Quality-Aware Determinantal Point Process (SQ-DPP), which jointly considers local content density and global semantic diversity. Then, for each target item, PID retrieves a sequence of semantically related prototypes and aggregates them into an informative PID representation, enabling rich and complementary semantic modeling. Extensive experiments on two public datasets demonstrate that PID consistently improves CTR prediction and yields larger gains for long-tail items. PID also produces more robust identifier assignments and provides more interpretable token semantics than existing residual SID methods.

10. 【2607.28997】hink2Go: Generative Next POI Recommendation with LLM Reasoning

链接：https://arxiv.org/abs/2607.28997

作者：Zhuang Zhuang,Shanshan Feng,Hangwei Qian,Mingqi Yang,Heng Qi,Yanming Shen,Baocai Yin

类目：Information Retrieval (cs.IR)

关键词：provide personalized suggestions, recommendation task focuses, mining user behavioral, task focuses, focuses on mining

备注： Accepted by KDD 2026 Research Track Cycle 1 (Oral presentation)

点击查看摘要

Abstract:Next Point-of-Interest (POI) recommendation task focuses on mining user behavioral preference patterns from historical check-ins to provide personalized suggestions for the next destination. Existing methods primarily rely on shallow contextual information and handcrafted feature interactions to predict the next POI. However, the inherent sparsity and complexity of user mobility patterns limit the computational capacity of non-reasoning models to capture deep intent, while large language models (LLMs) perform suboptimally because they lack a deep understanding of semantic IDs (SIDs) when SIDs are trained separately. To address these limitations, we propose Think2Go, a novel generative next POI recommendation framework, which enhances the model's comprehension of SID representations and explores diverse spatial-temporal patterns via test-time computational scaling. We unify supervised fine-tuning (SFT) and reinforcement learning (RL)-based reasoning within a single architecture, enabling joint optimization of memorization and adaptive reasoning to better retain user behavior patterns while exploring diverse user preferences. To further calibrate policy optimization in adaptive reasoning, we propose two advantage weighting mechanisms that integrate (1) prompt epistemic uncertainty, estimated via kernel density methods to assess the spatial-temporal periodic pattern alignment between queries and user history, promoting increased exploration under high epistemic uncertainty; and (2) reward-informed advantage scaling, captured by normalizing rewards against their maxima to adapt update magnitudes, thereby improving training stability and mitigating overfitting to noisy signals. This joint calibration forms an implicit curriculum learning strategy, delivering fine-grained, instance-aware policy updates that prevent entropy collapse and support robust exploration.

11. 【2607.28971】Don't Contrast the Impossible: Region-Constrained Batching for Contrastive User Modeling on a Local Community Platform

链接：https://arxiv.org/abs/2607.28971

作者：Seungho Han,Byeongchang Kim,Jin Yu

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：large-scale recommender systems, implicitly assume universal, assume universal exposure, standard in-batch negatives, in-batch negatives implicitly

备注： Accepted at SIGIR 2026 (Industry Track)

点击查看摘要

Abstract:Contrastive learning is widely used for user modeling in large-scale recommender systems, where standard in-batch negatives implicitly assume universal exposure that any user can be shown any item. On local community platforms such as Karrot, however, exposure is geographically constrained; many user-item pairs are impossible by design yet still treated as negatives during training, diluting the contrastive learning signal. We address this impossible negatives problem and propose Region-Constrained Batch Sampling (RCBS), a simple yet effective batching method that constructs region-homogeneous mini-batches so that users are contrasted primarily against items they could feasibly see. By replacing impossible negatives with feasible ones, RCBS naturally introduces harder and more informative negatives under realistic exposure constraints. With offline evaluations and online A/B tests, we show that RCBS consistently improves user representation quality and consequently enhances home feed ranking, retrieval, and display ads ranking. The resulting user embeddings have been deployed in production across various applications.

12. 【2607.28940】ransX: Scaling Transformer-based Recommendation via Behavioral and Serving Stream Crossings

链接：https://arxiv.org/abs/2607.28940

作者：Da Xu,Liyan Fang,Divya Venugopalan,Sunny Hsu,Xukai Wang,Rishav Roy Chowdhury,Cindy Liang,Nishant Satya Lakshmikanth

类目：Information Retrieval (cs.IR)

关键词：increasingly adopt Transformer-based, Modern industrial recommender, adopt Transformer-based sequence, Modern industrial, adopt Transformer-based

备注：

点击查看摘要

Abstract:Modern industrial recommender systems (RecSys) increasingly adopt Transformer-based sequence models, with an emerging paradigm that frames recommendation as next-token prediction over a unified monolithic user sequence. However, collapsing heterogeneous data sources -- such as long-term user behaviors and real-time serving events -- into a single monolithic token stream that obscures their distinct causal roles and temporal characteristics, leading to inefficient modeling and elevated training and serving costs. We propose TransX, a production-oriented encoder-decoder architecture that reformulates recommendation as a sequence-to-sequence action transduction problem. TransX explicitly decouples behavior-stream modeling from serving-event modeling and conditions next-action decoding on scalable cross-attention between nearline behavior encodings and real-time serving representations. To enable low-latency, high-QPS deployment, TransX is co-designed with an amortized serving strategy that combines incremental behavior encoding with per-request key-value caching, rendering serving latency insensitive to behavior sequence length. Extensive offline experiments and large-scale online A/B tests on LinkedIn's recommender systems show that TransX consistently outperforms state-of-the-art DLRMs and sequential baselines, and delivers substantial CTR lift (+6.0%) and conversion gain (+4.4%) while maintaining serving costs comparable to existing production models where our co-designed serving strategy reduces online computation by approximately 80%.

13. 【2607.28895】LLM-Based Generative Retrieval for Snapchat Content Recommendation

链接：https://arxiv.org/abs/2607.28895

作者：Liam Collins,Jiwen Ren,Donald Loveland,Bhuvesh Kumar,Clark Mingxuan Ju,Xuan Guo,Mo Li,Alvin Hou,Yi Cui,Peng Yang,Jian Wang,Saud Afzal Shafi,Nga Than,Ruiming Lu,Wenfeng Zhuo,Dongheng Li,Lili Zhang,Mingtao Zhang,Jinchao Ye,Vincent Xue,Chunhui Zhu,Neil Shah

类目：Information Retrieval (cs.IR)

关键词：Pretrained large language, large language models, promising retrieval engines, rich semantic priors, sequence modeling capabilities

备注：

点击查看摘要

Abstract:Pretrained large language models (LLMs) are promising retrieval engines because they combine rich semantic priors, strong sequence modeling capabilities, and favorable scaling behavior. However, turning a pretrained LLM into a generative retriever in production deployment raises several challenges: the model must learn an internal item vocabulary that was absent from pretraining, and generate valid item identifiers under strict latency and cost constraints. We address these challenges through the design and launch of SnapLGR, an LLM-based generative retrieval system for short-video recommendation at Snapchat. The system is built around three main designs. First, we construct semantic identifiers (SIDs) from multimodal item embeddings and enhance them with Personalized PageRank (PPR)-based co-engagement contrastive learning, resulting in improved codebook utilization, reduced collisions, and infused collaborative signal. Second, we use continued pretraining (CPT) to ground the introduced SID tokens before supervised fine-tuning (SFT) on user interaction sequences. Third, we make SnapLGR serving practical through TensorRT-LLM CUDA-backed beam search and a decentralized worker-loop architecture. In a live A/B test, the launched system increased View Time by 0.37%, Time Spent by 0.09%, Deep Sessions by 0.18%, and Deep Sessions Unique User by 0.11% relative to the existing TIGER-style generative retrieval baseline. We then decompose this offline gap under a fixed tokenizer and quantify the gains due to model architecture, scaling, and pretraining. Overall, our deployment shows that successful production SnapLGR requires joint design across representation learning, vocabulary grounding, and efficient training and serving.

14. 【2607.28879】RareSense: Rarity-Aware Similarity Search for Anomaly Retrieval in Transactional Data

链接：https://arxiv.org/abs/2607.28879

作者：Sidahmed Benabderrahmane,Talal Rahwan

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：frequent background attributes, Hamming compare objects, Hamming compare, dominated by frequent, frequent background

备注：

点击查看摘要

Abstract:Similarity search over sparse set-valued data is often dominated by frequent background attributes because classical measures such as Jaccard, cosine, and Hamming compare objects through atomic overlap. IDF (Inverse document frequency) weighting partially reduces this effect but remains atom-wise and cannot explicitly represent informative higher-order co-occurrences. We introduce RareSense, a rarity-aware similarity framework for sparse transactional anomaly data. RareSense mines minimal rare itemsets as intermediate structures, derives reliable rare association rules, maps objects into sparse rare-rule profiles, and compares them using weighted Jaccard similarity. Rule weights combine inverse support, confidence, lift, structural complexity, and stability, so that neighborhoods are determined by shared rare evidence rather than uniform feature overlap. We show that IDF-weighted Jaccard is a restricted singleton case of RareSense, and that the induced distance is a pseudometric on the original objects and a metric over equivalence classes defined by identical rule profiles. Experiments across four benchmark families spanning cybersecurity and general categorical domains show that RareSense attains the highest observed macro-average query-conditioned retrieval performance among the evaluated similarity measures. The statistical analysis indicates significant overall differences, with corrected paired comparisons favoring RareSense over the atomic baselines. The gains remain workload-dependent and are strongest when anomalies share repeatable rare higher-order structure. For global anomaly ranking, RareSense achieves the highest observed macro-average performance while remaining statistically comparable to several strong dedicated detectors.

15. 【2607.28685】Safety, or Just Capability? A Validity Audit of Agent-Safety Benchmarks

链接：https://arxiv.org/abs/2607.28685

作者：Youting Wang,Xiao Han,Dingyan Shang,Yuan Tang,Bowen Liu

类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：Agent-safety benchmarks measure, Agent-safety benchmarks, quoted interchangeably, MMLU and GPQA, Agent-safety

备注：

点击查看摘要

Abstract:Agent-safety benchmarks measure different behaviors, and their scores get quoted interchangeably as an agent's safety. We treat four of them (R-Judge, InjecAgent, AgentHarm, AgentDojo) as measurements to be validated, running each under its official implementation and author-provided scorer on up to 22 models, with MMLU and GPQA measured by us under one protocol as a capability composite. The metric is the first problem. On any binary trace-judgment benchmark scored by $F_1$, an ``always positive'' policy attains $F_1 = 2\pi/(1+\pi)$; on R-Judge that is $0.690$, above five of the 21 models that actually discriminate. The three broad-coverage benchmarks then rank the same 18 models differently, and the trade-off behind that disagreement is a small-panel artifact: R-Judge specificity against AgentHarm safety correlates $-0.64$ at $n{=}7$ and $+0.02$ at $n{=}18$, and a quarter of random size-7 subsets reach $|\rho| \geq 0.5$ around that near-zero value. Held-out validity turns on which outcome you pick. Capability predicts task success ($\rho{=}{+}0.60$) but correlates negatively with misalignment safety ($\rho{=}{-}0.44$, $n{=}21$). On their paired $n{=}20$ panel, the corresponding contrast is $\Delta{=}{-}1.00$ (95% CI $[-1.48, -0.49]$, $p0.001$), and it survives leave-one-organization-out and organization-clustered bootstrap analyses. On an expanded 41-model panel, the misalignment correlation weakens to $-0.16$ (95% CI $[-0.54, +0.22]$) and jailbreak strengthens to $+0.34$, though neither change is significant. \mbox{AgentHarm} shows the strongest held-out association, $\rho{=}{+}0.72$ with three-template jailbreak safety after controlling capability. But both instruments score harmful compliance, so this is evidence of convergent validity rather than general safety. Naming the benchmark, metric, target behavior, and model panel is the minimum a safety claim needs.

计算机视觉

1. 【2607.29684】oward Robust and 3D-Aware RGB-NIR Imaging in the Dark

链接：https://arxiv.org/abs/2607.29684

作者：Muyao Niu,Mingze Ma,Yifan Zhan,Qingtian Zhu,Zhihang Zhong,Wei Guo,Chang Wen Chen,Yinqiang Zheng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Robust low-light imaging, imaging remains challenging, Robust low-light, low-light imaging remains, remains challenging

备注： ACM Multimedia 2026, Codes and Models: [this https URL](https://github.com/MyNiuuu/3DarkFusion)

点击查看摘要

Abstract:Robust low-light imaging remains challenging for the community. Recent studies have explored fusing Near-Infrared (NIR) with noisy RGB to achieve improved enhancement, yet most methods depend on carefully curated training data pairs, with limited robustness under different scenarios. This paper offers a new perspective for RGB-NIR low-light imaging by incorporating 3D-aware neural modeling. Without using clean RGB supervision, a powerful model can be optimized to implicitly fuse extremely noisy RGB observations with NIR cues in 3D space, effectively recovering clean RGB images. The proposed model obviates the requirement for clean RGB data collection, generalizes across different noise levels. Extensive evaluations on synthetic and real data demonstrate its superiority. Codes available: this https URL

2. 【2607.29679】Scaling Properties of Text Conditioning in Visual Generation

链接：https://arxiv.org/abs/2607.29679

作者：Zilong Chen,Chaorui Deng,Kunchang Li,Hongyi Yuan,Haoqi Fan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：study empirical scaling, visual generation, empirical scaling properties, converged diffusion loss, study empirical

备注： Code: [this https URL](https://github.com/heheyas/context-scaling) Models: [this https URL](https://huggingface.co/collections/heheyas/context-scaling) Demo: [this https URL](https://heheyas-context-scaling.hf.space/) Project page: [this https URL](https://heheyas.github.io/context-scaling)

点击查看摘要

Abstract:We study empirical scaling properties for text conditioning in visual generation. Such properties have rarely been measured because diffusion loss does not scale with the number of tokens in natural-language prompts. Surprisingly, we find that the converged diffusion loss scales with the amount of structured language in the prompt. To quantify structured language, we adapt two complementary measures: a white-box likelihood metric (GPG) and a black-box attribute metric (ED). Across controlled training runs, the converged diffusion loss decreases approximately linearly with GPG and follows a power law with ED. Guided by these scaling properties, we improve \emph{diffusability} by constructing structured prompts with semantic and geometric annotations derived from images, and improve \emph{promptability} by training a prompter through supervised fine-tuning, cold-start, and verifier-gated on-policy distillation. The resulting system outperforms all evaluated open-weight models on nearly every compositional, reasoning, and world-knowledge benchmark, while matching or surpassing the strongest closed-weight models on most evaluations.

3. 【2607.29638】HierDoc: Hierarchical Page-to-Region Evidence Routing for Long-Document Visual Question Answering

链接：https://arxiv.org/abs/2607.29638

作者：Rongjian Gu,Wengang Zhou,Junyu Xiong,Yonghui Wang,Bing Yin,Bei Wang,Houqiang Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multi-page document visual, visual question answering, question answering requires, answering requires locating, requires locating sparse

备注： 15 pages, 4 figures; includes supplementary material

点击查看摘要

Abstract:Multi-page document visual question answering requires locating sparse evidence at both the page and region levels. Existing approaches typically emphasize one level over the other: page-centric methods focus on page acquisition, with region operations serving mainly as navigation aids, whereas region-centric methods assume that the relevant pages have already been supplied. Consequently, page and region selection remain disconnected rather than forming successive evidence decisions. We propose HierDoc, a hierarchical evidence-routing framework that formulates long-document evidence acquisition as two-stage set prediction from pages to regions. A page policy selects evidence pages from the full document; these pages are then parsed for semantic elements, after which a region policy selects the elements passed to a downstream answer model. Both answer-agnostic policies are optimized with stage-wise GRPO using granularity-specific structured-set rewards. The answer model receives selected full pages together with selected region crops and OCR or table text, preserving global context while emphasizing fine-grained evidence. Across the evaluated benchmarks, HierDoc achieves state-of-the-art or competitive performance among open-weight systems, improving LongDocURL by 16.87% relative to the strongest reported open-weight baseline. Controlled ablations further show that selected regional evidence improves the page-only system in accuracy and F1 by 5.51% and 4.82%, respectively. These results demonstrate the benefit of organizing coarse page routing and fine-grained region routing as successive, separately optimized stages of a unified evidence-acquisition process.

4. 【2607.29637】CodeShrink: Adaptive Visual Compression for Efficient Multimodal Code Understanding

链接：https://arxiv.org/abs/2607.29637

作者：Wenxin Tang,Jingyu Xiao,Zhenyu Liu,Zipeng Xie,Junliang Liu,Wang Luo,Yuan Jiang,Yintong Huo,Michael Lyu

类目：Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE)

关键词：Large Language Models, Multimodal Large Language, Large Language, Language Models, Multimodal Large

备注：

点击查看摘要

Abstract:Rendering source code as images offers a promising way to reduce the input costs of Multimodal Large Language Models (MLLMs). Adjusting image resolution can trade visual token cost against content fidelity. However, resolution scaling alone overlooks two sources of inefficiency: blank regions created by line breaks and indentation, and code regions irrelevant to the current instruction. Moreover, the best compression setting varies across inputs, tasks, and models, limiting fixed-ratio strategies. We propose CodeShrink, an adaptive visual compression framework with three components. Blank-Free Rendering replaces whitespace-dependent layouts with compact layouts and explicit structural markers, removing layout-induced tokens. Adaptive Compression Configuration uses a lightweight agent trained with reinforcement learning to predict a per-input setting that balances token efficiency and readability. Dominant Token Selection jointly analyzes the instruction and code image to prune task-irrelevant visual tokens during inference. We evaluate CodeShrink on code question answering, clone detection, and code completion. CodeShrink reduces visual token use by up to 71.2\% while matching or exceeding uncompressed text-only inputs, and consistently outperforms text-based and visual compression baselines across all three tasks. These results show that combining layout compaction, adaptive configuration, and instruction-aware pruning can make multimodal code understanding more efficient. Our code is available at this https URL.

5. 【2607.29633】OASIS: Occlusion-aware Single-image Hand Avatar Reconstruction via 3D Gaussian Splatting

链接：https://arxiv.org/abs/2607.29633

作者：Zhisheng Han,Shiyao Wu,Jiayan Qiu,Yakun Ju,Lu Liu,Le Zhang,Pengfei Feng,Huiyu Zhou,Zheheng Jiang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：complex pose-dependent deformation, hand avatar reconstruction, single-image hand avatar, fundamentally ill-posed, due to limited

备注： Accepted to ACM Multimedia 2026. Project page: [this https URL](https://mova-hand.github.io/MOVA/) . Code repository: [this https URL](https://github.com/ivyyy77/OASIS)

点击查看摘要

Abstract:Single-image 3D hand avatar reconstruction is fundamentally ill-posed and particularly challenging due to limited visual evidence under severe self-occlusion and the complex pose-dependent deformation of highly articulated hands. Existing methods predominantly rely on implicit NeRF-style representations, whose volumetric fitting is computationally expensive and often struggles to preserve fine-grained hand details. In this work, we present OASIS, a tailored 3D Gaussian Splatting framework for single-image hand avatar reconstruction. To faithfully encode sparse image-specific appearance cues in single-view reconstruction, we construct geometry-aligned visual evidence tokens by explicitly aligning input image observations with 3D hand geometry and context-adaptively tokenizing the resulting visual evidence. Since severe self-occlusion makes the reliability of image evidence inherently visibility-dependent, we introduce a visibility-conditioned point-image attention to reliably transfer visual evidence to geometric tokens, yielding occlusion-aware Gaussian features for faithful and robust reconstruction. To further capture non-rigid deformation of articulated hands, we introduce a Feature-on-Mesh representation to enable Gaussian deformation to be guided by local surface stretching. Under this framework, we adopt a one-shot adaptation scheme that learns a shared hand prior from multi-identity training data and then fits it to a target image for target-specific reconstruction. Extensive experiments show that OASIS outperforms existing baselines in both visual fidelity and efficiency across challenging poses and in-the-wild scenarios, and further demonstrates strong versatility in downstream applications such as text-to-avatar generation and texture editing.

6. 【2607.29627】FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Control

链接：https://arxiv.org/abs/2607.29627

作者：Songchun Zhang,Sitong Guo,Xianghao Kong,Pengwei Liu,Yuwei Guo,Lvmin Zhang,Anyi Rao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：involves inserting external, inserting external assets, external assets seamlessly, existing video sequences, involves inserting

备注： 30 pages, 10 figures

点击查看摘要

Abstract:Generative video compositing, which involves inserting external assets seamlessly into existing video sequences, is essential for content creation and visual effects. However, existing approaches suffer from a control-fidelity trade-off: they either hallucinate motion from static images, failing to preserve the dynamics of pre-animated assets, or lack fine-grained spatial control for precise asset placement along user-defined trajectories. We propose FlexComposer, a unified framework that standardizes video compositing as a trajectory-guided conditional generation task, enabling the seamless integration of both static images and dynamic footage. Our approach introduces three key designs: (1) a Unified Canonical Foreground Representation that decouples an object's intrinsic motion from its global displacement, standardizing heterogeneous inputs into a stabilized, centered latent space; (2) a Spatial-Aware Latent Injection strategy that exploits the translation equivariance of VAE latent spaces to transport canonical features onto target trajectories via a parameter-free mechanism; and (3) a Hybrid Dataset and Synthetic-to-Real Curriculum that synergizes procedural simulation, real-world cinematic footage, and generative data to implicitly learn physically plausible illumination and shadow harmonization. This unified design handles diverse inputs from product photos to dynamic subjects achieving high-fidelity motion control and environmental integration without the need for explicit 3D reconstruction or auxiliary learnable adapters. Extensive experiments demonstrate that FlexComposer outperforms state-of-the-art methods in visual quality, temporal consistency, and trajectory adherence.

7. 【2607.29622】RayViT: Ray-Conditioned Visual Representations for Viewpoint-Robust Imitation Learning

链接：https://arxiv.org/abs/2607.29622

作者：Qian Wang,Longrui Chen,Peiran Sun,Aleksandar Taranovic,Niklas Freymuth,Ge Li,Weiran Liao,C. F. Maximilian Nagy,Yucheng Tan,Tao Chen,Gerhard Neumann

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Visual imitation learning, RGB observations lack, explicit geometric cues, making learned policies, imitation learning enables

备注：

点击查看摘要

Abstract:Visual imitation learning enables robots to acquire visuomotor skills directly from images, yet RGB observations lack explicit geometric cues, making learned policies brittle to camera perturbations. To address this, we propose \textbf{Ray-conditioned Vision Transformer Encoder (RayViT)}, a lightweight architecture that injects camera geometry into pretrained ViT backbones. RayViT represents camera geometry as a Plücker ray map, patchifies it into ray features, and uses gated cross-attention to produce a ray-conditioned class token. These ray features are added as dense positional embeddings, while the ray class token replaces the original ViT class token to provide a geometry-aware summary representation. We combine this approach with an auxiliary cosine similarity loss to consistently improve the performance and robustness for geometry-aware tokens. Experiments on sim- and real-robot tasks demonstrate that RayViT improves robustness by approximately 13 percentage points under camera perturbations in multi-task RoboCasa benchmark and by 1.78 average completed stages in real-world multi-task success rate compared to baselines.

8. 【2607.29614】A Human-Centered Validation of the Explainability-Performance Coefficient

链接：https://arxiv.org/abs/2607.29614

作者：Christian Oliva,Luis F. Lago-Fernández

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Explainable Artificial Intelligence, trustworthy Explainable Artificial, Artificial Intelligence, Explainable Artificial, deep learning models

备注：

点击查看摘要

Abstract:The rapid adoption of deep learning models in high-risk domains has intensified the need for trustworthy Explainable Artificial Intelligence (XAI). However, objectively evaluating explanation fidelity and aligning XAI metrics with human-centered understanding remain critical open challenges. In this work, we propose a model-agnostic metric, the EPC score, which is an extension of the Explainability-Performance Coefficient (EPC), that quantifies explanation quality by explicitly balancing the trade-off between feature selection sparsity and preserved model performance. Through an empirical validation across tabular, text, and image modalities, we show that the EPC score effectively uncovers operational dependencies among network activations, data dimensionality, and explainer performance. Furthermore, we validate the EPC score against independent human-based explanations, proving that higher EPC scores strongly align with human lexical sentiment judgments and spatial visual annotations.

9. 【2607.29613】WCM: A World Critic Model for Vision-Language-Action Reinforcement Learning

链接：https://arxiv.org/abs/2607.29613

作者：Senyu Fei,Xiaopeng Yu,Siyin Wang,Xianzhong Zhao,Jingjing Gong,Xipeng Qiu

类目：Robotics (cs.RO); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：shown strong promise, Reinforcement learning, promise for robotic, Reinforcement, single-frame VLM backbone

备注：

点击查看摘要

10. 【2607.29602】FriendBench: Benchmarking Dyadic Familiarity Inference in Humans and Multimodal Large Language Models

链接：https://arxiv.org/abs/2607.29602

作者：Jeffrey M. Girard,Jason Z. Zheng,Jacqueline R. Vertino,Antony D'Avirro,Benjamin Peloquin

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：Reading a social, social situation, situation often depends, Reading, dyadic ice-breaker conversation

备注： 15 pages, 3 figures

点击查看摘要

11. 【2607.29596】FibVLA: An Efficient Temporal Vision-Language-Action Model with Fibonacci Sampling

链接：https://arxiv.org/abs/2607.29596

作者：Li Lin,Wujun Xu,Weiwei Meng,Kaiwen Xia,Kang Hao Cheong,Shuai Wang

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：infer physical-world actions, provide a generalized, embodied AI applications, infer physical-world, generalized solution

备注：

点击查看摘要

Abstract:Vision-language-action models (VLAs), which leverage the cognition of multimodal information to infer physical-world actions, provide a generalized solution for embodied AI applications. Conventional VLAs usually concentrate on current digital cognition. While some efforts are made to enhance VLAs' reasoning capabilities by capturing temporal information, encoding the long-context history causes an efficiency-decreasing issue. To reconcile the conflict between capturing temporal information and maintaining inference efficiency in VLAs, this paper introduces FibVLA, an efficient framework featuring temporal perception of long-context history. Specifically, we leverage logarithmic hindsight sampling to both proprioceptive states and visual frames to capture long-term temporal dependencies with minimal redundancy. For the action expert, we introduce the flow matching to produce action distributions, and the Fibonacci recurrent inference strategy to generate long-range planning steps based on real-time closed-loop feedback. Experiments demonstrate that FibVLA significantly improves action smoothness and success rates without retraining large-scale visual encoders. Efficiency analysis demonstrates superior real-time responsiveness compared to video-based baselines in real-world evaluations.

12. 【2607.29595】CoDe-SSM: Context-Detail Decoupled State Space Model for Efficient UHD Image Restoration

链接：https://arxiv.org/abs/2607.29595

作者：Jiaxu Su,Zhijian Wu,Jun Li,Bo Zhang,Yefeng Zheng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：localized image structures, spatially recurring degradation, recurring degradation cues, localized image, image structures

备注：

点击查看摘要

Abstract:Ultra-high-definition (UHD) image restoration must balance the aggregation of spatially recurring degradation cues with the preservation of localized image structures. Compact aggregation can reduce redundant processing but may attenuate edges, textures, and other fine structures. Existing approaches manage UHD restoration cost through downsampling, window partitioning, or cluster-based token reduction; yet many of them do not explicitly retain information that is poorly represented by shared aggregation. In this study, we propose a Context-Detail Decoupled State Space Model (CoDe-SSM) for UHD restoration, which processes aggregated context and clustering residuals in separate pathways. The context modeling pathway, implemented by the Global Cluster Scan Module (GCSM), aggregates features into $K$ input-dependent cluster centers and applies selective SSM reasoning over the resulting fixed-order sequence, enabling cross-region context sharing while decoupling computational cost from spatial resolution. The detail recovery pathway, implemented by the Local High-Frequency Module (LHFM), processes the clustering residual with an input-derived high-frequency mask and a sparse mixture of convolutional experts. Extensive experiments on five UHD benchmarks and five degradation types demonstrate that our explicit context-detail decoupling strategy yields substantial gains in restoration quality while maintaining desirable efficiency.

13. 【2607.29592】OOD: Task-Aware Out-of-Distribution Score Calibration for Continual Learners

链接：https://arxiv.org/abs/2607.29592

作者：Mostafa ElAraby,Samer B. Nashed,Liam Paull

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：OOD detection, primary challenge, remaining performant, performant on previously, OOD

备注： 21 pages, 9 figures, and 4 tables. Accepted for oral presentation at the Conference on Lifelong Learning Agents (CoLLAs 2026)

点击查看摘要

Abstract:The primary challenge of continual learning (CL) systems is to learn new tasks while remaining performant on previously learned tasks. A similarly important though less well-studied aspect of CL systems is their ability to distinguish inputs that are unlikely to come from within the set of tasks the system has already encountered, often called out-of-distribution (OOD) detection. This paper presents several findings related to the dynamics of OOD detection in CL systems, causes of performance degradation over time which we call OOD forgetting (OODF), and proposed mitigation strategies for this degradation. Chiefly, we find the unintuitive result that OODF is only weakly anti-correlated with classification performance on previous tasks, suggesting that the underlying mechanisms producing OODF are distinct. Moreover, this effect is observed for both energy-based and feature-based OOD detection methods. Energy-based detectors suffer a drop in logit scale as additional tasks are learned, which we term the Confidence Gap, while feature-based detectors also degrade under a complementary effect we call Manifold Crowding. Motivated by these observations, we propose TOOD, a training-free post-hoc method that decomposes logits into per-task energy scores and re-calibrates them using replay-buffer statistics. Experiments on CIFAR-10, CIFAR-100, and a 100-task ImageNet-1K stream show that TOOD improves OOD detection performance over uncalibrated energy in most settings and ranks first or second in nine of ten CIFAR configurations, with the largest gains when the confidence gap is most severe. These results suggest that a substantial portion of OOD deterioration in continual learning arises from score miscalibration rather than from a complete loss of discriminative structure.

14. 【2607.29586】raceViT: Grounded Trace Supervision for Visual Abstract Reasoning

链接：https://arxiv.org/abs/2607.29586

作者：Binnan Liu,Yechi Ma,Tian Xie,Wei Hua

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Reasoning Corpus, Abstraction and Reasoning, infer an unseen, ARC, Corpus

备注：

点击查看摘要

Abstract:The Abstraction and Reasoning Corpus (ARC) tests whether a model can infer an unseen transformation from a few input-output examples and apply it to a new grid. Looped visual reasoners refine predictions over multiple iterations, but conventional training constrains only the final output, leaving intermediate refinements unconstrained. We propose that these refinements should instead follow the transformation step by step. We introduce TraceViT, a looped visual reasoner trained with semantically monotonic transformation chains. We obtain these chains by rewriting and verifying programmatic task implementations, decomposing each solution into intermediate grid states. Each iteration is grounded by a task reference derived from the few-shot demonstrations and an object workspace representing the current grid state. Because these chains may differ in length from the loop, soft trace alignment enforces only their ordering, letting the model allocate iterations freely. TraceViT achieves 67.8% pass@2 on ARC-AGI-1 and 24.3% on ARC-AGI-2. Controlled ablations on ARC-AGI-1 show that trace supervision becomes beneficial only when paired with grounding. Code and data will be available at this https URL.

15. 【2607.29581】Explaining AI-Image Detection: What the Heatmap Actually Shows

链接：https://arxiv.org/abs/2607.29581

作者：Leonid Kuturin,Ilya Sotnikov,Mark Khusnutdinov,Mikhail Potemkin,Pavel Baranas,Aleksandra Korepanova,Alexander Kalashnikov

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：platforms approve refunds, marketplace review photograph, generative models drove, platforms approve, marketplace review

备注： 8 pages of main text; 27 pages including references and appendix. 9 figures, 21 tables

点击查看摘要

Abstract:A marketplace review photograph is a document: platforms approve refunds on it, and generative models drove the cost of forging one to zero. We study that detection problem, so we build a detector and attach an attribution map as its evidence, then measure what that pair delivers on 186,527 images under controls designed to change our conclusions when something is wrong. Compression history, not synthesis, drives naive evaluation: our strongest model reaches 0.9999 PR-AUC (area under the precision-recall curve) on a product-disjoint split, yet falls to 0.7254 once we re-encode synthetics into the real class's format, while five public detectors move by at most 0.07. Aligning one class relocates the cue rather than removing it, and the repaired model then assigns native files a median probability of synthesis of 0.0004. One identical final encode for both classes repairs that, and a three-seed factorial credits the encoding change with the whole gain (+0.176 +- 0.009 PR-AUC). That encode equalises the last stage only: forensic features alone still separate the classes at 0.7145 against a base rate of 0.254. For evidence we test maps causally, against controls that never consult the detector. Whether an attribution ranking exists at all depends on whether the detector reacts to the image. On our first-fix detector, which calls 96 of 100 edited frames real, no map beats a random one. On the detector we selected, twelve of seventeen maps clear that control on edited images and eight on generated ones; perturbation leads both axes and no gradient-CAM variant shows a positive advantage. The trivial controls never clear it, and on generated images the centre prior is worse than random. Our ensembled regional map clears both axes and takes the top pixel AP at 12.4 s per map against 44.9 for occlusion. Clearing a detector-blind control is not yet a faithful explanation, and we demonstrate none.

16. 【2607.29568】DynoDINO: Harnessing Dynamic Latent Information from DINO Features for Multi-Phase Medical Image Segmentation

链接：https://arxiv.org/abs/2607.29568

作者：Yu-Pu Hsu,Jen-Jee Chen,Yu-Chee Tseng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Contrast-Enhanced Computed Tomography, Computed Tomography, Multi-phase Contrast-Enhanced Computed, Contrast-Enhanced Computed, capturing temporal enhancement

备注： 21 pages, 8 figures, 14 tables

点击查看摘要

Abstract:Multi-phase Contrast-Enhanced Computed Tomography (CECT) plays a central role in the diagnosis and characterization of focal lesions by capturing temporal enhancement patterns across multiple acquisition phases. Accurate lesion segmentation from such data remains challenging because clinically relevant contrast kinetics are distributed across phases, while anatomical inconsistencies, respiratory motion, and incomplete acquisitions often lead to inter-phase misalignment and interrupted temporal information. Conventional segmentation frameworks typically process each phase independently or rely on simple fusion strategies, limiting their temporal reasoning capability. To address these challenges, we propose DynoDINO, a unified framework tailored to address the core challenges of multi-phase medical image segmentation. DynoDINO first performs slice-level alignment to establish inter-phase anatomical correspondence and then employs a Multi-phase Fusion Model to jointly enhance temporal correlations across phases. Our fusion model incorporates a Mix-attention (MA) mechanism for efficient multi-phase feature calibration and an Adaptive Gating Mechanism with difference-based residual learning to selectively preserve diagnostically relevant contrast variations while suppressing artifacts caused by residual misalignment. In addition, the adaptive gating mechanism improves training stability by preventing feature degradation caused by unguided subtraction operations. Experiments on three large-scale datasets, including LiTS, PLC-CECT, and WAW-TACE, demonstrate that DynoDINO consistently improves boundary delineation and structural fidelity under standard, shifted, and missing-phase conditions.

Comments:
21 pages, 8 figures, 14 tables

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.29568 [cs.CV]

(or
arXiv:2607.29568v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.29568

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

17. 【2607.29545】MoRoute: Dynamic Routing for In-Context Multimodal Video Generation

链接：https://arxiv.org/abs/2607.29545

作者：Chong Gao,Jie Ma,Zhan Peng,Chongxiao Wang,Haoxue Wu,Jun Liang,Guanbin Li,Jing Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：share complementary data, edit videos conditioned, allowing diverse tasks, combinations of text, generative priors

备注： Project page: [this https URL](https://orange-3dv-team.github.io/MoRoute/)

点击查看摘要

Abstract:Multimodal video generation aims to generate and edit videos conditioned on arbitrary combinations of text, images, and videos within a single model, allowing diverse tasks to share complementary data and generative priors. Unifying these tasks requires multimodal understanding of diverse conditions, which is typically provided by a pretrained vision-language model (VLM). A key challenge is how to connect the VLM's hierarchical multimodal representations with a pretrained video diffusion transformer (DiT). Existing methods either inject features from only the final or a few manually selected VLM layers, or jointly train architecture-matched understanding and generation streams, making it difficult to reuse heterogeneous pretrained backbones. We introduce MoRoute, a unified multimodal video generation framework that formulates a frozen VLM and a pretrained video DiT with different architectures as heterogeneous experts connected through dynamic layer routing. For each input, a lightweight block-wise router enables every DiT block to select the VLM layer most relevant to its generation stage, thereby learning an adaptive correspondence between multimodal understanding and video synthesis. MoRoute further incorporates reference images and source videos directly into the DiT token sequence through unified in-context conditioning, preserving fine-grained visual details across diverse generation and editing tasks. Experiments on IntelligentVBench, OpenVE-Bench, and RefVIE-Bench show that MoRoute consistently surpasses the best competing method on each benchmark, improving the average score by 0.15, 0.18, and 0.34 on a 1-5 scale, respectively.

18. 【2607.29541】he K-Space Signature: Frequency-Domain Representation Learning for Medical Deepfake Detection

链接：https://arxiv.org/abs/2607.29541

作者：Riccardo Raciti,Francesco Guarnera,Francesco Rundo,Luca Guarnera,Sebastiano Battiato

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：synthesize realistic data, augment limited datasets, medical imaging, increasingly deployed, deployed to synthesize

备注：

点击查看摘要

Abstract:In medical imaging, generative models are increasingly deployed to synthesize realistic data and augment limited datasets. Unfortunately, while beneficial for privacy-preserving data sharing, these synthesized images can be repurposed for malicious intents, threatening public health through the creation of Medical Deepfakes. To address this threat, we introduce the K-Space Signature (KSS), a novel forensic framework that isolates hardware and generative traces within the spectral domain. By shifting analysis to the frequency domain, the KSS suppresses macroscopic anatomical variance by subtracting an empirical global anatomical prior computed in the Logarithmic Power Spectral Density (Log-PSD) space. To effectively process these globally distributed spectral artifacts without the local spatial bias inherent to Convolutional Neural Networks, we pair the KSS representation with a novel 3D MLP-Mixer architecture equipped with an ArcFace metric-learning head. Extensive experiments on multi-center 3D MRI datasets demonstrate that this combined approach achieves exceptional detection performance, exceeding 0.99 Accuracy and ROC-AUC on multi-generator synthetic datasets. Furthermore, the framework exhibits robust zero-shot generalization, maintaining strong discriminative power (up to 0.93 Accuracy) on independent datasets acquired from entirely unseen scanners. To ensure full reproducibility, the complete source code and pre-trained models will be made publicly available upon acceptance.

19. 【2607.29533】OSAGEN: Object-Aware Mask Priors and Multistage Decoupled Diffusion for Industrial Anomaly Generation

链接：https://arxiv.org/abs/2607.29533

作者：Jinyi Xu,Peng Chen,Yunkang Cao,Chengliang Liu,Xinghui Dong,Chao Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Industrial anomaly detection, synthetic image-mask pairs, scarce real anomalies, pairs can alleviate, Industrial anomaly

备注：

点击查看摘要

Abstract:Industrial anomaly detection and localization are limited by scarce real anomalies and pixel-level annotations, a bottleneck that synthetic image-mask pairs can alleviate. However, existing few-shot mask-guided generation may over-follow mask geometry, produce weak anomalies, or use condition masks incompatible with the current object instance. We propose OSAGEN, which combines object-aware mask priors with multistage decoupled diffusion. Its three-stage adaptation sequentially learns normal appearance, defect appearance under coarse conditions, and fine-grained mask calibration, improving defect realization and local control. QBG injects object structure from a matched normal image into mask diffusion to produce object-aware priors, while ISC restricts anomaly propagation and preserves normal content during sampling. A lightweight materialization step recovers pixel-level labels aligned with the realized defects. On MVTec AD and VisA, OSAGEN achieves AP-P/F1-P scores of 88.1/82.2 and 68.5/66.1, respectively, under a unified downstream localization protocol. The code will be released upon acceptance.

20. 【2607.29531】Multi-Source Multi-View Graph Domain Adaptation with Hyperbolic Residual Encoding for Cross-Site MDD Identification from rs-fMRI

链接：https://arxiv.org/abs/2607.29531

作者：Zhanpeng Zheng,Xiran Chen,Haiteng Jiang,Renjie Tian,Qinyu Cai,Jiexi Liu,Xiaofeng Chen,Weikai Li,Yansu Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Neurons and Cognition (q-bio.NC)

关键词：resting-state functional magnetic, functional magnetic resonance, major depressive disorder, magnetic resonance imaging, inter-site distribution shifts

备注：

点击查看摘要

Abstract:Cross-site identification of major depressive disorder (MDD) from resting-state functional magnetic resonance imaging (rs-fMRI) is hindered by inter-site distribution shifts and heterogeneous functional connectivity (FC) views. These views capture complementary neural relationships but exhibit distinct site biases and graph topologies, complicating alignment without sacrificing disease-relevant information or cross-view consistency. Existing studies largely treat multi-view connectome learning and cross-site adaptation separately. To the best of our knowledge, few studies have jointly modeled multiple FC views under multi-source unsupervised domain adaptation for cross-site rs-fMRI-based MDD classification. We construct Pearson correlation, sparse representation, and Granger causality graphs, each encoded by a view-specific graph attention network. Dual-stream adaptive fusion explicitly integrates pairwise cross-view interactions, followed by lightweight hyperbolic residual encoding for curvature-aware representation refinement. Class-wise Cauchy--Schwarz alignment reduces inter-source and source-target discrepancies, complemented by adversarial learning, information maximization, and confidence-aware pseudo-labeling. Across seven unlabeled target domains, our framework achieves 73.60% mean accuracy and 71.90% AUC, demonstrating effective generalization under heterogeneous acquisition conditions. These results highlight the effectiveness of unified heterogeneous-view modeling, curvature-aware refinement, and multi-source domain adaptation for cross-site MDD this http URL source code is at this https URL

21. 【2607.29509】Leveraging Transfer Learning with Class-Specific Decoders for Laparoscopic Segmentation

链接：https://arxiv.org/abs/2607.29509

作者：Priya Tomar,Aditya Parikh,Christian Bauckhage,Rafet Sifa

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Effective multi-organ segmentation, Effective multi-organ, limitedly exposed structures, data requires learning, intricate anatomical features

备注： Paper already Published in IEEE Big data 2025

点击查看摘要

Abstract:Effective multi-organ segmentation in surgical data requires learning the intricate anatomical features and alleviating the challenge of class imbalance, which results from relatively lower proportions of small and limitedly exposed structures. Recent works on laparoscopic multi-organ segmentation focus on learning structure-specific features through class-specific decoder architectures and report favorable results. This work extends the decoder-focused architectures to investigate knowledge sharing in the cross-surgical domain. We utilize two datasets representing different surgical domains, rectal and cholecystectomy surgeries, to explore how surgical conceptual knowledge transfers under partially common anatomical representations. Additionally, we compare the feature adaptation for the encoder and decoder at different training stages to analyse the knowledge adaptation and retention in the network. Our results corroborate previous findings on decoder-specific architectures and demonstrate that the organ-specific decoder model (CEMD), fully fine-tuned after cross-domain pre-training, achieves the highest segmentation performance (62.4\% dice) while converging substantially faster than training from scratch. However, we also find that class imbalance in surgical data remains a persistent challenge that transfer learning does not fully resolve for underrepresented anatomical structures.

22. 【2607.29473】Lightweight Neural Networks for Affordance Segmentation: Enhancement of the Decoder Module

链接：https://arxiv.org/abs/2607.29473

作者：Simone Lugani,Edoardo Ragusa,Rodolfo Zunino,Paolo Gastaldo

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Performance (cs.PF)

关键词：deep neural networks, visual affordance segmentation, wearable robots poses, prove critical, deployment of deep

备注：

点击查看摘要

Abstract:The deployment of deep neural networks for visual affordance segmentation on wearable robots poses may prove critical, due to some conflicting aspects of the problem. On one hand, affordance segmentation requires high-level abstraction capabilities, that typically involve large-size models. On the other hand, computing resources hosted on wearable robots prevent to run large-size models in real-time. The paper presents an analysis of the role of the segmentation head in the trade-off between generalization performance and compute cost. The obtained models outperform modern baseline solutions in well-known, real-world datasets while meeting low computing requirements.

23. 【2607.29463】Weight-Space Mixture-of-Experts for Implicit Neural Representation Classification

链接：https://arxiv.org/abs/2607.29463

作者：Stanislaw Janik,Michal Byra

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Implicit Neural Representations, Neural Representations, coordinate-based neural network, coordinate-based neural, Implicit Neural

备注： ECCV 2026, 22 pages

点击查看摘要

Abstract:Implicit Neural Representations (INRs) encode signals as the weights of a coordinate-based neural network and have recently been proposed as an alternative domain for downstream learning. While promising, classification directly in weight space remains challenging due to the high dimensionality and complex structure of INR parameters. Furthermore, the way discriminative information is distributed across INR weights remains poorly understood. We propose a hierarchical Mixture-of-Experts (HMoE) Transformer that processes INR weights using conditional computation aligned with the structure of the underlying implicit network. Coupled with a meta-learning framework that shapes INR parameters for downstream tasks, our model achieves state-of-the-art accuracy across standard benchmarks, ranging from low-resolution datasets to high-resolution ImageNet-1K. To gain insight into how INRs encode discriminative information, we develop weight-space attribution and pruning methods that identify parameters most relevant for classification. These analyses reveal how class-specific structure emerges within INR layers and support the suitability of MoE architectures for weight-space learning. Our approach advances both the performance and interpretability of weight-space classifiers.

24. 【2607.29445】QR-Structured Thermal Triggers for Targeted Semantic Attacks on Infrared Vision-Language Models

链接：https://arxiv.org/abs/2607.29445

作者：Xiang Chen,Yingying Zhao,Chao Li,Jiaju Han,Ben Zhang,Ang Li,Jiahuan Long,Yiwei Wei,Jiujiang Guo,Chengyin Hu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Infrared vision-language models, visual question answering, vision-language models, question answering, extend thermal perception

备注：

点击查看摘要

Abstract:Infrared vision-language models (IR-VLMs) extend thermal perception to open-vocabulary classification, image captioning, and visual question answering. However, their robustness to structured thermal perturbations and the stability of cross-modal semantic alignment remain insufficiently studied. We propose QR-Structured Thermal Triggers (QR-STT), a stealthy, training-free, black-box framework for targeted semantic steering of IR-VLMs. QR-STT preserves the functional regions of a QR pattern while optimizing its internal modules, each of which is assigned a cold, neutral, or hot thermal state. The framework jointly searches module topology and rendering parameters, including position, scale, rotation, intensity, blur, and roundness. A three-stage gradient-free procedure with greedy module-flip refinement efficiently handles the mixed discrete and continuous search space. The objective promotes alignment with an attacker-selected target, suppresses source-class evidence, and regularizes QR structure and visual similarity. Experiments on multiple CLIP-style encoders show that QR-STT consistently redirects image-text alignment toward chosen concepts while maintaining visual stealth. Perturbations optimized for classification also transfer to image captioning and VQA, causing target-consistent semantic drift in generated outputs. These results identify QR-structured thermal patterns as an interpretable attack surface for language-driven infrared perception and highlight the need for robustness evaluation against structured cross-task semantic attacks.

25. 【2607.29412】Role-Break in Attention Heads: Understanding and Detecting Hallucinations in VLMs

链接：https://arxiv.org/abs/2607.29412

作者：Mingyu Wang,Weilin Jin,Wenbo Li,Haoyang Huang,Nan Duan,Tong Jia,Chaoran Luo,Ying Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：vision-language generation, producing content, input image, Vision-Language Models, remarkable progress

备注：

点击查看摘要

Abstract:Despite remarkable progress in vision-language generation, Vision-Language Models (VLMs) remain prone to hallucinations, producing content that is inconsistent with or unsupported by the input image. Existing works largely design detection or mitigation methods around one specific hallucination pattern, such as visual-textual imbalance, but real VLM hallucinations arise from a mixture of multiple patterns, so signals bound to a single pattern struggle to remain stable across models and tasks. Under a unified head-level view, we find that hallucination-induced changes manifest as localized deviations from each head's faithful contextual behavior, a phenomenon we term Role-Break. Detailed analysis reveals that these deviations are systematically organized across attention heads, contextual sources, and deviation directions, and that the resulting signal is linearly readable once head identity is preserved. Based on these findings, we build a lightweight linear detector on top of Role-Break that requires no fine-tuning of the VLM, whose feature dimension stays below 5,000 and reaches an average AUROC of 93.23 across six VLMs and four benchmarks. A small-scale intervention experiment further shows that the detected tokens can be directly acted upon in the discriminative setting.

26. 【2607.29401】OSEF: One-Step Evidence Fusion for Cross-Video Scene Procedure Planning

链接：https://arxiv.org/abs/2607.29401

作者：Zhentong Ye,Lei Zhang,Sijia Zhou,Yingda Yu,Yuehan Shi,Jiaqi Xuan,Shuaiwu Dong,Guanchao Tong,Meimei Zhang,Bin Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Scene Procedure Planning, Video Scene Procedure, Procedure Planning, target start-goal observations, Cross-Video Scene Procedure

备注： 12 pages, 4 figures, with ancillary technical supplement

点击查看摘要

Abstract:Video Scene Procedure Planning (VSPP) supplies the target start-goal observations in advance, leaving open how a planner should act when the evidence must itself be retrieved. We introduce Cross-Video Scene Procedure Planning (CVSPP): given an answer-redacted start-goal query and K candidate videos, a model must retrieve the supporting video, localize the relevant window, and predict the action sequence. Two obstacles couple here. Same-task demonstrations share stages and windows, and an early hard selection passes the wrong scene chain to the planner. We build an eleven-source benchmark with typed negative roles, a fail-closed answer-leakage gate, and separate Evidence- and Plan-axis metrics. On its 14 source-horizon cells we adapt nine planner families against a majority-sequence floor. We then present One-Step Evidence Fusion (OSEF), which scores a query-conditioned cell-and-span lattice over all candidates and feeds the full soft lattice to the planner through a token-global adapter, cropping no window beforehand. OSEF ranks first on all six cells the benchmark certifies as method-rankable. On four matched same-task COIN and CrossTask cells it improves exact-video-and-plan success by 2.9-10.7 points over an enhanced hard-selection SOTA, and a component study assigns the largest single increment to the token-global interface. Five converted-source cells sit at or near the majority-sequence floor, the benchmark's remaining headroom. The supplementary package includes model constructors and evaluation code.

27. 【2607.29394】Dense Temporal Contrast Synthesis via Conditioned Latent Transport

链接：https://arxiv.org/abs/2607.29394

作者：Smriti Joshi,Apostolia Tsirikoglou,Daniel M. Lang,Richard Osuala,Noah Márquez Varaa,Alejandro Guzman,Grzegorz Skorupko,Sebastian Ibarra Arregui,Lidia Garrucho,Akane Ohashi,Dimitra Ntoula,Eugen Divjak,Oğuz Lafcı,Jan C. Peeken,Julia A. Schnabel,Fredrik Strand,Oliver Diaz,Karim Lekadir

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Dynamic contrast-enhanced magnetic, environmental toxicity concerns, contrast-enhanced magnetic resonance, presents environmental toxicity, gadolinium-based contrast agents

备注：

点击查看摘要

Abstract:Dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) is essential for breast cancer management, but reliance on gadolinium-based contrast agents (GBCAs) restricts use in contraindicated populations, prolongs scan protocols, and presents environmental toxicity concerns. Contrast synthesis offers a non-invasive alternative; however, existing approaches struggle to balance spatial realism with temporal continuity, suffer from slow iterative sampling, underutilize structural priors, and lack clinical validation. We propose a novel conditioned latent transport framework that predicts contrast enhancement in a single forward pass. By anchoring the latent trajectory to the pre-contrast anatomy and applying continuous time conditioning, the model synthesizes patient-specific contrast evolution at any acquisition time. The proposed approach outperforms baseline and the state-of-the-art models across spatial, perceptual, temporal, and distributional metrics. Evaluated on an independent external cohort, the method demonstrates robustness to domain shifts induced by scanner noise as well as differing acquisition protocol. Furthermore, our synthetic contrast enhancement significantly improved downstream tumor segmentation performance, yielding a 22.4% relative increase in Dice coefficient (0.60 vs. 0.49 baseline pre-contrast, p 0.01), reducing boundary segmentation error by over 39%, while outperforming all other generative model baselines. Finally, a reader study involving four breast radiologists evaluated the image quality, kinetic fidelity, and diagnostic viability of our synthesized sequences across 40 randomly selected cases. The results demonstrated that in 70% of cases, synthesized images provided sufficient clinical information to support the same management decisions as real DCE-MRI, suggesting a path toward safer and faster contrast-free or contrast-reduced imaging workflows.

28. 【2607.29370】VFAD: Variational Semantic Prompting Meets Frequency-Adaptive Representation Learning for Zero-Shot Anomaly Detection

链接：https://arxiv.org/abs/2607.29370

作者：Peng Chen,Kaige Li,Wei Wang,Mingbo Yang,Wenqiang Wang,Li Shen,Fangjun Huang,Chao Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Zero-shot anomaly detection, target-specific training data, Zero-shot anomaly, aims to detect, training data

备注：

点击查看摘要

Abstract:Zero-shot anomaly detection (ZSAD) aims to detect and localize anomalies in unseen categories without access to target-specific training data. Although recent CLIP-based methods have demonstrated promising generalization through vision-language alignment, they remain limited in capturing diverse anomaly semantics and subtle local variations. To address these limitations, we propose VFAD, a unified framework that combines variational semantic prompting with frequency-adaptive representation learning. Specifically, we introduce a Variational Semantic Prompt Extractor (VSPE), which adaptively aggregates anomaly-relevant local semantics from dense patch tokens and regularizes them through a variational information bottleneck, thereby incorporating fine-grained visual cues and enabling more precise cross-modal alignment. Furthermore, we develop a Frequency-Adaptive Representation Aggregation (FARA) module that leverages wavelet-based frequency decomposition and frequency-specific expert aggregation to enhance anomaly-discriminative visual representations. By jointly strengthening semantic guidance and visual representation learning, VFAD improves both anomaly discrimination and fine-grained localization. Extensive experiments on 13 industrial and medical benchmarks demonstrate that VFAD consistently outperforms existing state-of-the-art ZSAD methods across diverse anomaly scenarios. The code will be publicly available upon publication.

29. 【2607.29367】SatEdit: Mask-Conditioned Image Editing via VLM-Guided Segment Annotation

链接：https://arxiv.org/abs/2607.29367

作者：Muhammad Talha,Muhammad Ahmed Amer

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：precise object-level control, Satellite image editing, requires spatially precise, spatially precise object-level, Satellite image

备注： 14 pages, 5 figures

点击查看摘要

Abstract:Satellite image editing requires spatially precise object-level control, but supervised editing datasets for overhead imagery are costly to build because object masks, semantic labels, and paired edits are rarely available at scale. We introduce SatEdit, a mask-conditioned satellite image editing framework that constructs training supervision from unlabeled imagery. SatEdit proposes object masks with a seg- mentation foundation model, assigns semantic la- bels to sampled segments with a Vision-Language Model, and applies lightweight human verification before generating paired addition and removal exam- ples through mask-guided inpainting. We fine-tune a high-resolution image editing backbone with LoRA on a SODA-A-derived dataset containing 1,014 im- ages and 852 verified object annotations across 91 classes. In controlled comparisons with open- source and proprietary image editing models, SatE- dit achieves the highest aggregate masked-region se- mantic alignment, with a CLIP score of 0.6322 and CLIP delta of 0.0726, while preserving the surround- ing scene qualitatively. These results suggest that VLM-assisted segment annotation is a practical route to data-efficient, spatially controllable satellite image editing.

30. 【2607.29337】DualDiT: A Conditional Dual-Output Diffusion Transformer for Joint OCT Image and Segmentation Mask Generation

链接：https://arxiv.org/abs/2607.29337

作者：Fernando García-Torres,Rocío del Amor,Sandra Morales,Álvaro Barroso,Peter Heiduschka,Björn Kemper,Valery Naranjo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Generating realistic medical, Background and Objective, optical coherence tomography, Generating realistic, anatomically accurate segmentation

备注：

点击查看摘要

Abstract:Background and Objective: Generating realistic medical images with anatomically accurate segmentation masks helps address the shortage of annotated data in medical imaging, particularly in optical coherence tomography (OCT) of mouse eyes, where manual retinal layer delineation is labour-intensive due to tiny structures and required expertise, resulting in scarce datasets. While diffusion models perform well in medical image synthesis, joint image-mask generation has relied mainly on U-Net-based denoisers, leaving diffusion transformers largely unexplored. Methods: We propose a conditional dual-output Diffusion Transformer (DualDiT) for joint synthesis of OCT B-scans and segmentation masks of the upper retinal cell layers in ex vivo mouse retina. DualDiT encodes both modalities into a shared latent space via a pretrained VAE, concatenates their latent representations, and performs conditional diffusion over the joint tensor. We compared DualDiT against two adapted diffusion baselines: DDPM and LDM. Generative quality was assessed via Fréchet Inception Distance (FID) and spatial FID (sFID); practical utility via synthetic data augmentation for downstream U-Net segmentation; and perceptual realism via evaluation by three domain experts. Results: DualDiT achieved the best generative quality (FID 56.14, sFID 114.35), outperforming DDPM and LDM. Expert panels misclassified 46% of synthetic samples as real and 42% of real samples as synthetic. Adding DualDiT-generated images and masks improved Dice and IoU scores on a held-out segmentation test set. Conclusions: DualDiT shows that transformer-based diffusion models can effectively learn the joint distribution of OCT images and segmentation masks, surpassing DDPM- and LDM-based baselines in generative fidelity, downstream utility, and perceptual realism, highlighting its potential for data augmentation in annotation-scarce medical imaging.

31. 【2607.29310】CALM-AH: An ABAW11-Calibrated Multimodal Ensemble with Reliability-Gated Multi-Expert Consensus for Video-Level Ambivalence and Hesitancy Recognition

链接：https://arxiv.org/abs/2607.29310

作者：Wenzhuo Sun,Mingjian Liang,Richard Attfield,Zongyuan Ge,Xuelian Cheng,Pamela Carreno-Medrano

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：subtle behavioural states, Ambivalence and hesitancy, Video Recognition Challenge, facial activity, expressed through language

备注：

点击查看摘要

Abstract:Ambivalence and hesitancy (A/H) are subtle behavioural states that may be expressed through language, voice, facial activity, and other non-verbal cues. The ABAW11 A/H Video Recognition Challenge asks systems to assign a binary A/H label to each naturalistic interview video. Performance is measured using Macro-F1 so that recognition of both A/H and No-A/H samples receives equal importance. We present CALM-AH, a multimodal ensemble that combines textual, acoustic, visual, and derived behavioural-statistical features. We construct 15 non-empty combinations of these feature branches. For each combination, we select the best of three classifier families using validation binary cross-entropy and optimise its decision threshold for validation Macro-F1. The resulting binary decisions are combined using fixed hard-voting weights transferred from BROTHER. We further introduce Reliability-Gated Multi-Expert Consensus(RG-MEC), an anchor-preserving decision-level ensemble that combines an initial prediction with three complementary correction experts: CALM-AH, AffectGPT, and a GPT-based semantic verifier. The initial system provides the default prediction. Its label is overridden only when all three correction experts unanimously support the same alternative class; otherwise, the anchor prediction is retained. This unanimity-gated design limits the influence of isolated expert errors while permitting bidirectional correction when task-specific, multimodal-affective, and semantic-pragmatic evidence are fully consistent. On the participant-disjoint ABAW11 dataset, CALM-AH achieves a Macro-F1 of 0.7525, and the complete RG-MEC system achieves 0.7771.

32. 【2607.29302】BWM: A Low-Cost High-Fidelity World Simulator for Robot Learning

链接：https://arxiv.org/abs/2607.29302

作者：BWM Team

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Reliable robot learning, predict action consequences, robot learning requires, Reliable robot, Boundless World Model

备注：

点击查看摘要

Abstract:Reliable robot learning requires a world simulator that can predict action consequences before execution on physical hardware, including risky and failure-prone outcomes. Existing physics simulators require substantial asset construction and calibration and still face a sim-to-real gap, while video generators often lack precise control over their responses to fine-grained robot actions. In this paper, we present the Boundless World Model (BWM), an open-source, low-cost, high-fidelity world simulator for robot manipulation. BWM is an action-conditioned world model that combines initial-environment guidance, dynamic visual history, and temporally aligned robot-action conditioning for stateful autoregressive prediction of future observations. We construct action-aligned training clips through trajectory replay, overlapping clip sampling, and initial-observation enhancement. BWM serves as a data engine that augments imitation-learning data with action-aligned rollouts, and as a policy evaluator for closed-loop assessment, risk anticipation, and policy ranking. Experiments on the WorldArena benchmark and physical robots demonstrate improved simulator fidelity and functional utility across the data-engine and policy-evaluator settings. BWM ranks first overall in the WorldArena Challenge across Track 1 and its two Track 2 applications. We release the BWM open-source ecosystem, including model checkpoints, training and inference code, and interfaces for data generation and policy evaluation.

33. 【2607.29284】FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement

链接：https://arxiv.org/abs/2607.29284

作者：Takashi Otonari,Toshihiko Yamasaki

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Gaussian Splatting, dynamic scenes photorealistically, render dynamic scenes, render dynamic, Splatting

备注： Accepted at ECCV2026

点击查看摘要

Abstract:4D Gaussian Splatting (4DGS) can render dynamic scenes photorealistically. However, with limited viewpoint coverage, some spatiotemporal regions remain sparsely observed, leading to artifacts, particularly in scenes with large motion. Existing approaches leveraging generative models rely on heuristic virtual-viewpoint selection before refining rendered views. As a result, they cannot actively explore such sparsely observed regions. To address this issue, we propose a pipeline that actively selects spatiotemporal virtual viewpoints to improve 4DGS reconstruction. Our method selects virtual viewpoints for generative enhancement based on the rendering sensitivity and motion-aware observation density of 4D Gaussians, prioritizing views that alleviate observation sparsity. In the refined images, we filter out regions that conflict with captured observations or are likely to contain generative artifacts and then fine-tune 4DGS using only the reliable regions. We evaluate our method on multi-view video benchmarks using new train/test splits designed to induce observation gaps. Results show consistent improvements over prior viewpoint selection strategies and fine-tuning methods in both qualitative and quantitative evaluations, while reducing artifacts.

34. 【2607.29278】raining-Free Entity-Level Few-Shot Segmentation of Remote Sensing Images with Advection Refinement

链接：https://arxiv.org/abs/2607.29278

作者：Xueting Bai,Huan Ni

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Existing cross-domain few-shot, segmentation approaches suffer, Existing cross-domain, source-domain episodic training, high training costs

备注：

点击查看摘要

Abstract:Existing cross-domain few-shot segmentation approaches suffer from high training costs due to source-domain episodic training and pixel-wise dense prediction, while often producing fragmented and noisy predictions. To overcome these issues, we propose a training-free entity-level few-shot segmentation framework for remote sensing images with advection refinement. Specifically, we first leverage SAM3's generic geometric priors to generate category-agnostic entity primitives. By reformulating few-shot inference from pixel-level prediction to entity-level reasoning, foreground and background prototypes are constructed and combined with dense textual semantic responses from SAM3 to build a multi-modal semantic potential field. Furthermore, an advection equation-based semantic refinement mechanism is introduced to propagate category-aware information across both feature and similarity spaces, enhancing semantic continuity and suppressing local texture noise. Extensive experiments on multiple remote sensing datasets demonstrate that the proposed framework effectively mitigates domain shift and local noise, substantially improving SAM3's adaptation capability for remote sensing few-shot segmentation without additional training. Our code will be publicly available at this https URL.

35. 【2607.29266】OsteoCAD: A Human-in-the-Loop Cloud-Edge Framework for Bone Tumor Segmentation

链接：https://arxiv.org/abs/2607.29266

作者：Maximo Rodriguez-Herrero,Dante D. Sanchez-Gallegos,Heriberto Aguirre-Meneses,Marco Antonio Núñez-Gaona,J. L. Gonzalez-Compean,Jesus Carretero

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：medical image analysis, care organizations struggle, notably advanced medical, advanced medical image, Artificial Intelligence

备注：

点击查看摘要

Abstract:Artificial Intelligence (AI) and Deep Learning (DL) have notably advanced medical image analysis, yet many health- care organizations struggle to adopt them due to limited com- putational resources and specialized expertise. To address these barriers, we introduce OsteoCAD, a modular eHealth framework that democratizes access to DL tools in clinical practice. Osteo- CAD delivers end-to-end DL capabilities-from dataset creation and preprocessing to model training and inference-through an integrated and user-friendly interface. To mitigate local hardware constraints, the framework securely connects to remote GPU infrastructures. We validate OsteoCAD's feasibility through a real-world case study in Mexico focused on large bone tumor segmentation. The results demonstrate the framework's ability to enable DL-powered eHealth solutions without demanding ad- vanced technical expertise or complex local configurations.

36. 【2607.29243】AVI-TEC: An AI-Based Tool for Procedural Planning of Transcatheter Aortic Valve Implantation

链接：https://arxiv.org/abs/2607.29243

作者：Alessandra Zerillo,Stefano Cannata,Diego Bellavia,Daniele Ciriello,Simone Manini,Salvatore Pasta,Caterina Gandolfo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Computed tomography angiography, preprocedural TAVI planning, Computed tomography, anatomical information required, TAVI planning

备注：

点击查看摘要

Abstract:Computed tomography angiography (CTA) is crucial for preprocedural TAVI planning, providing the anatomical information required for prosthesis sizing and vascular access assessment. As the volume of TAVI procedure increases, improving efficiency and standardizing annotations is becoming essential in clinical practice. This study presents TAVI-TEC, a fully automated artificial intelligence-based framework integrated into a web based DICOM viewer for routine preoperative TAVI planning. Pre-procedural CTA scans from patients undergoing TAVI with SAPIEN 3 Ultra (S3U) prostheses were processed using a fully automated pipeline. Deep learning-based segmentation of cardiovascular structures, calcification detection, centerline extraction, landmark identification, and annular plane definition was implemented to quantify key annular and aortic root measurements and color-coded maps of lumen reduction and vessel diameter for vascular access. A multilayer perceptron classifier was trained to predict prosthesis size prior to the TAVI procedure. Results revealed that TAVI-TEC enabled pre-procedural measurements in approximately 2-6 min. Strong agreement with clinician-derived measurements was observed for annular area (coefficient of concordance, CCC = 0.934; interclass correlation coefficient, ICC = 0.935; R^2 = 0.881) and perimeter (CCC = 0.909; ICC = 0.909; R^2 = 0.854). The valve-size prediction model achieved 82% overall accuracy, with most misclassifications occurring between adjacent prosthesis sizes. Though further multicenter validation and extension to additional measurements and valve platforms are required, the TAVI-TEC methodology may reduce operator variability in pre-TAVI measurements and streamline the preoperative workflows of the Heart Team for decision-making.

37. 【2607.29240】When Model Priors Conflict with Visual Evidence: Mitigating Commonsense-Driven Hallucinations by Selective Prior Calibration

链接：https://arxiv.org/abs/2607.29240

作者：Kesheng Chen,Yamin Hu,Wenjian Luo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：overrides clear visual, clear visual evidence, prior overrides clear, commonsense-driven hallucination, atypical state

备注：

点击查看摘要

Abstract:In vision--language models, commonsense-driven hallucination (CDH) occurs when a model's commonsense prior overrides clear visual evidence of an atypical state. For example, a model may report that a visibly six-fingered hand has five fingers. We show that these errors are systematically directed: when a model answers a question about a counterfactual (CF) image incorrectly, its answer often coincides with the candidate it prefers without access to the image. Suppressing this prior indiscriminately can repair CF errors, but may also disrupt correct answers on matched commonsense (CS) images, where the same prior is helpful. We therefore propose Selective Prior Calibration (SPC), which subtracts candidate-level prior-preference estimates from image-conditioned scores with an instance-dependent strength and revises the original prediction only when the resulting score pattern strongly supports an alternative. Extensive experiments demonstrate that SPC substantially improves accuracy on CF images while largely preserving accuracy on matched CS images. Furthermore, these gains generalize across CDH categories, candidate-answer permutations, and other conflict benchmarks, while SPC rarely alters predictions on benchmarks without such conflicts.

38. 【2607.29237】CorrelationFlow: A Training-Free Geometric Approach for LiDAR Scene Flow Estimation

链接：https://arxiv.org/abs/2607.29237

作者：Minh-Quan Dao,Yancong Lin,Julie Stephany Berrio Perez,Holger Caesar

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：LiDAR scene flow, scene flow estimation, self-supervised losses, blind spots, estimation has settled

备注：

点击查看摘要

Abstract:LiDAR scene flow estimation has settled into a monoculture: nearly all recent methods share the same feed-forward architecture and the same family of self-supervised losses, inheriting each other's assumptions, and each other's blind spots. When those assumptions fail, as they do for sparse, distant, or fast-moving objects, every method built on them fails together, and adding parameters or simulated training data does not fix what the formulation itself gets wrong. This paper takes the opposite path. We present CorrelationFlow, a training-free geometric framework that reduces scene flow to two textbook operations: connected-component labeling and correlation maximization on bird's-eye-view occupancy images. Objects are isolated as spatio-temporal connected components, their motions recovered as correlation peaks, and the resulting velocities propagated to all member points. However, this dense correlation evaluates every candidate displacement of every cluster and requires a window of past sweeps; therefore, we develop a sparse counterpart that operates on a single sweep pair by matching lightweight occupancy descriptors at boundary key points. Because nothing is trained, nothing is inherited: on the multi-domain test set of the Argoverse 2 2026 Scene Flow Challenge, spanning five datasets with heterogeneous sensors and platforms, CorrelationFlow ranked second among unsupervised methods and degrades most gracefully at long range, where the shared assumptions of learned methods break down. Our results suggest that a substantial share of the scene flow problem is solvable by classical computer vision, and that progress may require questioning the formulation, not scaling it.

39. 【2607.29222】Is It Time for the Renaissance of Salient Object Detection in the Era of MLLMs?

链接：https://arxiv.org/abs/2607.29222

作者：Wenzhuo Zhao,Xiuzhi Li,Zhongkuan Mao,Ronghao Xian,Yao Jiang,Zhao Gao,Keren Fu,Qijun Zhao,Jian Cheng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large language models, multimodal large language, salient object detection, pushing salient object, language models

备注： 10 pages, 4 figures, conference

点击查看摘要

Abstract:The zero-shot capabilities of multimodal large language models (MLLMs) are pushing salient object detection (SOD) beyond task-specific supervision. To disentangle MLLMs beyond conventional mask-based evaluation, we decompose SOD into localization and segmentation, and re-engineer datasets with phrases, boxes, and attributes, establishing a diagnostic benchmark for MLLM saliency perception (SaliLLM). SaliLLM uncovers a striking capability mismatch: MLLMs outperform state-of-the-art (SOTA) methods in localization, yet remain substantially weaker in segmentation. Further analyses attribute this gap primarily to mismatches between MLLMs and annotations over foreground cardinality, granularity, and extent. Motivated by this diagnosis, we recast zero-shot SOD as protocol-aligned Foreground Organization and introduce the first training-free framework that leverages Gestalt-inspired Collaborative attention for Unified SOD (FOCUS). FOCUS couples top-down Bayesian-surprise calibration of protocol-conditioned foreground granularity with bottom-up propagation of MLLMs evidence over entity-centric perceptual manifolds induced by self-supervised features, yielding coherent object extents as prompts for a general segmenter. Across 13 RGB, RGB-D, and RGB-T SOD benchmarks, FOCUS generally surpasses SOTA methods without training, reducing mean absolute error by 11\%, 34\%, and 48\% compared with fully, weakly, and self-supervised methods, respectively. Our findings signal the renaissance of SOD: from task-specific supervision to zero-shot foreground organization. Code is available in the supplementary material.

40. 【2607.29207】Multi-Modal Object Re-Identification with Dual Semantic Guidance and Global-Local Mutual Modulation

链接：https://arxiv.org/abs/2607.29207

作者：Weixiang Zhou,Xingguo Xu,Yuhao Wang,Cong Wang,Yang Yang,Zhixun Su,Jinshan Pan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：retrieve target instances, leveraging complementary information, Multi-modal object Re-Identification, object Re-Identification, aims to retrieve

备注： Accepted by IEEE TCSVT 2026. The version of record may differ slightly

点击查看摘要

Abstract:Multi-modal object Re-Identification (ReID) aims to retrieve target instances by leveraging complementary information across modalities. However, existing methods suffer from two challenges. First, they often fail to exploit well-aligned and reliable semantic priors, making them vulnerable to background clutter and cross-modal misalignment. On the other hand, they typically rely on holistic feature modeling, overlooking the synergy between global and local representations. To overcome these limitations, we propose a robust multi-modal ReID framework with dual semantic guidance and global-local mutual modulation, which mainly consists of three key components, namely the Text-Semantic Injector (TSI), the Masked Global-Local Modulator (MGLM), and the Hierarchical MoE Fusion (HMF). The TSI enhances semantic awareness by integrating clean and coherent textual features into visual tokens. The MGLM enables part-aware cross-modal interaction through joint guidance from soft masks and global context, improving fine-grained feature alignment. Finally, the HMF adaptively aggregates multi-spectral features under local semantic supervision, yielding discriminative and robust representations. Extensive experiments on three multi-modal ReID benchmarks demonstrate the effectiveness of the proposed method. The code will be made publicly available at this https URL upon acceptance.

41. 【2607.29202】Domain-Division based Progressive Learning for Source-Free Domain Adaptation

链接：https://arxiv.org/abs/2607.29202

作者：Pan Liu,Jing Li,Meng Zhao,Wanli Xue,Qinghua Hu,Shengyong Chen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：source pre-trained model, unlabeled target domain, source-free domain adaptation, portability concerns, allowing for effective

备注： Accepted by IEEE Transactions on Multimedia 2025

点击查看摘要

Abstract:With growing privacy and portability concerns, source-free domain adaptation requires only a source pre-trained model and an unlabeled target domain, allowing for effective adaptation to the target data. Most existing self-training methods focus on selecting and exploiting samples with reliable predictions, often neglecting others. Inspired by the finding that deep models learn clean samples faster than noisy ones, we propose a domain-division based progressive learning method named DPL. Specifically, our approach consists of two alternating stages, each beginning with the division of the target domain into easy-to-adapt and hard-to-adapt subdomains based on adaptation difficulty, followed by neighborhood-based pseudo label assignment. In stage one, we enhance classification accuracy through uncertainty-aware self-training and alignment of corresponding classes between subdomains. Stage two then applies tailored learning strategies to each subdomain, starting with consistency learning on the easy-to-adapt samples and progressing to utilizing local structural information for the more challenging ones, thereby mining the intrinsic properties of the target data. Extensive experiments on several widely used benchmarks validate the effectiveness of our approach, demonstrating superior performance compared to state-of-the-art methods. Our code is available at this https URL.

42. 【2607.29200】UltraSAM3: A Concept-Driven Foundation Model for Universal Ultrasound Image Segmentation

链接：https://arxiv.org/abs/2607.29200

作者：Bo Xu,Quanhao Zhu,Rui Lin,Boling Zhu,Chenyuan Wang,Hongfei Lin,Feng Xia,Chenhua Ji

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：clinical practice due, real-time capability, Ultrasound, image segmentation important, increasingly widespread

备注：

点击查看摘要

Abstract:Ultrasound imaging has become increasingly widespread in clinical practice due to its portability, low cost and real-time capability, making ultrasound image segmentation important. However, ultrasound images differ substantially from CT, MRI, and other medical imaging modalities, as they are often affected by speckle noise, low contrast, acoustic shadows and ambiguous boundaries. Existing ultrasound segmentation methods are still mainly limited to task-specific models or visual-prompt-based foundation models, which are either tailored to particular tasks or require expert-provided visual prompts, making them inconvenient for flexible clinical use. To address these challenges, we propose UltraSAM3, a concept-driven foundation model for universal ultrasound image segmentation. Unlike conventional models, UltraSAM3 enables text-based target specification by adapting SAM3 to ultrasound-specific image--mask--concept triplets. The model is trained on a large-scale ultrasound segmentation corpus covering 37 public datasets and 13 anatomical categories, allowing it to align ultrasound visual patterns with clinically meaningful concepts across diverse organs and lesions. To further improve usability under realistic clinical interaction, we propose an instruction-guided agent that parses complex natural language queries into concise ultrasound concept prompts for UltraSAM3. Extensive experiments demonstrate that UltraSAM3 consistently outperforms representative concept- and text-driven biomedical segmentation models on multi-organ ultrasound benchmarks, external datasets, and visual-prompt-enhanced settings. Moreover, the agent improves segmentation robustness for complex user instructions. These results indicate that ultrasound-specific concept adaptation is effective for building generalizable and interactive ultrasound segmentation foundation models.

43. 【2607.29192】Locally Consistent Transductive Information Maximization for Few-Shot Remote Sensing Scene Classification

链接：https://arxiv.org/abs/2607.29192

作者：Karim El Khoury,Benoît Gérin,Benoît Macq,Christophe De Vleeschouwer

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large-scale Earth-observation data, Transductive Information Maximization, Earth-observation data, large-scale Earth-observation, Consistent Transductive Information

备注： Accepted at ECCVW2026

点击查看摘要

Abstract:Remote sensing scene classification is increasingly relying on foundation models pre-trained on large-scale Earth-observation data. Moreover, transductive inference, which exploits the collective statistical structure of the entire unlabeled query set, appears to naturally match remote sensing pipelines where large images are routinely split into patches and inferred as a batch. In this work, we introduce LC-TIM (Locally Consistent Transductive Information Maximization), which extends the state-of-the-art Transductive Information Maximization for Few-Shot CLIP (TIM++) objective with a local consistency regularizer that enforces prediction agreement between each query sample and its $\kappa$ nearest feature-space neighbors. The regularizer enters as a single multiplicative factor in the closed-form $q$-update, adding negligible computational overhead. We further propose a multi-source extension that fuses the affinity graph from multiple remote sensing foundation model, further boosting classification accuracy. To assess these methods, we establish the first comprehensive, open-source benchmark for transductive few-shot RS scene classification, evaluating LP++, TransCLIP, TIM++, and LC-TIM across ten diverse datasets, two remote sensing vision-language models, and across various few-shot settings. Our experiments show that transductive methods consistently outperform zero-shot baselines, and that LC-TIM achieves state-of-the-art accuracy, with the largest gains in the low-shot regime where neighborhood cues are most informative. Code is publicly available at: this https URL

44. 【2607.29181】SERUM: State Extraction and Refinement for User Modeling

链接：https://arxiv.org/abs/2607.29181

作者：Andy J. Phu,James Mooney,Karin de Langis,Khanh Chi Le,Dongyeop Kang

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Agentic assistants capable, personalized interactions require, Agentic assistants, interactions require structured, capable of proactive

备注：

点击查看摘要

Abstract:Agentic assistants capable of proactive, personalized interactions require structured models of user intent and workflow. However, building these models from raw, unstructured screen activity remains an open challenge. We present SERUM, a multi-pass framework that extracts finite-state behavioral models directly from unstructured egocentric video using hierarchical VLM annotation. Processing screen recordings through a sliding window, SERUM alternates between activity-recognition and intent-inference passes, with each pass refining labels using accumulated prior context to reduce hallucination and temporal conflation seen in single-pass annotation. Synonymous states are then merged via sentence embeddings and human-calibrated thresholds into a compact, coherent taxonomy. We evaluate behavioral structure by fitting first-order Markov models over the resulting label sequences (both actions and intents) and measuring predictive accuracy against frequency baselines. Across 61 egocentric videos in four domains (coding, cooking, physical activities, and daily life), we find: (1) iterative label refinement converges to a stable state vocabulary, which we term schematic equilibrium, after several passes; (2) normalized Markov models achieve substantially lower perplexity and higher action predictions than frequency baselines, with the largest gains on structured tasks like coding; and (3) human annotators rate final-pass labels as accurate and meaningfully improved over first-pass labels. To our knowledge, SERUM is the first system to produce interpretable process models from unstructured egocentric screen video without manual annotation, opening a scalable pathway for user modeling and behavioral understanding in the wild. Our demo, code, and results are publicly available

45. 【2607.29180】MoRAE: Flow-Friendly Self-Supervised Latents for Text-to-Motion Generation

链接：https://arxiv.org/abs/2607.29180

作者：Yifei Zhu,Mingyi Shi,Yangyang Cai,Miao Cheng,Yoshifumi Kitamura,Taku Komura

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：temporally coherent, semantically correct, physically plausible, produce motions, space

备注：

点击查看摘要

Abstract:Text-to-motion generation must produce motions that are semantically correct, temporally coherent, and physically plausible. A natural approach is to first project motion data into a structured semantic space and then train a generative model within that space. Such a paradigm has been highly successful in image generation through Representation Autoencoders (RAEs), where a frozen self-supervised encoder provides semantic features for diffusion or flow models to learn from. However, direct transfer of such a paradigm to motion space using Motion-JEPA as the frozen encoder fails dramatically. We diagnose this failure geometrically and identify two motion-specific bottlenecks: (1) the JEPA feature space is spectrally ill-conditioned, making the Gaussian-to-data transport unstable; and (2) even with a well-conditioned spectrum, flow residuals tend to align with decoder-sensitive directions, where small latent errors are amplified into large motion artifacts after decoding. Based on these insights, we propose MoRAE. MoRAE addresses the two bottlenecks separately. A compact bottleneck distills the structured JEPA representation while removing weak and redundant directions, bringing the latent spectrum into a transport-stable regime. Motion-coupled training then aligns the retained latent geometry with the decoder, making characteristic flow errors less costly after decoding. With this flow-friendly latent, a standard non-autoregressive Flow-Matching DiT achieves state-of-the-art performance.

46. 【2607.29156】Progressive Decision-Making for Localizing Open-Ended AI-Generated Image Forgeries

链接：https://arxiv.org/abs/2607.29156

作者：Jingyi Hou,Xiaoxia Chen,Leyu Zhou,Zhichuang Wang,Zhijie Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：increasingly realistic, realistic and difficult, difficult to characterize, AI-generated image forgeries, fixed manipulation patterns

备注：

点击查看摘要

Abstract:AI-generated image forgeries are becoming increasingly realistic and difficult to characterize with fixed manipulation patterns. As generative models continue to evolve, it is impractical to expect a localization model to exhaustively learn all possible forgery appearances from large-scale training data alone. Nevertheless, many AI-generated forgeries still leave subtle forensic traces, although these cues are often weak and unevenly reliable across regions. Therefore, robust localization requires not only extracting informative forensic traces, but also making reliable decisions from incomplete and ambiguous evidence. In this paper, we move beyond static one-shot prediction and reformulate final forgery localization as an adaptive sequential decision-updating process, where the localization map is treated as an intermediate state rather than a fixed output. Rather than producing the final mask via one-shot pixel-wise prediction, our method progressively updates the localization state guided by available evidence, uncertainty, and boundary conditions. Specifically, we first transform mesoscopic traces into compact decision evidence via a lightweight decision evidence projector, and then introduce Evidence-Guided Mamba (EG-Mamba) to perform uncertainty- and boundary-aware state updating. This design allows reliable manipulated and background regions to be preserved, while ambiguous regions are cautiously revised according to the available evidence. Extensive experiments on both conventional and AI-generated manipulation benchmarks validate the effectiveness of the proposed method. Notably, even when trained only on conventional manipulation data, our method brings larger gains on unseen AI-generated forgeries, indicating that progressive decision-updating is especially useful for heterogeneous and hard-to-exhaustively-learn manipulation traces.

47. 【2607.29144】Have I Seen You? Embedding Behavior Signals Synthetic Face Dataset Membership

链接：https://arxiv.org/abs/2607.29144

作者：Paweł Borsukiewicz,Daniele Lunghi,Wendkûuni C. Ouédraogo,Jacques Klein,Tegawendé F. Bissyandé

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：reduce privacy exposure, data access constraints, reduce privacy, privacy exposure, access constraints

备注： Accepted at EUVIP'26 student session

点击查看摘要

Abstract:Synthetic face datasets are increasingly used to reduce privacy exposure and data access constraints in biometric recognition. Yet the generators that produce these datasets are trained on real faces, so synthetic data may still reveal their real source data. We study this risk through a dataset-level membership inference attack that first identifies the synthetic dataset used to train a face recognizer and then infers the real dataset used to train the generator. Across 11 face recognition models, 11 synthetic datasets, and 7 real datasets, the attack recovers the synthetic training dataset in 100% of cases and identifies the generator's source dataset in 54.5% of cases. These results show that synthetic data can retain dataset-level traces of real training data and that privacy-preserving deployment requires stronger leakage mitigation.

48. 【2607.29136】On the Efficacy of Self-Supervised Point Cloud Encoders for Efficient 3D Large Language Models

链接：https://arxiv.org/abs/2607.29136

作者：Yao Zheng,Tian Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large language models, point cloud-language models, creating high barriers, existing methods rely, pairing point cloud

备注： 14 pages, 3 figures. This work has been previously released as a preprint on ChinaXiv (No. ChinaXiv:202607.00167, DOI: [https://doi.org/10.12074/202607.00167](https://doi.org/10.12074/202607.00167) )

点击查看摘要

Abstract:3D point cloud-language models (3D-LLMs) enable 3D understanding by pairing point cloud encoders with large language models, but existing methods rely on costly multi-modal encoders (e.g., ULIP-2) that require image-text-point cloud alignment on 8x A100-scale compute, creating high barriers for research and deployment. In this work, we systematically investigate whether low-cost self-supervised point cloud encoders, specifically PCP-MAE and Point-MAE, can serve as effective alternatives. Using MiniGPT-3D as our testbed, we evaluate 7 encoder initialization/pre-training setups (1 multi-modal baseline, 5 self-supervised, 1 random init) under frozen and unfrozen fine-tuning (12 total groups), across 2 architectures (MaskTransformer, PointTransformer), 3 objectives (PCP-MAE, Point-MAE, random init), and 2 datasets (Objaverse 660K, ShapeNet55-34 approximately 50K). Our experiments reveal three key findings: (1) The four-stage MiniGPT-3D pipeline can effectively train a 3D encoder from random initialization: an end-to-end trained random init encoder reaches 52.50% open-vocabulary accuracy and 44.45 captioning score, approaching top pre-trained variants; (2) Architecture and pre-training objective show strong crossover interaction: PCP-MAE + MaskTransformer achieves 59.00% accuracy (best self-supervised), while Point-MAE + MaskTransformer drops to 46.50%, with the pattern reversed for PointTransformer; (3) Closed-set ModelNet40 classification remains a core weakness of purely geometric encoders, reaching only ~13-18% accuracy vs. ~62% for the multi-modal baseline, even after end-to-end fine-tuning. Our results offer practical guidelines for cost-effective 3D-LLM design and reveal interaction patterns between self-supervised objectives and encoder architectures.

Comments:
14 pages, 3 figures. This work has been previously released as a preprint on ChinaXiv (No. ChinaXiv:202607.00167, DOI: https://doi.org/10.12074/202607.00167)

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

ACMclasses:
I.2.10; I.2.7

Cite as:
arXiv:2607.29136 [cs.CV]

(or
arXiv:2607.29136v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.29136

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Yao Zheng [view email] [v1]
Fri, 31 Jul 2026 08:06:56 UTC (874 KB)

49. 【2607.29132】First Investigation of Deep Learning for Intraoperative Gauze Segmentation in Minimally Invasive Abdominal Surgery

链接：https://arxiv.org/abs/2607.29132

作者：Priya Tomar,Maximilian Broß,Philipp Feodorovici,Jan Arensmeyer,Philipp Leifels,Aditya Parikh,Hanno Matthaei,Christian Bauckhage,Helen Schneider,Rafet Sifa

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：absorbing bodily fluids, bodily fluids, controlling bleeding, bleeding and absorbing, absorbing bodily

备注： Paper already published in IEEE DSAA conference. The purpose here is to make it open-access

点击查看摘要

Abstract:Surgical gauze is an essential part of surgical procedures, primarily used for controlling bleeding and absorbing bodily fluids. The post-surgical retention of gauze can lead to serious complications and necessitate additional surgery for its removal. Despite the clinical significance, research on gauze segmentation using real-world surgical data remains underexplored, owing in part to the scarcity of annotated datasets. In this work, we investigate the use of deep learning methods for gauze segmentation in robot-assisted minimally invasive abdominal surgeries, utilizing an in-house surgical dataset prepared at a university hospital. The training data reflects realistic surgical settings and captures extensive diversity in spatial, morphological, and visual attributes across three different gauze categories. We evaluate several widely used segmentation architectures, including CNN-based, transformer-based, and hybrid architectures, to establish a proof-of-concept for gauze segmentation in a realistic clinical setting. In addition, we investigate the influence of sub-optimally annotated, auto-tracked segmentation masks as a strategy to address data scarcity and improve performance. Our results demonstrate the efficacy of real-world training data in countering the main challenge reported by prior works, the trade-off between blood presence and gauze detection. The incorporation of auto-tracked annotations yields performance enhancements, particularly in generic surgical scenarios. The integration of effective segmentation approaches can benefit robot-guided surgical procedures and various downstream applications by providing precise delineation of foreign objects, thereby enhancing patient safety and surgical outcomes.

50. 【2607.29124】SciFigPlag-Bench: A Benchmark for Provenance-Aware Scientific Figure Plagiarism Detection

链接：https://arxiv.org/abs/2607.29124

作者：Zhiying Cui,Minghao Yang,Linlin Gao,Jie Liu,Pengyuan Li

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：multimodal evaluation problem, plagiarism remains underexplored, benchmarked multimodal evaluation, figure plagiarism remains, evaluation problem

备注： 30 pages, 18 figures

点击查看摘要

Abstract:Scientific figures often encode the visual evidence behind scientific findings, yet figure plagiarism remains underexplored as a benchmarked multimodal evaluation problem. We present SciFigPlag-Bench, a benchmark for provenance-aware reasoning over scientific figures in scholarly documents. Unlike general image-similarity or image-forensics benchmarks, SciFigPlag-Bench evaluates whether a suspicious figure reuses evidence from a specific source figure, how the reused content has been transformed, and where the reused evidence appears. We introduce a factorized taxonomy that separates what is reused from how it is transformed, covering material-preserving reuse, such as full-figure and subfigure reuse, as well as abstract-content reuse, such as data re-expression and structural redraw. Guided by this taxonomy, we construct a hybrid benchmark with 2,582 positive pairs and 2,541 negative pairs, combining documented real-world cases, taxonomy-guided synthetic examples, and visually similar negatives. The benchmark supports four diagnostic tasks: pairwise detection, source attribution, hierarchical reuse-type classification, and reuse correspondence localization. Experiments with diverse vision-language models establish initial baselines and reveal persistent challenges in fine-grained provenance reasoning, reuse-type understanding, and spatial evidence grounding.

51. 【2607.29122】A Frozen Pixel-Space Diffusion Model Can Guide Itself with Its Own Samples

链接：https://arxiv.org/abs/2607.29122

作者：Zixuan Fu,Chong Wang,Lanqing Guo,Kailai Zhou,Jiahao Nie,Bihan Wen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Pixel-space diffusion models, Pixel-space diffusion, pixel diffusion, diffusion models aim, generator directly

备注：

点击查看摘要

Abstract:Pixel-space diffusion models aim to learn an end-to-end generator directly over raw pixels. This is challenging because a single model must capture both global structure and local texture in the same high-dimensional space. While recent work improves pixel diffusion through alternative prediction targets, training objectives, and architectures, these advances typically require training a new model from scratch. We show there is a cheaper, complementary strategy: \textbf{a frozen, pretrained pixel diffusion model can guide itself}. Our key observation is that intermediate layers of a pretrained pixel diffusion transformer can be decoded into coarse predictions that capture the main low-frequency structure, while the final layers progressively refine local, high-frequency details. We therefore attach a lightweight prediction head to an intermediate layer, keep the backbone frozen, and use the discrepancy between the intermediate and final predictions as a self-guidance direction during sampling. To train this head, we further find that real images are not necessary. Instead, model-generated samples suffice and even outperform real images for training the head, especially in enhancing the high-frequency components that pixel diffusion tends to underfit. Across multiple pixel diffusion models on ImageNet, our \textbf{Synthetic Self-Guidance (SSG)} consistently improves generation while adapter training requires less than 1$\%$ of full-model training compute: it reduces FID by over 50$\%$ across the evaluated JiT variants without classifier-free guidance (CFG) and further improves strong baselines with CFG, e.g., JiT-H/16 from 1.86 to 1.67 and PixelREPA-H/16 from 1.81 to 1.59. Our code is available at this https URL.

52. 【2607.29106】Forwardrobe: Garment-Aware Gaussian Avatars from a Single Image

链接：https://arxiv.org/abs/2607.29106

作者：Daisheng Jin,Shuyun Wang,Ying He

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：single image remains, reconstructing garment-aware Gaussian, single image, Reconstructing animatable, remains particularly challenging

备注：

点击查看摘要

Abstract:Reconstructing animatable 3D human avatars from a single image remains particularly challenging for loose garments, whose geometry and motion cannot be adequately represented by body-aligned topology and skinning. We present Forwardrobe, a feed-forward framework for reconstructing garment-aware Gaussian avatars from a single image. Forwardrobe explicitly separates clothing from the body in canonical Gaussian space and equips the garment layer with continuity-aware geometry and skinning initialization, pose-conditioned non-rigid deformation, and appearance adaptation. These designs improve garment reconstruction and visual quality during animation, particularly for skirts and dresses. The separated garment layer additionally forms an independently controllable 3D asset, enabling garment editing, transfer, and 3D virtual try-on. Experiments demonstrate improved garment reconstruction quality and greater flexibility in garment manipulation compared with existing single-image avatar reconstruction methods.

53. 【2607.29100】StraightDP: Geometry-Aware Differential Privacy for Rectified-Flow Transformers

链接：https://arxiv.org/abs/2607.29100

作者：Xujun Che,Depeng Xu,Xintao Wu

类目：Machine Learning (cs.LG); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

关键词：text-conditioned generative models, generative models suffers, Differentially private, text-conditioned generative, generative models

备注：

点击查看摘要

Abstract:Differentially private (DP) training of text-conditioned generative models suffers a utility cliff at strong privacy. We revisit this problem through the geometry of rectified flows: along the straight interpolation between noise and data, the Bayes-optimal velocity is governed to leading order at the noise end by a few class-conditional moments, and increasingly sample-specific structure matters toward the data end. StraightDP exploits this heterogeneity end to end. A small budget share releases whitened class-conditional moments once, to be distilled into the weights or injected at sampling time. The rest is spent by pre-declared DP-SGD toward the data end, beyond the moments' reach. At $\varepsilon=1$ on MNIST, the released moments alone already attain $0.76$ downstream accuracy with prototype-like samples and an FID of $237$, and uniform DP-SGD attains $0.21$. The pipeline built on the release reaches $0.81$ accuracy at FID $56$ in a public latent space. Constraining per-token stream norms of the multimodal backbone leaves the pretraining loss unchanged yet improves downstream accuracy in the extreme-noise pixel-space regime, and its accuracy effect becomes monotonically more favorable as privacy strengthens. The released moments also port to frozen SD3-medium, where sampling-time injection beats DP-LoRA training at a fraction of the budget.

54. 【2607.29083】MHRGait: Gait Recognition from Momentum Human Rig Pose

链接：https://arxiv.org/abs/2607.29083

作者：Huiran Duan,Qian Zhou,Xianda Guo,Hua Zou,Guoying Zhao,Zhongyuan Wang,Yingli Tian

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：body shape, projected body shape, Momentum Human Rig, body, shape

备注：

点击查看摘要

Abstract:Gait recognition is shaped by its input representation. Silhouettes encode projected body shape, skeletons encode sparse joint coordinates, and 3D meshes encode dense surface geometry. In each case, identity-bearing articulation is observed through geometric carriers that also vary with clothing, skeletal scale, or body shape. We investigate whether gait can instead be recognized from compact articulated controls. We introduce Momentum Human Rig (MHR) pose as a gait representation, describing each frame using 184 semantically organized body and hand parameters estimated from monocular video. MHRGait groups these heterogeneous controls by anatomy, models their intra-frame coordination and temporal evolution, and produces compact body and hand descriptors. We further introduce MHRGait++, which combines MHR pose with silhouettes through modality-balanced distance fusion, preventing descriptor count from determining modality importance. Experiments on four benchmarks show that MHRGait attains the best overall performance among compared model-based methods on CCPG and SUSTech1K and transfers effectively across datasets, while its recognition network requires only 2.76M parameters and 0.69 GFLOPs for a 30-frame input. MHRGait++ consistently improves silhouette recognizers with a favorable accuracy-efficiency trade-off. These results establish rig-space articulation as an effective standalone gait representation and a complementary cue to projected body shape. Our code is available at this https URL.

55. 【2607.29059】Learning from Adversity: Semantic-Aware Mask Refinement through Adversarial Perturbation

链接：https://arxiv.org/abs/2607.29059

作者：Beomyoung Kim,Sung Ju Hwang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：imperfect boundaries, models produce masks, significant advances, advances in image, Adversarial Mask Perturbation

备注： ECCV 2026

点击查看摘要

Abstract:Despite significant advances in image segmentation, even state-of-the-art models produce masks with imperfect boundaries, semantic inconsistencies, and structural errors. Mask refinement addresses these limitations, yet current approaches rely on simplistic synthetic noise that fails to capture the complex error patterns of real segmentation models. We introduce Phoenix, a novel framework that leverages adversarial learning to generate semantically meaningful noise patterns and contrastive learning to model refinement relationships. Our approach consists of two key innovations: (1) Adversarial Mask Perturbation, which employs embedding attacks to create semantic-aware noise that mimics real segmentation errors, and (2) Contrastive Mask Refinement Learning, which establishes a tri-directional framework that ensures feature consistency within semantic regions while maintaining separation between classes. Experiments demonstrate that Phoenix significantly outperforms existing methods across diverse tasks, while consistently enhancing state-of-the-art segmentation models with substantial improvements. Our code and project page are publicly available at this https URL.

56. 【2607.29048】Parameter-Efficient Fine-Tuning for Spiking Point Cloud Models

链接：https://arxiv.org/abs/2607.29048

作者：Zihao Guo,Jihua Zhu,Yiding Sun,Lin Chen,Danwei Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Spiking Neural Networks, Neural Networks, offer energy-efficient solutions, spiking point cloud, point cloud analysis

备注：

点击查看摘要

Abstract:Spiking Neural Networks (SNNs) offer energy-efficient solutions for point cloud analysis on resource-constrained devices through event-driven computation. However, existing pre-trained spiking point cloud models rely on full fine-tuning for downstream task adaptation, incurring substantial parameter and storage overhead. Furthermore, binary spike propagation suppresses task-relevant sub-threshold information. To address these issues, we propose SpikePEFT, the first parameter-efficient fine-tuning framework for spiking point cloud models. Specifically, Intrinsic Dynamics Tuning (IDT) adaptively modulates membrane decay and firing thresholds, enabling efficient neuron-intrinsic adaptation while keeping the pre-trained synaptic transformations frozen. Moreover, Silent-State Disambiguation Adaptation (SSDA) recovers task-relevant information from informative silent states, thereby providing richer evidence for downstream adaptation. Extensive experiments across multiple benchmarks demonstrate the effectiveness and efficiency of SpikePEFT. In particular, our method achieves 92.4% accuracy on ModelNet40 and 85.6\% on the most challenging classification split ScanObjectNN(PB\_T50\_RS) while updating only about 5% of the trainable parameters and preserving the energy efficiency of SNNs. This work provides a promising step toward parameter-efficient adaptation of neuromorphic vision models.

57. 【2607.29045】Adaptive Emotional Video Captioning via Affective Heterogeneous Graph Reasoning and Multi-task Joint Learning

链接：https://arxiv.org/abs/2607.29045

作者：Junbo Wang,Liangyu Fu,Yuke Li,Xuecheng Wu,Zhiyong Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Emotional video captioning, emotion, aims to describe, factual correctness, temporally varying emotional

备注：

点击查看摘要

Abstract:Emotional video captioning (EVC) aims to describe a video with both factual correctness and affective expressiveness. It requires a model to perceive subtle, ambiguous, and temporally varying emotional cues and translate them into natural language without weakening objective visual content. Existing methods have progressively introduced contextual attention, emotion interpretation, emotion priors, dynamic emotion perception and emotion-cause reasoning. Nevertheless, most of them still depend on either global emotion vectors or rigid hierarchical priors. In recent methods, the tree-structured emotion prior establishes a coarse-to-fine connection between psychological emotion categories and daily emotion words, but its hard subordinate masking may irreversibly suppress correct lexical emotions once the coarse category prediction is inaccurate. It is also limited in representing mixed or overlapping emotions that frequently occur in real videos. To address the issues, we propose SAGML, an adaptive EVC framework via affective heterogeneous graph and multi-task language modeling. Instead of treating the emotion prior as a discrete tree, SAGML constructs a soft affective heterogeneous graph containing catalog-level emotion nodes and lexical-level emotion word nodes. The soft gate is injected into video-to-emotion graph attention as a continuous bias, allowing visually supported lexical emotions to remain recoverable rather than being removed by a hard mask. The resulting affective representation is fed together with visual tokens into a causal language decoder, while dual catalog and lexical heads impose explicit emotion distribution learning on the prompt hidden states. The overall model is trained with a joint objective that combines autoregressive caption generation and emotion distribution supervision. SAGML provides an error-resilient and multi-emotion-aware baseline for EVC.

58. 【2607.29040】Rethinking Detection Calibration: A Coordinate and Direction Perspective

链接：https://arxiv.org/abs/2607.29040

作者：Juyong Lee,Seungjin Jung,Jungmin Lee,Sunju Lee,Jongwon Choi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：deep neural networks, Deep learning based, detectors require trustworthiness, assigning high confidence, confidence scores

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Deep learning based object detectors require trustworthiness beyond competitive detection performance, but deep neural networks are prone to overconfident predictions, assigning high confidence scores to predictions that are likely to be inaccurate. To improve the alignment between confidence scores and prediction accuracy, existing methods calibrate confidence scores based on box-level localization, such as precision or intersection over union with the ground truth bounding box. However, box-level localization reflects only a measure of agreement between the predicted box and the ground truth, resulting in calibrated confidence scores for box-level accuracy failing to capture the localization accuracy of coordinates of box. To tackle this issue, we propose a novel post-hoc calibration framework, rethinking detection calibration (ReDC), which provides reliable coordinate-level confidence scores, including directional information. The proposed framework defines coordinate-wise alignment and deviation direction between predictions and ground truth. Based on the alignment measure, confidence re-encoding produces reliable coordinate-level confidence scores, while directional displacement estimation predicts coordinate-wise deviation directions. Extensive experiments under in-domain and out-domain scenarios demonstrate that the proposed approach expresses the coordinate-wise localization of detected objects more precisely than existing methods. Furthermore, our method covers the representational scope of prior calibration approaches by aggregating coordinate-level confidence scores into box-level localization.

59. 【2607.29039】ReMoE: Report-Guided Mixture-of-Experts for Multimodal OCT/OCTA Anomaly Detection

链接：https://arxiv.org/abs/2607.29039

作者：Zihan Nie,Qincheng Qiao,Muhao Xu,Wei Feng,Xinguo Hou,Weiye Song,Zongyuan Ge

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：identifies samples deviating, scarce abnormal cases, abnormal cases make, detection identifies samples, Optical Coherence Tomography

备注：

点击查看摘要

Abstract:Multimodal medical anomaly detection identifies samples deviating from normal patterns, where scarce abnormal cases make normality modeling from normal data practical. In retinal Optical Coherence Tomography (OCT) and OCT Angiography (OCTA) anomaly detection, existing unsupervised methods rely on visual feature distributions, reconstruction residuals, or encoder-decoder discrepancies, making anomaly scores depend on appearance-level deviations, while multimodal normality also contains semantic organization described in normal medical reports. To this end, we propose Report-Guided Mixture-of-Experts (ReMoE), which distills normal report semantics into an image-to-text prior student, builds modality-aware priors, and uses Report-Guided Modality Modulation (RMM) to modulate features through mixture-of-experts routing. Experiments on a private OCT/OCTA dataset with paired normal reports and a public OCTA500-3MM setting using a fixed normal report demonstrate state-of-the-art performance.

60. 【2607.29037】GO-PRE: Goal-Oriented Next-Best-View Selection via Predictive Rendering Entropy for Active 3D Reconstruction

链接：https://arxiv.org/abs/2607.29037

作者：Yan Song,Zhihao Li,Chenglong Li,Li He,Yan Wang,Wenqiang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：limited capture budgets, capture budgets, limited capture, maximize reconstruction fidelity, reconstruction relies

备注： Accepted at the 43rd International Conference on Machine Learning (ICML 2026)

点击查看摘要

Abstract:Active 3D reconstruction relies on active view selection to maximize reconstruction fidelity under limited capture budgets. However, most existing methods rely on surrogate signals such as parameter uncertainty or geometric heuristics, but these signals are often misaligned with the ultimate goal: the fidelity of rendered predictions. We propose GO-PRE, a goal-oriented next-best-view selection framework that explicitly targets information gain in the prediction space. Specifically, we formulate the objective as maximizing the reduction of the average marginal predictive entropy over a user-specified target view manifold. GO-PRE supports interactive goal specification and yields an efficient acquisition rule that enables real-time computation of information gain. Extensive experiments across benchmarks demonstrate that GO-PRE consistently improves active reconstruction performance and provides more reliable uncertainty quantification compared to state-of-the-art methods.

61. 【2607.29033】SAM+D: Parameter-Efficient Dimensional Lifting of SAM-Family Models via Depth-Routed LoRA and Depth Shifting

链接：https://arxiv.org/abs/2607.29033

作者：Yu Song,Hao Sun,Shiyu Teng,Ikuko Nishikawa,Yen-wei Chen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：process slices independently, require substantial architectural, ignoring inter-slice context, SAM, Depth Shift Modules

备注： Accepted to ECCV2026

点击查看摘要

Abstract:Existing methods for adapting 2D foundation models such as SAM to 3D volumes either process slices independently---ignoring inter-slice context---or require substantial architectural changes and retraining. In this paper, we present \textbf{SAM+D}, a parameter-efficient framework that lifts SAM-family models by one spatial dimension---enabling 3D volumetric segmentation from 2D SAM and, for the first time via parameter-efficient fine-tuning, end-to-end 4D (3D+T) spatiotemporal segmentation from video-based SAM2---while keeping the vast majority of pre-trained parameters frozen. SAM+D introduces two lightweight, model-agnostic modules into frozen transformer blocks: (1)~\textbf{Depth-Routed LoRA (DRLoRA)} experts with learned routing for spatially adaptive low-rank updates, and (2)~\textbf{Depth Shift Modules (DSM)} for cross-slice feature exchange at zero additional parameter cost. Together, they provide volume-level context while tuning only ${\sim}$2.8\% of parameters for SAM and ${\sim}$3.7\% for SAM2. We evaluate SAM+D in two distinct settings, each lifting the base model by one spatial dimension: 3D segmentation, where SAM(2D$\,\to\,$3D) is evaluated on four CT benchmarks (KiTS, Pancreas, LiTS, Colon), and 4D segmentation, where SAM2 (2D+T$\,\to\,$3D+T) is evaluated on a cell tracking challenge (CTC) dataset (Fluo-N3DH-SIM+). In both settings SAM+D achieves competitive or superior results under the single-point prompt setting while using fewer trainable parameters than existing methods, demonstrating that SAM+D generalizes across SAM-family architectures, target dimensionalities (3D, 4D), and domains spanning medical imaging and bio-scene understanding. Code is publicly available at this https URL.

62. 【2607.29025】Evaluation-Verification Reward for Consistent Multi-Reference Image Editing

链接：https://arxiv.org/abs/2607.29025

作者：Yingmao Miao,Pengfei Zhang,Xiaochen Lv,Meng Yu,Lei Sun,Xiangxiang Chu,Chao Shen,Chenhao Lin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：made rapid progress, editing remains challenging, recent image editing, multi-reference editing remains, image editing models

备注：

点击查看摘要

Abstract:While recent image editing models have made rapid progress, multi-reference editing remains challenging, particularly in maintaining visual consistency across references and ensuring overall visual harmony. Reinforcement learning has proven highly effective for text-to-image generation and single-image editing, but its extension to multi-reference editing is hindered by the absence of suitable reward models that capture multi-image relational constraints. Moreover, naively using multimodal large language models(MLLMs) as zero-shot evaluators faces a key tension between hallucination-prone long-form reasoning and the limited deductive power of short-form judgments. We address these issues with a Multi-dimensional Evaluation-Verification Reward(EVR). EVR decomposes evaluation into distinct visual criteria; for each criterion, an MLLM Evaluator generates multiple candidate hypotheses, and a Verifier grounds each claim in concrete visual evidence to accept or reject it, producing reliable and fine-grained reward signals. Together with a scalable data pipeline, our method enables RL fine-tuning of off-the-shelf editors without architectural changes. Extensive experiments show substantial gains over the base Qwen-Image-Edit, improving consistency and harmony to match or surpass NanoBanana.

63. 【2607.28996】SULAND v2: A Refined RGB Dataset and Deep Learning Object Detection Benchmark for UAV/UGV-Based SUrface LANDmine Detection Under Domain Shift

链接：https://arxiv.org/abs/2607.28996

作者：Sagar Lekhak,Prasanna Reddy Pulakurthi,Lalit Joshi,Ramesh Bhatta,Emmett J. Ientilucci

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Ground Vehicle, Unmanned Aerial, RGB imagery offers, option for Unmanned, object detectors remain

备注： The manuscript is currently under submission to a journal for peer review

点击查看摘要

Abstract:RGB imagery offers a practical, low-cost option for Unmanned Aerial/Ground Vehicle (UAV/UGV) survey support in surface-landmine detection, but object detectors remain underexplored in this safety-critical domain. Limited cross-architecture benchmarking and insufficient out-of-distribution (OOD) analysis obscure whether detectors generalize across deployment conditions. This challenge is amplified by the scarcity of public RGB landmine datasets, making SULAND a key benchmark for PFM-1 and PMA-2 detection. However, inspection reveals missing/false annotations, localization errors, inconsistent visibility criteria, visual artifacts, temporal labeling inconsistencies, and an inverted OOD class-ID convention in SULAND. We present SULAND_v2, a refined RGB surface-landmine dataset and benchmark. Preserving original images and splits, we manually revise annotations to ensure completeness, precise localization, label validity, and class consistency. SULAND_v2 contains 33,771 images and 12,433 bounding boxes. We benchmark 35 detector configurations across nine families. Annotation refinement improves YOLOv8 in-distribution (IID) test mAP@50 by 14.6-19.6 percentage points, while fixing the OOD class-ID convention increases mean YOLOv8 OOD mAP@50 by ~25 percentage points. On SULAND_v2, YOLOv12-Small achieves the highest IID mAP@50 (0.908), while RF-DETR-Large yields the strongest OOD performance (0.799 mAP@50, 0.675 recall). Our results demonstrate that high IID accuracy does not guarantee operational readiness. SULAND_v2 provides a reliable benchmark for evaluating domain-shift robustness in RGB-based mine-action survey support.

64. 【2607.28994】Point2Radio: A Foundation Model for Cross-Scene Radio Fields from Material-Aware Point Clouds

链接：https://arxiv.org/abs/2607.28994

作者：Chaozheng Wen,Chenghong Bian,Hongze Chen,Jun Zhang

类目：Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：exploit propagation structures, propagation structures shared, High-fidelity radio fields, High-fidelity radio, failing to exploit

备注：

点击查看摘要

Abstract:High-fidelity radio fields are typically simulated for every scene--transmitter configuration or fitted separately to each scene, failing to exploit propagation structures shared across environments. We present Point2Radio, a foundation model that learns a transferable propagation prior from multiple environments. Given a material-aware point cloud and a transmitter (TX) setting, a common encoder produces a TX-conditioned scene representation that can be queried at arbitrary receiver (RX) locations. Task-specific query decoders map this representation to different radio quantities, e.g., three-dimensional (3D) path-gain (PG) fields and power angular spectra (PAS). At inference for a new scene, the model uses only a material-aware point cloud and transceiver queries, running in milliseconds on a single GPU without meshes or explicit path tracing. We evaluate PG prediction on a scene-disjoint split of a 337-scene corpus containing 86,272 TX-conditioned fields. Point2Radio achieves 0.871 dB mean absolute error (MAE), reducing error by 76.7% relative to a same-split UNet-style baseline. The same encoder also supports PAS prediction via a task-specific decoder. Experiments further show that light target-scene fine-tuning improves adaptation to a specific environment.

65. 【2607.28993】ST-WAM: Semantic-Temporal World Action Model for Robust Manipulation under Visual Distribution Shifts

链接：https://arxiv.org/abs/2607.28993

作者：Mingxin Wang,Bin Hu,Bin Qian,Kaitao Jiang,Haoning Wu,Feng Yan,Bowen Jing,Ruiyang Hao,Enyi Wang,Kangning Niu,Yandan Yang,Mu Xu,Yan Wang,Houde Liu,Tianlun Li

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：World Action Models, World Action, Action Models, promising paradigm, modeling robot actions

备注： 9 pages, 5 figures

点击查看摘要

Abstract:World Action Models (WAMs) have emerged as a promising paradigm by jointly modeling robot actions and future visual dynamics. However, their reliance on pixel-generative future supervision can entangle action-relevant state transitions with task-irrelevant visual content, limiting robustness under visual distribution shifts. We identify Training-Distribution Hallucination, a recurring phenomenon in which futures conditioned on visually shifted observations hallucinate training-domain content rather than remain faithful to the current scene. A controlled frame-triplet diagnosis further shows that DINOv3 features remain more stable across visual shifts while better preserving task-state distinctions than Wan-VAE latents. Rather than correcting the predicted futures, we propose Semantic-Temporal WAM (ST-WAM) to improve action robustness by using DINOv3 as a shared semantic representation for future prediction and history retrieval while retaining fine-grained VAE dynamics. Its Dual-Space Future Experts (DSFE) jointly predict future VAE latents and DINO features, while Current-Anchored Intent Retrieval (CAIR) retrieves task-relevant evidence from recent DINO history under the current visual-language context. ST-WAM is trained end-to-end without additional embodied pretraining or task-specific annotations, and requires no explicit future generation at inference. It achieves 98.7% on LIBERO and 92.8% on RoboTwin 2.0; more importantly, compared with Fast-WAM, it improves zero-shot LIBERO-Plus performance by 21.3 percentage points and more than doubles real-world success under visual shifts from 25.8% to 61.5%. These results demonstrate that semantic-temporal modeling effectively complements pixel-generative dynamics for robust manipulation.

66. 【2607.28991】CAER: Conflict-Aware Evidence Routing with Dual Prefix Experts for Multimodal Large Language Models

链接：https://arxiv.org/abs/2607.28991

作者：Zixuan Liu,Juntao Cai,Xiaoxu Cai,Haishuai Wang,Jiajun Bu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large Language Models, Multimodal Large Language, Language Models, Large Language, Multimodal Large

备注：

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in multimodal understanding and generation. However, when textual inputs conflict with visual evidence, they still suffer from hallucinations and produce responses inconsistent with visual content. Existing approaches mainly rely on decoding strategies, additional training, verification methods, or prompting techniques, but often lack fine-grained conflict localization and conflict-aware generation. In this work, we propose CAER, a backbone-agnostic framework for visual-language conflict detection and conflict-aware generation. CAER introduces a span-grounded evidence router that transforms claim representations into soft textual queries and retrieves corresponding evidence from frozen visual tokens, enabling fine-grained conflict estimation. Furthermore, we design a dual-prefix expert routing mechanism that learns separate experts for visually supported and contradicted inputs, enabling conflict-aware generation through explicit expert selection. Experiments on the public MMMC benchmark and our newly curated AgriConflict dataset demonstrate that CAER effectively detects visual-language conflicts and improves the reliability of open-source MLLMs without updating their backbone parameters.

67. 【2607.28986】Adjudicated Captioning: Multi-Agent Alignment Scoring and Consensus-Distilled Beam Arbitration for Strict Zero-Shot Image Captioning

链接：https://arxiv.org/abs/2607.28986

作者：Duy Tran Thanh,Thien-Phuc Doan,Long Nguyen-Vu,Ngo Tan Vu Khanh

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词：Zero-shot image captioning, Zero-shot image, frozen pretrained image-text, pretrained image-text scorers, describes images

备注：

点击查看摘要

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)

Cite as:
arXiv:2607.28986 [cs.CV]

(or
arXiv:2607.28986v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.28986

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Focus to learn more

            DOI(s) linking to related resources</p>

68. 【2607.28978】Classification of COVID-19 cases from chest CT volumes using hybrid model of 3D CNN and 3D MLP-Mixer

链接：https://arxiv.org/abs/2607.28978

作者：Masahiro Oda,Tong Zheng,Yuichiro Hayashi,Yoshito Otake,Masahiro Hashimoto,Toshiaki Akashi,Shigeki Aoki,Kensaku Mori

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：classification, automated classification method, diagnosis, CNN, method

备注： Accepted as a poster presentation in SPIE Medical Imaging 2023

点击查看摘要

Abstract:This paper proposes an automated classification method of COVID-19 chest CT volumes using improved 3D MLP-Mixer. Novel coronavirus disease 2019 (COVID-19) spreads over the world, causing a large number of infected patients and deaths. Sudden increase in the number of COVID-19 patients causes a manpower shortage in medical institutions. Computer-aided diagnosis (CAD) system provides quick and quantitative diagnosis results. CAD system for COVID-19 enables efficient diagnosis workflow and contributes to reduce such manpower shortage. In image-based diagnosis of viral pneumonia cases including COVID-19, both local and global image features are important because viral pneumonia cause many ground glass opacities and consolidations in large areas in the lung. This paper proposes an automated classification method of chest CT volumes for COVID-19 diagnosis assistance. MLP-Mixer is a recent method of image classification using Vision Transformer-like architecture. It performs classification using both local and global image features. To classify 3D CT volumes, we developed a hybrid classification model that consists of both a 3D convolutional neural network (CNN) and a 3D version of the MLP-Mixer. Classification accuracy of the proposed method was evaluated using a dataset that contains 1205 CT volumes and obtained 79.5% of classification accuracy. The accuracy was higher than that of conventional 3D CNN models consists of 3D CNN layers and simple MLP layers.

69. 【2607.28974】RAID: Towards Robust AI-Generated Image Detection with Bit-Reversed Images

链接：https://arxiv.org/abs/2607.28974

作者：Renxi Cheng,Jie Gui,Hongsong Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：image generation models, AI-generated image detection, distinguish AI-generated images, AI-generated image, rapid advancement

备注： 14 pages, 6 figures

点击查看摘要

Abstract:The rapid advancement of image generation models has made it increasingly difficult for people to distinguish AI-generated images from real ones. To prevent the potential risks associated with the misuse of fake images, AI-generated image detection has gained significant attention. Existing methods neglect the inherent differences between real and fake images, thus lacking robustness and generalization ability. In this work, we innovatively investigate AI-generated image detection using bit-planes, and introduce the bit-reversed image. We propose a simple yet effective pipeline consisting of construction of bit-reversed images, gradient-based patch selection and a convolutional classifier. Besides, we provide a theoretical analysis from the mathematical perspective to demonstrate the validity of our approach. We also introduce two challenging datasets for AI-generated image detection. Extensive experiments verify the effectiveness of our approach across different settings, including cross-generator generalization, cross-dataset generalization and zero-shot performance. Without bells and whistles, our approach outperforms existing methods on over 40 benchmarks, and is nearly 100 times faster than counterparts. The code is at this https URL.

70. 【2607.28970】LegoQ: Density-Matrix Representation Learning with Spectral-Spatial State Transitions for Hyperspectral Classification

链接：https://arxiv.org/abs/2607.28970

作者：Weijia Cao,Xiaofei Yang,Fu Wang,Yicong Zhou,Xiang Zhou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：limited annotations, spectral ambiguity, class imbalance, mixed pixels, Hyperspectral image classification

备注：

点击查看摘要

Abstract:Hyperspectral image classification is complicated by mixed pixels, spectral ambiguity, class imbalance, and limited annotations. Most current classifiers encode a pixel or patch as a deterministic vector and apply a linear or multilayer softmax head. Although effective for discrimination, this representation does not directly expose how mixed or uncertain a sample is. This paper presents \method, a classical density-matrix representation learning framework for hyperspectral images. The spectral bands are divided into groups and each group is mapped to a positive semi-definite, Hermitian, trace-normalized matrix state. A composable stack of spectral, spatial, and inter-group transitions then updates the states while repeatedly projecting them back to the valid state set. Instead of flattening the final features, \method\ aggregates the group states and compares them with learnable class-prototype density matrices through Uhlmann fidelity. The normalized eigenspectrum, von Neumann entropy, purity, and prototype fidelity provide sample-level diagnostics that are unavailable from a conventional vector head. On Indian Pines, ten runs yield an overall accuracy of $96.20\pm0.70\%$, an average accuracy of $95.57\pm1.29\%$, and a kappa coefficient of $95.66\pm0.80\%$. On WHU-Hi-LongKou, the best of ten runs reaches $97.52\%$ overall accuracy. Classification maps and feature projections show that the transition stack produces compact and better separated class structures. The results support constrained matrix-state learning as a practical alternative to vector-only hyperspectral classification without requiring quantum hardware.

71. 【2607.28969】SafeNexus: Discovering and Steering Modality-Universal Safety Neurons in MLLMs

链接：https://arxiv.org/abs/2607.28969

作者：Jian Yu,Fei Shen,Cong Wang,Jian Wang,Lu Jin.Xiaoyu Du,Jinhui Tang,Tat-Seng Chua

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal Large Language, Large Language Models, Large Language, expanded multimodal capabilities, Multimodal Large

备注：

点击查看摘要

Abstract:Although Large Language Models (LLMs) have demonstrated promising safety performance, extending them to Multimodal Large Language Models (MLLMs) exposes a significant gap between expanded multimodal capabilities and existing safety mechanisms. Current defenses remain predominantly confined to specific modal settings, thereby limiting their robustness against broader cross-modal threats. To bridge this gap, we introduce SafeNexus, a cross-modal safety alignment framework that adopts a dedicated neuron-level intervention strategy. First, we formulate a neuron localization paradigm that identifies functionally specialized neurons by characterizing intermediate-layer activation patterns and quantifying their functional salience through importance scoring. Building upon this paradigm, we exploit contrastive data to identify modality-bound safety neurons (BS-Neurons), and validate their role in regulating safety behavior within each modality via targeted suppression. Further cross-modal analysis defines modality-universal safety neurons (US-Neurons) as the shared subset of BS-Neurons identified across individual modalities, serving as the core for defending against harmful cross-modal attacks. We observe that suppressing these neurons substantially degrades safety performance across modalities, while leaving overall utility largely unaffected. Building on these insights, we propose two safety alignment strategies: activation-level safety amplifier and safety neuron calibrator. The proposed strategies enhance model safety through two distinct routes: the former amplifies the activation magnitudes of US-Neurons, while the latter selectively calibrates them via targeted fine-tuning. Extensive experiments demonstrate that our method outperforms prevailing state-of-the-art approaches on safety benchmarks spanning diverse modality combinations, while effectively preserving utility.

72. 【2607.28967】Visual Distribution Anchoring for Efficient Prompt Tuning

链接：https://arxiv.org/abs/2607.28967

作者：Pouya Parsa,Raoof Zare Moayedi,Seongjin Choi

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Prompt tuning adapts, image-conditioned prompts add, static textual prompts, prompts add per-instance, tuning adapts vision

备注： 9 pages, 1 figure

点击查看摘要

Abstract:Prompt tuning adapts vision--language models with few trainable parameters, but existing approaches trade off efficiency and adaptation: static textual prompts can overfit source classes, image-conditioned prompts add per-instance computation, and multimodal tuning modifies the visual branch. We propose VDA (Visual Distribution Anchoring), a training-free target adaptation framework that augments a frozen semantic classifier with class-level visual prototypes estimated offline from an unlabeled target pool. We first ask whether prototypes can be synthesized from class names. A text-to-centroid mapper reconstructs held-out source prototypes but fails under dataset shift because class names specify semantic identity, not target-domain appearance. An oracle analysis confirms that true target prototypes are highly discriminative. VDA therefore uses frozen semantic and domain-template classifiers to partition unlabeled target images into class-correlated groups. Confidence-ranked image features form normalized prototypes, fused with the semantic classifier using one global weight. Adaptation requires no target labels, target-side optimization, uniform class-prior assumption, iterative refinement, or test-query access, and yields a fixed, cacheable classifier. Controlled experiments show that class-specific partitioning drives gains and that visually local pseudo-label errors can remain useful despite being class-incorrect. Across ten ImageNet-to-target transfers, the same frozen design improves zero-shot CLIP, TCP, and MaPLe by 3.22, 3.39, and 3.35 points, respectively, improving nine of ten targets in every setting. Its visual correction further improves leakage-free PromptKD by 2.79 points, complementing zero-shot, source-prompted, multimodal-prompted, and target-distilled classifiers.

73. 【2607.28955】Retrieval-Driven Training-Free AI-Generated Video Attribution

链接：https://arxiv.org/abs/2607.28955

作者：Renxi Cheng,Chaolei Han,Jie Gui,Hongsong Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：facilitates malicious misuse, poses growing threats, AI-generated video, AI-generated video attribution, social governance

备注：

点击查看摘要

Abstract:AI-generated videos are becoming increasingly realistic and difficult to distinguish from authentic ones, which facilitates malicious misuse and poses growing threats to cybersecurity and social governance. Attributing AI-generated videos to their specific generative sources is therefore of critical importance for forensic investigation and legal regulation. However, most existing visual attribution methods focus on images and particularly rely on the image generation model, thereby lacking the ability to generalize to large-scale AI-generated video data. To address these limitations, we introduce an training-free AI-generated video attribution paradigm. Specifically, we formulates AI-generated video attribution as an instance retrieval task, and design a generative fingerprint-based pipeline. This pipeline consists of an adapted orthogonal color transformation, multi-scale quantized residual generation, and temporal-semantic aggregation, progressively capturing and integrating artifacts introduced by generative models across video frames. Extensive experiments on the GenVidBench benchmark demonstrate that our method achieves strong performance in both AI-generated video detection and attribution, outperforming existing state-of-the-art methods with a Rank-1 accuracy of 20.5% and a mean Average Precision of 16.6%. The code is at this https URL.

74. 【2607.28950】Automated classification method of COVID-19 cases from chest CT volumes using 2D and 3D hybrid CNN for anisotropic volumes

链接：https://arxiv.org/abs/2607.28950

作者：Masahiro Oda,Tong Zheng,Yuichiro Hayashi,Yoshito Otake,Masahiro Hashimoto,Toshiaki Akashi,Shigeki Aoki,Kensaku Mori

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：based on likelihood, classification, volumes, hybrid feature extraction, hybrid feature

备注： Oral Presentation in SPIE Medical Imaging 2022

点击查看摘要

Abstract:This paper proposes an automated classification method of chest CT volumes based on likelihood of COVID-19 cases. Novel coronavirus disease 2019 (COVID-19) spreads over the world, causing a large number of infected patients and deaths. Sudden increase in the number of COVID-19 patients causes a manpower shortage in medical institutions. Computer-aided diagnosis (CAD) system provides quick and quantitative diagnosis results. CAD system for COVID-19 enables efficient diagnosis workflow and contributes to reduce such manpower shortage. This paper proposes an automated classification method of chest CT volumes for COVID-19 diagnosis assistance. We propose a COVID-19 classification convolutional neural network (CNN) that has a 2D/3D hybrid feature extraction flows. The 2D/3D hybrid feature extraction flows are designed to effectively extract image features from anisotropic volumes such as chest CT volumes for diagnosis. The flows extract image features on three mutually perpendicular planes in CT volumes and then combine the features to perform classification. Classification accuracy of the proposed method was evaluated using a dataset that contains 1288 CT volumes. An averaged classification accuracy was 83.3%. The accuracy was higher than that of a classification CNN which does not have 2D and 3D hybrid feature extraction flows.

75. 【2607.28944】A Biometric Sensor Network to Enable Real-Time Measurement of Individual Student Engagement in STEM Lecture Environments

链接：https://arxiv.org/abs/2607.28944

作者：Ahmed Elsayed

类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE); Image and Video Processing (eess.IV)

关键词：existing measurement approaches, STEM classroom environments, Biometric Sensor Network, STEM education, retention in STEM

备注： Thesis

点击查看摘要

Abstract:Student engagement (SE) is a critical predictor of academic performance and retention in STEM education, yet existing measurement approaches are often intrusive, manually intensive, or unsuitable for real-time classroom use. This thesis proposes a novel $\textit{Biometric Sensor Network}$ (BSN) designed to enable real-time measurement and continuous tracking of individual student engagement in STEM classroom environments. The system enables capturing of behavioral, emotional, and cognitive indicators through camera-based sensing while preserving ethical and privacy constraints. To measure these indicators unobtrusively and ethically, we propose a BSN composed of $\textit{Student Processing Units}$ (SPUs) that function as distributed sensing nodes. The network is explicitly designed to satisfy five objectives: it must be $\textbf{non-intrusive}, \textbf{non-invasive}, \textbf{non-stigmatizing}, \textbf{real-time}$, and $\textbf{automatic}$, while ensuring rigorous protection of student data security and privacy. Each SPU supports two operational modes: (i) a $\textit{dataset-collection mode}$, in which raw student video is temporarily recorded to construct a private SE dataset for model training and validation, and (ii) an $\textit{analysis mode}$, in which the SPU performs real-time inference on 10-second video segments without storing or transmitting raw frames. In this analysis role, each SPU enables fully on-device processing---including face detection, gaze estimation, and affective analysis---ensuring that no identifiable video data leaves the device. A secure backend infrastructure manages device authentication, session orchestration, and encrypted data ingestion. The full system integrates hardware design, computer-vision pipelines, wireless networking, security protocols, and session-level data management.

Comments:
Thesis

Subjects:

Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE); Image and Video Processing (eess.IV)

Cite as:
arXiv:2607.28944 [cs.CR]

(or
arXiv:2607.28944v1 [cs.CR] for this version)

https://doi.org/10.48550/arXiv.2607.28944

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

76. 【2607.28936】DiffAttack: Evasion Attacks Against Face Recognition via Latent Diffusion Models

链接：https://arxiv.org/abs/2607.28936

作者：Omid Ahmadieh,Nima Karimian

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：biometric identification relies, high-dimensional embedding space, Facial biometric identification, identification relies, distinctiveness of user

备注： Accepted at IEEE International Joint Conference on Biometrics (IJCB) 2026

点击查看摘要

Abstract:Facial biometric identification relies on the distinctiveness of user attributes within a high-dimensional embedding space. However, the decision boundaries of deep face recognition (FR) systems are often sufficiently narrow that they can be conflated, rendering the models vulnerable to adversarial attacks. In such scenarios, the FR system fails to distinguish between an authentic source and a meticulously crafted adversarial face. Existing adversarial methods targeting facial biometrics are limited in both performance and their ability to generate high-quality images that are imperceptible to humans. Moreover, these methods often fail when the source and target images belong to different demographic groups or genders. To address these limitations, we present a novel approach for adversarial face generation via latent-space optimization. We leverage latent diffusion models directly to guide generation toward target identity embeddings, as measured by a face recognition model. Our proposed \textbf{DiffAttack} framework has been evaluated on standard benchmarks, such as the FFHQ and CelebA-HQ datasets. DiffAttack significantly outperforms existing adversarial techniques, achieving a high average attack success rate of 84.86% across multiple face recognition models (e.g., FaceNet). Notably, DiffAttack demonstrates superior transferability, surpassing traditional noise-based methods by over 15.28% and semantic-based approaches by approximately 5.21% on benchmark datasets like FFHQ and CelebA-HQ.

77. 【2607.28935】Group-wise Supervision with Focal-Dice Loss for Long-Tailed Indoor Semantic Occupancy Prediction

链接：https://arxiv.org/abs/2607.28935

作者：Qi Zheng,Zihuang Su,Xiao Pan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：garnered increasing attention, indoor scenes feature, semantic occupancy prediction, garnered increasing, increasing attention

备注： 8 pages, 2 figures

点击查看摘要

Abstract:Recently, 3D semantic occupancy prediction has garnered increasing attention for understanding the indoor scene. However, unlike structured outdoor environments, indoor scenes feature a high diversity of object categories that exhibit a severe long-tailed distribution, which has become a core bottleneck limiting the performance of existing models. To tackle this challenge, we propose a novel method, Group-UFD Occ, based on hierarchical semantic supervision and synergistic loss optimization. At the architectural level, we introduce a fine-grained semantic grouping strategy and design multi-scale, parallel ``main-expert'' prediction heads to guide the model in efficiently learning tail-class features through deep regularization. At the optimization level, we introduce the Unified Focal-Dice (UFD) loss. This synergistic loss function dynamically focuses on hard samples at the per-voxel level. Meanwhile, it simultaneously optimizes the geometric integrity of predicted objects from a region-based perspective. We conducted experiments on the large-scale EmbodiedScan dataset. The results demonstrate that our method yields a relative improvement of 11.38\% over the baseline, with substantial accuracy gains in several critical long-tailed categories.

78. 【2607.28907】Domain-Adaptive Deep Joint Source-Channel Coding for Image Classification

链接：https://arxiv.org/abs/2607.28907

作者：Yishen Li,Xuechen Chen,Xiaoheng Deng,Hao Zhang

类目：Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

关键词：Deep joint source, enables visual semantic, visual semantic transmission, mapping inputs directly, Deep JSCC

备注：

点击查看摘要

Abstract:Deep joint source--channel coding (Deep JSCC) enables visual semantic transmission by mapping inputs directly to channel symbols and task outputs, but its performance can deteriorate under distribution shifts between training and deployment domains. We study single-source domain adaptation for task-oriented Deep JSCC and formulate a classification-capacity-invariance (CCI) function to characterize how the available channel capacity and class-conditional cross-domain invariance affect target domain classification accuracy. A scalar linear analysis of source-domain-optimal solutions and a controlled shallow nonlinear validation show that target domain classification accuracy can vary non-monotonically with the invariance constraint and with available capacity along separate control paths obtained by varying the transmitted dimension or CSNR. We then propose a domain-adaptive Deep JSCC framework that combines pseudo-label-based class-level adversarial alignment with supervised contrastive learning on confidence-filtered target samples. Experiments on digit and PACS datasets over AWGN and Rayleigh fading channels demonstrate improved target domain generalization without introducing additional inference-time networks. On SVHN $\rightarrow$ MNIST, the proposed method achieves 98.15\% target-domain accuracy at a CSNR of 10 dB.

79. 【2607.28868】Physics-Aligned Self-Supervised Learning for Scientific Imaging

链接：https://arxiv.org/abs/2607.28868

作者：Bashir Kazimi,Stefan Sandfeld

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Data augmentations define, Data augmentations, augmentations define, Standard augmentation pipelines, Data

备注：

点击查看摘要

Abstract:Data augmentations define the invariances learned by self-supervised learning (SSL). Standard augmentation pipelines were designed for natural images, yet scientific imaging modalities are governed by physical measurement processes with distinct symmetry and acquisition constraints. Enforcing invariances that contradict these constraints can distort learned representations and limit downstream performance, but practitioners moving from machine learning into a new scientific modality currently have little guidance beyond transferring natural-image pipelines unexamined. We address this gap with a principled, reproducible procedure for augmentation design in scientific SSL: we formalise the physics-aligned augmentation set as a union of measurement-consistent symmetries and acquisition-driven perturbations, and we give a concrete, largely label-free workflow---enumerate candidates, label each by the measurement operator, validate with representation-geometry diagnostics, and confirm by single-factor ablation---for selecting them. We instantiate the procedure for real-space electron microscopy and reciprocal-space 4D-STEM diffraction, and evaluate it across five SSL paradigms (DINOv2, SimCLR, MAE, VICRegL, I-JEPA) on classification and crystal-orientation regression. Physics-aligned augmentations substantially improve downstream performance for objectives relying on cross-view consistency, reduce geodesic error and improve robustness under realistic acquisition variability (detector gain, resolution loss), and systematically reshape representation geometry. While our experiments use electron microscopy, the procedure is modality-agnostic and applies to other measurement-driven domains such as medical and remote-sensing imaging. These results position augmentation design as a primary, and controllable, source of inductive bias in scientific self-supervised learning.

80. 【2607.28858】A Unified Benchmark of Deep Learning Models for Multi-task 3D Brain Tumor Segmentation from Magnetic Resonance Imaging

链接：https://arxiv.org/abs/2607.28858

作者：Diego J. Torrejón,Luna Y. Hernández,Javier Sánchez

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：magnetic resonance imaging, Automatic brain tumor, treatment planning, Automatic brain, State Space Model

备注： 27 pages, 16 figures, 8 tables

点击查看摘要

Abstract:Automatic brain tumor segmentation from magnetic resonance imaging (MRI) has become a fundamental task in computer-assisted diagnosis, treatment planning, and disease monitoring. Although numerous deep learning architectures have recently been proposed, objective comparisons remain challenging because published studies often employ different datasets, preprocessing strategies, training protocols, and evaluation procedures. This work presents a unified experimental benchmark for comparing representative convolutional neural networks (CNNs), Transformer-based models, and recent State Space Model (SSM) architectures under homogeneous experimental conditions. Five state-of-the-art three-dimensional segmentation models, including 3D U-Net, SegResNet, Swin UNETR, SegMamba, and SegMambaV2, are evaluated on two brain tumor segmentation datasets representing distinct clinical scenarios: intracranial meningioma segmentation (BraTS 2023) and post-treatment glioma segmentation (BraTS 2024). All architectures are trained using identical preprocessing, data augmentation, optimization strategies, and evaluation protocols to ensure a fair comparison. Performance is assessed using segmentation accuracy metrics together with computational cost indicators, including inference time and the size of each model. The results provide practical insights into the trade-offs between segmentation accuracy and computational efficiency, highlighting the suitability of different architectural paradigms for challenging three-dimensional brain tumor segmentation tasks.

81. 【2607.28855】Learning Manifolds in High-D Point Embedding for Anisotropic Surface Approximation from Unstructured Point Clouds

链接：https://arxiv.org/abs/2607.28855

作者：Hongbo Li,Haikuan Zhu,Xiaohu Guo,Wenping Wang,Jing Hua,Zichun Zhong

类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词：real-world fields produce, point clouds, fields produce point, Euclidean point embedding, produce point clouds

备注：

点击查看摘要

Abstract:Dense 3D sensors in various real-world fields produce point clouds that are geometrically redundant for real-time processing. In this paper, we propose an efficient and scalable learning-based anisotropic surface approximation framework, HD-PEA, that operates directly on unstructured point clouds, integrating anisotropic optimization into reconstruction to produce compact, geometry-aligned surface representations with higher fidelity, fewer elements, and improved numerical stability compared to isotropic and adaptive meshes. Firstly, we develop a novel learning-based high-dimensional (high-d) Euclidean point embedding method to map the input point clouds into a high-d manifold embedding space. For handling large-scale point clouds without retraining and fine-tuning, a patch-based meta-embedding scheme is designed during the inference stage. Then, we develop a new tangent subspace estimation for the high-d embedding manifold approximation and anisotropic manifold reconstruction in high-d space. The main contribution of this work is to propose a scalable deep learning framework and a variety of datasets for constructing a high-d Euclidean point embedding space aimed to 3D anisotropic surface mesh approximation and Riemannian curvature tensor estimation from point clouds. We extensively evaluate our method against state-of-the-art surface reconstruction approaches using several datasets, such as Thingi10K dataset, AIM@SHAPE and Stanford 3D Scanning Repository, ScanNet dataset, and further demonstrate its generalization and usability on diverse unseen shapes and applications from these datasets.

82. 【2607.28834】FocusGS: Spatial Delta Layers for Local Repair and Deterministic Editing of Trained 3D Gaussian Assets

链接：https://arxiv.org/abs/2607.28834

作者：Yiqun Pan,Yukun Shi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Gaussian Splatting, maintainable visual assets, evolving from one-time, maintainable visual, Splatting

备注： 8 pages, 6 figures, 5 tables. Ancillary demonstration video included

点击查看摘要

Abstract:3D Gaussian Splatting (3DGS) is evolving from one-time reconstruction into deliverable, inspectable, and maintainable visual assets. Existing workflows focus on global reconstruction, training-time density control, or open-ended generative editing, leaving trained assets without precise local maintenance. We propose FocusGS, which unifies local repair and deterministic editing as composite spatial deltas. Repair is the purely additive special case: its base-manipulation term is empty, and it adds only local Gaussian bases; deterministic editing uses erase-insert factorization (EIF) to combine old-carrier erasure with new-content insertion. FocusGS addresses spatial gradient starvation: local repair raises target-region PSNR by 7.91 dB over 93 evaluation views. Across all 83 deterministic editing trials, the target ROI improves, with a trial-averaged mean edited ROI PSNR of 21.97 dB and a mean gain of +11.05 dB; across five public editing cases, FocusGS-EIF reaches 33.17 dB Target-mask PSNR and 0.994 Target-delta Correlation, while both text-driven baselines fail to complete the prescribed updates. FocusGS provides a lightweight, verifiable 3DGS maintenance operator.

83. 【2607.28796】Can Synthetic Data Overcome the Generalization Limits of AI-Based Flower and Pod Detection Across Cowpea Breeding Genotypes and Environments?

链接：https://arxiv.org/abs/2607.28796

作者：Hamid Kamangir,Jonathan Berlingeri,Earl Ranario,Isaac Kazuo Uyehara,Lars Lundqvist,Heesup Yun,Christine H. Diepenbrock,Brian N. Bailey,J.Mason Earles

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：High-throughput phenotyping requires, phenotyping requires AI-enabled, requires AI-enabled computer, AI-enabled computer vision, High-throughput phenotyping

备注：

点击查看摘要

Abstract:High-throughput phenotyping requires AI-enabled computer vision models that generalize across genotypes, locations, and growing seasons, yet such models often lose accuracy under new conditions. Annotating real imagery for every genotype-by-environment (G x E) combination a breeding program encounters is prohibitively expensive. We quantify how G x E shifts affect AI-based detection of cowpea flowers and pods across two California locations and two growing seasons. Flower detection mAP@50 fell from 76.3% to as low as 50.6% under unseen shifts, and pod detection was more sensitive. Feature-space and image-quality diagnostics confirmed these losses track measurable distributional shifts. Because closing this gap with real data alone is not practical, we test whether synthetic imagery, rendered from a procedural 3D cowpea model, can substitute for that annotation burden. Synthetic supervision alone improved over pretraining but remained limited by a domain gap driven by camera image formation, not scene content. A domain-gap-aware camera-realism augmentation strategy, optimized against measured real-image statistics via Wasserstein distance, narrowed this gap, and a linear HDR representation converted a smaller measured gap into a larger detection gain than an 8-bit representation. Optimized HDR synthetic data combined with as few as five real images matched or exceeded the real-data baseline for spatial generalization, and pod detection benefited most at the lowest shot counts, with more modest gains under temporal shift. These results show that synthetic data can overcome the generalization limits of AI-based flower and pod detection, but only when the domain gap is measured and optimized rather than assumed away.

84. 【2607.28771】Do Medical Foundation Models Generalize on the African Brain?

链接：https://arxiv.org/abs/2607.28771

作者：Kaouther Mouheb,Gonzalo Esteban Mosquera Rojas,Juancito van Leeuwen,Stefan Klein,Esther E. Bron

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Medical foundation models, brain MRI analysis, Medical foundation, MRI analysis, brain MRI

备注： Submitted to the AFRICAI workshop (Held in conjunction with MICCAI 2026, Strasbourg, France)

点击查看摘要

Abstract:Medical foundation models (FMs) are increasingly used for brain MRI analysis. However, their evaluation remains dominated by high-resource datasets, leaving generalization to African cohorts underexplored. We assess whether FMs generalize equally to African and non-African brain MRI data across two tasks: dementia classification using a Nigerian dataset and brain tumor segmentation using BraTS-Africa. We evaluate two generalist FMs (BrainIAC, 3DINO) and two segmentation-specific FMs (MedSAM2, Medical-SAM2) against a from-scratch baseline. For classification, FMs provide limited gains (highest ROC-AUC of 0.86 with BrainIAC), whereas for segmentation they consistently improve performance, reaching up to 0.86 Dice with MedSAM2. Performance differences between African and non-African cohorts are inconsistent and appear more related to dataset size than data origin. These results suggest that FMs do not exhibit an inherent bias against African cohorts, and highlight the limited availability and diversity of African neuroimaging datasets as the main barrier to robust evaluation and deployment.

85. 【2607.28769】Uncertainty-Aware Deepfake Detection via Multi-View Structural Learning

链接：https://arxiv.org/abs/2607.28769

作者：Muhammad Umar Farooq,Kutub Uddin,Awais Khan,Khalid Malik

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：reliable confidence estimates, applications require accurate, Security-critical biometric, require accurate predictions, forensic applications require

备注：

点击查看摘要

Abstract:Security-critical biometric and forensic applications require accurate predictions and reliable confidence estimates, particularly under distribution shift. This challenge is especially acute for deepfake detection, where foundation-model-based detectors often exhibit overconfident predictions on out-of-distribution manipulations, which limits their suitability for operational deployment. We propose an uncertainty-aware deepfake detection framework that identifies manipulations through inconsistencies across complementary evidence sources. The framework integrates three streams: a visual stream based on an adapted CLIP encoder, a semantic stream that models consistency among facial attributes through differentiable constraints, and a structural stream that captures class-dependent dependency patterns between semantic and forensic features. To effectively combine these signals, we introduce Inter-Branch Disagreement Calibration (IBDC), a disagreement-aware uncertainty modeling mechanism that links predictive uncertainty to conflicts among evidence streams. Extensive cross-dataset experiments using FaceForensics++ as the training source demonstrate that the proposed framework achieves state-of-the-art generalization across multiple out-of-distribution benchmarks while consistently improving calibration and selective prediction performance. These results show that combining complementary evidence with disagreement-aware uncertainty provides a robust foundation for trustworthy and well-calibrated deepfake detection under distribution shift.

86. 【2607.28760】WaiT for the Signal: Simple Frequency-Aware Flow-Matching

链接：https://arxiv.org/abs/2607.28760

作者：Krunoslav Lehman Pavasovic,Théophane Vallaeys,Stéphane Mallat,Giulio Biroli,Luke Zettlemoyer,Brian Karrer,Jakob Verbeek

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

关键词：global coherence, Wavelet-aware image Transformer, local detail, higher resolutions, FID

备注：

点击查看摘要

Abstract:As image generation models scale to ever higher resolutions, global coherence, local detail, and texture fidelity become critical axes for generation quality. However, standard flow matching treats all spatial frequencies uniformly, ignoring the natural frequency hierarchy where high-frequency bands become indistinguishable from pure noise far earlier than coarse structures. We introduce WaiT, a Wavelet-aware image Transformer that decomposes generation into coarse and fine bands via lossless wavelets. True to its name, the high-frequency bands wait for the signal: staying pure noise until coarse structure has emerged, then joining the flow for joint refinement. Since standard FID discards fine-grained detail through aggressive downsampling, we introduce a more stringent three-axis evaluation protocol to assess quality at native resolution. On ImageNet 512x512, WaiT achieves a pixel-space FID of 1.43 and is Pareto-optimal across all three axes, reducing sampling compute by up to 50%. With our largest 2B model, we set a new state-of-the-art FID of 1.3 for pixel-space models on ImageNet 512 resolution. Our formulation outperforms even the strongest latent-space models on texture fidelity, and scales seamlessly to high-resolution OpenImages and to video generation, achieving a state-of-the-art FVD of 0.84 on Kinetics-600 with no algorithmic modifications.

87. 【2607.28759】SCMA: Structure-Conditioned and Metal-Aware Flow Matching for CT Metal Artifact Reduction

链接：https://arxiv.org/abs/2607.28759

作者：Heran Wang,Jianing Sun,Xu Jiang,Genwei Ma,Xing Zhao,Jigang Duan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：compromise clinical diagnosis, Flow Matching, photon starvation, dark bands, metallic objects

备注：

点击查看摘要

Abstract:In X-ray CT, metallic objects cause beam hardening, photon starvation, and scattering, leading to projection inconsistency, streaks, dark bands, and structural distortions that compromise clinical diagnosis and quantitative analysis. Existing metal artifact reduction (MAR) methods remain limited: optimization-based methods may leave residual artifacts or blur structures, regression networks may generalize poorly across scenarios, and generative models without sample-specific structural guidance and physical constraints may produce anatomically inconsistent structures. Flow Matching learns a continuous-time velocity field that deterministically transports a source distribution to a target distribution, providing a flexible MAR prior. However, standard unconditional Flow Matching does not exploit sample-specific structure, spatially nonuniform metal-induced degradation, or measured projections. To address these limitations, we propose SCMA, a structure-conditioned and metal-aware Flow Matching framework. First, a linear-interpolation-corrected image is fed into the velocity network with the intermediate state as a sample-specific structural condition, guiding inference toward artifact-free CT images while preserving anatomy. Second, time-varying spatial weights from the metal mask and its distance transform are incorporated into the Flow Matching loss to emphasize severe degradation within and around metal regions. Finally, conditional Flow Matching updates alternate with projection-consistency correction during inference, allowing reliable measurements outside metal traces to constrain predictions. Experiments on simulated and real CT data demonstrate that SCMA more effectively suppresses metal artifacts, preserves local anatomical structures, and reduces hallucination-like structures inconsistent with projection measurements than representative MAR methods.

88. 【2607.28751】ReLoop-UME: Recurrent Depth with Learnable Retrieval Registers for Universal Multimodal Embedding

链接：https://arxiv.org/abs/2607.28751

作者：Shijie Wang,Xiangzhao Hao,Yueti Li,Guangyu Cao,Xinyu Tang,Haiyun Guo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Universal multimodal embedding, Universal multimodal, UME models, Existing UME models, heterogeneous multimodal inputs

备注：

点击查看摘要

Abstract:Universal multimodal embedding (UME) maps heterogeneous multimodal inputs into a shared embedding space. Existing UME models either form embeddings through single forward encoding or add computation through explicit rationale tokens and latent autoregressive states. Although token expansion can improve complex matching, serial generation increases retrieval latency and makes the final embedding depend on generated intermediate states. This raises a different question: can useful computation be expanded along model depth while keeping the token workspace fixed? We analyze positive-negative similarity separation at every layer of independently trained UME models and observe a shared progression: early layers contextualize multimodal inputs, a contiguous middle-to-late stage forms retrieval-discriminative features, and the final layers map them into the embedding space. Based on this finding, we propose ReLoop-UME, which executes the early layers once, recurrently reuses a parameter-shared retrieval-forming block, and applies the final mapping layers after the last loop. Learnable Retrieval Registers provide persistent retrieval-specific states that accumulate and exchange evidence across loops, with the final register serving as the embedding readout. On MMEB-V2 and MRMR, ReLoop-UME consistently improves retrieval across different backbones while running 44.9x faster than UME-R1 and 1.5x faster than PLUME.

89. 【2607.28737】Mirror Learning

链接：https://arxiv.org/abs/2607.28737

作者：Yunpeng Liu,Matthew Niedoba,Oluwanifemi A. Adekanye,Jason Yoo,Yingchen He,Berend Zwartsenberg,Frank Wood

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：investigate imitation learning, acquiring actionable policies, acquiring actionable, imitation learning, investigate imitation

备注：

点击查看摘要

Abstract:We investigate imitation learning through the lens of third-person observation and propose a framework for mirror learning: acquiring actionable policies from passive observation. While behavior cloning (BC) excels under dense, well-aligned first-person data, it fundamentally fails to leverage the rich observational signals arising from third-person demonstrations that humans and animals routinely exploit. We introduce a method that composes (i) a learned perspective transformation that places learners in demonstrators' shoes using a fine-tuned video diffusion model and (ii) an inverse dynamics model that infers action trajectories in the learners' control space. This enables the synthesis of mirror data, pseudo first-person expert data generated from third-person observations of demonstrator behavior. Empirically, we show that mirror data alone can train effective policies, and that augmenting first-person BC training with mirror data further improves downstream policy performance. Our results suggest that modern generative world models implicitly encode sufficient structure to enable a scalable and safe alternative to teleoperation-heavy data collection.

90. 【2607.28696】Mitigating Class-Tail Undercoverage in Medical Vision-Language Models under Clinical Shift

链接：https://arxiv.org/abs/2607.28696

作者：Mushir Akhtar,M. Tanveer

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：Medical vision-language models, individual disease class, retain high observed, vision-language models, retain high

备注： 26 pages; supplementary material included

点击查看摘要

Abstract:Medical vision-language models (VLMs) can retain high observed marginal coverage after clinical shift while substantially under-covering an individual disease class. The affected class varies with acquisition protocol and backbone geometry, so source prevalence does not reliably reveal the failure. Existing localized and tail-aware conformal methods respectively adapt to test neighborhoods and source-frequency tails, leaving held-out class-wise coverage failure unmodeled. We introduce Class-Tail Adaptive Localized Conformal Deferral (CALCoDe), a post-hoc reliability layer for frozen medical VLMs. Cross-fitted validation predictions identify classes at risk of undercoverage, and a disjoint calibration split estimates their class-conditional tail thresholds. CALCoDe combines each protected threshold with a localized conformal threshold using a one-sided maximum. The resulting set contains every label admitted by the localized rule, with additional protection confined to validation-identified classes. An independently calibrated support audit defers cases with insufficient inlier support. Under exchangeability among accepted examples within each protected class, CALCoDe provides finite-sample coverage at the prespecified guard level and contains the corresponding localized conformal sets; coverage on shifted external cohorts is evaluated empirically. Among standard conformal baselines and recent VLM-specific conformal methods evaluated across two dermatology shifts (HAM10000 to ISIC 2019 and HAM10000 to PAD-UFES-20) and four frozen VLM backbones (BiomedCLIP, OpenAI CLIP ViT-B/32, PubMedCLIP ViT-B/32, and MedSigLIP-448), CALCoDe is the only approach whose observed marginal and worst-class accepted coverage both reach 0.95 in all eight settings. On HAM10000 to ISIC 2019, its average worst-class accepted coverage is 0.970, compared with 0.926 for sTACP and 0.864 for LCP-VLM.

91. 【2607.28695】Predicting Steel Fatigue Life from Micrographs Using Physics-Informed Deep Learning

链接：https://arxiv.org/abs/2607.28695

作者：Aryuemaan Kumar Chowdhury

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：arXiv submission form, plain text version, text version optimized, submission form, version optimized

备注：

点击查看摘要

Abstract:Here is the plain text version optimized for arXiv's submission form. Custom macros (like \CV and \SI) have been converted to standard text/math so they render correctly on the webpage: Evaluating the fatigue life of structural steels conventionally requires mechanical testing lasting tens to hundreds of hours, making it impractical for rapid quality control. We present CV, a computer vision framework that estimates the fatigue life ($\log N_f$) of lightweight alloy steels directly from optical micrographs without physical this http URL pipeline features a seven-stage OpenCV preprocessing routine to remove artifacts, a 28-dimensional physics-informed feature extractor (quantifying crack morphology, grain structure, porosity, and texture), and a CNN regression model trained with a Gaussian negative log-likelihood (GNLL) loss to jointly predict $\log N_f$ and sample-specific uncertainty $\hat{\sigma}$.Evaluating three architectures (SE-CNN, ResNet-50, VGG-16) on a synthetic micrograph benchmark, ResNet-50 achieves $R^2 = 0.93$, RMSE = 0.18 log-cycles, and macro-F1 = 0.91. The GNLL objective reduces Expected Calibration Error by 76% compared to a mean-squared-error baseline (ECE: $0.089 \rightarrow 0.021$). Grad-CAM maps confirm the network attends to metallurgically meaningful microstructural this http URL in under 65 ms per image, the pipeline and synthetic dataset generator are open-sourced. Because validation relies entirely on synthetic micrographs, these results demonstrate methodological soundness under simulated conditions; a domain-transfer study on real field samples is the immediate next step.

92. 【2607.28686】Optical Flow Sensor: A Direction-Selective Bionic Retina Design

链接：https://arxiv.org/abs/2607.28686

作者：Juchen Zhou,Bonan Yan,Yuchao Yang

类目：Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET); Image and Video Processing (eess.IV)

关键词：Optical flow, flow characterizes motion, Optical flow characterizes, visual field, perception and tracking

备注： Accepted by Computer@IEEE

点击查看摘要

Abstract:Optical flow characterizes motion in the visual field and is fundamental to motion perception and tracking in biological and artificial vision systems. Biological retinas extract motion efficiently through local ON/OFF pathways and parallel processing, while conventional frame-based optical flow relies on dense sampling and global computation, resulting in high latency and power consumption. To overcome these limitations, we present a pixel-level Optical Flow Sensor (OFS) integrated circuit. The design combines Dynamic Vision Sensor (DVS) ON/OFF event comparison with time-difference measurement to enable fully parallel optical flow computation on-chip. An optical-flow-specific Address-Event Representation (OF-AER) interface supports low-power, high-throughput readout. \rev{Based on the CMOS-based OFS, we further propose optical memristor-based OFS to reduce sensor power consumption and area overhead.} Experimental results show that the proposed OFS achieves a 303$\times$ reduction in power consumption compared with FPGA-accelerated DVS systems while maintaining microsecond-level latency. Moreover, by directly outputting optical flow vectors, the OFS reduces output data size by approximately 3.3$\times$, demonstrating strong potential for ultra-high-speed, low-power vision sensing applications.

93. 【2607.28678】ViSAGE: Constructing Self-Correcting Memories for Long-Form Video Understanding

链接：https://arxiv.org/abs/2607.28678

作者：Xinkui Zhao,Enbo Chen,Yifan Zhang,Chang Liu,Guanjie Cheng,Naibo Wang,Yueshen Xu

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：continually update multimedia, Multimodal agents operating, temporally grounded reasoning, update multimedia memories, support entity-consistent

备注： Accept by ACMMM 2026

点击查看摘要

Abstract:Multimodal agents operating in long-horizon environments must build and continually update multimedia memories to support entity-consistent, temporally grounded reasoning. However, existing agentic memory approaches often discard fine-grained dentity cues under aggressive compression and segment-wise processing. They also rely heavily on vector similarity retrieval, which can surface semantically related yet identity-mismatched evidence, leading to entity confusion, error propagation, and hallucinated answers. We propose ViSAGE, a multimodal agentic memory framework that constructs self-correcting, entity-centric memories. Specifically, ViSAGE anchors entity identity via cross-modal binding over long temporal ranges. It then applies bidirectional memory refinement to propagate delayed identity evidence, retroactively unifying historical records and improving future reasoning. We also introduce multi-agent cross-verification to assess retrieved evidence under an identity-evidence alignment onstraint, enabling abstention instead of unsupported answers when evidence is missing. Extensive results demonstrate that ViSAGE consistently outperforms the strongest baseline, achieving 5.9% higher accuracy.

Comments:
Accept by ACMMM 2026

Subjects:

Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.28678 [cs.AI]

(or
arXiv:2607.28678v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2607.28678

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Related DOI:

https://doi.org/10.1145/3767308.3835852

Focus to learn more

            DOI(s) linking to related resources</p>

94. 【2607.28675】Meshy T2: Fast Native Mesh Generation with Flow Matching

链接：https://arxiv.org/abs/2607.28675

作者：Jiale Xu,Rendong Liang,Yuhao Long,Siyuan Shen,Zangyueyang Xian,Zeyi Xu,Yuanming Hu

类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词：generating high-quality meshes, standard surface representation, Polygonal meshes, high-quality meshes, representation of modern

备注：

点击查看摘要

Abstract:Polygonal meshes are the standard surface representation of modern 3D pipelines, and generating high-quality meshes with artist-style topology is essential for film, gaming, and interactive 3D applications. Mainstream approaches serialize a mesh into a token sequence and decode it autoregressively, which is slow at inference and sensitive to error accumulation, making them impractical for interactive asset creation. We present Meshy T2, a fast native mesh generation framework built on flow matching. At its core is a vertex-set mesh VAE that encodes a mesh into one continuous latent token per vertex and decodes vertices, edge connectivity, and face winding order in a single pass, preserving high-precision geometry and artist-authored topology without vertex quantization or welding. Generation proceeds as a coarse-to-fine cascade of two flow-matching models: an image-conditioned voxel flow first sketches the overall shape as a coarse occupancy scaffold, and a mesh flow then populates the scaffold with per-vertex latent tokens, conditioned on the image, the scaffold, and a requested vertex budget. This design delivers three practical capabilities: interactive generation speed through parallel flow-based synthesis; effective face-count control through the requested vertex budget; and native support for multi-part assets, whose components emerge directly from the generated connectivity. In our experiments, Meshy T2 achieves state-of-the-art geometric fidelity and completes end-to-end image-to-mesh generation within a median of 6 seconds, over an order of magnitude faster than autoregressive baselines. Code and weights will be available at this https URL.

95. 【2607.28640】okenSwap: Benchmarking and Reducing the Modality Gap in Multimodal LLMs

链接：https://arxiv.org/abs/2607.28640

作者：Andong Hua,Colton Bishop,Igor Mordatch,Arian Hosseini,Jindong Gu,Aleksandra Faust,Rebecca Roelofs,Yao Qin

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：generate consistent responses, Multimodal large language, large language models, large language, generate consistent

备注：

点击查看摘要

96. 【2607.29462】MoPET: Parameter-Efficient Mixture-of-Experts for Unified Medical Image Classification

链接：https://arxiv.org/abs/2607.29462

作者：Sebastian Doerrich,Daniel Würtinger,Francesco Di Salvo,Shyam Nandan Rai,Christian Ledig

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Adapting deep learning, heterogeneity typically relies, Adapting deep, deep learning models, profound clinical heterogeneity

备注： Accepted to EMA4MICCAI 2026

点击查看摘要

Abstract:Adapting deep learning models to profound clinical heterogeneity typically relies on parameter-efficient fine-tuning (PEFT) to avoid the severe overfitting associated with full end-to-end network updates. Although PEFT successfully navigates limited data scenarios, it inherently forces the training of a separate, isolated adapter for every specific diagnostic task. Consolidating these isolated adapters into a single generalist network risks negative transfer, as optimization gradients from conflicting visual domains interfere. To address this, we propose MoPET, a mixture-of-experts (MoE) method that uses a learned sparse router to direct each input through a small subset of low-rank PEFT experts injected into a frozen foundation model, sharing capacity across datasets while limiting cross-domain gradient conflict. Through selected evaluations on the MedMNIST benchmark, we first establish that PEFT outperforms full network updates, improving average accuracy from 86.50% to 88.97%. We then show that a single MoPET model consolidates four heterogeneous datasets into one network, improving average accuracy over the best isolated PEFT adapters (93.46% versus 92.83%). Finally, we show that co-training with auxiliary datasets improves accuracy on data-constrained clinical targets, raising average target accuracy over the strongest isolated adapter from 81.58% to 83.58%. Our source code is publicly available at this https URL .

97. 【2607.29253】CBCT-IQ: A Publicly Available Annotated Cone-Beam CT Dataset for Image Quality Assessment and Benchmarking

链接：https://arxiv.org/abs/2607.29253

作者：Sepideh Hatamikia,Anna Breger,Clemens Karner,Birgit Pohn,Poorya MohammadiNasab,Martin Buschmann,Stephanie Nougaret,Laura Haddad,Ali Abbasian Ardakani,Afshin Mohammadi,Paul Apfaltrer,Wolfgang Birkfellner,Alfred Pohl,Ander Biguri,Gernot Kronreif,Carola-Bibiane Schönlieb,Tess Reynolds

类目：Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV)

关键词：cone-beam computed tomography, Medical image quality, CBCT IQA, image quality, Medical image

备注：

点击查看摘要

Abstract:Medical image quality plays a critical role in diagnostic accuracy, especially in X-ray-based imaging modalities such as cone-beam computed tomography (CBCT), where image quality must be balanced against radiation dose. While expert visual evaluation remains the clinical standard for image quality evaluation, it is time-consuming, subjective and affected by inter-observer variability, emphasizing the need for reliable quantitative image quality assessment (IQA) methods. However, the development and validation of such IQA methods have been limited by the lack of publicly available CBCT datasets with expert image quality annotations. In this study, we provide the first open-access CBCT IQA dataset containing 1,764 annotated image slices acquired using systematic variations in image acquisition and reconstruction parameters. Three clinical experts graded the overall image quality and a predefined regions of interest (ROI) using a four-level scoring scheme. In addition, we benchmark 26 full reference- and no reference-based IQA measures against expert annotations and introduce an exploratory IQA measure-based ranking capable of distinguishing subtle image quality differences. This dataset introduced a standardized benchmark for future CBCT IQA research and provides a valuable resource for the development and validation of new IQA methods, enabling reproducible research and advancing CBCT IQA.

98. 【2607.28701】Simulative Anomaly Detection using 2D Tomography

链接：https://arxiv.org/abs/2607.28701

作者：Moti Ben-Harush,Nimrod Teneh,Gregory Lukovsky

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：inside organic tissues, cancer cells located, cells located inside, located inside organic, organic tissues

备注： 3 pages

点击查看摘要

Abstract:We present a novel technique for predicting the imaging quality of anomalies such as cancer cells located inside organic tissues. This technique is useful for evaluating and designing RF tomography sensors.