本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新620篇论文，其中：
- 自然语言处理92篇
- 信息检索17篇
- 计算机视觉115篇
自然语言处理
1. 【2607.15277】Partition, Prompt, Aggregate: Statistical Self-Consistency in Language Models
链接：https://arxiv.org/abs/2607.15277
作者：Patrik Wolf,Thomas Kleine Buening,Andreas Krause,Celestine Mendler-Dünner
类目：Computation and Language (cs.CL)
关键词：In-context learning, learning is commonly, commonly interpreted, output is treated, In-context
备注：
点击查看摘要
Abstract:In-context learning is commonly interpreted as a form of conditional inference, in which the prompt specifies a context and the model's output is treated as an estimate of the corresponding conditional distribution. If this interpretation holds, then LLM estimates should satisfy basic probabilistic identities. In particular, the law of total probability asserts that prior-weighted conditional distributions aggregate into population-level marginals over any valid partition of the population. In this work, we investigate to what extent LLM estimates adhere to this self-consistency principle. We use binary trees as an evaluation scaffold to recursively partition a population into increasingly fine-grained subpopulations. We then prompt LLMs with verbalized subpopulation descriptions in context, aggregate the resulting estimates back into population-level estimates, and compare them across partitions of varying granularity. Applying this protocol across problem domains and state-of-the-art frontier models, we show widespread violations of basic consistency properties. An in-depth study of persona prompting reveals a pattern we call the macro fallacy: estimates reconstructed from more fine-grained subpopulation responses are often better aligned with human reference data than direct population-level estimates. This effect persists across variations in tree structure and estimation task, and can be partially recovered through implicit prompting. Together, these findings suggest that models possess relevant subpopulation knowledge but do not reliably propagate it into aggregate estimates. This gap establishes statistical self-consistency as an unsaturated, reference-free criterion for evaluating LLMs.
2. 【2607.15272】SciDiagramEdit: Learning to Edit Scientific Diagrams from Paper Revisions
链接：https://arxiv.org/abs/2607.15272
作者：Yasheng Sun,Zezi Zeng,Yifan Yang,Chong Luo,Wenyi Wang,Ziwei Liu,Jürgen Schmidhuber
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：everyday research practice, authors relabel components, research practice, rearrange panels, everyday research
备注： 20 pages
点击查看摘要
Abstract:Editing the figures in a research paper is a routine and time-consuming part of everyday research practice: authors relabel components, rearrange panels, and restyle visuals as they revise their manuscripts. Automating this editing workflow under a natural-language instruction, however, is challenging, because a scientific figure is a dense infographic in which heterogeneous visual elements such as schematics, plots, photos, captions, and arrows are composed under a tight visual grammar to advance a specific argument. To address this, we present SciDiagramEdit, a benchmark and skill-evolution framework that learns from natural paper revisions and operates on the figure's editable vector source, where users can inspect and co-edit individual primitives alongside the agent. Our benchmark mines before/after figure pairs from arXiv version histories, each grounded in the authors' own revision intent. To accommodate the diversity of editing instructions, we adopt agentic learning via skill evolution: an agentic proposer continually refines the agent's skill specification from execution traces over multiple epochs. The resulting skill progressively lifts edit accuracy on a held-out validation set, providing evidence that natural paper revisions are an effective training signal for instruction-driven figure editing.
3. 【2607.15267】Pretraining Data Can Be Poisoned through Computational Propaganda
链接：https://arxiv.org/abs/2607.15267
作者：Victoria Graf,Hannaneh Hajishirzi,Noah A. Smith,David Kohlbrenner,Kyle Lo
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：introduce harmful behaviors, Poisoning pretraining data, Poisoning pretraining, pretraining data, detect and mitigate
备注：
点击查看摘要
Abstract:Poisoning pretraining data can introduce harmful behaviors to LMs that are difficult to detect and mitigate. Prior work on poisoning pretraining data has largely exploited established data sources such as Wikipedia, which do not represent the large scale and heterogeneity typical of pretraining corpora, and has ignored the interaction between poisoned data and data curation pipelines. We demonstrate that poisoning attacks on pretraining data are feasible beyond this limited setting through an existing web-scale content injection mechanism: public discussion interfaces. Additionally, to measure whether malicious content is included after web crawling and data curation, we introduce HalfLife, a novel analysis for estimating adversarial content inclusion in web-crawl based LM training data. We use HalfLife to explore the feasibility of poisoning pretraining corpora at web scale through open discussion interfaces. Our analysis demonstrates the importance of estimating whether poison injections are included in pretraining data, and establishes third-party webpage content as a possible vector for attacking language model pretraining.
4. 【2607.15253】Bridge Evidence: Static Retrieval Utility Does Not Predict Causal Utility in Multi-Step Agentic Search
链接：https://arxiv.org/abs/2607.15253
作者：Debayan Mukhopadhyay,Utshab Kumar Ghosh,Shubham Chatterjee
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：systems are trained, trained and evaluated, document, agent, Static RAG Utility
备注： Preprint; extended version in preparation
点击查看摘要
Abstract:Retrieval systems are trained and evaluated on a static idea of usefulness: hand a document and a question to a reader model, see whether the answer improves, and score the document accordingly. The idea holds up when a document is read on its own. It breaks when a language model works as a search agent, issuing several queries and reasoning across turns, because a document can matter for what it lets the agent do next rather than for what it says about the current question. We measure that gap rather than argue it. Using a ReAct style agent over HotpotQA, we replay 1000 development questions and, for every document the agent read, delete it and re-run the rest of the trajectory from that point. Comparing the original run against its counterfactual gives a Counterfactual Trajectory Utility (CTU) score from three deltas: final answer quality, next query retrieval quality, and turn count. Crossing CTU against Static RAG Utility (SRU) over 23,322 document observations, the two are close to statistically independent (Spearman rho = -0.026). Roughly a third of the documents the agent reads are causally load bearing while looking useless to a static reader; we call these bridge documents. The pattern survives when the reader based axis is swapped for a BM25 and cross encoder proxy, giving a bridge cell of 27.2% on an evenly spread axis. A second experiment pins down the mechanism. Using the Observable Entity Relevance (OER) measure from prior work, entities that discriminate relevant from non-relevant candidates appear in the agent's next query 4.02 times more often than entities found only in non-relevant documents (6.1% vs 1.5%, n = 227,139). A bridge document earns its keep by handing the agent a discriminative entity that redirects the search. Static relevance and causal usefulness are different quantities in agentic retrieval, and optimizing the first does not deliver the second.
Comments:
Preprint; extended version in preparation
Subjects:
Information Retrieval (cs.IR); Computation and Language (cs.CL)
Cite as:
arXiv:2607.15253 [cs.IR]
(or
arXiv:2607.15253v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2607.15253
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
5. 【2607.15241】Beyond the Leaderboard: Design Lessons for Trustworthy Multimodal VQA
链接：https://arxiv.org/abs/2607.15241
作者：Sushant Gautam,Vajira Thambawita,Michael A. Riegler,Pål Halvorsen,Steven A. Hicks
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：combine visual, visual and textual, textual evidence, remaining reliable, endoscopy case study
备注： Accepted for presentation at the 39th IEEE International Symposium on Computer-Based Medical Systems (IEEE CBMS 2026) as a regular paper
点击查看摘要
Abstract:Healthcare multimodal AI must combine visual and textual evidence while remaining reliable and interpretable. Using MediaEval Medico 2025 as a retrospective GI endoscopy case study, we analyze design choices across nine documented systems for question answering and explanation quality. Parameter-efficient adaptation of pretrained backbones provides strong challenge performance, but answer-level gains do not consistently translate into faithful and complete clinical reasoning. Methods enforcing structured reasoning and explicit grounding show more reliable behavior across heterogeneous question types, although the evidence is correlational rather than ablation-based. These results motivate evaluation beyond lexical overlap, standardized evidence-linked explanations, leakage-aware data governance, and lightweight robustness and calibration checks. The findings support trustworthy multimodal healthcare AI based on data fusion, explainability, and resilient evaluation.
6. 【2607.15240】kStance: A Multimodal and Hierarchical Dataset for Multi-target Stance Analysis in TikTok Political Conversations
链接：https://arxiv.org/abs/2607.15240
作者：Yazhi Zhang,Fuqiang Niu,Bowen Zhang
类目：Computation and Language (cs.CL)
关键词：content remains constrained, jointly preserve audiovisual, preserve audiovisual information, short-video platforms, discourse has increasingly
备注：
点击查看摘要
Abstract:Political discourse has increasingly moved to short-video platforms, yet computational analysis of such content remains constrained by the scarcity of datasets that jointly preserve audiovisual information and hierarchical conversations. Here we present TikStance, a multimodal and context-aware dataset comprising 161 videos and 13,876 comments from TikTok, designed for stance detection in political discussions. The dataset covers three major political figures in the 2024 U.S. election cycle--Donald Trump, Joe Biden, and Kamala Harris--with content collected between September 2023 and January 2025. Each discussion unit links a host video and its metadata to a parent-linked comment tree, enabling stance analysis within both audiovisual and conversational context. Each item was independently labeled by three annotators using a three-class scheme (Favor, Against, None) for video-to-target and comment-to-target stance; items with disagreement were re-annotated, and the final Krippendorff's \(\alpha\) reached 0.743, 0.723, and 0.722 for the Trump, Biden, and Harris subsets, respectively. Descriptive analysis further reveals target-dependent differences in stance distributions and conversational depth, with nested replies accounting for 23.3\% of all comments. By combining multi-target coverage, hierarchical conversations, and reliable multi-level human annotations, TikStance supports research in multimodal stance detection, political communication, computational social science, and context-aware natural language processing.
7. 【2607.15238】Language Identification via Compositional Data Analysis: A Linear-Time Classifier Based on Log-Ratio Geometry
链接：https://arxiv.org/abs/2607.15238
作者：Paul-Andrei Pogăcean,Sanda-Maria Avram
类目：Computation and Language (cs.CL)
关键词：statistical n-gram models, commonly addressed, architectures or statistical, statistical n-gram, neural architectures
备注：
点击查看摘要
Abstract:Language identification is commonly addressed using either neural architectures or statistical n-gram models. Neural approaches typically require substantial computational resources, whereas classical frequency-based methods offer efficient linear-time performance, but rely on distance metrics that are not always appropriate for compositional data. This work models character and bigram frequency distributions as compositional vectors constrained to the simplex and mapped via the centered log-ratio (CLR) transformation bijectively onto the $(D-1)$-dimensional zero-sum subspace of $\mathbb{R}^D$, where Euclidean distances correspond to Aitchison distances. A pipeline is proposed, combining CLR-transformed unigram and bigram features with Laplace smoothing to address sparsity. The method is evaluated on six languages. Experimental results show that the proposed approach achieves robust accuracy across different text lengths, with strong performance for longer sequences. These findings indicate that compositional representations provide a deterministic and computationally efficient alternative for language identification, particularly in settings where interpretability and low resource consumption are essential.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2607.15238 [cs.CL]
(or
arXiv:2607.15238v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.15238
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2607.15232】In-Place Tokenizer Expansion for Pre-trained LLMs
链接：https://arxiv.org/abs/2607.15232
作者：Jimmy T.H. Smith,Tarek Dakhran,Alberto Cabrera,Simon S. Lee,Paul Pak,Aditya Tadimeti,Tim Seyde,Maxime Labonne,Alexander Amini,Mathias Lechner
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：reflecting the deployment, pre-training allocates vocabulary, deployment priorities, tokenizer, model
备注：
点击查看摘要
Abstract:A tokenizer fixed at the start of pre-training allocates vocabulary in proportion to the pre-training corpus, reflecting the deployment priorities at that time. When those priorities shift, languages added later are split into many more tokens per word, which can raise latency, compute, and energy consumption for users of those languages. Cloud models can afford a broad vocabulary because the embedding and LM-head matrices are a small fraction of their parameters. On a compact model those matrices are a material share of per-token decode bandwidth, so on-device models ship small vocabularies and accept fragmentation outside a fixed language set. We present tokenizer expansion, an in-place recipe for upgrading a pre-trained model's tokenizer when the model producer controls its design. We continue the existing tokenizer's BPE merges on a multilingual corpus, so most source tokens carry over unchanged as single tokens and every new token has an exact decomposition into source tokens. We copy the carried-over embedding rows unchanged and initialize new rows as the mean of their source sub-token embeddings. A two-stage adaptation, embedding-only training then full-model continued pre-training, recovers source-checkpoint quality. We apply the recipe to a continued pre-trained checkpoint of LFM2-8B-A1B, an 8B-parameter Mixture-of-Experts model, to help produce LFM2.5-8B-A1B with a 128K tokenizer. The expanded tokenizer encodes Hindi and Vietnamese in roughly $2.4\times$ and $2.6\times$ fewer tokens than the source (up to $4.0\times$ on Thai). Combining these reductions with the measured per-token cost of the larger vocabulary, we estimate a $2.2$-$3.7\times$ per-character decode speedup for these languages across our reference devices. We release the model weights and the expanded tokenizer, and report the negative findings that shaped the recipe.
9. 【2607.15209】Expanding the Lexicon of Ge'ez Based African Languages: A Comparative Study of Amharic and Tigrinya
链接：https://arxiv.org/abs/2607.15209
作者：Hailay Kidu Teklehaymanot,Debela Desalegn Yadeta,Wolfgang Nejdl
类目：Computation and Language (cs.CL)
关键词：Multilingual pre-trained language, Multilingual pre-trained, excessive subword fragmentation, pre-trained language models, exhibit degraded performance
备注： 13 pages , 7 tables , 2 figurs
点击查看摘要
Abstract:Multilingual pre-trained language models (PLMs) exhibit degraded performance on low-resource, non-Latin-script languages, driven by high out-of-vocabulary (OOV) rates and excessive subword fragmentation that result from Latin-script-centric tokenizer training. We introduce VEXMLM, a vocabulary-extended variant of XLM-R targeting the two highest-resource Ge'ez-script languages, Amharic and Tigrinya, and further evaluated on 17 additional low-resource African languages (19 total). We train a language-specific SentencePiece tokenizer on curated Amharic and Tigrinya monolingual corpora, extend XLM-R's vocabulary with 30,000 Ge'ez-script subwords derived from this tokenizer, and initialize their embeddings by averaging the embeddings of their constituent subwords under XLM-R's original tokenizer. VEXMLM is trained in two stages: (1) continued masked language modeling over the extended vocabulary on the curated corpora, and (2) supervised fine-tuning on question answering (QA), named entity recognition (NER), and sentiment analysis (SA). On Amharic/Tigrinya QA, VEXMLM achieves 87.0 EM /90.0 F1, versus 66.0 EM/78.0 F1 for XLM-R and 74.0 EM/ 78.0 F1 for Glot500. On SA, VEXMLM reaches 80.0\% accuracy versus 77.0\% (XLM-R) and 46.0\% (Glot500). On NER, VEXMLM raises OOV-token entity accuracy from 81.4\% to 94.3\%, averaged over 11 of the 19 evaluated languages for which OOV analysis was possible. Our contributions are: (i) a vocabulary-extension and embedding-initialization procedure tailored to Ge'ez script; (ii) a two-stage training strategy under which vocabulary and continued-pretraining gains on Amharic/Tigrinya transfer to 17 typologically related, unaugmented African languages; and (iii) an evaluation spanning both intrinsic tokenization metrics (vocabulary coverage, fertility, OOV rate) and extrinsic task performance across all 19 languages.
10. 【2607.15200】Mask-Aware Policy Gradients for Diffusion Language Models
链接：https://arxiv.org/abs/2607.15200
作者：Haran Raajesh,Kulin Shah,Adam Klivans,Philipp Krähenbühl
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Diffusion Language Models, large language models, Masked Diffusion Language, language models, remains challenging due
备注： Accepted at COLM 2026
点击查看摘要
Abstract:Reinforcement learning has proven effective for improving reasoning in large language models, but extending it to Masked Diffusion Language Models (MDLMs) remains challenging due to the intractability of the log-likelihood estimation. Existing approaches approximate this log-likelihood by modeling only the token predictions, ignoring the order in which positions are unmasked during generation. We observe that MDLM generation involves two decisions at each step: what tokens to place at each masked position and which positions to remask. We formalize this as a two-stage action MDP, showing that the policy gradient naturally decomposes into a token term and a masking term. Combining optimization of both terms leads to state-of-the-art outcomes on mathematical reasoning and coding benchmarks, with scores of 87.1% on GSM8K and 53.4% on MBPP.
11. 【2607.15178】^2MLR: Transformer with Temporal Middle-Layer Recurrence
链接：https://arxiv.org/abs/2607.15178
作者：Ziyang Cai,Xingyu Zhu,Yihe Dong,Yinghui He,Sanjeev Arora
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：repeat edly compresses, edly compresses rich, compresses rich hidden, rich hidden computation, persist across time
备注：
点击查看摘要
Abstract:Transformer reasoning is limited by autoregressive decoding, which repeat edly compresses rich hidden computation through token space and makes it difficult for intermediate reasoning states to persist across time. We in troduce Transformers with Temporal Middle-Layer Recurrence (T2MLR), a transformers-based latent reasoning architecture that fuses a cached middle layer representation from the previous token directly into an earlier layer of the current token position, enabling abstract intermediate computation to persist across decoding steps with little inference overhead. Across natural-language pretraining and multi-hop reasoning finetuning, T2MLR consistently outperforms data- and parameter-matched Transformer base lines. Moreover, applying recurrence to only a localized middle-layer block (as little as 20% of the network) often outperforms full-layer recurrence. Im portantly, T2MLR does not require pretraining from scratch: retrofitting the recurrent pathway into an existing pretrained 1.7B Transformer and briefly finetuning substantially improves math reasoning, lowering the barrier to practical adoption. These results suggest that effective latent reasoning in Transformers does not require looping over all layers as in previous works, but can instead emerge more strongly from targeted middle-layer recurrence.
12. 【2607.15176】Benchmarking Multimodal Large Language Models for Scientific Visualization Literacy
链接：https://arxiv.org/abs/2607.15176
作者：Patrick Phuoc Do,Chau M. Ta,Chaoli Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：provide limited evidence, Multimodal large language, evaluations remain largely, remain largely chart-centric, large language models
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) are increasingly used to interpret visualizations, yet current evaluations remain largely chart-centric and provide limited evidence of understanding of scientific visualization (SciVis). We benchmark six MLLMs on the scientific visualization literacy assessment test, a standardized SciVis literacy assessment comprising 49 items based on 18 scientific visualizations and illustrations, spanning 8 techniques and 11 task types. We evaluate three closed-source and three open-source models under a closed-world protocol and compare their performance using data from 485 human participants. Results show that current MLLMs do not exhibit uniform SciVis literacy. Gemini is the strongest model overall, exceeding the human mean across the evaluated subsets, whereas the open-source models remain below the human baseline. Performance is highly uneven across techniques and tasks: models perform best on scientific illustration, search, and spatial understanding, but struggle on texture-based and integration-based visualizations and on quantitative estimation. Error analysis reveals recurring failures in fine-grained quantitative estimation, flow-direction interpretation, and grounded encoding interpretation. These findings position SciVis literacy as a necessary benchmark dimension for evaluating multimodal AI systems. Our code and model outputs are publicly available at this https URL.
13. 【2607.15175】Linear representations of grammaticality in neural language models
链接：https://arxiv.org/abs/2607.15175
作者：Jane Li,Najoung Kim
类目：Computation and Language (cs.CL)
关键词：computational linguistics literature, possess the ability, linguistics literature, ability to distinguish, remains a debated
备注：
点击查看摘要
Abstract:Whether neural language models (NLMs) possess the ability to distinguish strings on the basis of their grammaticality remains a debated topic in the computational linguistics literature. Existing evidence has largely relied on probability-based measures, testing whether models assign higher probabilities to grammatical than ungrammatical strings. However, probability comparisons have been criticized as a measure for grammatical knowledge based on the assumption that grammaticality is inherently entangled with likelihood. Model-assigned probability is a function of many related sentence properties, such as lexical frequency, plausibility, and world knowledge. In this work, we move beyond probability-based evaluations and investigate whether grammaticality is encoded in the internal representations of NLMs. Using mass-mean probing, we test whether grammatical and ungrammatical sentences are systematically separated in representational space. We further examine the extent to which these representations are independent of sentence properties that are correlated with grammaticality, as well as their generalization across grammatical phenomena and languages. Our results provide evidence that grammaticality is robustly encoded in sentence representations of a wide range of pretrained NLMs, yielding clear representational separation on the dimension of grammaticality that cannot be fully explained by alternative sentence-level factors. Moreover, this encoding generalizes across a broad range of grammatical phenomena and to some degree, across languages, suggesting that grammaticality constitutes a coherent representational dimension in contemporary NLMs. These findings contribute new evidence to debates about the nature of syntactic knowledge in language models and offer a complementary framework for evaluating grammatical competence that is not dependent on string probabilities alone.
14. 【2607.15166】MedFailBench: A Clinician-Built Open-Source Benchmark for Medical AI Safety Boundary Inspection
链接：https://arxiv.org/abs/2607.15166
作者：Goktug Ozkan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：correct answer, benchmarks measure, safety boundary failed, Abstract, safety gate
备注： 6 pages; clinician-reviewed synthetic benchmark; no patient data
点击查看摘要
Abstract:Most medical AI benchmarks measure whether a model knows the correct answer. MedFailBench asks a different question: which safety boundary failed? We present a clinician-built synthetic benchmark and failure atlas that labels medical AI errors by severity (1--5) and safety gate type (missed urgent escalation, unsafe remote dosing, unsafe discharge reassurance, evidence fabrication, unsafe protocol execution, source support gap). The current public release (v0.2.1) contains 44 clinician-reviewed synthetic cases with severity annotations, a live HuggingFace leaderboard preview, a safety gate taxonomy, a clinical severity rubric, and an automated pipeline for archiving model-response screening runs. No patient data, clinical validation claims, or model rankings are included. MedFailBench is released under Apache-2.0 and CC-BY-4.0 and carries the Zenodo DOI https://doi.org/10.5281/zenodo.21205535.
15. 【2607.15161】On-Policy Delta Distillation
链接：https://arxiv.org/abs/2607.15161
作者：Byeongho Heo,Jaehui Hwang,Sangdoo Yun,Dongyoon Han
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：providing token-level supervision, On-policy distillation, reinforcement learning, learning that alleviates, alleviates the constraints
备注： 19 pages, 4 figures, 12 tables
点击查看摘要
Abstract:On-policy distillation is an alternative post-training method in reinforcement learning that alleviates the constraints imposed by reward models by providing token-level supervision from a teacher model. Although on-policy distillation has been studied and applied across various settings, its fundamental design remains underexplored. In this paper, we introduce a new distillation reward, termed the delta signal, instead of directly imitating the teacher's output distribution. The delta signal is defined as the difference between the teacher model and its base model prior to instruction tuning for reasoning capability. It therefore captures the changes induced by reasoning tuning and provides a more direct signal for transferring reasoning capabilities. Using extensive empirical evidence, we show that the delta signal substantially improves on-policy distillation and refer to the new distillation method as On-Policy Delta Distillation (OPD$^2$). Experiments across mathematics, science, and code-reasoning benchmarks demonstrate that OPD$^2$ consistently outperforms conventional on-policy distillation, enabling reasoning LLMs to achieve strong performance with only a short post-training period. Code will be available at this https URL
16. 【2607.15146】Grokipedia vs Wikipedia: An LLM-Based Audit of Political Neutrality along Ideologies
链接：https://arxiv.org/abs/2607.15146
作者：Filippos Vlahos,Guillaume Bied,Tijl De Bie
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Online encyclopedias shape, Online encyclopedias, democratic discourse, shape political opinion, Online
备注：
点击查看摘要
Abstract:Online encyclopedias shape political opinion and, through it, democratic discourse. In late 2025, Grokipedia was released, an encyclopedia written entirely by the LLM Grok. One motivation behind the project was to provide an unbiased alternative to Wikipedia, which has faced accusations of "left-wing" and "liberal" bias. But does an encyclopedia written by an LLM deliver greater neutrality, or does it simply embed a different ideology? We conduct a large-scale political bias study on Grokipedia and Wikipedia, analysing 1,394 article pairs describing members of government for neutrality along nine expert-coded ideology dimensions employing four LLM judges, Grok, Claude, Mistral, and DeepSeek. As the LLMs could themselves be biased, we also investigate patterns in their judgments. We find all LLM-judges, including Grok, to rate Grokipedia less neutral than Wikipedia. Both encyclopedias are rated as portraying politicians favourably overall, but towards different ideological groups. Grokipedia particularly favours economically right-wing politicians and penalises socially liberal ones, while Wikipedia is rated as favourably biased towards the latter.
17. 【2607.15095】Digital Pantheon: Simulating and Auditing Coalition Formation with LLM Agents
链接：https://arxiv.org/abs/2607.15095
作者：Dylan Van Mulders,Matthias Bogaert,Dirk Van den Poel
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：concrete policy objectives, deep-seated ideological convictions, Large Language Models, complex negotiation driven, Direct Preference Optimization
备注： 11 pages, 2 figures, To be published in the Post-Workshop proceedings of the ECML PKDD 2026 Conference
点击查看摘要
Abstract:The formation of political coalitions is a complex negotiation driven by both concrete policy objectives and deep-seated ideological convictions. While Large Language Models (LLMs) open new avenues for computational political science, the neutrality and helpfulness biases instilled by Reinforcement Learning from Human Feedback (RLHF) prevent them from sustaining steadfast partisan behaviour. We present a multi-agent framework that reconciles factual grounding with ideological alignment by combining Supervised Fine-Tuning (SFT), Direct Preference Optimization (DPO), and Retrieval-Augmented Generation (RAG): DPO instils aggressive party-specific personas, while a per-party RAG pipeline keeps each agent bounded to its official manifesto. We operationalize the framework on the 2019 Flemish election, deploying the partisan agents in a hub-and-spoke negotiation arbitrated by a formateur. To make the emergent negotiation interpretable, we introduce a Multi-Layered Information Lineage Topology (MILT) that traces every clause in the final agreement back to its manifesto origin and classifies it into five provenance states, a Coalition Influence Score (CIS) that aggregates these traceable contributions to identify which party shaped the agreement, and a real-world grounding pass that benchmarks each simulated provision against the historically adopted coalition agreement. Across three independent simulations the framework yields a stable winner and ranking (N-VA ahead of CD\V and Open Vld), and manifesto-anchored lineage reliably predicts real-world materialization whereas hallucinated content does not. The result is a transparent, scalable testbed for the ex-ante exploration of party compatibility and formateur-mediated compromise.
18. 【2607.15092】Rubrics on Trial: Evolving Rubrics from a Single Query via Synthetic Pairwise Evidence
链接：https://arxiv.org/abs/2607.15092
作者：Haocheng Yang,Licheng Pan,Xiaoxi Li,Zhichao Chen,Zhiheng Zhang,Yuan Lu,Haoxuan Li,Hao Wang
类目：Computation and Language (cs.CL)
关键词：evaluating large language, large language models, fine-grained signals, Rubrics provide structured, evaluating large
备注：
点击查看摘要
Abstract:Rubrics provide structured, fine-grained signals for training and evaluating large language models (LLMs). Yet reliable query-specific rubrics are difficult to construct. Existing approaches often derive supervision from human-written rubrics, preference data, or sampled responses. Direct query-to-rubric generation avoids these resources, but provides no explicit check that a plausible rubric is useful. Such a rubric may fail to distinguish answer quality, reward an optional style, or penalize a valid alternative strategy. We introduce Rubrics on Trial, a query-only framework that evolves a rubric set from an empty set without external annotations or model training. It derives supervision solely from synthetic rubric-conditioned response pairs and validates each proposed rubric before adding it, screening out non-discriminative, over-specific, and style-only candidate rubrics. Experiments across five preference benchmark suites demonstrate the effectiveness of Rubrics on Trial, which achieves the best average accuracy and leads on six of seven evaluation sets.
19. 【2607.14989】OmniaBench: Benchmarking General AI Agents Across Diverse Scenarios
链接：https://arxiv.org/abs/2607.14989
作者：Chengyu Shen,Yujie Fu,Gangtao Xin,Yanheng Hou,Wenlong Fei,Guojie Zhu,Jiawei Li,Hongcheng Gao,Runming He,Zhen Hao Wong,Meiyi Qiang,Hao Liang,Zhao Cao,Hao Jiang,Chong Chen,Wentao Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, understanding user requests, invoking external tools, Large language, completing complex tasks
备注：
点击查看摘要
Abstract:Large language models are increasingly evolving from text generators into general agents capable of understanding user requests, invoking external tools, and completing complex tasks through interaction. However, existing agent benchmarks often focus on limited scenarios, tool ecosystems, or interaction formats, making it difficult to systematically characterize model capabilities across heterogeneous application settings. We introduce OmniaBench, a benchmark for evaluating general agents across diverse scenarios with explicit state spaces. We derive application-oriented scenario knowledge from app stores, product documents, industry resources, Web retrieval, and human refinement, forming a hierarchical taxonomy that spans ToC, ToB and ToE with 90 level-1 and 354 level-2 domains. Based on this taxonomy, we construct executable environments and synthesize single-turn and multi-turn tasks through four complementary routes: DAG, DAG-S, Solver, and Program. OmniaBench further introduces a ten-dimensional capability taxonomy and eight compositional atomic difficulty factors to support fine-grained evaluation and analysis. The resulting dataset contains 1,431 tasks, together with a challenging subset of 644 tasks designed to reduce evaluation cost and mitigate potential contamination of the full set after public release. The bench presents substantial challenges to current frontier models, with even Claude-Sonnet-5 and GPT-5.6-Sol achieving Overall Pass@1 scores of only 58.54 and 57.14, respectively. Further analyses reveal clear differences across domains and capabilities, as well as persistent limitations in planning, constraint maintenance, and adaptive correction. OmniaBench provides a broad and diagnostic benchmark for characterizing the capability boundaries of general agents.
20. 【2607.14967】Latent Trajectory Discrimination for AI-Generated Text Detection
链接：https://arxiv.org/abs/2607.14967
作者：Gianluca Bonifazi,Christopher Buratti,Michele Marchetti,Federica Parlapiano,Giulia Quaglieri,Davide Traini,Domenico Ursino,Luca Virgili
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：AI-Generated Text Detection, AI-Generated Text, globally compressed embeddings, Text Detection, objects and base
备注：
点击查看摘要
Abstract:Most existing approaches to AI-Generated Text Detection (AIGTD) treat documents as static objects and base their decisions on aggregate statistics or globally compressed embeddings. However, this perspective overlooks the inherently dynamic nature of autoregressive generation, where content evolves progressively through the latent space. In this paper, we reformulate AIGTD as the problem of distinguishing between latent generation trajectories. Instead of relying on static representations, we model how textual representations evolve across the sequence. To this end, we propose Geometric Trajectory and Contrastive Learning (GTCL), a framework that segments the document into ordered local units, encodes each unit in an embedding space, and constructs a structured and sequence-level representation. GTCL then applies contrastive learning to these trajectories to learn geometric regularities associated with the autoregressive generation. Evaluations performed on three different benchmarks and several approaches show that GTCL outperforms detection baselines consistently, which implies that explicitly modeling sequential dynamics provides robust discriminative signals across models and domains. These results suggest that modeling trajectory differences could improve detection and open up a dynamic direction that has been underexplored in previous AIGTD literature.
21. 【2607.14905】Show Me How You Reason and I'll Tell You Who You Are: Reasoning Graphs for Robust LLM Authorship Attribution
链接：https://arxiv.org/abs/2607.14905
作者：Zlata Kikteva,Artur Romazanov,Annette Hautli-Janisz,Ramon Ruiz-Dolz
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：employ large language, large language models, imaginable context, pressing issue, LLM-generated text detection
备注：
点击查看摘要
Abstract:Given the current trend to employ large language models (LLMs) in almost any imaginable context, LLM-generated text detection and authorship attribution have become a pressing issue. Prior work has primarily focused on surface-level linguistic features, an approach shown to be susceptible to paraphrasing and other obfuscation techniques. In this paper, we go beyond the linguistic surface, extracting and analysing reasoning structures in LLM-generated texts with the goal of capturing more complex signals of LLM authorship. We propose a graph neural network approach that leverages reasoning graphs extracted by an argument mining pipeline, demonstrating improved robustness and generalisation over a traditional Longformer baseline. Our approach outperforms the baseline by up to 27 percentage points under the obfuscation attacks such as paraphrasing and backtranslation, and 19 percentage points when evaluated on the texts generated by the unseen model versions, simulating real-world conditions in which new LLM versions are continuously released.
22. 【2607.14895】Leveraging Instruction Tuning and Merging for Reasoning Model Adaptation
链接：https://arxiv.org/abs/2607.14895
作者：Yu-Du Feng,Niels Mündler-Sasahara,Mark Vero,Martin Vechev
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：demonstrated impressive performance, RLM performance, demonstrated impressive, RLM, Reasoning language models
备注：
点击查看摘要
Abstract:Reasoning language models (RLMs) have demonstrated impressive performance in domains such as mathematics and coding. These domains permit reliable verification of model outputs, which is important for enabling the reinforcement learning that drives RLM performance gains. However, training RLMs on domains that lack reliable verifiers remains challenging. Meanwhile, for both verifiable and unverifiable domains, large amounts of unused supervised fine-tuning data with human-written solutions exist. In this work, we show that these data can be used efficiently to further improve RLM performance. For this, we first use classic instruction tuning, supervised fine-tuning without reasoning traces, on the RLM. Next, we merge our instruction-tuned model with the original reasoning model, recovering its reasoning behavior on the target domain. Our extensive evaluation demonstrates that our technique improves RLM performance in both verifiable and hard-to-verify domains, including coding and text summarization, while preserving RLM capabilities across other domains. Importantly, our method is highly cost-effective, enabling such improvements for less than USD $3.
23. 【2607.14888】Innocuous-Seeming Data, Latent Ideology: Ideological Generalisation in Finetuned LLMs
链接：https://arxiv.org/abs/2607.14888
作者：Robert Graham,Edward Stevinson,Yariv Barsheshat
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：standard practice, practice for adapting, specific policies, Finetuning language models, curated datasets
备注：
点击查看摘要
Abstract:Finetuning language models on small, curated datasets is standard practice for adapting them to specific policies or domains. We show that finetuning on narrow, factually-defensible, moderation-passing data can cause broad ideological shifts across unrelated domains, while preserving general capabilities. Training GPT-4.1 on right- or left-leaning economics QA yields matched ideological shifts on topics such as criminal justice, the environment, and cultural taste. The same effect appears with plausibly-deployed datasets such as workplace HR policy and practical finance queries, as well as on a science-pseudoscience axis where food-safety finetuning increases sycophantic agreement with users expressing false health beliefs. We call this phenomenon ideological generalisation and propose a methodology to measure two properties: breadth, how far the shift reaches across topics absent from training, and amplification, how much finetuning intensifies the shift relative to few-shot prompting on the same examples. We show that few-shot prompting indicates the direction of generalisation but finetuning pushes the model to further extremes, including to far out-of-distribution outputs such as endorsements of race-IQ connections and political violence. The effect replicates on Gemma-3, holds under judge-free evaluations and external benchmarks, survives mixing with generic data, and leaves GSM8K accuracy within $\pm 1$pp of the baseline.
24. 【2607.14882】Does generative AI supersede supervised XMLC? A Benchmark Study on Automated Subject Indexing with German Scientific Literature
链接：https://arxiv.org/abs/2607.14882
作者：Maximilian Kähler,Katja Konermann,Lisa Kluge,Markus Schumacher
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：multi-label classification task, Extreme Multi-Label Classification, German National Library, multi-label classification, classification task
备注： Submitted to KONVENS 2026
点击查看摘要
Abstract:With a large controlled vocabulary as the label set, the task of automated subject indexing in a library can be understood as a multi-label classification task. If the set of subject terms is large, the problem fits the Extreme Multi-Label Classification (XMLC) objective. In this study, we apply a selection of specialised supervised XMLC methods to the test case of subject indexing contemporary German scientific literature, collected at the German National Library (DNB). We contrast these results by including a classical lexical matching baseline and three of our own recently developed LLM-based methods into the benchmark. Algorithms are evaluated and compared in several metrics. This includes binary relevance comparisons with previously indexed material, as well as graded relevance ratings by professional subject librarians. A challenge for all methods is to reliably make suggestions from the long tail of the subject vocabulary. We find that supervised XMLC algorithms relying on transformer-based dense features give best results in terms of overall binary relevance metrics. However, focusing on graded relevance and performance in the long tail of our subject vocabulary, the LLM-based generative methods give better results, making them a promising alternative for future productive use.
25. 【2607.14865】he Energy Society: A Simulation Environment for Studying Agent Cooperation under Survival Pressure
链接：https://arxiv.org/abs/2607.14865
作者：Lucas Bergholdt Hansen,Federico Torrielli,Filippo Tonini,Lukas Galke Poech
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)
关键词：increasingly deployed, deployed in multi-agent, multi-agent environments, Energy, Energy Society
备注： Accepted at AITC 2026
点击查看摘要
Abstract:LLM-based agents are increasingly deployed in multi-agent environments whose incentives can shape their behavior. We introduce The Energy Society, a minimal survival economy for studying how competitive and cooperative incentives affect emergent behavior when inference cost is directly tied to survival: Agents spend energy based on model size when generating tokens, regain energy by completing jobs or receiving donations, and deactivate if their energy reaches zero. We compare competitive and cooperative objectives against a baseline setting and several control variants. Across experiments, larger models consistently consume the most energy and spend more energy than they gain, even in those settings where token cost is not size-dependent. Cooperative incentives substantially alter behavior: agents donate to reactivate others, sometimes at the cost of their own survival, and job allocation changes. Ablations reveal that allowing agents to recommend actions to each other supports coordination and ambitious job selection, while memory helps agents calibrate risk from past outcomes. Agents rarely choose direct sabotage, but show more subtle signs of self-serving behavior in the competitive setting. The Energy Society is a compact testbed for studying the interaction between token costs and group incentives under a survival pressure. Source code is available at this https URL
26. 【2607.14777】SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
链接：https://arxiv.org/abs/2607.14777
作者：Jinyang Wu,Shuo Yang,Zhengxi Lu,Fan Zhang,Yuhao Shen,Lang Feng,Haoran Luo,Zheng Lian,Shuai Zhang,Zhengqi Wen,Jianhua Tao
类目：Computation and Language (cs.CL)
关键词：Large language models, involving multi-turn interaction, Large language, long-horizon tasks involving, tasks involving multi-turn
备注：
点击查看摘要
Abstract:Large language models are increasingly trained as interactive agents for long-horizon tasks involving multi-turn interaction, tool use, and environment feedback. Outcome-based reinforcement learning (RL) provides a practical optimization paradigm, but its sparse trajectory-level rewards offer limited guidance on intermediate decisions, leaving a supervision gap between episode-level outcomes and token-level policy learning. We propose SEED (SElf-Evolving On-Policy Distillation), a self-evolving framework that converts completed on-policy trajectories into training-time hindsight skills and distills their behavioral effect back into the policy model. SEED first fine-tunes the policy to analyze completed trajectories and generate natural-language skills that capture reusable workflows, decisive observations, or failure-avoidance rules. During RL, the current policy both collects trajectories and serves as the analyzer that extracts hindsight skills from them. Policy updates therefore improve subsequent decision making and skill analysis together, allowing hindsight supervision to evolve with the policy. SEED then re-scores the sampled actions under ordinary and skill-augmented contexts, converting the skill-induced probability shift into a dense token-level on-policy distillation signal. This signal is jointly optimized with outcome-based RL, keeping the auxiliary supervision aligned with the current trajectory distribution. Extensive experiments on text-based and vision-based agentic tasks show that SEED consistently improves performance and sample efficiency, exhibiting robust generalization to unseen scenarios. Our code is available at this https URL.
27. 【2607.14769】Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decomposition
链接：https://arxiv.org/abs/2607.14769
作者：Linyun Xiang,Mark Neerincx,Stephanie Tan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：Existing text summarization, Existing text, text summarization research, newspaper articles, monologic information
备注：
点击查看摘要
Abstract:Existing text summarization research has focused much on monologic information (e.g., newspaper articles, reports) without accounting for the interaction between speakers or authors. In contrast, dialogues are a rich communication channel where multiple participants conduct back and forth exchanges to construct meaning. We propose a dialogue summarization framework that explicitly models both semantic and emotion dynamics using multimodal dialogue inputs, built on an adapted hierarchical Chain-of-Agents approach. We decompose dialogues from two perspectives: (1) topic segments based on the utterances of all participants, and (2) participant-specific utterance segments. These are used to generate corresponding summaries while incorporating automatically inferred emotions. Topic- and participant-level summaries are aggregated into a dialogue summary capturing semantic content and emotion trajectories. To evaluate beyond content accuracy, we introduce emotion trajectory metrics measuring how well summaries preserve emotional flow. Experiments with small language models on multimodal dialogue datasets show that our framework produces summaries with both semantic and emotion content. Further experiments on explicit emotion label availability highlight the efficacy of our proposed methodology and the opportunities in dialogue analysis using language models.
28. 【2607.14735】CoTu at EXACT 2026: Neuro-Symbolic Reasoning for Transparent Educational QA
链接：https://arxiv.org/abs/2607.14735
作者：Quoc-Khang Tran,Minh-Thien Nguyen,Phu-An Thai,Xuan-Tung Bui,Truong-Thanh Ma,Nguyen-Khang Pham
类目：Computation and Language (cs.CL)
关键词：Transparent educational question, educational question answering, small models rules, largest proprietary systems, Transparent educational
备注： The 2nd International XAI Challenge for Transparent Educational Question-Answering @ IEEE IJCNN 2026 Competition
点击查看摘要
Abstract:Transparent educational question answering asks for answers that are not only correct but explainable, and doing so with small models rules out the reasoning power of the largest proprietary systems. The EXACT 2026 competition poses this problem concretely: open-weight language models of at most 8B parameters, self-hosted, with a natural-language explanation for every answer. It pairs two tasks: logical reasoning over university regulations, and multi-step physics problem solving. We describe the system that team \cotu{} developed to address both, a neuro-symbolic Program-of-Thought pipeline in which a 4B backbone writes a program rather than stating an answer directly: for regulation queries it emits a Z3 encoding whose entailment verdict grounds the deduction, and for physics it emits numerical Python, both wrapped in a shared self-correction loop and a unified explained-JSON output. Answer-type routing, distillation-based task fine-tuning, and a latency-aware serving stack -- SGLang with speculative decoding -- keep the system within the 60-second per-query limit. The system achieved a \textbf{perfect score} on the physics task in both automated selection rounds and obtained the \textbf{highest final-round technical score} of any team -- $13.44/15$, combining automated answer evaluation with expert-judged reasoning depth -- with the equally weighted presentation score included, \cotu{} placed 3rd overall. Grounding answers in a symbolic solver yields correct, verifiable deductions at the 4B scale, and the residual difficulty lies in premise selection rather than the deduction itself.
29. 【2607.14729】he Misclassification of Autistic Writing as AI-Generated
链接：https://arxiv.org/abs/2607.14729
作者：Summer Chambers,Matthew C. Kelley
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Recent findings suggest, Recent findings, accurately identify AI-generated, artificial intelligence, minority groups
备注： Author Accepted Manuscript, Artificial Intelligence in Education 2025
点击查看摘要
Abstract:Recent findings suggest that detection models for artificial intelligence (AI) cannot accurately identify AI-generated text and may exhibit bias against certain minority groups. In the present study, anecdotal claims that autistic writers more often have their work flagged as AI-generated are examined empirically. A corpus of approximately 60,000 Reddit posts split into "likely-autistic" and "general-Reddit" subcorpora is used to compare the distribution of probabilities output by the OpenAI GPT-2 detection model. Differences in textual features between subcorpora are observed and compared to reported features of AI-generated text. Results showed that while less than two-percent of either subcorpus was flagged as AI-generated by the model, significantly more texts from the likely-autistic subcorpus were flagged. Connections between features of text with likely-autistic authors and AI-generated text were not straightforward. The widespread use of AI-detection models with a potential bias against autistic writers in their output prompts ethical scrutiny, and the authors recommend further critical examination of the models themselves as well as their use in academic contexts.
30. 【2607.14709】Gold-Guided Programmatic Distillation for Financial Reasoning over Hybrid Tables and Text
链接：https://arxiv.org/abs/2607.14709
作者：Yun Dong,Erica Zhao,Elana Chen
类目：Computation and Language (cs.CL)
关键词：precise numerical computation, Financial question answering, require multi-source reasoning, question answering, data may require
备注： 12 pages, 7 figures
点击查看摘要
Abstract:Financial question answering over hybrid tabular and textual data may require multi-source reasoning and precise numerical computation. While large language models (LLMs) can generate intermediate reasoning steps, natural-language rationales remain prone to arithmetic errors, making them an unreliable supervision source for distillation. Building on programmatic distillation, we develop an approach that transfers reliable numerical reasoning from a large teacher model to a compact student using execution-verified Python programs instead of free-form textual rationales. It leverages gold derivations to guide teacher-side program synthesis and retains only programs that execute correctly and produce the gold answer, ensuring high-quality supervision. We further introduce an iterative recovery stage that revisits teacher-failed examples, enabling the student to recover and incorporate newly verified programs into training. Experiments on TAT-QA show that our framework is highly effective for hybrid financial reasoning. Our best 7B student achieves 87.00 EM / 87.18 F1 on the test set, substantially outperforming the 72B teacher (78.46 EM) as well as traditional and strong LLM-based baselines, including TAGOP and TAT-LLM. These results demonstrate that execution-verified programmatic distillation provides an effective and extensible framework for training smaller models to perform reliable numerical reasoning.
31. 【2607.14707】Harnessing LLMs for Reliable Academic Supervision: A Comparative Study
链接：https://arxiv.org/abs/2607.14707
作者：Akash Raj
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：routinely produce fluent, produce fluent answers, Large language models, models routinely produce, domain decision system
备注： 15 pages, 4 tables, 1 figure. Code and data available at [this https URL](https://github.com/AkashRajSingh/Harnessing-LLMs-for-Reliable-Academic-Supervision)
点击查看摘要
Abstract:Large language models routinely produce fluent answers to single-shot prompts, yet deploying them as reliable components of a domain decision system is substantially harder. Closing this gap is the work of harness engineering: the deliberate composition of deterministic scaffolding (symbolic filters, retrieval, schema-typed I/O, LLM-as-judge loops, HITL gates, persistent state, audit trails) around an LLM core. We present a case study in academic supervision, a domain combining high-stakes recommendation, longitudinal accountability, and structured operational workflows. We compare a baseline (ASA), a GPT-5 chatbot with no scaffolding, against a multi-module system (ASuS) that wraps the much smaller GPT-4o-mini in a LangGraph harness with symbolic-semantic retrieval, schema-validated outputs, LLM-as-judge with bounded retry, HITL gates, deterministic weighted risk scoring with LLM narration, and a per-node SQLite audit trail. The evaluation rubric is retargeted at six harness-mechanism dimensions (grounding, explainability, consistency, process integrity, cognitive load, constraint adherence). A blind ten-rater hybrid evaluation, supplemented by a 2 x 2 model-harness ablation, finds that ASuS, despite using a much smaller base model, outscores ASA on every dimension. Across ten raters the pooled mean for ASuS is 4.08 versus 1.23 for ASA, and 8 of 10 raters reject the null at alpha = 0.05 on a paired Wilcoxon test; full numbers are in Sections 6.4 and 6.7. The ablation confirms that the structural contributions of the harness are largely model-invariant. We extract seven recurring harness-engineering patterns and argue that where reliability, traceability, and institutional consistency matter more than open-ended fluency, harness engineering challenges the prevailing 'bigger model is better' intuition.
Comments:
15 pages, 4 tables, 1 figure. Code and data available at this https URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
ACMclasses:
I.2.7; I.2.11; K.3.1
Cite as:
arXiv:2607.14707 [cs.CL]
(or
arXiv:2607.14707v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.14707
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.5281/zenodo.21380237
Focus to learn more
DOI(s) linking to related resources</p>
32. 【2607.14682】Stop Thinking, Start Looking: Efficient Post-Training for Multimodal Document Question Answering via Reasoning-Free Alignment
链接：https://arxiv.org/abs/2607.14682
作者：Harikrishnan P M,Goutham Vignesh,Ganesh Parab,Saisubramaniam Gopalakrishnan,Vishal Vaddina,Varun V,Rohit Agrawal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Efficient multimodal document, document question answering, precise document region, Efficient multimodal, reasoning-centric Reinforcement Learning
备注： Accepted at ICML 2026, Workshop on Efficient Multimodal Question Answering (EMM-QA)
点击查看摘要
Abstract:Efficient multimodal document question answering with explicit visual grounding, locating the precise document region that supports each answer remains an open challenge. Current approaches bifurcate into Supervised Fine-Tuning (SFT), which requires large annotated datasets and reaches optimization plateaus, and reasoning-centric Reinforcement Learning (RL), which depends on verbose intermediate traces that inflate inference token cost without clear benefit. We introduce Perception-RFT, a training framework that applies Group Relative Policy Optimization (GRPO) to multimodal document QA, bypassing intermediate reasoning tokens to directly align visual features with structured grounding outputs. To rigorously evaluate the necessity of reasoning, we construct a reasoning variant under identical reward settings. We find that reasoning-enabled models suppress their reasoning traces during training, converging to direct perception-based policies at the 4B parameter scale, reducing per-query inference token length by more than 60%, while reasoning-enabled RL underperforms perception-only training. Through a fine-grained analysis of Qwen3-VL-4B optimization dynamics, we confirm that SFT saturation and cold-start RL instability established in text-domain post-training extend to multimodal, and identify a previously uncharacterized Grounding Divergence: a selective trade-off between semantic robustness and geometric precision on two out of distribution (OOD) benchmarks (4,828 samples) under joint RL optimization. We further show that an early SFT$\rightarrow$RL transition achieves comparable precision with 65% less training data.
33. 【2607.14647】D-cut: Adaptive Verification Depth Pruning for Batched Speculative Decoding
链接：https://arxiv.org/abs/2607.14647
作者：Tianyu Liu,Yuhao Shen,Rui Cen,Junhan Shi,Jiebin Zhang,Guangshuo Qin,Hong Liu,Song Liu,Guanghua Yu,Jianchen Zhu
类目：Computation and Language (cs.CL)
关键词：compromising output quality, accelerates large language, decoding accelerates large, Speculative decoding accelerates, inference without compromising
备注：
点击查看摘要
Abstract:Speculative decoding accelerates large language model (LLM) inference without compromising output quality. Recent parallel drafting methods further improve single-request performance by decoupling draft length from drafting latency, enabling longer drafts and higher mean accepted tokens (MAT). However, under high request concurrency, long drafts waste substantial computation on rejected tokens, increasing verification cost and potentially making speculative decoding slower than autoregressive decoding. We present D-Cut, an adaptive pruning method that selects draft tokens jointly across the batch and concentrates the verification budget on tokens most likely to be accepted. D-Cut is motivated by two observations. First, acceptance lengths vary considerably across concurrent requests; D-Cut therefore performs cross-request pruning, allocating the verification budget adaptively according to draft confidence. Second, verification cost depends strongly on the deployment environment, including GPU architecture and parallelism strategy; D-Cut incorporates a runtime cost model to adapt its pruning depth to the target environment. Experiments on dense and mixture-of-experts (MoE) models show that, under high concurrency, D-Cut improves the average speedup from \(1.26\times\) to \(1.65\times\), restores acceleration in dense-model configurations where long-draft baselines are slower than autoregressive decoding, and achieves up to \(3.0\times\) speedup over autoregressive decoding on MoE models.
34. 【2607.14628】Routing Ceilings Are Domain-Independent: Structural Prior Injection in Code Security Vulnerability Detection
链接：https://arxiv.org/abs/2607.14628
作者：Manuel Israel Cázares
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：lack reliable internal, reliable internal routing, Large language models, Large language, exhibit a well-documented
备注： 12 pages, 5 tables
点击查看摘要
Abstract:Large language models (LLMs) exhibit a well-documented gap between latent capability and consistent activation: the router hypothesis posits that models possess the knowledge to solve a task but lack reliable internal routing to activate it. Prior work in formal mathematical reasoning (SAIR, Cázares 2026) reports that structural priors (cheatsheets) raise in-distribution performance dramatically, yet collapse below the zero-shot baseline out-of-distribution (OOD) -- and that iterative recalibration amplifies rather than corrects the collapse. We test whether this phenomenon is cross-domain by reproducing the SAIR design in source-code security vulnerability detection, evaluating three LLMs (GPT-OSS-120B, Llama-3.3-70B, Gemma-4-31B) across three vulnerability categories (CWE-798, CWE-284, and the non-CWE N+1 anti-pattern) spanning syntactic, contextual, and semantic complexity, then transferring cheatsheet-augmented prompts to real-world CVE data from VUDENC (CWE-89, CWE-22). Our findings replicate and extend SAIR: (F1) structural priors lift semantic-vulnerability recall from 20.0% to 100.0% across all models; (F2) zero-shot performance degrades along a semantic complexity gradient; (F3) the same cheatsheets that saturate synthetic performance amplify distribution-shift collapse on real CVE data (CWE-89: 100% synthetic F1 to 48.9% on VUDENC, -51.1pp); (F5) iterative recalibration produces a v2 cheatsheet that performs worse than v1 on real data, mirroring SAIR's AN45c-vs-AN38 finding. These results provide evidence that the cross-distribution trade-off surface documented in SAIR generalises to code security, and that the router hypothesis is cross-domain. We argue the structural nature of the collapse motivates distribution-aware training over prompt calibration. Code and evaluation scripts: this https URL
Comments:
12 pages, 5 tables
Subjects:
Computation and Language (cs.CL); Cryptography and Security (cs.CR)
ACMclasses:
D.2.5; K.6.5; I.2.7
Cite as:
arXiv:2607.14628 [cs.CL]
(or
arXiv:2607.14628v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.14628
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Manuel Israel Cazares [view email] [v1]
Thu, 16 Jul 2026 06:45:08 UTC (15 KB)
35. 【2607.14614】Beyond Entropy: Correctness-Aware Advantage Shaping via Contrastive Policy Optimization
链接：https://arxiv.org/abs/2607.14614
作者：Weiwen Xu,Jia Liu,Hou Pong Chan,Long Li,Deng Cai,Min Chen,Hao Zhang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Reinforcement learning, verifiable rewards, Contrastive Policy Optimization, learning with verifiable, advantage shaping
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) commonly uses entropy for advantage shaping. However, entropy cannot distinguish useful uncertainty from detrimental confusion, limiting its effectiveness as a correctness signal. We propose Contrastive Policy Optimization (CPO), which uses token-level contrastive disagreement between reference-guided and vanilla generation distributions for correctness-aware advantage shaping. Both theoretical and empirical results show that this disagreement reliably indicates token-level correctness. We further show that On-policy Distillation is a special case of CPO, where the posterior distribution is instantiated by an external teacher model. CPO also resolves the zero-advantage problem. Experiments on in-domain and out-of-domain benchmarks demonstrate that CPO substantially outperforms entropy-based RLVR methods while maintaining strong generalization. Further analysis shows that correct and incorrect responses naturally support exploration and exploitation respectively, and balancing both leads to the best performance.
36. 【2607.14605】Investigating first-language bias in LLM-based automated essay scoring: A cross-prompt evaluation of an open-weight AI-model on TOEFL essays
链接：https://arxiv.org/abs/2607.14605
作者：John Maurice Gayed
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Writing Evaluation System, Automated Writing Evaluation, large language model, LLM Automated Writing, automated essay scoring
备注： 21 pages, 2 figures, and 8 tables
点击查看摘要
Abstract:This study examines the cross-prompt generalization and first-language (L1) scoring effects of a LoRA-adapted open-weight large language model (Gemma-3-27B-it) applied to automated essay scoring. Using the identical model and inference configuration reported in "AiAWE: An Open-Source LLM Automated Writing Evaluation System Using LoRA-Adapted Instruction-Tuned Models" (Gayed, 2026), which was fine-tuned on 480 argumentative essays from two prompts, we evaluate scoring accuracy on the full TOEFL11 corpus: 12,100 essays written by test-takers from 11 first-language backgrounds across eight prompts, none of which were seen during training. The model's raw scores (0.5-5.0) are mapped to the same three proficiency bands (low, medium, high) used by ETS, enabling direct comparison. The model achieved an overall band agreement of 77.79% and a quadratic weighted kappa of 0.702, with adjacent-band agreement of 99.98%. Accuracy was stable across all eight unseen prompts, with no advantage for prompts thematically related to the training data, indicating robust cross-prompt generalization. However, the model exhibited a systematic, L1-linked scoring offset. Within every proficiency band, essays from European-language backgrounds received consistently higher scores than essays from East-Asian-language backgrounds, a pattern not attributable to the composition of the fine-tuning data. This is the first large-scale L1 fairness analysis of a fine-tuned open-weight LLM for automated essay scoring.
37. 【2607.14593】Memory-Driven Self-Disclosure and Relational Turning Points: A Longitudinal Multimodal Study of Human-AI Interaction
链接：https://arxiv.org/abs/2607.14593
作者：Ryuichi Sumida,Mao Saeki,Masaki Eguchi,Sadahiro Yoshikawa,Koji Inoue,Tatsuya Kawahara,Yoichi Matsuyama
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：designed for repeated, central question, series of interactions, conversational, conversational quality
备注： 15 pages, 3 figures. Accepted to ICMI 2026 (International Conference on Multimodal Interaction), October 5-9, 2026, Napoli, Italy
点击查看摘要
Abstract:As conversational AI systems are designed for repeated use, a central question is how a series of interactions becomes a relationship. We present a longitudinal multimodal study of a memory-augmented conversational agent (24 participants x 10 sessions), in which participants rated five relational constructs -- familiarity, self-disclosure, perceived memory, conversational quality, and enjoyment -- after each session. Two complementary dynamics emerge. First, conversational quality strongly shapes how enjoyable a session feels in the moment but does not carry forward across sessions, whereas perceived memory is relationally conditioned -- predicted by prior relational state rather than reflecting system capability alone -- and it shapes later enjoyment indirectly, via subsequent self-disclosure. Second, relationships are punctuated by discrete turning points -- crashes and surges -- that are partially traceable in multimodal behavior and open different intervention windows: surges are more behaviorally detectable in the moment, enjoyment surges persist more reliably than enjoyment crashes recover, and some crashes are better forecast from person-specific behavioral drift than detected after they have already occurred. Together, the findings suggest that longitudinal human-AI relationships are built through both slow accumulation and abrupt turning points.
38. 【2607.14591】How Well Does AI-Generated Feedback Work? Intrinsic and Extrinsic Evaluation across more than 20,000 EFL Essay Drafts
链接：https://arxiv.org/abs/2607.14591
作者：Steven Coyne,Diana Galvan-Sosa,Ryan Spring,Machi Shimmei,Michael Zock,Keisuke Sakaguchi,Kentaro Inui
类目：Computation and Language (cs.CL)
关键词：Foreign Language, study examines feedback, written corrective feedback, focusing on written, study examines
备注： Pre-review version of DOI [this https URL](https://doi.org/10.1007/978-3-032-29788-4_35) , presented at AIED 2026 Late Breaking Results. Readers are encouraged to refer to the published version
点击查看摘要
Abstract:This study examines feedback in English as a Foreign Language (EFL) writing contexts, focusing on written corrective feedback (WCF). Large language models (LLMs) can provide WCF at scale, but aligning them with pedagogical best practices remains an ongoing challenge. WCF meeting criteria like factuality or relevance may still be unsuitable for learning contexts, highlighting the need for extrinsic evaluation based on the learner's perspective. We deployed WCF systems in a university-level EFL class with nearly 2,000 students, collecting over 20,000 drafts. We evaluated the generated WCF from two perspectives: intrinsic evaluation by experienced English teachers using a rubric, and extrinsic evaluation via student feedback and engagement metrics. Results revealed low alignment between teacher expert ratings and student feedback. These findings suggest that traditional expert evaluation alone may not fully capture WCF's usability or helpfulness from the learner's perspective, highlighting the importance of learner-centered evaluation frameworks for AI-based applications in language education.
39. 【2607.14587】Qubes OS Security in the Public Record
链接：https://arxiv.org/abs/2607.14587
作者：Alfonso De Gregorio
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：Qubes Security Bulletins, Qubes-maintained Xen Security, component boundaries security-relevant, architecture makes component, makes component boundaries
备注： 18 pages, 3 figures, 4 tables, dataset bundle published on Zenodo
点击查看摘要
Abstract:Qubes OS is a revealing case for security measurement because its architecture makes component boundaries security-relevant. We present a protocol-driven longitudinal analysis of 109 public Qubes Security Bulletins (QSBs, 2011--2025), the official Qubes-maintained Xen Security Advisory (XSA) tracker, and a secondary vulnerability-event sensitivity series. The study measures the public advisory record rather than latent vulnerability incidence or realized compromise. The methodology combines audited deterministic component attribution, change-point analysis, overdispersion checks, severity-proxy weighting, censoring sensitivity, documentary latency lower bounds, and baseline-aware evaluation of vulnerability discovery models (VDMs). The results show persistent upstream dependence in that public record. On the official tracker, 113 of 464 XSAs affect Qubes; under primary labeling, 87 of 109 QSBs (79.8\%) are attributable to Xen, CPU/microarchitectural, or other upstream components rather than Qubes-core logic, with similar results under weighted views. Change-point analyses identify 2015Q1 as the dominant break in the quarterly advisory series, while post-2018 annual disclosure rates are statistically flat. Poisson inferences are stable under dispersion diagnostics and negative-binomial sensitivity checks. The attribution codebook performs well in a stratified 30-QSB audit, and S-shaped VDMs fit descriptively but do not significantly outperform a rolling-mean baseline in short-horizon forecasts. Overall, the Qubes public advisory record appears stable, but not quiet: disclosure activity plateaus at a higher level than in the earliest years, while the observed burden remains concentrated in upstream trust anchors.
Comments:
18 pages, 3 figures, 4 tables, dataset bundle published on Zenodo
Subjects:
Cryptography and Security (cs.CR); Computation and Language (cs.CL)
Cite as:
arXiv:2607.14587 [cs.CR]
(or
arXiv:2607.14587v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2607.14587
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
40. 【2607.14575】Penny: Transition Network Analysis of Learner-Chatbot Interactions in Scaffolded EFL Writing
链接：https://arxiv.org/abs/2607.14575
作者：Steve Woollaston,Brendan Flanagan,Yuko Toyokawa,Hiroaki Ogata
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：Foreign Language, transform English, promise to transform, Transition Network Analysis, Generative
备注：
点击查看摘要
Abstract:Generative AI chatbots promise to transform English as a Foreign Language (EFL) writing by providing immediate, personalised feedback. However, their pedagogical value depends on how learners engage with them - a process often treated as a "black box." This study uses Transition Network Analysis to model the temporal dynamics of Japanese EFL learners using "Penny," an LLM-powered writing chatbot. Analysis of over 4,500 writing sessions and 21,000 chatbot interactions reveals two dominant behavioural loops: a "Revision Loop," where feedback leads directly to successful error correction, and a "Chat Loop," where learners engage in sustained dialogue with the chatbot following feedback. Crucially, EFL proficiency significantly shapes interaction: high-proficiency learners engage more in open dialogue and negotiation with the chatbot, while low-proficiency learners rely more heavily on repetitive corrective feedback cycles. The findings demonstrate that AI-scaffolded writing is a non-linear, dialogic process and highlight the need for differentiated chatbot design to move beyond simple error correction and foster deeper cognitive engagement for all learners.
41. 【2607.14561】MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA
链接：https://arxiv.org/abs/2607.14561
作者：Nikit Srivastava,Daniel Vollmers,René Speck,Nikolaos Karalis,Hamada M. Zahera,Axel-Cyrille Ngonga Ngomo
类目：Computation and Language (cs.CL)
关键词：Large language models, knowledge-intensive tasks requiring, demonstrated strong reasoning, Large language, tasks requiring
备注： EKAW 2026 ( [this https URL](https://ekaw2026.di.unito.it/accepted-posters-and-demos) )
点击查看摘要
Abstract:Large language models (LLMs) have demonstrated strong reasoning performance, but their tendency to hallucinate limits their reliability in knowledge-intensive tasks requiring up-to-date and grounded information. Combining knowledge graphs (KGs) with LLMs facilitates the use of explicit symbolic knowledge that can be continuously updated without costly fine-tuning, while benefiting from rapidly advancing LLM reasoning. We propose MARS, a scalable knowledge graph question answering (KGQA) approach that requires no model fine-tuning. Rather than relying on open-ended agentic exploration, MARS performs a structured retrieval procedure that links question entities to the KG and iteratively retrieves relevant next-hop information. At each step, MARS decides whether to continue graph traversal or to generate the final SPARQL query, allowing the model to adapt the retrieval depth to the question while keeping the overall pipeline more predictable than fully agentic approaches. We evaluate MARS on three established KGQA benchmarks across several LLMs and settings, including multilingual evaluation, and provide insights through ablation studies and error analysis. Our approach achieves competitive performance relative to state-of-the-art methods while remaining efficient and scalable. The evaluation results, code and resources are publicly available: this https URL.
42. 【2607.14552】Answer-Conditioned Chains of Thought Degrade Verifiable-Reasoning Distillation in Large Language Models
链接：https://arxiv.org/abs/2607.14552
作者：Jungseob Lee,Seungyoon Lee,Suhyune Son,Dongyub Jude Lee,Sungbin Han,Sugyeong Eo,Heuiseok Lim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：correct final answer, large language models, standard recipe, recipe for distilling, ability of large
备注： 13 pages, 4 figures, 14 tables. Code: [this https URL](https://github.com/js-lee-AI/answer-leakage)
点击查看摘要
Abstract:A standard recipe for distilling the reasoning ability of large language models (LLMs) is to sample chains of thought from the model, keep those that reach the correct final answer, and fine-tune on the survivors. When sampling fails, a common fix shows the generator the gold answer and asks it to write a chain that reaches that answer. We show that this second step degrades the training data in a way that correctness filtering cannot catch. We run a controlled experiment that fixes the generator, the problem set, and the correctness filter, and varies only whether the chain is generated under answer-conditioning, the gold answer shown with a request to reach it. Training a strong instruction-tuned reasoning model on its own answer-conditioned chains sharply lowers its verifiable-reasoning accuracy. The loss grows with difficulty, reaching as much as about 27 points on the hardest competition problems. The mechanism is legible in the chains themselves, which rationalize backward from the shown answer instead of deriving it, with the early final-answer statement as the measurable symptom. The harm is a property of the data rather than the generator, read off unlabeled generations before any fine-tuning, ordering the penalty across eight thinking models from four families, and transferring across teacher families. A prompt ablation localizes it to the rationalize-toward instruction rather than the answer's bare visibility. The practical takeaway is to generate answer-blind, because no correctness filter can see this damage in the data.
43. 【2607.14542】CityLLM: A framework for natural-language querying of semantic 3D city models
链接：https://arxiv.org/abs/2607.14542
作者：Rabindra Lamsal,Sisi Zlatanova,Johnson Xuesong Shen
类目：Computation and Language (cs.CL)
关键词：specialized data formats, provide rich geometric, models provide rich, city models alongside, city models
备注： Accepted to the 21st International 3D GeoInfo Conference. To appear in the ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
点击查看摘要
Abstract:Semantic 3D city models provide rich geometric and semantic information, but remain challenging for non-experts and interdisciplinary researchers to access and query due to their complex structures and specialized data formats. To address this issue, we present CityLLM, a framework for natural-language querying of semantic 3D city models alongside complementary urban datasets. The framework combines spatial and graph databases within an LLM-based workflow that supports iterative query refinement and cross-database chaining. We evaluate CityLLM on a CityJSON dataset of Rotterdam (853 LoD2 buildings) using GPT-OSS, Gemini 3.1, and GPT-5.4, along with selected variants, across multiple metrics: answer correctness, visualization correctness, query success, and retry attempts. A total of 54 natural-language queries are curated across four scenarios: spatial, graph, cross-database, and conversational. Results show strong overall performance, with answer correctness ranging from 85.2% to 100%, visualization correctness from 92.9% to 100%, a 100% query success rate, and fewer than three retries across all 54 queries. Overall, the findings suggest that CityLLM provides a lightweight and extensible approach for conversational access to semantic 3D city data.
44. 【2607.14530】xHC: Expanded Hyper-Connections
链接：https://arxiv.org/abs/2607.14530
作者：Xiangdong Zhang,Xiaohan Qin,Sunan Zou,Tuo Dai,Xiaoming Shi,Huaijin Wu,Yebin Yang,Zhuo Xia,Shaofeng Zhang,Lin Yao,Yuliang Liu,Yu Cheng,Junchi Yan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：providing a form, width and depth, Transformers, xHC, parallel streams
备注： Technical report. Project page: [this https URL](https://github.com/aHapBean/xHC)
点击查看摘要
Abstract:Hyper-Connections (HC) expand the residual stream of Transformers into $N$ parallel streams, providing a form of memory scaling beyond model width and depth. Manifold-Constrained HC (mHC) stabilizes this formulation at scale. The large gains from $N{=}1$ to $N{=}4$ suggest residual-stream expansion as a promising scaling axis. However, existing HC-family methods typically stop at $N{=}4$. Our experiments reveal why: scaling mHC beyond this point yields diminishing performance gains and rapidly increasing training cost. We attribute this limitation to two bottlenecks: insufficient write-back information for an expanding number of streams and residual-mixing generation whose cost scales cubically with $N$. To address both bottlenecks, we propose xHC (Expanded Hyper-Connections), the first HC-family method to achieve meaningful expansion beyond $N{=}4$. xHC combines temporal feature augmentation for richer write-back with a sparse residual-stream architecture that updates only $k=4$ of the $N=16$ streams while retaining dense access to the full residual state. Across 18B and 28B MoE models, xHC delivers strong and consistent downstream improvements. On an 18B MoE model, xHC improves the average downstream score by 4.0 points over mHC, while adding only modest training FLOPs over the vanilla baseline. Scaling-law experiments show that the vanilla and mHC require $1.50\times$ and $1.19\times$ the compute of xHC, respectively, to reach the same loss. Practical large-$N$ training also requires controlling memory traffic from the expanded residual state. We therefore introduce xHC-Flash, which reduces the per-sublayer memory traffic from $73.5C$ to $40C$, comparable to the $34C$ required by mHC at $N{=}4$, while retaining the gains of full xHC. Together, xHC and xHC-Flash make large-$N$ residual-stream expansion effective and practical for LLM pre-training.
45. 【2607.14528】Controlled Reformulation Testing for Logical Consistency in Large Language Models
链接：https://arxiv.org/abs/2607.14528
作者：Alexander Gu,Alan Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, Controlled Reformulation Testing, language models, frequently contradict
备注： 10 pages
点击查看摘要
Abstract:Large language models (LLMs) frequently contradict themselves when the surface form of a logically equivalent question changes. We present a benchmark of 350 question families (1,750 total questions) for Controlled Reformulation Testing (CRTBench) to evaluate logical invariance. In this benchmark, we investigate LLMs' ability to maintain consistent answers across controlled reformulations, which include contrapositive rewriting, double negation, negation flipping, and passive voice. We evaluate several frontier LLMs and observe an accuracy-consistency gap where GPT-5.4-mini achieves $98.9\%$ base accuracy but only $60.3\%$ family-level consistency, while reasoning-optimized o4-mini achieves $96.9\%$ consistency. From our experiments, we observe that failures cluster around logically nontrivial transformations such as contrapositive rewriting ($72.4\%$ for GPT-5.4-mini) and double negation ($84.6\%$), while surface-level rephrasing remains robust ($94-100\%$). Increasing reasoning effort improves GPT-5.4-mini to $85.4\%$ consistency, but leaves GPT-5.4 unchanged overall because gains on nested negation are offset by failures on quantifier families. These results show that accuracy alone is not enough for evaluating logical reasoning in LLMs.
46. 【2607.14524】WrAFT: a Modularized Automated Writing Evaluation System for Argumentative Essays
链接：https://arxiv.org/abs/2607.14524
作者：Adnan Labib,Yixuan Huang,Jiahui Wu,John Maurice Gayed,Zheng Yuan,Qiao Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：effective comprehensive feedback, study presents WrAFT, Writing Assessment, Feedback Tool, TOEFL Independent Writing
备注：
点击查看摘要
Abstract:This study presents WrAFT, a Writing Assessment and Feedback Tool, that delivers both accurate and reliable scores and effective comprehensive feedback to argumentative essays. WrAFT adopts a modular design by dividing automated writing evaluation (AWE) tasks into scoring, surface-level feedback, and deep-level feedback. In building the system, various Large Language Models (LLMs) have been evaluated, including LLaMA-3.3-70B-Instruct, GPT-4o, and Claude 3.7, through both direct prompting and supervised fine-tuning approaches. A proprietary dataset of 480 TOEFL Independent Writing essays with official benchmark scores was utilized. Benchmark-based evaluation shows that WrAFT achieves state-of-the-art performance in scoring, with a quadratic weighted kappa (QWK) of 0.84 and a root mean square error (RMSE) of 0.44 against official scores on a scale of 0-5. Human evaluation of system-generated feedback also reveals high approval ratings: 96.14 percent for surface-level feedback, 93.03 percent for deep-level macro feedback, and 94.69 percent for deep-level micro feedback. An interactive user interface has been developed for the system and is publicly available and free to use.
47. 【2607.14512】RetroAgent: Harnessing LLMs to Search Over Structured Memory for Agentic Retrosynthesis Planning
链接：https://arxiv.org/abs/2607.14512
作者：Yanqiao Zhu,Jingru Gan,Xiaoqi Sun,Fang Sun,Yidan Shi,Md Mofijul Islam,Chao Shang,Wenhao Gao,Connor W. Coley,Yizhou Sun,Wei Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：retrosynthesis planning seeks, Multi-step retrosynthesis planning, feasible reactions, retrosynthesis planning, planning seeks
备注： To appear at COLM 2026
点击查看摘要
Abstract:Multi-step retrosynthesis planning seeks to decompose a target molecule into commercially available building blocks through a sequence of feasible reactions. The vast combinatorial search space makes this task challenging even for expert chemists. Traditional methods combine tree search with offline-trained value networks that score candidates in isolation, without reasoning about complete multi-step routes. Recent work leverages Large Language Models (LLMs) for this task, but relies on simple interfaces that limit exploration of the full search space. We introduce RetroAgent, an LLM agent that bridges symbolic search and neural reasoning through a harness with structured memory. Through memory and chemistry tools, the agent observes the full search state, including explored routes, available alternatives, and properties of intermediates, enabling informed decisions grounded in both global progress and domain knowledge. Experiments on in-distribution and out-of-distribution benchmarks demonstrate that RetroAgent delivers strong performance and generalization.
48. 【2607.14491】Manufactured Divisiveness: Decomposing the Hostile Content of Seven Social Media Influence Operations
链接：https://arxiv.org/abs/2607.14491
作者：Emilio Ferrara
类目：ocial and Information Networks (cs.SI); Computation and Language (cs.CL)
关键词：State-backed influence operations, Twitter Information Operations, broader definition inclusive, Information Operations archive, toxicity. We argue
备注：
点击查看摘要
Abstract:State-backed influence operations are routinely measured as high-prevalence sources of ``hate'' and ``toxicity.'' We argue those rates rest on a measurement error: the detectors behind them are validated to catch a broader definition inclusive of hostility or divisiveness aimed at an out-group, and so over-attribute hate to content better described as partisan or geopolitical invective. Across 25.08M tweets from seven government-attributed campaigns in the Twitter Information Operations archive (8,275 accounts), we separate hate from the other forms of divisiveness. We first validate a two-prompt LLM-based detector, matching human labels at Cohen's $\kappa=0.82$, to identify the broader hostility; we then develop an auditable rule, agreeing with an expert at $\kappa=0.52$, to further classify this content (5,457 posts) into three sub-categories. About 50.1% are identity-based attacks on people, whereas 30.4% are partisan attacks and 19.5% invective against states and their foreign policy. Reporting all of it as hate therefore overstates hate roughly twofold; only 18.7% is both identity-based and dehumanizing or inciting. Six of seven campaigns sort into three regimes that a single ``hate'' rate flattens, namely identity hate (RU-op and IRA, both Russia-attributed), geopolitical invective (both Iran operations), and partisan divisiveness (both Venezuela operations). We call the shared product $manufactured divisiveness$. The line to separate these constructs itself remains unsettled: on the hardest cases three independent human experts agree only moderately (pairwise $\kappa=0.37$--$0.50$), and the best of nineteen LLM models tops out at $\kappa=0.601$ against the experts' majority. Our findings can help redefine the study of hate in the context of influence campaigns and broader online discourse.
49. 【2607.14480】LLM Evaluators are Biased across Languages
链接：https://arxiv.org/abs/2607.14480
作者：Ej Zhou,Lucas Resck,Zheng Hui,Anna Korhonen
类目：Computation and Language (cs.CL)
关键词：pairwise accuracy, trained reward models, LLM evaluators, trained reward, routinely validated
备注：
点击查看摘要
Abstract:LLM evaluators (trained reward models and prompted LLM-as-a-Judge) are routinely validated via pairwise accuracy. In a multilingual setting, this operates under the premise that high pairwise accuracy implies reliable, language-neutral scoring. We show that this assumption does not hold. We conduct experiments with semantically identical instruction-response pairs across 23 languages, and find that multilingual evaluators assign significantly different scores to different evaluation languages. The bias is statistically significant and consistent across eight open-weight evaluators of different architectures and training paradigms, persists in frontier judges, and is strongly correlated with language resource level: lower-resource languages are scored more generously. Meanwhile, these biases are invisible to pairwise accuracy: evaluators achieve above 90% pairwise accuracy, yet have up to 43% difference in acceptance rate across languages under a global decision threshold, meaning, for instance, that harmful content in lower-resource languages is more likely to pass safety filters. Per-language thresholds would require language identification, which can be defeated by code-switched prompts. We then investigate why lower-resource languages receive higher rather than lower scores, and we find that model uncertainty is linked with the effect: models tend to give higher scores when less confident, both under negative log-likelihood and under token-free uncertainty measures; however, language identity remains a significant predictor after controlling for uncertainty, and the bias cannot be explained away by content difficulty alone, but is a structural, language-level misalignment.
50. 【2607.14431】Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel
链接：https://arxiv.org/abs/2607.14431
作者：Sietse Schelpe
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Performance (cs.PF)
关键词：frozen small language, small language model, changing any weights, small language, capable and dramatically
备注： 18 pages, 4 figures
点击查看摘要
Abstract:We report a way to make a frozen small language model both more capable and dramatically cheaper at once, without changing any weights. Verified knowledge is deposited once as a byte-exact key-value (KV) state artifact and later restored, by graft, into a fresh inference context. The restore is bit-exact: under a pinned deterministic configuration, the grafted logits are byte-for-byte identical to a fresh computation (SHA-256 equality), with zero KL divergence and 100% argmax agreement over fifty samples. We show that own-position graft is the unique numerically exact operating point on a model with floating-point rotary encoding, and we verify byte-exactness on two model scales (12B, 31B) and two GPU targets, one through a pre-registered replay. On AIME 2025, a frozen Gemma-4-12B moves from 80.0% to 93.3% once a verified solution library is grafted, above its own 77.5% and its 31B sibling's 89.2% published anchors. On the recurring case, eight problems the base model never solves within a 401,026-token budget are answered from cached verified solutions in 61 total decode tokens, a factor of 6,574 fewer tokens and about 8,700x less energy; the capability claim proper rests on held-out transfer (7 of 7 at 31B). The same byte-exact store widens usable context from 32,768 to 2,854,766 tokens at zero extra accelerator memory, and moves byte-identical between machines of the same architecture. We describe the system at the behavior level; the engine is proprietary, and every reported number is backed by committed input and output hashes so the scoring can be re-checked without it.
51. 【2607.14400】DS@GT ARC at LongEval: Citation Integrity and Factual Grounding in Scientific QA
链接：https://arxiv.org/abs/2607.14400
作者：Brandon Michaels,Brendon Johnson
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：LongEval Task, ARC submission, RAG, paper describes, Retrieval-Augmented Generation
备注： 12 pages, 4 figures. Accepted to the CLEF 2026 LongEval Lab Working Notes
点击查看摘要
Abstract:This paper describes DS@GT ARC's submission to the CLEF 2026 LongEval Task 4 on Retrieval-Augmented Generation (RAG). In this submission, we examine a divergence between traditional natural language evaluation metrics and citation integrity as applied to RAG QA systems. We evaluate a corrective pipeline using Corrective RAG (CRAG) and CiteFix against baseline and frontier model benchmark RAG QA scores. While frontier models maximized answer relevance and fluency scores, our RAGAs LLM-as-judge diagnostics indicate that frontier models would correctly identify relevant documents without using their context in answer generation. Conversely, by filtering chunks pre-generation and enforcing strict entailment of generated claims to the cited material post-generation, our corrective pipeline marginally improved citation faithfulness and answer grounding. We propose that evaluation of trustworthy RAG QA requires metrics that reward strict answer grounding.
52. 【2607.14399】Instrument Effects in Language-Model Honesty Evaluation: An Auditable Single-System Demonstration
链接：https://arxiv.org/abs/2607.14399
作者：Justin Bronder(Corabo Inc.)
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Evaluations of language-model, language-model honesty read, language-model honesty, Evaluations, honesty read
备注： 21 pages. Code: [this https URL](https://github.com/Aargau/latent-underground) (tag v1.0-arxiv). Data: [this https URL](https://doi.org/10.5281/zenodo.21384627)
点击查看摘要
Abstract:Evaluations of language-model honesty read the model's verdicts as evidence about the model. We test the instrument instead. We built a text-adventure world where the game engine, not any model, knows whether the quest can be completed. A language model plays under a budget and must eventually declare its quest complete, unreachable, or not yet decidable; the engine scores every verdict. Decision rules were recorded before results were read, and run artifacts bind the revisions they executed; the strength of preregistration varies by series and is disclosed. With the player held fixed, instrument choices substantially changed measured behavior. On four byte-identical anchors, expanding a two-verdict grammar to three verdicts moved strong claims from 38/40 to 7/40, while the new incomplete verdict took 28/40 outcomes; across series 2, 93/158 valid games ended incomplete. One sentence disclosing the success criterion took matched-instance false verdicts from 18/59 to 0/58, through fewer decision points and cleaner decisions. Repeated runs of one fixed configuration produced non-stable verdict distributions on 3 of 4 instances: single runs report samples as dispositions. A formally preregistered narrative-register gradient was falsified; two post-hoc, hypothesis-generating patterns remain: register presence roughly doubled strong claims, and budget rendering moved verdicts more than register content (.383 meter vs .150 lantern). The narrator compressed abundant budgets toward scarcity landmarks, yet the registered mediation test returned a null. We propose a four-check integrity protocol for eval instruments.
53. 【2607.14385】MamaBench: Benchmarking LLM Robustness in Maternal and Child Health Diagnosis through Counterfactual Clinical Perturbation
链接：https://arxiv.org/abs/2607.14385
作者：Thanni Adewuyi,Anuoluwa Sotome,Samuel Okoko,Angel Ezendu,Oluwafunke Akinbuwa,Oluwaseun Odunsi,Oluwasegun Oguntuase,Oluwadarasimi Oguntuase,Ifeoma Nwabueze,Abiodun Adereni
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, distinguish clinically similar, clinically similar presentations, similar presentations requiring, Bias Trap Rate
备注：
点击查看摘要
Abstract:Large language models achieve strong scores on medical benchmarks, yet these benchmarks evaluate each question in isolation, providing no measure of whether a system can distinguish clinically similar presentations requiring different interventions. We introduce MamaBench, the first counterfactual benchmark for maternal and paediatric AI: 434 expert-authored clinical narratives in 217 pairs across 371 pathologies, evaluated via the Bias Trap Rate (BTR), the conditional probability that a model fails the counterfactual given success on the base case. We propose Evidence-Anchored RAG (EA-RAG), a three-stage retrieval method that replaces aggregate similarity with an evidence coverage objective through clinical parameter extraction, coverage auditing, and contrastive sub-queries. Across eight configurations of four frontier LLMs, base accuracy overstates robust accuracy by 16-28 percentage points in every model. EA-RAG achieves 20.3% BTR and 65.0% robust accuracy on Claude Sonnet 4.6, a 5.5 percentage point BTR reduction without degrading base accuracy. The residual 20% BTR confirms that counterfactual robustness in clinical AI remains an open challenge. Keywords: counterfactual evaluation, clinical AI, maternal healthcare, retrieval-augmented generation, diagnostic robustness
54. 【2607.14349】HABIB_TAZ at SemEval-2026 Task 11: Disentangling Formal Logic from Content via Synthetic Training and Multi-Objective Optimization
链接：https://arxiv.org/abs/2607.14349
作者：Abdullah Shaikh,Zain Naqi,Taha Zahid,Sandesh Kumar,Abdul Samad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：general NLP tasks, Large Language Models, NLP tasks, general NLP, Large Language
备注：
点击查看摘要
Abstract:While Large Language Models (LLMs) excel in many general NLP tasks, their formal reasoning capabilities are often compromised by content effects, demonstrating a measurable bias towards real-world plausibility. In this paper, we present our system for SemEval-2026 Task 11, which evaluates the ability of models to disentangle formal logic from content across 12 languages with and without distractor premises. We address this challenge using mDeBERTa-v3 networks fine-tuned on a synthetic, rule-based dataset of syllogistic schemes to avoid the semantic noise of LLM-augmented data. To explicitly decouple plausibility from logical structure, our training pipeline employs a multi-objective loss function combining Adaptive Group Distributionally Robust Optimization (DRO), a scheduled differentiable bias penalty, and KL-Divergence consistency regularization. Our system achieved #1 ranks and perfect Ranking Scores (100.0) with 0.00% bias and 100.0% accuracy on Subtask 1 (English), Subtask 2 (Noisy English), and Subtask 3 (Multilingual). On the highly complex Subtask 4 (Noisy Multilingual), the system achieved the 6th rank with 89.06% Accuracy and F1-score, alongside a limited 2.89% Bias and a 37.78 Ranking Score. Our dataset generation engine and codebase are publicly available to facilitate future work on robust logical reasoning.
55. 【2607.14333】SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning
链接：https://arxiv.org/abs/2607.14333
作者：Shiyu Yuan,Sourav Sanjukta Bhabesh,Zhe Wang,Dmitriy Bespalov,Wesley Rose,Huzefa Rangwala
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Vision Language Models, Vision Language, strong perceptual abilities, multiple visual states, multi-step visual inference
备注：
点击查看摘要
Abstract:Vision Language Models (VLMs) demonstrate strong perceptual abilities but remain limited in tasks requiring analytical reasoning across multiple visual states, such as multi-image comparison, change detection, and multi-step visual inference. These capabilities are critical for real-world multimodal applications where reasoning must be grounded in systematic differences between visual contexts. However, existing benchmarks rarely require both explicit visual comparison and analytical reasoning, leaving this capability underexplored. To address this gap, we introduce SD-MAR (Synthetic Data for Multi-image Analytical Reasoning), a framework for training and evaluating VLMs on multi-image analytical reasoning. SD-MAR constructs paired visual scenarios through controlled perturbations and generates reasoning tasks spanning semantic change attribution and quantitative comparison. We further train VLMs using GRPO-lite with Backward Discounted Allocation (BDA), a reinforcement learning approach that removes KL regularization to encourage stronger policy optimization while allocating greater credit to the later reasoning steps where analytical conclusions are formed. Experiments on Qwen2.5-VL-7B and InternVL3-8B show that GRPO-lite fine-tuning on SD-MAR improves in-domain accuracy by up to 36.95%, with Qwen2.5-VL-7B outperforming GPT-4.1 on the SD-MAR benchmark. Importantly, out-of-domain generalization is preserved or improved: performance remains within 1% on MME, MMMU-Pro, and MathVista, while improving by up to 4% on MMBench. LLM-as-judge evaluation further demonstrates consistent improvements in logical coherence and explanation quality across both models.
56. 【2607.14327】PReM: Learning What to Preserve and When to Refresh for Context Compression
链接：https://arxiv.org/abs/2607.14327
作者：Bohan Yu,Lei Shen,Chenxi Zhou,Chen Han,Junlin Liu,Wenbo Su,Yu Cheng,Bo Zheng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Efficient long-context inference, Efficient long-context, reducing memory cost, contextual evidence accessible, Efficient
备注：
点击查看摘要
Abstract:Efficient long-context inference is not only about reducing memory cost, but also about keeping useful contextual evidence accessible as generation proceeds. However, existing compression-oriented approaches, such as key-value (KV) cache compression and context compression, often either make an early decision about which contextual information to keep or rely on an external compressor. Such designs make it difficult to adapt the compressed context to the evidence needed by later reasoning steps. This paper introduces PReM (Preserve and Refresh Memory), a context-compression framework that maintains the long context as the model's internal layer-wise KV memory and learns what to preserve and when to refresh it. Specifically, PReM uses a dedicated memory layer to make memory-selection decisions, and a special memory token m to trigger refreshes during generation. To train this behavior, PReM introduces Phase-Separated Refresh Training, aligning memory selection with memory-conditioned generation while preserving continuity across refreshes. Experiments with 32K-token contexts show that PReM outperforms strong baselines under both 16x and 32x compression, while maintaining a favorable balance between answer quality and inference efficiency.
57. 【2607.14301】Measuring How Students Rely on Generative AI in Academic Writing: Development and Multi-Source Validation of the Generative AI Reliance Types Scale (GenAI-RTS)
链接：https://arxiv.org/abs/2607.14301
作者：Shahin Hossain,Tukhbita Afroz Nawmi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：academic integrity, question for learning, GenAI Reliance, increasingly embedded, central question
备注： 21 pages, 3 figures, 14 tables
点击查看摘要
Abstract:As generative AI (GenAI) becomes increasingly embedded in undergraduate academic writing, how students rely on these tools, rather than simply whether they use them, has become a central question for learning, academic integrity, and educational equity. Existing measures of reliance were developed inductively, focused on discrete problem-solving tasks, and validated mainly with homogeneous samples. This study developed and validated the GenAI Reliance Types Scale (GenAI-RTS), a 20-item instrument measuring four theoretically derived types of GenAI reliance: Strategic, Instrumental, Dependent, and Dialogic. Validation followed the multisource framework of the Standards for Educational and Psychological Testing, drawing on a survey of 382 undergraduates at a U.S. Minority-Serving Institution and interviews with 14 purposively sampled students. Confirmatory factor analyses of six competing models supported a five-factor structure in which Strategic Reliance comprises two facets, Deliberate Use and Critical Evaluation, alongside Instrumental, Dependent, and Dialogic factors (CFI = .92, RMSEA = .08; DWLS CFI = .98, RMSEA = .07). Subscale reliability was acceptable to good (omega = .75-.88), and scalar measurement invariance held across gender, first-generation status, and STEM/non-STEM majors, to our knowledge the first such evidence for a GenAI reliance instrument. Rasch analysis indicated that a five-point response format would improve category functioning. Strategic reliance was positively associated with AI literacy, and the reliance types differentiated students across multiple writing process and outcome variables. The GenAI-RTS offers researchers and educators a theoretically grounded, psychometrically validated instrument for identifying undergraduate reliance profiles and supporting research, assessment, and AI literacy intervention.
58. 【2607.14277】Multi-Head Latent Control: A Unified Interface for LLM Agent Decision Making
链接：https://arxiv.org/abs/2607.14277
作者：Amirhosein Ghasemabadi,Ruichen Chen,Bahador Rashidi,Di Niu
类目：Computation and Language (cs.CL)
关键词：reliable agentic behavior, agentic behavior requires, next-token prediction, increasingly deployed, reliable agentic
备注：
点击查看摘要
Abstract:Large language models are increasingly deployed as agents, but reliable agentic behavior requires more than next-token prediction. At inference time, it is preferred that an agent can decide whether to proceed with its current reasoning, defer to a stronger model, request additional information, invoke external tools, or abstain under the given setup. Existing approaches address these decisions through prompt-level routing, external orchestration, or task-specific fine-tuning, which primarily rely on input-side signals, and are often costly and difficult to maintain as model backbones evolve. We ask whether such control decisions can be inferred directly from a model's latent generation process. We introduce Multi-Head Latent Control, a lightweight layer that reads hidden-state trajectories from a frozen LLM or VLM to produce deployment-time control signals. A Capability Head predicts whether the current model can solve the instance or should defer to a stronger collaborator, while a Resolution Head predicts appropriate resolution decision Clarification, Tool Use, Abstention, or Direct Answering. Both heads are trained only on latent traces from the same frozen LLM backbone, enabling post hoc adaptation without modifying the model. Across language and vision-language settings, Multi-Head Latent Control consistently improves the quality-cost tradeoff of multi-model systems, enabling early handoff from partial generations and more accurate intervention decisions. In routed execution (small + large model), it reduces large-model usage by up to 90.7 percent on AndroidWorld and 27-53 percent on average across benchmarks, while retaining most of large-model performance. Additionally, the learned control signals improve tool-use decision quality, yielding up to +158 percent relative score gain and 65.5 percent fewer missed-required tool calls.
59. 【2607.14264】MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation
链接：https://arxiv.org/abs/2607.14264
作者：Yi Lin,Yihao Ding,Elana Benishay,Elefterios Trikantzopoulos,David Nauheim,Hanley Ong,Jiang Bian,Hua Xu,Yuzhe Yang,George Shih,Yifan Peng
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：generation remains challenging, faithful reporting requires, clinically faithful reporting, Automated chest, report generation remains
备注：
点击查看摘要
Abstract:Automated chest CT report generation remains challenging because clinically faithful reporting requires both whole-volume understanding and accurate description of localized anatomical findings. Here we developed and retrospectively evaluated MonteRET, a region-aware retrieval-enhanced framework for generating chest CT findings sections. MonteRET integrates global CT features with region-level anatomical representations, retrieves clinically relevant knowledge using predicted medical conditions and region-level vision-language alignment, and refines initial reports through a knowledge-guided report rewriting agent. We trained our model on a public cohort with 24,128 CT scans from RadGenome-ChestCT. We evaluated MonteRET on the public RadGenome-ChestCT test set of 1,564 CT scans and an external cohort of 82 CT scans from NewYork-Presbyterian/Weill Cornell Medical Center. MonteRET improved report quality, semantic similarity, and clinical efficacy compared with a matched baseline and several state-of-the-art methods. Gains were most pronounced for recall, suggesting fewer omitted findings. Human expert evaluation by radiology residents also favored MonteRET.
60. 【2607.14252】MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning
链接：https://arxiv.org/abs/2607.14252
作者：Zihao Yu,Xiu Yuan,Chongjie Zhang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：future goals interpretable, Long-horizon robot planning, makes future goals, Embodied Action Memory, Long-horizon robot
备注： 43 pages, 9 figures. Oral presentation at the Robotics: Science and Systems 2026 Workshop on Foundation Models for Robot Planning (FM4RoboPlan)
点击查看摘要
Abstract:Long-horizon robot planning requires more than predicting what actions will do next; it also requires memory of the embodied experience that makes future goals interpretable. People do not plan from the present scene alone: they draw on remembered places, object-state changes, prior procedures, and regularities revealed through repeated action. We formulate Embodied Action Memory (EAM) as the capability to form, maintain, and use such experience as a persistent memory state for later decisions. MEMORA realizes EAM with a formation-consolidation-retrieval lifecycle and four typed stores: Environment Memory, Entity Memory, Activity Memory, and Inferred Knowledge. Online editing maintains object identities and state histories as new observations arrive; offline consolidation abstracts repeated experience into reusable procedures and participant-specific regularities. MEMORA-Bench evaluates this lifecycle on 45 hours of EPIC-KITCHENS-100 extension video across 18 participants through memory-grounded planning, including previously unseen goals, and a complementary memory-assessment task. Across four open-weight language models, full MEMORA--combining editing, typed stores, and consolidation--achieves the strongest aggregate results among the evaluated memory conditions. It improves memory-assessment accuracy by up to 20.5 points over the strongest controlled baseline and improves out-of-distribution Robot-Grounded Plan score by up to 16.6% relative. A qualitative two-task robot deployment study further illustrates how memory-grounded language plans can interface with downstream control, while the overall results show that editable, consolidated memory can supply remembered context for robot planning. Project page: this https URL
61. 【2607.14250】he Severance Problem: LLMs are Unaware of the Person Beyond the Prompt
链接：https://arxiv.org/abs/2607.14250
作者：Dor Litvak,Liu Leqi
类目：Computation and Language (cs.CL)
关键词：enhance everyday life, supporting consequential decisions, automating routine tasks, attracted significant interest, everyday personal matters
备注：
点击查看摘要
Abstract:Personal AI assistants have attracted significant interest for their potential to enhance everyday life by automating routine tasks, supporting consequential decisions, and assisting with everyday personal matters. Yet despite rapid recent technical advances, these assistants continue to exhibit undesirable behaviors, such as sycophancy, overconfidence, and hallucination. We argue that these failures stem from a fundamental limitation: language models lack an explicit representation of the person beyond the context they are given, which we term as the \textbf{Severance Problem}. Even with rich personal context and strong commonsense reasoning capabilities from the backbone model, current AI assistants fail to represent what remains unknown about the user. We propose a simple solution: incorporating structured ignorance into the language model context via the \textbf{Severance Schema}, which explicitly outlines dimensions along which the model lacks knowledge about the user, including physicality, temporality, consequences, continuity, multiplicity, and interiority. Empirically, across five model families, with the Severance Schema, the assistant consistently reduces sycophancy, harmful advice, and hallucination. Notably, models with the schema ask clarifying questions when information about the user is missing, rather than confidently extrapolating from incomplete user information.
62. 【2607.14242】Implicit Reasoning Steering via Concept Chaining
链接：https://arxiv.org/abs/2607.14242
作者：Xiao Ye,Sanika Chavan,Yuxi Huang,Shahriar Kabir Nahin,Muhao Chen,Anshuman Chhabra,Ben Zhou
类目：Computation and Language (cs.CL)
关键词：Large language models, repeated sampling yields, Large language, questions repeated sampling, reason reliably
备注：
点击查看摘要
Abstract:Large language models often appear to reason reliably, yet on many questions repeated sampling yields both correct and incorrect answers, revealing an underlying fragility in how final decisions are formed. We study whether this fragility can be exploited through implicit reasoning steering: using natural-language text to bias a model toward a designated answer without explicit instructions, triggers, or direct answer cues. Our approach, Concept Chaining, generates a short connection paragraph that links question entities to a target option through one or two intermediate concepts. We then continue pretraining a victim model on these connection paragraphs and evaluate whether its answer preference shifts on the original multiple-choice questions. Our results show that indirect, natural-looking text can systematically steer model predictions while remaining substantially less inferable than direct paraphrases, which shows that reasoning brittleness is not merely an evaluation artifact: it creates a practical channel through which latent biases can be amplified by ordinary-looking text to covertly redirect model decisions.
63. 【2607.14205】Privacy Leakage in Federated Learning in Radiology Reports: A Comparative Evaluation of Tokenizer-Driven Privacy Risks
链接：https://arxiv.org/abs/2607.14205
作者：Santhosh Parampottupadam,Andres Martinez,Dimitrios Bounias,Sinem Sav,Klaus Maier-Hein,Ralf Floca
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：sharing raw data, enables multi-institutional training, reconstruct sensitive information, Federated learning, enables multi-institutional
备注：
点击查看摘要
Abstract:Federated learning (FL) enables multi-institutional training on clinical text without sharing raw data, but gradient inversion can reconstruct sensitive information from shared model updates. The extent of this leakage for radiology reports, and the role of tokenizer design, remains unclear. We quantify gradient-based text reconstruction in FL and compare privacy risk across three tokenizers with the model architecture held fixed. Six FL clients trained a GPT-2-style transformer (sequence length 32) on public radiology corpora (368,751 diagnostic reports, 98,206 discharge summaries, 1,500 MIMIC-CXR free-text reports) using the GPT-2, RadBERT, and LLaMA-2 tokenizers at batch sizes of 64, 128, and 256. Assuming an active malicious server that modifies the shared architecture before distribution, we applied analytic gradient inversion and measured reconstruction fidelity over five runs. Exact sentence reconstruction ranged from 31% to 44% across tokenizers (30.6-43.5% across the 27 tokenizer x dataset x batch-size cells). At batch size 64 on the Discharge dataset, accuracy was 42.1% (GPT-2), 42.3% (RadBERT), and 39.4% (LLaMA-2), decreasing to 37.3%, 37.2%, and 34.3% at batch size 256. S-BLEU declined as batch size grew (GPT-2: 0.44 to 0.33; RadBERT: 0.48 to 0.35). RadBERT yielded the highest reconstruction fidelity and recovered the most clinical terms (18.1% of a 1,440-term reference vocabulary, vs 12.5% for GPT-2 and 9.4% for LLaMA-2), yet no tokenizer prevented leakage. Substantial portions of report text are therefore recoverable from FL gradients even at larger batch sizes and with domain-specific tokenizers. Tokenizer design influences leakage severity and is a privacy-relevant decision, not only a utility one; safeguards such as secure aggregation and differential privacy are likely necessary to meet HIPAA and GDPR requirements for FL in radiology NLP.
64. 【2607.14171】Branching Policy Optimization: Sandbox-Native Language Agent Reinforcement Learning
链接：https://arxiv.org/abs/2607.14171
作者：Bowei He,Yankai Chen,Xiaokun Zhang,Xue Liu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：large language model, training large language, Reinforcement learning, language model, learning has emerged
备注： Accepted by WAIC Academic 2026
点击查看摘要
Abstract:Reinforcement learning has emerged as the dominant paradigm for training large language model (LLM) agents that interact with executable sandboxes. State-of-the-art algorithms such as PPO, RLOO, and GRPO inherit their rollout topology from RLHF: for each prompt, N independent trajectories are sampled from the initial state, and an advantage is computed by subtracting a group baseline. This design ignores a defining property of agent sandboxes. They are deterministic, snapshottable, and resumable from any intermediate state. We argue that this property enables a fundamentally different rollout topology: rather than N independent trees of depth T, one can construct a single tree of N leaves whose siblings share prefixes, and therefore share variance. We instantiate this idea as Branching Policy Optimization (BPO), a sandbox-native RL algorithm that (i) adaptively snapshots the sandbox at high-entropy decision points along a backbone trajectory, (ii) forks K alternative actions per branch point and rolls out each to termination, and (iii) computes per-step advantages from sibling returns rather than from independent prompts. We prove this estimator is unbiased and has strictly lower variance than the trajectory-level baseline, with the reduction equal to the prefix-explained portion of return variance. On WebShop, ALFWorld, and SWE-bench Verified with Qwen2.5-7B and Llama-3.1-8B backbones, BPO improves success by 3.6--6.1 absolute points over GRPO and RLOO at matched compute, halves gradient-norm variance, and matches the best baseline using 38% fewer policy updates.
65. 【2607.14159】MemoHarness: Agent Harnesses That Learn from Experience
链接：https://arxiv.org/abs/2607.14159
作者：Yue Huang,Wenjie Wang,Han Bao,Yuchen Ma,Xiaonan Luo,Yi Nian,Haomin Zhuang,Zheyuan Liu,Yue Zhao,Xiangliang Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：external control layer, output handling, base LLM, layer that turns, harness
备注：
点击查看摘要
Abstract:An agent harness is the external control layer that turns a base LLM into an executable agent by managing context, tools, orchestration, memory, decoding, and output handling. While harness design strongly affects agent behavior, most automatic improvement methods optimize narrower artifacts such as prompts, pipelines, or workflows, and deployed agents usually reuse a single global harness for all cases. We introduce MemoHarness, an adaptive harness optimization framework that learns from its own executions. MemoHarness decomposes the harness into six editable control dimensions, stores per-case diagnoses and distilled global patterns in a dual-layer experience bank, and adapts the learned harness to each test case using retrieved experience without test-time labels, feedback, or additional search. In our evaluation across shell-agent, code-generation, and analytical-reasoning benchmarks, MemoHarness improves over the fixed harnesses we compare against and shows selective transfer to unseen suites and base models. Its additional context can also remain cost-competitive when much of the retrieved experience is cacheable. These results provide evidence that execution experience is a practical substrate for building agent harnesses that are more adaptive than a single static configuration, while leaving broader claims about statistical robustness and component attribution to future work.
66. 【2607.14158】Orchestrating Power Grid Studies with Multi-Agent AI and MCP Servers
链接：https://arxiv.org/abs/2607.14158
作者：Jérôme Picault,Clément Goubet
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：Transmission System Operator, Model Context Protocol, System Operator, Transmission System, Context Protocol
备注： Accepted to IJCAI AISE 2026 workshop
点击查看摘要
Abstract:This position paper explores how Agentic AI and Model Context Protocol (MCP) can support power-grid studies in a Transmission System Operator (TSO) context. We focus on integrating Large Language Models with numerical simulation tools, structured workflows, and human supervision. We identify key industrial requirements for agent assisted grid studies and introduce pypowsybl-mcp, an MCP-based interface exposing selected capabilities of our simulation tool, pypowsybl to AI agents. This first step provides a testbed to study how agents can setup simulations, execute analyses, retrieve results, and interact with power-system simulators through standardized tool calls. We also discuss principles for human-in-the-loop, multi-agent workflows and outline an evaluation strategy combining technical metrics and practitioner feedback. The paper positions MCP-based tool integration as a step toward more interactive, auditable, and scalable grid-study environments.
67. 【2607.14147】Breaking Refusal in the First Half: A Mechanistic Study of the Prefill Jailbreak
链接：https://arxiv.org/abs/2607.14147
作者：Alex Kwon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：Aligned language models, Aligned language, language models refuse, refuse harmful requests, models refuse harmful
备注： 31 pages, 3 figures. Code and derived artifacts: [this https URL](https://github.com/collapseindex/breaking-refusal)
点击查看摘要
Abstract:Aligned language models refuse harmful requests, but a one-line prefill ("Sure, here is") strips the refusal. We ask where and how it fails. The harm representation stays intact: on the prompts the attack flips to compliance, a linear probe reads harm as high as on the refused ones (0.91-0.98), while behavioral refusal drops to chance. This holds across four models and three families (1.5-3.8B, and at 14B). Refusal is therefore a shallow, response-site computation. We localize it to an early window: a dose-matched position control shows the first half of the response suffices to break refusal, while the second half is nearly inert. Three causal probes converge on that window. Restoring the harm direction there partially re-engages refusal. Injecting the model's own refuse-state reverses the jailbreak (74%, held-out). And knocking out the early response's attention to the prefill, but not an equal attention mass elsewhere, selectively collapses the harmful continuation. A base-model control identifies the mechanism: the same knockout collapses the continuation prefill-specifically even in a non-safety-tuned base model (64% to 25% harmful content vs a matched control's 64%, replicated at 7B). So the prefill's grip is generic autoregressive conditioning, not safety-specific suppression, and "refusal restoration" is a model-dependent fallback. The dominant mechanism is passive. A small safety-specific attractor remains on top (logit-trace concentration 0.24 vs 0.03), whose active-vs-passive character we size but do not fully separate. No single direction or component is a clean handle either: the decision is decodable but distributed, and refusal tracks harm rather than scary surface. The consequence is structural: a monitor reading the untouched prompt-side representation is immune by construction, but only to response-site attacks. The mechanism is diffuse; the failure surface is local.
68. 【2607.14131】Cross-Dataset Generalization in Urdu Fake News Detection: An Empirical Study with XLM-RoBERTa and a Length Confound Analysis
链接：https://arxiv.org/abs/2607.14131
作者：Muhammad Abdullah Haroon
类目：Computation and Language (cs.CL)
关键词：million people worldwide, detection remains under-resourced, Urdu, million people, people worldwide
备注： 10 pages, 7 figures, 5 tables, submitted to arXiv
点击查看摘要
Abstract:Urdu fake news detection remains under-resourced despite Urdu being spoken by over 231 million people worldwide. While prior work has demonstrated strong in-domain performance on individual Urdu datasets, cross-dataset generalisation has received little systematic attention. This paper presents the first cross-dataset generalisation study for Urdu fake news detection, using two publicly available balanced datasets: the Ax-to-Grind Urdu corpus (10,083 articles, 15 domains) and the Notri-Fact Urdu dataset (13,388 articles). We fine-tune xlm-roberta-base under four experimental conditions, in-domain on each dataset and two zero-shot cross-domain transfer directions, comparing against TF-IDF baselines using Logistic Regression and Support Vector Machines. Our experiments reveal a striking asymmetry: Notri-Fact to Ax-to-Grind transfer achieves a macro F1 of 0.771, while the reverse collapses to F1 of 0.005, with the model predicting fake for 99.7% of test articles. We demonstrate that this collapse stems from a systematic length confound in Ax-to-Grind, where fake articles average 117 words versus 35 for real articles, a 3.4x asymmetry inducing shortcut learning. A length ablation capping articles at 50 words yields only a 0.0067 F1 drop, confirming the confound inflates but does not solely drive in-domain performance. We provide a reusable diagnostic methodology that combines bidirectional transfer analysis and prediction-collapse inspection to identify confound-driven behavior in multilingual fake news detection settings.
69. 【2607.14126】Interpretable Language Model for Closed-Loop Type 1 Diabetes Control
链接：https://arxiv.org/abs/2607.14126
作者：Maya Sarkar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：pancreatic beta cells, life-threatening autoimmune condition, autoimmune condition characterized, insulin-producing pancreatic beta, Artificial Pancreas Systems
备注： Accepted at the 2026 IEEE 22nd International Conference on Automation Science and Engineering conference (IEEE CASE 2026)
点击查看摘要
Abstract:Type 1 Diabetes (T1D) is a chronic, life-threatening autoimmune condition characterized by the complete destruction of insulin-producing pancreatic beta cells. While Artificial Pancreas Systems (APS) powered by Reinforcement Learning (RL) have shown promise in automating insulin delivery, their ``black-box'' nature makes it hard for patients and doctors to trust them fully. This paper presents LLM-T1D, a promising approach that combines the precision of RL with the clear, human-like reasoning of Large Language Models (LLMs) to create a more transparent and reliable insulin pump controller. By training an expert RL system and distilling its knowledge into fine-tuned LLaMA 3.1 8B and Qwen3 8B models, we developed a controller that not only surpasses the RL system's performance but also explains its decisions in plain, understandable language. Tested on the FDA-approved UVA/Padova T1D simulator, the LLM controllers deliver excellent blood sugar control (73.5% Time in Range) while maintaining strict formal safety verification against hallucinations.
70. 【2607.14119】Semantic Register Compression in Multi-Agent LLM Cascades
链接：https://arxiv.org/abs/2607.14119
作者：Manuele Tele Junior Fernandez
类目：Computation and Language (cs.CL)
关键词：commonly decompose complex, decompose complex tasks, systems commonly decompose, Multi-agent LLM systems, specialized roles
备注： 15 pages, 2 figures, 4 tables
点击查看摘要
Abstract:Multi-agent LLM systems commonly decompose complex tasks into specialized roles. However, this modularity introduces a representational risk: when intermediate agents transform text across linguistic registers, they can systematically compress the semantic distinctions needed for accurate downstream decisions. We term this phenomenon semantic register compression and characterize it as an observable failure mode in multi-agent cascades. Using a three-agent pipeline (Collector-Evaluator-Decider), we quantify compression via inter-label separation in sentence-transformer embedding space. Across political fact-checking (LIAR), sentiment analysis (SST-5), and medical triage (Triagegeist), critical evaluation consistently reduces label separability by 41.7% at the Evaluator stage, while identity passthrough preserves it nearly fully. Five architectural variants causally isolate oriented semantic transformation as the primary driver. A credibility-seeking variant produces minimal geometric compression yet shifts outputs toward mostly-true, demonstrating that transformation valence controls the direction of distributional collapse independently of compression magnitude. Compression generalizes across the three domains with varying intensity: 41.7% in fact-checking, 27.2% in sentiment, and 20.0% in triage. Prompt-level regression explains 78% of the variance, with operational constraints associated with lower compression. These results demonstrate that semantic register compression is a measurable and generalizable phenomenon in multi-agent LLM systems, with implications for safety evaluation in high-stakes domains.
71. 【2607.14118】Budgeted Subset Refinement for Execution-Aware LLM Research Ideation
链接：https://arxiv.org/abs/2607.14118
作者：Micah Zhang
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large language models, Large language, strong executed projects, generate research ideas, lack diversity
备注： 18 pages, 3 figures, 9 tables
点击查看摘要
Abstract:Large language models (LLMs) can generate research ideas that appear novel to expert reviewers, but recent work also shows that such ideas often lack diversity, are difficult for LLMs to evaluate reliably, and may fail to translate into strong executed projects. This paper evaluates a controlled proxy benchmark for a pre-execution scaffolding problem: given a noisy pool of LLM-generated research ideas, how should a system allocate limited refinement effort to construct a stronger, more diverse, more execution-aware portfolio for human researchers under a fixed rubric? We introduce Budgeted Subset Refinement, a family of strategies that refine only a selected subset of candidates rather than refining all candidates uniformly. In a unified shared-candidate-pool evaluation across 10 random seeds and 10 research-ideation environments, raw generation and reranking alone produce no research-strong nonduplicate ideas under the benchmark rubric, while refinement is necessary for strong proxy-rated portfolios. Uniform refinement produces strong individual ideas but is not the best portfolio-level allocation of compute. Random-k refinement is a strong low-cost baseline, while diversity-aware MMR-k refinement gives the best overall proxy tradeoff: the highest research-strong nonduplicate yield, the lowest duplicate rate among successful methods, and the best cost per research-strong nonduplicate idea. A blinded external-judge robustness check on a balanced 72-item sample supports the broad refinement effect across independent model families, while showing that per-item rankings among refined strategies vary by judge. These results suggest that LLM research ideation systems should be evaluated not only as idea generators, but as budgeted support-allocation systems. The claims are scoped to proxy-rated portfolio quality and do not substitute for expert review or execution-grounded validation.
72. 【2607.14117】Heterogeneous Element-Aware Cross-Version Differencing of Scientific Documents via Layout-Aware Alignment and Structure-Aware Reasoning
链接：https://arxiv.org/abs/2607.14117
作者：Zhen Yina,Wenkang An,Hao Wang,Keran You
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：technical documentation, essential in scholarly, scholarly publishing, publishing and technical, remains challenging
备注：
点击查看摘要
Abstract:Cross-version differencing of scientific documents is essential in scholarly publishing and technical documentation, but remains challenging because scientific documents are page-structured artifacts containing heterogeneous elements such as text, tables, formulas, figures, and layout cues. Existing text-sequence-based methods often lose layout and structural information, while image-based methods lack semantic interpretability and are sensitive to rendering variation. To address these limitations, this paper proposes a layout-aware heterogeneous element-aware framework for scientific document differencing. The framework decomposes document versions into semantically typed elements, establishes cross-version correspondence through an alignment-first mechanism that jointly models spatial, content, and structural compatibility, and performs type-aware difference reasoning over aligned element pairs. It supports unified change detection, localization, structure-awareness analysis, and alignment/matching evaluation across text, tables, formulas, and figures. Experiments on real-world scientific PDF data from journal production proofreading workflows show that the proposed framework consistently outperforms element-specific baselines. It achieves detection F1 scores of 0.903, 0.855, 0.862, and 0.845 for text, tables, formulas, and figures, respectively, with further improvements in localization, structure awareness, and matching quality. Ablation and sensitivity analyses confirm the effectiveness of cross-version alignment, type-specific representations, structure-aware reasoning, and compatibility-weight design. These results demonstrate that heterogeneous element-aware differencing provides a robust and interpretable solution for scientific document comparison in realistic editorial production scenarios.
73. 【2607.14116】ReportMedSAM: Guiding Segmentation Through Radiology Reports
链接：https://arxiv.org/abs/2607.14116
作者：Anghong Du,Theodoros N. Arvanitis,Colin Watts,Alejandro F. Frangi,Le Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, rich clinical descriptions, reliable segmentation remains, segmentation remains challenging, natural language
备注：
点击查看摘要
Abstract:Free-form radiology reports contain rich clinical descriptions, yet converting them for reliable segmentation remains challenging due to the inherent variability of natural language. Existing pipelines often rely on predefined organ phrases or brittle rule-based inference-time extraction, which limits their scalability to novel anatomical structures and makes them sensitive to linguistic variations. To address this, we propose ReportMedSAM, a report-driven framework that replaces discrete extraction with a learnable concept bank. By leveraging a frozen medical vision-language encoder (BiomedCLIP), we align organ-level concept embeddings with large-scale clinical corpora through contrastive learning, establishing mutually orthogonal semantic anchors. Our approach explicitly mitigates organ-level semantic collapse and ensures high robustness against diverse clinical synonyms (e.g., "renal" vs. "kidney" ). During inference, a clinical report is embedded and matched against this concept bank to dynamically activate task-specific Mixture-of-Experts (MoE) modules. This decoupled design allows new concepts and experts to be added without retraining existing components, providing a parameter-isolated extension mechanism while keeping previously learned experts unchanged. Evaluated on the AbdomenAtlas 3.0 dataset, ReportMedSAM effectively interprets free-form reports, achieves competitive segmentation accuracy, and demonstrates seamless, non-interfering extension to novel clinical tasks.
74. 【2607.14115】DialogueVPR: Towards Conversational Visual Place Recognition
链接：https://arxiv.org/abs/2607.14115
作者：Yukun Song,Changwei Wang,Xingtian Pei,Shibiao Xu,Wenhao Xu,Shunpeng Chen,Yu Zhang,Ke Zhang,Rongtao Xu,Xuxiang Feng,Pengyang Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：communicate spatial information, humans communicate spatial, gained significant traction, spatial information, language-guided geo-localization
备注： Accepted to CVPR 2026
点击查看摘要
Abstract:Inspired by how humans communicate spatial information, language-guided geo-localization has gained significant traction for its intuitive and practical value. Despite this progress, most methods still rely on a static, one-shot retrieval paradigm, which fails to handle the ambiguity and incompleteness inherent in real-world natural language descriptions. We propose a paradigm shift to reasoning retrieval and introduce Dialogue Place Recognition (DlgPR), which casts localization as an interactive, dialogue-driven reasoning process. To support this new task, we present DlgQuest-Cities, the first large-scale dialogue-based benchmark for place recognition, and a unified reasoning framework that couples a cross-modal multi-level retriever with an intelligent questioner, DQ-pilot. DQ-pilot is trained in a curriculum: supervised fine-tuning on a curated DQ-cities-20k subset followed by reinforcement refinement on a harder DQ-cities-10k split via GRPO. Two task-aligned metrics guide learning: a Discriminative Difficulty Index (DDI) for curriculum sampling and a Positional Retrieval Gain (PRG) reward that directly measures retrieval improvement induced by a question. Experiments show this reasoning-based approach significantly outperforms baselines. The code and model are available at this https URL.
75. 【2607.14114】CoEvoT: Co-Evolving Chain-of-Thought Prompting for Graph-LLM Reasoning
链接：https://arxiv.org/abs/2607.14114
作者：Haohua Niu,Xingtong Yu,Yang Liu,Junfeng Fang,Xuanting Xie,Jie Tan,Zhongjian Zhang,Hong Cheng,Yuan Fang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：distribution shift presents, persistent challenge, learning under distribution, distribution shift, shift presents
备注： Under review
点击查看摘要
Abstract:Graph learning under distribution shift presents a persistent challenge, where models adapt to new graphs with limited or even no supervision. Recent graph--LLM approaches move toward label-efficient prediction by linearizing graphs into prompts and using large language models (LLMs) as predictors, and can adopt Chain-of-Thought (CoT) prompting to exploit LLM's multi-step reasoning capability. However, existing CoT-based graph--LLM methods generate intermediate thoughts while conditioning on fixed graph tokens, limiting step-wise refinement of structural cues. In this paper, we propose CoEvoT, a simple yet effective co-evolving CoT prompting framework for graph--LLM reasoning. CoEvoT couples text-to-graph token rewriting and graph-to-text reasoning guidance in a closed loop: each intermediate textual thought is used to update the graph token evidence state via a lightweight condition network, and the updated tokens are fed back into the next-step instruction to guide subsequent LLM reasoning. This enables step-wise, state-aware evidence refinement, rather than reasoning over a fixed graph snapshot. Extensive experiments on eight datasets demonstrate that CoEvoT consistently outperforms state-of-the-art baselines.
76. 【2607.14113】5-CSBoost: Adversarial Perturbation Resistant LLM Fingerprinting
链接：https://arxiv.org/abs/2607.14113
作者：Gayan K. Kulatilleke,Mahsa Baktashmotlagh,Siamak Layeghy,Marius Portmann
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：accuracy degrades significantly, detectors achieve strong, Style Boosted Classifier, achieve strong performance, Contrastive Style Boosted
备注： 14 pages, 3 datasets, code and data will be provided
点击查看摘要
Abstract:While many AI-generated text (AIGT) detectors achieve strong performance on clean inputs, their accuracy degrades significantly under light paraphrasing, word substitutions, character edits, and distribution shifts. We present T5 Contrastive Style Boosted Classifier (T5-CSBoost), an extension to the T5-Sentinel framework that keeps the original next-token prediction objective for source attribution while introducing an auxiliary margin-based triplet loss over decoder embeddings. This contrastive style regularization encourages the learning of compact, perturbation-resistant stylistic representations, offering a lightweight yet effective alternative to prior approaches that rely on architectural modifications, adversarial training, or complex multi-task objectives without altering the underlying T5-small backbone. T5-CSBoost achieves state-of-the-art multiclass source attribution and binary human-vs-LLM detection on OpenLLMText and HC3 AIGT benchmarks. More importantly, T5-CSBoost demonstrates enhanced robustness to word and character level adversarial perturbations of up to 90% intensity, achieving state-of-the-art on the challenging MAGE/Deepfake stress-test suite, including unseen models, unseen domains, and extreme paraphrasing scenarios. Our results highlight that explicitly regularizing stylistic embeddings via contrastive learning is a practical and effective strategy for building more robust LLM fingerprinting systems in real-world adversarial settings.
Comments:
14 pages, 3 datasets, code and data will be provided
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2607.14113 [cs.CL]
(or
arXiv:2607.14113v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.14113
Focus to learn more
arXiv-issued DOI via DataCite</p>
77. 【2607.14112】Information-Theoretic Limits of Reliability and Scaling in Language Models
链接：https://arxiv.org/abs/2607.14112
作者：Subhabrata Majumdar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT)
关键词：Large language models, sufficient scale, Large language, Large, perfect reliability
备注： 29 pages, 2 figures
点击查看摘要
Abstract:Large language models (LLMs) are evaluated as though perfect reliability is achievable for any task given sufficient scale. We show this assumption is information-theoretically unjustified. Every generative task has a reliability ceiling that no model can exceed, determined by how much output uncertainty is resolvable from observable context. The gap decomposes into a resolvable component closable with additional context and a subjective component inherent to task ambiguity. Autoregressive generation further degrades this ceiling at a rate governed by the task's dependency kernel, which quantifies inter-token correlations in the output. From these two primitives, we derive a first-principles scaling law where LLM performance is bottlenecked by the scarcer resource: training data or model capacity. This law recovers the Chinchilla scaling law as a special case and provides a structural account of when scaling improves reliability. Beyond scaling, our framework unifies diverse practical phenomena, such as the benefits of retrieval-augmentation and the spectral mechanics of catastrophic forgetting. Our work formalizes the resource-complexity tradeoffs that govern model performance across domains, offering a unified theory of performance limits in generative language models.
78. 【2607.14111】Introspection Fine-Tuning (IFT): Training Small LLMs to Introspect
链接：https://arxiv.org/abs/2607.14111
作者：Ely Hahami,Ishaan Sinha,Lavik Jain
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language models detect, small language models, internal activations, models, model
备注： 9 pages (excluding appendices / references), 2 figures, 3 tables
点击查看摘要
Abstract:Can small language models detect and report on perturbations their own internal activations? We investigate this question through the lens of activation steering: injecting concept vectors into a model's residual stream and measuring whether the model can accurately report on the perturbation. We first show that the binary detection paradigm used in prior work -- prompting the model to answer Yes'' or No'' to whether it detects an injected thought -- is confounded in small models, as steering biases the model toward affirmative responses regardless of the question content. We therefore propose two confound-free evaluation paradigms: sentence localization (identifying which of $N$ sentences was perturbed, chance $= 1/N$) and strength comparison (identifying which of two sentences received a stronger injection, chance $= 50\%$). Evaluating across six models from two families (Llama-3.2 and Gemma-4), we find that models as small as 2B parameters introspect reliably well above chance, and that introspective ability generally increases with scale. Llama-1B, however, performs at or below chance. We then introduce \emph{Introspection Fine-Tuning} (IFT): supervised fine-tuning on sentence-localization examples constructed from the model's own perturbed forward passes. IFT raises Llama-1B sentence-localization accuracy from $9.6\%$ to $60.6\%$ (a $6\times$ improvement), with gains generalizing zero-shot to the held-out strength-comparison task ($30.2\% \to 52.2\%$). IFT also improves introspection for 3B and 8B models, while inducing negligible degradation on standard capability benchmarks. Our results suggest that introspective ability is not fixed by scale alone: it can be directly trained, and doing so unlocks latent self-monitoring capacity with implications for AI transparency and alignment. Our code is \href{this https URL}{here}.
79. 【2607.14110】MAPS: Modeling Co-Existing Subjective Perspectives and Shared Meaning in Multi-Agent Cognitive Dialogue
链接：https://arxiv.org/abs/2607.14110
作者：Molood Arman,Clément Bonnafous
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Human dialogue involves, subjective cognitive styles, Human dialogue, exchanging information, expresses beliefs
备注：
点击查看摘要
Abstract:Human dialogue involves more than exchanging information; it also expresses beliefs, emotions, and subjective cognitive styles. Yet current AI dialogue systems often enforce semantic uniformity, sacrificing diversity and interpretability. We present MAPS (Multi-Agent Perspective Spaces), a novel framework that models dialogue between cognitively distinct agents through domain-weighted profiles, dynamic GRU-based memory, and interpretable token-level attention. MAPS enables agents to maintain individualized reasoning while progressively converging on shared meaning. Evaluations on EmpatheticDialogues, TopicalChat, and MultiWOZ show that MAPS supports semantic alignment without collapsing subjectivity. Our results demonstrate a path toward cognitively grounded, interpretable dialogue systems that balance expressiveness and coherence.
80. 【2607.14109】Simplicity Paradox: Debunking myths about prompting and datasets for LLM evaluation
链接：https://arxiv.org/abs/2607.14109
作者：Inder Preet,Shuxin Lin,Dhaval Patel
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：natural language understanding, building robust solutions, Probing the capabilities, Multiple-Choice Question Answering, language understanding
备注：
点击查看摘要
Abstract:Probing the capabilities of Large Language Models (LLMs) and building robust solutions for Multiple-Choice Question Answering (MCQA) remain central challenges in natural language understanding. Furthermore, the rapid proliferation of LLMs has created the implicit assumption that more sophisticated prompting techniques yield better performance. Several studies claim better performance with more sophisticated prompting techniques, but do not provide a comprehensive evaluation. We address this gap through a comprehensive empirical study of 8 prompting techniques across 10 multiple-choice question answering (MCQA) datasets, encompassing 27 model configurations and roughly 4,300 unique questions evaluated more than 430,000 times. Our findings reveal a striking paradox that baseline prompting consistently outperforms complex reasoning techniques on various benchmarks. Only minimal expert and inductive role framing (CoT-Expert and CoT-Inductive) yields a small but statistically significant $\sim$3 percentage-point (pp) gain over baseline whereas every other elaborate technique we tested matches or under-performs it, often by large margins (up to 31~pp for Self-Analogical). We further investigate three critical phenomena: (1) the unexpected victory of Qwen3-30B-A3B-Thinking-2507 in Elo ratings, (2) the performance-efficiency trade-offs across model variants with different thinking budgets, revealing model-dependent optimal configurations, and (3) the substantial variation in dataset difficulty, with 60% of benchmarks below 70% accuracy and a 47.5~pp spread from easiest to hardest, indicating considerable room for model improvement. These results suggest that the LLM evaluation community may be overcomplicating prompt engineering and that substantial performance gaps remain across diverse benchmarks, offering opportunities for genuine model improvements rather than prompt optimization.
81. 【2607.14108】Eta Given Delta: Defining LLM Tool Efficiency With Marginal Tool Utility
链接：https://arxiv.org/abs/2607.14108
作者：Nyx Iskandar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)
关键词：quantitative metric, tool, paper introduces tool, introduces tool efficiency, tool efficiency
备注：
点击查看摘要
Abstract:This paper introduces tool efficiency, a new quantitative metric to evaluate the rate of useful tool calls in an LLM agent trajectory. To ensure that tool efficiency is well-defined, we also introduce marginal tool utility, a new quantitative metric defined per tool call indicating whether a tool is useful or whether it can be safely removed from the tool suite without affecting accuracy while increasing tool efficiency; in this paper, we determine the sign of marginal tool utility for each tool call in a trajectory using LLM-as-a-Judge. While much prior work has been done to develop techniques that improve tool use by LLMs and design evaluation methods measuring efficiency indirectly using accuracy as a proxy, our work is centered on measuring efficiency directly via the quantitative metric proposed in this paper in post hoc trajectory analyses. It is our intention that this work contributes to the frontier of LLM evaluation research as a springboard for future benchmark designs and agent harness engineering (specifically with regards to creating lean tool suites) that optimize for metrics that complement but are distinct from accuracy.
82. 【2607.14107】Polestar: Drift-Aware Cache Calibration and Token Commitment for Efficient Inference of Diffusion LLMs
链接：https://arxiv.org/abs/2607.14107
作者：Mingyu Lee,Akshat Ramachandran,Souvik Kundu,Tushar Krishna
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, compromise generation quality, diffusion large language, static confidence thresholds, bidirectional attention precludes
备注：
点击查看摘要
Abstract:The inference efficiency of diffusion large language models (dLLMs) is constrained by two challenges: bidirectional attention precludes efficient KV-cache reuse, while increasing decoding parallelism with static confidence thresholds can compromise generation quality. We observe that both challenges arise from a shared phenomenon: as tokens are decoded, their contextual integration through bidirectional attention causes token representations to drift (evolve) across decoding steps. This insight motivates Polestar, a training-free inference framework that uses token representation drift as a unified signal to jointly address both challenges. Polestar comprises two components: Polestar-Cache, which identifies stale KV-cache positions via drift and performs sparse KV-cache refreshes to enable efficient reuse, and Polestar-Commit, which detects sharp drift events to reliably identify commit-ready tokens. Across mathematics and coding benchmarks on several dLLM families, Polestar sets a new state of the art on the accuracy-throughput Pareto frontier, achieving up to 10.73% accuracy improvement, up to 3.7x higher throughput, and high decoding parallelism of 3.67 tokens per forward pass over existing baselines.
83. 【2607.14106】oken Time Continuous Diffusion for Language Modeling
链接：https://arxiv.org/abs/2607.14106
作者：Parikshit Bansal,Sujay Sanghavi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：mapping Gaussian noise, deterministically mapping Gaussian, Gaussian noise, mapping Gaussian, final token canvas
备注：
点击查看摘要
Abstract:In this paper we introduce token time continuous diffusion (TTCD), a new diffusion language model which (a) operates in continuous space, deterministically mapping Gaussian noise to a final token canvas with no further sampling, and crucially (b) incorporates a new notion of per-token times, with some tokens proceeding from noise to token at a faster rate than others. Continuous space modeling helps TTCD avoid the parallel sampling of multiple tokens, which is a key source of inaccuracy at high speedups for models that iterate purely in discrete space. The notion of per-token times helps TTCD to better model conditional generation, allows for more sure tokens to proceed at a faster rate, and allows for differentiated inter-token influences during refinement. TTCD outperforms discrete models at high speedups. We train a 160M parameter TTCD model on OpenWebText, and then self-distill it; we find that at high speedups we are comparable in unconditional generation quality, and outperform in conditional generation, several existing models of similar size trained, on the same data, and self-distilled. We achieve similar gains in Sudoku solving as well.
84. 【2607.14105】Automatically Evolving Prompt Guidelines for Task-Specific Optimization
链接：https://arxiv.org/abs/2607.14105
作者：Cedric Richter,Salah Ghamizi,Mike Papadakis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, Language Models, Large, Language
备注：
点击查看摘要
Abstract:For Large Language Models to reliably answer user queries, users must clearly specify requirements, context, and constraints. In practice, however, user queries are often underspecified, forcing models to infer unstated assumptions that may misalign with the actual user intent. Existing prompt engineering guidelines aim to mitigate this issue, they are typically generic and task-agnostic, limiting their practical utility. Additionally, existing guidelines are formed manually and in a non-systematic way. To this end, we study prompt guideline optimization: the problem of automatically generating task-specific guidelines that help write better-specified prompts for a given task and model. Our key observation is that existing (completed) task examples (aka reference answers) often implicitly encode the missing information required to complete underspecified queries, including behavioral constraints, contextual assumptions, and evaluation criteria. We therefore propose AGOPS, an automatic approach that evolves task-specific guidelines via an optimization scheme that involves a prompt LLM writer, a solver LLM and prompt evolution, which maximize downstream effectiveness on a set of examples (user queries with reference answers). At inference time, our guidelines help users write well-specified prompts, boosting the effectiveness of LLMs. We show across mathematical reasoning, medical question answering, and coding tasks, that prompt underspecification leads to major drops (up to 95.3%) in downstream task performance (compared to well-specified prompts) and, perhaps more importantly, that this drop can hardly be recovered by existing prompt optimization techniques. Users following AGOPS guidelines can regain this loss (increasing performance between 15.5 to 81.7% on average) consistently across all benchmarks.
85. 【2607.14104】UzWordnet and Generative AI for Learning Uzbek by Game Playing
链接：https://arxiv.org/abs/2607.14104
作者：Alessandro Agostini,Saydobid Khusanov,Mirkamol Mirkamilov
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)
关键词：Uzbek language, paper presents, enables learners, learners to practice, educational system architecture
备注： 19 pages, 3 figures
点击查看摘要
Abstract:This paper presents an educational system architecture that enables learners to practice the Uzbek language through game-playing. The architecture integrates UzWordnet and the largest currently available orthographic dictionary for Uzbek as core lexical resources, together with generative AI as a fundamental component for learning support. We design four educational games to facilitate Uzbek language learning and propose a game-based methodology for improving UzWordnet as a direct by-product of game dynamics. Our approach combines game design and lexical resources to address objectives that are at the same time educational (language learning) and lexical (improvement and enrichment of a lexical resource).
86. 【2607.14103】Latent Communication Between Language Model Agents: Channels, Alignment, and the Limits of Text
链接：https://arxiv.org/abs/2607.14103
作者：Markus Wenzel
类目：Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Multi-agent systems, Large Language Models, text, Multi-agent, MAS
备注：
点击查看摘要
Abstract:Multi-agent systems (MAS) are utilized in many contexts and many professions. Those MAS rely on inter-agent communication, usually implemented by clear-text message passing. We hypothesize that Large Language Models may have a world model at their disposal that exceeds expressibility in text when complex concepts need to be communicated. Our aim is to approach a proof of this hypothesis with structured experiments. In this work, we show that LLM agents communicating via text lose information, which we quantify via Sparse Autoencoder (SAE) feature analysis. We construct three communication channels and measure concept-discriminating information in each. We first show that the SAE-sparse channel retains a 99.4% probe accuracy at 28-fold compression over the dense-latent channel vs 80.4% for the text channel. We then proceed to examine the same for cross-architecture communication by using sparse latent space alignment. We find for Procrustes alignment a 92% top-1 retrieval between Llama and Mistral. Using a text round-trip, we perform feature survival analysis to find that text serialization destroys 88% of SAE features, replacing them with a different feature set. We attribute the loss to identity replacement, not attenuation. By our analysis, we were able to attribute a 3-10pp performance penalty to the linear Procrustes alignment, improving with nonlinear alignment methods. In a task-level evaluation we find that the latent channel matches the text channel on cross-lingual concept tasks but never exceeds it. Text augmentation with latent features provides no benefit, leading us to negative conclusions for the initial hypothesis: lost features mostly or completely encode surface form, not task-relevant semantics. To pinpoint the practical advantage of latent communication over a text channel, deeper tasks eliciting complex concepts and an corresponding analysis framework are needed.
87. 【2607.14102】UniSAGE: Unifying Static and Dynamic Attributes with Hyper-Structure
链接：https://arxiv.org/abs/2607.14102
作者：Taoran Fang,Yan Deng,Chunping Wang,Yang Wang,Lei Chen,Yang Yang
类目：Computation and Language (cs.CL)
关键词：applications increasingly involve, increasingly involve hierarchical, involve hierarchical information, real-world applications increasingly, rapid growth
备注：
点击查看摘要
Abstract:With the rapid growth of digital data, real-world applications increasingly involve hierarchical information that combines static attributes with dynamic records. Modeling such heterogeneous data in a unified and generalizable manner remains challenging. Existing approaches often rely on extensive manual design, are tightly coupled to specific data schemas, and typically process static and dynamic attributes in isolation, thereby overlooking their implicit interactions. We propose UniSAGE, a unified framework for modeling data with both static and dynamic attributes. UniSAGE constructs a global attribute graph that represents hierarchical and temporal relationships in a unified structure. To ensure representational consistency, it introduces two orthogonal parameter subspaces that jointly support static aggregation and dynamic reasoning within a shared semantic space. Building on these unified representations, UniSAGE further enables task-specific interaction between static and dynamic attributes via a lightweight hyper-structure mechanism. UniSAGE is fully automated, robust to evolving data schemas, and capable of capturing complex cross-attribute dependencies. Extensive experiments on multiple public benchmarks and a real-world financial behavior dataset demonstrate that UniSAGE consistently outperforms existing methods, achieving performance improvements of over 10% on several tasks.
88. 【2607.14101】LBA: Textual Hard-Label Adversarial Attack under Low Query Budgets
链接：https://arxiv.org/abs/2607.14101
作者：Shixin Guo,Ming Zhong,Xuhong Zhang,Dandan Zhao,Zhe Wang,Bo Zhang,Shouling Ji,Hao Peng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Generating high-quality adversarial, low query budgets, query budgets remains, Generating high-quality, hard-label scenario
备注：
点击查看摘要
Abstract:Generating high-quality adversarial texts with low query budgets remains a challenging problem in the hard-label scenario. Most existing approaches rely on greedy algorithms, where one position in the text is selected for substitution, followed by the substitutions of other positions. This local search approach may fail to discover high-quality adversarial examples and often leads to excessive query costs. Ideally, an optimal adversarial sample would consider all possible position combinations in the text, but exhaustive search is computationally impractical. To address this challenge, we propose a sampling-based method called LBA, which constructs an approximate distribution of high-quality adversarial examples by integrating both prior and posterior knowledge, and utilizes this distribution for sampling. As sampling progresses, posterior knowledge updates the approximate distribution, which in turn guides more effective sampling. Extensive experiments on six language models, ranging from small-scale to large-scale architectures across four datasets, demonstrate that LBA significantly outperforms state-of-the-art baselines on all evaluation metrics. Additionally, LLM-based assessment indicates that LBA generates more semantically preserved and comprehensible adversarial texts.
89. 【2607.14100】Quantum Compositional NLP for Arabic: Grammar, Morphology, and Word Sense in Circuit Topology
链接：https://arxiv.org/abs/2607.14100
作者：Wajahath Mohammed
类目：Computation and Language (cs.CL)
关键词：natural language processing, uniquely demanding testbed, compositional natural language, grammar-based quantum compositional, quantum compositional natural
备注： 32 pages, also published here: [this https URL](https://zenodo.org/records/19564468)
点击查看摘要
Abstract:We present the first application of pregroup grammar-based quantum compositional natural language processing (QNLP) to Arabic; a morphologically rich, free-word-order language whose structural complexity provides a uniquely demanding testbed for theories of meaning composition in quantum circuits. Our system converts Arabic sentences into quantum circuits whose topology mirrors grammatical structure: subjects, verbs, and objects become quantum gates, and the typed dependencies between them (the pregroup grammar) determine how those gates are wired together. We conduct three controlled experiments spanning word order, morphological tense, and verb sense disambiguation, comparing quantum circuit methods against classical baselines including AraVec (Arabic word embeddings) and AraBERT (a pre-trained Arabic transformer).
90. 【2607.14099】Just Keep Prompting: Evaluating Repetitive Socratic Prompting in VLMs
链接：https://arxiv.org/abs/2607.14099
作者：Shayda Moezzi,Bishoy Galoaa,Lorena Genua,Taskin Padir,Sarah Ostadabbas
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deploying Vision-Language Models, real-world settings requires, Deploying Vision-Language, Pure Socratic Interrogation, sustained conversational pressure
备注：
点击查看摘要
Abstract:Deploying Vision-Language Models (VLMs) in real-world settings requires not only strong visual reasoning but also stability under sustained conversational pressure. We introduce Just Keep Prompting (JKP), a multi-turn evaluation framework that measures VLM epistemic stability when users repeatedly challenge, question, or contradict a model's answer. JKP probes models for up to 10 follow-up turns using three strategies: Adversarial Negation (repeated rejection), Pure Socratic Interrogation (repeated calls to reassess certainty), and Context-Aware Socratic Summarization (reflecting the model's prior rationale back before asking for reconsideration). We evaluate GPT-4o, Gemini 2.5 Pro, and Qwen3-VL-30B on a subset of the STAR benchmark across 720 multi-turn runs. Aggregate accuracy changes modestly from Turn 0 to Turn 10, but trajectory-level analysis reveals substantial instability: correct answers regress, wrong answers recover, and many runs exhibit repeated answer flipping. Repeated prompting has bounded upside and often acts as a destabilizer rather than a reasoning aid. The effect is strongly model-dependent: Qwen3-VL-30B achieves the highest final accuracy but becomes confidently wrong under direct contradiction; Gemini 2.5 Pro is comparatively stable but token-expensive; GPT-4o is the most brittle and oscillatory. These findings reveal that multi-turn VLM evaluation captures not just additional reasoning but pressure-response profiles: how models trade off visual grounding, calibration, and conversational compliance under repeated challenge.
91. 【2607.13707】he Test Oracle Problem in Synthetic LLM-as-Judge Corpora: Disappearance, Distortion and a Validation Protocol
链接：https://arxiv.org/abs/2607.13707
作者：Serkan Ballı(Department of Software Engineering, Mehmet Akif Ersoy University, Burdur, Türkiye)
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：systems typically build, typically build synthetic, prompting an LLM, LLM to generate, build synthetic corpora
备注： 23 pages, 1 figure, 3 tables
点击查看摘要
Abstract:Studies of bias in LLM-as-judge systems typically build synthetic corpora by prompting an LLM to generate a hallucinated answer to pair with a factual one, then presenting both to a judge. We report a case in which this generation step silently failed, and use it to argue that the failure mode is structural rather than incidental. In a multilingual (Turkish/English) faithfulness-judgment corpus, a decoding-budget parameter shared between judging and generation calls truncated one producer's hallucinated answers to a few words. The resulting items produced a large, statistically robust effect: a 32-point cross-lingual collapse in one judge's selection accuracy, replicated from N=50 to N=500, explained by a three-layer mechanistic account, and confirmed by a controlled producer-swap experiment, none of which was real. The effect vanished to ceiling once the shared parameter was corrected, and only manual reading of the raw generations, not any aggregate statistical check, exposed the fault. A second measured bias (Markdown-formatting preference) was not fabricated but distorted by the same fault, its magnitude and in one case its sign shifting with stimulus length, a mode aggregate metrics cannot distinguish from the first. We frame the underlying vulnerability using the test oracle problem: corpora whose negative examples are LLM-generated carry no mechanical way to verify item integrity, while corpora built by deterministic perturbation of a gold answer carry an item-level oracle for free. A positive control supports this claim directly: an analogous fault injected into a minimal perturbation-based corpus is caught with 100% accuracy by a zero-cost, zero-human gold-to-negative string comparison. We close with a validation protocol, derived from our own case, for analysts working in the oracle-less regime that we argue describes most contemporary multilingual LLM-as-judge corpora.
92. 【2607.14713】Does Multi-Agent Debate Improve AI Feedback on Research Papers?
链接：https://arxiv.org/abs/2607.14713
作者：Tomas Havranek,Zuzana Irsova
类目：General Economics (econ.GN); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：journal referee report, single pass, reports, meta-analyses in economics, referee report
备注： 29 pages, 1 figure, 6 tables. Pre-registered on OSF; data, code, judge prompts, and blinded reports in the replication package on Zenodo. Project page: [this https URL](https://meta-analysis.cz/debate)
点击查看摘要
Abstract:Probably not, at least for meta-analyses in economics. In a pre-registered, identity-masked, within-paper experiment, the authors of 44 meta-analyses ranked three AI reports on their own paper by usefulness for improving it: a single pass by a frontier model against two multi-agent debate tools we built and expected to win. All reports were held to a common length and template. The authors preferred the single pass, by 0.66 rank points over mad-research (95% CI 0.32 to 1.00) and 0.57 over paper-workshop (0.16 to 0.95), though paper-workshop spent roughly thirty times the tokens. Authors who recalled their journal referee report usually placed it first and never last; in a separate exercise, three AI judges almost always placed the real journal referee report last. Among the three AI reports, Gemini (the judge whose model family wrote none of the reports) would have ranked paper-workshop first in the authors' place, reversing the single-pass preference. The reversal warns against substituting an AI judge for the author. We measure perceived usefulness for finished papers; whether AI should referee papers is a separate question.
信息检索
1. 【2607.15257】SearchOS-V1: Towards Robust Open-Domain Information-Seeking Agent Collaboration
链接：https://arxiv.org/abs/2607.15257
作者：Yuyao Zhang,Junjie Gao,Zhengxian Wu,Jiaming Fan,Jin Zhang,Shihan Ma,Yao Yao,Weiran Qi,Chuyan Jin,Guiyu Ma,Xingzhong Xu,Kai Yang,Ji-Rong Wen,Zhicheng Dou
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Tool-Integrated Large Language, Large Language Models, Large Language, made web search, Recent advances
备注： Code is available at [this https URL](https://github.com/antins-labs/SearchOS)
点击查看摘要
Abstract:Recent advances in Tool-Integrated Large Language Models have made web search a core capability of information-seeking agents. However, as interaction histories grow, agents increasingly struggle to track task progress. When search attempts fail to yield useful evidence, current single- and multi-agent systems can become trapped in repetitive loops, wasting search budgets and ultimately compromising the quality and completeness of the final output. We introduce SearchOS, a system-level multi-agent framework that turns fragile, implicit search progress into explicit, persistent, and shared state. First, we formulate open-domain information seeking as relational schema completion with grounded citations, where agents discover entities, populate attributes across linked tables, and anchor each value to source evidence. Then we design Search-Oriented Context Management (SOCM), which externalizes the evolving state into Frontier Task, an Evidence Graph, a Coverage Map, and Failure Memory. Built on SOCM, SearchOS applies a pipeline-parallel scheduling mechanism that overlaps the execution of sub-agents and continuously refills freed slots with tasks targeting unresolved coverage gaps to improve utilization and throughput. To schedule and control the execution of search agents, SearchOS introduces a Search Tool Middleware Harness that intercepts model and tool interactions to record grounded evidence and react to stalls or budget exhaustion, and provides a reusable hierarchical skill system comprising strategy and access skills to augment the agents' search process and avoid repeating failed search patterns across runs. On WideSearch and GISA, SearchOS leads all metrics among the evaluated single- and multi-agent baselines, paving the way toward robust information-seeking collaboration.
2. 【2607.15253】Bridge Evidence: Static Retrieval Utility Does Not Predict Causal Utility in Multi-Step Agentic Search
链接：https://arxiv.org/abs/2607.15253
作者：Debayan Mukhopadhyay,Utshab Kumar Ghosh,Shubham Chatterjee
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：systems are trained, trained and evaluated, document, agent, Static RAG Utility
备注： Preprint; extended version in preparation
点击查看摘要
Abstract:Retrieval systems are trained and evaluated on a static idea of usefulness: hand a document and a question to a reader model, see whether the answer improves, and score the document accordingly. The idea holds up when a document is read on its own. It breaks when a language model works as a search agent, issuing several queries and reasoning across turns, because a document can matter for what it lets the agent do next rather than for what it says about the current question. We measure that gap rather than argue it. Using a ReAct style agent over HotpotQA, we replay 1000 development questions and, for every document the agent read, delete it and re-run the rest of the trajectory from that point. Comparing the original run against its counterfactual gives a Counterfactual Trajectory Utility (CTU) score from three deltas: final answer quality, next query retrieval quality, and turn count. Crossing CTU against Static RAG Utility (SRU) over 23,322 document observations, the two are close to statistically independent (Spearman rho = -0.026). Roughly a third of the documents the agent reads are causally load bearing while looking useless to a static reader; we call these bridge documents. The pattern survives when the reader based axis is swapped for a BM25 and cross encoder proxy, giving a bridge cell of 27.2% on an evenly spread axis. A second experiment pins down the mechanism. Using the Observable Entity Relevance (OER) measure from prior work, entities that discriminate relevant from non-relevant candidates appear in the agent's next query 4.02 times more often than entities found only in non-relevant documents (6.1% vs 1.5%, n = 227,139). A bridge document earns its keep by handing the agent a discriminative entity that redirects the search. Static relevance and causal usefulness are different quantities in agentic retrieval, and optimizing the first does not deliver the second.
Comments:
Preprint; extended version in preparation
Subjects:
Information Retrieval (cs.IR); Computation and Language (cs.CL)
Cite as:
arXiv:2607.15253 [cs.IR]
(or
arXiv:2607.15253v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2607.15253
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
3. 【2607.15114】CoSimRec: Measuring Coordinated-Content Penetration in Recommender Feedback Loops
链接：https://arxiv.org/abs/2607.15114
作者：Nan Li,Jiahong Shao,Jiuyang Lyu
类目：Information Retrieval (cs.IR); Social and Information Networks (cs.SI)
关键词：systems increasingly shape, Recommender systems increasingly, content reaches users, making it important, systems increasingly
备注： 9 pages, 4 figures, 4 tables
点击查看摘要
Abstract:Recommender systems increasingly shape which content reaches users, making it important to understand whether coordinated activity is amplified beyond the accounts that initiate it. Existing robustness evaluations largely focus on static target-rank changes and do not capture how coordinated interactions, recommendation, and user response evolve within a feedback loop. To address this gap, we propose CoSimRec, an offline agent-based evaluation framework that models coordinated accounts, dynamic ranking, non-bot responses, and ranking interventions in a shared closed-loop process. CoSimRec introduces the Algorithmic Penetration Rate (APR) metric family to measure target content's share of non-bot exposure and engagement, lift against matched no-attack baselines, and exposure gained per coordinated interaction. We evaluate CoSimRec on MIND, MovieLens, and LastFM using random, popularity-based, feedback-sensitive, MF, and BPR-MF recommenders, with ten-seed inference for the primary APR analysis and population-scale experiments of up to 1000 users. Random controls show no statistically supported positive penetration, whereas popularity-based and feedback-sensitive ranking produce significant positive APR-Lift in all six master-worker dataset--recommender settings, reaching 0.4505 on LastFM; synchronization-aware ranking reduces APR in every corresponding defense setting.
4. 【2607.15082】owards Hierarchical Structure Understanding of Newspaper Images
链接：https://arxiv.org/abs/2607.15082
作者：William Mocaër,Solène Tarride,Thomas Constum,Merveilles Agbeti-Messan,Tom Simon,Clément Chatelain,Stéphane Nicolas,Pierrick Tranouez,Sébastien Cretin,Thierry Paquet
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：challenging task due, nested hierarchical structures, Hierarchical Structure Understanding, structure understanding, newspaper images remains
备注： Accepted at ICDAR 2026 Workshop on Historical Document Imaging and Processing (HIP)
点击查看摘要
Abstract:Understanding newspaper images remains a challenging task due to their complex, nested hierarchical structures and dense, heterogeneous layouts. In this paper, we explore two complementary approaches for newspaper structure understanding. First, we present a modular bottom-up pipeline that combines state-of-the-art open-source models: YOLO for layout detection, LayoutReader for reading order prediction, and a custom algorithm for article segmentation. This approach leverages existing robust components while maintaining flexibility and interpretability. Second, we introduce Tiramisu (Tiered Transformers for Hierarchical Structure Understanding), a novel end-to-end transformer-based architecture that explicitly models document hierarchy through an iterative tiered process. Tiramisu performs section and article separation, block localization, semantic categorization, and reading order prediction using highly parallelized attention mechanisms. Finally, we release Finlam La Liberté, a new dataset designed specifically for evaluating hierarchical information retrieval in historical newspapers. Experimental results demonstrate the effectiveness of both approaches in reconstructing complex newspaper hierarchies, with comparative analysis highlighting their respective strengths for scalable document digitization. The Tiramisu training code, including the synthetic newspaper generator, is available at this https URL.
5. 【2607.14882】Does generative AI supersede supervised XMLC? A Benchmark Study on Automated Subject Indexing with German Scientific Literature
链接：https://arxiv.org/abs/2607.14882
作者：Maximilian Kähler,Katja Konermann,Lisa Kluge,Markus Schumacher
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：multi-label classification task, Extreme Multi-Label Classification, German National Library, multi-label classification, classification task
备注： Submitted to KONVENS 2026
点击查看摘要
Abstract:With a large controlled vocabulary as the label set, the task of automated subject indexing in a library can be understood as a multi-label classification task. If the set of subject terms is large, the problem fits the Extreme Multi-Label Classification (XMLC) objective. In this study, we apply a selection of specialised supervised XMLC methods to the test case of subject indexing contemporary German scientific literature, collected at the German National Library (DNB). We contrast these results by including a classical lexical matching baseline and three of our own recently developed LLM-based methods into the benchmark. Algorithms are evaluated and compared in several metrics. This includes binary relevance comparisons with previously indexed material, as well as graded relevance ratings by professional subject librarians. A challenge for all methods is to reliably make suggestions from the long tail of the subject vocabulary. We find that supervised XMLC algorithms relying on transformer-based dense features give best results in terms of overall binary relevance metrics. However, focusing on graded relevance and performance in the long tail of our subject vocabulary, the LLM-based generative methods give better results, making them a promising alternative for future productive use.
6. 【2607.14835】LLM-Based Re-Ranking for Real Estate Search
链接：https://arxiv.org/abs/2607.14835
作者：Nkateko Ntimane,Rafel Guedes,Tiago Cunha,Pedro Nogueira
类目：Information Retrieval (cs.IR)
关键词：QuintoAndar Group operates, Latin America, QuintoAndar Group, Group operates, marketplace in Latin
备注：
点击查看摘要
Abstract:QuintoAndar Group operates the leading housing marketplace in Latin America for both rentals and sales. The platform replaces traditionally paper-heavy workflows with a fully digital experience, making housing transactions faster and more accessible to tenants, buyers, and landlords in the region. Finding the ideal home in such a vast catalog is inherently difficult. At the same time, the widespread adoption of conversational assistants is reshaping user expectations: people increasingly want to express their needs through open, multi-turn dialog rather than rigid filter menus and faceted search. This shift is particularly pronounced in housing, where intent is multi-dimensional, context-dependent, and rarely reducible to a small set of structured constraints. To meet these expectations, we propose a Large Language Model (LLM) based re-ranker that augments a conversational recommendation system by reordering retrieved candidates according to the nuanced, context-rich intent expressed across the user's conversation. We additionally construct a large-scale offline evaluation dataset for conversational real-estate search, containing 960,000 query-item pairs constructed from both synthetic and production queries and annotated using an LLM-as-a-Judge framework with human validation. We validate our approach both offline, on this proprietary dataset, and online, through a production A/B test. Both evaluations show consistent improvements in ranking quality, including a statistically significant increase in production of +5.3% in click-through rate and +4.8% in scheduled visits, demonstrating the value of integrating conversational context into housing recommendations.
7. 【2607.14604】Accelerating A/B-Tests with Counterfactual Estimation: Reducing Variance through Policy Overlap
链接：https://arxiv.org/abs/2607.14604
作者：Olivier Jeunen
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR); Methodology (stat.ME)
关键词：Online controlled experiments, online platforms, Online controlled, controlled experiments, hypothesis testing
备注：
点击查看摘要
Abstract:Online controlled experiments are the gold standard for hypothesis testing in online platforms. Notwithstanding their ubiquity, they are notoriously expensive to run, and issues of variance hamper statistical power in assessing treatment effects. While standard variance reduction techniques leverage model-based control variates to reduce outcome noise, they remain agnostic to potential structural relationships between competing policies. In this work, we identify a critical inefficiency in the standard A/B-testing protocol: when a treatment and control policy agree on an action, the resulting outcome contributes noise but no signal regarding the treatment effect -- unnecessarily inflating confidence intervals. We propose a novel experimental protocol that exploits this policy overlap to accelerate experimentation. The key insight is to frame the randomised treatment assignment mechanism as a meta-policy, and leverage $\Delta$-Off-Policy Estimation methods to obtain unbiased estimates for average treatment effects. We prove analytically that our approach recovers standard A/B-testing practices in the general case, but that its variance scales with the divergence between policies rather than raw outcome variance. Hence, we dominate the standard Difference-in-Means estimator whenever policies have common support, and the improvement is strict whenever the overlap region contributes non-zero residual variance. Empirical results corroborate these theoretical insights -- holding promise for significant impact on the real-world evaluation of recommender systems, information retrieval pipelines, and large language model interfaces.
Subjects:
Machine Learning (cs.LG); Information Retrieval (cs.IR); Methodology (stat.ME)
Cite as:
arXiv:2607.14604 [cs.LG]
(or
arXiv:2607.14604v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.14604
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2607.14556】Impact of Expert-Following Strategies in Financial Asset Recommendation
链接：https://arxiv.org/abs/2607.14556
作者：Ryuki Unno,Koshi Watanabe,Keigo Sakurai,Keisuke Maeda,Takahiro Ogawa,Miki Haseyama
类目：Information Retrieval (cs.IR); Computational Engineering, Finance, and Science (cs.CE)
关键词：Financial institutions hold, institutions hold rich, maximize investment returns, ensure preference alignment, preference alignment remains
备注： 2pages, 1figure
点击查看摘要
Abstract:Financial institutions hold rich transaction histories, yet delivering recommendations that simultaneously maximize investment returns and ensure preference alignment remains a significant challenge. Existing approaches, namely return-based and preference-based strategies, each optimize a single objective, resulting in a fundamental trade-off between profitability (ROI) and relevance (nDCG). In this paper, we propose the Expert-Following Strategies: a framework that identifies top-performing investors based on their historical ROI and recommends the assets they purchased, scored by ROI-weighted purchase frequency. Our experiments using real-world transaction histories show that our strategy achieves statistically significant improvement over the market-average baseline in both ROI and nDCG simultaneously across all four thresholds.
9. 【2607.14494】SAGA: Schema-Aware Grounding for Agentic Text-to-SPARQL Generation
链接：https://arxiv.org/abs/2607.14494
作者：Yiming Zhang,Koji Tsuda
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：executable logical form, Complex knowledge base, base question answering, Complex knowledge, knowledge base question
备注：
点击查看摘要
Abstract:Complex knowledge base question answering (KBQA) is commonly approached through either information retrieval over a question-specific subgraph or semantic parsing into an executable logical form. We study the latter paradigm. Recent large language model agents make semantic parsing interactive: they alternate between reasoning, querying the knowledge base, and extending a partial SPARQL query. This interleaving reduces reliance on one-shot generation, but makes the quality of \emph{KB grounding} depend on what the interaction tools expose. Existing agents retrieve or prune candidate properties mainly through lexical relevance and instance-level observations, without systematically conditioning on entity types, property domains and ranges, or the expected answer type. We call this failure mode \emph{type-blind grounding}. It enlarges the grounding search space and often produces plausible-looking but semantically incompatible triple patterns that execute to empty results. We propose SAGA (\underline{S}chema-\underline{A}ware \underline{G}rounding for \underline{A}gentic Text-to-SPARQL Generation), a training-free framework that turns property exploration into a schema-constrained grounding operation. SAGA maintains a persistent bidirectional type state, filters known-incompatible property candidates at construction time, presents the remaining graph patterns in a compact schema-annotated format, and handles missing schema information permissively through empirical and trace-local evidence. Across nine benchmark settings over Wikidata and Freebase, SAGA achieves the highest F1 on all nine settings and the highest exact-match accuracy on eight, while reducing empty-result queries across all reported Wikidata settings.
10. 【2607.14400】DS@GT ARC at LongEval: Citation Integrity and Factual Grounding in Scientific QA
链接：https://arxiv.org/abs/2607.14400
作者：Brandon Michaels,Brendon Johnson
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：LongEval Task, ARC submission, RAG, paper describes, Retrieval-Augmented Generation
备注： 12 pages, 4 figures. Accepted to the CLEF 2026 LongEval Lab Working Notes
点击查看摘要
Abstract:This paper describes DS@GT ARC's submission to the CLEF 2026 LongEval Task 4 on Retrieval-Augmented Generation (RAG). In this submission, we examine a divergence between traditional natural language evaluation metrics and citation integrity as applied to RAG QA systems. We evaluate a corrective pipeline using Corrective RAG (CRAG) and CiteFix against baseline and frontier model benchmark RAG QA scores. While frontier models maximized answer relevance and fluency scores, our RAGAs LLM-as-judge diagnostics indicate that frontier models would correctly identify relevant documents without using their context in answer generation. Conversely, by filtering chunks pre-generation and enforcing strict entailment of generated claims to the cited material post-generation, our corrective pipeline marginally improved citation faithfulness and answer grounding. We propose that evaluation of trustworthy RAG QA requires metrics that reward strict answer grounding.
11. 【2607.14390】Why Git Is the Memory Solution for the Agentic Development Lifecycle
链接：https://arxiv.org/abs/2607.14390
作者：Frank Guo
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Coding agents, alternatives weighed, agents now produce, produce a growing, growing share
备注： 8 pages
点击查看摘要
Abstract:Coding agents now produce a growing share of a team's code, while the reasoning behind each change -- the alternatives weighed, the constraints discovered, the approaches rejected -- is trapped in assistant transcripts that vanish with the session. Memory for this setting, the agentic development lifecycle (ADLC), is usually posed as one retrieval problem and built as machinery: tiered stores, memory graphs, compiled wikis, model-judged admission. We argue memory should instead be git-bound -- built into the repository's version control, inheriting the guarantees the machinery struggles to construct: ground truth from commits, freshness from rebuild, verification from the merge, containment from review. On this ledger we solve two problems separately, then combine them. Seed supply is closed as an eight-corpus retrieval study under a pre-registered ship discipline: five imported ranking mechanisms rejected, two kept, and a best configuration of ~0.31 pooled MRR -- ~60x the raw-transcript grep floor, ~15x an honest parsed-turn floor. Answer assembly is where ranking stops helping: single-shot retrieval scores only 0.07-0.20 answer-sufficiency on real developer questions, and ungated episode injection measurably degrades good answers. A router dispatches breadth to a git-anchored structural map, pointed lookups to confidence-gated episodes, and rationale to decision synthesis, which reconstructs why-arcs no single session contains (0.83 sufficiency on a young ~50k-LOC production system). Routed, the system answers at 382-980 tokens per question -- three orders of magnitude below the recorded history. Because ground truth is mined from commit-session links rather than annotated, every result is replicable on any user's own history at zero labeling cost. The remaining constraint is capture. Code, benchmark, and paper source: this http URL.
12. 【2607.14331】Long-History User Transformers for Real-Time Ad Ranking
链接：https://arxiv.org/abs/2607.14331
作者：Viacheslav Ovchinnikov,Georgii Smirnov,Nikolai Savushkin,Veronika Ivanova,Maksim Kuzin
类目：Information Retrieval (cs.IR)
关键词：Long interaction histories, hard serving constraint, large sequence encoder, Long interaction, click-through rate
备注：
点击查看摘要
Abstract:Long interaction histories are among the most informative inputs for click-through rate (CTR) prediction, yet in online advertising they collide with a hard serving constraint: ads must be scored within a few hundred milliseconds to enter the auction, which rules out running a large sequence encoder at request time. We describe how a production advertising system resolves this conflict by decoupling history encoding from real-time inference. A high-capacity offline transformer asynchronously encodes the user's full cross-surface interaction history into a compact representation cached in a feature store, while a lightweight runtime model combines this cached representation with the user's most recent events and the request context at serving time. The offline encoder is pre-trained autoregressively on large-scale interaction logs with a dual objective - feedback prediction and next-item prediction - and the two-stage architecture is then fine-tuned for CTR prediction on the target advertising surface. Offline, the split design recovers 72-80% of the quality of a full-history runtime transformer that would be too expensive to deploy, and the cached representation is robust enough to staleness to permit inexpensive refresh policies. In production A/B experiments, the system improves the primary ranking metric by +2.77% in search advertising and +2.1% on the Yandex Advertising Network, with revenue gains of +2.26% and +0.43% respectively - without increasing serving latency.
13. 【2607.14234】ICAConfPubs: A Dataset and User Interface for ICA Conference Papers (2003-2018)
链接：https://arxiv.org/abs/2607.14234
作者：Hongtao Hao,Xinyue Chen,Jiye Sun,Yanling Zhao,Jing Zhang
类目：Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：International Communication Association, annual conference papers, Communication Association, International Communication, past ICA
备注： 21 pages; preprint
点击查看摘要
Abstract:This paper presents a comprehensive dataset of past ICA (The International Communication Association) annual conference papers from 2003 to 2018, encompassing 27,466 papers, 21,038 authors, and 4,935 sessions. We made the dataset publicly available in both CSV and JSON formats. Additionally, we developed an API to facilitate programmatic access, and an intuitive user interface to enable users to navigate and explore the data more easily. The web application, API documentation, downloadable data, and reproducible code to obtain and process the data are available at this https URL.
14. 【2607.14192】Long-term User Engagement Optimization through Model-agnostic Downstream Rewards Learning
链接：https://arxiv.org/abs/2607.14192
作者：Dingsu Wang,Filip Ryzner,Kelly He,Armando Ordorica,David Woo,Aditya Mantha,Liyao Lu,Usha Amrutha Nookala,Haoran Guo,Jiacong He,Olafur Gudmundsson,Matt Chun,Krystal Benitez,Dhruvil Deven Badani,Yijie Dylan Wang
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：short-term behavioral signals, recommender systems mature, past few years, optimization objectives, objectives have evolved
备注： Recsys 2026
点击查看摘要
Abstract:As recommender systems mature in the past few years, their optimization objectives have evolved from a primary focusing on short-term behavioral signals to a broader emphasis on long-term user engagement and retention. However, directly optimizing retention is difficult because return signals are sparse, delayed, and only partially attributable to earlier recommendations. Prior work has addressed this challenge with sequential modeling and reinforcement learning, but these approaches typically require task specific reward engineering, substantial computational overhead, and surface specific implementations that are difficult to generalize. In this paper, we present a unified, model-agnostic downstream reward framework for optimizing long-term user value in large-scale recommendation systems. First, we formulate the downstream reward learning problem and develop an offline screening framework to identify session level behaviors that are both observable early and predictive of future retention. We then propose several model-agnostic downstream rewards signals derived from observed user action patterns across multiple sources. We further discuss the engineering effort to productionize the proposed rewards derivations and challenges we faced when adding them to our ranking models. Online A/B experiments demonstrate consistent improvements in engagement and retention-related metrics, and the framework has been deployed across multiple Pinterest surfaces, including Homefeed, Related Pins, Search, and Notifications.
15. 【2607.14190】A Temporal Machine Learning-Based Time-to-Event Model for Predicting ALS Progression and Healthcare Utilization
链接：https://arxiv.org/abs/2607.14190
作者：Zongliang Yue,Qi Li,Terry Heiman-Patterson,Frank Bearoff,Zhaohui Qin,Huanmei Wu
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR); Machine Learning (stat.ML)
关键词：Amyotrophic lateral sclerosis, Amyotrophic lateral, ALS Functional Rating, clinically meaningful milestones, heterogeneous neurodegenerative disease
备注：
点击查看摘要
Abstract:Amyotrophic lateral sclerosis (ALS) is a progressive and heterogeneous neurodegenerative disease in which predicting clinically meaningful milestones, such as assistive device use, remains challenging. We developed a time-to-event, digital-twin-inspired framework that integrates longitudinal ALS Functional Rating Scale-Revised (ALSFRS-R) trajectories with survival modeling to support individualized prediction of functional decline and assistive device utilization. We constructed a harmonized longitudinal dataset by integrating diagnosis records, ALSFRS-R assessments, activities of daily living, and demographic information, followed by preprocessing to ensure data quality, temporal alignment, and cohort consistency. Correlation-based clustering identified coherent functional domains spanning bulbar, upper limb, axial, lower limb, and respiratory systems. Generalized additive mixed models characterized nonlinear, domain-specific functional decline across all domains. In addition, a temporal machine learning model was developed to predict longitudinal functional decline and capture stage-dependent disease progression. Cox proportional hazards modeling further identified lower limb function, particularly walking and stair climbing, as the strongest predictors of earlier wheelchair access. Building on these results, we implemented a digital twin-inspired temporal machine learning-based time-to-event (TTE) model that generates individualized survival curves and dynamically predicts wheelchair-free survival. This framework provides a scalable, interpretable, and clinically actionable approach for linking ALS progression with personalized decision support, with applications in proactive care planning, clinical trial stratification, and precision medicine.
16. 【2607.14161】Deep-learning Causal Retrieval Optimization for Efficient e-commerce Distribution in Pinterest
链接：https://arxiv.org/abs/2607.14161
作者：Junpeng Hou,XianXing Zhang,Sai Xiao,Derek Cheng,Darren Reger,Olafur Gudmundsson,Mehdi Ben Ayed,Zhiqing Rao,Huizhong Duan
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：people turn inspiration, discovering shoppable content, users browse ideas, browse ideas, steps toward realization
备注： Accepted at KDD '26: The 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining
点击查看摘要
Abstract:Pinterest is where people turn inspiration into action as users browse ideas, then take steps toward realization, often by discovering shoppable content. To support this journey, we must distribute commerce content when it helps, not when it distracts. We frame this as a causal decision of triggering shopping candidate generators in early retrieval and deploy a production system at Pinterest that learns personalized and contextualized triggering policies. A deep multi-task model jointly predicts outcomes and uplift of multiple events, trained with a doubly-robust pseudo-outcome alongside calibrated outcome losses for stable, single-robust uplift learning. A randomized data logging supplies counterfactual coverage, and the model is evaluated by both regular and reverse metrics for full assessment. A linear-time offline replay is designed to select thresholds and forecast policy impact with extremely high consistency with online results. For productionization, the model runs in parallel with remote retrieval calls without end-to-end latency regression. At web scale, we cut shopping triggers by up to 85% while holding key shopping sessions neutral, improving important total sessions (+0.26%) and Pin saves (+1.10%), with significant infrastructure savings. By unifying deep causal learning with reliable offline replay and demonstrating production-grade deployment, this work provides a generally practical recipe for early-retrieval optimizations in modern cascading recommenders beyond shopping, aligning exploration and cost with user intent at scale.
17. 【2607.14157】Certified Domain Consistency for Multi-Domain Retrieval: Label-Free Per-Domain Contamination Control with Conformal Risk Guarantees
链接：https://arxiv.org/abs/2607.14157
作者：Jayakumar Manoharan
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Systems and Control (eess.SY)
关键词：ranking metrics miss, Retrieval over corpora, conformal risk control, risk control bounds, under-covering the worst
备注： Submitted to ACM TOI
点击查看摘要
Abstract:Retrieval over corpora that mix several domains often returns relevant but wrong-domain evidence that ranking metrics miss and that conformal risk control bounds only marginally, under-covering the worst domains. This work introduces C3R, a drop-in control layer that, from an inferred domain posterior and no query-time label, certifies a per-domain contamination budget where feasible and otherwise abstains rather than silently violating; on the hardest domains it guarantees a reduction, not a tight bound. The core is a two-split scheme built on risk-controlling prediction sets, whose finite-sample transfer bound crosses from the inferred to the true domain with fully estimable slack, supports heterogeneous budgets, and inverts for deployment. Population validity rests on this bound and a controlled simulation; across a thousand resampled calibrations the certificate never violates (a stability result) while marginal control violates the most-contaminated domain in every draw, and soft demotion retains more recall than the strongest calibrated cascade at equal certified contamination. The method replicates across open testbeds including an independent one from public federal regulations, and an LLM-judged downstream probe indicates wrong-authority grounding rises with contamination and falls under control. The layer is frozen-stack and reranker-agnostic.
计算机视觉
1. 【2607.15278】Hierarchical Denoising For Multi-Step Visual Reasoning
链接：https://arxiv.org/abs/2607.15278
作者：Zezhong Qian,Xiaowei Chi,Chak-Wing Mak,Tianze Zhou,Ruibin Yuan,Yuhan Rui,Hengzhe Sun,Zhuoqun Wu,Yuming Li,Siyuan Qian,Sirui Han,Shanghang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision foundation models, lack human-like multi-step, evolving into vision, vision foundation, lack human-like
备注：
点击查看摘要
Abstract:Video models are evolving into vision foundation models, yet they still lack human-like multi-step reasoning. Streaming autoregressive diffusion models are efficient but limited in reasoning, while bidirectional diffusion enables global revision with high inference costs due to dense frame-level denoising. Both paradigms struggle to achieve logical consistency and low-latency streaming for complex reasoning tasks. We propose HDR (Hierarchical Denoising for Visual Reasoning), a unified framework that integrates hierarchical latents into causal video generation for multi-step reasoning. HDR organizes video latents into a tree-structured hierarchy, enabling coarse-to-fine reasoning before streaming output. Coarse denoising layers preserve uncertain hypotheses for global planning, while finer layers progressively refine them into concrete visual states. A sparse hierarchical attention pattern (SHAP) further reduces temporal attention costs. We introduce a level-stratified multi-step video reasoning benchmark with out-of-distribution cases, covering six tasks: maze navigation, Tower of Hanoi, one-line drawing, sliding puzzle, Sokoban, and water pouring. Compared with streaming autoregressive diffusion baselines, HDR improves success from 34.22 to 60.29 (76.2% relative gain) and increases average progress from 76.00 to 89.56, demonstrating more consistent reasoning trajectories. HDR maintains low-latency streaming at 0.70 seconds per latent, achieving 54.2 times faster inference than bidirectional diffusion. It also retains 82.9% of full-data performance with only 2% training data, compared with 52.0% for bidirectional diffusion. Real-world robot experiments further demonstrate HDR's potential for physical interaction and world modeling. Project demo: this https URL.
2. 【2607.15273】MeanFlowNFT: Bringing Forward-Process RL to Average-Velocity Generators
链接：https://arxiv.org/abs/2607.15273
作者：Yushi Huang,Xiangxin Zhou,Jun Zhang,Liefeng Bo,Tianyu Pang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：time intervals, MeanFlow, velocities, Abstract, average
备注： Project Page: [this https URL](https://harahan.github.io/meanflownft-project-page/) , GitHub: [this https URL](https://github.com/Harahan/MeanFlowNFT) , Hugging Face: [this https URL](https://huggingface.co/Harahan/MeanFlowNFT)
点击查看摘要
Abstract:MeanFlow generators achieve fast few-step sampling by predicting average velocities over time intervals, making them attractive for efficient generation. Reinforcement learning (RL) has become a powerful way to align diffusion and flow models with human preferences and task-specific objectives. In particular, DiffusionNFT offers an efficient forward-process RL framework that does not require reverse-process trajectories or likelihood estimation. However, applying such RL methods to MeanFlow remains underexplored. DiffusionNFT optimizes instantaneous velocities, whereas MeanFlow samples with average velocities. To bridge this gap, we introduce MeanFlowNFT. Inspired by the MeanFlow identity, which bridges average and instantaneous velocities, we construct an induced instantaneous-velocity predictor. We apply the DiffusionNFT objective to this predictor, making reward optimization well-defined for MeanFlow. Sampling remains based on the average velocity, preserving MeanFlow's fast few-step generation. We further prove that MeanFlowNFT inherits DiffusionNFT's strict policy-improvement guarantee. Experiments on image and video generation show that MeanFlowNFT consistently improves baselines. Moreover, it outperforms prior state-of-the-art RL-tuned few-step generators on most metrics ($6$ of $8$ on SD3.5-M), and can even surpass multi-step RL-tuned diffusion while using only a few sampling steps. For instance, on Wan 2.1, $4$-step MeanFlowNFT reaches a VBench score of $84.33$, surpassing $50$-step LongCat-Video RL ($82.57$).
3. 【2607.15271】Online Neural Space Time Memory for Dynamic Novel View Synthesis
链接：https://arxiv.org/abs/2607.15271
作者：Baback Elmieh,Lynn Tsai,Zeman Li,Srinivas Kaza,Tiancheng Sun,Gabor Csapo,Ali Behrouz,Yuan Deng,Stephen Lombardi,Steven M. Seitz,Xuan Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：reconstruct temporarily occluded, temporarily occluded regions, strict real-time constraints, streaming videos faces, multi-view streaming videos
备注： 15 pages. Preprint. Project page with demos and video results: [this https URL](https://nst-mem.github.io)
点击查看摘要
Abstract:Online novel view synthesis from multi-view streaming videos faces a fundamental trade-off: maintaining a persistent, long-horizon memory to reconstruct temporarily occluded regions while operating under strict real-time constraints. While Test-Time Training (TTT) offers a powerful memory mechanism, standard models mandate gradient-based memory updates at every frame to adapt to the changing motion in dynamic scenes. The computational cost of heavy memory updates precludes real-time application and can lead to instability over long contexts. Given that memory updates are more demanding than memory application and video content is largely redundant, we propose to decouple the frequencies of these two processes. Our approach performs periodic memory updates while applying the memory on a per-frame basis, using cross-view attention to manage deformations between the prior memory state and the current frame. To lock in the historical context, we introduce two critical mechanisms: an auxiliary Memory Loss that forces persistent internalization of the scene, and a Memory Caching strategy that regularizes active weights against catastrophic drift. Our method demonstrates real-time, state-of-the-art performance on scenes with dynamic human motion as well as minute-scale online memorization.
4. 【2607.15268】Motion-Conditioned Multi-View Fusion for Myocardial Infarction Localization from Echocardiography
链接：https://arxiv.org/abs/2607.15268
作者：Guang Yang,Wentian Xu,Siyu Wang,Betty Raman,Lei Li,Vicente Grau
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：mortality worldwide, Echo, Myocardial, motion, Echo foundation model
备注：
点击查看摘要
Abstract:Myocardial infarction (MI) remains a leading cause of mortality worldwide. Echocardiography (Echo) is a widely available modality for MI assessment, where regional wall motion abnormality is a key indicator. Prior learning based methods for myocardial motion analysis often use handcrafted descriptors or densely supervised estimation, but the need for extensive annotation limits applicability. Foundation models have recently improved vision-based Echo analysis; however, most methods operate on single views and segment-level localization remains unreliable under view-dependent ambiguity, especially in apical views. To address this, we propose MCF-Net, a novel motion-guided multi-view fusion framework that fuses myocardial motion cues with foundation model representations to localize infarction. Visual features are extracted using EchoPrime, a pretrained Echo foundation model shared across dual views. Cardiac motion is modeled with extremely sparse supervision: a single annotated template frame is transferred across videos to initialize point tracking, avoiding dense labels. Motion-derived segment-aware soft masks provide coarse spatial priors that selectively enhance features for challenging myocardial segments. A motion-conditioned fusion mechanism then integrates motion and vision across views, refining predictions without overriding strong appearance cues. On segment-level MI localization, MCF-Net achieves 72.4\% F1 and 84.9\% accuracy, outperforming state-of-the-art motion-only, vision-only, and fusion baselines.
5. 【2607.15265】SceneBind: Binding What and Where Across Vision, Audio and Language
链接：https://arxiv.org/abs/2607.15265
作者：Mingfei Chen,Zijun Cui,Ruoke Zhang,Hyeonggon Ryu,Eli Shlizerman
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD)
关键词：audio and language, understanding across vision, spatial, semantic, joint semantic
备注： Project website: [this https URL](https://scenebind.github.io/)
点击查看摘要
Abstract:We present SceneBind, an omni-modal representation of realistic scenes with joint semantic and 3D spatial understanding across vision, audio and language. Existing omni-modal encoders excel at instance-level semantics (i.e., what is present), but often lack explicit spatial structure (i.e., where it is). SceneBind addresses this gap by representing each scene as a semantic-spatial entity, combining a global semantic embedding with object-centric semantic-spatial slots. This representation explicitly captures object-level semantics, spatial attributes, and uncertainty. We further propose SceneBind Matching, a semantic-spatial matching scheme that integrates global scene similarity with object alignment, supporting cross-modal scene retrieval and object grounding. To train and evaluate SceneBind, we curate a novel real-world binaural audio-visual dataset with structured semantic and spatial annotations, and propose a training protocol for aligning semantic and spatial signals across modalities. SceneBind is compatible with large-scale pretrained semantic encoders, adds lightweight spatial modeling with only a few additional tokens. It achieves state-of-the-art scene and spatial retrieval while enabling strong zero-shot transfer to downstream tasks such as audio-visual localization.
6. 【2607.15255】HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning
链接：https://arxiv.org/abs/2607.15255
作者：Pengcheng Zhou,Xuanyu Liu,Yanchen Yin,Bobo Li,Shengqiong Wu,Mong-Li Lee,Wynne Hsu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：form spurious correlations, models remain susceptible, Recent advances, improved image geo-localization, overlook geographical cues
备注：
点击查看摘要
Abstract:Recent advances in Vision-Language Models (VLMs) have significantly improved image geo-localization, yet existing models remain susceptible to landmark bias, causing them to overlook geographical cues or form spurious correlations, ultimately resulting in inaccurate localization. To systematically investigate this issue, we first design two quantitative metrics, Bias Intensity (BI) and Bias Harmfulness (BH), to characterize the impact of landmarks exerted on model reasoning, and establish a comprehensive benchmark, LandmarkBias-3K. To mitigate landmark bias, we further propose an evidence-driven reasoning framework, HoloGeo, to improve the reliability of geo-localization. HoloGeo is supported by a high-quality dataset, BF-30k, annotated with structured multi-evidence bias-free reasoning chains. By incorporating multi-dimensional rewards, HoloGeo explicitly encourages balanced attention over diverse visual cues and achieves evidence-driven joint reasoning. Extensive experiments demonstrate that HoloGeo not only maintains excellent performance on IM2GPS3K and YFCC4k but also significantly outperforms existing open-source VLMs on LandmarkBias-3K, validating its effectiveness for robust geospatial reasoning.
7. 【2607.15246】ARMOR++: Agentic Orchestration of a Multi-Domain Primitive Set for Transferable Attacks on Deepfake Detectors
链接：https://arxiv.org/abs/2607.15246
作者：Christos Korgialas,Gabriel Lee Jun Rong,Dion Jia Xu Ho,Pai Chet Ng,Xiaoxiao Miao,Konstantinos N. Plataniotis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：architecture-dependent forensic cues, black-box adversarial transfer, detectors frequently degrades, rely on fragile, architecture-dependent forensic
备注：
点击查看摘要
Abstract:The reliability of deepfake detectors frequently degrades under black-box adversarial transfer, as these models often rely on fragile, architecture-dependent forensic cues. Existing transfer attacks often lack semantic awareness and struggle to maintain effectiveness under strict no-query constraints, particularly when perturbations are transferred from convolutional surrogates to transformer-based targets. To address these limitations, this paper introduces ARMOR++, a robust multi-agent framework designed for high-transferability deepfake evasion. The framework leverages the Qwen2.5-VL Vision-Language Model (VLM) to supply spatial semantic priors, while the Qwen3 Large Language Model (LLM) orchestrates primitive selection, adaptive hyperparameter reparameterization, and entropy-regularized perturbation mixing. By integrating five complementary primitives, spanning dense optimization, saliency-based methods, spatial transformations, frequency-domain perturbations, and block-structured modifications, ARMOR++ effectively targets heterogeneous inductive biases. Rigorous evaluation on the AADD-2025 benchmark demonstrates that ARMOR++ significantly outperforms existing agentic and non-agentic baselines across both low- and high-quality image regimes. Statistical analysis confirms a substantial gain in blind-target Attack Success Rate (ASR) over the state-of-the-art agentic baseline, with further performance advantages evidenced against non-agentic benchmarks and under robust defensive configurations. These findings highlight a significant residual reliability gap in current deepfake detector deployments and demonstrate the efficacy of agentic orchestration in identifying latent vulnerabilities.
8. 【2607.15241】Beyond the Leaderboard: Design Lessons for Trustworthy Multimodal VQA
链接：https://arxiv.org/abs/2607.15241
作者：Sushant Gautam,Vajira Thambawita,Michael A. Riegler,Pål Halvorsen,Steven A. Hicks
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：combine visual, visual and textual, textual evidence, remaining reliable, endoscopy case study
备注： Accepted for presentation at the 39th IEEE International Symposium on Computer-Based Medical Systems (IEEE CBMS 2026) as a regular paper
点击查看摘要
Abstract:Healthcare multimodal AI must combine visual and textual evidence while remaining reliable and interpretable. Using MediaEval Medico 2025 as a retrospective GI endoscopy case study, we analyze design choices across nine documented systems for question answering and explanation quality. Parameter-efficient adaptation of pretrained backbones provides strong challenge performance, but answer-level gains do not consistently translate into faithful and complete clinical reasoning. Methods enforcing structured reasoning and explicit grounding show more reliable behavior across heterogeneous question types, although the evidence is correlational rather than ablation-based. These results motivate evaluation beyond lexical overlap, standardized evidence-linked explanations, leakage-aware data governance, and lightweight robustness and calibration checks. The findings support trustworthy multimodal healthcare AI based on data fusion, explainability, and resilient evaluation.
9. 【2607.15231】CRISP: Constrained Refinement via Iterative Squeezing Process for Robust Medical Image Segmentation under Domain Shift
链接：https://arxiv.org/abs/2607.15231
作者：Yizhou Fang,Pujin Cheng,Yixiang Liu,Xiaoying Tang,Longxi Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：medical imaging remains, medical imaging, central bottleneck, clinical translation, Distribution shift
备注： X pages, 3 figures, 3 tables; submitted to AAAI 2027
点击查看摘要
Abstract:Distribution shift in medical imaging remains a central bottleneck for the clinical translation of medical AI. Failure to address it can lead to severe performance degradation in unseen environments and exacerbate health inequities. Existing methods for domain adaptation are inherently limited by exhausting predefined possibilities through simulated shifts or pseudo-supervision. Such strategies struggle in the open-ended and unpredictable real world, where distribution shifts are effectively infinite. To address this challenge, we adopt the "Rank Stability of Positive Regions" as a working assumption under distribution shift, and use it to derive robust spatial hints for source-only segmentation. Guided by this assumption, we propose CRISP, a model-agnostic framework that, unlike deployment-time adaptation, requires no test-time parameter updates and no target-domain data--a target-free, plug-in refinement framework that segments with frozen weights. Rather than using ranking to directly output masks, CRISP exploits the stability of probability rankings under distribution shift to derive robust spatial priors. Via latent feature perturbation, perturbation-invariant high-grade regions define a high-precision (HP) core, while voxels that remain potentially foreground under at least one perturbation define a high-recall (HR) support; these dual priors are then recursively refined under perturbation. We then design an iterative training framework that progressively squeezes HP and HR toward the final segmentation. Extensive evaluations on multi-center cardiac MRI and CT-based lung vessel segmentation demonstrate CRISP's superior robustness, significantly outperforming state-of-the-art methods with striking HD95 reductions of up to 0.14 (7.0% improvement), 1.90 (13.1% improvement), and 8.39 (38.9% improvement) pixels across multi-center, demographic, and modality shifts, respectively.
10. 【2607.15227】Divergent Gaze Patterns in Artistic Viewing: Spatial and Temporal Signatures of Attention Across Autistic Individuals, Artists, and Neurotypical Observers
链接：https://arxiv.org/abs/2607.15227
作者：Mohammed Amine Kerkouri,Daphné Senggaran,Renaud Jusiak,Océane Lehmann,Marouane Tliba,Claire Wardak,Emmanuelle Houy-Durand,Shasha Morel-Kohlmeyer,Aladine Chetouani,Nadia Aguillon-Hernandez
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：populations visually explore, visually explore artworks, explore artworks bears, accessibility design, populations visually
备注： Submitted for review
点击查看摘要
Abstract:How different populations visually explore artworks bears on cognitive science and on accessibility design, yet most eye-tracking work in autism has used social scenes rather than art, and has analysed where the eyes land while ignoring when and in what order. We present a comparative free-viewing study across three groups, autistic adults (ASD), trained artists, and neurotypical observers, who each viewed 30 paintings for 15s. We introduce a directed, metric-grounded framework that compares groups along two complementary axes: a spatial axis, in which one group's fixation-density map predicts another's fixations under six saliency metrics (AUC-Judd, NSS, CC, SIM, KL, Information Gain); and a temporal axis, in which individual scanpaths are compared with MultiMatch, ScanMatch, a foveal-disc IoU score (FDISS), and dynamic time warping (DTW). Fixations are extracted uniformly for all groups with a dispersion-threshold algorithm. Three results converge. (i)Artists and neurotypicals are almost indistinguishable in both space (density-map correlation CC=0.96) and time (they form the most alignable scanpath pair), whereas ASD gaze diverges from both. (ii)ASD attention is dissociated: it matches artists' wide spatial exploration (dispersion, explored area) but carries a distinct temporal signature, shorter fixations, less dwell, and the most idiosyncratic (least self-consistent) scanpaths of any group. (iii)ASD gaze is not selectively artist-like on any metric; if anything it is marginally closer to neurotypical. Together these findings indicate that autistic viewing of art is a distinct, group-specific attentional profile in both space and time, and they motivate population-conditioned models of aesthetic attention. We release all analysis code and per-stimulus results.
11. 【2607.15220】Structural-Semantic Reciprocal Learning for Unsupervised Visible-Infrared Person Re-Identification
链接：https://arxiv.org/abs/2607.15220
作者：Moyao Tian,Shijia Liu,Yan Yang,Xin Yuan,Minshi Chen,Wei Wang,Xiao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unsupervised visible-infrared person, visible-infrared person re-identification, large modality gap, Unsupervised visible-infrared, cross-modal identity annotations
备注： Accepted by PRCV 2026
点击查看摘要
Abstract:Unsupervised visible-infrared person re-identification (USVI-ReID) is challenging due to the large modality gap and the lack of cross-modal identity annotations. Progressive association paradigms have been proposed to gradually bridge the gap, but they suffer from two critical bottlenecks: reliance on ambiguous global representations and unchecked propagation of pseudo-label noise in an open-loop manner. To address these issues, we propose Structural-Semantic Reciprocal Learning (SSRL), a framework that transforms open-loop association into a self-correcting closed-loop system. Structurally, we introduce Fine-grained Structural Decoupling (FSD) to extract discriminative body-part primitives as reliable spatial anchors, complementing ambiguous holistic silhouettes with spatially consistent structural details. Semantically, we design a Closed-loop Semantic Calibration (CSC) mechanism that reconstructs shared semantic prototypes at each epoch and feeds them back into the training loop, effectively filtering pseudo-label noise before the next clustering cycle. Through the reciprocal interaction between structural and semantic learning, SSRL achieves robust cross-modal representation. Extensive experiments demonstrate the competitive performance of SSRL against state-of-the-art USVI-ReID methods on both SYSU-MM01 and RegDB, notably surpassing several supervised counterparts on RegDB.
12. 【2607.15216】Symbal: Detecting Systematic Misalignments in Model-Generated Captions
链接：https://arxiv.org/abs/2607.15216
作者：Maya Varma,Jean-Benoit Delbrouck,Sophie Ostmeier,Akshay Chaudhari,Curtis Langlotz
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multimodal large language, Multimodal large, systematic misalignments, resulting in misaligned, generating image captions
备注： ICML 2026
点击查看摘要
Abstract:Multimodal large language models (MLLMs) often introduce errors when generating image captions, resulting in misaligned image-text pairs. Our work focuses on a class of captioning errors that we refer to as systematic misalignments, where a recurring error in MLLM-generated captions is closely associated with the presence of a specific visual feature in the paired image. Given a vision-language dataset with MLLM-generated captions, our aim in this work is to detect such errors, a task we refer to as systematic misalignment detection. As our first key contribution, we present Symbal, which utilizes a structured, dual-stage setup with off-the-shelf foundation models to identify systematic misalignments and summarize results in natural language. As our second key contribution, we introduce SymbalBench, a benchmark designed to evaluate automated methods on our proposed task. SymbalBench consists of 1.7 million image-text pairs from two domains (natural and medical images), organized into 420 vision-language datasets with annotated systematic misalignments. Symbal exhibits strong performance on this benchmark, correctly identifying systematic misalignments in 63.8% of datasets, a nearly 4x improvement over the closest baseline. We supplement our evaluations on SymbalBench with real-world evaluations, showing that (1) Symbal can accurately surface systematic misalignments in captions generated by four MLLMs and (2) Symbal is a powerful tool for auditing off-the-shelf image-caption datasets. Ultimately, our novel task, method, and benchmark can aid users with auditing MLLM-generated captions and identifying critical errors, without requiring access to the underlying MLLM. Code is available at this https URL.
13. 【2607.15211】MAGiSt3R: Multi-Agent Feed-forward 3D Reconstruction from Monocular RGB Videos
链接：https://arxiv.org/abs/2607.15211
作者：Ziren Gong,Xiaohan Li,Fabio Tosi,Ninghui Xu,Stefano Mattoccia,Jianfei Cai,Matteo Poggi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：monocular RGB videos, framework performing reconstruction, reconstruction framework performing, RGB videos, process RGB videos
备注：
点击查看摘要
Abstract:This paper presents MAGiSt3R, a multi-agent 3D reconstruction framework performing reconstruction and camera tracking for monocular RGB videos at almost 10 FPS. MAGiSt3R relies on a feed-forward model from the 3R family to process RGB videos and regress local point maps, and on a merging model, MAGMA, that combines local maps at both intra-agent and inter-agent levels to obtain the final global point map. Furthermore, MAGiSt3R performs pose graph optimization to mitigate cumulative camera drift occurring along the feed-forward pipeline. We evaluate MAGiSt3R on both synthetic and real-world datasets, demonstrating its superior reconstruction and camera tracking accuracy compared to state-of-the-art approaches.
14. 【2607.15139】Ray-based phase error correction for miniaturized DOE projector-based FPP under single-directional hyperbolic projection
链接：https://arxiv.org/abs/2607.15139
作者：Seung-Jae Son,Yatong An,Jae-Sang Hyun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Fringe Projection Profilometry, limited pattern controllability, Projection Profilometry, severe phase artifacts, phase artifacts due
备注：
点击查看摘要
Abstract:Fringe Projection Profilometry (FPP) systems using miniaturized DOE pro-jectors often suffer from severe phase artifacts due to nonlinear projection characteristics and limited pattern controllability. We propose a ray-based phase error correction framework that models phase artifacts along projection rays from the projector pinhole, incorporating projector geometry without re-lying on image-domain processing or neighboring pixels. A projector pinhole estimation method based on a single-directional hyperbolic fringe pattern is introduced, through which projector geometry can be recovered without stereo calibration. In addition, a data-efficient strategy constructs the re-finement model from a single calibration pose. Experiments on miniaturized DOE projector-based FPP systems demonstrate significant improvements in reconstruction accuracy under nonlinear projection conditions, confirming the robustness and physical consistency of the proposed approach.
15. 【2607.15128】DAPGNet: Dynamic Adaptive Physics-Guided Graph Diffusion Network for Hyperspectral Image Classification
链接：https://arxiv.org/abs/2607.15128
作者：Pengkun Wang,Weijia Cao,Ning Wang,Xiaofei Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires reliable pixel-relation, reliable pixel-relation modeling, Hyperspectral image, classification requires reliable, mixed pixels
备注： 9 figures and 9 tables. Pengkun Wang and Weijia Cao contributed equally to this work
点击查看摘要
Abstract:Hyperspectral image (HSI) classification requires reliable pixel-relation modeling under spectral variability, mixed pixels, and heterogeneous boundaries. Existing graph-based HSI classifiers usually construct graph topology from spatial proximity, superpixel connectivity, or learned feature affinity. However, the spectral physical prior carried by contiguous bands has limited influence on topology estimation and message propagation. This paper presents DAPGNet, a dynamic adaptive physics-guided graph diffusion network that injects a structure-constrained physical prior into relation-level graph learning. DAPGNet first encodes contiguous spectral responses into node-wise multiscale physical-prior representations. A two-stage graph constructor then combines spectral-spatial affinity, physical-prior consistency, and spatial distance to form a physical-prior-aware sparse topology. During graph diffusion, learned edge weights are transformed into additive attention biases, while a physical gate performs node-wise and feature-wise interpolation between graph-aggregated features and projected physical-prior features. Cross-scale fusion integrates node states from different diffusion depths, and the network is optimized with main classification, auxiliary supervision, and second-order spectral smoothness regularization. Experiments on Indian Pines, WHU-Hi-LongKou, Houston2013, and Houston2018 show that DAPGNet achieves the best OA, AA, and Kappa among representative CNN-, Transformer-, Mamba-, and graph-based baselines. It improves AA over the strongest competing method by 3.64 to 7.31 percentage points across the four datasets. Ablation and sensitivity analyses further support the complementary effects of physical-prior extraction, prior-aware topology construction, physics-gated propagation, and spectral smoothness regularization.
16. 【2607.15097】QuReC: All-in-One Image Restoration with Query-Specific Guidance and Local-Global Response Calibration
链接：https://arxiv.org/abs/2607.15097
作者：Shen Zhou,Jinghui Zhang,Wenbo Huang,Xuwei Qian,Zhen Wu,Guangwen Peng,Zhiyuan Li,Ding Ding,Dian Shen,Fang Dong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover clean images, clean images degraded, multiple corruption types, single unified model, aims to recover
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:All-in-one image restoration aims to recover clean images degraded by multiple corruption types using a single unified model. Existing methods typically rely on image-level prompts or shared guidance to handle diverse degradations. However, such a paradigm becomes inadequate when degradations are spatially heterogeneous or even coexist in mixed forms within a single image. Yet spatially adaptive guidance alone is not sufficient, since accurate restoration also requires each spatial query to reliably aggregate complementary information from local neighborhoods and global contexts. To this end, we propose QuReC, a unified framework for all-in-one image restoration. QuReC consists of a Degradation-Guided Query Reconstruction Module (DQRM) and a Local-Global Response Calibration Module (LGRCM). Specifically, DQRM matches each spatial query against a degradation prototype space to reconstruct a query-specific degradation-aware representation, thereby providing fine-grained spatially adaptive restoration guidance. To further stabilize this query-wise matching process, we introduce a weakly supervised prototype matching learning strategy to improve optimization stability and degradation semantic consistency. Meanwhile, LGRCM performs local-global dual-branch aggregation and calibrates the aggregated responses with learnable priors, improving the reliability of feature aggregation and the coordination between local detail modeling and global context modeling. Extensive experiments demonstrate that QuReC achieves superior performance on multiple all-in-one image restoration benchmarks. The code is released at this https URL.
17. 【2607.15094】AlphaWiSE: Adaptive Weight Interpolation for Continual Multimodal Representation Learning
链接：https://arxiv.org/abs/2607.15094
作者：Sarthak Jain,Qiran Hu,Zhen Zhu,Yaoyao Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：cross-modal alignment acquired, sequentially arriving data, CLIP learn, shared embedding space, earlier phases
备注：
点击查看摘要
Abstract:Multimodal models such as CLIP learn a shared embedding space for cross-modal retrieval, but continual adaptation to sequentially arriving data can disrupt the cross-modal alignment acquired from earlier phases. Conventional continual-learning methods return a single checkpoint, which commits every retrieval direction to the same stability-plasticity trade-off. We propose AlphaWiSE, a post-hoc weight-space interpolation method that composes two frozen source checkpoints. For each aligned parameter tensor identified by its checkpoint key, AlphaWiSE fits one scalar interpolation coefficient shared by all tensor entries. The coefficients are fitted on a smaller exemplar memory and used to materialize one interpolated checkpoint. The deployed model has the same architecture and parameter count as either source checkpoint, which does not require additional inference time. Extensive experiments on audio-image-text retrieval show consistent improvements over strong continual-learning baselines across multiple retrieval directions and evaluation metrics.
18. 【2607.15084】Quantifying Training Membership Information in the Hyperspherical Embedding Geometry of Face Recognition Models
链接：https://arxiv.org/abs/2607.15084
作者：Ünsal Öztürk,Sébastien Marcel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Face recognition models, embedding vector, clustering embeddings, recognition models represent, unit hypersphere
备注： Accepted at IEEE/IAPR IJCB 2026
点击查看摘要
Abstract:Face recognition models represent each face as an embedding vector on the unit hypersphere by clustering embeddings of the same identity while pushing different identities apart through angular-margin losses. Because these losses act only on training identities, non-member identities may form clusters with different geometric properties. In this paper, we quantify the magnitude of this difference and what training-time factors control it. We compute four statistics based on cluster geometry across 180 face recognition models in a factorial design over IResNet backbone size, loss head, training duration, and the number of training identities, and evaluate each configuration on nine benchmarks. Our results indicate that the number of training identities has the largest effect on member/non-member separability, while backbone and loss head contribute far less, and that, on a same-domain held-out reference, the geometric membership signal decreases monotonically as more identities are added to training. We provide an analysis of cross-domain (pose, age, quality, ethnicity) non-member benchmarks and report that these inflate the apparent membership signal. Finally, we fuse all four statistics with a learned classifier to reveal additional membership information beyond the best individual statistic.
19. 【2607.15082】owards Hierarchical Structure Understanding of Newspaper Images
链接：https://arxiv.org/abs/2607.15082
作者：William Mocaër,Solène Tarride,Thomas Constum,Merveilles Agbeti-Messan,Tom Simon,Clément Chatelain,Stéphane Nicolas,Pierrick Tranouez,Sébastien Cretin,Thierry Paquet
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：challenging task due, nested hierarchical structures, Hierarchical Structure Understanding, structure understanding, newspaper images remains
备注： Accepted at ICDAR 2026 Workshop on Historical Document Imaging and Processing (HIP)
点击查看摘要
Abstract:Understanding newspaper images remains a challenging task due to their complex, nested hierarchical structures and dense, heterogeneous layouts. In this paper, we explore two complementary approaches for newspaper structure understanding. First, we present a modular bottom-up pipeline that combines state-of-the-art open-source models: YOLO for layout detection, LayoutReader for reading order prediction, and a custom algorithm for article segmentation. This approach leverages existing robust components while maintaining flexibility and interpretability. Second, we introduce Tiramisu (Tiered Transformers for Hierarchical Structure Understanding), a novel end-to-end transformer-based architecture that explicitly models document hierarchy through an iterative tiered process. Tiramisu performs section and article separation, block localization, semantic categorization, and reading order prediction using highly parallelized attention mechanisms. Finally, we release Finlam La Liberté, a new dataset designed specifically for evaluating hierarchical information retrieval in historical newspapers. Experimental results demonstrate the effectiveness of both approaches in reconstructing complex newspaper hierarchies, with comparative analysis highlighting their respective strengths for scalable document digitization. The Tiramisu training code, including the synthetic newspaper generator, is available at this https URL.
20. 【2607.15065】DriftWorld: Fast World Modeling through Drifting
链接：https://arxiv.org/abs/2607.15065
作者：Susie Lu,Haonan Chen,Weirui Ye,Yilun Du
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Predictive world models, Predictive world, plan by imagining, imagining the outcomes, hinges on generating
备注： Website at [this https URL](https://susie-lu.github.io/driftworld/)
点击查看摘要
Abstract:Predictive world models enable robots to plan by imagining the outcomes of their actions, but their value for control hinges on generating many rollouts quickly. This creates a bottleneck for diffusion-based world models: multistep sampling makes each rollout expensive, limiting large-scale action search at inference time. We introduce DriftWorld, an action-conditioned world model based on drifting generative models. Rather than denoising iteratively at inference, DriftWorld learns an action-conditioned drift during training, allowing it to generate future frames from the current observation and a candidate action sequence in a single forward pass at 30+ fps, which is 17x faster on average than diffusion based baselines. We evaluate DriftWorld on standard vision-based robotic manipulation benchmarks, including Bridge-V2, RT-1, Language Table, Push-T, and Robomimic. By producing rollouts that are both accurate and fast, DriftWorld achieves state-of-the-art decision-making performance with far less inference time than diffusion-based world model baselines. Beyond online control, DriftWorld can also serve as an offline simulator for ranking real-world robot policies, with rollout-based scores correlating with ground truth at up to 0.99. These results show that drifting models are a strong fit for robot world modeling, where fast, high-quality imagination directly supports planning and policy evaluation.
21. 【2607.15058】SUFLECA: Scaling Up Feature Learning for CAD-to-image Alignment
链接：https://arxiv.org/abs/2607.15058
作者：Saad Ejaz,Miguel Fernandez-Cortizas,Javier Civera,Holger Voos,Jose Luis Sanchez-Lopez
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：single RGB image, single RGB, RGB image, enabling applications, augmented reality
备注：
点击查看摘要
Abstract:CAD-to-image alignment aims to estimate an object's 9D pose (rotation, translation, and anisotropic scale) from a single RGB image, enabling applications in robotics and augmented reality. Recent zero-shot methods use visual foundation models to match image regions to CAD models, yet typically their correspondences are appearance-driven and degrade under occlusion or sim-to-real domain shift. To address these limitations, we introduce SUFLECA (Scaling Up Feature LEarning for CAD Alignment), a weakly-supervised framework for zero-shot CAD alignment with two key contributions. First, SUFLECA scales up geometry-grounded feature learning from pretrained visual representations through Normalized Object Coordinates (NOCs) supervision on 674K images spanning 12 real and synthetic datasets, learning compact geometry-aware features that generalize across domains. Second, we propose a geometrically consistent matching algorithm that establishes reliable one-to-one CAD-to-image correspondences. Together, these contributions enable accurate, sub-second alignment per object instance without iterative pose refinement. On ScanNet25k, SUFLECA achieves 33.4%/42.3% category/instance accuracy, outperforming, with a smaller computational footprint, the strongest zero-shot baseline by 10.3/12.2 percentage points and, for the first time on this benchmark, even surpassing fully supervised methods. Code is available at: this https URL
22. 【2607.15054】Beyond Single Expert: Harmonizing Diverse Visual Priors in MLLMs for Spatial Understanding
链接：https://arxiv.org/abs/2607.15054
作者：Xiao Lin,Xiaohu Huang,Kai Han
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, demonstrated substantial promise
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) have demonstrated substantial promise in spatial understanding. Existing works typically incorporate prior knowledge extracted from a pre-trained foundation model to further enhance the spatial awareness of MLLMs. In this paper, we first reveal that when integrating diverse foundation models into MLLMs, different models provide complementary spatial priors that benefit different tasks. Motivated by this, we propose $\textbf{ViPS}$, a novel multi-model prior framework designed to fully unleash the potential of incorporating multiple $\textbf{Vi}$sual $\textbf{P}$riors from diverse models into MLLMs for $\textbf{S}$patial understanding. Specifically, ViPS introduces an Efficient Prior Proxy to generate multiple foundational priors with minimal inference overhead, and a Dynamic Prior Fusion mechanism to achieve harmonious and context-aware prior fusion and injection from the prior proxies. Extensive experiments demonstrate that ViPS successfully harmonizes diverse visual priors, establishing new state-of-the-art performance across multiple complex spatial reasoning and 3D spatial understanding benchmarks. Project page: this https URL
23. 【2607.15048】RoGS: Adaptive Meshgrid Gaussian for Large-Scale Road Surface Mapping
链接：https://arxiv.org/abs/2607.15048
作者：Tianchen Deng,Zhiheng Feng,Wenhua Wu,Ziming Li,Siting Zhu,Hesheng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-definition map generation, supporting high-definition map, automatic road annotation, surface mapping plays, Road surface mapping
备注：
点击查看摘要
Abstract:Road surface mapping plays a crucial role in autonomous driving, supporting high-definition map generation, lane-level perception, and automatic road annotation. Recent mesh-based road surface reconstruction methods have shown promising results, but they still suffer from limited reconstruction quality and high optimization cost, especially in large-scale driving scenarios. To address these limitations, we propose ROADGS-T, a robust and efficient large-scale road surface mapping framework based on adaptive meshgrid Gaussian representation. Specifically, we model the road surface by placing 2D Gaussian surfels on a meshgrid, where each surfel explicitly stores color, semantic, and geometric information. Compared with conventional mesh-based representations and 3D Gaussian primitives, the proposed meshgrid Gaussian representation better matches the thin-surface property of roads while significantly reducing redundant primitives and overlap during optimization. To further improve representation efficiency and structural fidelity, we introduce a road-structure-aware adaptive meshgrid strategy, which allocates denser Gaussian surfels to geometrically or semantically complex regions, such as lane markings, road boundaries, and height discontinuities, while maintaining a compact representation in flat road areas. Moreover, instead of relying on a single nearest vehicle pose, we design a trajectory-consistency-guided pose-robust refinement strategy, which estimates local surface priors from multiple neighboring poses and adaptively weights pose-guided height regularization according to their geometric consistency.
24. 【2607.15047】Parameter-efficient Prompt Tuning of Vision Foundation Model With Adaptive Focal Loss for Interpretable MCI Screening
链接：https://arxiv.org/abs/2607.15047
作者：Javad Khoramdel,Farhad Hoseyni,Amirhossein Nikoofard
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：precedes Alzheimer disease, Mild Cognitive Impairment, frequently precedes Alzheimer, critical early stage, neuropsychological drawing tests
备注：
点击查看摘要
Abstract:Mild Cognitive Impairment is a critical early stage of cognitive decline that frequently precedes Alzheimer's disease, yet its automated detection from neuropsychological drawing tests remains fundamentally constrained by data scarcity, class imbalance, and diagnostic ambiguity near clinical boundaries. Existing methodologies attempt to bypass these constraints using computationally expensive, fully fine-tuned hybrid architectures that relegate spatial explainability to a post-hoc approximation rather than an intrinsic model property. We propose a parameter-efficient framework utilizing frozen DINOv2-Small model adapted via three modality-specific learnable prompt tokens while Operating with 1.19 million trainable parameters, each token serves as a query in a shared cross-attention layer over the source image patch tokens. Crucially, spatial explainability is achieved directly through these attention maps; as a structural consequence of the architecture. Then task-conditioned embeddings fused via an attention module to quantify modality-level importance per subject. To handle boundary ambiguity, a MoCA-adapted focal loss introduced that integrates continuous cognitive scores into the training target, loss modulation, and adaptive sample weighting, strictly generalizing standard soft-label approaches. Under stratified five-fold cross-validation, the proposed architecture yields an MCI-class F1 of 0.641 and an AUC of 0.795, outperforming the computationally heavier ResViT baseline by 0.110 in MCI-class F1.
25. 【2607.15041】Weakly-Supervised RGB-D Salient Object Detection via SAM-driven Pseudo Annotation and State Space Interaction-based Diffusion
链接：https://arxiv.org/abs/2607.15041
作者：Wenqi Si,Gongyang Li,Shixiang Shi,Weisi Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Weakly-supervised RGB-D Salient, Salient Object Detection, RGB-D Salient Object, Weakly-supervised RGB-D, RGB-D Salient
备注： 13 pages, 9 figures, accepted by IEEE TMM
点击查看摘要
Abstract:Weakly-supervised RGB-D Salient Object Detection (SOD) is explored to reduce the heavy burden of pixel-level annotations. But scribble annotations lack the structure and details of objects, resulting in inaccurate saliency maps. In this paper, we propose a novel scribble-supervised RGB-D SOD method, consisting of a Segment Anything Model (SAM)-driven pseudo annotation generation method (\emph{SAM-PAG}) and a state space interaction-based conditional diffusion model (\emph{$S^2$Diff}). Specifically, SAM-PAG is tailored to address the issue of sparse supervision information. In SAM-PAG, we adopt the advanced SAM to expand sparse scribbles to dense pixel-level pseudo annotations through the dual-branch structure and the consistency of segmentation masks. In $S^2$Diff, we adopt the diffusion model to iteratively refine the noisy saliency maps with the guidance of conditional information, generating accurate saliency maps. Naturally, the core of our $S^2$Diff lies in the acquisition of conditional features and the denoising of saliency maps. For the former, we employ a cross-modal conditional generation module to interweave cross-modal features through frequency integration and implicit-explicit state space interaction, effectively achieving global conditional features. For the latter, we employ a context injection module to mitigate noise interference and to enhance object information with the conditional context. With the close cooperation of SAM-PAG and $S^2$Diff, our method outperforms relevant scribble-supervised methods and achieves competitive performance compared to fully-supervised methods on seven datasets. The code and results of our method are available at this https URL.
26. 【2607.15038】Video = World + Event Stream
链接：https://arxiv.org/abs/2607.15038
作者：Lianghua Huang,Zhi-Fan Wu,Yupeng Shi,Wei Wang,Mengyang Feng,Cheng Yu,Chen Liang,Junjie He,Chen-Wei Xie,Yu Liu,Jingren Zhou,Ang Wang,Bang Zhang,Baole Ai,Chongyang Zhong,Jinwei Qi,Kai Zhu,Pandeng Li,Peng Zhang,Wenyuan Zhang,Xinhua Cheng,Yitong Huang,Yun Zheng,Yuxiang Bao,Yuzheng Wang,Zhiwei Lin,Zoubin Bi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：single organizing view, organizing view, event stream, reframes our native-streaming, single organizing
备注： website; [this https URL](https://wan-streamer.com/)
点击查看摘要
Abstract:We present Wan-Streamer v0.3, which reframes our native-streaming interaction model under a single organizing view: a video is a world plus an event stream. The world is the persistent context in which a video unfolds, including the environment, scene, subjects, ambient acoustic conditions, voice characteristics, and other relatively stable conditions. The event stream is everything that changes over time within that world, including scene or environmental changes, subject behavior, speech, and other sounds. This yields a general-purpose pretraining task over large amounts of real video: given a world and incoming input, predict how the world moves, changes, and responds in real time. The resulting competence can be specialized to a broad family of real-time downstream tasks. We instantiate it on real-time full-duplex audio-visual interaction, where the event stream is the agent's speech together with free-form behavior. Functionally, the model's multimodal understanding process is vision-language-action-like: it maps multimodal user input to language-form speech and behavior actions. Wan-Streamer v0.3 preserves the v0.2 operating point: 640x368 video at 25 FPS, a 160 ms streaming unit, approximately 200 ms model-side response latency, and approximately 550 ms total interaction latency under a 350 ms bidirectional network budget.
27. 【2607.14990】JADE-GS: Joint Alternating Deblurring Guided by Events in 3D Gaussian Splatting
链接：https://arxiv.org/abs/2607.14990
作者：Haoyu Fu,Jiafeng Huang,Yuchen Wang,Shengjie Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：camera moves fast, event cameras capture, camera moves, cameras capture, fast during exposure
备注：
点击查看摘要
Abstract:When a camera moves fast during exposure, blur destroys the intra-exposure motion a 3D model needs to recover the sharp scene, while event cameras capture exactly this signal at microsecond resolution. Turning them into reliable 3D supervision faces two obstacles. First, the two restoration priors fail in opposite ways: physics-based event-integration priors preserve edges but accumulate drift; learned networks recover texture but distort boundaries. Second, existing pipelines run in one direction only, so raw event noise or the biases of fixed 2D pseudo-labels pass uncorrected into the geometry. JADE-GS addresses both: a pixel-adaptive routing gate fuses the complementary priors, and the resulting 2D restorer is coupled to a 3D Gaussian Splatting student in a bidirectional loop, where detached, multi-view-consistent renders and a physics-based reblurring constraint regularize the restorer, turning a fixed preprocessor into a geometry-aware predictor. Across synthetic and real benchmarks, JADE-GS attains the best perceptual quality, leading LPIPS and CLIP-IQA on both benchmarks with competitive PSNR and SSIM, and trainsin about one hour under 5 GB on a single consumer GPU while preserving real-time rendering.
28. 【2607.14976】From Draft to Draft-Free: One-Step Video Object Removal via Privileged Distillation and Fast Planting
链接：https://arxiv.org/abs/2607.14976
作者：Zizhao Chen,Ping Wei,Guang Dai,Jingdong Wang,Mengmeng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fundamental yet challenging, challenging task, Video object removal, video editing, Video object
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Video object removal is a fundamental yet challenging task in video editing. Despite recent progress, existing methods typically fall into two categories. Traditional approaches based on optical flow or attention mechanisms often introduce noticeable artifacts and yield unnatural results. In contrast, diffusion-based methods improve visual realism but demand multiple denoising steps, limiting their practicality. To address these issues, we propose From-Draft-to-Draft-Free (D2DF), a framework that distills the ability of transforming coarse drafts into refined videos into a one-step video generation model. Within D2DF, a teacher model is trained to refine low-quality removal results ("drafts") into high-fidelity videos by multiple steps. Then, through Prior-Privileged Consistency Distillation (PPCD), we distill this capability into a student model that performs one-step removal conditioned on the draft. To eliminate draft dependency, we introduce a Self-Guided Fast Planting (SGFP) module based on our Temporal Masked Transformer that autonomously generates scene-consistent pseudo-drafts in latent space, enabling a fully draft-free one-step model. Extensive experiments show that both draft-conditioned and draft-free versions achieve state-of-the-art performance on multiple metrics, surpassing traditional and multi-step generative methods in both quality and efficiency. The denoising process for a single video takes only about 1 second.
29. 【2607.14974】On Success and Simplicity: A Second Look at Transferable Vision-Language Attack Pipeline
链接：https://arxiv.org/abs/2607.14974
作者：Yuchen Ren,Zhengyu Zhao,Chenhao Lin,Bo Yang,Chao Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)
关键词：Vision-Language Pre-training Models, Pre-training Models, Vision-Language Pre-training, vulnerable to adversarial, Models
备注： Accepted for publication in IEEE Transactions on Information Forensics and Security (TIFS)
点击查看摘要
Abstract:Vision-Language Pre-training Models (VLPMs) are known to be vulnerable to adversarial attacks. Recent transferable attacks on VLPMs have followed a common pipeline with complicated loss functions or multi-stage text/image attacks. However, in this paper, we demonstrate that such a sophisticated attack pipeline can be simpler yet more successful. Specifically, we identify three previously overlooked issues caused by inappropriate cross-modal interactions and excessive operations. To address them, we propose the Simple Vision-Language Attack (SimVLA) pipeline, which observably improves transferability and efficiency. Experiments on four datasets and three downstream tasks validate the superiority of our pipeline. For instance, on Flickr30k text-image retrieval dataset, our SimVLA outperforms the SOTA baseline in R@1 transferability by 8.01\%-14.71\%, while consuming only about 35.73\% of the time and 46.26\% of the max VRAM. Overall, the superiority of our SimVLA highlights the importance of leveraging domain knowledge (e.g., our proposed cross-modal word identification), while blindly pursuing intricate operations (e.g, complex loss functions and redundant multi-stage designs) may even be harmful. We hope our SimVLA can serve as a simple yet effective backbone for future extensions. Code is available at this https URL.
30. 【2607.14968】Stitch-Inferencer: Enhance Endoscopic Video Segmentation and Tracking via Panoramic Reconstruction
链接：https://arxiv.org/abs/2607.14968
作者：Shunsuke Kikuchi,Atsushi Kouno,Hiroki Matsuzaki
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Surgical video understanding, Surgical video, navigation systems, understanding is fundamental, fundamental to navigation
备注：
点击查看摘要
Abstract:Surgical video understanding is fundamental to navigation systems. Endoscopic perception is often hindered by a limited field-of-view and frequent instrument occlusions, making spatio-temporal context essential for robust inference. These challenges have motivated video models that aggregate information across frames. However, existing video models typically store past observations implicitly in learned feature representations, often requiring task-specific video training, substantial annotated data, and increased computational cost. We propose Stitch-Inferencer, a real-time, model-agnostic inference framework that replaces implicit feature memory with an explicit image-space panoramic canvas. By stitching valid observations across frames, Stitch-Inferencer preserves previously observed pixels in an online, instrument-free view, expanding the effective field-of-view and providing direct access to regions that are temporarily occluded or absent from the current frame. Downstream segmentation or tracking models are applied to a compact region of interest on the panorama, and their predictions are reprojected to the current frame, enabling existing models to exploit long-range context without retraining. Experiments on anatomy segmentation and point/box tracking demonstrate consistent improvements across diverse baselines while preserving real-time throughput. The stitching module alone runs at over 60 FPS, providing a practical inference-time solution to enhance endoscopic perception in computationally constrained intraoperative environments. Source code will be made publicly available.
31. 【2607.14966】U-shaped Multi-granularity Learning for Vision-Language Models
链接：https://arxiv.org/abs/2607.14966
作者：Biao Chen,Yunqian Yu,Xiangxu Zhao,Zhongshu Chen,Mengmeng Jing,Lin Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：ignore contextual associations, limiting cross-task generalization, fine-grained semantic awareness, prompts lack fine-grained, prompts ignore contextual
备注：
点击查看摘要
Abstract:The prompt learning paradigm for vision-language models is effective yet faces a granularity dilemma: global prompts lack fine-grained semantic awareness, while local prompts ignore contextual associations, limiting cross-task generalization. This dilemma exists in dense prediction tasks. Inspired by U-Net, which unifies multi-level representations across granularities, we propose UPrompt, a U-shaped multi-granularity prompt learning framework for vision-language models. Similar to how U-Net integrates fine and coarse features through symmetric encoder-decoder pathways with cross-level connections, UPrompt constructs parallel multi-granularity representations in both visual and textual modalities, where coarse-to-fine cascaded enhancement propagates global context to refine local details, while fine-to-coarse hierarchical supervision ensures semantic consistency across scales. Extensive experiments on 17 benchmarks validate our effectiveness. UPrompt outperforms MAMET and VPKE by 4.1 and 7.3 rSum on MSCOCO, surpasses CoCoA-Mix by 5.09% in base-to-novel generalization, while maintaining competitive performance with minimal overhead (coarse-grained) and matching PSRC with 1/3 cost (medium-grained).
32. 【2607.14962】Multi-Axis Max@K Reinforcement Learning for Representative Diversity in Text-to-Image Generation
链接：https://arxiv.org/abs/2607.14962
作者：Ku Onoda,Paavo Parmas,Hiroki Furuta,Soichiro Nishimori,Yuta Oshima,Shohei Taniguchi,Yutaka Matsuo
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：visually distinct modes, synthesize realistic, small subset, subset of visually, visually distinct
备注：
点击查看摘要
Abstract:Text-to-image (T2I) models can synthesize realistic, prompt-aligned images, yet samples generated for the same prompt often cover only a small subset of visually distinct modes. This limits the diversity of images, and for person-centric prompts, can reflect or amplify demographic skew. We formalize this problem as coverage of a predefined set of semantically specified modes, which we call target-mode coverage. We then propose multi-axis max@K, a group-based reinforcement learning objective for improving such coverage in diffusion-based T2I models. Given a group of samples and one score per target category, multi-axis max@K first takes the maximum score across samples for each category and then sums these category-wise maxima. The resulting credit assignment gives a sample positive weight on a category only when it increases that category's group-wise maximum, allowing different samples to contribute to different categories. We first validate the credit-assignment mechanism on a synthetic mixture and on SD3.5-M using deterministic pixel-based color rewards. We then evaluate the same objective on perceived-appearance fairness. Across three automatic evaluators on held-out prompts, multi-axis max@K improves the Fairness Score by 0.23-0.36 relative to the base model, while maintaining image quality and text alignment.
33. 【2607.14946】DINE: Distance Is Not Enough -- Learning Global Deformation Priors for Robust Soft-Tissue Point Cloud Registration
链接：https://arxiv.org/abs/2607.14946
作者：Sara Monji-Azad,Rohit Beer,Marvin Kinz,Claudia Scherl,Jürgen Hesser
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：correspondence estimation challenging, make correspondence estimation, Non-rigid point cloud, soft-tissue shape analysis, outliers make correspondence
备注：
点击查看摘要
Abstract:Non-rigid point cloud registration is central to soft-tissue shape analysis, but large deformations, noise, and outliers make correspondence estimation challenging. Most learning-based methods rely on local objectives such as Chamfer distance, which encourage point-wise proximity but do not constrain the global plausibility of the predicted deformation field. We address this limitation with DINE, a maximum a posteriori framework that augments distance-based registration with a learned statistical prior over displacement vector fields. DINE is applied to two registration backbones, Robust-DefReg and DefTransNet, using a two-stage strategy: a first-stage model is trained with Chamfer distance, its predicted deformation fields are used to estimate a prior, and the model is then refined with a combined distance and negative log-prior objective. We compare a full-field PCA Gaussian prior with a per-vector normalizing-flow prior. Experiments on DeformedTissue and SynBench show lower mean Chamfer distance under deformation and corruption. On DeformedTissue, DINE-PCA reduces Chamfer distance by approximately 27--69\% relative to the corresponding Stage-1 backbone across deformation levels, and improves robustness by up to 66\% for outliers and 83\% for Gaussian noise. On SynBench, improvements are modest at the smallest deformation levels and reach approximately 59--79\% from moderate to severe deformation. These results suggest that global deformation plausibility is an important constraint for reliable soft-tissue point cloud registration. (The code will be published soon.)
34. 【2607.14945】Introspective Attention Modulation for Safe Text-to-Image Generation
链接：https://arxiv.org/abs/2607.14945
作者：Basim Azam,Hossein Rahmani,Naveed Akhtar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：producing unsafe content, exhibit remarkable generative, remarkable generative abilities, generative abilities, abilities but remain
备注： Accepted at ECCV 2026. 20 pages, 7 figures. Project page: [this https URL](https://basim-azam.github.io/iam/)
点击查看摘要
Abstract:State-of-the-art flow based text-to-image (T2I) models exhibit remarkable generative abilities but remain vulnerable to producing unsafe content. Prior safety efforts range from concept erasure and prompt filtering to classifier-based gating. However, simple techniques like parameter efficient adaptations of the models easily bypass such guardrails. We introduce a unique principled approach that achieves safety by regulating the model's attention dynamics through inference-time introspection, exhibiting intrinsic robustness. Our method analyzes and rebalances attention activations throughout image synthesis, steering generations away from unsafe concepts while preserving semantic alignment. This introspective control ensures safety of deployed models. Across standard and adversarial safety benchmarks, our approach achieves remarkable safety scores while maintaining or even improving alignment and perceptual quality. Our results reveal that attention-space regulation offers a considerably more promising path to safer diffusion transformer based image generation than the existing concept erasing this http URL code can be accessed at this https URL
35. 【2607.14941】Frequency-Structured Field Learning for Light-Field Disparity Estimation
链接：https://arxiv.org/abs/2607.14941
作者：Sara Monji-Azad,Yulin Liu,Jürgen Hesser
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：abrupt depth transitions, requires global consistency, thin structures, occlusion boundaries, depth transitions
备注：
点击查看摘要
Abstract:Light-field disparity estimation requires global consistency in smooth or textureless regions and local precision near occlusion boundaries, thin structures, and abrupt depth transitions. Existing methods address these requirements through EPI matching, cost-volume or focal-stack construction, view aggregation, or direct convolutional regression, often relying on local windows, discrete disparity hypotheses, memory-intensive volumes, or attention-based aggregation. We instead formulate disparity estimation at the field level, predicting disparity from globally and locally updated EPI-derived latent features without explicitly constructing a disparity volume. We introduce FreqLF, an EPI-guided Fourier-local framework that encodes angular parallax cues from horizontal and vertical EPI stacks together with central-view appearance features. These cues are projected into a latent field and updated through stacked hybrid Fourier-local layers. Fourier low-mode updates enable global feature interaction, while local convolutions preserve spatial variations needed for fine disparity detail. A coordinate-conditioned Gaussian-mixture decoder then predicts disparity, using the mixture mean as the final estimate. Experiments on the HCI 4D Light Field Benchmark show that FreqLF approaches the accuracy of strong supervised baselines while avoiding explicit cost-volume construction in the base model. Ablations confirm the complementary roles of the Fourier and local branches, and scaling experiments demonstrate practical behavior across spatial resolutions. These results suggest that Fourier-local latent field learning is a competitive alternative for light-field disparity estimation. The code will be published soon.
36. 【2607.14935】VideoChat3: Fully Open Video MLLM for Efficient and Generalist Video Understanding
链接：https://arxiv.org/abs/2607.14935
作者：Xinhao Li,Yuhan Zhu,Xiangyu Zeng,Yuhao Dong,Haoning Wu,Zhiqiu Zhang,Yuandong Yang,Changlian Ma,Qingyu Zhang,Yansong Shi,Xinyu Chen,Haoran Chen,Zizheng Huang,Jun Zhang,Kun Ouyang,Lin Sui,Ziang Yan,Yicheng Xu,Chenting Wang,Yinan He,Hongjie Zhang,Yi Wang,Yu Qiao,Yali Wang,Ziwei Liu,Kai Chen,Limin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, spanned motion, driving this field, real-world applications, field toward real-world
备注：
点击查看摘要
Abstract:Recent advances in video understanding have spanned motion, long video, and streaming interaction, driving this field toward real-world applications. Despite this progress, current open-source models remain limited in several ways. They often struggle to generalize across diverse video types, making them effective only in specific domains. High computational demands further restrict their efficiency and scalability. Moreover, most models are only partially open, with key components such as training code, strategy, or datasets unavailable, which hinders reproducibility and slows community-driven development. To address these issues, we introduce VideoChat3, a fully open, efficient, and generalist video-centric MLLM. VideoChat3 advances video understanding through two complementary designs. For efficiency, we introduce Inflated 3D Vision Transformer (I3D-ViT) and Adaptive Frame Resolution for Streaming Video Perception, which enables efficient spatiotemporal representation and reduces the cost of processing video inputs during training and inference. For effectiveness, we develop a scalable video data synthesis pipeline that curates three diverse, high-quality training datasets: VideoChat3-Academic2M, VideoChat3-LV116K, and VideoChat3-OL617K, covering general, long-form, and streaming video scenarios, improving the model's generalization across domains. By integrating these designs, VideoChat3 achieves a rare balance of broad generalization and computational efficiency. Experiments across general, long-form, and streaming benchmarks demonstrate that VideoChat3 surpasses prior open-source models with equal or larger parameter counts with only 4B parameters and higher efficiency.
37. 【2607.14934】Still image and spatial-temporal tomato data enabling detection, segmentation, tracking, and video-instance segmentation using strong and weak labels
链接：https://arxiv.org/abs/2607.14934
作者：Michael Halstead,Esra Guclu,Mohamed Farag,Enrico Pallotta,Christian Hund,Ribana Roscher,Maren Bennewitz,Juergen Gall,Cyrill Stachniss,Chris McCool
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tomato plants grown, manuscript we release, visual sensing, grown in commercial-like, commercial-like settings
备注： 21 pages, 2 figures, 9 tables. Two novel datasets released - link to repository in document
点击查看摘要
Abstract:In this manuscript we release two datasets for visual sensing of tomato plants grown in commercial-like settings and acquired using a robot. The first is BUTom21 which consists of still images and manual annotations. The second is BUTom-ST21 which consists of video-based data and semi-automated annotations through AI-based methods, referred to as pseudo-labels. In both cases, we provide pixel-level labels for the ripeness of the fruit. The aim is to provide the research community a challenging set of real-world imagery to explore methods to sense and estimate the state of tomato plants and their fruit, which is an important horticultural crop. Importantly, the spatial-temporal dataset provides individual fruit count and ripeness information enabling researchers to push the boundaries of field-based phenotyping.
38. 【2607.14932】Benchmarking Face Recognition without Real Faces
链接：https://arxiv.org/abs/2607.14932
作者：Paweł Borsukiewicz,Daniele Lunghi,Wendkûuni C. Ouédraogo,Jacques Klein,Tegawendé F. Bissyandé
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：accuracy rivaling, real benchmarks, Synthetic, real, face recognition
备注： Accepted at IJCB 2026
点击查看摘要
Abstract:Synthetic face datasets have become effective enough to train face recognition models with accuracy rivaling that of models trained on real photographs. This progress sidesteps the ethical and legal burdens of collecting real biometric data, yet evaluation has not kept pace. Even studies that train entirely on synthetic images still rely on real-face benchmarks to measure performance, leaving the privacy problem only half solved. We ask whether synthetic datasets can replace real benchmarks for face recognition evaluation. We test 12 synthetic datasets against 7 established real benchmarks using 24 pre-trained models that span both convolutional and transformer architectures. Our evaluation covers biometric verification metrics, similarity score distributions, cross-model ranking consistency, and the underlying distributional properties of each dataset. Benchmarking fidelity varies widely across the synthetic candidates, but the two strongest, MorphFace and Vec2Face, reproduce the relative behavior of real benchmarks and reach agreement levels that fall within the natural disagreement already observed among the real benchmarks themselves. These results establish that well-constructed synthetic datasets can support reliable comparative evaluation for face recognition, moving the field closer to a fully synthetic and privacy-preserving pipeline for both training and benchmarking.
39. 【2607.14927】anGO: Training-Free 3D Editing via Tangent-Space Guidance and Optimization
链接：https://arxiv.org/abs/2607.14927
作者：Siwoo Lim,Sunjae Yoon,Gwanhyeong Koo,Hyeonseo Yun,Chang D. Yoo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：adopt structured representations, share global context, collapsed preserved regions, causing conventional training-free, tokens share global
备注： ECCV 2026
点击查看摘要
Abstract:While recent flow-matching 3D generative models (e.g., VecSet) adopt structured representations, their tokens share global context, causing conventional training-free editing to suffer from semantic artifacts such as collapsed preserved regions or incomplete transformations. To address this, we propose TanGO, a training-free framework that enables adaptive per-token steering in the tangent space of generative dynamics. To realize this selective control, we formulate a one-step optimal control rule and determine the strength of each token's control signal using a von Mises-Fisher inspired directional discrepancy derived from the source and target velocity fields. Experiments show that TanGO substantially reduces structural artifacts and achieves state-of-the-art performance, outperforming existing 3D editing baselines. The code is publicly available at this https URL.
40. 【2607.14898】FlashDecoder: Real-Time Latent-to-Pixel Streaming Decoder with Transformers
链接：https://arxiv.org/abs/2607.14898
作者：Minguk Kang,Suha Kwak
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Real-time video generation, diffusion models rely, Real-time video, generation demands fast, video generation demands
备注： CVPR2026
点击查看摘要
Abstract:Real-time video generation demands fast decoding as much as fast denoising, yet current latent video diffusion models rely on 3D convolutional decoders that are slow and memory-intensive at high resolutions or for long video. We introduce FlashDecoder, a fast, memory-efficient pure-Transformer video decoder that decodes latents to pixels frame by frame. At each step, the current frame attends only to a fixed-size window of past frames through a rolling KV cache. The fixed temporal window keeps decoding fast and memory bounded regardless of video length, enabling constant-latency streaming. Because frames are processed sequentially, temporal causality is enforced without explicit attention masks, enabling training at resolutions up to 1080p and matching the reconstruction quality of convolutional decoders. On the Wan2.1 and Wan2.2 latent spaces, FlashDecoder matches each convolutional decoder in reconstruction quality (e.g., 41.55dB vs. 41.49dB PSNR at 1080p) while decoding 3.6x-4.7x faster with up to 11x less memory on a single H100 GPU. With architecture-aware inference optimizations, the speedup widens to 12x.
41. 【2607.14897】Selectivity Drives Efficiency: Dataset Pruning for Visual Place Recognition
链接：https://arxiv.org/abs/2607.14897
作者：Tong Jin,Yunpeng Liu,Shuyu Hu,Chun Yuan,Song Wang,Feng Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent visual place, Recent visual, studies have increasingly, increasingly relied, relied on large-scale
备注： 14 pages,7 figures,15 tables
点击查看摘要
Abstract:Recent visual place recognition (VPR) studies have increasingly relied on large-scale datasets to train more robust and discriminative models. Although this trend significantly improves recognition performance, it also introduces substantial storage and training costs, especially when new architectures or training strategies need to be repeatedly developed and evaluated. Dataset pruning (DP) provides a promising way to improve data efficiency by retaining only informative training data. However, conventional DP methods mainly follow the sample-wise classification paradigm, which overlooks the relation-dependent training nature of VPR, where supervision is typically formed by image pairs rather than independent images. To address this issue, we propose a place-wise dataset pruning framework tailored for VPR. Instead of pruning individual images, our method treats each place as the basic pruning unit and introduces two complementary novel metrics, i.e., intra-place diversity (IPD) and inter-place similarity (IPS), to evaluate the training value of each place. By jointly considering these two metrics, our method ranks all places and constructs a compact yet informative coreset, thereby allowing the pruned dataset to still support the training of robust and discriminative VPR models. Extensive experiments demonstrate that our method consistently outperforms state-of-the-art DP baselines under different pruning ratios while reducing selection and training costs. Moreover, by pruning a merged dataset roughly 3.5$\times$ the size of GSV-Cities to a comparable scale, our coreset maintains highly competitive performance, achieving 94.5\% R@1 on MSLS-val and 97.0\% R@1 on Nordland with only NetVLAD. Codes will be made publicly available.
42. 【2607.14876】Rotational Motion-Induced Error Compensation for Phase-Shifting Profilometry-Based Eye Reconstruction
链接：https://arxiv.org/abs/2607.14876
作者：Seong-Jin An,Sanghoon Jeon,Yatong An,Jae-Sang Hyun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Augmented Reality, Virtual and Augmented, immersive Head-Mounted Displays, Head-Mounted Displays, increasingly important
备注：
点击查看摘要
Abstract:With the proliferation of immersive Head-Mounted Displays (HMDs) for Virtual and Augmented Reality (VR/AR), reliable and high-precision eye tracking has become increasingly important. Conventional 2D image-based methods offer low system complexity but remain limited in stability, accuracy, and robustness. Three-dimensional ocular surface reconstruction can provide richer geomet-ric information, and structured light profilometry is particularly attractive because it enables dense and accurate surface measurement. However, Phase-Shifting Profilometry (PSP), which estimates phase from sequentially acquired fringe images, is highly susceptible to motion-induced errors when the eye rotates between frames. This study proposes a rotational motion compensation framework for PSP-based dynamic 3D eye reconstruction. Relative eye rotation is estimated from image-based motion cues using a user-specific 3D eye model in a spherical-coordinate domain. The estimated motion is then used to compensate for camera-pixel mismatch and phase-shift errors caused by inter-frame rotation. A region-wise optimization strategy is further introduced to reduce residual artifacts by inde-pendently refining the compensation strength in different ocular regions. Experiments with a rotating fake eye under non-uniform motion demonstrate that the proposed method substantially suppresses motion-induced deformation and improves reconstruction accuracy. An additional experiment with a non-spherical rigid object indicates that the compensation principle is not restricted to spherical eye geometry. These results establish a practical basis for stable PSP-based dynamic 3D eye reconstruction toward future high-precision eye tracking in immersive environments.
43. 【2607.14836】Physics-Informed Diffusion for Biomechanically Plausible 3D Sign Language Generation
链接：https://arxiv.org/abs/2607.14836
作者：Emanuele Colonna,Moises Diaz,Gennaro Vessio,Miguel Angel Ferrer,Giovanna Castellano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generated skeleton respects, spoken language input, skeleton respects anatomical, respects anatomical constraints, generates continuous
备注：
点击查看摘要
Abstract:Sign language production, which generates continuous 3D skeletal motion from spoken language input, must simultaneously satisfy two constraints: semantic fidelity, so that a deaf viewer can recognize the intended sequence of glosses, and biomechanical plausibility, so that the generated skeleton respects anatomical constraints. Existing approaches optimize semantic reconstruction through coordinate-based objectives that treat the skeleton as an unstructured vector, thus allowing for bone length drift, joint angle violations, and temporarily locked fingers. We introduce PIDiffSign, a physics-informed diffusion model for gloss-to-pose translation that incorporates anatomical constraints into both the architecture and training objective. The model uses a Transformer encoder-decoder, where the decoder is conditioned on the diffusion time step through adaptive zero-initialized layer normalization and cross-attends to gloss representations. A differentiable geometry module enforces bone length consistency and biologically valid joint angles throughout generation. Training combines anthropomorphic, kinematic, angular, and finger-joint constraints with a contrastive gloss-pose alignment loss and classifier-free guidance for semantically conditioned sampling. Experiments on the PHOENIX14T and CSL-Daily benchmarks show consistent improvements over a strong diffusion baseline in pose accuracy, joint-angle correctness, distributional realism, and back-translation quality. These results demonstrate that physics-informed diffusion improves both motion realism and semantic fidelity for sign language generation.
44. 【2607.14821】Blurring Modal Boundaries: A Unified Survey from Single- to Multi-Modal Person Re-ldentification
链接：https://arxiv.org/abs/2607.14821
作者：Xiao Wang,Bing Wang,Bin Yang,Cuiqun Chen,Xin Xu,Mang Ye
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intelligent surveillance systems, disjoint camera networks, Person re-identification, surveillance systems, aiming to match
备注： 61 pages, 6 figures, journal
点击查看摘要
Abstract:Person re-identification (ReID) serves as a critical component in intelligent surveillance systems, aiming to match identities across disjoint camera networks. While traditional methods primarily rely on single-modal RGB imagery, they are often constrained by environmental challenges such as low illumination and occlusion. To overcome these limitations, the field is rapidly evolving toward cross-modal and multi-modal paradigms. This survey presents a comprehensive overview of this transition, systematically reviewing key cross-modal tasks including visible-infrared (VI-ReID), text-image (TI-ReID), sketch-based (Sketch-ReID), and the emerging Non-Line-of-Sight (NLOS) ReID, which extends perception beyond direct visibility. Furthermore, we examine tri-spectral and multi-modal fusion ReID, discussing how complementary information from diverse sensors enhances robustness. Beyond summarizing datasets, challenges, and methodologies, we propose a Transformer-based baseline framework for visible-infrared ReID, designed to effectively capture modality-invariant features. Finally, based on the current landscape, we outline several promising directions for future research.
45. 【2607.14809】An LLM-Based Automatic Sportscast Solution for Robot Soccer Matches
链接：https://arxiv.org/abs/2607.14809
作者：Francesco Petri,Michele Brienza,Daniele Nardi,Domenico Daniele Bloisi,Aldo Gangemi,Vincenzo Suriani
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：solve real-world problems, FIFA World Cup, World Cup champions, real-world problems, scenario to develop
备注： Poster presentation at RoboCup Symposium 2026
点击查看摘要
Abstract:RoboCup has always been a scenario to develop systems that solve real-world problems. Driven by the main goal of playing against the 2050 FIFA World Cup champions, the RoboCup Soccer leagues need to constantly measure how the research community is progressing. Computing visual statistics from match videos is a crucial way to track this evolution. To address this challenge, this paper introduces a fully autonomous, real-time sports commentator for RoboCup matches. By bridging the gap between raw kinematic tracking and natural language generation, our neuro-symbolic architecture extracts precise statistics from video streams and turns them into fluent, hallucination-free narration. The proposed system is capable of generating statistics and commentary both during live match streaming and in post-game analysis, easily adapting to the new dynamism of the league where different humanoid robots of different sizes share the field. Supplemental materials are available at this https URL
46. 【2607.14807】AMF-VTON: Texture-Aware Mask-Free Virtual Try-On via High-Fidelity Image Synthesis
链接：https://arxiv.org/abs/2607.14807
作者：Jie Wang,Qian He,Gaofeng He,Xiaogang Jin,Huamin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent diffusion-based virtual, diffusion-based virtual try-on, Recent diffusion-based, methods remain limited, virtual try-on
备注：
点击查看摘要
Abstract:Recent diffusion-based virtual try-on (VTON) methods remain limited by their reliance on segmentation masks, insufficient preservation of fine-grained textures, and limited support for arbitrary multi-garment compositions. Consequently, existing approaches still face significant challenges in real-world e-commerce deployment. We present TAMF-VTON, a texture-aware, mask-free framework that enables high-fidelity image synthesis under practical unconstrained conditions. Our method requires no human parsing or inpainting masks at inference time and supports diverse garment styles, categories, and quantities, enabling the simultaneous transfer of multiple items while preserving body structure and intricate texture details. This is achieved through a unified generative pipeline with three key components: (1) a lightweight Mixture-of-Experts (MoE) adaptation scheme that enables efficient fine-tuning without compromising the base model's general editing capabilities; (2) a frequency-domain supervision mechanism that explicitly optimizes high-frequency spectral consistency to preserve high-fidelity textures; and (3) a robust data curation pipeline employing an adaptive inpainting strategy to simulate the inverse VTON process for high-quality training pair generation. Extensive experiments demonstrate that our approach outperforms state-of-the-art methods in both quantitative metrics and perceptual quality. Optimized for efficiency, the model achieves inference in under 15 seconds per image on an NVIDIA RTX 4090 with INT4 quantization. By combining mask-free operation, flexible multi-garment composition, faithful texture preservation, and efficient inference on consumer hardware, TAMF-VTON demonstrates a commercially viable solution for scalable deployment in real-world digital fashion scenarios. The project is available at this https URL.
47. 【2607.14765】Rare Concept Generation via Counterfactual Inference in Diffusion Models
链接：https://arxiv.org/abs/2607.14765
作者：Zhengyuan Jiang,Haipeng Liu,Meng Wang,Yang Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Rare concept generation, synthesizing customized images, customized images conditioned, rare concepts, concept generation focuses
备注： Comments: 17 pages, 15 figures, to appear at ACM Multimedia 2026
点击查看摘要
Abstract:Rare concept generation focuses on synthesizing customized images conditioned on text prompts that describe objects with unusual attributes. Previous works failed to align the generated images with rare concepts, resulting in incorrect attribute rendering or inconsistent composition of concepts. Such failures, as we observed, stem from the inherent common knowledge bias in the training stage of diffusion models, where objects are strongly associated with their common attributes, making it difficult to break these associations when generating rare concepts. To address such challenges, in this paper, we propose a novel Counterfactual Inference-based Diffusion approach, dubbed CI-Diff. CI-Diff blocks the interference of the model's inherent common knowledge bias and utilizes the Natural Direct Effect to capture the independent influence of the text prompt of rare concepts on image generation so that decoupling the unusual attributes from the rare concepts. To this end, we reformulate the classifier-free guidance mechanism to highlight the atypical attributes. To the best of our knowledge, we are the first to introduce causal inference into the rare concept generation task. Extensive experiments on the RareBench benchmark validate the superiority of CI-Diff over state-of-the-art diffusion models. Our code can be accessed from this https URL.
48. 【2607.14760】Clean-Reference Streaming Detection of Lens Occlusion and Photometric Transitions for Camera Tamper Monitoring
链接：https://arxiv.org/abs/2607.14760
作者：Bo Ma,WeiQi Yan,Jinsong Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：silent physical degradation, physical degradation invalidates, surveillance camera, silent physical, physical degradation
备注：
点击查看摘要
Abstract:A surveillance camera is an image sensor whose silent physical degradation invalidates every downstream consumer of its data. In-situ integrity alarms for such vision sensors require low false-alarm rates, bounded computation, and diagnosable behavior under nuisance illumination changes. This paper studies a deliberately narrow streaming integrity monitor for two low-cost sensor-fault signatures: texture-collapsing lens occlusion and abrupt photometric scene transition. The detector compares sampled luminance and local-gradient statistics with a clean-only sliding reference, applies coarse-grid structured-light rejection and mode/rapid-brightness suppression, and emits at most one notification per tamper episode. We formalize the decision predicates and derive a consistency rule for when rapid-brightness suppression makes the scene-transition path unreachable. On 320 in-scope controlled sequences, the default state machine attains 0.800 F1 and 0.822 balanced accuracy (significantly better paired correctness than the strongest baseline, though the F1 margin is not statistically resolved); on a magnitude-swept public audit it attains the highest partial AUC under a 5\% false-alarm budget, and a separate extended-stress FPR-constrained sweep reaches 0.925 recall at 0.025 false-positive rate. Public Xiph, Bremen IoT, and UHCTD diagnostics show the fixed predicates preserve low false alarms while recall concentrates inside the declared envelope (UHCTD in-scope covered recall 0.667 versus 0.016 out of scope), and a 9.09-camera-hour verified-negative public audit records zero false alarms. The method is best interpreted as an auditable sensor-health subsystem rather than a universal camera-tamper classifier.
49. 【2607.14743】On the Disagreement in Perturbation-based xAI -- Benchmarking Perturbation Choices for Flood Detection from SAR Images
链接：https://arxiv.org/abs/2607.14743
作者：Anastasia Schlegel,Ronny Hänsch
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep learning models, analyze the behavior, deep learning, Perturbation-based xAI methods, resulting relevance maps
备注：
点击查看摘要
Abstract:Perturbation-based xAI methods are widely used to analyze the behavior and predictions of deep learning models. By altering input regions and measuring the resulting changes in class probabilities with respect to the original image, they assign relevance scores and generate heatmaps that reflect each region's contribution to the prediction. Despite their apparent simplicity, however, perturbation-based methods are sensitive to parameter choices. In this work, we focus on two key parameters of the perturbation pipeline, namely the patch geometry, including the size and shape of the perturbed regions, and the perturbation type, defined by the replacement scheme. Grounded in the use case of flood detection from Synthetic Aperture Radar imagery, we conduct a comprehensive investigation of how relevance estimation changes under different perturbation settings. Beyond visual inspection of the resulting relevance maps, we evaluate their consistency across perturbation strategies and their faithfulness to the model's reasoning. We demonstrate how different perturbation choices can steer the resulting relevance maps, yielding ambiguous and even contradictory explanations. Our findings emphasize the importance of methodological settings in perturbation-based xAI. They underscore the need to carefully inspect and evaluate perturbation choices and to treat them as an integral part when interpreting explanations, ensuring a robust understanding of both the explanations and model predictions.
50. 【2607.14739】FoMoVLA: Bridging Visual Foresight and Motion Guidance for Vision-Language-Action Models
链接：https://arxiv.org/abs/2607.14739
作者：Wei Li,Peijin Jia,Yuan Ma,Xuefeng Jiang,Titong Jiang,Sheng Sun,Yujian Li,Xin Wen,Han Hong,Zhikang Liu,Bailin Li,Kun Zhan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：mapping current observations, remain fundamentally reactive, achieved impressive results, fundamentally reactive, mapping current
备注： 12 pages, 7 figures, 8 tables. Project page: [this https URL](https://liauto-research.github.io/FoMoVLA)
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have achieved impressive results in visuomotor policy learning, yet remain fundamentally reactive, mapping current observations and language to actions without explicit forward prediction of world dynamics. Existing visual foresight methods predict future visual states but lack explicit motion guidance: they show where to go but not how to get there. We argue that future feature prediction and sparse point tracking are naturally complementary: the former provides the goal state, while the latter captures the continuous motion path toward it. We propose FoMoVLA, a framework that augments VLA representations with explicit spatio-temporal supervision by jointly learning future feature foresight and sparse 2D point tracking, enhancing the continuous action policy. FoMoVLA introduces compact foresight tokens to decode future feature states, decodes sparse temporal 2D point trajectories to model compact geometric motion, and couples both through a lightweight future-conditioned cross-attention module that enables consistent reasoning between anticipated states and point dynamics. Extensive experiments on LIBERO, RoboCasa GR-1 Tabletop, and LIBERO-Plus demonstrate state-of-the-art performance and strong zero-shot generalization. Project page is available at this https URL.
51. 【2607.14737】GeoDetect: Geometric Adversarial Detection for VLPs
链接：https://arxiv.org/abs/2607.14737
作者：Afsaneh Hasanebrahimi,Hanxun Huang,Christopher Leckie,James Bailey,Sarah Erfani
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Vision-language pre-trained models, Vision-language pre-trained, real-world applications, Vision-language, adversarial
备注： ECCV 2026
点击查看摘要
Abstract:Vision-language pre-trained models (VLPs) are widely used in real-world applications. However, they remain vulnerable to adversarial attacks. Although adversarial detection methods have demonstrated success in single-modality settings (either vision or language), their effectiveness and reliability in multimodal models such as VLPs remain largely unexplored. In this work, we study the geometry of VLP embedding spaces and observe structured anisotropy that differs from unimodal vision models. Our theoretical analysis shows that under this anisotropic structure, adversarial attacks increase the expected geometric separation between clean and adversarial examples (AEs). Specifically, we demonstrate that AEs consistently exhibit greater expected distances to randomly sampled points than their clean counterparts, indicating that AEs tend to push representations out of manifold regions. Building on these insights, we propose GeoDetect, which leverages these off-manifold deviations via geometric scores to identify AEs. Through comprehensive evaluations, we show that our approach reliably detects AEs across diverse VLP architectures and threat settings, covering unimodal and multimodal attacks as well as adaptive attacks, thereby providing a robust and practical approach to improving the safety and reliability of these models.
52. 【2607.14728】VQ-Touch: A Data-Efficient Tactile Generation Framework Across Sensors and Scenarios
链接：https://arxiv.org/abs/2607.14728
作者：Kailin Lyu,Long Xiao,Jianing Zeng,Di Wu,Lin Shu,Jie Hao
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：human-machine interaction systems, synthesizing high-fidelity tactile, tactile information acquisition, generation significantly reduces, high-fidelity tactile data
备注： 6 pages, 5 figures
点击查看摘要
Abstract:Tactile image generation significantly reduces the dependency on expensive and wear-prone sensors by synthesizing high-fidelity tactile data, offering an efficient solution for tactile information acquisition in robotic perception and human-machine interaction systems. However, existing methods depend on large-scale, diverse datasets from specific sensors and lack efficient data utilization and robust generalization capabilities, struggling in vision-limited environments. To address this, we introduce VQ-Touch, a tactile generation framework that supports both cross-sensor and multi-scenario applications. Specifically, to efficiently extract complex deformation and texture features from the data, we propose DM-VQGAN, an effective tactile representation learner. Furthermore, we introduce a discrete diffusion decoder with a unified conditioning interface, supporting multimodal generation tasks such as images and labels, and enhances the model's generalization capability through few-shot mixed training, thus achieving compatibility with current mainstream sensors and their variants. Experiments show that VQ-Touch surpasses state-of-the-art methods in multiple tasks.
53. 【2607.14727】WorkDrive: Roadwork Chain of Causation for Autonomous Driving
链接：https://arxiv.org/abs/2607.14727
作者：Tianyi Jiang,Wen Zhang,Sihan Yang,Ming Lu,Wentao Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous driving vision-language, driving vision-language models, familiar visual cues, Autonomous driving, vision-language models
备注：
点击查看摘要
Abstract:Autonomous driving vision-language models (VLMs) struggle in roadwork zones, where familiar visual cues such as lane markings and permanent signs are altered or absent, and temporary devices such as cones and barriers redefine the drivable corridor. VLMs can detect these objects, but without explicit guidance they anchor their reasoning on familiar elements from pre-training and fail to connect work-zone observations to correct planning decisions. We propose WorkDrive, a framework that constructs perception-grounded causal reasoning for work zones and aligns it with trajectory prediction. An automated multitask perception pipeline extracts structured scene facts and injects them into a Chain-of-Causation (CoC) annotation pipeline, redirecting the annotator's attention to domain-specific elements. The resulting reasoning labels are used for supervised fine-tuning, followed by reinforcement learning with a single reward: consistency between lateral meta-actions and the predicted trajectory. On ROADWork, the largest public work-zone dataset, the proposed roadwork CoC reduces trajectory average displacement error (ADE) by 9.0\%, and consistency-based GRPO yields a further 3.0\%, achieving progressive improvement over the trajectory-only baseline. Code and data will be publicly released.
54. 【2607.14726】AE-UAV: An Air-to-Air Event-Based UAV Tracking Benchmark and a Real-Time Frequency-Domain Tracker
链接：https://arxiv.org/abs/2607.14726
作者：Zixin Jiang,Bing He,Chaoran Xiong,Zhenzhen Wang,Xin Zhao,Ling Pei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unmanned aerial vehicle, low-altitude aerial targets, event-based UAV tracking, unmanned aerial, aerial vehicle
备注： 12 pages, 7 figures. Submitted to IEEE Transactions on Geoscience and Remote Sensing
点击查看摘要
Abstract:Air-to-air (A2A) unmanned aerial vehicle (UAV) tracking is fundamental to airborne remote sensing of low-altitude aerial targets. However, the deployment of continuous, real-time tracking systems on UAVs presents significant challenges. In A2A scenarios, traditional frame-based cameras suffer from severe performance degradation under low illumination, overexposure, and high-speed motion owing to their limited dynamic range and fixed temporal sampling. Although event cameras offer a promising alternative with microsecond temporal resolution and a high dynamic range, current research is bottlenecked by two primary issues: 1) the absence of dedicated A2A event-based datasets, and 2) the heavy reliance of existing trackers on GPU acceleration and extensive training data, rendering them impractical for resource-constrained UAVs. To bridge these gaps, we introduce AE-UAV, an air-to-air event-based UAV tracking benchmark. To the best of our knowledge, this is the first airborne-captured event camera dataset for A2A tracking, comprising 178 flight sequences with continuous-time cubic B-spline annotations. Furthermore, we propose the Fast-Slow Frequency-domain Tracking (FSFT) method. This lightweight, training-free framework seamlessly integrates frequency-domain template matching with search region prediction and detection-based drift correction. Extensive experiments demonstrate that FSFT operates at an ultra-fast 420 frames per second (FPS) on CPU-only hardware. It retains 93.97% of the accuracy of state-of-the-art GPU-dependent methods while delivering a 5.32-fold effective speedup and exhibiting superior temporal resolution generalization, thereby providing a highly efficient and robust solution for airborne remote sensing of aerial targets. The dataset and source code are available at this https URL.
55. 【2607.14721】Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality
链接：https://arxiv.org/abs/2607.14721
作者：Kunal Pratap Singh,Ali Garjani,Rishubh Singh,Muhammad Uzair Khattak,Efe Tarhan,Jason Toskov,Andrei Atanov,Oğuzhan Fatih Kar,Amir Zamir
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：test environment, Cross-modal learning, fundamental mechanism, mechanism for self-supervision, environment
备注： Project page: [this https URL](https://tst-vision.epfl.ch/)
点击查看摘要
Abstract:Cross-modal learning, i.e., learning to predict one modality from another, is a fundamental mechanism for self-supervision via leveraging multimodality. Many practical applications, e.g., deploying a household robot, involve devices that are equipped with a rich set of sensors that enable multimodal sensing in their test environment. This presents an opportunity to apply cross-modal learning to the multimodal data sensed by these devices to learn representations. Findings in developmental psychology also suggest that biological agents leverage it to build an effective representation of their surroundings. To study this, we propose a controlled setup, where we restrict a user device to just a given test environment. It results in a specialization setup where we attempt to develop a performant model for this specific test environment. Under this setup, we develop Test-Space Training (TST), which performs multimodal data collection in the test environment and performs self-supervised pre-training on it. We evaluate these models on various downstream tasks in the same environment. Under this setup, we find various interesting insights, such as collecting rich multimodal data only from the test environment and leveraging cross-modal learning, we can achieve competitive results with generalist models (e.g., DINOv2 and CLIP) pre-trained on large-scale internet datasets. This enables an alternative scenario where the need for external Internet-scale datasets for pre-training models is reduced. We also present a set of analyses and ablations that raise intriguing points on substituting data with (multi)modality, and how varying pre-training data enables a tradeoff between a model's abilities to specialise to a test environment, and generalize to held-out spaces.
Comments:
Project page: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2607.14721 [cs.CV]
(or
arXiv:2607.14721v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.14721
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
56. 【2607.14720】Causal-Adversarial Probing of Clinical Covariates for Prostate MRI Grading
链接：https://arxiv.org/abs/2607.14720
作者：Yipei Wang,Shiqi Huang,Wen Yan,Weixi Yi,Dean C. Barratt,Mark Emberton,Daniel C. Alexander,Veeru Kasivisvanathan,Yipeng Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MRI-based International Society, ISUP Grade Group, ISUP grade, International Society, Society of Urological
备注：
点击查看摘要
Abstract:Deep learning models for prostate MRI-based cancer grading may encode clinical covariates that either reflect useful disease-related signal or non-generalising shortcut information, but their role is usually assumed. We propose a causal-reasoning framework for probing covariate dependence in MRI-based International Society of Urological Pathology (ISUP) Grade Group prediction. Rather than treating mpMRI as a direct cause of grade, we model MRI appearance and ISUP grade as observations of latent tumour pathology, and test whether candidate clinical variables act as nuisance correlates, disease-related proxies, or irrelevant covariates in the learned representation. We implement this using an adversarial framework that suppresses the decodability of individual clinical covariate at a time while preserving MRI-based grade prediction. The approach is developed and evaluated on 2,903 prostate MRI examinations, with external validation on 576 patients. We report a set of interesting and previously under-explored imaging-to-clinical-variable interactions in the context of deep learning generalisation. For examples, in binary ISUP Grade Group $\geq2$ classification, suppressing age, BMI, and alcohol use improved AUC by 1.23%, 0.84%, and 1.42%, respectively (all p 0.05), suggesting reduced non-generalising covariate information; In contrast, suppressing PSA and prostate volume degraded AUC by 1.91% and 7.61% (all p 0.001), indicating that these variables carried task-relevant signal. These findings show that adversarial covariate suppression can provide a practical representation-level analysis for distinguishing potentially harmful dependence from informative signal in prostate MRI grading models.
57. 【2607.14711】VideoSEMA: a scalable and efficient Mamba-like attention for video understanding
链接：https://arxiv.org/abs/2607.14711
作者：Nhat Thanh Tran,Fanghui Xue andShuai Zhang,Jiancheng Lyu,Yunling Zheng,Yingyong Qi,Jack Xin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：efficient Mamba-like attention, split space-time attention, SEMA attention applies, efficient Mamba-like, block in space
备注： 15 pages, 3 figures
点击查看摘要
Abstract:We present for video understanding (classification) a split space-time attention model, VideoSEMA, consisting of a scalable and efficient Mamba-like attention (SEMA) block in space and a softmax temporal attention in time. In each frame, SEMA attention applies a local window attention in parallel with a global averaging in a Mamba macro-architecture, which is called Mamba-like. Under certain rank conditions, we prove that the computationally cheaper split space-time attention is equivalent to full space-time attention. On benchmark K400 data sets, VideoSEMA out-performs heavier vision transformer and Mamba models. On benchmark SSv2 data, VideoSEMA leads in top-1 accuracy among models of similar parameter sizes. As image resolution scales up from standard $224^2$ to $1024^2$ on K400 and without fine-tuning, VideoSEMA degrades much more gracefully than VideoMamba in accuracy. It is promising to extend VideoSEMA to longer videos with a dilated/sparse temporal attention.
58. 【2607.14710】Variational Inference for Bird's Eye View Segmentation in Autonomous Driving
链接：https://arxiv.org/abs/2607.14710
作者：Jingyue Shi,Huaicheng Li,Junhui Zhao,Yanxiang Jiang
类目：Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)
关键词：unified spatial representation, BEV, bird eye view, autonomous driving, BEV segmentation
备注： 13 pages, 9 figures
点击查看摘要
Abstract:The bird's eye view (BEV) has emerged as a pivotal approach for environmental perception in autonomous driving, providing a unified spatial representation for vehicles. Nevertheless, despite BEV's significance in addressing the challenges inherent to autonomous driving, effectively fusing data from multiple camera sensors and operating in complex external driving environments remains a considerable challenge. To mitigate this issue, we recast the BEV segmentation problem within a variational inference framework. In this paper, we propose a novel transformer-based variational flow transformation network for BEV segmentation, denoted as TVB. Our architecture implicitly learns the mapping from multiple camera views to a unified canonical BEV map during training by exploiting posterior BEV supervision. TVB employs a conditional variational auto encoder (CVAE) as its backbone and produces multiple BEV map candidates. To augment the realism of the generated BEV maps, we integrate normalizing flows into the map generation process, enabling the construction of more complex and expressive probability distributions. Furthermore, we design a BEV-attention fusion (BAF) module that harnesses attention mechanisms to adaptively integrate the multiple candidate BEV maps. Experimental results, evaluated on both the nuScenes and OPV2Vdatasets, demonstrate that our proposed method achieves superior performance in multi-camera view BEV segmentation and lane environment perception.
59. 【2607.14703】Pretraining Multiple Instance Learning Networks with Multi-Teacher Distillation from Pathology Slide Foundation Models
链接：https://arxiv.org/abs/2607.14703
作者：Mingxi Fu,Jiawen Li,Renao Yan,Jiali Hu,Qiehe Sun,Tian Guan,Yonghong He
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multiple instance learning, Multiple instance, MIL, main paradigm, paradigm for whole-slide
备注：
点击查看摘要
Abstract:Multiple instance learning (MIL) has become the main paradigm for whole-slide image (WSI) analysis in computational pathology. However, existing MIL aggregators are still typically trained from scratch for each downstream task, relying on limited slide-level labels to learn both aggregation mechanisms and downstream discriminative representations simultaneously. As a result, they often suffer from unstable optimization, overfitting, and limited transferability. Similar to pretrained ResNet and Vision Transformer models in natural image learning, MIL also requires reusable pretrained initialization. However, high-quality slide-level pretraining data remain scarce, and MIL models are usually lightweight and weakly supervised, making large-scale pretraining difficult in practice. To address this challenge, we propose a distillation-based pretraining framework for MIL, which leverages two slide-level foundation models, TITAN and CARE, as teachers to transfer their representational knowledge into a diverse set of MIL architectures. To effectively balance supervision from different teachers, we further introduce an angular dispersion normalized distillation loss. The distilled weights are then used as initialization for downstream adaptation. We conduct systematic evaluations on 15 benchmark datasets under both linear probing and full-parameter fine-tuning, and further validate its advantages in few-shot scenarios. Experimental results show that pretraining generally improves MIL aggregators over from scratch training, especially in linear-probing and few-shot settings, while maintaining the computational efficiency of lightweight MIL models. Code is available at this https URL.
60. 【2607.14702】am RAS in 11th ABAW Competition: Multimodal Ambivalence Recognition Approach
链接：https://arxiv.org/abs/2607.14702
作者：Elena Ryumina(1),Maxim Markitantov(1),Alexandr Axyonov(1),Fedor Shchetinin(2),Timur Abdulkadirov(1),Dmitry Ryumin(1),Alexey Karpov(1, 2) ((1) St. Petersburg Federal Research Center of the Russian Academy of Sciences (SPC RAS), St. Petersburg, Russia, (2) HSE University, St. Petersburg, Russia,(3) TMO University, St. Petersburg, Russia)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Affective Behavior Analysis, computationally expensive ensembles, Automatic recognition, Text Residual Fusion, contextual patterns
备注： 10 pages, 2 figures
点击查看摘要
Abstract:Automatic recognition of ambivalence and hesitancy is challenging because these states may be expressed through inconsistent linguistic, acoustic, facial, and contextual patterns, while top-performing systems often rely on computationally expensive ensembles. We present a single text-centered multimodal approach for video-level ambivalence and hesitancy recognition for the 11th Affective Behavior Analysis in-the-Wild (ABAW) Challenge. The proposed approach combines linguistic, acoustic, facial, and scene features using text-centered multimodal fusion model. Text Residual Fusion treats text as the anchor modality and applies gated residual adjustments based on the other modalities. Experiments on the Behavioural Ambivalence/Hesitancy (BAH) corpus confirm that text is the strongest unimodal modality. The Text Residual Fusion model achieves an average Macro F1-score (MF1) of 75.14% across the Development and Public Test subsets. On the Private Test subset, it reaches an MF1 of 78.24%, outperforming the text model by 4.03%. These results demonstrate that complementary multimodal information can improve recognition performance without requiring a large model ensemble.
61. 【2607.14684】GlobalForge: Towards Robust AI-Generated Image Detection
链接：https://arxiv.org/abs/2607.14684
作者：Manni Cui,Ruiqi Liu,Dianyuan Zou,Ziheng Qin,Jingrui Xu,ZiAn Wang,Jianglan Wei,Han Zhou,Yu Liu,Yan Wang,Shu Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieve strong accuracy, performance drops sharply, detectors achieve strong, AI-generated image, real-world channels
备注：
点击查看摘要
Abstract:AI-generated image (AIGI) detectors achieve strong accuracy on clean benchmarks, but their performance drops sharply after images are propagated through real-world channels. We trace this fragility to what these detectors actually learn: they overfit to local artifacts left by generators in small spatial neighborhoods, which are easily destroyed by common propagation degradations such as JPEG compression and blur. Instead, we shift the discriminative cue from fragile local artifacts to more robust global structure. Building on this, we propose GlobalForge, a framework with two complementary modules. The Local Information Bottleneck (LIB) suppresses local components to block shortcut learning, while the Global Structural Reasoning (GSR) module forces every token to gather evidence from distant regions. Both modules are trained jointly under a contrastive structural loss based on degradation that keeps the resulting features stable under degradation. To support fine-grained robustness evaluation, we further introduce RealDeg-Bench, covering 7 common degradation operators and multi-step compound chains. GlobalForge improves average BAcc on 8 in-the-wild benchmark groups by $\mathbf{5.89\%}$ over the previous state-of-the-art, and is clearly ahead of representative baselines on RealDeg-Bench under both single and compound degradations. Code is available at this https URL.
62. 【2607.14681】ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationships
链接：https://arxiv.org/abs/2607.14681
作者：Xinyu Liu,Shihao Li,Weihong Lin,Xinlong Chen,Yang Shi,Yujin Han,Yiyang Cai,Yanghao Wang,Ruibin Yuan,Yuanxing Zhang,Pengfei Wan,Wenhan Luo,Yike Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent diffusion-based video, made significant progress, Recent diffusion-based, diffusion-based video generation, made significant
备注： Project Page: [this https URL](https://rebind-mrv2v.github.io/)
点击查看摘要
Abstract:Recent diffusion-based video generation models have made significant progress in multi-reference image-conditioned video editing. However, existing methods still struggle to coordinate information from multiple visual sources accurately. We identify a critical deficiency in existing approaches. Existing editing instructions lack explicit reference relationships, and most multimodal large language models (MLLMs) cannot generate them reliably. To address this problem, we propose ReBind, a systematic framework that introduces semantic instructions with embedded reference tokens as the intermediate representation for multi-reference image-conditioned video editing. Our key insight is embedding reference tokens at semantic positions to eliminate ambiguity and establish precise bindings between visual attributes and their sources. We develop ReBind-Instruct, a specialized MLLM that learns to establish explicit bindings between visual attributes and their reference sources through a two-stage progressive scheme for precise reference relationships. We further develop ReBind-Edit, which enables lightweight adaptation of text-to-video models to coordinate multiple references by binding visual attributes to their designated sources. Extensive experiments demonstrate that ReBind substantially outperforms general-purpose MLLMs in instruction quality and achieves state-of-the-art performance among open-source methods on reference image conditioned video editing. Our project webpage: this https URL.
63. 【2607.14660】VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance
链接：https://arxiv.org/abs/2607.14660
作者：Yunfeng Liu,Yuandong Yang,Jiarui Han,Zhenpeng Huang,Yuqing Tang,Xiangyu Zeng,Gangshan Wu,Limin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：encounter significant daily, significant daily challenges, daily challenges due, Multimodal Large Language, Visually impaired individuals
备注：
点击查看摘要
Abstract:Visually impaired individuals (VIIs) encounter significant daily challenges due to limited access to visual information. Although Multimodal Large Language Models (MLLMs) have achieved impressive results on general vision and language tasks, their practical utility in real-world blind assistance still remains largely underexplored. To fill this gap, we introduce VIABench, a comprehensive video benchmark specifically designed to evaluate MLLMs in Visually Impaired Assistance scenarios using first-person videos recorded or shared by VIIs themselves. VIABench defines three core tasks, each targeting a distinct requirement in visual assistance. Proactive Reminder: Assesses the model's ability to interpret ongoing video content while proactively anticipating and verbally describing upcoming navigation-critical events; Visual Question Answering (VQA): Evaluates the model's capacity to answer user-posed questions about the environment or objects within the video; Vision-Guided Interaction: Tests context-aware reasoning to accomplish intentional interactions between user and environment. To ensure a robust and fair evaluation, we propose a rigorous benchmarking pipeline that supports both online (real-time) and offline settings. Our experiments demonstrate that current MLLMs still struggle to deliver comprehensive support for VIIs, especially in the Proactive Reminder task, which demands accurate anticipation and real-time responsiveness. We hope VIABench will drive future research toward developing customized MLLMs for real-world assistance, ultimately improving navigation and interaction experiences for visually impaired individuals. Code and data will be released at this https URL.
64. 【2607.14645】Autoregressive Modeling of Film with Applications in Video Montage
链接：https://arxiv.org/abs/2607.14645
作者：Marcelo Sandoval-Castañeda,Fabian Caba Heilbron,Shiry Ginosar,Bryan Rusell,Josef Sivic,Alexei A. Efros,Greg Shakhnarovich
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autoregressive transformer designed, coherent cinematic sequences, turning a collection, designed to address, address the challenge
备注：
点击查看摘要
Abstract:This work introduces FilmGPT, an autoregressive transformer designed to address the challenge of video montage--turning a collection of raw, "unwatchable" footage into coherent cinematic sequences. Inspired by language learning in modern LLMs, we train a long-context autoregressive transformer on a large corpus of movies. The aim is to implicitly capture the "grammar" of film directly from data rather than from hand-coded rules. Unlike other generative models, FilmGPT does not generate any new video frames. Instead, at inference time, we introduce a footage-constrained decoding algorithm to select the best next shot from the input raw footage according to the statistical patterns learned from films. We first evaluate these learned statistics directly by using the FilmGPT autoregressive model for next shot prediction on a standard benchmark of shot sequence ordering, outperforming the previous state of the art. We then evaluate our footage-constrained decoding algorithm on the full film editing task via a user study, and find that our FilmGPT-based editing significantly outperforms previous approaches. Finally, we demonstrate the applicability of FilmGPT to a wide range of applications in video montage, from automatic video segment trimming to human-in-the-loop film editing.
65. 【2607.14639】Image-to-Point Cloud Registration Made Easy with Rectified Flow-based LiDAR Upsampling
链接：https://arxiv.org/abs/2607.14639
作者：Reon Tabata,Kenji Koide,Shuji Oishi,Masashi Yokozuka,Taku Okawara,Aoki Takanose,Jun Miura
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：point clouds makes, Conditional Rectified Flow, autonomous systems, strong generalization, essential for integrating
备注：
点击查看摘要
Abstract:Image-to-Point Cloud Registration (I2P) is essential for integrating camera and LiDAR in perception and autonomous systems, yet the modality gap between images and point clouds makes it difficult to achieve both high accuracy and strong generalization. In this paper, we propose a simple yet effective I2P method that treats LiDAR as an imaging sensor: from a single sparse LiDAR scan, we generate a dense LiDAR intensity image using Conditional Rectified Flow, match it with a camera image using a pre-trained feature matcher, and estimate the 6-DoF relative pose via PnP-RANSAC. The proposed model is pre-trained through a self-supervised image completion task and fine-tuned on a small amount of LiDAR data (neither image-point cloud pairs nor ground-truth sensor poses are required), enabling it to scale to diverse LiDAR and camera configurations. Experiments on the R3LIVE dataset show that the proposed method achieves a mean error of 4.89° / 1.63 m, outperforming existing methods, while completing a single registration in approximately 0.68 s.
66. 【2607.14635】Action QFormer: Structured Representation Shaping under Action Supervision in Vision-Language-Action Models
链接：https://arxiv.org/abs/2607.14635
作者：Yufeng Ji,Wenhao Tang,Haoyi Niu,Koushil Sreenath,Yi Wu,Zhongyu Li
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：learning action prediction, inherited multimodal, inherited multimodal representations, Action, shapes inherited multimodal
备注：
点击查看摘要
Abstract:Action supervision in vision-language-action (VLA) models is often treated as a downstream objective for learning action prediction. In this paper, we study it instead as a force that shapes inherited multimodal representations. We show that this shaping has a dual effect: it is necessary for forming action-compatible representations, but when action supervision is applied too directly to the inherited multimodal pathway, it can also destabilize representations that support language-side processing and object grounding. To address this tension, we introduce Action QFormer, a query-based action-facing interface that uses instruction-conditioned queries to reorganize inherited multimodal information into action-facing representations before downstream action generation. In zero-shot sim-to-real navigation, Action QFormer improves average closed-loop task success from 18.8% to 56.3%, raises fixed-instruction action-generation correctness from 22.5% to 75.5%, and nearly eliminates out-of-distribution instruction generations. Further analyses show that Action QFormer changes how action supervision shapes inherited multimodal representations, reducing broad upstream rewriting while preserving targeted and sometimes constructive action-supervised adaptation. These results suggest that improving VLA performance requires not only stronger pretrained backbones, but also better ways of selecting and organizing inherited multimodal information while controlling how it is shaped under action supervision.
67. 【2607.14631】Knowing You at First Glance: Inferring Apparent Personality from Faces
链接：https://arxiv.org/abs/2607.14631
作者：Shuhuan Chen,Xiangyu Zhu,Weisong Zhao,Haichao Shi,Xiao-Yu Zhang,Zhen Lei
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：images is important, important in social, social scenarios, personality, inferring intrinsic personality
备注： Accepted by The 9th Chinese Conference on Pattern Recognition and Computer Vision, PRCV2026
点击查看摘要
Abstract:Inferring apparent personality from facial images is important in social scenarios for embodied agents in human-robot interaction. Unlike inferring intrinsic personality traits via conversation, this task models first-impression personality perception based solely on facial appearance before interaction begins. Existing studies mainly focus on the Big Five personality model and often rely on language or multimodal inputs. As a result, it remains unclear whether facial cues alone can support meaningful associations with perceived personality traits. This question is particularly relevant for MBTI types, which are widely used in practice and more readily interpretable by large language models. To this end, we propose \textbf{GlanceFace}, an end-to-end framework for apparent personality inference leveraging vision-language models to introduce semantic priors and a semantic-enhanced facial representation module to capture subtle personality-related cues, together with an uncertainty-aware learning strategy to handle noisy and subjective annotations. Extensive experiments demonstrate strong performance on MBTI-based apparent personality benchmarks and reveal relationships between facial characteristics and perceived personality traits, highlighting its potential to support adaptive initial interaction strategies for embodied agents. The code and dataset are available at this https URL.
68. 【2607.14616】SportD: Can VLMs Physically Strategize?
链接：https://arxiv.org/abs/2607.14616
作者：Jasin Cekinmez,Addison J. Wu,Haotian Xia,Akshaya Bharadhwaj,Anay Putty,Anirudh Ravishankar,Jaewoong Lee,Jinglin Xiao,Kyumin Andrew Shim,Mishika Ahuja,Nisarga Patil,Leo Liu,Zhuohan Liu,Weining Shen
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：interpreting visual scenes, make strategically effective, strategically effective decisions, visual scenes, increasingly capable
备注：
点击查看摘要
Abstract:Vision--language models have become increasingly capable of interpreting visual scenes, but it remains unclear whether they can use information to make strategically effective decisions. We investigate this question in soccer, where models observe the seconds preceding an on-ball decision and must choose whether to shoot or pass to a specific teammate. Unlike conventional visual-understanding tasks, soccer enables decisions to be evaluated quantitatively by estimating the value of every available action. We introduce SportD, a benchmark comprising 478 on-ball decisions from the 2022 FIFA World Cup. Each model choice is evaluated against a possession-value model that estimates the action that most increases the attacking team's probability of scoring, allowing us to measure both optimal-action accuracy and the value forfeited by suboptimal decisions. Across three frontier VLMs, the best selects the highest-valued action on 31.4% of events, compared with 38.9% for the professional players, and all models incur significantly greater regret. Further analysis reveals a systematic preference for lower-variance and lower-reward actions: VLMs shoot less often and select substantially less progressive passes than either the optimal policy or the real players. The models also reproduce the player's specific action above chance even when that action is suboptimal, suggesting partial imitation of familiar play patterns rather than consistent evaluation of counterfactual alternatives. SportD provides a value-grounded testbed for measuring physical strategic reasoning in VLMs.
69. 【2607.14598】Hough-SIFT: Robust Image Registration for Linear Structures via Hough Space
链接：https://arxiv.org/abs/2607.14598
作者：Masaki Satoh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：electronic image stabilization, image stabilization, electronic image, Scale-Invariant Feature Transform, essential in applications
备注： 5 pages, 6 figures. Supplementary video is available as an ancillary file. Accepted for oral presentation at the 29th Meeting on Image Recognition and Understanding (MIRU2026)
点击查看摘要
Abstract:Image registration is essential in applications such as electronic image stabilization. Scale-Invariant Feature Transform (SIFT), a widely used local keypoint detector and descriptor, typically provides accurate registration; however, it often fails in scenes with strong linear structures (e.g., shutters), where local features become ambiguous. We propose Hough-SIFT, a robust registration method that performs SIFT descriptor matching in Hough space. In this domain, linear structures form distinctive peaks that restore descriptor discriminability. Experiments demonstrate that Hough-SIFT is robust in linear scenes where SIFT frequently fails, while maintaining accuracy comparable to SIFT in normal scenes.
70. 【2607.14595】MagicPrompt: Ultra-Lightweight Prompt Tuning for Video Generation
链接：https://arxiv.org/abs/2607.14595
作者：Yinhan Zhang,Dinwei Tan,Xianghao Kong,Yue Ma,Yeying Jin,Anyi Rao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale video diffusion, incurs prohibitive computational, Large-scale video, video diffusion models, downstream tasks incurs
备注：
点击查看摘要
Abstract:Large-scale video diffusion models (VDMs) deliver strong generation performance, but full fine-tuning for downstream tasks incurs prohibitive computational costs. Existing parameter-efficient fine-tuning (PEFT) methods have two critical flaws on billion-scale models: they still require substantial trainable parameters, and reward-based training suffers from noise-induced optimization instability in condition-guided tasks. We propose MagicPrompt, a lightweight framework that achieves extreme parameter efficiency and stable reward optimization. It first adopts Attention-Embedded Prompt Tuning, which steers generation via lightweight soft prompts with orders of magnitude fewer parameters while preserving pre-trained knowledge. It further introduces Dual-Space Reward Feedback Optimization, which uses self-supervised latent objectives to improve condition-guided reward training. Experiments show MagicPrompt reaches competitive performance with less than 1\% trainable parameters and notably reduces training costs.
71. 【2607.14581】Multi-LLM Collaborative MRI Report Generation for Visual Instruction Tuning in Brain Oncology
链接：https://arxiv.org/abs/2607.14581
作者：Sinyoung Ra,Jonghun Kim,Hyunjin Park
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, Recent advances, language models, vision-language models, advances in large
备注：
点击查看摘要
Abstract:Recent advances in large language models (LLMs) and their extension to vision-language models (VLMs) have made it easier to combine text and images for tasks such as report generation. Existing VLMs in medicine typically focus on 2D images (chest X-rays), and their extension to 3D imaging has been difficult because of the lack of paired 3D imaging-text data. Thus, we introduce a new method for creating a 3D image-text dataset for brain oncology using 3D MRI scans of glioma and meningioma cases. We use a cooperative system in which several LLMs work together to generate and check reports, ensuring that they are accurate and clear. By leveraging the new 3D MRI-text dataset, we further build a VLM that converts MRI scans into tokens and aligns them with text instructions. Our VLM performed better in report generation and visual question answering tasks than other 2D and 3D methods. Our method not only improves the quality of reports but also helps with better diagnosis and treatment in brain oncology.
72. 【2607.14580】Advanced Image Generation: Negative Prompt Optimization and Latent Classifier Guidance
链接：https://arxiv.org/abs/2607.14580
作者：Vaddi Charan Sai Nandan Reddy,Harini B,Chandana M S
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：LLM and latent-space, latent-space classifier guidance, integrates negative prompt, negative prompt optimization, generated by Stable
备注：
点击查看摘要
Abstract:We present a novel system that integrates negative prompt optimization via a fine-tuned sequence-to-sequence LLM and latent-space classifier guidance to improve the quality of images generated by Stable Diffusion. Our approach automatically generates optimized negative prompts, and employs a CNN-RNN hybrid classifier to evaluate and guide diffusion steps, rolling back low-quality latent updates. Experimental results demonstrate that our dual-guidance framework reduces artifacts and improves semantic fidelity compared to baseline diffusion.
73. 【2607.14579】Skeleton: Visual Authoring of Non-visual Data Experiences
链接：https://arxiv.org/abs/2607.14579
作者：Frank Elavsky,Chieri Nnadozie,Lucas Nadolskis,Patrick Carrington,Dominik Moritz
类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)
关键词：assistive technologies traverse, traverse an interface, bindings that govern, govern how assistive, assistive technologies
备注： 9 pages core, 2 pages acknowledgements + references, 4 pages appendices. Accepted at IEEE VIS 2026, to appear in November 2026
点击查看摘要
Abstract:When sighted practitioners author accessible data visualizations, they build navigation structures (the nodes, edges, and input bindings that govern how assistive technologies traverse an interface) entirely in code, with no visual representation. Without a representation to react to, practitioners cannot develop judgment about what makes navigation good or bad, and the quality ceiling of non-visual experiences is set by the absence of a feedback loop. We address this problem through longitudinal co-design with practitioners across cartography, design systems, and open-source visualization, and make three contributions. First, we introduce an Inspector that renders navigation graphs as interactive node-link diagrams, and a Dimensions API that expresses navigation in terms of data dimensions rather than explicit graph construction. Second we present Skeleton, a direct-manipulation authoring environment in which the properties of an accessible navigation structure are translated into visual representations authors can observe and manipulate. Key techniques include a dual-view editor that simultaneously shows the system's navigation model and the end user's spatial experience, a scaffolding engine that automates spatial node placement by repurposing a visualization rendering pipeline, a live label-template editor with real-time screen-reader-output preview, and a testing mode that makes traversal sequence visually trackable. Third, we evaluate Skeleton through an in-situ study with 8 practitioners across visualization design, engineering, and research. Making navigation structure visible changed how practitioners engaged with accessible design: they reconsidered the architecture of their own visualizations, attended to a broader range of input modalities, and shifted from treating accessibility as a compliance task to treating it as a design problem. (abstract shortened for arxiv)
74. 【2607.14560】Breaking the Model Forgetting Cycle in Long-Incremental 3D Object Detection
链接：https://arxiv.org/abs/2607.14560
作者：Peisheng Qian,Jie Xu,Xulei Yang,Na Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sequentially arriving data, remembering previously learned, requires a detector, detector to learn, previously learned
备注： ECCV 2026
点击查看摘要
Abstract:Incremental 3D object detection requires a detector to learn novel object classes while remembering previously learned ones over sequentially arriving data. Previous methods, primarily based on pseudo-labeling, perform reasonably in short-incremental stages but still suffer from severe model forgetting when dealing with long-incremental sequences. We investigate this failure and reveal a detrimental self-reinforcing cycle: data distribution shift of novel classes causes model forgetting on old classes, which further produces accumulated error in pseudo-labeling that exacerbates model degradation. To address this issue, we draw inspiration from the human learning process and propose the \emph{Learning-Dynamics-driven Memory and Review} (LDMR) framework. LDMR monitors per-class detection quality at periodic training checkpoints and uses these learning-dynamics signals to drive two innovative mechanisms, namely (i) human-like intra-stage review that divides each incremental stage into multiple sub-stages' training and concentrates on remembering the most-forgotten objects, and (ii) scene-aware cross-stage memory evolution that evolves a memory bank to transfer knowledge between two consecutive stages by jointly considering scene learnability and diversity. Extensive experiments across multiple long-incremental protocols on indoor benchmarks SUN RGB-D and ScanNetV2 show that LDMR substantially mitigates the model forgetting and outperforms all baselines by a clear margin. Code is available at this https URL.
75. 【2607.14548】HyMobileAgent: Data-Environment Co-Scaling for Efficient GUI Agents
链接：https://arxiv.org/abs/2607.14548
作者：Hy Vision Team,Huawen Shen,Zhengyang Tang,Shangpin Peng,Liang Wu,Anran Zhang,Weinong Wang,Yiduo Guo,Chenxin Li,Zhengyao Fang,Yang Ding,Junyi Li,Fei Tang,Zheng Ruan,Yi Zhang,Xingran Zhou,Dingchen Yang,Sunqi Fan,Zhiyi Wan,Han Hu,Xin Lai,Pengyuan Lyu,Chengquan Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：digital embodied intelligence, large multimodal models, multimodal models move, digital embodied, embodied intelligence
备注：
点击查看摘要
Abstract:As large multimodal models move from understanding content to operating on digital environments, mobile GUI has emerged as a challenging and consequential testbed for digital embodied intelligence. Mobile agents operate under three coupled constraints: precise perception of complex interfaces, scalable acquisition of high-quality interaction data, and robust long-horizon decision making under compounding execution errors. This report presents HyMobileAgent, a mobile GUI agent built on Hy3.0-VL-A3B, a vision-native foundation model featuring native any-resolution input, an A3B-scale deployment budget, and a 32K context window to model extended interaction histories. Rather than relying solely on model scaling, we develop a joint data and environment centric scaling framework to address the key bottlenecks of mobile interaction. Our framework integrates a GUI perception flywheel combining mock-interface synthesis, rejection sampling, and icon-specific augmentation; a knowledge pipeline that transforms tutorial videos into structured interaction data; a million-scale action data pipeline deployed across more than 2000 sandbox and real-device instances with automated failure attribution; the PhoneWorld Mock App Factory, providing a resettable training environment with 34 mock applications and over 34000 tasks; and a structured Planning-and-Reflection mechanism with explicit dead-loop detection for reliable long-horizon execution. We also introduce a progressive training recipe consisting of mid-training, supervised fine-tuning, and reinforcement learning with task-specific reward designs.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.14548 [cs.CV]
(or
arXiv:2607.14548v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.14548
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
76. 【2607.14547】AdaTurn: Budget-Aware Test-Time Scaling for Active Visual Perception Agents
链接：https://arxiv.org/abs/2607.14547
作者：Susan Liang,Chao Huang,Filippos Bellos,Jing Bi,Jason J Corso,Chenliang Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Active visual agents, solve fine-grained image, fine-grained image tasks, visual agents solve, agents solve fine-grained
备注：
点击查看摘要
Abstract:Active visual agents solve fine-grained image tasks by interleaving reasoning with image-grounding actions across multiple turns. However, deployment-time rollout budgets are rarely fixed: some requests permit long rollouts, while others require the agent to act under a tight turn limit. Existing methods train the policy as if the rollout budget were hidden, so when the available budget is smaller than the trajectory the agent prefers, the interaction is often truncated before any valid answer is produced; we term this failure \emph{catastrophic truncation}. To overcome this challenge, we present AdaTurn, a budget-aware framework that conditions the agent on the allowed number of turns and explicitly trains the boundary behavior induced by the budget. Our key component, Forced-Answer DAPO (FA-DAPO), converts the over-budget event from a masked or penalized failure into a trainable final-decision step, teaching the model to synthesize partial evidence when further tool use is no longer possible. We further randomize rollout budgets during both training and inference and introduce a load-balanced scheduler that makes such operations practical. AdaTurn substantially improves low-budget accuracy, for example raising VisualProbe-Medium from 36.7% to 47.6% at four turns, while preserving strong scaling at larger budgets and transferring effectively to multiple backbones and general multimodal benchmarks.
77. 【2607.14544】3D Geometric Tooth Alignment Planning via Deep Reinforcement Learning
链接：https://arxiv.org/abs/2607.14544
作者：Yong Li,Jianwen Lou,Jiayue Ma,Yao-Xiang Ding,Youyi Zheng,Haihua Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：final target alignment, modern digital orthodontics, tooth alignment planning, determines sequential trajectories, initial malocclusion
备注：
点击查看摘要
Abstract:3D geometric tooth alignment planning, which determines sequential trajectories from initial malocclusion to the final target alignment, is a cornerstone of modern digital orthodontics. This paper presents a novel deep reinforcement learning (DRL) framework to automate the generation of these alignment paths. We formulate the planning process as a Markov Decision Process (MDP) to capture its sequential decision-making nature, focusing on optimizing geometric trajectories while integrating essential spatial constraints, such as inter-dental collision avoidance and path efficiency. The proposed method leverages the Deep Deterministic Policy Gradient (DDPG) algorithm, enhanced by three key innovations: (1) a Transformer-based agent to model complex spatial interactions between teeth and manage high-dimensional state-action spaces; (2) a dynamic masking scheme that restricts movement to a sparse subset of teeth per step, better reflecting the clinical logic of sequential alignment; and (3) a two-stage curriculum learning strategy that gradually increases task difficulty to ensure training stability and efficient path discovery. We evaluate our approach on a dataset of 10K expert-designed treatment plans based on clinical data. Experimental results demonstrate that our method outperforms existing baselines in terms of path safety and geometric efficiency, providing a robust and automated solution for 3D geometric orthodontic alignment planning.
78. 【2607.14534】SwinAD: Multi-stage feature reconstruction for unsupervised industrial anomaly detection
链接：https://arxiv.org/abs/2607.14534
作者：Huong Ninh,Chien Thai,Mai Xuan Trang,Vu-Minh Le,Thanh Ha Le,Long Tran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：localize defective regions, defect types, Industrial anomaly detection, anomaly detection aims, multi-class unsupervised anomaly
备注：
点击查看摘要
Abstract:Industrial anomaly detection aims to identify and localize defective regions without relying on exhaustive annotations of all possible defect types. Although recent unsupervised methods have achieved strong performance, most are primarily designed for single-class settings and often struggle in multi-class scenarios, where diverse normal patterns may lead to over-generalization and reduce the discriminative capability between normal and anomalous regions. In this paper, we propose SwinAD, a reconstruction-based framework for multi-class unsupervised anomaly detection that leverages a frozen pretrained Swin Transformer V2 encoder and a feature diversity-preserving reconstruction decoder. The hierarchical encoder provides semantically rich multi-scale features, while stage-wise bottleneck modules with dropout prevent trivial identity mapping and encourage robust reconstruction of normal patterns. To further improve localization, we introduce a feature diversity-preserving reconstruction framework that maintains complementary reconstruction hypotheses instead of relying on a single decoding branch. The discrepancies between encoder features and the two reconstructed features are then aggregated across multiple scales to produce the final anomaly map. Experiments conducted on three industrial anomaly detection benchmarks, including MVTec AD, VisA, and Real-IAD, demonstrate that SwinAD achieves competitive image-level performance and strong pixel-level localization accuracy, with particularly notable improvements in pixel-level AP and 1 on MVTec AD. These results indicate that combining hierarchical Swin features with diverse multi-scale reconstruction substantially improve pixel-level localization in multi-class unsupervised anomaly setting.
79. 【2607.14521】Uni-AdaVD: Universal Concept Erasure for Visual Generation via Orthogonal Value Decomposition
链接：https://arxiv.org/abs/2607.14521
作者：Qifan Zhou,Yuan Wang,Yanbin Hao,Xiang Wang,Kuien Liu,Richang Hong,Meng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：uncurated pretraining data, inevitably absorb undesirable, absorb undesirable concepts, models inevitably absorb, pretraining data
备注：
点击查看摘要
Abstract:Visual generative models inevitably absorb undesirable concepts from uncurated pretraining data, making concept erasure essential for safe deployment. Existing erasure methods, however, are often architecture-specific and struggle to remove target concepts while preserving non-target content and generative priors. We present Uni-AdaVD, a universal inference-time concept erasure framework for visual generation. Uni-AdaVD treats the value space of multimodal attention as a unified intervention space and introduces encoder-aware target representation construction to localize target semantics across heterogeneous text encoders. It further combines orthogonal value decomposition with an adaptive erasing shift to suppress target semantic directions without updating the original model weights. Extensive experiments on U-Net-, DiT-, and autoregressive image generators, as well as text-to-video models, demonstrate strong performance on single- and multi-concept erasure while preserving non-target priors. These results suggest that Uni-AdaVD provides an efficient and adaptable safety mechanism for modern visual generative models. Our code is available at this https URL.
80. 【2607.14514】VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation
链接：https://arxiv.org/abs/2607.14514
作者：Xiaoran Xu,Yupeng Wu,Tianyu Xue,Yifan Xu,Xuanran Dong,Xiaoshan Yang,Changsheng Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Object-goal navigation requires, indoor environment, requires an embodied, locate and reach, reach an instance
备注：
点击查看摘要
Abstract:Object-goal navigation requires an embodied agent to locate and reach an instance of a specified object category in an indoor environment. Recent training-free approaches leverage vision-language models (VLMs) for open-vocabulary semantic reasoning, but are typically evaluated under an episodic protocol that resets all scene-specific state after each episode. We introduce Cross-Episode Object-Goal Navigation, in which an agent repeatedly operates in the same scene, retains only self-acquired experience, and keeps its model parameters fixed. To support experience reuse, we present \method, a training-free VLM navigation framework with a persistent hierarchical Visual-Topological Memory (VTM). The VTM organizes scene knowledge at room and object levels and retrieves relevant experience through coarse-to-fine matching, providing memory as soft guidance only when it agrees with current observations. A conservative execution guard further mitigates oscillations, blocked motions, and premature stopping. Under a controlled same-scene protocol, we evaluate \method{} on three benchmarks, HM3D v0.1, HM3D v0.2, and MP3D, and compare it with a strengthened WMNav baseline augmented with cross-episode textual memory, while keeping the VLM backbone and action pipeline identical. \method{} achieves the best performance across all three benchmarks, demonstrating the effectiveness and robustness of structured visual-topological experience reuse across datasets.
81. 【2607.14513】Compression of 3D Gaussian Splatting Data Using GPU-friendly Graphics Texture Coding
链接：https://arxiv.org/abs/2607.14513
作者：Amir Said,Randall Rauwendaal
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：Gaussian Splatting, Techniques for modeling, Graphics Processing Units, image collections, leveraging graphics primitives
备注：
点击查看摘要
Abstract:Techniques for modeling 3D scenes from image collections, such as 3D Gaussian Splatting (3DGS), are capable of generating high-quality novel views by leveraging graphics primitives with view-dependent appearance. In 3DGS, spherical harmonic (SH) are employed to model view-dependent color, resulting in a large number of SH coefficients per primitive and large memory requirements. While compression approaches have been proposed to mitigate this problem, they do not exploit the capabilities of modern Graphics Processing Units (GPUs) for parallel decoding and rendering. In this paper, we propose a method for compressing SH color coefficients using texture compression schemes specifically designed for efficient parallel GPU decoding and supported by dedicated hardware acceleration. It is shown that those methods can compress color coefficients more effectively than 2D textures by exploiting the fact that primitives can be locally grouped and reordered according to color. Furthermore, we introduce a bit-rate control strategy that preserves random access, enabling large-scale parallelization without compromising rendering performance. Experimental results using BC1 and BC7 texture compression formats show that GPU-based decompression can be achieved with negligible or imperceptible degradation in the visual quality of rendered 3DGS scenes.
82. 【2607.14509】Multi-Scale ViT Inference with Habitat-Fit Priors and kNN Retrieval for Multi-Species Plant Identification
链接：https://arxiv.org/abs/2607.14509
作者：Alper Erten,Murilo Gustineli,Adrian Cheung
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：ARC third-place solution, multi-species plant identification, vegetation quadrat images, ARC third-place, multi-species plant
备注：
点击查看摘要
Abstract:This paper describes DS@GT ARC's third-place solution to the PlantCLEF 2026 challenge on multi-species plant identification in vegetation quadrat images, where systems must predict every species present in high-resolution (~3000 x 3000 pixel) plot photographs while training only on single-label images of individual plants. The pipeline is built around a fine-tuned DINOv2 ViT-L/14 classifier applied over a multi-scale tile decomposition of each quadrat, with per-tile predictions blended with a FAISS kNN retriever and post-processed by source-aware temporal fusion across repeated plot visits, a habitat-fit demotion that injects geographic and altitude priors from the training data, and a South-Western Europe geographic mask. Habitat-fit demotion and multi-scale aggregation are the largest individual contributors in the ablations. Two complementary training-centric directions, a cross-region transformer with noisy-student distillation on the LUCAS dataset and a label-as-query transformer decoder over synthetic CLS-domain pseudo-quadrats, yielded null results. An inference-time augmentation with instance-aware segmentation crops also did not improve performance. The selected submission reaches a private-leaderboard macro-F1 of 0.43902 (third place; public 0.51096); an unselected configuration of the same pipeline scored above 0.45 on the private set. Code: this https URL.
83. 【2607.14497】Reinforcing Egocentric Spatial Perception in Multimodal Large Language Models via Ego Scene Augmentation
链接：https://arxiv.org/abs/2607.14497
作者：Chi Kit Wong,Ye Pan,Yuanhuiyi Lyu,Xu Zheng,Zidong Cao,Lutao Jiang,Zixin Zhang,Huiyu Zhou,Xuming Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, enabling Multimodal Large, Large Language Models, Visual Question Answering, Question Answering
备注： 14 pages, 8 figures. Chi Kit Wong and Ye Pan contributed equally. Code: [this https URL](https://github.com/Chikit-WONG/spatialGraph)
点击查看摘要
Abstract:Egocentric Visual Question Answering (VQA) has attracted widespread attention as an important task for enabling Multimodal Large Language Models (MLLMs) to interact with the real world. However, existing MLLMs struggle to perform effective spatial reasoning in complex egocentric scenes due to their limited spatial perception capabilities. To this end, we introduce Ego Scene Augmentation (ESA), an egocentric spatial perception framework, which actively enhances the spatial perception capabilities from the egocentric perspective, powered by the proposed Ego-element Graph. Our core insight is leveraging the Ego-element Graph as an intermediary representation to augment the egocentric spatial perception of MLLMs via visual foundational models. Specifically, we 1) construct the Ego-element Graph, which encapsulates and integrates egocentric spatial features enabled by visual foundational models; 2) enhance the spatial perception capabilities of MLLMs via the Ego-element Graph for ego-perspective scenes. Our proposed ESA framework presents significant performance improvement on the EgoTextVQA benchmark. We achieve an 8.14% gain on the indoor setting and an 8.72% gain on the outdoor setting. Furthermore, our ESA shows the most impressive performance improvement in the shopping subset of the indoor setting. The project code is publicly available.
84. 【2607.14481】Immediate 3D Gaussian Splat Reconstruction of Unordered Input with Global Consistency
链接：https://arxiv.org/abs/2607.14481
作者：Andreas Meuleman,Linus Franke,Boris Zhestiankin,Camille Montemagni,George Drettakis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, choice for reconstructing, reconstructing and real-time, real-time rendering, rendering of captured
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has become the method of choice for reconstructing and real-time rendering of captured scenes. To capture a scene with good visual quality, continuous image sequences are usually combined with out-of-order shots for better scene coverage. Structure from motion can reconstruct such captures, but only after they are all available and often with high computational cost. Incremental reconstruction methods -- often derived from SLAM solutions -- provide immediate feedback, but cannot handle the out-of-order capture we require. We provide the first immediate feedback solution for such radiance field capture that provides global consistency. We first introduce a method for fast matching in out-of-order sequences, by repurposing visual place recognition models and a covisibility graph, and provide an efficient way to find highly connected keyframes, improving quality even for ordered sequences. We show how these steps -- together with GPU optimization and careful Gaussian primitive placement -- provide fast local reconstruction, in our challenging radiance field reconstruction case. We then introduce a novel cluster-based method, again using the covisibility graph, to provide efficient loop closure that does not require sequential input. Finally, to handle large scenes in our context, we introduce a progressive hierarchy that allows our method to scale to large environments, without compromising efficiency. Our results show we provide immediate feedback 3DGS reconstruction with good visual quality in several datasets, with up to thousands of input images.
85. 【2607.14470】G$^2$SR: Geometric Methods for Fast and Memory-Efficient Gaussian-based Surface Reconstruction
链接：https://arxiv.org/abs/2607.14470
作者：Dasong Gao,Vivienne Sze,Sertac Karaman
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：posed RGB images, Few-view surface reconstruction, posed RGB, surface reconstruction recovers, Few-view surface
备注： 8 pages, 3 figures
点击查看摘要
Abstract:Few-view surface reconstruction recovers the visible surfaces of a scene from a few posed RGB images, providing the 3D models that robots need to explore and interact online. On mobile platforms, the reconstruction must be fast and geometrically accurate while keeping a small memory footprint to ensure safe and efficient operation. 3D Gaussian Splatting (3DGS) offers a high-fidelity scene representation, but building it from a few views is ill-posed, as many distinct surfaces reproduce the same images, making traditional photometric methods prone to "floater" artifacts. End-to-end methods resolve the ambiguity by regressing splats with large, usually Transformer-based, networks that require heavy compute and memory while generalizing poorly to new scenes. We propose G2SR, which exploits a well-posed core of the task: given cross-view 2D splat correspondences, 3D splats follow analytically from multi-view geometry. G2SR employs a lightweight neural frontend to detect and track 2D Gaussian splats on the image plane and an analytic backend to triangulate each into a metric-scale 3D splat. On ScanNet, Replica, and DTU, G2SR matches or exceeds the geometric accuracy of state-of-the-art end-to-end methods while running at 69-89 reconstructions per second within 203 MB of GPU memory (5-107x less) for 2- and 3-view inputs at 384 x 512 resolution, offering a practical path to online Gaussian-based surface reconstruction.
86. 【2607.14463】Depth-Dependent Hidden-State Collapse in Dynamical System Autoencoders for LiDAR Point-Cloud Classification
链接：https://arxiv.org/abs/2607.14463
作者：Patricia Medina,Hy P. G. Lam
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Dynamical System Autoencoders, study Dynamical System, System Autoencoders, Dynamical System, Coefficient feature augmentations
备注： 6 pages, 2 figures, 1 table. Submitted to the 2026 IEEE High Performance Extreme Computing Conference (HPEC 2026)
点击查看摘要
Abstract:We study Dynamical System Autoencoders (DSAE) for LiDAR point-cloud classification using spatial coordinates and Product Coefficient feature augmentations. The experiments compare separately trained DSAE architectures at encoder depths $K=1,\ldots,5$ and evaluate the resulting hidden representations with Random Forest, kNN, and a majority-class Dummy baseline. The main finding is a hidden-state collapse at $K=5$. For both xyz and xyz plus Product Coefficient inputs, the hidden-state standard deviation falls to the order of $10^{-5}$, while all three classifiers attain the same macro F1 score of $0.224688$. We prove that between-class hidden scatter is bounded by total hidden scatter, which in turn is controlled by the reported hidden-state variance. Thus a nearly constant hidden representation cannot retain substantial class-separating structure. Product Coefficients neither improve pre-collapse macro F1 nor prevent the $K=5$ collapse in the present DSAE setting. These results identify large-depth representation collapse as a concrete failure mode for DSAE LiDAR classification.
87. 【2607.14445】Cotton-SF YOLO: Learning Structural and Frequency Cues for Early Cotton Square Detection in Complex Field Environments
链接：https://arxiv.org/abs/2607.14445
作者：Chengjia Zhang,Yu Li,Feiri Ali,Yan Zhang,Xin Chen,Longke He,Daokun Ma,Liting Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：important phenotypic indicators, precision cultivation management, early reproductive growth, cotton growth monitoring, cotton square detection
备注：
点击查看摘要
Abstract:Cotton squares are important phenotypic indicators of the early reproductive growth of cotton, and automatic field detection of cotton squares provides an important basis for cotton growth monitoring and precision cultivation management. However, early cotton square detection in complex field environments remains insufficiently explored, as cotton squares are small, frequently occluded, easily blurred, subject to illumination variations, and exhibit low contrast against surrounding cotton leaves. To address these challenges, we propose a task-oriented framework based on YOLO26m, named Cotton-SF YOLO, for cotton square detection under natural field conditions. To improve the perception of small and irregular cotton square boundaries, we introduce Dynamic Snake Convolution into the detector, enabling adaptive extraction of deformable edge features. Furthermore, a frequency-domain feature modulation module is designed by incorporating spectral enhancement into the C2f structure, which recalibrate frequency-domain representations and strengthen discriminative edge and texture cues while reducing interference from complex cotton leaf backgrounds. Trained and evaluated on our newly constructed and annotated field dataset with manually annotated cotton squares, the proposed model achieves mAP$_{50}$, mAP$_{50:95}$, and recall values of 0.8196, 0.4942, and 0.7939, improving over the baseline YOLO26m by 1.25%, 3.45%, and 2.96%, respectively. Ablation experiments and visualization demonstrate that the best performance is achieved with the complementary effects of structural and frequency cues.
88. 【2607.14423】Emergent Region-Level Facial Correspondence in Frozen Vision Foundation Models
链接：https://arxiv.org/abs/2607.14423
作者：Izaldein Al-Zyoud,Abdulmotaleb El Saddik
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：appearance varies sharply, identity-specific appearance varies, self-supervised vision models, Frozen self-supervised vision, generic objects
备注：
点击查看摘要
Abstract:Frozen self-supervised vision models can align parts of generic objects, but it remains unclear whether this correspondence extends to human faces, where global layout is shared while identity-specific appearance varies sharply. We test whether frozen DINOv3 features define a region-level facial coordinate system: a feature space in which eyes, brows, nose, mouth, skin, and hair remain distinguishable across people and across time without face-specific training. Using DINOv3 ViT-L/16 patch embeddings and FaRL only as a face-part labeling interface, we evaluate cross-identity nearest-neighbor matching and temporal label propagation on 200 CelebDF-v2 real videos. DINOv3 achieves 83.0% region-level semantic accuracy under unconstrained cross-identity matching, compared with a 23.0% area-weighted random baseline, and 95.5% temporal tracking accuracy without a learned temporal module. A no-FaRL control collapses to 0.9%, showing that FaRL supplies semantic initialization while DINOv3 supplies dense spatial correspondence. The strongest correspondence appears at an intermediate layer: block 18 gives a 4.93x same-region versus cross-region discrimination ratio, compared with 1.48x at the final block. Against CLIP ViT-L/14, DINOv3 shows only a small aggregate advantage but a +16.8 pp gain on anatomical regions, indicating that image-level contrastive supervision captures coarse facial layout but not fine-grained anatomical identity. These results establish frozen DINOv3 as a strong zero-shot representation for region-level facial correspondence and identify intermediate self-supervised features as the most useful layer for dense face analysis.
89. 【2607.14415】$K$-NeAS: Scalable Multi-Material CT Reconstruction Using Neural SDFs
链接：https://arxiv.org/abs/2607.14415
作者：Daksh K. Shah,Emmanouil Nikolakakis,Razvan V. Marinescu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Computed Tomography, carries significant ionizing, ionizing radiation risks, significant ionizing radiation, carries significant
备注： 9 pages, 3 figures. Under peer review
点击查看摘要
Abstract:Computed Tomography (CT) carries significant ionizing radiation risks, driving the need for sparse-view reconstruction. Implicit scene representations (ISRs) address this by recovering continuous volumetric attenuation fields directly from sparse projections, and recent geometry-aware extensions jointly model surface geometry alongside attenuation to improve fidelity and enable clean tissue segmentation without manual thresholding. However, these methods remain limited by manually tuned attenuation bounds and rigid two-material constraints. This paper proposes $K$-NeAS, a unified and scalable architecture for automated, multi-material surface reconstruction. We replace independent material networks with a shared latent backbone and introduce a fully differentiable $K$-material sequential soft selector to model an arbitrary number of overlapping tissues. To eliminate manual tuning, we automate attenuation bounding using a Gaussian Mixture Model (GMM) and implement a scheduled auxiliary floater loss to mitigate geometric hallucinations common under extreme sparsity. Evaluated across four clinical Cone-Beam CT (CBCT) datasets, $K$-NeAS successfully scales to arbitrary material counts, achieving superior 3D volumetric fidelity at $K=3$ materials on complex multi-tissue regions such as the Abdomen ($33.28\text{ dB}$ 3D PSNR vs. $31.40\text{ dB}$ single-material NeAS baseline, a $+1.88\text{ dB}$ improvement). Furthermore, our model exhibits enhanced robustness under sparse-sampling conditions, outperforming baseline 3D PSNR by up to $1.17\text{ dB}$ under 5- and 10-view constraints.
90. 【2607.14350】Dynamic Manipulation Hypergraphs for HAR: Beyond Pairwise Relations: Dynamic Manipulation Hypergraphs for Vision-Based Human Activity Recognition
链接：https://arxiv.org/abs/2607.14350
作者：Fatemeh Ziaeetabar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supporting surfaces, requires modeling evolving, manipulation recognition requires, disconnected binary relations, recognition requires modeling
备注：
点击查看摘要
Abstract:Fine-grained manipulation recognition requires modeling evolving relations among hands, objects, tools, and supporting surfaces. Conventional graph-based methods use pairwise edges that can fragment a coordinated event into disconnected binary relations. We propose a dynamic manipulation hypergraph framework that represents multi-entity configurations as higher-order relational units. At each temporal step, relevant entities are encoded using appearance, spatial, motion, and semantic-role features. Hyperedge candidates are instantiated and ranked using proximity, contact, and motion-coupling predicates. A hypergraph reasoning network performs node-to-hyperedge and hyperedge-to-node message passing, followed by temporal attention over the evolving interaction structure. The framework provides class-agnostic hyperedge-importance scores that identify entity configurations and temporal intervals emphasized by the model without treating them as causal explanations. Quantitative evaluation is conducted on EPIC-KITCHENS-100/VISOR and Assembly101 under an annotation-assisted entity-localization protocol. Video-only and entity-based methods provide contextual comparisons, while a matched pairwise graph and a static hypergraph serve as the principal controlled baselines because they use identical entity inputs and comparable relational settings. The proposed method improves HO-F1 over the matched pairwise graph by 6.9 percentage points on EPIC-KITCHENS-100/VISOR and 9.5 points on Assembly101, and exceeds the static hypergraph by 4.4 and 5.8 points, respectively. Qualitative analysis on ARCTIC further shows correspondence between highly ranked hyperedges and contact-rich manipulation intervals. These results demonstrate the value of time-varying higher-order relational modeling for fine-grained manipulation activity recognition.
91. 【2607.14338】Beyond scalar losses: calibrating segmentation models via gradient vector field surgery
链接：https://arxiv.org/abs/2607.14338
作者：Laurin Lux,Alexander H. Berger,Moritz Knolle,Daniel Rückert,Johannes C. Paetzold
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Region-based loss functions, Dice loss, Region-based loss, highly class, facto standard
备注： MIDL 2026. Published version: [this https URL](https://proceedings.mlr.press/v315/lux26a.html)
点击查看摘要
Abstract:Region-based loss functions, such as the Dice loss, have established themselves as the de facto standard for highly class- and region-imbalanced segmentation tasks. However, models trained using region-based loss functions are notoriously miscalibrated and typically yield over-confident predictions. In medical imaging applications, such as defining tumor resection margins, this miscalibration is hindering clinical adoption. In this work, we outline a novel gradient perspective on this overconfidence and show how it affects region-based loss functions. We propose a "surgery" on the gradient vector field as a simple, yet effective intervention to mitigate calibration issues. This surgery adds a factor to the loss's partial derivative, scaling the gradient's magnitude linearly with the prediction error. In empirical evaluations across 2D and 3D medical segmentation tasks, we demonstrate the effectiveness of this intervention while maintaining high prediction accuracy when used in conjunction with any region-based loss function.
92. 【2607.14334】MixCompress: Mixture of Experts for Variable Rate Learned Image Compression
链接：https://arxiv.org/abs/2607.14334
作者：Calvin-Khang Ta,Praneet Singh,Tong Shao,Peng Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rate-distortion operating point, Learned image compression, store independent models, operating point, store independent
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Learned image compression (LIC) is bottlenecked by the need to store independent models for each rate-distortion operating point. Existing variable bit-rate (VBR) methods aim to reduce this overhead via dense parameter modulation, but forcing a shared backbone to approximate divergent mappings causes severe feature entanglement. Specifically, low-rate smoothing gradients inherently conflict with the preservation of high-frequency textural details, leading to sub-optimal performance. To resolve this, we propose MixCompress, a unified VBR framework based on sparse structural specialization. While sparsely gated Mixture-of-Experts (MoE) routing successfully mitigates gradient conflict, it operates on a fixed computational budget. To address the increased representational demands of higher bit-rates we introduce a Mixture-of-Depths (MoD) extension to dynamically scale model capacity. Combined with Conditional Auxiliary Transforms (CAT) for dynamic sub-band energy modulation, our hierarchical framework effectively dynamically scales capacity. Extensive evaluations demonstrate that MixCompress not only matches individually optimized single-rate baselines but can even surpass them, establishing a new Pareto frontier for computationally efficient image coding.
93. 【2607.14333】SD-MAR: Multi-image Analytical Reasoning via Synthetic Data and Reinforcement Learning
链接：https://arxiv.org/abs/2607.14333
作者：Shiyu Yuan,Sourav Sanjukta Bhabesh,Zhe Wang,Dmitriy Bespalov,Wesley Rose,Huzefa Rangwala
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Vision Language Models, Vision Language, strong perceptual abilities, multiple visual states, multi-step visual inference
备注：
点击查看摘要
Abstract:Vision Language Models (VLMs) demonstrate strong perceptual abilities but remain limited in tasks requiring analytical reasoning across multiple visual states, such as multi-image comparison, change detection, and multi-step visual inference. These capabilities are critical for real-world multimodal applications where reasoning must be grounded in systematic differences between visual contexts. However, existing benchmarks rarely require both explicit visual comparison and analytical reasoning, leaving this capability underexplored. To address this gap, we introduce SD-MAR (Synthetic Data for Multi-image Analytical Reasoning), a framework for training and evaluating VLMs on multi-image analytical reasoning. SD-MAR constructs paired visual scenarios through controlled perturbations and generates reasoning tasks spanning semantic change attribution and quantitative comparison. We further train VLMs using GRPO-lite with Backward Discounted Allocation (BDA), a reinforcement learning approach that removes KL regularization to encourage stronger policy optimization while allocating greater credit to the later reasoning steps where analytical conclusions are formed. Experiments on Qwen2.5-VL-7B and InternVL3-8B show that GRPO-lite fine-tuning on SD-MAR improves in-domain accuracy by up to 36.95%, with Qwen2.5-VL-7B outperforming GPT-4.1 on the SD-MAR benchmark. Importantly, out-of-domain generalization is preserved or improved: performance remains within 1% on MME, MMMU-Pro, and MathVista, while improving by up to 4% on MMBench. LLM-as-judge evaluation further demonstrates consistent improvements in logical coherence and explanation quality across both models.
94. 【2607.14305】DCVC-MB: Neural B-Frame Video Compression using State Space Models
链接：https://arxiv.org/abs/2607.14305
作者：Arjun Arora,Calvin-Khang Ta,Carlos Restrepo-Galeano,Kruthi Murali,Naga Akhil E S,Arunkumar Mohananchettiar,Jay Shingala,Tong Shao,Peng Yin,Sean McCarthy
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：low-delay B-frame coding, B-frame coding, propose DCVC-Mamba, paper we propose, video codec framework
备注： Accepted to ICME 2026
点击查看摘要
Abstract:In this paper we propose DCVC-Mamba (DCVC-MB), a neural video codec framework for B-frame coding. Our approach incorporates an IBP frame strategy for low-delay B-frame coding, a spatio-temporal fusion model based on state-space models for bidirectional temporal prediction, and an entropy-aware skipping mechanism that selectively omits coding certain latents to reduce entropy coding times. In addition to our model contributions we also implement two inference-time strategies that enhance compression performance. Experimental evaluation shows that DCVC-MB compares favorably to existing NVCs and traditional codecs. The method demonstrates BD-rate reductions of up to $8.98\%$ on average compared to prior neural video codecs, and improvements of up to $30.45\%$ and $1.81\%$ over the VTM-19.0-LDP and VTM-19.0-RA(Inter-GoP=16) benchmarks, respectively, contributing to advances in neural video compression.
95. 【2607.14287】XCT-SAM: Sequential Parameter-Efficient Domain Adaptation of SAM for Industrial XCT Defect Segmentation
链接：https://arxiv.org/abs/2607.14287
作者：Md Mahedi Hasan,Md Mushfiqur Rahaman,Alan Pachkovskiy,Imtiaz Ahmed,Jeremy Dawson,Srinjoy Das
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：X-ray computed tomography, remains challenging due, severe class imbalance, XCT defect segmentation, X-ray computed
备注： 10 pages, 7 figures, 3 tables. Accepted to the IAPR Workshop on Machine Vision for Industrial Inspection (MVI2), in conjunction with ICPR 2026. Code: [this https URL](https://github.com/Mahedi-61/XCT-SAM)
点击查看摘要
Abstract:Defect segmentation in additive manufacturing (AM) X-ray computed tomography (XCT) images remains challenging due to severe class imbalance and large distribution shifts across scan conditions. Although recent foundation models such as the Segment Anything Model (SAM) provide strong general-purpose segmentation priors, their natural-image pre-training transfers poorly to the AM XCT domain, where defects appear as subtle non-semantic microstructural anomalies. Moreover, adapting SAM to the AM domain is further limited by the large domain gap and scarcity of labeled real XCT data. We present XCT-SAM, a sequential parameter-efficient adaptation framework for AM XCT defect segmentation. Instead of adapting SAM directly from natural images to XCT data, we first fine-tune Conv-LoRA adapters on an alloy-microstructure dataset and subsequently transfer the adapted model to XCT images, progressively bridging the domain gap. Using Conv-LoRA adapters with rank r=2, the framework injects convolutional spatial inductive bias into SAM's backbone while training approximately 4.15M parameters and keeping over 99% of the model frozen. We evaluate XCT-SAM on out-of-distribution CycleGAN-XCT benchmarks and real-world NIST XCT scans. Across both settings, XCT-SAM consistently outperforms zero-shot SAM and other domain-adapted SAM baselines, achieving the best overall IoU and Dice scores. These results demonstrate the effectiveness of intermediate domain adaptation with parameter-efficient adapters for industrial XCT defect segmentation. The source code is publicly available at this https URL
96. 【2607.14264】MonteRET: AI Agent Enhancing Multimodal LLMs with Multi-granularity Knowledge Retrieval for Chest CT Report Generation
链接：https://arxiv.org/abs/2607.14264
作者：Yi Lin,Yihao Ding,Elana Benishay,Elefterios Trikantzopoulos,David Nauheim,Hanley Ong,Jiang Bian,Hua Xu,Yuzhe Yang,George Shih,Yifan Peng
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：generation remains challenging, faithful reporting requires, clinically faithful reporting, Automated chest, report generation remains
备注：
点击查看摘要
Abstract:Automated chest CT report generation remains challenging because clinically faithful reporting requires both whole-volume understanding and accurate description of localized anatomical findings. Here we developed and retrospectively evaluated MonteRET, a region-aware retrieval-enhanced framework for generating chest CT findings sections. MonteRET integrates global CT features with region-level anatomical representations, retrieves clinically relevant knowledge using predicted medical conditions and region-level vision-language alignment, and refines initial reports through a knowledge-guided report rewriting agent. We trained our model on a public cohort with 24,128 CT scans from RadGenome-ChestCT. We evaluated MonteRET on the public RadGenome-ChestCT test set of 1,564 CT scans and an external cohort of 82 CT scans from NewYork-Presbyterian/Weill Cornell Medical Center. MonteRET improved report quality, semantic similarity, and clinical efficacy compared with a matched baseline and several state-of-the-art methods. Gains were most pronounced for recall, suggesting fewer omitted findings. Human expert evaluation by radiology residents also favored MonteRET.
97. 【2607.14248】3D Lane Detection with Odometry for High-Speed Vehicle Racing
链接：https://arxiv.org/abs/2607.14248
作者：Omoruyi Atekha,John Subosits,Marcus Greiff
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：regular driving scenarios, autonomous driving systems, Lane boundary detection, critical component, component in autonomous
备注： 14 pages, IROS paper, includes extended abstract
点击查看摘要
Abstract:Lane boundary detection is a critical component in autonomous driving systems and has been rigorously studied in regular driving scenarios. However, it is less explored in vehicle racing, where the car moves at higher speeds across more extreme road geometries. To study this problem, we introduce a new dataset for 3D lane detection in racing, featuring $250$k images from multiple camera feeds and inertial measurements taken with a Lexus LC 500 driving on a closed circuit. With this dataset, we compare various approaches to 3D lane detection and propose modifications that permit frames to be processed at rates of almost 300Hz while retaining high predictive performance in the racing application. This facilitates a multi-camera ensemble approach that is validated on hardware. We show that sensing modalities such as inertial measurements can be leveraged for pre-integration to regress road geometries over both cameras and time, yielding improvements in key metrics. Compared to methods such as BevLaneDet, adding odometry and ensemble predictions improves the F1 score by 3 points and reduces near-vehicle mean absolute errors (MAEs) by $30 \%$. We show F1 scores $$0.9 and lateral MAEs of $$0.18m in vehicle deployments.
98. 【2607.14228】SeeSE3: Emergence of 3D Space in Vision Features
链接：https://arxiv.org/abs/2607.14228
作者：Caroline Chen,Sayna Ebrahimi,Fedor Kitashov,Ming-Hsuan Yang,Leonidas Guibas,Viorica Pătrăucean,Maks Ovsjanikov
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：foundation models construct, models construct representations, vision foundation models, Euclidean space, construct representations
备注：
点击查看摘要
Abstract:In this paper, we ask whether vision foundation models construct representations that reflect the intrinsic properties of 3D Euclidean space. Unlike previous works that probe 3D awareness of vision features by regressing image-centric quantities such as depth or normals, we investigate the relation between the structure of the space of visual features and the group of Euclidean transformations $SE(3)$. We propose a set of probes to evaluate this relation from both topological and geometric perspectives: a mutual neighborhood metric that measures the alignment between feature neighborhoods and spatial topology, and a Poincaré Adapter to test the linear accessibility of the geometry of camera motion from latent displacements in static scenes. We show that self-supervised vision models, which, in principle, have not been trained with direct 3D supervision or active agency, possess latent subspaces that are remarkably strongly correlated with three-dimensional Euclidean space, when probed correctly. Building on this insight we propose a new class of "Latent-Space Navigation" techniques that perform visual odometry and localization purely in the latent space, bypassing the need for explicit 3D reconstruction.
99. 【2607.14203】Instant NuRec: Feed-Forward 3D Gaussian Reconstruction for Driving Scene Simulation
链接：https://arxiv.org/abs/2607.14203
作者：NVIDIA:Jiahui Huang,Jiawei Ren,Michal Tyszkiewicz,Bjoern Haefner,Michael Shelley,Xin Kang,Seung Wook Kim,Ning Xu,Qi Wu,Janick Martinez Esturo,Shengyu Huang,Nick Schneider,Laura Leal-Taixe,Zan Gojcic,Sanja Fidler
类目：Graphics (cs.GR); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：reducing development costs, policy evaluation, improving safety, platforms are critical, critical for autonomous
备注： Project Page: [this https URL](https://research.nvidia.com/labs/sil/projects/instant-nurec/)
点击查看摘要
Abstract:3D simulation platforms are critical for autonomous driving because they enable end-to-end policy evaluation, thereby reducing development costs and improving safety. In recent years, neural simulation has become predominant, with methods such as NuRec playing a central role; however, these methods remain relatively slow and typically require per-scene tuning. In this work, we present Instant NuRec, a feed-forward neural reconstruction model that turns a short multi-view driving log into a fully simulatable 3D Gaussian Splatting (3DGS) world in a single forward pass. The model accepts multi-view input from a calibrated camera rig and emits a layered output consisting of static and dynamic 3DGS layers, a sky cubemap, and per-camera ISP corrections, while providing native support for non-pinhole camera models via 3DGUT. It reconstructs a 10-20-second multi-camera scene in roughly 1.5 seconds and achieves a PSNR on the Waymo Open Dataset that is 2.01 dB above the strongest evaluated baseline. Instant NuRec is deeply integrated into NuRec and is compatible with AlpaSim for closed-loop simulation.
100. 【2607.14202】KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generation
链接：https://arxiv.org/abs/2607.14202
作者：Yuqi Tang,Tengfei Liu,Yizheng Lai,Yuran Wang,Yang Shi,Wanshun Su,Zhuoran Zhang,Qixun Wang,Xiaohan Zhang,Xinlei Yu,Xuehai Bai,Xuanyu Zhu,Bohan Zeng,Bozhou Li,Shujie Li,Yifan Dai,Yujie Wei,Shixuan Liu,Haotian Wang,Jialu Chen,Yuanxing Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generation increasingly relies, keyframe-based workflows, Video, increasingly relies, relies on keyframe-based
备注： 35 pages
点击查看摘要
Abstract:Video generation increasingly relies on keyframe-based workflows, where creators specify a sequence of reference images to guide generation. Although recent models support multi-keyframe conditioning, it remains unclear whether they can faithfully reproduce the prescribed keyframes while maintaining overall video quality. We present KeyFrame-Compass, the first comprehensive benchmark for evaluating keyframe-conditioned video generation. The benchmark contains 386 carefully curated samples spanning three application domains, two video structures, two prompt granularities, two conditioning formats, and four keyframe densities, enabling controlled analysis under diverse generation settings. We further introduce an automated evaluation framework that jointly measures keyframe execution and overall video quality. Specifically, we decompose keyframe execution into six complementary metrics covering presence, fidelity, temporal ordering, localization, persistence, and uniqueness, while assessing overall video quality through evidence-grounded MLLM judgments augmented with specialized perception models. Experiments on nine representative video generation systems reveal several fundamental limitations. Current models exhibit a clear trade-off between faithful keyframe execution and natural video synthesis. Their performance further degrades as keyframe constraints become denser and most open-source models also fail to interpret storyboard-grid inputs as temporally ordered keyframe sequences.
101. 【2607.14194】Inference-Time Concept Suppression and Video-Centric Evaluation for Text-to-Video Models
链接：https://arxiv.org/abs/2607.14194
作者：Wenxuan Chen,Wenjie Feng
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：generator remains difficult, Toggle, temporally coherent videos, Toggle Hugging Face, target concept
备注： 29 pages, 9 figures, 11 tables
点击查看摘要
Abstract:Text-to-video (T2V) generators can synthesize realistic and temporally coherent videos, but controllably removing a target concept from a generator remains difficult. Unlike text-to-image concept erasure, T2V unlearning must suppress a target concept that may persist across frames while preserving non-target subjects, actions, scenes, and temporal structure. We propose \textbf{SIRUS}, a training-free inference-time framework for concept-level T2V unlearning. Given textual aliases of a target concept, SIRUS localizes target-related prompt evidence and suppresses target expression during sampling, without updating the text encoder or denoising network. We further introduce a video-oriented evaluation framework for T2V unlearning that separately measures target forgetting, non-target preservation, video quality, jailbreak robustness, and efficiency, using video-level failure criteria, frame-level residue statistics, paired preservation analysis, VBench-based quality diagnostics, and deployment overhead measurement. Across five safety, object, and style concepts on CogVideoX, SIRUS reaches 70.4\% average forgetting success and 25.7\% average frame hit, compared with 44.4\% / 47.2\% for VideoEraser, while reducing the average VBench quality drop from -0.043 to -0.016, yielding the strongest forgetting-quality trade-off among fully evaluated baselines. Transfer experiments on Wan2.2 further suggest that SIRUS generalizes across modern T2V backbones.
Comments:
29 pages, 9 figures, 11 tables
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2607.14194 [cs.CV]
(or
arXiv:2607.14194v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.14194
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Wenxuan Chen [view email] [v1]
Wed, 15 Jul 2026 16:26:09 UTC (12,633 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Inference-Time Concept Suppression and Video-Centric Evaluation for Text-to-Video Models, by Wenxuan Chen and 1 other authorsView PDFHTML (experimental)TeX Source
view license
Current browse context:
cs.CV
prev
|
next
new
|
recent
| 2026-07
Change to browse by:
cs
cs.LG
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
102. 【2607.14189】MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generation
链接：https://arxiv.org/abs/2607.14189
作者：Xiaohan Zhang,Yuqing Wen,Junlin Chen,Yuqi Tang,Yiting He,Lizhuo Shao,Weiming Zhu,Tengfei Liu,Yang Shi,Jialu Chen,Yuanxing Zhang,Huaxiong Li
类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：audio-video content conditioned, generate coherent audio-video, aims to generate, coherent audio-video content, generation aims
备注： 32 pages
点击查看摘要
Abstract:Multi-reference-to-audio-video (MR2AV) generation aims to generate coherent audio-video content conditioned on multiple references and textual instructions. Existing benchmarks mainly focus on text-driven generation, single-reference subject preservation, or isolated audio-video alignment, leaving the emerging MR2AV setting largely unexplored. Compared with these settings, MR2AV requires models to jointly reason over multiple references while generating synchronized visual and audio content. Models must not only preserve each reference faithfully but also correctly bind and compose multiple referenced entities into coherent audio-visual events. To address this gap, we introduce MultiRef-Compass, a unified benchmark for MR2AV generation. It comprises $350$ carefully curated samples constructed through a scalable and controllable asset-composition pipeline, covering multi-view subject preservation, multi-entity binding, and human-object-scene composition. To provide interpretable assessment, MultiRef-Compass defines an evaluation protocol with four dimensions: Basic Quality, Reference Consistency, Audio-Visual Consistency, and Instruction Following, using 14 sub-metrics. MultiRef-Compass integrates automatic metrics with a rejudging-enhanced MLLM-as-a-Judge framework, enabling scalable and auditable evaluation of both perceptual fidelity and reference-conditioned composition. Extensive experiments on eight representative MR2AV systems reveal substantial room for improvement across multiple evaluation dimensions, underscoring the need for a comprehensive benchmark and positioning MultiRef-Compass as a foundation for future MR2AV research.
103. 【2607.14183】Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning
链接：https://arxiv.org/abs/2607.14183
作者：Zishuo Li,Bowen Yang,Changtao Miao,Kai Zhu,Hao Chen,Qingze Guan,Zhengxing Wu,Wanke Zhan,Yang Sun,Zhiyi Huang,Zitong Shan,Zhenchao Jin,Jiadong Hong,Taowen Wang,Yushi Feng,You Liu,Yibo Wang,Yifan Yang,Zhaowen Zhou,Man Luo,Hao Cheng,Bo Zhang,Jianshu Li,Jiansheng Cai,Guocai Yao,Jize Zhang,Chenhao Lin,Renjing Xu,Lequan Yu,Chao Shen,Chunhua Shen,Zhe Li
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：existing resources rarely, resources rarely combine, rarely combine low-cost, combine low-cost continuous, low-cost continuous capture
备注：
点击查看摘要
Abstract:Egocentric videos of human manipulation provide scalable supervision for embodied intelligence, yet existing resources rarely combine low-cost continuous capture, manipulation-level structured annotations, and reusable tools for robot learning. We present Open-AoE, an open, community-oriented egocentric manipulation dataset and toolchain spanning the full pipeline from smartphone capture to model training. Its first release contains approximately 2,000 hours of manipulation video collected in natural environments by 500+ contributors using 400+ smartphones. The dataset provides text annotations, MANO-based hand poses, camera trajectories, and temporally localized atomic actions. Open-AoE further includes a data processing pipeline that transforms raw recordings into structured samples through temporal action segmentation, semantic annotation, hand reconstruction, and camera trajectory reconstruction. Meanwhile, we provide a separate downstream toolchain supports visualization, cross-embodiment retargeting, model-specific data conversion, and training recipes for VLA policies, WAMs, and World Models. By integrating scalable capture, structured processing, and downstream adaptation, Open-AoE reduces the barriers to both data contribution and reuse, providing practical open infrastructure for embodied model training, human-to-robot transfer, and world modeling.
104. 【2607.14160】QFireNet: A Quantum-Enhanced U-Net for Wildfire Segmentation from Sentinel-2 Imagery
链接：https://arxiv.org/abs/2607.14160
作者：Jaiman Munshi,Tanvi Tewary,Sawyer Bloom,Aidan Chu,Chetan Maviti,Kyon Winston-Bey,Harshit Badjatia,Farhan Kittur,Vardhan Madhavarapu,Varun Kota,Joshua Kwon,Nazia Rangwala-Vohra,Franz Klein(IonQ Team, App Dev Club, University of Maryland, College Park)
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：semantic image segmentation, image segmentation, U-Net image segmentation, Feature Pyramid Network, image segmentation model
备注： 19 pages, 8 figures
点击查看摘要
Abstract:Wildfire detection from satellite imagery is a semantic image segmentation problem that has proven to be difficult due to challenges such as class imbalance, feature complexity, and atmospheric interference. In this paper, we build on the foundational U-Net image segmentation model to develop a quantum-hybrid solution in hopes of more effectively modeling the high-dimensional spectral feature space of the Sen2Fire dataset. We inject a variational quantum circuit in the bottleneck portion of U-Net, specifically the QuFeX and QB-Net ansatzes. We test a classical Feature Pyramid Network (FPN) for further comparative analysis of the model, and we also explore classical improvements to the U-Net model and its training process, including a compression of parameters, alternative loss functions, and uniform mixing of input data. Our primary finding is that under matched conditions, both QB-Net (with an $F_1$ score of 31.18) and QuFeX ($F_1 = 30.79$) outperformed the classical U-Net baseline results ($F_1 = 28.71$). Additionally, the classical FPN achieved a comparable score of 31.13. A crucial finding was that data mixing removed a significant domain shift between the geographically-separated train and test sets, which boosted the classical FPN $F_1$ score to 39.76. We validate the architecture's robustness and generalizability to the wildfire detection problem via cross-dataset transfer on the California Burned Areas (CaBuAr) dataset. Overall, we find that quantum machine learning has potential to provide an advantage in the problem of wildfire image segmentation, and further experiments will continue to validate and expand upon this finding.
105. 【2607.14145】oolAnchor: Anchoring Counterfactual Context to Boost Agentic Tool-use Capability
链接：https://arxiv.org/abs/2607.14145
作者：Weiting Liu,Jieyi Bi,Wanqi Zhou,Jianfeng Feng,Yining Ma,Ai Han,Wenlian Lu
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Tool-augmented large language, Tool-augmented large, large language model, large language, excel at long-horizon
备注：
点击查看摘要
Abstract:Tool-augmented large language model agents excel at long-horizon tasks, yet they are typically post-trained on fixed toolsets. When tasks demand new tools, these agents struggle to incorporate them effectively, and retraining from scratch is often impractical. We identify the core obstacle in such toolset expansion problem as behavioral inertia: the tendency of agents to fall back on familiar tools and established reasoning patterns despite having access to new ones. We demonstrate that injecting counterfactual anchor contexts at critical decision points can break this inertia, recovering failed trajectories by eliciting suppressed agent capabilities. To scale this insight, we propose ToolAnchor, a framework that uses teacher models to hypothesize these counterfactual contexts, verifies them via student rollouts, and internalizes the successful interventions through agentic post-training. Extensive evaluations across general AI assistant (GAIA), textual search (BrowseComp), and visual search (VDR-Bench) tasks demonstrate that ToolAnchor consistently exhibits competitive performance under expanded toolsets. Our work bridges the gap between static post-training and dynamic adaptation, charting a new path for scalable agentic reinforcement learning.
106. 【2607.14125】CARPRT: Class-Aware Zero-Shot Prompt Reweighting for Black-Box Vision-Language Models
链接：https://arxiv.org/abs/2607.14125
作者：Ruijiang Dong,Zesheng Ye,Jianzhong Qi,Lei Feng,Feng Liu,Gang Niu,Masashi Sugiyama
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Pre-trained vision-language models, Pre-trained vision-language, vision-language models, textual descriptions, typically formed
备注： Accepted at ICLR 2026
点击查看摘要
Abstract:Pre-trained vision-language models (VLMs) enable zero-shot image classification by computing the similarity score between an image and textual descriptions, typically formed by inserting a class label (e.g., "cat") into a prompt (e.g., "a photo of a"). Since the score for a given image-class pair is sensitive to the choice of prompt, existing studies ensemble multiple prompts using a weighting vector to aggregate scores across different prompts. Yet, in current strategies, the weighting vector assigned to each prompt is shared across all classes, implicitly assuming that prompts are conditionally independent of classes, which often does not hold in practice, as a prompt like "an aerial view of" might be apt for "airport" but ill-suited for "apple". To address this, we propose class-aware zero-shot prompt reweighting (CARPRT). This scoring scheme adjusts the weighting vector for each class label by capturing the class-specific relevance of different prompts in a training-free manner. For each class label and every available prompt, we quantify their class-specific relevance by averaging image-text relevance scores over images predicted to that class under the given prompt. These estimates are then normalized to derive class-specific weights. Evaluations on standard image classification benchmarks show that CARPRT outperforms existing class-independent reweighting methods, confirming that modeling prompt-class dependencies is crucial for effective zero-shot prediction and even broader VLM-based application settings that rely on prompt ensembling. Our code is available at this https URL.
107. 【2607.14116】ReportMedSAM: Guiding Segmentation Through Radiology Reports
链接：https://arxiv.org/abs/2607.14116
作者：Anghong Du,Theodoros N. Arvanitis,Colin Watts,Alejandro F. Frangi,Le Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, rich clinical descriptions, reliable segmentation remains, segmentation remains challenging, natural language
备注：
点击查看摘要
Abstract:Free-form radiology reports contain rich clinical descriptions, yet converting them for reliable segmentation remains challenging due to the inherent variability of natural language. Existing pipelines often rely on predefined organ phrases or brittle rule-based inference-time extraction, which limits their scalability to novel anatomical structures and makes them sensitive to linguistic variations. To address this, we propose ReportMedSAM, a report-driven framework that replaces discrete extraction with a learnable concept bank. By leveraging a frozen medical vision-language encoder (BiomedCLIP), we align organ-level concept embeddings with large-scale clinical corpora through contrastive learning, establishing mutually orthogonal semantic anchors. Our approach explicitly mitigates organ-level semantic collapse and ensures high robustness against diverse clinical synonyms (e.g., "renal" vs. "kidney" ). During inference, a clinical report is embedded and matched against this concept bank to dynamically activate task-specific Mixture-of-Experts (MoE) modules. This decoupled design allows new concepts and experts to be added without retraining existing components, providing a parameter-isolated extension mechanism while keeping previously learned experts unchanged. Evaluated on the AbdomenAtlas 3.0 dataset, ReportMedSAM effectively interprets free-form reports, achieves competitive segmentation accuracy, and demonstrates seamless, non-interfering extension to novel clinical tasks.
108. 【2607.14115】DialogueVPR: Towards Conversational Visual Place Recognition
链接：https://arxiv.org/abs/2607.14115
作者：Yukun Song,Changwei Wang,Xingtian Pei,Shibiao Xu,Wenhao Xu,Shunpeng Chen,Yu Zhang,Ke Zhang,Rongtao Xu,Xuxiang Feng,Pengyang Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：communicate spatial information, humans communicate spatial, gained significant traction, spatial information, language-guided geo-localization
备注： Accepted to CVPR 2026
点击查看摘要
Abstract:Inspired by how humans communicate spatial information, language-guided geo-localization has gained significant traction for its intuitive and practical value. Despite this progress, most methods still rely on a static, one-shot retrieval paradigm, which fails to handle the ambiguity and incompleteness inherent in real-world natural language descriptions. We propose a paradigm shift to reasoning retrieval and introduce Dialogue Place Recognition (DlgPR), which casts localization as an interactive, dialogue-driven reasoning process. To support this new task, we present DlgQuest-Cities, the first large-scale dialogue-based benchmark for place recognition, and a unified reasoning framework that couples a cross-modal multi-level retriever with an intelligent questioner, DQ-pilot. DQ-pilot is trained in a curriculum: supervised fine-tuning on a curated DQ-cities-20k subset followed by reinforcement refinement on a harder DQ-cities-10k split via GRPO. Two task-aligned metrics guide learning: a Discriminative Difficulty Index (DDI) for curriculum sampling and a Positional Retrieval Gain (PRG) reward that directly measures retrieval improvement induced by a question. Experiments show this reasoning-based approach significantly outperforms baselines. The code and model are available at this https URL.
109. 【2607.14099】Just Keep Prompting: Evaluating Repetitive Socratic Prompting in VLMs
链接：https://arxiv.org/abs/2607.14099
作者：Shayda Moezzi,Bishoy Galoaa,Lorena Genua,Taskin Padir,Sarah Ostadabbas
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Deploying Vision-Language Models, real-world settings requires, Deploying Vision-Language, Pure Socratic Interrogation, sustained conversational pressure
备注：
点击查看摘要
Abstract:Deploying Vision-Language Models (VLMs) in real-world settings requires not only strong visual reasoning but also stability under sustained conversational pressure. We introduce Just Keep Prompting (JKP), a multi-turn evaluation framework that measures VLM epistemic stability when users repeatedly challenge, question, or contradict a model's answer. JKP probes models for up to 10 follow-up turns using three strategies: Adversarial Negation (repeated rejection), Pure Socratic Interrogation (repeated calls to reassess certainty), and Context-Aware Socratic Summarization (reflecting the model's prior rationale back before asking for reconsideration). We evaluate GPT-4o, Gemini 2.5 Pro, and Qwen3-VL-30B on a subset of the STAR benchmark across 720 multi-turn runs. Aggregate accuracy changes modestly from Turn 0 to Turn 10, but trajectory-level analysis reveals substantial instability: correct answers regress, wrong answers recover, and many runs exhibit repeated answer flipping. Repeated prompting has bounded upside and often acts as a destabilizer rather than a reasoning aid. The effect is strongly model-dependent: Qwen3-VL-30B achieves the highest final accuracy but becomes confidently wrong under direct contradiction; Gemini 2.5 Pro is comparatively stable but token-expensive; GPT-4o is the most brittle and oscillatory. These findings reveal that multi-turn VLM evaluation captures not just additional reasoning but pressure-response profiles: how models trade off visual grounding, calibration, and conversational compliance under repeated challenge.
110. 【2607.12569】raceback Translators Against Forgetting in Continual Fake Speech Detection
链接：https://arxiv.org/abs/2607.12569
作者：Enrico Gottardis,Mattia Tamiazzo,Simone Milani
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Multimedia (cs.MM); Sound (cs.SD)
关键词：Fake speech detectors, accurate generative models, Fake speech, increasingly challenged, accurate generative
备注： Accepted at EUSIPCO 2026
点击查看摘要
Abstract:Fake speech detectors are increasingly challenged by the development of new and more accurate generative models. To cope with this problem, continual learning techniques are nowadays widely considered feasible strategies for updating models to new datasets, but they also lead to decreased performance on previously seen samples (catastrophic forgetting). In this work, we propose a forgetting-resilient solution based on the adoption of domain translators within a frozen detector, which remaps the new feature spaces into the original ones by means of a traceback translator network. Experimental results show that this strategy enables the achievement of high detection rates with respect to traditional retraining, while minimizing the computational effort and preserving the detection accuracy on previous data.
111. 【2607.15073】ESAR: Event-Based Synthetic Aperture Reconstruction
链接：https://arxiv.org/abs/2607.15073
作者：Harbir Antil,Daniel Blauvelt,David Sayre
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：cameras report asynchronous, report asynchronous polarity, fixed contrast threshold, conventional image frames, Event cameras report
备注：
点击查看摘要
Abstract:Event cameras report asynchronous polarity events when changes in log--radiance exceed a fixed contrast threshold, producing signed temporal contrast measurements rather than conventional image frames. We formulate monocular event-based imaging as a synthetic-aperture inverse problem for a static ground-domain log--radiance field $\theta \in \mathbb{R}^{N_g}$. Instead of reconstructing a latent pixel-time volume $v \in \mathbb{R}^{N_pN_t}$, we impose the geometric relation $v=P\theta$, where $P$ maps the fixed scene into motion-dependent latent views. Aggregating events over finite time intervals gives the linearized model \[ AP\theta = b+\eta, \] where $A$ is a temporal differencing operator, $b$ contains signed binned event counts, and $\eta$ represents measurement and modeling errors. This decomposition exposes a synthetic-aperture structure: under near-nadir motion, successive projections are approximately shifted views of a common scene, while the composite operator $AP$ remains ill-conditioned because it combines spatial averaging with temporal differencing. We therefore use regularized inversion to recover $\theta$. Numerical experiments on simulated data and real near-nadir Falcon Neuro event data show that the proposed $\theta$-based formulation recovers coherent large-scale spatial structure, relative to dynamic latent-image and learned event-reconstruction baselines, while suppressing fine-scale texture.
Subjects:
Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
Cite as:
arXiv:2607.15073 [eess.IV]
(or
arXiv:2607.15073v1 [eess.IV] for this version)
https://doi.org/10.48550/arXiv.2607.15073
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
112. 【2607.14749】WanSong v1.0 Technical Report
链接：https://arxiv.org/abs/2607.14749
作者：Binghui Chen,Pandeng Li,Yu Liu,Jingren Zhou
类目：Audio and Speech Processing (eess.AS); Computer Vision and Pattern Recognition (cs.CV)
关键词：significant industry attention, recently attracted significant, attracted significant industry, Music generation foundation, industry attention
备注： Wan Team
点击查看摘要
Abstract:Music generation foundation models have recently attracted significant industry attention. However, achieving efficient generation and high-fidelity long-form audio while supporting controllability remains challenging. To address these needs, we present \textbf{WanSong}, a simple yet powerful approach for long-form, commercial-grade song generation. Unlike autoregressive (AR) and cascaded multi-stage pipelines (\eg, AR followed by diffusion), \textbf{WanSong} is a pure diffusion-based model that directly generates high-fidelity, multilingual songs up to 5 minutes and outputs dual stems (vocals and background music) in a single run. In addition, our diffusion framework enables faster inference through step-distillation, and offers an efficient pathway for fine-tuning and customization to support downstream editing tasks.
113. 【2607.14328】ViPSAM: Visual Prompting Medical Image Segmentation Using Segment Anything Model
链接：https://arxiv.org/abs/2607.14328
作者：San Lee,Nalee Kim,Jeong Il Yu,Hee Chul Park,Boah Kim
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：delineation remains challenging, remains challenging due, due to low, accurate delineation remains, delineation remains
备注： Accepted at MICCAI 2026
点击查看摘要
Abstract:In proton therapy planning, respiratory-gated non-contrast CT (NCCT) is commonly used for lesion segmentation; however, accurate delineation remains challenging due to low lesion-to-background contrast. Although learning-based methods have shown strong performance, they often struggle with non-contrast image segmentation. Inspired by clinical practice, where contrast-enhanced MRI is referenced to delineate lesions on NCCT, we propose ViPSAM, a visual prompting framework that leverages complementary cross-modality information. Built upon the Segment Anything Model (SAM), ViPSAM introduces a visual prompt encoder to extract guidance features from contrast-enhanced images and a visual-guided cross-attention module to integrate non-contrast and contrast-enhanced features, thereby enhancing lesion-relevant representations in low-contrast regions. The mask decoder is further adapted in a parameter-efficient manner to utilize visual prompts effectively. We evaluate the proposed method on liver lesion segmentation using NCCT acquired for proton therapy. Experimental results demonstrate that ViPSAM outperforms representative U-Net- and SAM-based methods, indicating that cross-modality visual prompting enables more robust and accurate segmentation in non-contrast images.
114. 【2607.14179】OvAi Focus: AI-based Multi-class Segmentation of Functional Ovaries and Adnexal Masses in Gynecological Ultrasound
链接：https://arxiv.org/abs/2607.14179
作者：Niccolò Tallone,Francesca Salis,Pio Raffaele Fina,Roberta Massobrio,Rosilari Bellacosa Marotti,Daniele Conti,Luca Fuso,Luca Mariani,Annamaria Ferrero,Alessandro Arena,Stefano Cosma,Dan Grisaru,Angelo Lacalandra,Renato Seracchioli,Marianna Roccio,Federica Gerace
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：deadliest gynecological malignancy, remains challenging due, Ovarian cancer, gynecological malignancy, accurate and objective
备注： Accepted for presentation at Ital-IA 2026 (6th CINI National Conference on Artificial Intelligence) in Rome, Italy. To be published in the CEUR-WS proceedings
点击查看摘要
Abstract:Ovarian cancer is the deadliest gynecological malignancy; accurate and objective segmentation of adnexal masses and functional ovaries in ultrasound (US) remains challenging due to operator variability and morphological complexity. We present OvAi Focus (SynDiag s.r.l., Italy), a stand-alone AI software medical device that performs multi-class semantic segmentation of functional ovaries and adnexal masses, distinguishing cystic from solid components. The system was trained and independently validated on a multicenter dataset of 1,081 adult women from 6 centers across Italy and Israel. Segmentation achieved DICE scores of 0.87 (complete lesion), 0.85 (cystic), 0.68 (solid), and 0.62 (functional ovary), in line with or superior to state-of-the-art approaches across heterogeneous acquisition settings.
115. 【2607.14163】A vision foundation model for single-cell biology via spatial gene cartography
链接：https://arxiv.org/abs/2607.14163
作者：Ridvan Yesiloglu,Sakib Mostafa,James Zou,Ash Alizadeh,Jiajun Wu,Lei Xing,Ehsan Adeli,Md Tauhidul Islam
类目：Quantitative Methods (q-bio.QM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：adapted from language, foundation models, vision foundation model, language models, vision
备注： 54 pages, 34 figures, 10 tables, including supplementary information. Project page: [this https URL](https://islamlab.org/scvision)
点击查看摘要
Abstract:Most single-cell foundation models are adapted from language models, representing each cell as a sequence of gene tokens. This discards the relationships among genes and often the magnitude of their expression. We present scVision, a vision foundation model that instead renders each cell as a continuous image. Using optimal transport, it places genes at fixed positions on a single shared, pan-tissue layout so that co-expressed genes become spatial neighbours, turning a transcriptome into an image in which gene programs appear as local texture. We pretrain a vision transformer by masked image modelling on 72 million human cells and use the frozen encoder with no fine-tuning. In zero-shot evaluations on six independent, held-out studies, scVision is the most accurate cell-type annotator and recovers gene programs without supervision, ahead of existing foundation models and classical baselines; on multi-study integration it matches the strongest token-based model while conserving the most biological structure, without ever seeing a batch label. Permuting the gene layout with the network fixed sharply lowers accuracy, more than removing the vision transformer itself, showing that biologically meaningful position, not the network, carries the signal. By preserving expression magnitude and gene relationships, scVision reframes single-cell representation learning as a vision problem, connecting it to the mature methods of computer vision.
