本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新531篇论文，其中：
- 自然语言处理87篇
- 信息检索16篇
- 计算机视觉103篇
自然语言处理
1. 【2608.21325】Move by Move: Measuring and Steering How LLMs Conduct Psychotherapy
链接：https://arxiv.org/abs/2608.21325
作者：Afonso Baldo,Hugo Pitorro,Areti Vassilopoulos,Anabela C. Areias,Maya D'Eon,Fabíola Costa,Ricardo Rei,Nuno M. Guerreiro
类目：Computation and Language (cs.CL)
关键词：Users increasingly turn, Users increasingly, large language models, emotional support, psychotherapy interaction
备注：
点击查看摘要
Abstract:Users increasingly turn to large language models for emotional support, yet little is known about how these models actually conduct a psychotherapy interaction. We introduce an ontology of ten therapeutic moves: compact, function-based categories grounded in the MULTI-60 inventory, validated through an annotation campaign with five licensed psychologists, and scaled with a judge-based approach that matches expert agreement. Applying it to real counseling transcripts and model-led sessions, we compare the move distributions between human clinicians and a panel of frontier models. Models over-use inquiry at up to three times the human rate, neglect psychoeducation, and are strongly context-anchored: they carry forward strategies initiated by a human clinician but rarely initiate them themselves. Exposing the ontology as a set of tools roughly halves the mean deviation from the human move distribution and improves turn-level alignment with human therapist by 7-9 percentage points, without any fine-tuning.
2. 【2608.21315】Prompt-Model Interaction Reaches the Fixed Points: A deterministic, task-free structural readout -- and the factorizations of it that failed
链接：https://arxiv.org/abs/2608.21315
作者：Nicolás Vera Zúñiga
类目：Computation and Language (cs.CL)
关键词：prompts optimised, neutral reformatting, prompt effect, prompt, prompt is established
备注： 11 pages, 4 tables. Companion to [arXiv:2608.10986](https://arxiv.org/abs/2608.10986) . Code, per-run results, and the findings ledger: [this https URL](https://github.com/nicoveraz/token-lattice-ca) (archived: [this https URL](https://doi.org/10.5281/zenodo.21880472) )
点击查看摘要
Abstract:That a prompt's effect is not a property of the prompt is established: prompts optimised for one model degrade on another, and rankings reorder under neutral reformatting. That evidence is about task accuracy, which cannot say whether the interaction is a fact about task machinery or about the conditional distribution itself. We ask on a readout with no task in it: the fixed-point structure of the short-window argmax map x_{t+1} = argmax_x p(x | x_{t-1}, x_t), censused from 96 starts. It is deterministic, so nothing can be helped or hurt, and it exists only at short windows -- four of six models lose it entirely by window 16 -- so everything here concerns how a model reads a fragment. Two results. First, the interaction reaches this readout at full magnitude: nine tokens of conditioning move the fixed-point fraction across most of its range, change a four-way structural class, and reorder models, while instruction tuning worth 60.5 IFEval points moves the class by zero. Second, nothing we proposed carries it. Prefix length fails: the effect is not monotone. Four phenomenological factors -- prose-versus-markup, a universal direction, bidirectionality, instruct-resistance -- were each withdrawn within one run of being proposed, dissolved by widening the sample. And the nearest mechanistic account, attention-sink dominance of early tokens, predicts the sign of the shift on 2 of 5 models -- chance -- while a length-by-content cross shows it holds on real text and fails on our probe's uniformly random input, so we are outside its regime, not against it. One fixed nine-token prefix drives four models toward 0 and two toward 1; the bidirectionality survives in-distribution starts. On this readout the unit of explanation is the prompt-model pair. The recurring error it caught in us has a name: a criterion with a shape applied to a quantity with no room to vary.
3. 【2608.21265】Memory Augmentation Unlocks Efficient Chain-of-Thought Reasoning
链接：https://arxiv.org/abs/2608.21265
作者：Simeng Zhang,Yilong Chen,Wenyuan Zhang,Zhenyu Zhang,Yao Chen,Junyuan Shang,Tingwen Liu
类目：Computation and Language (cs.CL)
关键词：Large language models, substantial inference overhead, introduce substantial inference, Large language, traces introduce substantial
备注：
点击查看摘要
Abstract:Large language models often rely on Chain-of-Thought (CoT) reasoning to solve complex tasks, but verbose reasoning traces introduce substantial inference overhead. CoT compression shortens generation, yet aggressive compression may disrupt logical coherence and degrade performance. We formalize this trade-off as the \textit{Context-Generation Substitution Law}, where explicit reasoning context substitutes for part of decode-time generation. Based on this principle, we propose \textit{Memory-Augmented Compression}, a training-free framework that constructs reusable reasoning memories from historical traces and retrieves them as prefill-side scaffolds. Rather than using raw demonstrations, these memories summarize reusable reasoning patterns, key constraints, and critical operations to compensate for information lost during compression. Experiments show that Memory consistently improves prompt-based Chain-of-Draft (CoD) compression across mathematical reasoning, complex reasoning, and science question answering tasks, yielding accuracy gains of 21.4, 28.0, 29.5, and 6.61 points over CoD on GSM8K, MATH, BBH, and MMLU-Sci, while achieving a 1.14--1.49$\times$ latency speedup over standard CoT. Memory is also compatible with token-level, reasoning-trace-level, and inference-state compression mechanisms. Further analyzes show that the gains come from relevant reasoning memories rather than simply increasing context length.
4. 【2608.21252】EnSI-RAG: Entity-Structure-Indexed Retrieval-Augmented Generation for Long-Document Question Answering
链接：https://arxiv.org/abs/2608.21252
作者：Xuanyu Meng,Jiashuo Sun,Jash Rajesh Parekh,Jiawei Han
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：connected documents remains, documents remains challenging, span multiple entities, remains challenging, challenging because relevant
备注： 21 pages, preprint
点击查看摘要
Abstract:Question answering (QA) over long, connected documents remains challenging because relevant evidence may span multiple entities and their relationships. Existing retrieval-augmented generation (RAG) methods typically index documents as raw chunks and retrieve them through embedding similarity. Their performance degrades when chunk boundaries separate entities from supporting evidence or when a question requires multi-hop reasoning across the corpus. We propose EnSI-RAG (Entity-Structure-Indexed Retrieval-Augmented Generation), a framework that constructs a query-independent, entity-centered index. Each record (e, t, k, v) represents an entity e, its type t, a semantic category k in {property, relation, aspect}, and a value v, while retaining links to the original source passages. At query time, these records serve as retrieval handles, and an LLM synthesizes the retrieved passages into the final answer. This design separates evidence localization from answer synthesis while preserving traceable source evidence. Across Loong and Oolong, EnSI-RAG achieves an average accuracy of 78.24. Relative to the published baseline scores used as references, this is 6.62 points higher, suggesting its effectiveness across these settings. The code is available at this https URL.
5. 【2608.21249】Benchmarking Patent Drafting from Inventor-Style Disclosures
链接：https://arxiv.org/abs/2608.21249
作者：Lekang Jiang,Wenjun Sun,Stephan Goetz
类目：Computation and Language (cs.CL)
关键词：early-stage invention materials, recent large language, achieved promising results, invention materials, achieved promising
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:While recent large language models (LLMs) have achieved promising results on individual patent drafting tasks, they fundamentally fail to investigate the core challenge of real-world patent drafting: generating a complete and legally coherent patent application directly from early-stage invention materials. Prior work predominantly assumes later-stage, highly structured, or already legalistic inputs. However, real patenting workflows begin with informal, de-legalized disclosures authored by inventors. To bridge the gap, we introduce Dis2Pat, a disclosure-to-patent dataset that reflects realistic patenting workflows by requiring the generation of complete patent applications directly from inventor-style, de-legalized disclosures. Given the inherent difficulty of long-form, legally constrained patent drafting and the strong privacy requirements, we further propose a strong baseline named Patent-MAF. It is a multi-agent framework for locally deployable patent drafting. Benchmark results reveal that current LLMs exhibit limitations in patent drafting, while Patent-MAF provides a strong baseline that consistently outperforms evaluated open-source models and remains competitive with large closed-source models.
6. 【2608.21242】Affective Context Amplifies Sycophancy in LLM Responses
链接：https://arxiv.org/abs/2608.21242
作者：Jiayi Li,Sanjana Menon,Brett Frischmann,Shomir Wilson,Sarah Rajtmajer
类目：Computation and Language (cs.CL)
关键词：large language models, users' emotional states, conversational companions, large language, access to users'
备注：
点击查看摘要
Abstract:As conversational companions, large language models (LLMs) often have access to users' emotional states. We study how this affective context modulates LLM sycophancy in subjective, evaluative interactions, where users share actions or opinions that invite feedback. Drawing on ingratiation theory, we measure sycophancy as the divergence between a model's independent evaluation and its user-facing response, elicited by presenting the same content as either a third-party account or the user's own disclosure. Across seven LLMs and two Reddit datasets (r/AmItheAsshole and r/TrueUnpopularOpinion), we find that this divergence is systematic and strongly one-directional. User-facing responses consistently soften or withhold negative or oppositional judgments. Affective context further amplifies this divergence with negative states, particularly loneliness and distress, producing the largest effects. These findings suggest that affective context functions as a vulnerability signal that suppresses critical feedback when users may need it most, often through evasive sycophancy, in which models retreat toward non-committal responses rather than outright agreement.
7. 【2608.21236】RARE: Decoupling Representation Steering from Expert Routing in Mixture-of-Experts Language Models
链接：https://arxiv.org/abs/2608.21236
作者：Zhibo Zhang,Zhen Ouyang,Ling Shi,Kailong Wang
类目：Computation and Language (cs.CL)
关键词：intermediate hidden states, controlling language-model behavior, modifying intermediate hidden, Representation engineering offers, hidden states
备注： 20 pages, 3 figures. Paper accepted to the Actionable Interpretability Workshop at COLM 2026
点击查看摘要
Abstract:Representation engineering offers a lightweight means of controlling language-model behavior by modifying intermediate hidden states, but its direct application to Mixture-of-Experts (MoE) models introduces a structural mismatch. We first verify this failure mode through a series of empirical studies and find that preserving clean routing substantially recovers steering performance and that routing is more sensitive to semantic content than to behavioral changes under controlled content. Motivated by these findings, we introduce RARE, a router-agnostic representation engineering framework for MoE language models. RARE projects arbitrary behavioral perturbations onto the null space of the router matrix, thereby removing router-visible components, and further corrects routing drift propagated to selected downstream layers. To decide the best perturbation estimator in this framework, we evaluate five estimators on six heterogeneous open-weight MoE models across three steering scenarios: harmfulness, truthfulness, and factual editing. On harmfulness steering, RARE reaches an average attack success rate of 53.3% while retaining 67.8% MMLU accuracy, yielding a stronger aggregate effectiveness--utility trade-off than baselines. It further improves average TruthfulQA MC1 accuracy from 41.0% to 58.6% and CounterFact efficacy from 16.8% to 96.3%. These results support routing consistency as an important architectural consideration for adapting representation engineering to MoE models.
8. 【2608.21218】Enhancing LLMs in Predictive Political QA with Semi-Structured Data
链接：https://arxiv.org/abs/2608.21218
作者：Yinan Liu,Zihan Zhou,Zichun Jin,Xinyu Wang,Bin Wang,Xiaochun Yang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：political question answering, question answering, factual lookup, Predictive political question, political
备注：
点击查看摘要
Abstract:Predictive political question answering (QA), such as predicting how a political actor will vote, goes beyond factual lookup. External political resources offer rich historical evidence, but rarely contain the answer itself. Existing LLM augmentation methods, including actor-profile-based simulation and knowledge graph evidence injection, improve political reasoning but largely treat external resources as knowledge-based evidence, leaving prediction-relevant signals under-modeled. We identify two complementary signals for predictive political QA: actor stances that capture issue-specific preferences, and high-order structure signals that capture indirect dependencies among political actors. We propose PSL, a dual-view framework that converts semi-structured political records into inference-oriented evidence for LLMs. PSL extracts stance signals from question-relevant actor records in a semantic view, and learns structure-aware actor representations from an actor interaction graph in a vector view. Across three real-world datasets and multiple LLMs, PSL consistently outperforms baselines, with ablations confirming the complementary gains of stance and structure signals.
9. 【2608.21209】Personalized Privacy Control in LLMs via Attention Head Intervention
链接：https://arxiv.org/abs/2608.21209
作者：Junseok Kim,Nakyeong Yang,Kyomin Jung
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：diverse user data, access diverse user, raising critical privacy, critical privacy concerns, raising critical
备注： EMNLP 2026
点击查看摘要
Abstract:The rise of agentic AI enables LLMs to access diverse user data, raising critical privacy concerns. Prior work on contextual privacy studies whether LLMs regulate information disclosure according to context-dependent norms. However, acceptable disclosure boundaries may vary across users even within the same context. To address this limitation, we introduce \textit{personalized privacy}, which incorporates user-specific disclosure preferences into privacy control. We further present P3Bench~(\textbf{P}ersonalized \textbf{P}rivacy \textbf{P}reservation \textbf{Bench}mark), a novel benchmark extending contextual privacy policies with personalized disclosure policies. Experiments show that prompt-based policies fail to reliably enforce personalized privacy policies, with Qwen2.5-7B and Gemma3-4B showing average policy ignorance ratios of 51.25\% and 74.28\%, respectively. Finally, to address this problem, we propose \textsc{Repair}, a robust inference-time attention head intervention method that adjusts disclosure behavior toward policy-consistent responses. Our method significantly improves adherence to user-specific privacy preferences by reducing cases where the model fails to follow the given policy.
10. 【2608.21206】No PUN Intended: Plausible Unknown Names for Person-Centred LLM Evaluation
链接：https://arxiv.org/abs/2608.21206
作者：Dimitri Staufer,David Hartmann,Ibrahim Baroud
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：privacy leakage, bias and abstention, web-enabled LLM screening, evaluations of factuality, status is uncontrolled
备注： Under review
点击查看摘要
Abstract:Person names are widely used as prompt variables in LLM evaluations of factuality, privacy leakage, bias and abstention, but when a name's evidential status is uncontrolled, measurements may conflate memorisation, retrieval, name priors and wrong-person attribution. We operationalise an unknown name as one with plausible First-Last form, no indexed full-name evidence, and no ambiguity signals under a documented validation run, and introduce PUN (Plausible Unknown Names), a protocol for constructing and validating such names, combining Wikidata-derived components, web-enabled LLM screening, and controlled search revalidation. We report acceptance rate, reproducibility, ablations, and a 204-participant human study, finding accepted names are more name-like than controls while participants recover person evidence in only 3% of cases. We release 300 names with comparison controls.
11. 【2608.21095】rustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems
链接：https://arxiv.org/abs/2608.21095
作者：Balkrishna Giri,Md Toufique Hasan,Jussi Rasku,Muhammad Waseem,Pekka Abrahamsson
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：grounds Large Language, Large Language Model, guarantee factual truth, grounds Large, RAG systems
备注： 7 pages, 1 figure. Accepted for publication in the Main Research Track of the Twenty-First International Conference on Software Engineering Advances (ICSEA 2026)
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) grounds Large Language Model (LLM) outputs in external knowledge, but RAG systems usually trust whatever they retrieve, creating a Security-Reliability Gap: high semantic relevance does not guarantee factual truth. Adversaries exploit this through knowledge poisoning, inserting malicious documents to cause targeted misinformation. We propose an Evaluation Agent, middleware that combines Natural Language Inference (NLI) factual verification, a five-signal poison detector with relevance-weighted aggregation, and a Trust Index T = 0.4 F + 0.35 C + 0.25 (1 - P ) with a non-linear dampener for high-contamination contexts. On TruthfulQA with Llama 3.3 70B, the agent reaches 91% accuracy and 100% precision, with 100% recall on instruction injection, while in-place edits, such as entity swaps, remain hard to detect. Across three LLMs the Trust Index stays discriminative, with a Receiver Operating Characteristic Area Under the Curve (ROC-AUC) of 0.73 to 0.81; generation style matters more than model size, and per-LLM threshold calibration restores baseline competitive accuracy, whereas a weaker FEVER result shows that cross-dataset generalization requires domain-specific calibration. In a software-engineering use case, a secure-coding assistant over guidance from the Open Worldwide Application Security Project (OWASP) Top 10 and the Common Weakness Enumeration (CWE), the agent reliably blocks instruction injection of unsafe advice (F1 92%), while contradiction and subtle semantic weakening remain hard. Throughout, the agent measures detection of poisoned context before generation, not whether the LLM adopts the injected misinformation. We release the proposed approach, attack generator, and experimental artifacts at the link: this https URL.
12. 【2608.21088】When the Feature Pool Goes Algorithmic: Extending Mufwene's Ecology of Language Evolution to LLM-Mediated Exposure
链接：https://arxiv.org/abs/2608.21088
作者：Kunmei Han
类目：Computation and Language (cs.CL)
关键词：locates language evolution, linguistic material made, model locates language, ecological model locates, evolution in competition
备注：
点击查看摘要
Abstract:Mufwene's ecological model locates language evolution in competition among variants contributed by individual idiolects and in speakers' selection from linguistic material made available through interaction. Large language models (LLMs) complicate this architecture without requiring the locus of selection to move away from human speakers. This article argues that LLMs are best treated as distributional mediators: they aggregate language produced across human populations, transform its distribution through training and post-training, and redistribute model-specific outputs at scale. I call the resulting ecological process algorithmic reweighting of the speaker-accessible distribution: model mediation can alter the relative frequencies with which competing variants reach human selectors. Emerging evidence on model-specific linguistic profiles and lexical uptake is consistent with parts of this pathway, but does not establish inevitable convergence. Human social evaluation remains decisive: model-associated forms may diffuse and become conventionalized, become socially recognizable as 'AI-like' and subsequently avoided, or fail to diffuse in the first place. The proposal extends Mufwene's feature-pool ecology one step upstream of speaker selection and yields testable predictions about uptake, model-version effects, convergence, and social reversal.
13. 【2608.21087】Jokes Aside: Measuring the Semantic Distance of Double Meanings
链接：https://arxiv.org/abs/2608.21087
作者：Fabio De Ponte
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, computational humor research, significantly enriched, enriched the toolkit
备注： The paper was submitted to ISHS (International Society for Humor Studies) conference held in Kraków, Poland on 7-11 July 2025. It was awarded the GSA AWARD and was presented during a special plenary session (see the section Graduate Student Awards, 2006-2025 of the webpage [this https URL](https://www.humorstudies.org/ConferCenter.htm) )
点击查看摘要
Abstract:Large language models have significantly enriched the toolkit for computational humor research, particularly in the automated generation of jokes and puns. A key innovation, contextual embedding vectors, offers new opportunities to revisit and refine earlier hypotheses. Notably, Petrovic and Matthews (2013) proposed a joke generation model based on the scheme "I like my X like I like my Y, Z" (e.g. "I like my ice like I like my dreams, crushed"). They suggested that joke hilarity increases with: a) frequent association of Z with X and Y, b) rarity of Z, c) ambiguity of Z, and d) meaning distance between X and Y. Building on this, Winters et al. (2019) proposed a set of metrics, based on Google Ngrams and Word2Vector. In this work, three out of their five metrics are revisited with word embeddings: obviousness, compatibility, and comparison. Another measure, symmetry, defined as closeness of Z to both X and Y, is introduced here for the first time. Two models were used to collect the embedding vectors (OpenAI text-embedding-3-small and MiniLM all-MiniLM-L6-v2) on three datasets: JokeJudger, Expunations, and rJokes. The last two datasets, Expunations, and rJokes, were expanded by adding paired sentences that captured the ambiguous expression at the core of each joke in its two different meanings. Results revealed that models trained on the proposed metrics performed poorly in predicting humor ratings: on JokeJudger, the best model achieved 57.1% accuracy, below the 61.5% baseline, while performance on Expunations and rJokes was even lower. Nevertheless, the symmetry metric seems consistently associated with higher-rated jokes, suggesting it may capture a necessary -though not sufficient- property of humor.
14. 【2608.21074】PromptResponse: Optimizing Prompts for LLM Coding Tasks
链接：https://arxiv.org/abs/2608.21074
作者：Erik Thureck,Robert Kühnen,Tim Jacobowitz
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Software Engineering (cs.SE)
关键词：Large language models, output remains sensitive, Large language, input prompt variations, unicode
备注： 22 pages, 7 figures, 10 listings
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used in research workflows and software development pipelines, yet their output remains sensitive to input prompt variations. This paper presents $\unicode{x00AB}$PromptResponse$\unicode{x00BB}$, a controlled study examining how formatting and LLM-based tuning of coding task prompts affect the resulting code's performance, efficiency, and stability. Using five semantically identical yet syntactically distinct variants of the HumanEval dataset$\unicode{x2014}$baseline, JSON, Markdown, YAML, and an LLM-tuned version$\unicode{x2014}$we had GPT-4o solve its coding problems over 8200$\unicode{x00A0}$executions. Our results show that consistent formatting$\unicode{x2014}$especially JSON$\unicode{x2014}$improves generation efficiency and syntactic stability, with minor gains in task performance. Conversely, the LLM-tuned prompts resulted in significantly degraded task performance without significant improvements in any other dimension. These findings suggest that low-effort reformatting alone can yield measurable improvements, while tuning must account for model alignment. We conclude our work with providing a set of practical recommendations informed by our results as well as releasing our dataset variants and evaluation pipeline for future work.
15. 【2608.21043】Evidence-Consistent Generative Detection under Scenario-Level Distribution Shift
链接：https://arxiv.org/abs/2608.21043
作者：San Kim,JinYeong Bak
类目：Computation and Language (cs.CL)
关键词：Conventional in-distribution evaluation, recurring task-specific patterns, Conventional in-distribution, task-specific patterns, patterns or surface
备注： Accepted at CIKM 2026 (35th ACM International Conference on Information and Knowledge Management), Rome, Italy, November 2026. 12 pages, 4 figures. Code and data: [this https URL](https://github.com/kimsan1120/ECoG)
点击查看摘要
Abstract:Conventional in-distribution evaluation can overestimate robustness when training and test data share recurring task-specific patterns or surface cues. This risk is especially relevant in social-engineering fraud detection, where attackers can preserve malicious intent while changing the scenario, impersonated entity, or wording. We study this problem as scenario-level out-of-distribution (SL-OOD) detection for SMS and voice phishing, where entire attack scenarios are held out from training while the label space remains fixed. This setting tests whether models can generalize to unseen attack scenarios using decision-relevant evidence rather than familiar scenario-specific cues. Using this SL-OOD evaluation, we find that high in-distribution performance does not reliably predict held-out robustness across feature-, encoder-, and decoder-based baselines. We interpret this gap as scenario memorization: reliance on recurring scenario-specific lexical or entity cues rather than decision-relevant evidence. We propose ECoG, an evidence-consistent generative framework that combines evidence-span supervision with a rationale-label consistency objective during training. On the 0.5B decoder, relative to the same backbone trained without consistency regularization, ECoG raises Macro-F1 on OOD challenging instances by 3.22 points, reduces the share of predictions whose generated rationale supports the opposite label by 4.22 points, and increases token-level overlap with reference evidence spans by 8.38 points; the reduction in prediction-rationale inconsistency is consistent across four decoder backbones. These results suggest that compact generative detectors can benefit from evidence supervision and rationale-label consistency under social-engineering shift.
16. 【2608.21030】COMET: Contrastive Motion-Enhanced Temporal Reasoning for Video Multimodal Large Language Models
链接：https://arxiv.org/abs/2608.21030
作者：Chenghua Zhu,Zhaolu Kang,Qifan Shi,Siyan Wu,Kehan Jiang,Lei Wei,Lianyu Hu,Guangyuan Dong,Mingbo Yang,Rui Lu,Guibo Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：multimodal large language, Video multimodal large, understanding remains fragile, fine-grained motion-temporal understanding, large language models
备注： Accepted at the 34th ACM International Conference on Multimedia (ACM MM 2026)
点击查看摘要
Abstract:Video multimodal large language models have advanced significantly, yet fine-grained motion-temporal understanding remains fragile. The core bottleneck is not only sparse frame sampling, but also the lack of a complete temporal modeling pipeline for explicitly representing frame-to-frame change, enabling appearance-motion interaction, and optimizing temporal direction sensitivity. We propose COMET, a temporally grounded framework that systematically strengthens video MLLMs through explicit temporal representation, appearance-motion fusion, and direction-aware optimization. Architecturally, COMET introduces a temporal motion branch built on Taylor frame differences and injects its motion evidence into the appearance stream via temporal attention bias-enhanced cross-attention. For optimization, COMET combines temporal prior distillation with a forward-reverse TC-GRPO stage that turns temporal order into a direct learning signal and strengthens the model's use of directional motion patterns encoded by the temporal motion branch. The method achieves consistent overall improvements with a pronounced motion-temporal bias: on Qwen3-VL-8B, action-centric tasks (STAR, SSv2) improve by 4.9% on average, temporal reasoning tasks (NExT-QA, CLEVRER, LLaVA-178K) by 2.1% over BL-GRPO, while static perception tasks (PerceptionTest) remain on par. The same gain pattern also transfers to InternVL2.5-8B, indicating that COMET generalizes across model families.
17. 【2608.21023】Scaling Unsupervised Word Alignment to Documents via Structural Constraints
链接：https://arxiv.org/abs/2608.21023
作者：Michelle Wastl,Jannis Vamvas,Rico Sennrich
类目：Computation and Language (cs.CL)
关键词：cross-lingual tasks increasingly, tasks increasingly require, increasingly require correspondences, traditionally been studied, cross-lingual tasks
备注： 18 pages; accepted at EMNLP 2026 Main
点击查看摘要
Abstract:Word alignment has traditionally been studied between sentences, but many cross-lingual tasks increasingly require correspondences across full documents. While recent multilingual embedding models can encode long inputs, we show that applying algorithms designed for sentences directly to documents leads to performance degradation. To address this, we introduce CTFAlign, a lightweight, training-free approach for document-level word alignment. CTFAlign applies a coarse-to-fine refinement strategy that restricts the alignment search space to semantically similar regions. Additionally, we introduce MDPAlign, a simpler alternative that constrains alignments by position with a main diagonal prior. Both approaches operate directly on full documents without relying on sentence segmentation or sentence alignment. We evaluate these methods across six language pairs varying in typological distance, resourcedness, and document length. Averaged over three models, CTFAlign reduces word alignment error rate from 0.412 to 0.326. These gains transfer downstream, leading to improvements in document-level translation coverage evaluation and recognition of semantic differences. We release CTFAlign as a Python package and make the code and data to reproduce our experiments publicly available.
18. 【2608.21021】Free-Text Evaluation of LLMs for 5G Domain Knowledge and Fault Analysis using LLM-as-Judge
链接：https://arxiv.org/abs/2608.21021
作者：Rishiraj Sengupta,Sotiris Chatzimiltis,Mohammad Shojafar,Xiatian Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Networking and Internet Architecture (cs.NI)
关键词：including root-cause explanations, Real-world fault analysis, networks demands domain, demands domain expertise, analyze free-text diagnostics
备注： 6pages, 4figures. Accepted for presentation in IEEE CSCN conference
点击查看摘要
Abstract:Real-world fault analysis in 5G and emerging 6G networks demands domain expertise to analyze free-text diagnostics, including root-cause explanations and recommended actions. LLMs have emerged as a promising approach to automating this, yet whether lightweight, edge-deployable models are capable of performing in-depth free-text diagnostics remains an open question. While existing benchmarks rely on restrictive MCQs with fixed answer keys, this paper evaluates 5G domain understanding and fault analysis in a free-text generation format. Transitioning to this paradigm requires evaluating lightweight, edge-deployable AI models on open-ended diagnostic reasoning, alongside a dependable framework to validate these text outputs at scale. To address this we evaluate three lightweight LLMs, Claude-Haiku-4.5, GPT-5.4-Mini, and Gemini-3.1-Flash-Lite, on free-text 5G domain knowledge and fault-analysis tasks across three benchmarks, TeleQNA ORAN FT, 5G-Faults FT, and TeleInter FT. Three independent frontier judges score outputs, and pairwise inter-judge agreement is measured as an empirical test of the LLM-as-Judge methodology. All three models reach at least 90% accuracy on fault diagnosis, while zero-shot recall of 3GPP and O-RAN specifications remains the critical gap, with all models scoring below 60%. Mean inter-judge agreement is at least 0.90 across all runs, indicating that multi-judge LLM scoring produces consistent, reproducible grades for open-ended telecom responses. Operationally, Gemini-3.1-Flash-Lite offers the best efficiency trade-off, combining competitive accuracy with the lowest inference cost and latency, making it the most suitable candidate for production telecom deployments.
19. 【2608.21019】arget-Aware Calibration Data Selection for Preserving Uncertainty in Quantized Language Models
链接：https://arxiv.org/abs/2608.21019
作者：Zhen Yang,Sizai Hou,Kaiwen Zheng,Yaofang Liu,Liang He,Yixuan Chen,Kangning Cui
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：deploy large language, primary objective, deploy large, effect on uncertainty, large language models
备注： 20 pages, 5 figures. Accepted to EMNLP Findings 2026
点击查看摘要
Abstract:Quantization is widely used to deploy large language models, but its effect on uncertainty behavior, such as confidence, margins, and abstention, is rarely treated as a primary objective. We frame calibration-data selection for quantization as a target-dependent uncertainty-preservation problem. Different deployments emphasize different regions of the input distribution, yet prior work mainly optimizes accuracy-oriented compression metrics or adjusts scores after quantization. We formalize this goal with distributional and boundary preservation risks, and provide a simple mixture-mismatch argument explaining why no single calibration recipe should be expected to fit all targets. We introduce Doubt-Preserving Quantization (DPQ), a lightweight pre-quantization recipe family that uses full-precision predictions to construct target-aligned calibration mixtures of high-doubt examples and generic anchors. Across 8 language models, 9 NLP benchmarks, and 22 comparison methods, the leading fixed recipe changes with the preservation target: DPQ-r75 leads on SQuAD2 answerability-boundary preservation, while milder or single-signal variants, including DPQ-r50, confidence-only, and entropy-only, better preserve broad multiple-choice QA behavior. These results show that calibration data should be selected for the specific full-precision score behavior a deployment needs to preserve, rather than treated as a fixed quantization detail.
20. 【2608.20984】MigrationNarrate: A Dataset for Detection of Migration Narratives in YouTube Videos
链接：https://arxiv.org/abs/2608.20984
作者：Fatima Haouari,Carolina Scarton,Kalina Bontcheva
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：analysing public discourse, critical for understanding, understanding and analysing, public discourse, Narratives
备注： This work was accepted to the main conference of EMNLP 2026
点击查看摘要
Abstract:Narratives are central to how social communication is framed, making their detection critical for understanding and analysing public discourse. Prior work has explored narrative detection and extraction across diverse domains; however, migration narratives remain significantly understudied, primarily due to the absence of dedicated annotated datasets. Furthermore, public communication has recently shifted towards video-centric platforms, where narratives are conveyed through multimodal signals and consumed at scale. Despite this shift, narratives in videos remain largely unexplored. To bridge these gaps, we introduce MigrationNarrate, the first multimodal dataset for detection of migration narratives in the UK, consisting of 1,115 YouTube video transcripts annotated using a two-level taxonomy of 12 migration super-narratives and 53 narrative labels. This paper details the dataset design, collection, and annotations; together with benchmark results using a combination of pre-trained encoder models and both open- and closed-source Large Language Models. Finally, a thorough error analysis offers insights for future work.
21. 【2608.20964】Extractive Summarization for Arabic Documents Using SAraBERT with a Semantic Siamese Similarity Evaluation Metric
链接：https://arxiv.org/abs/2608.20964
作者：Sami Shames El Deen,Mariette Awad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：extractive summarization tasks, inter-sentence transformer layers, Semantic Siamese Similarity, proposes inter-sentence transformer, propose Semantic Siamese
备注：
点击查看摘要
Abstract:In this research, we introduce SAraBERT, an enhanced version of AraBERT which proposes inter-sentence transformer layers for extractive summarization tasks. To ensure that the summaries generated by SAraBERT achieve a high coverage of the document's main ideas, we propose Semantic Siamese Similarity, a novel evaluation metric that measures the level of similarity between two text inputs. We validated using BLEU, ROUGE, and Semantic Siamese similarity on Sarabert and published related models. Simulation results showed the effectiveness of our proposed model and motivate follow on research.
22. 【2608.20961】reeWY: Speculative Verification for Gated DeltaNet Hybrids
链接：https://arxiv.org/abs/2608.20961
作者：Sneha Murthy Ghantasala
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Performance (cs.PF)
关键词：Modern open models, Modern open, fixed-size recurrent state, small fixed-size recurrent, growing key-value
备注： 10 pages, 3 figures
点击查看摘要
Abstract:Modern open models are hybrids: most layers are linear-attention (Gated DeltaNet, GDN) layers carrying a small fixed-size recurrent state instead of a growing key-value (KV) cache. This makes ordinary decoding memory-efficient, but hurts speculative decoding. To verify a batch of draft tokens and then roll back the rejected ones, today's systems snapshot the full recurrent state at every draft position for GDN layers, and those snapshots cannot be shared across branches of a draft tree, so a wide, high-acceptance tree becomes memory-infeasible. We remove the snapshots. Using a tree-structured WY transform of the gated delta rule, we compute every draft node's output with a single triangular solve and reconstruct only the one accepted state on commit, storing a small pseudo-value matrix instead of per-node states; the derivation depends only on the gated delta rule, not on any other architectural detail. In serving benchmarks on two scales of one hybrid model family (Qwen3.5 35B and 397B) this cuts speculative recurrent-state memory and KV-cache pressure at identical acceptance length, turning the freed HBM into higher throughput and much lower time-to-first-token (TTFT) wherever memory binds, and costing a few percent where it does not. For tree width the same memory buys affordability: a wider, higher-acceptance draft becomes possible, though not yet a throughput win.
23. 【2608.20953】Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs
链接：https://arxiv.org/abs/2608.20953
作者：Bakbergen Ryskulov,Iker García-Ferrero,David Montero,David Jansen,Ali Hashemi,Jezabel R. Garcia,Antonio Tiene,Román Orús
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Performance (cs.PF)
关键词：Serving large language, language models cheaply, models cheaply increasingly, cheaply increasingly, increasingly means shipping
备注： Patent Application Number: 26382838.6 / P202602102EP
点击查看摘要
Abstract:Serving large language models cheaply increasingly means shipping models that are both structurally compressed to a fraction of their parameters and quantized to 4 bits. Together these steps degrade reasoning, mathematics, coding, and long-context behavior enough to require a recovery, or healing, stage before deployment. The default recipe, quantization-aware training (QAT), re-fits the compressed, quantized model to hard labels; in our pipeline it converged slowly and collapsed past its peak. We adopted Quantization-Aware Healing (QAH) instead. Because a structurally compressed model is never independently trained at full precision, its bfloat16 checkpoint is a distillation-recovered approximation of the original; QAH distills the 4-bit student directly from the original, uncompressed model. On a GPT-OSS 120B to 60B to MXFP4 pipeline, the QAH student matches or beats its bfloat16 source on 7 of 9 benchmarks at roughly 4 times less weight memory and half the teacher's parameter count, and is released open-weight as Hypernova-60B. Against a matched QAT baseline it reaches a comparable peak about 7 times faster and stays stable under continued training, without hand-tuned early stopping. We also report deployment lessons, including a large, reproducible quality gap between distributed-training backends. Our aim is a recipe deployable without a multi-week hyper-parameter search.
24. 【2608.20927】MentorPulse: Refreshing Cross-Model Latent Guidance for Long-Form Generation
链接：https://arxiv.org/abs/2608.20927
作者：Ziwu Liu,Guozhong Li,Chen Qiu,Weiyang Kong,Panos Kalnis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Cross-model latent guidance, frozen small student, frozen large mentor, Cross-model latent, small student generate
备注： 26 pages, 12 figures
点击查看摘要
Abstract:Cross-model latent guidance lets a frozen large mentor encode an input once and a frozen small student generate from the resulting signal. Existing methods keep this signal fixed, assuming it stays useful as the output grows; we show this fails in long-form generation. On multi-turn instruction following, static guidance pushes a 4B student's constraint satisfaction 2.5 points below its no-guidance baseline; a training-free refresh every 16 tokens changes only the memory content and restores a 2.0-point gain over that baseline. We propose MentorPulse to keep guidance fresh at practical cost: it compresses mentor states into a capped slot memory, incrementally processes newly generated tokens, and updates the memory that the student reads through gated cross-attention without resetting the student's KV cache. Windowed Refresh Training exposes the bridge to prefix-conditioned memory. Across thirteen datasets, MentorPulse closes 52.2% of the mentor-student gap on macro average, outperforming C2C, T2T, and equal-budget LoRA, with the largest gains on long outputs. It performs best on all eleven mentor-student pairs from three model families, with margins that narrow as the capability gap grows, and a lightweight read-pattern check predicts the gain before deployment. Measured costs identify refresh intervals that dominate text guidance on long outputs.
25. 【2608.20925】Source-Free MT Evaluation Is Not MT Evaluation
链接：https://arxiv.org/abs/2608.20925
作者：Baban Gain,Ramakrishna Appicharla,Asif Ekbal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：quality estimation methods, Reference-based metrics remain, machine translation evaluation, partly because quality, human judgments
备注：
点击查看摘要
Abstract:Reference-based metrics remain the standard choice in machine translation evaluation, partly because quality estimation methods often correlate less well with human judgments. As a result, source-free, reference-based evaluation has become the practical norm, even though it is unfaithful to the definition of translation adequacy and unfair to systems whose outputs preserve the source meaning while differing from the reference. This paper argues that adequacy must be judged with respect to the source. A reference is only one possible rendering of the source and may introduce bias, under-specification, or errors. We further argue that source-reference-hypothesis evaluation is fair only when the judge treats the reference as auxiliary evidence rather than as the primary standard. Otherwise, even source-aware evaluation can reduce adequacy to preference towards reference. We show the existing hybrid metrics are highly reliant on reference compared to source. Our argument is not that all automatic MT metrics fail to use the source. Rather, we argue that any evaluation protocol that removes the source, or allows the reference to dominate the source, is structurally incomplete for adequacy evaluation. However, existing MT papers generally prefer reference-based metrics and use QE metrics only when reference is unavailable. We therefore call for QE to be reframed as a primary approach to source-grounded adequacy evaluation, rather than as a fallback motivated by missing references. We further call for hybrid metrics whose designs explicitly prioritize source--hypothesis faithfulness while using references only as complementary evidence.
26. 【2608.20920】ForeDreamer: A Self-Evolving Dual-Agent Memory Architecture for Future Event Prediction
链接：https://arxiv.org/abs/2608.20920
作者：Linhao Zhong,Zongze Du,Linyu Wu,Yu Bo,Hourong Li,Chenchen Jing,Hao Chen,Yuling Xi,Chunhua Shen
类目：Computation and Language (cs.CL)
关键词：distill reliable signals, Open-web future event, future event prediction, event prediction requires, future event
备注： accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Open-web future event prediction requires agents to distill reliable signals from noisy, redundant, and incomplete evidence. Existing retrieval/memory mechanisms directly feed retrieved information to agents or rely on simple memory functions such as storing and reusing prior information for prediction, leaving them insufficient for open-web forecasting. We propose to transform raw web evidence into structured memory before prediction, enabling agents to reason over distilled, question-specific evidence rather than noisy retrieval results. This paper presents ForeDreamer, a self-evolving dual-agent framework for managing memory over open-web evidence. ForeDreamer separates factual memory, a question-specific evidence state for the current forecast, from experiential memory, persistent agent experience accumulated across forecasting episodes. It uses a main agent for search and prediction, and a memory-processing subagent to convert search results into factual memory with dedicated tools. ForeDreamer further evolves experiential memory through two tracks, improving both forecasting decisions and factual-memory construction. Experiments on Prophet Arena and FutureX demonstrate the effectiveness of ForeDreamer. Project page: this https URL
27. 【2608.20887】KREL: Automatic Medical Coding via Knowledge-Guided Reasoning over Clinical Evidence with LLMs
链接：https://arxiv.org/abs/2608.20887
作者：Xubin Chen,Yipeng Zhou,Wen Sun,Chengkai Huang,Xiaoming Fu,Quan Z. Sheng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：assigns standardized International, Automatic Medical Coding, standardized International Classification, Automatic Medical, standardized International
备注：
点击查看摘要
Abstract:Automatic Medical Coding (AMC), which assigns standardized International Classification of Diseases (ICD) codes to clinical notes, is essential for medical reimbursement, quality reporting, and clinical research. Existing pre-trained language model (PLM)-based methods typically formulate AMC as an extreme multi-label classification problem over a predefined code set, while recent large language model (LLM)-based approaches instead frame it as generation or multi-step reasoning. However, key challenges remain, including the extreme length of clinical notes that hinders effective interpretation, the vast ICD label space, and complex coding rules that are not explicitly captured by LLMs. In this work, we propose Knowledge-Guided Reasoning over Clinical Evidence with LLMs (KREL), a framework that leverages LLMs for clinical text understanding and reasoning while integrating external ICD coding guidelines as structured knowledge. This design enables tight coupling between domain knowledge and LLM reasoning, reducing hallucinations and improving compliance with coding standards. Experiments on benchmark datasets show that KREL consistently outperforms strong PLM-based and state-of-the-art LLM-based baselines.
28. 【2608.20868】Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images
链接：https://arxiv.org/abs/2608.20868
作者：A. Said Gurbuz(1 and 2),Ahmed Nassar(1),Christoph Auer(1),Maksym Lysak(1),Lucas Morin(1),Matteo Omenetti(1),Tim Strohmeyer(1),Panagiotis Vagenas(1),Nikolaos Livathinos(1),Michele Dolfi(1),Peter Staar(1) ((1) IBM Research Zurich, (2) ETH Zurich)
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：optical character recognition, multi-stage error propagation, traditionally cascade optical, cascade optical character, structured information extraction
备注： Accepted at ICDAR 2026. 17 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Document processing pipelines traditionally cascade optical character recognition (OCR) engines with downstream models for structured information extraction, leading to multi-stage error propagation. We fine-tune SmolDocling, a compact 256M-parameter vision-language model (VLM), to perform end-to-end key-value extraction directly from document images, jointly solving identification, localization, and association in a single pass without OCR preprocessing. We extend DocTags with specialized key, value, region, and link tags, enabling many-to-many relationships in a unified output sequence. To address data limitations, we design an augmentation pipeline combining synthetic form filling and graph-based crops that preserve complete key-value subgraphs. We further introduce a layout-aware evaluation framework extending text matching with spatial bounding box verification. On FUNSD, XFUND, and a large-scale private dataset, our model outperforms larger zero-shot VLM baselines under layout-aware evaluation, while being 27 times smaller than Qwen2.5-VL (7B) and over 5 times faster at inference. The model weights will be released publicly after publication.
29. 【2608.20856】Ontology-Driven Structural Regularization for Document-Level Relation Extraction
链接：https://arxiv.org/abs/2608.20856
作者：Laura Menotti,Stefano Marchesin,Gianmaria Silvello
类目：Computation and Language (cs.CL)
关键词：Document-Level Relation Extraction, Relation Extraction, costly manually annotated, remain underexploited due, Document-Level Relation
备注： Accepted at EMNLP 2026
点击查看摘要
Abstract:Document-Level Relation Extraction (DocRE) relies heavily on costly manually annotated datasets, while large distant supervision resources such as DocRED distant remain underexploited due to noise. We show that a critical yet overlooked source of noise lies in structural inconsistencies within relational triples, including violations of ontology constraints and logical contradictions. We introduce an ontology-driven framework to quantify and enforce structural consistency in DocRE datasets. Our analysis reveals substantial structural noise in DocRED distant and demonstrates that such inconsistencies propagate to model predictions. Enforcing structural well-formedness during training significantly reduces logical contradictions and consistently improves generalization performance. These findings establish structural consistency as a missing axis of supervision in DocRE and highlight structural regularization as an effective strategy for leveraging distant data at scale.
Comments:
Accepted at EMNLP 2026
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.20856 [cs.CL]
(or
arXiv:2608.20856v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.20856
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
30. 【2608.20839】SAC-Copula: Quality-Preserving Watermarking for Diffusion Language Models via Smooth Correlated Gumbel Fields
链接：https://arxiv.org/abs/2608.20839
作者：Baixin Li,Haiyun He
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：diffusion language models, requires mechanisms compatible, Watermarking diffusion language, iterative parallel unmasking, language models
备注： Accepted to Findings of EMNLP 2026. 24 pages, 13 figures
点击查看摘要
Abstract:Watermarking diffusion language models (DLMs) requires mechanisms compatible with iterative parallel unmasking rather than autoregressive decoding. Existing sampling-based watermarking methods typically inject position-wise i.i.d. perturbations, which can be poorly aligned with DLM decoding dynamics and degrade generation quality. We propose SAC-Copula, a quality-preserving watermarking method for DLMs based on smooth, locally correlated Gumbel perturbation fields constructed via a Gaussian copula. We further develop a SAC-aware detector using covariance-aware filtering and native-sample calibration. Mechanism-level analysis shows that local correlation reduces latent perturbation roughness and better matches iterative refinement dynamics. Experiments on LLaDA show that SAC-Copula achieves a favorable quality-detectability trade-off compared with existing baselines. In particular, further evaluations on Dream-7B and additional datasets show that SAC-Copula substantially improves PPL tail stability over the i.i.d. Gumbel baseline, while maintaining strong low-FPR detectability and competitive overall generation quality. Additional token-edit stress tests further assess watermark robustness under controlled synchronization drift.
31. 【2608.20831】STAR-OPD: Structured Aspect-Cascade-Aware On-Policy Reward Distillation for ABSA Quadruple Extraction
链接：https://arxiv.org/abs/2608.20831
作者：Tong Sun,Mingyang Ma,Jiayang Yu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Aspect-based sentiment analysis, requires jointly predicting, Aspect-based sentiment, fine-grained sentiment tuples, multiple fine-grained sentiment
备注：
点击查看摘要
Abstract:Aspect-based sentiment analysis (ABSA) quadruple extraction requires jointly predicting target, aspect, opinion, and sentiment over reviews that often contain multiple fine-grained sentiment tuples. While large chain-of-thought (CoT) models perform well on this task, distilling them into smaller deployable models remains difficult. We identify a task-specific failure mode in distilled ABSA extraction: student errors at the target-aspect interface create structurally invalid states, such as broken target-aspect bindings and hallucinated targets, which then corrupt downstream predictions. Conventional off-policy distillation is poorly suited to this setting because it trains only on teacher-generated trajectories and provides little supervision on the student-induced structural states that dominate inference. To address this mismatch, we propose STAR-OPD (STructured Aspect-cascade-aware On-Policy Reward Distillation), which builds on generic on-policy distillation and instantiates it for ABSA quadruple extraction with cascade-aware, set-structured rewards. STAR-OPD trains on student rollouts and applies set-structured rewards that directly target binding consistency, target grounding, and fine-grained aspect disambiguation. Experiments on E-ABSA20K and SemEval-2014 show that STAR-OPD consistently outperforms off-policy and general on-policy baselines, reduces target hallucination, and substantially improves performance on structurally hard cases. With Qwen3-4B, STAR-OPD substantially narrows the student-teacher gap while improving inference efficiency, highlighting the importance of on-policy structural correction for distilled ABSA extraction.
32. 【2608.20804】Denoising the Future: Context-Aware Spectral Diffusion for Temporal Knowledge Graph Extrapolation
链接：https://arxiv.org/abs/2608.20804
作者：Yanglei Gan,Peng He,Run Lin,Peiyuan Jiang,Yifan Wang,Qiao Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Temporal Knowledge Graph, Knowledge Graph, time-varying relational histories, Temporal Knowledge, seeks to infer
备注： EMNLP 2026 Main
点击查看摘要
Abstract:Temporal Knowledge Graph (TKG) extrapolation seeks to infer future facts from time-varying relational histories. Recent diffusion-based approaches improve uncertainty modeling through generative denoising, but their aggregated conditioning on subject histories may insufficiently distinguish query-specific evidence from non-salient historical facts, thereby diluting target-discriminative signals. To bridge this gap, we propose FreqDiff, a Frequency-aware Diffusion framework for TKG extrapolation. Specifically, FreqDiff formulates future object prediction as query-slot denoising and develops a dual-stream denoiser that integrates temporal dependency modeling with context-aware spectral calibration. The spectral branch synthesizes history-conditioned filters from learnable bases to adaptively re-calibrate denoising representations, while a frequency-domain regularizer is proposed to align the denoised target with the gold object in spectral space. Experiments on four public TKG benchmarks demonstrate that FreqDiff achieves state-of-the-art performance.
33. 【2608.20801】Profiling What Matters: Context-Aware Item Profiles from Large-Scale Metadata for LLM Recommenders
链接：https://arxiv.org/abs/2608.20801
作者：Dojun Hwang,Seunghan Lee,Cheonyoung Park,Sara Yu,SeongKu Kang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Language Models, Large Language, information remains challenging, significantly advanced reranking
备注： Accepted to CIKM 2026
点击查看摘要
Abstract:While Large Language Models (LLMs) have significantly advanced reranking in recommendation, effectively leveraging item-side information remains challenging. Real-world items are described by vast, heterogeneous, and unstructured metadata, where decision-relevant signals are often implicit, noisy, or buried in long descriptions. Moreover, feature salience is highly context-dependent, varying not only across items but also across users. Existing methods often rely on item titles, fixed attributes, or static item summaries, which limit personalized and fine-grained item understanding. To bridge this gap, we propose CAIRO, a user context-aware item profiling framework for LLM-based reranking. CAIRO first structures raw metadata and reviews into objective features and subjective traits, and employs a lightweight profiler to select the most relevant information for each user-item pair with limited serving-time overhead. The resulting profiles are concise and context-specific, providing relevant item-side evidence for the LLM's ranking decision. Experiments show that CAIRO consistently improves LLM-based reranking, highlighting the importance of item profiling that effectively exploits vast item-side information.
34. 【2608.20777】ree-of-Concerns: Hierarchical Multi-Agent Debate for Unstated-Limitation Extraction in Scientific Critique
链接：https://arxiv.org/abs/2608.20777
作者：Sahil Mishra,Niranjan Rajeev,Tanmoy Chakraborty
类目：Computation and Language (cs.CL)
关键词：hidden failure modes, scientific literature grows, multi-agent LLMs offer, increasingly under-report limitations, papers increasingly under-report
备注： Accepted in the Findings of EMNLP 2026
点击查看摘要
Abstract:As scientific literature grows and papers increasingly under-report limitations, multi-agent LLMs offer a promising approach to systematically uncover these hidden failure modes. Here, we introduce Tree-of-Concerns, a multi-agent framework that deploys specialized skeptic personas, each operating through a category-specific analytical lens, as parallel debate trees to extract unstated limitations from scientific papers. Each persona conducts structured, evidence-grounded argumentation, while a Panel Review mechanism re-evaluates each surviving claim from all five perspectives to correct category drift and severity miscalibration. Through experiments on ToC-Bench, our benchmark of 414 research papers with 1,905 unstated limitations, sourced from reviewer-reported weaknesses and follow-up citation critiques, we demonstrate that ToC improves precision by 79% and coverage by 11% relative to strongest baselines, surfacing specific, evidence-grounded concerns that support reviewers in systematic evaluation.
35. 【2608.20757】PSK at WMT 2026 MIST: Task-Specialized QLoRA Adapters for Multilingual Summarization and Question Answering
链接：https://arxiv.org/abs/2608.20757
作者：Srikar Kashyap Pulipaka
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Instruction Shared Task, Multilingual Instruction Shared, Instruction Shared, Tiny Aya Global, Shared Task
备注：
点击查看摘要
Abstract:We describe the PSK submission to the WMT 2026 Multilingual Instruction Shared Task. Our system uses the 3.35B-parameter Tiny Aya Global model with three QLoRA adapters, one for each task. The adapters are trained on multilingual document-summary pairs, passage-based question answering, and filtered standalone question answering. The summarization data also includes scientific papers with their author-written abstracts. On our held-out split, the context and summarization adapters perform better than our multitask adapter, which was trained only on data supplied by the organizers. Results for open QA are mixed and vary with answer length and evaluation method. We therefore submit three systems with the same context and summarization adapters but different open-QA adapters.
36. 【2608.20729】Calibrating Criterion Revision in LLM Agents: Failure Modes and a Trace-Anchored Protocol
链接：https://arxiv.org/abs/2608.20729
作者：Guodong Xu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Language-model agents, counts as success, agents can improve, carry text, text across episodes
备注： 18 pages, 8 tables, 1 figure. CMB-0.1 is an instrument-calibration study; CMB-0.4 is a prospective protocol, not an empirical result
点击查看摘要
Abstract:Language-model agents can improve after failure or carry text across episodes without revising what counts as success. We study the narrower attribution problem of criterion revision: when criterion K0 accepts an outcome violating a broader commitment B, what observations justify saying that the system formed and persistently used K1? We require five non-compensatory conditions: criterion-failure detection, a model-emitted proposal, new-episode transfer, intervention sensitivity on the claimed carrier, and preservation. We evaluate CMB-0.1 on twelve cross-domain cases and four arms: stateless inference, append-only history, model-generated but harness-committed state, and evaluator-written oracle state. Seven mechanism fixtures yield 84 deterministic scorer trials; four local quantized artifacts yield 96 calls and 192 model-case-arm trials. No model trial satisfies all five conditions, but this zero does not establish general capability absence. Eleven calls remain invalid after one retry; several commitments disclose the target distinction; the harness performs commits; deletion reuses a stateless call; and conflict changes multiple factors. Qwen2.5-7B answers every transfer and preservation item without revision state, exposing zero-state reconstruction. These failures make CMB-0.1 an instrument-calibration result rather than a model ranking. We derive a prospective, trace-anchored CMB-0.4 protocol requiring concealed transfer, explicit WRITE/NO-WRITE/ESCALATE actions, a separately logged policy-selected commit, matched interventions, repeated hidden items, and a frozen executable oracle. It is a successor design, not a completed confirmatory result. The paper contributes a measurement chain, an empirical diagnosis of its first implementation, and a more discriminating protocol for future tests of criterion revision.
Comments:
18 pages, 8 tables, 1 figure. CMB-0.1 is an instrument-calibration study; CMB-0.4 is a prospective protocol, not an empirical result
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2608.20729 [cs.AI]
(or
arXiv:2608.20729v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.20729
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
37. 【2608.20711】AsmEvo: Agentic Assembly-Level Optimization of AMD GPU Kernels with Functional Equivalence Verification
链接：https://arxiv.org/abs/2608.20711
作者：Ji Liu,Puyuan Yang,Rongzhang Zheng,Fan Wang,Jinglin Wang,Muhammad A. Awad,Mortis Huang,Andy Chang,Zekai Li,Zeping Li,Zihao An,Yue Liu,Yuchen Yang,Jianghui Wang,Chushi Chen,Ziqiong Liu,Fuwei Yang,Dong Li,Wen Heng Chung,Shengcai Liu,Emad Barsoum
类目：Computation and Language (cs.CL)
关键词：expose remaining optimizations, systems increasingly rely, High-performance ML systems, final machine code, AMDGPU code object
备注：
点击查看摘要
Abstract:High-performance ML systems increasingly rely on GPU kernels whose editable source is unavailable, generated, or too distant from final machine code to expose remaining optimizations. Existing LLM kernel optimizers and autotuners mainly operate on CUDA, Triton, HIP, or tensor-program source and validate against reference implementations. We study a stricter setting: optimizing an already compiled AMDGPU code object, where the deployed binary is the only behavioral oracle. We present AsmEvo, an agentic assembly-level optimizer for AMD GPU kernels. Given an AMDGPU code object K0, AsmEvo reconstructs a reassemblable representation, proposes low-level edits with a long-horizon agent, rebuilds an ABI-preserving optimized object, and accepts candidates only after differential verification against K0 under identical launches. AsmEvo combines code-object recovery, metadata-aware rebuilding, profiling-guided hot-window editing, correctness-gated timing, and conservative in-place patch fallback. We conduct extensive experiments with AsmEvo on various AMD GPU kernels. On MI308X, AsmEvo improves 29 of 30 selected KernelBench kernels, reaching 1.35x geometric-mean and 3.88x maximum speedup. On MI300X production workloads, it improves all evaluated AITer binaries and vLLM/SGLang Triton assembly kernels, reaching 1.09x/1.31x and 1.18x/1.34x geometric-mean/maximum speedups, respectively, while preserving functional equivalence.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.20711 [cs.CL]
(or
arXiv:2608.20711v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.20711
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
38. 【2608.20685】mporal Validity on Real Software Histories: Eliminating Stale-Fact Errors in Code-Assistant Memory over GitHub Fixes
链接：https://arxiv.org/abs/2608.20685
作者：Neeraj Yadav
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Retrieval-augmented generation, coding session, function is renamed, endpoint moves, dependency is bumped
备注：
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) has no model of time: when a fact changes across a coding session - a function is renamed, an endpoint moves, a dependency is bumped - RAG retrieves both the old and new value with near-identical similarity and cannot tell which is current, so it serves the superseded value. Paper 1 showed, on synthetic single-value benchmarks, that a deterministic (subject, relation, object) supersession memory eliminates this failure. Here we validate it end-to-end on real software history. From 707 real GitHub issues (SWE-bench Lite + Verified) we extract 130 clean atomic state transitions, a fix that changes one identifiable value from a pre-fix to a post-fix form, and render each marker-free (the stale and current statements differ only in the value). On this set, MemStrata reaches 0.91 answer accuracy versus RAG's 0.57-0.59; and, the structural result, when forced to answer RAG serves the superseded value 36-38% of the time (an LLM reranker does not help) while MemStrata drives this to ~0, at RAG retrieval latency (~2.1 s vs ~18 s for the reranker). We are explicit about scope: only ~18% of real fixes are clean atomic transitions; Paper 2 isolates the memory mechanism on that class, and extraction coverage of the remaining fixes is the orthogonal problem we defer to follow-on work. A real product bug surfaced and was fixed during the study (a case/punctuation-insensitive value comparison), with the moat property (deterministic-supersession accuracy on clean code mutations) preserved and verified.
39. 【2608.20670】Why2Speak: Faithful Reasoning for Abstaining Action Policies
链接：https://arxiv.org/abs/2608.20670
作者：Shreya Mendi,Brinnae Bent
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：making faithful reasoning, faithful reasoning important, acting and abstaining, making faithful, reasoning
备注：
点击查看摘要
Abstract:Many agentic systems must repeatedly choose between acting and abstaining, making faithful reasoning important for oversight: an explanation is useful only if it reflects the computation that produced the action. We study this problem through intervention timing in multi-party conversation, where an assistant must decide whether to speak or remain silent. This setting exposes class imbalance, asymmetric action costs, and the possibility that exposing reasoning changes the policy being audited. Using Qwen3-8B, decoded with or without chain-of-thought reasoning, we compare direct decision policies, reasoning policies, supervised fine-tuning, and reinforcement learning. We find a capability-auditability tradeoff: the strongest direct policy achieves higher quality but exposes no reasoning to inspect, while the reasoning policy provides a trace at the cost of lower performance, particularly recall of true intervention opportunities. Supervised fine-tuning either suppresses reasoning or preserves it without improving decision quality, while reinforcement learning also fails to improve the reasoning policy. We identify one mechanism underlying this failure: group relative objectives provide no learning signal on confidently wrong prompts when sampled rollouts all select the same action. Controlled activation probes and behavioral ablations show that standard faithfulness methods can overstate evidence that exposed reasoning reflects the underlying decision process. Probability-based metrics saturate under confident decisions, probes are vulnerable to class imbalance and textual leakage, and reasoning ablations can confound reasoning content with changes in inference mode. Together, these results show that exposing reasoning can change an agent's action policy rather than simply make it observable. We provide controls for evaluating reasoning-based oversight of agents that can act or abstain.
40. 【2608.20661】Auditable by Construction: An Ontology-Driven Framework for Trustworthy LLM Analytics in Enterprise Finance
链接：https://arxiv.org/abs/2608.20661
作者：Sergiy Lunyakin
类目：Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Planning and Analysis, Financial Planning, large language models, Knowledge-Driven Analytics Framework, Context-Aware Relevance Propagation
备注： 20 pages, 1 figure, 4 tables, 1 algorithm. Artifact deposit with configurations, ontology schema, prompts, audit reports and reconstruction scripts: [this https URL](https://doi.org/10.5281/zenodo.22022068)
点击查看摘要
Abstract:Enterprise adoption of large language models in finance is constrained less by fluency than by trust: in Financial Planning and Analysis (FPA) and other regulated workflows, an answer is usable only if it is traceable to authoritative sources and auditable after the fact. This paper argues that retrieval-augmented generation for enterprise finance should be evaluated on auditability alongside accuracy, and presents the Knowledge-Driven Analytics Framework (KDAF), which builds ontology-driven knowledge systems through six iterative stages and retrieves evidence via Context-Aware Relevance Propagation (CARP), so that every retrieved fact carries its relationship type, confidence, and source lineage. An evaluation on FinanceBench (145 questions) compares KDAF against zero-context inference, BM25, concept-weighted lexical retrieval, and ungrounded graph traversal. First, retrieval is necessary: zero-context inference reaches 4.1% correctness against 10-12% for retrieval-augmented conditions. Second, on answer correctness the retrieval conditions are statistically indistinguishable (KDAF vs BM25: -0.007, 95% CI [-0.021, 0.000]), so accuracy alone does not justify structured retrieval here -- a negative result we report explicitly. Third, on auditability the ordering reverses: KDAF attains the highest citation traceability F1 (0.515), exceeding ungrounded traversal by +0.027 (CI [0.006, 0.050]) and BM25 by +0.052 (CI [0.024, 0.083]), intervals excluding zero. Graph-structured retrieval also admits no evidence from outside the question subject entity (0 of 426 items, against 16.8% and 20.2% for lexical baselines), and every selected item resolves to a complete provenance chain. We argue that auditability, not accuracy, is the axis on which ontology-grounded retrieval earns its cost.
Comments:
20 pages, 1 figure, 4 tables, 1 algorithm. Artifact deposit with configurations, ontology schema, prompts, audit reports and reconstruction scripts: this https URL
Subjects:
Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
ACMclasses:
H.3.3; I.2.4; I.2.7; J.1
Cite as:
arXiv:2608.20661 [cs.AI]
(or
arXiv:2608.20661v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.20661
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
41. 【2608.20647】Directional Contextual Representations for Dependency Relations: Why Cross-Direction Pairing Fails
链接：https://arxiv.org/abs/2608.20647
作者：Sai Krishna Arthanari,JaeHyeong Chang,Chengzhe Sun,Siwei Lyu
类目：Computation and Language (cs.CL)
关键词：LSTM contextual representation, bidirectional LSTM contextual, fused self-attention representation, dependency relation-type classification, strictly a function
备注：
点击查看摘要
Abstract:Splitting a bidirectional LSTM's contextual representation into a forward-only $F_i$ (strictly a function of tokens $1..i$) and a backward-only $B_i$ (strictly a function of tokens $i..n$) beats either alone and beats a fused self-attention representation for dependency relation-type classification. But a specific, natural extension of this idea -- pairing a token's forward state against a \emph{candidate}'s backward state (``cross-direction'' pairing, $F_i$ vs.\ $B_j$) -- consistently \emph{underperforms} same-direction pairing, and the penalty \emph{grows}, not shrinks, with token distance, both paired-bootstrap significant. We diagnose why using a frozen-trunk methodology: architectural information leakage between directions is impossible by construction (a single-layer BiLSTM, verified by code inspection); 93\% of the same-vs-cross gap survives freezing the trunk and training only fresh heads, ruling out training-co-adaptation as the primary cause; linear regression shows partial representational redundancy between $F_i$ and $B_i$ ($R^2{=}0.324$ vs.\ $0.028$ for a shuffled control) and a linear probe shows partial anticipatory encoding of upcoming tokens in $F_i$ (36.5\% vs.\ 17.2\% majority baseline) -- real effects, but neither alone, nor combined, cleanly explains the full gap. Extended frozen-trunk diagnostics (a positional probe and a distance-decay probe) show directional information is genuinely stored but not exactly positioned, and propagates only a few tokens before decaying to baseline -- consistent with, and mechanistically underneath, the distance-growth finding.
42. 【2608.20636】MIL-BERT: Classification of Arbitrarily Large Text with Performance and Explanatory Guarantees
链接：https://arxiv.org/abs/2608.20636
作者：John Cadigan,Dayne Freitag,Eric Yeh
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：text classification decisions, classification decisions, decisions are viable, viable based, text classification
备注：
点击查看摘要
Abstract:Many text classification decisions are viable based on constituent excerpts alone. Taking inspiration from the field of multiple instance learning, we present an algorithm for training a neural network to classify text by selecting such excerpts. We show that our approach is also scalable with demonstrated learning against samples with nearly 1M tokens. We evaluate our methods on 7 datasets with emphasis on long-textual collections that far exceed the encoding limit of our base model. We present state-of-the-art results with this algorithm on 3 datasets: identification of political bias in news outlets, trigger warnings in long stories, and demographic characteristics of authors in tweet collections. Furthermore, the model trained on weakly-labeled collections of text (bags) generalizes to accurately classify constituent, smaller instances. Besides a new state-of-the-art for these problems, this approach is one of the few neural methods to excel in these datasets.
43. 【2608.20634】AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale
链接：https://arxiv.org/abs/2608.20634
作者：Minbyul Jeong,Chanwoong Yoon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Agents learn, learn to act, manually constructed, constructed or synthesized, synthesized around predefined
备注：
点击查看摘要
Abstract:Agents learn to act through interaction with environments, yet the environments used for training are often manually constructed or synthesized around predefined tasks and benchmarks. This task-centric paradigm makes it difficult to scale environments that reflect realistic and evolving workflows where diverse tasks can naturally emerge from the underlying world. We introduce AgentMercury, a scalable framework for synthesizing executable environments from high-level business scenarios. Rather than constructing an environment for a specific task, AgentMercury first instantiates a persistent world with entities, services, tools, state, and executable cross-service invariants, from which diverse tasks and interaction trajectories can subsequently emerge. We construct 4,783 executable environments spanning 14 industries and 50 countries, and use them as training substrates for reinforcement learning. Despite being generated without targeting the evaluation benchmarks, policies trained on these business-oriented environments improve substantially on both enterprise workflows and out-of-domain benchmarks spanning reasoning, coding, scientific computing, and tool use. In our experiments, Qwen3.5-4B improves from 12.3 to 15.7 on EnterpriseOps-GYM and from 45.9 to 56.0 on AIME26 after training on AgentMercury environments. We further show that the construction process itself can be learned: fine-tuning Qwen3.5-35B-A3B on construction traces increases executable-world authoring success from 3.3% to 83.3% on held-out business scenarios. These results show that scenario-grounded environments can provide useful and generalizable learning signals beyond benchmark-specific training, while their construction can itself become a learnable capability.
44. 【2608.20632】Sparse Token Routing in Efficient Transformers
链接：https://arxiv.org/abs/2608.20632
作者：Sai Krishna Arthanari,JaeHyeong Chang,Chengzhe Sun,Siwei Lyu
类目：Computation and Language (cs.CL)
关键词：equal computational effort, require equal computational, Efficient-transformer research, motivates token pruning, tokens require equal
备注：
点击查看摘要
Abstract:Efficient-transformer research often motivates token pruning and adaptive computation with the claim that not all tokens require equal computational effort. We test this claim end to end using SEWN, a two-stream Transformer that routes tokens through either lightweight or full-capacity processing using a learned gate. Across our experiments, routing introduces negligible accuracy change relative to parameter-matched baselines, while the gate's token-importance signal depends critically on how it is learned. A static lexicon-seeded prior fails a counterfactual faithfulness test on BoolQ, whereas a fully contextual gate achieves highly significant separation ($p10^{-10}$) on both evaluated tasks without changing task accuracy.
45. 【2608.20627】When Failures Propagate: Causal Failure Attribution in Agentic Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2608.20627
作者：Lauren Pothuru
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Agentic retrieval-augmented generation, retrieval-augmented generation, agentic RAG, interleaves retrieval, answer generation
备注：
点击查看摘要
Abstract:Agentic retrieval-augmented generation (RAG) interleaves retrieval, reasoning, and answer generation across multiple hops. A retrieval error at hop 1 can surface only as a wrong answer at hop 3, while later retrieval can also repair the trajectory. This paper introduces AgenticRAG-FP, an interventional benchmark for causal failure attribution in agentic RAG. The benchmark injects a certified fault at a specified hop, re-executes the downstream trajectory, and evaluates diagnosers against the known intervention. Its central question is whether a post-hoc trace still identifies the injected hop after the suffix changes. In the completed strict dense Claude Haiku 4.5 sweep on 80 three-hop MuSiQue questions, coverage-based diagnosis is 0.91 at hop 1 and 0.00 at hops 2 and 3 (n=43,36,21 failed trajectories). A smaller content-corruption study changes an answer-bearing or bridge fact in topically intact evidence. At depth 2, where 18 failed cases remain after filtering, coverage-based diagnosis is 0.00 and a frozen-hop counterfactual probe is 0.67 in an exploratory pooled comparison. Depth-3 content estimates are descriptive only because they contain three failed cases. These results make propagation depth an explicit evaluation axis for diagnosing agentic RAG failures while distinguishing broad evidence of post-hoc signal loss from small-sample method comparisons.
46. 【2608.20607】JuryProbe: An Empirical Consensus-Risk Diagnostic for Routing Reference-Free Factuality Judge Panels to Grounded Verification
链接：https://arxiv.org/abs/2608.20607
作者：Tianxin Zhou,Ruixi Lin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：inexpensive LLM judges, LLM judges increasingly, inexpensive LLM, judges increasingly make, LLM judges
备注： 22 pages, 1 figure, 16 tables
点击查看摘要
Abstract:Panels of inexpensive LLM judges increasingly make accept-or-escalate decisions. In factuality settings, accepting a claim because several reference-free judges agree can create a hidden risk: agreement may reflect shared false-negative blind spots rather than independent evidence. We introduce JuryProbe, an empirical consensus-risk diagnostic for reference-free factuality judge panels, paired with a calibration-based routing policy. JuryProbe estimates consensus risk from a labeled calibration probe using false-negative-only (FN-only) judge correlation and false-consensus lift; when flagged high-risk, reference-free majority accepts are routed to the same judges with trusted references. On audited FEVER corruptions, reference-free panels show correlated false negatives (FN-only correlations 0.402 and 0.368; lifts 3.13x and 18.13x), while unanimous false consensus drops to zero under a trusted-reference best-case diagnostic on both minimal-pair and non-minimal-pair evidence. In flagged settings, the routed policy is by construction equivalent to grounding every reference-free majority accept (verified in 34/34 splits): improvement comes from accept-conditioned grounding, while the diagnostic determines whether to activate it. A fixed, pre-specified rule flags 8-10 of 10 splits across synthetic, benchmark-authored, and scientific families and 0 of 10 on a negative control, where standing down avoids 28% of reference acquisitions at a 0.004 increase in false accepts. False-accept reduction persists under weak BM25 retrieval at substantial coverage cost, while stale stand-down labels require periodic recalibration. JuryProbe provides no formal risk guarantee and does not establish reliable stand-down on natural panels; its supported contribution is an empirical diagnostic of high-risk panel error dependence.
47. 【2608.20569】Open-Weight Masked Introspection: Measuring What Language Models Can Report About Their Own Computation
链接：https://arxiv.org/abs/2608.20569
作者：Emilio Ferrara
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Open-Weight Masked Introspection, model, models, frontier models, open-weight models
备注： We release OWMI as a library so that this emerging ability can be measured as it develops. Hugging Face OWMI library: [this https URL](https://huggingface.co/emilioferrara/owmi)
点击查看摘要
Abstract:Are frontier models able to introspect about their internal states? Recent work suggests that under certain conditions a complex enough model can audit its own internals, call out what changed, and report back confidently about it. We tested that claim on eight open-weight models from seven families and found no such ability: asked whether their own computation had been altered, none answered better than chance. To test it we built Open-Weight Masked Introspection (OWMI), a framework that intervenes on residual-stream sites, attention heads and sparse-autoencoder features, then interrogates the model about the change against the null conditions an answer has to beat: sham runs where nothing was altered, impact-matched random perturbations, and a text-only observer that sees only the visible output. Over 78,000 measurements, no model's report discriminates a real intervention from a sham beyond chance (AUROC ~0.5007), and an equivalence test bounds the effect below 0.15 percentage points of AUROC. Surprisingly, all the information needed is in the models. A model fine-tuned to report this class of intervention reaches near-perfect recovery on held-out directions, and a linear probe recovers intervention presence from the same activations at 75% to 95.8% accuracy, sharpening to no held-out error at the last layer before the model speaks. In one model the signal surfaces in the confidence rather than the words: its yes-or-no report never varies, while the confidence attached to it separates intervention from sham at AUROC 0.647. The failure sits in the path from internal state to verbal report, so oversight that reads a model's own testimony needs validating against an internal reference. While our results show the inability of current open-weight models to introspect, the debate is not settled for future models.
Comments:
We release OWMI as a library so that this emerging ability can be measured as it develops. Hugging Face OWMI library: this https URL
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2608.20569 [cs.AI]
(or
arXiv:2608.20569v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.20569
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
48. 【2608.20530】LiLiCorr: Lightweight Likelihood Correlation of Parallel Drafts for Speculative Decoding
链接：https://arxiv.org/abs/2608.20530
作者：Matan Rusanovsky,Yoav Miron,Roy Uziel,Omer Belhasin,Ran Zilberstein,Maor Ashkenazi,Michael Elad
类目：Computation and Language (cs.CL)
关键词：accelerates language-model inference, Speculative decoding accelerates, drafting future tokens, decoding accelerates language-model, Speculative decoding
备注：
点击查看摘要
Abstract:Speculative decoding accelerates language-model inference by drafting future tokens that the target model verifies in parallel. A diffusion-style block head such as DFlash is an attractive drafter, predicting an entire block of future tokens in one forward pass. However, it is trained on per-position marginals rather than the joint block distribution, so the tokens it emits are individually plausible yet jointly incoherent. We introduce LiLiCorr, a Lightweight Likelihood-based model that Correlates the per-position marginal distributions a drafter already produces. It keeps the top-k tokens at each position as candidates and processes them jointly, producing for each an in and an out vector. A pair of adjacent candidates matches when the earlier one's out vector has high cosine similarity with the later one's in vector. These matches capture the block's joint structure without ever materializing the full joint distribution. One lightweight network pass produces all the vectors, and the pairwise scores are then computed in parallel as batched matrix operations, leaving only a cheap greedy walk sequential. We further co-train the drafter with LiLiCorr, so it learns to propose candidates that correlate into longer accepted sequences. Over the vanilla DFlash drafter, LiLiCorr raises acceptance length on every benchmark by 9 to 19%, while its scoring head accounts for about 2.8% of the per-block latency. Against DFlash and two concurrent methods that also restore coherence at draft time, LiLiCorr delivers the highest throughput in 70 of 72 settings: nine benchmarks at two target sizes under greedy and temperature-one decoding, and a throughput sweep over six concurrencies, two input lengths and three entropy tiers, with all systems equally optimized on a common serving stack. Extending LiLiCorr to inputs an order of magnitude longer than it was trained on preserves that lead.
49. 【2608.20432】ProofJudge: Tool-Grounded LLM Evaluation of Formal Proof Quality in Mathlib
链接：https://arxiv.org/abs/2608.20432
作者：Shane Caldwell
类目：Logic in Computer Science (cs.LO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：kernel type checker, nonetheless vary widely, formal proof quality, scores formal proof, pass the kernel
备注： 4 pages, 1 figure, 1 table
点击查看摘要
Abstract:Formal proofs in Lean 4 that pass the kernel's type checker can nonetheless vary widely in quality. We introduce ProofJudge, an agentic LLM-as-judge system that scores formal proof quality along five dimensions beyond correctness: library leverage, automation fit, structural clarity, statement quality, and Mathlib conventions. We evaluate ProofJudge on a novel dataset of 218 declarations drawn from distinct Mathlib PRs. The judge agent is grounded by tool access to the commit the PR is applied to, enabling it to query the library state when scoring. A judge is considered aligned with human preferences when it rates the version of the PR Mathlib accepted above the initial version that was sent back for revision. All six judge models evaluated recover the reviewers' preference well above chance, from 80.8% to 63.5%, and two open-weight judges reach roughly 70% at a tenth of the best judge's cost. We release the judge harness, evaluation dataset, and evaluation traces as open-source artifacts to support further research.
50. 【2608.20405】ARGUS: Theory-of-Mind Guided Argument Generation with Strategy-Aware Planning and Knowledge Grounding
链接：https://arxiv.org/abs/2608.20405
作者：Zhe Hu
类目：Computation and Language (cs.CL)
关键词：generation requires modeling, requires modeling audience, argument generation requires, Persuasive argument generation, factual grounding
备注：
点击查看摘要
Abstract:Persuasive argument generation requires modeling audience beliefs, rhetorical strategies, and factual grounding. Despite recent advancements, existing methods remain largely audience-agnostic and fail to integrate strategy selection to improve persuasiveness. To bridge this gap, we propose Argus, an agent-based framework that operationalizes classical rhetoric for persuasive writing. At its core, a Theory-of-Mind (ToM) Reasoner constructs an explicit dual mental model of the audience's beliefs and values to guide downstream decisions. This representation conditions a component-aware planner that decomposes the argument into subtopics, assigns fine-grained rhetorical functions (logos, pathos, ethos, kairos), and triggers strategy-guided evidence retrieval at planning time. Finally, a refinement module iteratively targets and resolves multi-dimensional weaknesses without quality regression. We evaluate Argus across three diverse benchmarks using both automated pairwise Elo and LLM-as-judge metrics. Results show that Argus consistently outperforms strong baselines across multiple backbone models, achieving top rankings and the highest overall scores. Targeted simulation experiments further validate its effectiveness in shifting resistant audience stances.
51. 【2608.20402】LingShu: A Large-Scale Symptom-Centric Contextualized Knowledge Graph Bridging Traditional Chinese Medicine and Modern Biomedicine
链接：https://arxiv.org/abs/2608.20402
作者：Rui Hua,Zixin Shu,Kai Chang,Dengying Yan,Jianan Xia,Hui Zhu,Shujie Song,Shurui Yang,Tongxin Wang,Yue Yin,Yu Wei,Lijuan Pei,Yunhui Hu,Hao Xu,Mingzhong Xiao,Xiaodong Li,Haibin Yu,Runshun Zhang,Wenjia Wang,Baoyan Liu,Xuezhong Zhou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Traditional Chinese Medicine, linking Traditional Chinese, traditional binary relations, traditional binary, struggle to represent
备注：
点击查看摘要
Abstract:Biomedical knowledge graphs (KGs) are pivotal for knowledge organization, yet traditional binary relations often struggle to represent the conditional nature of biomedical knowledge. Symptoms provide a shared phenotypic layer for linking Traditional Chinese Medicine (TCM), which relies on symptom patterns for syndrome differentiation and treatment selection, with modern biomedicine, which connects clinical manifestations to diseases and molecular mechanisms. We present LingShu, a large-scale symptom-centric contextualized knowledge graph designed to bridge TCM and modern biomedicine. The exported version of LingShu analyzed in this study comprises 17.33 million atom-level entity records and 39.47 million relation records, including 17.19 million semantic triples and 22.29 million contextualized quadruples. LingShu integrates multi-source data, including clinical electronic medical records, authoritative TCM texts, biomedical ontologies, and curated knowledge bases, through a pipeline combining natural language processing, terminology normalization, and human-in-the-loop verification. A key innovation of LingShu is its hybrid data model: it maintains 64 typed triple relation patterns to ensure broad connectivity, while incorporating 35 contextual quadruple relation patterns to capture conditional medical associations. This dual-structure approach explicitly encodes conditional knowledge, providing a granular representation of the contexts associated with medical relations. These contextualized relations cover syndrome-dependent herb efficacy, disease-contextualized drug effects, population-specific clinical associations, and mechanism-related therapeutic responses. Furthermore, we developed a web platform (this http URL) that integrates graph visualization, graph-based reasoning, and an evidence-grounded knowledge question-answering agent.
52. 【2608.20400】When Retrieval Fails Before It Begins: Structurally Indirect Prerequisite Eviction as a Retention Failure in Agentic Memory
链接：https://arxiv.org/abs/2608.20400
作者：Minkyu Song
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Agentic memory, fixed budget involves, involves two stages, Semantic Garbage Collection, Dependency-aware Semantic Garbage
备注： Accepted at the ICML 2026 Workshop on Failure Modes of Agentic AI (FAGEN@ICML 2026). Non-archival. Code: [this https URL](https://github.com/smkgenesis/dsgc)
点击查看摘要
Abstract:Agentic memory under a fixed budget involves two stages: retention and retrieval. Existing retrieval-centered paradigms implicitly assume necessary evidence survives eviction, but we challenge this by isolating a pre-retrieval failure mode: structurally indirect prerequisite eviction, in which upstream blocks weakly aligned with the query are discarded under budget pressure. We provide an operational definition of this failure, a reproducible deterministic benchmark, and per-seed trace diagnostics. Finally, we evaluate Dependency-aware Semantic Garbage Collection (DSGC), a one-hop graph-aware rule. In our main suite, DSGC improves full-chain retention from 0.03 to 0.90 under a lexical encoder and from 0.23 to 1.00 under a sentence encoder. Robustness checks then identify the budget and scaling regimes where the one-hop rule holds or degrades. Our released pipeline and failure postmortem support mechanistic analysis of retention before retrieval as a distinct failure boundary.
53. 【2608.20396】Self-Supervised Speech Representations Track Spoken Language Convergence to Adult Models in Infants and Children Who Are Deaf/Hard-of-Hearing
链接：https://arxiv.org/abs/2608.20396
作者：L. Choy,A. S. Khan,S. Patrizi,D. Ye,J. Gross,M. Cychosz
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：children, gradual convergence, speech, Abstract, Language
备注： 10 pages, 5 figures, 2026 ACL CDL Workshop
点击查看摘要
Abstract:Language development is characterized by a gradual convergence of children's speech toward adult patterns. Measuring this process has traditionally required detailed transcription and language-specific expertise, limiting scalability across languages and populations. Here, we use speech embeddings to capture this convergence directly from the acoustic signal in longform, child-centered recordings, taken as children go about their daily lives. Using HuBERT-BASE, we extracted embeddings from speech vocalizations of children who are deaf/hard-of-hearing and their female adult caregivers ($$925 hrs. observation). Embedding distance between children and caregivers decreased with hearing age, controlling for pitch and vocalization length, indicating, as expected, that children's speech patterns converge to caregivers over development. This single distance metric likewise related to multiple standardized measures of speech and language from infancy through preschoolhood. These results suggest a path toward scalable, language-neutral assessment of spoken language development from children's everyday lives.
54. 【2608.20394】A Factorial Ablation of a Speech-to-SFT Pipeline: Differential Effects on Data Quality and Downstream Transfer
链接：https://arxiv.org/abs/2608.20394
作者：Wonsup Shin,Jingu Kim
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：Industry pipelines, supervised fine-tuning, publicly ablated, leaving each stage, turn speech
备注： 20 pages, 2 figures
点击查看摘要
Abstract:Industry pipelines that turn speech into supervised fine-tuning (SFT) data via multi-stage refinement are increasingly adopted but, to our knowledge, have not been publicly ablated stage-by-stage, leaving each stage's marginal value unknown. We design a production-ready speech-to-SFT pipeline in which transcript refinement (Phase 0) and SFT data quality refinement (Phase 2) are independently toggleable, yielding a 2x2 factorial design. For each condition, we generate QA-form SFT data from Korean medical and finance conference recordings and fine-tune 9 models (5 LLM families, 2.4B-70B); we evaluate with four cross-provider LLM judges, a blind six-expert human evaluation, and 3 downstream MCQA benchmarks. Our central finding: under a fixed, standard SFT recipe, improvements in QA data quality do not transfer uniformly into downstream MCQA gains. 4-judge quality rises consistently, yet the cross-model mean MCQA gain is not significant; positive transfer concentrates on family-domain aligned pairs. This differential pattern is consistent with a format mismatch: Phase 2 shifts SFT-data composition toward explanatory items, while MCQA primarily probes factoid recall. All six human raters report higher full-pipeline quality, confirming the LLM-judge direction. An STT-engine swap to Whisper-medium confirms pipeline robustness. A non-hallucination audit shows the two frontier LLMs admit unknown on approximately 8% of QA on average; we release samples, prompts, code, and all SFT checkpoints.
55. 【2608.20393】Knowledge-Graph-Gated Defactualization for Style-Controllable and Fact-Preserving Generation in Agentic Conversational AI
链接：https://arxiv.org/abs/2608.20393
作者：Tanmay Kumar Shrivastava,Darsh Rohit Nandu,Rajesh Kumar Mundotiya
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Agentic large language, Agentic large, simultaneously preserve factual, preserve factual correctness, large language models
备注：
点击查看摘要
Abstract:Agentic large language models (LLMs) deployed in fact-sensitive applications such as customer support must simultaneously preserve factual correctness and generate responses in a controllable stylistic register. Activation steering enables fine-tuning-free style control by perturbing hidden representations, but it lacks an explicit mechanism for distinguishing verifiable facts from stylistic content, leading to semantic leakage. We address this challenge through \emph{Defactualize-Steer-Rehydrate} (DSR), a knowledge-engineering framework that integrates a typed, salience-weighted knowledge graph (KG) with activation steering. DSR extracts salient entities using a layered regex or NER or lexical-classifier pipeline, replaces them with typed placeholders prior to steering, and deterministically restores verified values through salience-guided rehydration after generation. DSR is evaluated across six LLaMA-family models (1B--13B parameters) on 600 A2A-generated customer-support cases (1,200 generations), with a dedicated KG ablation study. DSR significantly increases verified-entity recovery relative to a steering-only baseline (Cohen's $d=0.225$, $p_{\text{Bonf}}=1.0\times10^{-4}$), though the absolute recovery rate remains modest, while preserving effective style control across diverse model families. Layer-wise separability and steering-strength diagnostics further show previously unexplored interactions between representation-level steering and factual grounding. hese results demonstrate that explicit knowledge engineering can systematically enhance trustworthy, controllable, and reproducible generative AI without requiring model fine-tuning. Code, cached steering vectors, and evaluation scripts are publicly released to support reproducibility.\footnote{this https URL}
56. 【2608.20392】Evaluation-as-Search: Adaptive Discovery of Grounding Failures in Meeting Assistants
链接：https://arxiv.org/abs/2608.20392
作者：Sami Khairy,Yasaman Hosseinkashi,Vishak Gopal,Ross Cutler
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：specific discourse structures, fidelity remains limited, miss failure modes, failure modes tied, deployed at scale
备注：
点击查看摘要
Abstract:LLM-powered meeting assistants are deployed at scale, yet systematic evaluation of their grounding fidelity remains limited to static benchmarks that miss failure modes tied to specific discourse structures or reasoning demands. We propose Evaluation-as-Search (EaS), a feedback-driven methodology that frames quality evaluation as an adaptive search over the space of natural questions a meeting participant might ask. Rather than sampling uniformly, EaS learns from evaluator feedback across iterations to concentrate probing effort on cognitive demands where failures are most likely, guided by a UCB-scored coverage map and blind multi-dimensional quality evaluation. Using EaS, we construct MeetingProbe, a benchmark of over $3{,}000$ annotated question--answer pairs spanning 20 transcripts from three meeting genres and three LLM assistants. In ablations, adaptive search surfaces $2.5\times$ more failures than random probing ($7.1\%$ vs. $2.9\%$ finding rate), with the strategic planner contributing the largest individual effect. Across three models, we observe a clear capability gradient and identify eight recurring failure categories dominated by discourse-pragmatic challenges rather than factual recall errors. We further validate MeetingProbe across multiple model families and providers, finding a clean capability gradient and a curated subset of universal failures that no model handles. MeetingProbe is released publicly to support reproducible evaluation of meeting assistant grounding fidelity.
57. 【2608.20391】ImmigrationReason: A Structured Dataset of U.S. Immigration Appeals for Legal Reasoning Research
链接：https://arxiv.org/abs/2608.20391
作者：Amirhossein Afsharrad,Seyed Shahabeddin Mousavi
类目：Computation and Language (cs.CL)
关键词：NLP resources draw, federal case law, legal NLP resources, government decisions occur, Administrative Appeals Office
备注：
点击查看摘要
Abstract:Most legal NLP resources draw from federal case law and focus on coarse classification, leaving administrative adjudication, where the vast majority of government decisions occur, essentially unaddressed. We introduce ImmigrationReason, a large-scale structured dataset derived from 12,375 non-precedent decisions of the U.S. Citizenship and Immigration Services (USCIS) Administrative Appeals Office (AAO) spanning 2005 to 2026. Each record captures the applicable legal framework, per-criterion evidence-sufficiency findings under a five-category label, verbatim adjudicator-criticism quotes, all citations, and final dispositions, alongside high-quality Claude-transcribed source text. Extraction quality is validated through a three-pass pipeline combining two independent modalities with comparison-prompt adjudication by Opus 4.7, and verified by domain experts on a 500-record sample. The dataset documents nearly 9,000 verbatim instances of AAO-identified legal errors, spans a natural legal-regime transition (the 2016 Dhanasar rule change), and covers 21 years of adjudication. We analyze the dataset in detail and outline research directions it enables, from outcome prediction and adjudicator-error analysis to agent design for high-stakes regulatory domains.
58. 【2608.20390】Ansari: A Retrieval-Grounded Islamic AI Assistant -- Architecture, Deployment, and Lessons from 140,000 Conversations
链接：https://arxiv.org/abs/2608.20390
作者：M Waleed Kadous,Amr Elsayed,Abdullah Al Nahas,Ashraf Haress
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：inventing Qur'anic verses, General-purpose large language, answer religious questions, inventing Qur'anic, General-purpose large
备注： 10 pages, 1 figure, 3 tables. Live system: [this https URL](https://askansari.ai) . Code: [this https URL](https://github.com/ansari-project)
点击查看摘要
Abstract:General-purpose large language models (LLMs) are increasingly used to answer religious questions, but for Islamic content they carry two serious risks: factual fabrication (inventing Qur'anic verses or hadith) and subtle value misalignment. We present Ansari, a deployed, retrieval-grounded Islamic AI assistant that has handled more than 140,000 conversations across 25+ languages since June 2023. Ansari is built around an agentic retrieval loop: a tool-using language model issues searches against authenticated Islamic corpora -- the Qur'an, hadith collections, a multi-volume jurisprudence (fiqh) encyclopedia, and exegetical (tafsir) sources -- and answers only on the basis of what it retrieves, with citations attached for verification. We describe the system's architecture (the agent loop, the retrieval tools, the corpora, and the system prompt that encodes editorial and theological policy), its multi-platform deployment (web, mobile, WhatsApp, and as a Model Context Protocol server and an Agent Skill), and what 140,000 real conversations reveal about how Muslims actually use such a tool. We report results on several complementary evaluations -- zero-shot performance on accredited institutional exams, a human-rated validation during Ramadan, and two independent, externally run benchmarks on which Ansari currently tops the public IslamicMMLU leaderboard ahead of frontier models and is competitive on Islamic legal reasoning (IslamicLegalBench) while strongly resisting false premises -- and draw out lessons that generalize beyond Islam to any faith- or values-sensitive deployment of LLMs: grounding is necessary but not sufficient, the system prompt is a theological as much as a technical artifact, and the absence of community in how models are formed remains a hard gap.
59. 【2608.20388】Intent Engine: Natural-Language Intent Translation for Intent-Driven Orchestration in the Compute Continuum
链接：https://arxiv.org/abs/2608.20388
作者：Koushikur Islam,Rodrigo N. Calheiros
类目：Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：low-level Service-level Objectives, Service-level Objectives, increases misconfiguration risk, low-level Service-level, metric-level constraints creates
备注：
点击查看摘要
Abstract:Microservice placement in the compute continuum is driven by low-level Service-level Objectives (SLOs), but requiring users to specify metric-level constraints creates an adoption barrier and increases misconfiguration risk. Although large language models (LLMs) can interpret natural-language intents, direct generation of orchestration-consumable SLO artifacts remains unreliable due to unsupported constraints, incorrect grounded values, and schema violations. These errors can propagate to downstream placement logic and produce infeasible or incorrect placements. This paper presents Intent Engine, a natural-language intent translation architecture that constructs validated SLO artifacts for compute-continuum service placement. Intent Engine acts as an intent acquisition and SLO construction layer for existing intent-driven orchestration and placement frameworks; it does not perform placement or runtime QoS optimization. The architecture combines schema-constrained extraction, retrieval-grounded value construction from monitored infrastructure state, and validation against supported constraints before emitting the final SLO artifact. We evaluate Intent Engine using a 716-record intent-to-SLO dataset derived from an edge-cloud testbed, including valid and invalid intents. Across GPT-4.1 mini, Claude Sonnet 4.5, and DeepSeek V4-Flash, Intent Engine outperforms prompting baselines and a non-LLM rule-based parser. With GPT-4.1 mini, it achieves 0.941 total F1 Score and reduces aggregate hallucination by 85.1%, while lowering downstream placement failure from 30.8% to 2.1%.
60. 【2608.20387】Poly-InstructTTS: Learning In-the-Wild Expressive Speech Synthesis from Open-Ended Instructions
链接：https://arxiv.org/abs/2608.20387
作者：Junhui Zhang,Qianhui Xu,Qingxiang Guo,Dawei Yang,Ling Miao,Qiangqiang Wang,Yang Song
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：models achieve high, achieve high naturalness, controlling fine-grained expression, instructions remains challenging, natural-language instructions remains
备注： Accepted to Interspeech 2026. Demo page: [this https URL](https://zhangjh915.github.io/PolyInstructTTS-demo/)
点击查看摘要
Abstract:While recent text-to-speech (TTS) models achieve high naturalness, controlling fine-grained expression via natural-language instructions remains challenging. We introduce Poly- InstructTTS, which learns expressive speech from open-ended instructions using in-the-wild audiovisual data. We build a scalable multi-modal pipeline to construct a 1,000-hour instruction-annotated corpus covering 1,000+ fine-grained emotions and styles. The framework uses a prompt-free GPT with attribute-based thinking tokens, followed by a flow-matching module that injects timbre from a reference audio. We also present a speaker fine-tuning procedure to transfer instruction control to specific speakers while preserving persona. We further extend InstructTTSEval with broader tasks. Experiments show that Poly-InstructTTS delivers strong performance in instruction adherence and expressiveness. Audio demos and the expanded testset are available on our project page.
61. 【2608.20385】Using Human-LLM Disagreement to Improve Checklist-Based Quality Appraisal
链接：https://arxiv.org/abs/2608.20385
作者：Timo van der Kuil(1),Bruno Messina Coimbra(1),Mirjam van Zuiden(2),Robert A. Bagheri(1),Rens van de Schoot(1),Klaas Dieleman(1),Berend Greijn(1),Stefan Houkes(1),Sebastiaan Rodenhuis(1),Elizabeth M. Grandfield(1) ((1) Methodology and Statistics Utrecht University, (2) Clinical Psychology Utrecht University)
类目：Computation and Language (cs.CL)
关键词：Systematic reviews rely, Systematic reviews, reviews rely, rely on quality, time-consuming and sensitive
备注： 31 pages, 8 figures
点击查看摘要
Abstract:Systematic reviews rely on quality appraisal of included studies, a process that is time-consuming and sensitive to ambiguity in checklist criteria. Although large language models (LLMs) offer opportunities to support these tasks, appraisal checklists are typically treated as fixed inputs, and it remains unclear how their design affects agreement with expert judgments. Therefore, we investigate (1) whether LLMs can approximate human judgments in checklist-based appraisal and (2) whether patterns of human-LLM disagreement can be used to identify and improve ambiguous checklist items. Using the Guidelines for Reporting on Latent Trajectory Studies (GRoLTS) checklist, we compare LLM-generated assessments with expert annotations across three research topics and two checklist versions. Agreement is assessed using item-level accuracy, chance-corrected agreement, and preservation of study-level rank ordering. We find that performance varies substantially across checklist items, with ambiguous and conditional criteria producing the greatest disagreement. Revising these items improves both raw and chance-corrected agreement. Although item-level misclassifications persist, LLM-generated scores often preserve the relative ranking of studies when high-agreement items are retained. These results indicate that reliable LLM-assisted appraisal depends not only on model choice but also on checklist design. The findings suggest that analyzing human-LLM disagreement can help identify problematic checklist items and support the iterative improvement of research synthesis workflows.
Comments:
31 pages, 8 figures
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.20385 [cs.CL]
(or
arXiv:2608.20385v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.20385
Focus to learn more
arXiv-issued DOI via DataCite</p>
62. 【2608.20382】Decoupled Vision-Language System for Multimodal Understanding and Generation
链接：https://arxiv.org/abs/2608.20382
作者：Yifan Xu,Baochen Xiong,Xiaoshan Yang,Donglin Di,Yaowei Wang,Changsheng Xu
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, multimodal large language, language models, large language, Libra architecture
备注：
点击查看摘要
Abstract:We introduce a new architecture design for multimodal large language models (MLLMs), Libra, capable of both multimodal understanding and generation. Libra architecture contains one vision system and one language system, connected by cross-modal bridges. This design decouples self-modal modeling and cross-modal interaction, enabling each modality to learn its unique representations while maintaining effective cross-modal comprehension. The decoupling is mainly achieved in a switch attention module and a switch FFN module, which dynamically routes the computation flow for self-modal modeling and cross-modal interaction scenarios. We evaluate the effectiveness in two important settings: \textbf{Libra-1} for the understanding-only image-to-text setting, and \textbf{Libra-2} for unified image-to-text understanding and text-to-image generation. In addition to the architecture design, we discuss various improvements on tokenization, positional encoding, and supervision. Experiments demonstrate that the dedicated Libra design enables mutual improvements on multimodal understanding and generation, achieving strong performance on both understanding and generation benchmarks.
63. 【2608.20381】EditPPT: Faithful Long-Deck Slide Editing via Structured Tool-Using Multi-Agent with Dual-Modal Validators
链接：https://arxiv.org/abs/2608.20381
作者：Jiheon Kim,Kyudan Jung,Jaegul Choo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：satisfying modification accuracy, requires simultaneously satisfying, simultaneously satisfying modification, Automating slide editing, editing requires simultaneously
备注： 30 pages, 7 figures, 17 tables, EMNLP 2026 submitted, under review
点击查看摘要
Abstract:Automating slide editing requires simultaneously satisfying modification accuracy, preservation fidelity, and robustness to deck length. Existing LLM-based systems often fail on real-world presentation files because they rely on idealized intermediate representations or open-ended code generation, which are prone to cascading errors in long decks. We introduce EditPPT, a multi-agent framework that reformulates slide editing as a constrained tool-selection problem. By executing localized shape-level operations through the native PowerPoint COM interface, EditPPT narrows the LLM action space while preserving the application-resolved structure of user-authored decks. By separating validation across modalities, our dual-modal validation provides more robust assessment of both instruction fidelity and visual quality. We also present DeckEdit-Bench, a benchmark with 28 human-authored decks, 582 slides, and 183 editing prompts across short, medium, and long deck tiers. Experiments show that EditPPT achieves a 99.5% execution rate, 88.7% slide-targeting F1, 82.5% instruction following, and 91.5% object preservation overall, while maintaining strong performance on long decks. Our code and benchmark are available at this https URL
64. 【2608.20376】H-GNN: Heterogeneous Temporal Graph Neural Networks for LLM-Agent Shilling Attack Detection
链接：https://arxiv.org/abs/2608.20376
作者：Shivam Swarup,Divya Prakash Shrivastava,Rakesh Thakur
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：systematically defeating recommender-system, defeating recommender-system defenses, LLM agents, realistic shilling profiles, generate realistic shilling
备注：
点击查看摘要
Abstract:LLM agents can now generate realistic shilling profiles, fluent reviews, and coherent ratings at scale, systematically defeating recommender-system defenses. Text-only detectors that flag semantic drift in review embeddings are blind to graph structure and temporal coordination, while graph-only detectors that exploit neighborhood anomalies cannot reason over review semantics or the cross-modal inconsistencies produced by LLM-generated content. We propose TH-GNN, a heterogeneous temporal graph neural network with a two-layer Heterogeneous Graph Transformer backbone that applies per-type and per-relation attention augmented with learnable sinusoidal temporal encodings on every edge. Cross-modal attention fuses structural user embeddings with frozen RoBERTa representations of reviews and item descriptions, while a GRU operating over log inter-arrival times captures temporal burstiness. Evaluated across five attack families and four benchmark datasets, TH-GNN achieves a grand-mean F1 score of 0.870, outperforming the strongest text-only baseline on Agent4SR attacks by 10.9 percentage points and 11.5 percentage points at the lowest injection rate. These results demonstrate the effectiveness of jointly modeling temporal, structural, and semantic signals for detecting sophisticated LLM-driven shilling attacks.
65. 【2608.20375】GRAFT: Adaptive DLM-Based Draft Tree Construction with Target-Distilled Edge Scoring
链接：https://arxiv.org/abs/2608.20375
作者：Xuming Ye,Zeming Ma,Runjie Yu,Yuan Liu,Tianle Li,Shuhan Bai,Jian Zhou,Fei Wu
类目：Computation and Language (cs.CL)
关键词：builders typically construct, Tree-based speculative decoding, Tree-based speculative, parent-conditioned expansion, existing tree builders
备注：
点击查看摘要
Abstract:Tree-based speculative decoding raises the mean accepted tokens of standard speculative decoding by verifying multiple draft paths, and existing tree builders typically construct these paths through parent-conditioned expansion, where each child token is generated conditioned on its parent path. This construction is incompatible with diffusion language model (DLM) drafters such as DFlash, which produces all future-position distributions in a single forward pass. DDTree bridges this gap by treating high-probability tokens from each future-position distribution as candidate nodes and selecting edges between consecutive positions under a fixed node budget. However, its edge selection relies on token probability alone without modeling parent--child compatibility, so target-compatible tokens can be attached to wrong parents; moreover, its fixed budget ignores that the throughput-optimal tree size varies with the decoding state. We propose GRAFT, a draft-tree construction framework for DLM-based speculative decoding. GRAFT introduces Target-Distilled Edge Scoring (TDES), which distills parent--child preferences from target-model traces to select target-compatible edges, and State-Aware Budget Allocation (SABA), which sets the per-round tree budget by balancing expected draft gain against verification cost. Across multiple models and tasks, GRAFT achieves $2.13\times$--$6.36\times$ end-to-end speedup over autoregressive decoding while adding less than $0.5$\,ms of overhead per round, approximately $1.4\%$ of the target-model verification latency.
66. 【2608.20374】VA-DPO: Valence-Arousal Direct Preference Optimization for Controllable Emotion Generation in Language Models
链接：https://arxiv.org/abs/2608.20374
作者：Hyunwoo Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Direct Preference Optimization, language model, emotional generation answers, Preference Optimization, Direct Preference
备注： 9 pages, 1 figure, 5 tables
点击查看摘要
Abstract:How precisely can we tell a language model how to feel? Most work on emotional generation answers with a discrete label - happy, angry, sad - which cannot express a target like "mildly downcast but calm." We instead specify the desired affect as a continuous point (v*, a*) in the Valence-Arousal plane and train the model to hit it. Our method, VA-DPO, is a small modification to Direct Preference Optimization: a frozen VA regressor scores each sampled generation by its Euclidean distance to the target, we keep only candidate pairs whose distance gap clears a margin tau, and we optimize a LoRA adapter with the ordinary DPO loss against a frozen reference. The DPO objective itself is unchanged; what is new is how the preference data is built. On Llama-3.1-8B-Instruct this cuts mean VA distance to the target by 33% over system-prompting and 25% over few-shot prompting, lifting valence/arousal correlation to r_v=0.93 and r_a=0.75. The gains carry over to Qwen3-8B and Llama-3.2-3B, and they do not come at the usual price: MMLU is unchanged (Delta=+0.0) and HellaSwag and TruthfulQA are preserved. We release the code, configs, and the preference-construction pipeline.
67. 【2608.20373】An ambiguity taxonomy for evaluating large language model performance on clinical registry abstraction: a multi-site prospective study
链接：https://arxiv.org/abs/2608.20373
作者：James Matheson,Betsy Castillo,Andrew Y. Shin,David Scheinker
类目：Computation and Language (cs.CL)
关键词：Cardiology National Cardiovascular, evaluate large language, National Cardiovascular Data, electronic medical record, ACC NCDR registry
备注：
点击查看摘要
Abstract:Objective: To evaluate large language model (LLM) performance on unprocessed electronic medical record (EMR) data for clinical registry abstraction. Methods: We evaluated LLM performance answering registry questions for the American College of Cardiology National Cardiovascular Data Registry (ACC NCDR). In a pilot study at an academic medical center, the model identified candidate data sources for each registry question and experienced abstractors used these results to define question-specific document sets. In a validation study at a second center with a second ACC NCDR registry, the LLM answered questions using the question-specific document sets. Before reviewing any output, two abstractors independently established the ground truth and assigned each question to one of six categories, ordered by the ambiguity and clinical reasoning required to resolve it: Medication/Event Flag, Binary Clinical Presence, Administrative, Quantitative Laboratory/Physiologic, Clinical Interpretation, and Event Timing. Results: The analytical sample comprised 9,430 abstractor answers reconciled to 4,715 consensus answers (501 pilot; 4,214 validation). In the pilot, candidate data sources per question averaged between 14.6 (SD 13.9) for demographics and 89.2 (SD 56.1) for history and risk factors. In validation, human inter-rater agreement was approximately 98\% while 87\% of LLM answers exactly matched consensus, 2\% partially, and 9\% did not. Mean question-level accuracy was 91.5\% (SD 13.4\%) across 157 questions with at least 20 answers, and declined as ambiguity increased, from 96\% for Medication/Event Flag to 62\% for Event Timing questions. Conclusions: LLMs answering clinical registry questions on unprocessed EMR data achieved far lower accuracy than human abstractors. LLM accuracy fell steadily as ambiguity and the level of required clinical reasoning increased.
68. 【2608.20371】When Do LLMs Replace Fine-Tuned NLU? A Decision Framework for Intent Detection in Production Conversational Systems
链接：https://arxiv.org/abs/2608.20371
作者：Carson Rodrigues,Oysturn Vas
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：replace fine-tuned NLU, zero-shot large language, fine-tuned NLU classifiers, large language models, fine-tuned NLU
备注： 6 pages
点击查看摘要
Abstract:A common claim is that zero-shot large language models (LLMs) can replace fine-tuned NLU classifiers for intent detection. We test this claim head-to-head and find that the honest answer is: it depends on the intent space. On full ATIS and CLINC150 we compare a fine-tuned RoBERTa, a TF-IDF+logistic-regression baseline, sentence-embedding kNN, and Claude Haiku zero-shot, reporting bootstrap 95% confidence intervals and paired significance tests. When abundant in-domain labels exist, fine-tuned RoBERTa is as good or better and three orders of magnitude cheaper and faster: on ATIS it beats Claude zero-shot by 11.8 points (95.9 vs. 84.1, p0.001). On the broad 150-intent CLINC150 schema the two are statistically tied (89.1 vs. 88.5, p=0.24): the LLM matches a fully supervised model with no training data. The LLM's advantages appear in three production-relevant regimes: out-of-scope detection (OOS recall 85.6 vs. 58.1 for RoBERTa); robustness to realistic ASR noise via a controlled text-to-speech to noise to Whisper pipeline (92.5 vs. 80.0 at 0 dB); and dynamic per-deployment schemas, where a classifier trained on one app's intents scores 0% on a new app's intents while the schema-prompted LLM serves both at ~94% with zero retraining. We distill these findings into a decision framework for practitioners.
69. 【2608.20369】ASTAR: Automated induction of STAndardized radiology Reporting templates from large-scale clinical free-text corpora
链接：https://arxiv.org/abs/2608.20369
作者：Xinfeng Zhang,Mingxuan Liu,Yifei Chen,Juncheng Zhu,Kasidit Anmahapong,Yiming Huang,Yuan Zhang,Hongjia Yang,Yi Liao,Gang Ning,Haibo Qu,Qiyuan Tian
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Structured reporting converts, facilitating cohort assembly, queryable data keys, training label generation, Structured reporting
备注： Accepted by MICCAI
点击查看摘要
Abstract:Structured reporting converts free-text radiology narratives into queryable data keys, facilitating cohort assembly, longitudinal tracking, and training label generation for medical AI. The prevailing paradigm follows a two-stage pipeline: (1) constructing a reporting template, (2) extracting information to populate it. While the extraction stage has benefited from advances in large language models (LLMs), template construction remains a manual bottleneck relying on labor-intensive expert consensus that is static, difficult to scale, and may fail to capture real-world reporting diversity. We address this limitation with \textbf{\texttt{ASTAR}}, an LLM-based framework for Automated induction of STAndardized radiology Reporting templates from large-scale clinical free-text corpora. Extensive experiments on 4,215 fetal brain MRI reports from multiple centers demonstrate that the \textbf{\texttt{ASTAR}}-induced template surpasses two expert-curated templates across template coverage, information fidelity, diagnostic fidelity, and expert-rated usability, reducing template development from weeks of committee deliberation to hours of automated processing. Code: this https URL
70. 【2608.20368】Research Paper Quality Recognition Through Textual Feature Analysis
链接：https://arxiv.org/abs/2608.20368
作者：Saikiran Korla,Sadwik Gummadavelli,Trung-Nghia Le,Minh-Triet Tran,Tam V. Nguyen
类目：Computation and Language (cs.CL)
关键词：Knowledge and innovations, innovations are shaped, Support Vector Machines, Knowledge, scientific research
备注： SOICT 2025
点击查看摘要
Abstract:Knowledge and innovations are shaped by using the quality and credibility of the scientific research. Yet, distinguishing between impactful, high-quality work and flawed studies remains a challenge. This paper introduces a benchmark for classifying research papers into two categories: good (highly cited) and non-good (retracted), using only textual features from titles and abstracts. We evaluate multiple embedding techniques, including SBERT, Word2Vec, FastText, USE, and TF-IDF, combined with classifiers such as Support Vector Machines (SVM), Random Forests, and Neural Networks. Our contributions include: (1) hyperparameter transparency, (2) feature space visualizations using t-SNE, (3) model interpretability analysis with SHAP, and (4) detailed examination of error cases. Experimental results show that a neural network with SBERT embeddings achieves 87.22\% accuracy, while FastText combined with SVM reaches 91.12\%. These findings highlight the value of textual information in assessing research quality, with ethical considerations for deployment. This work contributes toward the development of academic integrity tools that promote trustworthy scholarship.
71. 【2608.20365】rilingual Topic Modeling of Sri Lankan Parliamentary Debates
链接：https://arxiv.org/abs/2608.20365
作者：Himath Dhanapala,Haren Daishika,Himandhi Kuruppu,Sithija Seneviratne,Ashini Kavindya,Patalee Narasinghe,Sandeepa Weerasekara,Nisansa de Silva,Sandareka Wickramanayake
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Sri Lankan parliamentary, Lankan parliamentary debates, Sri Lankan, standard NLP pipelines, including code-mixed content
备注：
点击查看摘要
Abstract:Sri Lankan parliamentary debates (Hansards) constitute a trilingual corpus of speeches in Sinhala, Tamil, and English, including code-mixed content, yet remain inaccessible to standard NLP pipelines due to layout-complex PDFs, multilingual scripts, and agglutinative morphology. We present an end-to-end framework that addresses these challenges through LLM-based text extraction followed by a multilingual embedding and density-based clustering pipeline for topic modeling. A hybrid semantic-lexical extension, BiTopic, is further explored to improve interpretability and recover speeches otherwise discarded as noise. Applied to 19,553 speeches spanning 2017-2026, the pipeline recovers 30 macro-topics achieving a cluster purity (BCP) of 0.673, whose temporal trajectories align unsupervised with major national events including the 2019 Easter Sunday attacks and the 2022 economic crisis. Traditional LDA fails on this corpus due to cross-lingual fragmentation, whereas the proposed approach successfully identifies thematic structure across all three languages without supervision.
72. 【2608.20364】Hadith computational science in the age of large language models: a critical narrative review
链接：https://arxiv.org/abs/2608.20364
作者：Md. Ashraful Haque(1),Riasat Islam(1 and 2) ((1) Greentech Apps Foundation, United Kingdom, (2) Queen Mary University of London, London, United Kingdom)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, hadith computational science, retrieval-grounded pipelines, computational science, reshaped by transformer
备注： Submitted to Artificial Intelligence Review
点击查看摘要
Abstract:We examine how hadith computational science is being reshaped by transformer models, retrieval-grounded pipelines, and large language models (LLMs). Recent reviews document growth in the literature, but they do not yet provide a critical account of which advances are methodologically robust, which remain benchmark-bound, and which unresolved problems still limit scholarly use. We address this gap through a critical narrative review that combines critique of existing reviews, paper-level appraisal of representative original studies, and synthesis of Islamic scholar and domain-expert perspectives on authenticity, authority, and responsible use. We find uneven progress. Data resources have expanded, segmentation tasks have matured, narrator and source-verification problems are better formalized, and LLM-assisted workflows now support corpus-scale enrichment, multilingual access, and grounded evaluation. At the same time, progress remains constrained by narrow corpora, weak benchmark comparability, synthetic-to-real transfer gaps, narrator identity resolution, preprocessing fragility, limited reproducibility, and sparse expert-grounded validation. We show that important gaps lie beyond dominant benchmarks: non-canonical and obscure corpora, commentary and explanatory literature, cross-source links with Qur'an and seerah, and fiqh-facing evidence support. We argue that hadith computation should be assessed less as isolated model performance than as an evidence infrastructure problem requiring knowledge integration, provenance, and expert supervision. On this basis, we define a research agenda for making the field methodologically stronger and more useful to Islamic scholarship.
73. 【2608.20362】Multilingual Verifier Bias in RLVR: Benchmark, Rollout Diagnosis, and the Cross-Lingual Selection Bottleneck
链接：https://arxiv.org/abs/2608.20362
作者：Chenyu Zhou,Qiliang Jiang,Xu Zhou
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：language-neutral reward function, Reinforcement learning, multilingual RLVR rewards, answer verifier serves, mathematical reasoning
备注： 16 pages, 2 figures, 5 tables
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) is a standard recipe for training large language models on mathematical reasoning, where an answer verifier serves as a language-neutral reward function. We show that this assumption fails in multilingual settings: an exact-match verifier turns format and script variation into language-dependent false-negative reward noise. We introduce a reusable protocol for auditing multilingual RLVR rewards: a verifier-robustness suite, a rollout-diagnosis procedure, and language-conditioned reward-error metrics for Japanese, English, and Chinese answers. On MGSM rollouts with k=8, the exact-match proxy rejects trusted-correct answers at sharply different rates by language across Qwen3-4B, Qwen3-8B, and Llama-3.1-8B-Instruct; for Qwen3-8B, the false-negative rate reaches 0.642 on JP against 0.122 on EN and 0.073 on CN. A plain-numeric probe localizes the mechanism to the final-answer interface: an interface model drives reward-error VLB to zero while the residual accuracy gap is unchanged. We then expose a cross-lingual selection bottleneck: on MGSM250 rollouts, a target-local aggregation rule using no trusted labels closes 55-78% of the average selection gap, and over 95% of repairs require genuine cross-lingual support. The bottleneck replicates on a 483-problem MATH-500 set. A controlled training audit shows that rule-GRPO raises trusted accuracy while the reward-error VLB stays high. The unifying message is operational: multilingual RLVR rewards should be audited by language and by answer interface before they are optimized.
74. 【2608.20361】oward Auto-Research: Mining Falsifiable Research Ideas from Paper Knowledge Graphs with Categorical Structure
链接：https://arxiv.org/abs/2608.20361
作者：Yuchen Wang,Zhongzhi Luan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Automated research-idea generation, research-idea generation systems, generation systems built, random paper pairing, large language models
备注： 18 pages, 10 figures
点击查看摘要
Abstract:Automated research-idea generation systems built on large language models (LLMs) share a structural weakness: they reduce ideation to free-text recombination, random paper pairing, or embedding-similarity retrieval. The three approaches fail in the same way: each treats a paper as a flat object, a string or a vector, and so quotients away the typed problem-method-metric-claim arrows a researcher actually uses when reasoning about a cross-domain analogy. We recover the missing structure with the minimal piece of category theory that a typed graph alone does not provide: composition, together with identity arrows, which makes it possible to ask whether a proposed analogy preserves relation chains. Concretely, each paper $p$ is modelled as a small category $C_p$ whose objects are extracted typed research entities and whose morphisms are the relations the paper asserts; a cross-paper bridge from $p$ to $q$ is then a partial functor candidate $F: C_p - C_q$ that preserves object kinds and covered relation classes. We instantiate the model as a three-layer algorithm: categorical signature clustering, a functor-preservation gate, and a six-axis LLM plausibility judge. Evaluated on a corpus of tens of thousands of full-text-parsed papers under four ablation conditions, the categorical gate filters cross-domain candidates at roughly a 17:1 ratio while the quantitative-falsifier rate of accepted ideas stays above 83% throughout; every rejected candidate is retained with its per-axis rationale, so the gate doubles as a logging layer rather than a silent filter.
75. 【2608.20360】riPLU: Bypassing the Gate with Direct Trilinear Product FFNs in Tiny Language Models
链接：https://arxiv.org/abs/2608.20360
作者：He Zhang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：learned feature projections, tiny decoder-only language, decoder-only language models, language models benefit, directly multiply learned
备注：
点击查看摘要
Abstract:We study whether tiny decoder-only language models benefit from feed-forward layers that directly multiply learned feature projections. TriPLU, a Trilinear Product Linear Unit, replaces the usual gated FFN branch with a product-only degree-3 branch that multiplies three projected streams coordinatewise. In a character-level TinyStories 1M-byte prefix study, TriPLU reaches a mean best validation loss of 1.0637, compared with 1.1017 for closely matched SwiGLU, 1.0780 for a degree-4 product control, and 1.1026 for a degree-2 control. In train-only Byte-BPE experiments, TriPLU also lowers validation and heldout bits per byte on TinyStories and WikiText-2 raw under low-learning-rate settings, with PMI-slice evidence suggesting gains on seen middle- and high-PMI adjacent-token pairs. Constant-learning-rate diagnostics show that product-branch normalization can reduce the high-learning-rate best-checkpoint gap, although final BPB still degrades under hot schedules. The resulting claim is deliberately narrow: direct product FFNs can improve fixed-budget small-model loss in specific low-compute regimes, but the branch is optimization-sensitive and does not establish FLOP-normalized efficiency, scaling behavior, or broad LLM performance.
76. 【2608.20359】Self-Speculation for Faster Reasoning Models
链接：https://arxiv.org/abs/2608.20359
作者：Ravisri Valluri,Tung Nguyen,Aditya Grover
类目：Computation and Language (cs.CL)
关键词：multi-step decision making, increasingly complex tasks, complex tasks involving, tasks involving planning, requires generating long
备注：
点击查看摘要
Abstract:Large language models (LLMs) are deployed for increasingly complex tasks involving planning and multi-step decision making, but high-quality performance on these tasks often requires generating long reasoning traces. This is a poor fit for latency-sensitive and interactive applications like voice assistants or coding agents, where generation latency can strongly affect user experience. Existing acceleration methods typically focus on token-level generation, without utilizing the structure of reasoning workflows. We introduce SSR: Self-Speculation for Reasoning Models, a training-free self-speculative decoding method that leverages the chain-of-thought (CoT) as a source of speculation. SSR uses the partial-CoT answer distribution as the drafter and the full-CoT distribution as the verifier, deriving both from the same model at different reasoning budgets. This builds on the observation that later partial-CoT responses often exhibit greater semantic and lexical overlap with the full-budget response. Due to this overlap, SSR can accept long draft prefixes at once, leading to large speedups on structured and long-form generation tasks. To further exploit draft-response overlap beyond the contiguous prefix accepted by standard speculative decoding, SSR also incorporates suffix decoding, using the draft to seed a suffix cache and recover useful spans beyond the accepted prefix, further reducing latency on tasks with high lexical overlap between the draft and the final response. We evaluate SSR on multiple structured and long-form generation tasks where it is most useful, and demonstrate a relative improvement of up to 24.1% on total generation latency for popular open-source models such as Qwen3.5 and Gemma-4.
77. 【2608.20355】ExpertIVS: Sociological Expert Driven Individual Value Simulation in Large Language Models
链接：https://arxiv.org/abs/2608.20355
作者：Zhen Wang,Yuqi Ren,Yuehan Cui,Hongxiang Wang,Jianxiang Peng,Zhaoxia Zhang,Bingkun Zhu,Tongxuan Zhang,Dezhi Tong,Deyi Xiong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Model, Large Language, Language Model, demonstrated considerable potential, accurately model individual
备注：
点击查看摘要
Abstract:Large Language Model (LLM) agents have demonstrated considerable potential for social simulation, yet struggle to accurately model individual value systems. Most existing methods mechanically stitch survey responses into prompts, which suffer from semantic fragmentation, failing to capture the internal coherence of human value systems. The value systems of LLMs are typically assessed using static multiple-choice questions, which fail to evaluate the value orientation in real-world dialogue interactions. To address these issues, we propose ExpertIVS, a framework employing 14 Sociological Expert Agents to interpret World Values Survey (WVS) responses through structured professional perspectives, rather than direct responses concatenation. These expert agents perform deep semantic reconstruction to generate robust and internally consistent individual profiles. To evaluate the consistency between LLMs and individual value systems during dynamic interactions, we further introduce a multi-agent debate mechanism. Extensive experiments across 480 individuals from 12 countries demonstrate that ExpertIVS achieves 90.78% value restoration fidelity and significantly outperforms baselines in value generalization (+5.3%). Moreover, ExpertIVS exhibits strong personality discriminability and behavioral consistency, enabling a shift from mere response concatenation to genuine sociological role-playing.
78. 【2608.20353】he Divergence Hypothesis: Unmasking Lexical Interference and Label Bias in Mental Health NLP
链接：https://arxiv.org/abs/2608.20353
作者：Moustafa Yehia Hassan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Computational mental health, distant-supervision pipelines reward, Computational mental, mental health, classifiers often degrade
备注： 14 pages including appendices. Code, decontamination scripts, and qualitative workbook are publicly available
点击查看摘要
Abstract:Computational mental health (CMH) classifiers often degrade under distribution shift because human annotators and distant-supervision pipelines reward different linguistic signals. We introduce TSS (Triple-Stream Stress probe), a multi-channel diagnostic framework that decomposes text into (A) lexical character n-grams, (B) a small, mostly content-free morpho-syntactic channel, and (C) a 154-feature psycholinguistic style channel. Across four English datasets (N=12,906), TSS reveals a lexical interference effect: adding lexical features to the style channel reduces Macro-F1 on human-labeled data (mean drop 0.072, p10^-4) but not on auto-labeled data. We propose Degree of Divergence (DoD), a difference-in-differences statistic adapted from econometrics for label-source auditing, with instance-level bootstrap inference; the headline estimate is DoD(BC-A) = 0.0374, 95% CI [0.0097, 0.0651], p=0.0032. A platform-stratified Twitter-only DoD (which removes the Reddit vs. Twitter contrast) reproduces the pattern with bootstrap inference: DoD-Tw(BC-A) = +0.096 (p0.001) and DoD-Tw(AC-A) = -0.089 (p0.001). Interventional masking (pos_only) retains ~95-99% of Channel C's performance after destroying content words on human datasets, indicating that the style channel does not rely primarily on lexical surface form. TSS is positioned as a diagnostic audit framework, not a clinical screening tool: it flags label-source-specific shortcut learning before generalization claims are made.
79. 【2608.20351】Exploratory As-Analyzed No-Detection of Culturally-Marked Predicate-Triggered PII Amplification in a Synthetic-English RAG Probe: A Predicate-Resource-Confounded Audit
链接：https://arxiv.org/abs/2608.20351
作者：Yanhang Li,Zhichao Fan,Zexin Zhuang
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：otherwise-equivalent neutral queries, marked people leak, English PII corpus, synthetic English PII, stereotype-loaded queries
备注：
点击查看摘要
Abstract:We ask whether stereotype-loaded queries about culturally marked people leak more personal information from a retrieval-augmented generation (RAG) system than otherwise-equivalent neutral queries. We pre-register a four-culture audit (en-Anglo, es-LATAM, Arabic, Hindi) on a synthetic English PII corpus, comparing five query arms we call the Stereotype-Trigger Leakage Delta (STLD). Two caveats up front. Our locked confirmatory estimator was never run, so every test in the paper is exploratory or sensitivity, with all plan deviations listed in the appendix. And the name-leakage metric is contaminated by a prompt-echo artifact: the model often just re-emits the name we asked about, which inflates apparent leakage without any retrieval at all. On the cleaner channels (email, phone, ssn-like, address), we find no stereotype-driven amplification on any of the four cultures after multiple-comparison correction. Because our sample is only powered for mid-sized effects, and because the culturally marked probes mix stereotype content with cultural markers and heritage practices, we present this as no detection, not evidence of no effect, of culturally marked predicate leakage that is confounded with the underlying resource.
80. 【2608.20350】How to Train a Real-World Silicon Concierge? Internalizing Complex Business Workflow to Only OneModel
链接：https://arxiv.org/abs/2608.20350
作者：Chang Liu,Chaoyang Ning,Dayi Jiang,Enrui Gu,Fang Ran,Hongyan Xue,Huaqing Li,Hui Cai,Jia Liu,Jiang-Ming Yang,Jianshe Li,Jiawei Luo,Jin Zhou,Leshen Zhu,Lihui Chen,Liying Ma,Lyuxin Xue,Mengjian Ji,Ruijia Xu,Wei Ren,Wei Wu,Xiaoling Qu,Xiaoyun Feng,Xin Zhang,Xixie Zhou,Xuanwei Hu,Yan Chen,Yichao Wang,Yongqi Tong,Yu Liu,Yuhong Zhou,Zemin Sun,Zhenwen Xu,Zhiling Liu,Zifan Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：including Router, Traditional industrial agents, Traditional industrial, Retriever, Planner
备注： Accepted to the ACL 2026 Industry Track (Oral). To appear in Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Industry Track)
点击查看摘要
Abstract:Traditional industrial agents rely on modular pipelines, including Router, Retriever, Planner, Executor, Responder, Reviewer, and other components. These systems often fracture into a labyrinth of ad-hoc patches, leading to cascading errors and high latency. We propose OneModel, an applicable paradigm shift from external workflows to internalized knowledge representation. Unlike modular systems that slice fluid user intents into static steps, OneModel consolidates complex business logic and SOPs directly into the model parameters. Through Continual Pre-training (CPT) and logic-compilation SFT, we transform fragmented business rules into intuitive model reasoning within a unified attention space. Deployed in our global financial service system, OneModel effectively breaks the trade-off between latency, accuracy, and complexity. Online A/B testing demonstrates an end-to-end latency reduction of more than 50 percent, from 18.7 seconds to 8.0 seconds, while the Intelligent Resolution Rate (IRR) increases from 64.3 percent to 83.3 percent. The results show that OneModel can replace brittle engineering logic with internalized cognitive intuition, offering a scalable blueprint for transitioning industrial agents from complex, error-prone workflows to unified model architectures.
81. 【2608.20349】Beyond Prompt Engineering: A Systematic Analysis of Prompt Lexical Sensitivity and Its Impacts on Quality
链接：https://arxiv.org/abs/2608.20349
作者：Qipeng Xie,Zi Liang,Jiafei Wu,Yufei Chen,Weizheng Wang,Wenao Ma,Zhong Ming,Haiqin Yang,Kaishun Wu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, exhibit extreme sensitivity, surface-level prompt variations, disproportionate performance fluctuations
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) exhibit extreme sensitivity to surface-level prompt variations, in which minor lexical changes can trigger disproportionate performance fluctuations. Moving beyond black-box optimization and coarse-grained templates, we present the first large-scale, n-gram token-level mechanistic analysis of prompt stability, leveraging a dataset of 132,000 prompt variants. Our investigation reveals a fundamental Scaling Law of Prompt Performance Stability: higher average task performance is strongly associated with lower variance and greater robustness across prompt perturbation. We identify two core linguistic drivers underlying this robustness: (1) Domain-Specific Terminology, which tightly anchors semantic boundaries, and (2) Explicit Action Directives, which formalize reasoning trajectories. Together, these elements constrain the model's interpretative space, effectively ``locking in'' more deterministic generation behavior. Building on these insights, we introduce an automated Prompt-Refining Agent that systematically restructures input queries by injecting domain anchoring and operational constraints. Empirical evaluation shows that our approach reduces performance variance by 40.7% in code generation task, while preserving or improving mean performance. These findings provide a statistically grounded and mechanistically interpretable framework for achieving robust prompt engineering.
82. 【2608.20348】Inhibitory Attention for Clinical Long-Context Reasoning: Characterizing and Mitigating Lost-in-the-Middle Effects in EHR Processing
链接：https://arxiv.org/abs/2608.20348
作者：Sanjay Basu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Electronic health records, Electronic health, tokens per patient, routinely exceed, health records
备注： 29 pages, 5 figures. Code: [this https URL](https://github.com/sanjaybasu/inhibitory-attention-ehr)
点击查看摘要
Abstract:Electronic health records now routinely exceed 100,000 tokens per patient. Yet large language models exhibit the lost-in-the-middle (LitM) effect: information near the center of a long context is retrieved less reliably than information near the edges. In clinical use this is not benign: the single most consequential fact in a note can sit at its center. We term this the clinical lost-in-the-middle (CLitM) problem, give its first systematic characterization using MedAlign, and compare context-selection strategies as remedies. Across 2,196 instruction-response pairs and six language models, we observe a 21.9 percentage-point gap between peak accuracy (59.5%, 95% CI [46.3, 71.0], 20-30% decile) and trough accuracy (37.6% [23.2, 52.5] at 70-80%); 67.8% of reference answers fall between the 10th and 90th percentiles of the EHR timeline, inside the CLitM trough. We introduce Query-Conditioned Clinical Suppression (QCCS), a lightweight query-conditioned selection gate, and evaluate it against BM25, BM25 with section-header filtering, dense retrieval, and cross-encoder reranking (N=83 held-out instructions). With Qwen2.5-7B-Instruct (16k context), QCCS outperforms all five comparators under LLM-as-judge scoring: for middle-position instructions QCCS reaches 16.7% versus BM25 3.3%, cross-encoder 0.0%, dense 0.0%, and full context 6.7%; overall QCCS reaches 25.3% versus at most 3.6% for retrieval-only comparators. This advantage is not explained by retrieval recall: at k=20, BM25 retrieves the gold evidence sentence in 98.8% of instructions (QCCS 34.9%), yet retrieval arms stay at most 2.6% accurate even when they retrieve it, whereas QCCS reaches 25.0% even when it does not. In this proof-of-concept evaluation, query-aligned context selection predicts EHR instruction-following accuracy better than gold-sentence retrieval recall.
83. 【2608.20347】Who Do Language Models Think Is Competent? A Mechanistic Analysis of Occupational Bias
链接：https://arxiv.org/abs/2608.20347
作者：Keren Fuentes,Aaron Mueller
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Language models, behavioral bias evaluations, remains unclear, longer represent, represent the underlying
备注：
点击查看摘要
Abstract:Language models (LMs) often pass behavioral bias evaluations, but it remains unclear whether they no longer represent the underlying associations that give rise to biases, or have merely learned not to express them. In this study, we show that representational biases are often detectable, even when behavioral biases are not visible. We introduce a causal framework that decomposes occupational bias into two measurement points: a model's internal representation of a user's competence, and its observable outputs. We derive steering vectors for representations of user expertise, and verify that they causally mediate model behavior in both a question-answering task and a hiring task. Applying this framework to several open-weight models, we find that demographic attributes, such as gender, race, and socioeconomic status, influence a model's representation of user expertise, even in cases where behavioral metrics detect no disparity between demographics. We show that these model representations can influence downstream behavior under intervention, suggesting failure modes that behavioral metrics alone may not detect.
84. 【2608.20346】Building and Evaluating a Synthetic Bengali Speech Resource for Telecom Customer Care
链接：https://arxiv.org/abs/2608.20346
作者：Kawshik Kumar Paul,Md. Nafiul Alam Fuji
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：domain-specific language coverage, require domain-specific language, language coverage, customer-facing applications, applications often require
备注： Dataset URL: [this https URL](https://huggingface.co/datasets/kawshikbuet17/bengali-telecom-customer-care-speech)
点击查看摘要
Abstract:Speech systems used in customer-facing applications often require domain-specific language coverage. We present a synthetic Bengali speech dataset for telecom customer-care scenarios. The dataset contains 10,000 audio-text pairs, approximately 26.82 hours of 24 kHz speech, and predefined train, validation, and test splits of 9,000, 500, and 500 examples. It is publicly released on Hugging Face under the CC-BY-4.0 license. The speech was generated with OmniVoice in voice-cloning mode using a real female reference recording and transcript, with bfloat16 precision, 16 diffusion sampling steps, and a speaking-rate control value of 1.0. Along with the original Bengali text, the dataset provides a normalized transcript field designed for ASR/STT training and evaluation. We report an automatic intelligibility check over all 10,000 samples using a domain-adapted Whisper ASR model fine-tuned from bengaliAI/tugstugi_bengaliai-regional-asr_whisper-medium, along with a manual listening check on selected samples. The evaluation gives an average WER of 2.54%, an average CER of 0.59%, and median WER and CER values of 0.00%. These results suggest strong text-audio consistency under the selected automatic evaluation pipeline, while the paper also discusses the limitations of synthetic speech and STT-based evaluation.
85. 【2608.20345】When Vocabulary Comprehension Fails Clinical Reasoning: Evaluating Therapy Bots' Safety Risks for Generation Alpha
链接：https://arxiv.org/abs/2608.20345
作者：Manisha Mehta,Virendra Mehta
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Gen Alpha, resources for Generation, Generation Alpha, Gen Alpha mental, Gen Alpha versions
备注： 42 pages, 6 figures. Accepted at ACM FAccT '26
点击查看摘要
Abstract:Conversational AI systems have become informal mental health support resources for Generation Alpha (Gen Alpha, born 2010-2024), with 13.1% of U.S. adolescents (5.4 million) using generative AI for mental health advice. While these systems, from therapy apps to general chatbots, rely on large language models trained on extensive psychological literature, their safety for youth communication patterns characterized by hyperbolic language, ironic positivity, rapid semantic drift, and contextual polysemy remains unvalidated. Following multiple adolescent deaths linked to AI chatbot interactions, systematic evaluation is critical. We present two benchmarks: (1) 64 Gen Alpha mental health expressions validated by native speakers (ICC=0.72) and clinicians (kappa=0.78); (2) 75 multi-turn conversations (780 turns) with paired Standard/Gen Alpha versions. Across evaluations of LLM architectures underlying therapy apps and general chatbots - Claude, GPT-4o, Llama-3.1 - models understand 76-82% of vocabulary but correctly calibrate only 64-72% of clinical risk, creating a 10-14 percentage point (pp) vocabulary-comprehension gap (p.001, d0.48) absent in human therapists (3pp, p=.22). The gap is architecturally consistent and widens with ambiguity (7pp - 18pp). We identify six failure patterns: sarcasm masking (29pp), minimization acceptance (43pp), informal style bias (24pp), risk-stratified ambiguity (19pp), semantic drift (19pp), context-dependent violence (7pp). Patterns compound; three or more yield 94% miss rates. Lightweight mitigations fail; only heavy scaffolding achieves human performance (6.4x cost). With 34% baseline miss rate yielding 146,880 estimated annual missed crises, we recommend mandatory human-in-the-loop architectures, quarterly youth-specific validation, transparent performance disclosure, and regulatory frameworks for youth-facing mental health AI.
86. 【2608.20344】Beyond Raw Transcripts: Structured Persona Extraction for LLM-Based Digital Twins
链接：https://arxiv.org/abs/2608.20344
作者：Iris Ye,Tianze Deng,Ozan Candogan
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：individual prior responses, aim to simulate, behavein new environments, environments or respond, individual prior
备注： Preprint. Submitted to NeurIPS 2026
点击查看摘要
Abstract:LLM-based "digital twins" aim to simulate how an individual would behavein new environments or respond to novel questions, given some representation of that individual's prior responses. A common approach constructs this representation from survey transcripts or summaries responses. Prior work shows that compressing long transcripts into shorter LLM-generated summaries does not significantly reduce predictive accuracy, suggesting that information volume is not the primary bottleneck. In this work, we argue that the key limitation is instead structural:how persona information is organized before being provided to thesimulator model. We study this by comparing unstructured summaries with structured persona representations. First, we introduce a hand-craftedschema (BDE: Background, Decision procedure, Evaluation), grounded in consumer-behavior theory, and show that it improves predictive accuracy over raw transcripts by +1.91 percentage points on a homogeneous benchmark (Twin-2K-500), with similar gains on gpt-5.4-mini and Qwen3-8B as robustness checks. However, this fixed structure does not generalizeacross more heterogeneous tasks, where performance is statistically indistinguishable from the raw transcript baseline. To address this limitation, we propose an automatic structure-discovery pipeline in which an LLM iteratively proposes and refines task-specific persona structures and extraction prompts. On a benchmark of 13 diverse sub-studies, this approach restores performance, improving mean accuracy by +1.91 percentage points over the raw transcript baseline and eliminating significant losses observed with the fixed schema. Overall, our results suggest that the main constraint in LLM-based digital twins is not how much information is provided, but how it is structured -- and that the optimal structure depends on the task.
Comments:
Preprint. Submitted to NeurIPS 2026
Subjects:
Computation and Language (cs.CL); Computers and Society (cs.CY)
Cite as:
arXiv:2608.20344 [cs.CL]
(or
arXiv:2608.20344v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.20344
Focus to learn more
arXiv-issued DOI via DataCite
Submission history From: Tianze Deng Mr. [view email] [v1]
Sat, 13 Jun 2026 19:00:54 UTC (220 KB)
87. 【2608.21343】urboBias 2.0: Streaming Context-Biasing for Production-Efficient ASR Systems
链接：https://arxiv.org/abs/2608.21343
作者：Vladimir Bataev,Lilit Grigoryan,Andrei Andrusenko,Nikolay Karpov,Vitaly Lavrukhin,Boris Ginsburg
类目：Audio and Speech Processing (eess.AS); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
关键词：Transducer-based ASR systems, Contextualization is essential, production ASR systems, production automatic speech, ASR systems
备注：
点击查看摘要
Abstract:Contextualization is essential for production automatic speech recognition (ASR) systems, where user-provided phrases must be recognized accurately under strict latency constraints. Although many context-biasing methods improve recognition accuracy, they often do not address the practical requirements of modern production ASR systems: streaming inference, efficient batched decoding, user-specific context lists, and low runtime overhead. We propose TurboBias 2.0, a production-oriented framework for efficient phrase boosting in Transducer-based ASR systems. The framework extends GPU-accelerated TurboBias with a case-insensitive boosting graph and per-stream batched decoding, allowing each utterance in a batch to use an independent context-biasing configuration. This enables personalized context biasing for multiple simultaneous users without sharing or mixing their context lists. The proposed framework supports both offline and streaming inference and can be used with greedy and beam-search decoding. Experiments show that TurboBias 2.0 improves contextual phrase recognition while preserving low latency and high throughput.
信息检索
1. 【2608.21252】EnSI-RAG: Entity-Structure-Indexed Retrieval-Augmented Generation for Long-Document Question Answering
链接：https://arxiv.org/abs/2608.21252
作者：Xuanyu Meng,Jiashuo Sun,Jash Rajesh Parekh,Jiawei Han
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：connected documents remains, documents remains challenging, span multiple entities, remains challenging, challenging because relevant
备注： 21 pages, preprint
点击查看摘要
Abstract:Question answering (QA) over long, connected documents remains challenging because relevant evidence may span multiple entities and their relationships. Existing retrieval-augmented generation (RAG) methods typically index documents as raw chunks and retrieve them through embedding similarity. Their performance degrades when chunk boundaries separate entities from supporting evidence or when a question requires multi-hop reasoning across the corpus. We propose EnSI-RAG (Entity-Structure-Indexed Retrieval-Augmented Generation), a framework that constructs a query-independent, entity-centered index. Each record (e, t, k, v) represents an entity e, its type t, a semantic category k in {property, relation, aspect}, and a value v, while retaining links to the original source passages. At query time, these records serve as retrieval handles, and an LLM synthesizes the retrieved passages into the final answer. This design separates evidence localization from answer synthesis while preserving traceable source evidence. Across Loong and Oolong, EnSI-RAG achieves an average accuracy of 78.24. Relative to the published baseline scores used as references, this is 6.62 points higher, suggesting its effectiveness across these settings. The code is available at this https URL.
2. 【2608.21243】Adapting Knowledge Graphs for Behavior Denoising in Sequential Recommendation
链接：https://arxiv.org/abs/2608.21243
作者：Zichun Jin,Zihan Zhou,Yinan Liu,Bin Wang,Xiaochun Yang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：equally informative, user interaction history, Sequential recommendation predicts, user interaction, recommendation predicts
备注：
点击查看摘要
Abstract:Sequential recommendation predicts the next item from a user's interaction history, but not every interaction is equally informative. Real logs combine persistent preferences with temporary needs, exploration, and incidental behavior, so some interactions can distort history representations or provide unreliable supervision. Existing denoising methods judge such interactions mainly from co-occurrence, order, or model predictions, without explicit evidence from relations between items. Knowledge graphs (KGs) offer this evidence, but item popularity, graph degree, uneven coverage, and widely shared entities can inflate connectivity and bias reliability estimates. Here we present AdaptedKG, which derives calibrated KG evidence for each training example without adding graph representations to the recommendation model. It first compares the observed context with structurally matched alternatives to identify relational paths that are unusually prominent and uses them to build a local KG view. It then compares each interaction with structurally matched reference items to calibrate its support within that view. The resulting retention coefficients gate historical representations and reweight target losses. All sample-specific scores are computed offline using training interactions and a fixed KG, so the backbone remains unchanged and no KG access is required at inference. Experiments show gains with a standard sequential recommender and multiple behavior-denoising sequential recommenders.
3. 【2608.21218】Enhancing LLMs in Predictive Political QA with Semi-Structured Data
链接：https://arxiv.org/abs/2608.21218
作者：Yinan Liu,Zihan Zhou,Zichun Jin,Xinyu Wang,Bin Wang,Xiaochun Yang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：political question answering, question answering, factual lookup, Predictive political question, political
备注：
点击查看摘要
Abstract:Predictive political question answering (QA), such as predicting how a political actor will vote, goes beyond factual lookup. External political resources offer rich historical evidence, but rarely contain the answer itself. Existing LLM augmentation methods, including actor-profile-based simulation and knowledge graph evidence injection, improve political reasoning but largely treat external resources as knowledge-based evidence, leaving prediction-relevant signals under-modeled. We identify two complementary signals for predictive political QA: actor stances that capture issue-specific preferences, and high-order structure signals that capture indirect dependencies among political actors. We propose PSL, a dual-view framework that converts semi-structured political records into inference-oriented evidence for LLMs. PSL extracts stance signals from question-relevant actor records in a semantic view, and learns structure-aware actor representations from an actor interaction graph in a vector view. Across three real-world datasets and multiple LLMs, PSL consistently outperforms baselines, with ablations confirming the complementary gains of stance and structure signals.
4. 【2608.21156】Graph Engineering in the Era of LLM Agents: From Individual Intelligence to System Intelligence
链接：https://arxiv.org/abs/2608.21156
作者：Yuyuan Feng,Zhishang Xiang,Chaobin Yang,Qichao Ma,Zerui Chen,Yujing Zhang,Ke Huang,Chuanjie Wu,Zhaoxu Liu,Yili Wang,Xin He,Jiapu Wang,Zijin Hong,Hao Chen,Yuanchen Bei,Kun Wang,Shengyuan Chen,Ningyu Zhang,Enyan Dai,Linhao Luo,Qingyi Pan,Qi Wang,Wenqi Fan,Guangjing Wang,Na Zou,Yangqiu Song,Xin Wang,Zechao Li,Xia Hu,Qing Li,Xiao Huang,Zhihong Zhang,Jinsong Su,Qinggang Zhang,Yi Chang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET)
关键词：Graph Engineering, autonomous agents capable, including Prompt Engineering, Engineering, evolved from language
备注：
点击查看摘要
Abstract:LLMs have evolved from language generators to autonomous agents capable of complex, long-horizon tasks. This evolution has produced paradigms including Prompt Engineering to elicit model capabilities, Context Engineering to manage information access, Harness Engineering to organize external tools and resources, and Loop Engineering to support continual reflection and self-improvement. Yet as tasks grow more complex, individual intelligence faces a fundamental limit: many tasks require heterogeneous expertise, interdependent subtasks, parallel execution, independent verification, and persistent state, exceeding any single agent's organizational capacity. Augmenting one agent's capabilities or context cannot resolve this architectural mismatch; intelligence must instead be distributed across specialized agents and organized at the system level. We call this System Intelligence: an agent system's ability to organize and coordinate multiple intelligent components into a coherent, adaptive whole pursuing a shared objective. Achieving it requires more than adding agents; it demands explicit structures to organize work, coordinate heterogeneous agents, and maintain evolving execution states. We introduce Graph Engineering, an emerging paradigm for next-generation agent systems. Unlike prior paradigms that mainly optimize individual interactions or agent-level behavior, Graph Engineering constructs explicit, dynamic, evolving graph structures representing tasks, agents, and system states. These abstractions provide a unified foundation for organizing complex objectives, orchestrating heterogeneous agents, modeling system dynamics, and enabling scalable agent evolution. We systematically review the principles, methodologies, and applications of Graph Engineering for LLM agents. Related papers, open-source data, and projects are collected at this https URL.
5. 【2608.21095】rustworthy RAG: An Evaluation Agent for Detecting Misinformation and Knowledge Poisoning in Generative AI Systems
链接：https://arxiv.org/abs/2608.21095
作者：Balkrishna Giri,Md Toufique Hasan,Jussi Rasku,Muhammad Waseem,Pekka Abrahamsson
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：grounds Large Language, Large Language Model, guarantee factual truth, grounds Large, RAG systems
备注： 7 pages, 1 figure. Accepted for publication in the Main Research Track of the Twenty-First International Conference on Software Engineering Advances (ICSEA 2026)
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) grounds Large Language Model (LLM) outputs in external knowledge, but RAG systems usually trust whatever they retrieve, creating a Security-Reliability Gap: high semantic relevance does not guarantee factual truth. Adversaries exploit this through knowledge poisoning, inserting malicious documents to cause targeted misinformation. We propose an Evaluation Agent, middleware that combines Natural Language Inference (NLI) factual verification, a five-signal poison detector with relevance-weighted aggregation, and a Trust Index T = 0.4 F + 0.35 C + 0.25 (1 - P ) with a non-linear dampener for high-contamination contexts. On TruthfulQA with Llama 3.3 70B, the agent reaches 91% accuracy and 100% precision, with 100% recall on instruction injection, while in-place edits, such as entity swaps, remain hard to detect. Across three LLMs the Trust Index stays discriminative, with a Receiver Operating Characteristic Area Under the Curve (ROC-AUC) of 0.73 to 0.81; generation style matters more than model size, and per-LLM threshold calibration restores baseline competitive accuracy, whereas a weaker FEVER result shows that cross-dataset generalization requires domain-specific calibration. In a software-engineering use case, a secure-coding assistant over guidance from the Open Worldwide Application Security Project (OWASP) Top 10 and the Common Weakness Enumeration (CWE), the agent reliably blocks instruction injection of unsafe advice (F1 92%), while contradiction and subtle semantic weakening remain hard. Throughout, the agent measures detection of poisoned context before generation, not whether the LLM adopts the injected misinformation. We release the proposed approach, attack generator, and experimental artifacts at the link: this https URL.
6. 【2608.21012】From a Static Multi-Level Small Semantic Codebook to a Dynamic Single-Level Large Semantic Codebook for Generative Recommendation
链接：https://arxiv.org/abs/2608.21012
作者：Tianlu Xie,Xin Ku,Mingjie Sun,Yunhao Sha,Lixiang Wang,Peng Wang,Yiyu Wang,Wenjin Wu,Zhaojie Liu,Peng Jiang,Wenwu Ou
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Generative recommendation represents, discrete Semantic IDs, Generative recommendation, recommendation represents, Semantic IDs
备注： 6 figures, 10 tables, and 1 algorithm
点击查看摘要
Abstract:Generative recommendation represents each item with a sequence of discrete Semantic IDs (SIDs) and predicts the sequence to retrieve the next item. Typical systems use multi-level residual quantization, which increases autoregressive decoding cost and creates a large hierarchical space that may be sparsely occupied. Static codebooks also become misaligned with current traffic as new items arrive and exposure distributions change. We propose a single-level large semantic codebook that replaces multiple residual semantic codes with one semantic token while retaining a separate collaborative disambiguation token to reduce item collisions. We further introduce an exposure-aware dynamic update mechanism based on temporal weight decay, exponential moving-average center updates, and an exposure-weighted penalty on SID changes. We also develop an offline evaluation framework covering representation quality, code utilization, cluster load, full-SID collision, and temporal stability. On two public datasets, the two-level SID improves mean Recall@10 by 5.0%-8.8% and mean NDCG@10 by 4.1%-5.1% for OneRec-V1, and by 7.1%-8.7% and 3.8%-8.5%, respectively, for OneRec-V2. Dynamic updating provides further gains on KuaiRec. Across three serving architectures, the shorter SID reduces estimated autoregressive-decoding FLOPs by 47.93%-48.70% and increases single-card QPS by 28.57%-47.0%. A five-day online A/B test serving 2.5% of production traffic improves the primary consumption metric by 0.792%.
7. 【2608.20845】RAG Deserves an Index: Why Ingest-Time Compilation Beats Query-Time Interpretation
链接：https://arxiv.org/abs/2608.20845
作者：Kyle Wild,Yusuke Takahashi,Asako Uraki
类目：Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：language model re-derives, raw corpus text, retrieval-augmented question-answering system, hidden interpreter, retrieval-augmented question-answering
备注： Position paper. 6 pages, 2 figures, 2 tables
点击查看摘要
Abstract:Nearly every retrieval-augmented question-answering system in production ships with a hidden interpreter: on each query a language model re-derives the meaning of raw corpus text and then throws that work away. Cheaper models do not close the gap: per-token prices have fallen by orders of magnitude while inference spend has risen, because context volume grows faster than prices fall. This is the modern equivalent of the full-table scan, and the remedy is the one databases found fifty years ago: do the expensive work once, at write time, into a maintained structure that makes reads cheap. A corpus whose read pattern is known before it ever meets a user can and should be indexed too. We call the paradigm ingest-time semantic compilation (ISC): compile a corpus's meaning into a queryable substrate with two coupled layers - incrementally maintained embeddings, and atomic claims whose provenance is validated at compile time - and treat that substrate as a first-class database object with its own DDL, maintenance contract, migration contract, and cost model. Two existence proofs support it. Substrate upkeep scales with change rather than corpus size: incremental updates run 33.7x cheaper than reconstruction while tracking it to floating-point precision. And on a held-out sample of 500 broadcast-interview transcripts, compiled claims as the retrieval payload win all 32 budget-by-model cells: 85.2% correct from roughly 2.2k reader tokens against 72.5% from 16.3k for the best chunk configuration anywhere. The only baseline that keeps pace is a contextualized-chunk pipeline with hybrid retrieval and reranking, statistically indistinguishable from compiled claims at roughly twenty-one times the query-path tokens - and it reaches that parity, we argue, precisely because it has itself begun to compile. We close with the systems agenda this opens, from compilation planners to read planning.
Comments:
Position paper. 6 pages, 2 figures, 2 tables
Subjects:
Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.20845 [cs.AI]
(or
arXiv:2608.20845v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.20845
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2608.20840】KoViDoRe: Korean Visual Document Retrieval
链接：https://arxiv.org/abs/2608.20840
作者：Yongbin Choi,Yongwoo Song,Mujeen Sung
类目：Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Korean visual document, Recent advances, Korean visual, Korean visual documents, visually rich documents
备注：
点击查看摘要
Abstract:Recent advances in multimodal retrieval have improved the ability to retrieve information from visually rich documents such as PDFs and reports. However, existing benchmarks remain largely centered on English and provide limited coverage of Korean visual documents with complex structures. Furthermore, most existing Korean resources primarily evaluate single-page retrieval, failing to capture realistic scenarios that require evidence aggregation across multiple pages. To address these gaps, we introduce KoViDoRe, a benchmark for Korean visual document retrieval. The dataset is constructed from publicly available Korean documents with diverse layouts, including tables, figures, and multi-column structures. We develop a multi-stage data curation pipeline consisting of structured document parsing, synthetic query generation using both summary-based and context-based strategies, and relevance mapping with human verification. Using KoViDoRe, we evaluate a wide range of multimodal retrieval models and observe that current models struggle to effectively handle Korean visual document retrieval, particularly in settings involving structured content and diverse query types. Motivated by this finding, we further curate a large-scale training dataset, Ko-VDR Train Public, to support the development of retrieval models tailored to Korean visual documents. Together, KoViDoRe and Ko-VDR Train Public provide a unified benchmark and training resource for Korean visual document retrieval.
9. 【2608.20801】Profiling What Matters: Context-Aware Item Profiles from Large-Scale Metadata for LLM Recommenders
链接：https://arxiv.org/abs/2608.20801
作者：Dojun Hwang,Seunghan Lee,Cheonyoung Park,Sara Yu,SeongKu Kang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Language Models, Large Language, information remains challenging, significantly advanced reranking
备注： Accepted to CIKM 2026
点击查看摘要
Abstract:While Large Language Models (LLMs) have significantly advanced reranking in recommendation, effectively leveraging item-side information remains challenging. Real-world items are described by vast, heterogeneous, and unstructured metadata, where decision-relevant signals are often implicit, noisy, or buried in long descriptions. Moreover, feature salience is highly context-dependent, varying not only across items but also across users. Existing methods often rely on item titles, fixed attributes, or static item summaries, which limit personalized and fine-grained item understanding. To bridge this gap, we propose CAIRO, a user context-aware item profiling framework for LLM-based reranking. CAIRO first structures raw metadata and reviews into objective features and subjective traits, and employs a lightweight profiler to select the most relevant information for each user-item pair with limited serving-time overhead. The resulting profiles are concise and context-specific, providing relevant item-side evidence for the LLM's ranking decision. Experiments show that CAIRO consistently improves LLM-based reranking, highlighting the importance of item profiling that effectively exploits vast item-side information.
10. 【2608.20786】Structure for Reading, Prose for Writing: Asymmetric Structural Conditioning in Multi-Agent Document Authoring
链接：https://arxiv.org/abs/2608.20786
作者：Cheng Yu,Nikhil Mathew,Zhengjie Wang
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Multi-agent pipelines, author formal documents, author formal, deployed tender-response system, Multi-agent
备注： 10 pages, 3 figures
点击查看摘要
Abstract:Multi-agent pipelines that author formal documents must both read a requester's forms and write against them. We report a deployed tender-response system, running an open-weights model under sovereignty constraints, and evaluate it against human-written bids the same organisation actually submitted. On a blind comparison where the system had no worked example available, an LLM judge rated its answers at least as good as the human-submitted answer on $40$ of $55$ ground-truth sections, better on $4$, missing on none, and flagged one unsupported claim in total. Classifying every gap the judge identified shows that $68\%$ were content absent from the system's own sources -- knowledge the human author held and the pipeline was never given -- so only $6$ of the $15$ adverse verdicts involve a deficiency the system could have avoided. A divergence from ground truth is more often an information-availability result than a writing-quality one, and evaluations that do not separate the two understate such systems. Against this backdrop we report a conditioning asymmetry. It is well established that rendering documents as structural markup rather than flat prose improves extraction, and we reproduce that on three reading tasks. The benefit does not transfer to conditioning: converting a bid's \emph{instruction} material from prose to nested XML dropped answer quality from $74\%$ to $48\%$ under a paired comparison. We further find that naming a forbidden construction concentrates rather than removes it -- $96\%$ of surviving defects fall in the two forms the prompt explicitly names -- and that coupling a stochastic annotation to a deterministic windowing function moves the extracted requirement count from $68$ to $51$ on a byte-identical file. Structure belongs where the model reads; prose and self-applied tests belong where it writes.
11. 【2608.20707】owards Faithful Simulation of Human Shopping Behavior
链接：https://arxiv.org/abs/2608.20707
作者：Jiakai Tang,Yan Mi,Jing Yu,Yang Zhang,See-Kiong Ng,Qi Cao,Fei Sun,Xu Chen,Wen Chen,Jian Wu,Han Zhu,Bo Zheng
类目：Information Retrieval (cs.IR)
关键词：Simulating realistic user, behavior underpins offline, underpins offline evaluation, Simulating realistic, shopping behavior underpins
备注：
点击查看摘要
Abstract:Simulating realistic user shopping behavior underpins offline evaluation and reinforcement learning in e-commerce scenarios. While recent LLM- and VLM-based simulators have made encouraging progress, reproducing a real browsing session remains difficult for two reasons. (i) Memory Challenge: a shopping session spans dozens of pages, yet existing agents either discard long-range observation histories, losing the evolving user state, or naively concatenate them, overwhelming the context window and even degrading simulation quality. (ii) Optimization Challenge: current user simulators are typically supervised to match each logged action via imitation or step-level rewards; the resulting sessions often display unrealistic patterns, such as over-exploration or excessive passivity, which per-step supervision can neither detect nor correct. To address the above challenges, we present RecVerse, a GUI-grounded simulation agent that perceives pages through screenshots and produces faithful multi-turn trajectories. For the memory challenge, RecVerse adopts a cognitive-inspired hierarchical memory: Working Memory for short-term focus, Episodic Memory for in-session traces, and Preference Memory for high-level intent, with memory updates treated as actions so that the agent adaptively learns when and what to memorize. For the optimization challenge, RecVerse is optimized with a trajectory-level RL objective that scores entire sessions, aligning both macro-level action-type distributions and micro-level shopping intent with real users. We further release USB (User Simulation Benchmark), an interactive e-commerce GUI trajectory dataset for multi-turn user simulation. Experiments show that RecVerse significantly outperforms existing baselines in both behavioral fidelity and intent consistency.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2608.20707 [cs.IR]
(or
arXiv:2608.20707v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.20707
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
12. 【2608.20661】Auditable by Construction: An Ontology-Driven Framework for Trustworthy LLM Analytics in Enterprise Finance
链接：https://arxiv.org/abs/2608.20661
作者：Sergiy Lunyakin
类目：Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Planning and Analysis, Financial Planning, large language models, Knowledge-Driven Analytics Framework, Context-Aware Relevance Propagation
备注： 20 pages, 1 figure, 4 tables, 1 algorithm. Artifact deposit with configurations, ontology schema, prompts, audit reports and reconstruction scripts: [this https URL](https://doi.org/10.5281/zenodo.22022068)
点击查看摘要
Abstract:Enterprise adoption of large language models in finance is constrained less by fluency than by trust: in Financial Planning and Analysis (FPA) and other regulated workflows, an answer is usable only if it is traceable to authoritative sources and auditable after the fact. This paper argues that retrieval-augmented generation for enterprise finance should be evaluated on auditability alongside accuracy, and presents the Knowledge-Driven Analytics Framework (KDAF), which builds ontology-driven knowledge systems through six iterative stages and retrieves evidence via Context-Aware Relevance Propagation (CARP), so that every retrieved fact carries its relationship type, confidence, and source lineage. An evaluation on FinanceBench (145 questions) compares KDAF against zero-context inference, BM25, concept-weighted lexical retrieval, and ungrounded graph traversal. First, retrieval is necessary: zero-context inference reaches 4.1% correctness against 10-12% for retrieval-augmented conditions. Second, on answer correctness the retrieval conditions are statistically indistinguishable (KDAF vs BM25: -0.007, 95% CI [-0.021, 0.000]), so accuracy alone does not justify structured retrieval here -- a negative result we report explicitly. Third, on auditability the ordering reverses: KDAF attains the highest citation traceability F1 (0.515), exceeding ungrounded traversal by +0.027 (CI [0.006, 0.050]) and BM25 by +0.052 (CI [0.024, 0.083]), intervals excluding zero. Graph-structured retrieval also admits no evidence from outside the question subject entity (0 of 426 items, against 16.8% and 20.2% for lexical baselines), and every selected item resolves to a complete provenance chain. We argue that auditability, not accuracy, is the axis on which ontology-grounded retrieval earns its cost.
Comments:
20 pages, 1 figure, 4 tables, 1 algorithm. Artifact deposit with configurations, ontology schema, prompts, audit reports and reconstruction scripts: this https URL
Subjects:
Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
ACMclasses:
H.3.3; I.2.4; I.2.7; J.1
Cite as:
arXiv:2608.20661 [cs.AI]
(or
arXiv:2608.20661v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.20661
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
13. 【2608.20640】One Hierarchy, Two Systems: Semantic Product IDs for Discovery-Surface Ranking and Search-Page Query Reformulation
链接：https://arxiv.org/abs/2608.20640
作者：Steven Xu,Sanjyot Thete,Saathvik Dirisala,Raghav Saboo,Nimesh Sinha,Leo Shao,Elyse Winer,Sudeep Das,Martin Wang,Kyle MacDonald
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Multi-merchant e-commerce catalogs, Multi-merchant e-commerce, fragmenting behavioral evidence, merchant-scoped identifiers, e-commerce catalogs
备注：
点击查看摘要
Abstract:Multi-merchant e-commerce catalogs contain equivalent and related products under different merchant-scoped identifiers, fragmenting behavioral evidence across merchants. Expert-defined taxonomies, meanwhile, are often too coarse for fine-grained discovery. We investigate whether a single hierarchical Semantic ID (\sid{}) representation can support personalized ranking and query reformulation. Learned once from product-content embeddings, the hierarchy defines product concepts at multiple granularities that each application combines with its own behavioral and serving context. For ranking, we aggregate consumer affinity and product performance over \sid{} prefixes and derive sequence features for candidate products and consumer histories. Controlled ablations show improved offline relevance, while online evaluation of the full ranking treatment shows stronger top-slot add-to-cart engagement and broader exposure for less-popular products. For query reformulation, we ground queries and session transitions in \sid{} concepts, use the hierarchy for navigation and refinement, and filter suggestions against the merchant's assortment. Offline evaluation shows finer intent preservation than taxonomy and higher-quality suggestions than raw query-string transitions; online evaluation shows reduced search effort and earlier access to purchasable products. These results show that a shared semantic product hierarchy can support both recommendation and search while preserving the task-specific context required by each application.
14. 【2608.20372】Edge-Based Agentic Retrieval-Augmented Generation for Autonomous FHWA Bridge Inspection Compliance
链接：https://arxiv.org/abs/2608.20372
作者：Viraj Nishesh Darji,Hemaliben Rakeshkumar Darji
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：Federal Highway Administration, Highway Administration, Federal Highway, United States, National Bridge Inventory
备注： 27 pages, 1 figure, 5 tables. Pre-print submitted to the ASCE Journal of Computing in Civil Engineering. Code and data available at: [this https URL](https://github.com/virajdarji/bridgeguard)
点击查看摘要
Abstract:The Federal Highway Administration (FHWA) mandates that over 600,000 bridges in the United States be evaluated against the Recording and Coding Guide for the National Bridge Inventory (NBI). Manual compliance verification is labor-intensive, error-prone, and impractical in connectivity-limited field environments. This paper introduces BridgeGuard, a fully air-gapped agentic Retrieval-Augmented Generation (RAG) system for autonomous bridge inspection compliance. BridgeGuard integrates vector search over the FHWA Recording and Coding Guide with structured SQL queries against NBI tabular data, orchestrated by a stateful multi-step ReAct planning loop executing locally on commodity edge hardware. A section-aware chunking algorithm preserves hierarchical regulatory item boundaries, achieving 94.2% chunk integrity compared with 28.4% for naive fixed-size splitting. Evaluated on the full Delaware 2023 NBI inventory (874 bridges) and a Texas sample (200 bridges), the system achieves 99.77% and 100.0% classification accuracy, respectively, for Structurally Deficient bridge identification, with 100.0% citation accuracy, at 197.0 bridges per hour with out external network access. Ablation experiments confirm that both vector search and the multi-step agentic loop are necessary for correct compliance reasoning.
15. 【2608.20357】Clarify-Then-Search: A Clarification Benchmark for Deep Search with End-to-End Nugget Restoration
链接：https://arxiv.org/abs/2608.20357
作者：Deqiang Huang,Jingbo Zhou,Xinjiang Lu,Tong Xu,Hua Wu,Enhong Chen
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：underspecified user queries, missing constraints, incomplete answers, definitions can lead, lead to retrieval
备注： Accepted to KDD 2026 Datasets and Benchmarks Track. 12 pages, 4 figures, 11 tables
点击查看摘要
Abstract:Deep search is brittle on underspecified user queries: missing constraints such as time, location, scope, or definitions can lead to retrieval drift and incomplete answers. We introduce Clarify-Then-Search, a benchmark for evaluating whether LLM-generated clarification questions improve downstream deep-search utility. Built on real-world query data from the Baidu search engine, the benchmark contains 518 curated instances, each with an intent query and a corresponding underspecified query. For each intent query, we run WebDancer once to archive evidence and construct a static golden reference as weighted, evidence-grounded nuggets with traceable source identifiers. At evaluation time, a Clarifier asks k in {1, 2, 3} questions; a closed-book User Answerer replies only with information explicitly stated in the intent query, otherwise returning unknown; and a closed-book Rewriter produces a rewritten query using only the underspecified query and the elicited question-answer pairs. WebDancer then executes on the rewritten query, and we score end-to-end utility using restore_score_100, a weighted nugget-recall score with partial credit against the static gold. Across all evaluated models, clarification improves over the no-interaction baseline at k=1, and larger budgets generally yield further gains. GPT-5.2 achieves the highest mean score at k=1, while ERNIE-4.5-Turbo-128K becomes the overall top-performing model at k=3. Diagnostics reveal a consistent failure mode: many systems over-ask region-only questions that are often unanswerable from the intent and thus elicit unknown. Clarify-Then-Search enables leakage-resistant and reproducible evaluation of clarify-then-search pipelines, with fine-grained analyses of question utility, answerability, and budget effects in deep search.
16. 【2608.21274】Recommendation Quality and the Concentration of Consumption: Experimental Evidence from Netflix
链接：https://arxiv.org/abs/2608.21274
作者：Guy Aridor,Winston Chou,Nathan Kallus,Antoine Scheid,Allen Tren,Kevin Zielincki
类目：General Economics (econ.GN); Information Retrieval (cs.IR)
关键词：Netflix recommender system, recommendation technology affect, users on Netflix, Netflix recommender, million users
备注：
点击查看摘要
Abstract:We study an experiment with 8.5 million users on Netflix's recommender system to measure how improvements in recommendation technology affect the set of products that get consumed. Improvements increase total consumption and users' reliance on recommendations while diffusing recommendations and consumption away from the most popular titles (``superstars") toward a larger number of moderately popular titles (``middle-tail"), with minimal effects on the most niche titles (``long-tail"). Our results challenge the notion that recommender systems polarize consumption -- raising the consumption shares of the head and tail at the expense of the middle -- and suggest that the returns to investing in middle-tail products grow as algorithms improve and platforms scale.
计算机视觉
1. 【2608.21360】OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMs
链接：https://arxiv.org/abs/2608.21360
作者：Xianyun Sun,Chaoyou Fu,Zhengye Zhang,Feiyang Duan,Qingyuan Cao,Yonghui Niu,Sihang Yuan,Ge Zhang,Caifeng Shan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent omni-modal large, omni-modal large language, continuously perceive environments, Recent omni-modal, large language models
备注： Project page: [this https URL](https://xianyunsun.github.io/OmniAssistBench/)
点击查看摘要
Abstract:Recent omni-modal large language models (Omni-LLMs) show great potential as real-time video assistants, which continuously perceive environments and guide users to achieve specific goals. Unlike traditional passive video understanding, interactive assistants should actively combine visual states, user goals, and prior knowledge to provide effective help. Evaluating this is rather challenging, as the model's unpredictable response dynamically changes the user's subsequent actions, which static offline datasets cannot accommodate. To address this bottleneck, we introduce OmniAssistBench. To solve the issue of diverging interaction paths where the same user goal can be achieved through various methods, we provide models with predefined priors derived from the source video, requiring them to guide users along the exact same routes. Since real interaction videos are rare, we construct the dataset by reverse-engineering existing Internet videos. We deduce logical user goals and segment the videos into multi-turn clips to simulate continuous interactions. This rigorous pipeline required over 1000 expert person-hours to build the dataset. Results show that the proprietary Gemini-3-Pro reaches 66.4 out of the max point of 100, while the open-source Qwen3-Omni-Instruct achieves 51.2. Although current models generally understand user inputs, they frequently provide incorrect or incomplete answers. Specifically, they struggle with visual prompts (e.g., hand gestures), fail to maintain historical context during multi-turn interactions, and fail to delay response until the target event. Results indicate substantial room for improvement before models can become reliable assistants.
2. 【2608.21332】Anatomy-Informed Neural Networks: Encoding Anatomic Priors in Loss and Architecture, with an SE(3) Formulation of Guidewire-Induced Aortoiliac Deformation
链接：https://arxiv.org/abs/2608.21332
作者：David P. Stonko
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：numerically plausible, generalize poorly, Deep-learning models, Anatomy-Informed Neural Networks, physics-informed neural network
备注： 42 pages, 10 figures, 4 tables
点击查看摘要
Abstract:Deep-learning models of anatomy can be numerically plausible yet anatomically impossible, and they generalize poorly when data are scarce. We introduce Anatomy-Informed Neural Networks (AINN), in which soft anatomic priors enter as penalty terms in the loss (e.g., a branching penalty that treats a renal transplant artery off the iliac instead of the aorta as unexpected rather than impossible), in direct analogy to a physics-informed neural network, and hard anatomic priors (e.g., continuity of the vessel) are built into the architecture and state representation, making such invalid predictions impossible by construction wherever the prior admits architectural enforcement. We develop it on a clinical test case with limited data: how the aortoiliac tree deforms when a stiff wire is introduced endoluminally. This is important to contemporary aortic surgery and will matter to autonomous endovascular navigation. We lift the vessel centerline and the wire path from R^3 to curves of frames in the Lie group SE(3), and couple a Cosserat-rod wire to a tortuosity-modulated, anatomically anchored vessel through a unilateral lumen-contact inequality. The prediction is a constrained minimizer of the coupled elastic energy, with contact forces as its Lagrange multipliers. Supervision is a Wasserstein-2 optimal-transport loss between the predicted projection through the C-arm geometry and the observed angiogram, so a 2D angiogram can train a 3D prediction. The kinematics, loss and projection are verified against known ground truth; the mechanics solver only against its own optimality conditions, and predicted displacement is not yet mesh-converged. Here, no network is trained. Future work will transfer this in silico model to real CT scans and test whether it improves predictive accuracy and reduces the training data required.
Comments:
42 pages, 10 figures, 4 tables
Subjects:
Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
Cite as:
arXiv:2608.21332 [cs.AI]
(or
arXiv:2608.21332v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.21332
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
3. 【2608.21305】Re$^3$Cap: Retrieval-Guided Refinement for Image Captioning Enhancement via Reinforcement Learning
链接：https://arxiv.org/abs/2608.21305
作者：Haonan Jia,Shichao Dong,Zenghui Sun,Jiawen Zheng,Ziqi Miao,Gege Shi,Qiuyu Zhao,Jinsong Lan,Xiaoyong Zhu,Bo Zheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large Vision-Language Models, encouraging Large Vision-Language, Reinforcement Learning, demonstrated significant gains, Vision-Language Models
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Reinforcement Learning (RL) has demonstrated significant gains in image captioning, yet it is still limited in encouraging Large Vision-Language Models (LVLMs) to explore novel reasoning strategies. This limitation leads to a performance gap between RL and Supervised Fine-Tuning (SFT). In this paper, we argue that multi-modal retrieval can serve as an effective reasoning signal for caption refinement. Based on this insight, we present the Retrieval-Guided Refinement for Image Captioning (Re$^3$Cap), a retrieval-guided reasoning strategy that enhances image captioning without requiring additional annotations. Instantiated by Caption Refinement Suggester (CRS) and Caption Quality Assessor (CQA), this strategy identifies hallucinations and omissions in image captions, leading to more accurate and detailed descriptions. Extensive experiments demonstrate the superiority of our method in image captioning, even compared with Supervised Fine-Tuning. Especially, Re$^3$Cap outperforms GRPO with an average improvement of 8.64% in relation reasoning on the COCO-LN500 benchmark.
4. 【2608.21300】When Adaptation Hurts: Connecting Representational Drift to OOD Failures in MedSAM Fine-Tuning
链接：https://arxiv.org/abs/2608.21300
作者：Marko Haralović,Sounic Akkaraju,Carlo Baretta,Vasil Zapryanov,Alexia Briassouli
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：medical image segmentation, Foundation models, Curated Breast Imaging, Breast Ultrasound Images, Breast Imaging Subset
备注： Accepted at the SAFER Workshop, MICCAI 2026
点击查看摘要
Abstract:Foundation models for medical image segmentation, like prompt-based MedSAM, generalize well across domains and modalities, often in zero or few-shot setups. However, their performance depends on the quality of prompts and the adaptation of the models to custom datasets. This work systematically examines how MedSAM generalizes across diverse medical imaging benchmarks, with six adaptation strategies: full-model and encoder-only LoRA, shallow and deep visual prompt tuning (VPT), and decoder-only and full fine-tuning. Models are trained on the International Skin Imaging Collaboration Challenge (ISIC 2018) dataset and evaluated under clean and increasingly noisy prompts on IN and Out-of-Distribution (OOD) datasets: close-OOD PH2 (dermoscopy), far-OOD BUSI (Breast Ultrasound Images Dataset) and CBIS-DDSM (Curated Breast Imaging Subset of the Digital Database for Screening Mammography). We show that adaptation improves performance on IN and close-OOD data but often reduces performance on far-OOD data. Full fine-tuning provides the best tradeoff, while encoder-only LoRA is the strongest parameter-efficient alternative, outperforming standard LoRA and VPT under far-OOD shifts. Using Centered Kernel Alignment (CKA), we show that far-OOD degradation is strongly associated with drift in decoder representations, whereas encoder similarity alone does not explain robustness. This suggests encoder-only LoRA provides stronger robustness than standard LoRA by adapting the encoder to distribution shift in visual features, while preserving the decoder pathway. We further show that random 0-100 pixel jitter on prompts produces more robust and better performing models. We thus conclude that robust MedSAM adaptation requires the combined consideration of prompt noise exposure, domain shift, and representation preservation. We release our code: this https URL
5. 【2608.21290】VT-MUSE: Multimodal Unified Sequential Visuotactile Representation Learning for Manipulation
链接：https://arxiv.org/abs/2608.21290
作者：Congsheng Xu,Qiaochu Yang,Fangyuan Shi,Yifan Han,Baijun Chen,Yiming Wang,Haonan Zhao,Daolin Ma,Xiaokang Yang,Hesheng Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Unified SEquential, Multimodal Unified, Unified SEquential representation, Unified SEquential, SEquential representation learning
备注：
点击查看摘要
Abstract:We propose VT-MUSE, a Multimodal Unified SEquential representation learning framework for visuotactilemanipulation. Existing approaches often encode visual and tactile observations independently before fusion, limiting their ability to capture fine-grained cross-modal dependencies. Moreover, most methods focus on observations at the current time step and overlook the temporal evolution of contact. VT-MUSE addresses both limitations through a two-stage representation learning framework. In Stage I, modality specific encoders are jointly adapted via cross-modal temporal alignment and masked-view consistency. In Stage II, a conditional variational latent model processes masked visual sequences together with full tactile histories. Auxiliary decoders reconstruct the masked recent visual observations and predict tactile depth changes, encouraging the latent representation to retain both global visual context and local contact dynamics. The learned representation is subsequently integrated into a lightweight Transformer policy through gated cross-attention. On the simulation benchmark, VT-MUSE outperforms the strongest baseline evaluated on all tasks by 11 percentage points and also achieves substantial improvements in real-world experiments.
6. 【2608.21286】Difficulty-Calibrated Interpolation Paths for Conditional Flow Matching
链接：https://arxiv.org/abs/2608.21286
作者：Airin Akter Tania,Md Raihan Khan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Conditional Flow Matching, Flow Matching trains, Matching trains generative, trains generative models, Flow Matching
备注：
点击查看摘要
Abstract:Conditional Flow Matching trains generative models by regressing a network onto the velocity of a prescribed noise-to-data interpolation path. The interpolation schedule that shapes this path is known to affect convergence and sample quality, yet it is invariably fixed in advance, independent of both the data and the model. We show that the regression difficulty of Conditional Flow Matching varies systematically along the path, and we propose Difficulty-Calibrated Flow Matching, which derives the schedule from the model itself: a short pilot run with the linear path records the per-time loss, and the schedule is set to the quantile function of this difficulty profile, so the trajectory lingers where the velocity is hardest to learn. The method has a single hyperparameter, leaves the training objective and its gradient equivalence intact, composes with classifier-free guidance, and adds about two percent training overhead. In controlled experiments on CIFAR-10, MNIST, and Fashion-MNIST with an identical compact U-Net, the calibrated path attains the best FID on CIFAR-10 at full sampling budget and clearly outperforms all fixed schedules in the large-batch, few-update regime, precisely the setting where compute is scarcest.
7. 【2608.21281】WildFin: An In-the-Wild Dataset for Fish Behavioral Recognition
链接：https://arxiv.org/abs/2608.21281
作者：Abigail G. Grassick,Jerome Tze-Hou Hsu,Ethan Lin,Ziang Liu,Max Whitton,Madelyn Hair,Liam Gutierrez,Haozheng Yu,Kristin Branson,Vivek Jayaraman,Michael A. Gil,Andrew M. Hein,Jennifer J. Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, ecological science, advances in field, field technology, technology have led
备注： 31 pages, 4 figures ECCV Marine 26 Workshop
点击查看摘要
Abstract:Recent advances in field technology have led to a massive influx of in-the-wild video data for ecological science. The primary bottleneck in leveraging this data is the high cost of expert annotation. While computer vision offers a potential solution, current models frequently fail when deployed in complex marine environments. To characterize these failures, we introduce WildFin, a novel benchmark for fish behavior recognition collected and annotated by this http URL spans two critical real-world paradigms: stationary cameras monitoring groups of fish and dynamic divers following individual subjects. The dataset represents a massive curation effort, involving 1,350 hours of fieldwork and 600 hours of expert annotation to produce 9 hours of behavioral data with over 2 million frame-by-frame labels. We benchmark modern vision foundation models and quantify tradeoffs between static and spatiotemporal architectures, revealing the substantial gap that remains between current model capabilities and the demands of real-world underwater behavioral analysis. Project website: this https URL.
8. 【2608.21276】he Coastline as a Structural Constraint: Harnessing Scene Geometry for Autonomous Surface Vessel Localization
链接：https://arxiv.org/abs/2608.21276
作者：Derek R. Benham,Joshua G. Mangelson
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：largely unexploited geometric, unexploited geometric structure, geometric structure capable, largely unexploited, unexploited geometric
备注： 22 pages, 13 figures, 7 tables
点击查看摘要
Abstract:Coastal environments contain rich, largely unexploited geometric structure capable of providing globally referenced localization cues. In this work, we present two complementary localization frameworks that exploit shoreline and water-surface geometry for GPS-denied autonomous surface vessel localization. The first framework leverages LiDAR observations of the water surface to estimate roll, pitch, and heave (vertical motion), while recovering global position and heading through direct registration of shoreline observations against a satellite-derived coastline map. The second framework relies solely on passive imagery to detect the shoreline and horizon through semantic segmentation. Using the proposed coastal scene geometry, shoreline distance is inferred from monocular imagery. Shoreline observations are accumulated into short-duration local submaps, registered against the same satellite-derived coastline map, and fused within a hierarchical factor graph. Evaluated across three real-world coastal datasets, the LiDAR pipeline consistently improves trajectory accuracy over standard baselines, while the monocular architecture maintains bounded long-term drift. In addition, we establish that modern zero-shot foundation models can reliably extract shoreline observations across diverse coastal environments. Together, these results demonstrate that coastal geometry provides a powerful and dependable source of globally referenced information for GPS-denied maritime localization.
9. 【2608.21254】On the Transferability of Agricultural Weed Detection Under Cross-Field Distribution Shift
链接：https://arxiv.org/abs/2608.21254
作者：Nikhilesh Prabhakar,Pranuthi Tenali,Wilfredo Abudeye Fernandez,Shekhar Borah,Athresh Karanam,Erik Blasch,Prabha Sundaravadivel,Sriraam Natarajan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：enabling targeted intervention, Accurate agricultural weed, reducing yield loss, real-world field conditions, Accurate agricultural
备注：
点击查看摘要
Abstract:Accurate agricultural weed detection in real-world field conditions is essential for precision agriculture, enabling targeted intervention and reducing yield loss. Recent work has reported strong detection performance from UAV-based imagery across a range of crops, yet existing approaches evaluate within a single crop and field, leaving practitioners with little evidence that a model trained on one crop will generalize to a new field or crop type. In this work, we characterize where cross-dataset weed-localization performance degrades and which modeling choices recover it, reducing the need to relabel every new deployment field. We introduce a newly collected and annotated UAV image dataset for agricultural weed detection in cotton fields and use it alongside an existing soybean dataset collected under a similar protocol. Using these datasets, we evaluate the performance of several strategies for transferring a detector trained on one crop to another, comparing unsupervised domain adaptive object detection (DAOD) against pretraining on a domain-adjacent source dataset followed by few-shot fine-tuning on the target dataset. Our analysis spans target-domain label budgets from zero to the full target dataset, characterizing the trade-off between adaptation strategy and annotation effort. We find that few-shot fine-tuning with as few as 25 labeled target examples outperforms unsupervised DAOD in our cross-crop comparison, suggesting that source domain selection combined with modest target supervision is more productive than algorithmic sophistication in adaptation.
10. 【2608.21247】Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models
链接：https://arxiv.org/abs/2608.21247
作者：Zhuoyuan Li,Rui Zhao,Jin Wang,Hanwei Zhu,Cong Zhang,Giuseppe Valenzise,Weisi Lin,Kin-Man Lam
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：large foundation models, KV-cache reuse widely, reuse widely adopted, foundation models, vision-language models
备注： 15 pages, 5 figures
点击查看摘要
Abstract:Token compression has become a key technique for reducing the inference cost of large foundation models, with approaches such as token pruning and KV-cache reuse widely adopted in vision-language models and recently explored for embodied agents. In embodied agents, tokens not only support perception and semantic understanding but also directly affect latency-sensitive closed-loop robot action prediction. Existing schemes typically guide compression using redundancy or importance cues, such as visual similarity, attention scores, and saliency. However, these cues only indirectly measure the key factor for safe compression: how much a token can change before causing an unacceptable deviation in downstream actions. This receiver-dependent tolerance is closely related to the principle of just noticeable difference (JND). Classical JND characterizes signal tolerance in the human visual system, while machine-oriented JND extends this concept to downstream machine responses. Building on this progression, we introduce Action-JND, which extends JND modeling to embodied perception by defining noticeability through the language-conditioned action response of a vision-language-action (VLA) policy in closed-loop control. A token change is considered admissible only when the induced action deviation remains within a tolerated margin. To realize this concept, we develop a lightweight token-wise JND estimator in deep visual-feature space to predict the maximum tolerable perturbation while preserving policy responses. The resulting action-tolerance score serves as a plug-and-play criterion for VLA compression paradigms, including stale-KV reuse and token pruning, prioritizing action-tolerant tokens for compression. Experiments on the LIBERO benchmark with OpenVLA and OpenVLA-OFT demonstrate that Action-JND consistently improves compression reliability, especially under aggressive compression ratios.
11. 【2608.21244】A VLM Answer Is Not an Anomaly Score: Rank Compression in Training-Free Video Anomaly Detection
链接：https://arxiv.org/abs/2608.21244
作者：Inpyo Song,Jangwon Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models enable, enable training-free video, training-free video anomaly, video anomaly detection, models enable training-free
备注： Preprint
点击查看摘要
Abstract:Vision-language models enable training-free video anomaly detection by answering questions about video segments. VAD benchmarks, however, require a scalar anomaly score for each segment and evaluate the resulting ranking using the AUROC or AP. A VLM-based detector should therefore define an answer interface: the answer scale specifies the admissible answers, and the readout rule maps the model's output distribution to a score. Because this interface can change the evaluated ranking, it is part of the detector rather than a formatting detail. The generated readout uses only the most likely answer, whereas the probability readout uses the full distribution over admissible answers. Across four 7-8B VLMs, the probability readout outperforms the generated readout for every tested combination of answer scale, benchmark, and metric, with average gains ranging from 5 to 13 points across the four benchmark-metric pairs. The gap arises because the generated readout keeps only one answer value per segment, so segment with different answer distributions can receive the same score and lose their relative order. We call this loss of relative order generated-answer rank compression. Even when the answer scale allows 91 answers, the generated readout produces only 4-18 distinct scores, whereas the probability readout retains substantially finer score resolution. The advantage persists under every decoding strategy, prompt wording, and joint scoring-explanation prompt we test. The answer interface is therefore a consequential component of VLM-based VAD and should be explicitly specified and evaluated.
12. 【2608.21229】Anchoring Instruction Outside Mask: Exact Reference Caching for Efficient In-Context Diffusion Transformers
链接：https://arxiv.org/abs/2608.21229
作者：Yangshuai Liu,Zheming Li,Jiaao Li,Kang He,Ziliang Lai,Zhitai Liu,Chengru Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Omnimodal generation, wide range, range of content, content creation, Omnimodal
备注：
点击查看摘要
Abstract:Omnimodal generation is central to a wide range of content creation and editing applications. In-context conditioning is essential to this paradigm. It allows diffusion transformers to process text instructions and visual references in a shared attention sequence. However, each reference image introduces thousands of tokens. Computation therefore grows rapidly with the number of references. Existing methods reduce computation through structured sparse attention, which limits interactions between reference and target tokens. This structure also makes the reference K and V independent of the denoising target, allowing them to be computed once and reused across steps. However, it blocks visual references from attending to the text instruction. This substantially degrades instruction following and reference fidelity in multi-reference editing. To resolve this conflict, we jointly redesign the token sequence and attention mask. Our beyond-mask design uses static text anchors to connect the instruction to the reference branch. It preserves exact K and V reuse without adding parameters. However, this direct architectural conversion degrades generation quality. We recover the lost performance through teacher-forced velocity distillation, followed by a short on-policy stage in which the teacher supervises student-visited states. To our knowledge, this is the first use of on-policy distillation for architectural recovery in diffusion models. Across three image-editing benchmarks, our method matches full-attention generation quality. With five reference images, it accelerates the complete 40-step denoising process by 3.92x, while static text anchors introduce negligible runtime overhead; the speedup reaches 5.47x at ten references in our scaling study.
13. 【2608.21194】ES-VP : Energy-Shaped Dynamic Visual Prompting for Efficient Model Adaptation
链接：https://arxiv.org/abs/2608.21194
作者：Can Jin,Ying Li,Jingchen Sun,Hongwu Peng,Jiahui Zhao,Yang Zhou,Lei Li,Dimitris N. Metaxas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream tasks, Visual prompting, Energy-Shaped Visual Prompting, adapting pre-trained models, ES-VP
备注：
点击查看摘要
Abstract:Visual prompting (VP) has emerged as a parameter-efficient method for adapting pre-trained models to downstream tasks. However, existing approaches encounter a trade-off between flexibility and efficiency. Some methods apply a fixed prompt to all images, ignoring individual image characteristics, while others introduce auxiliary networks to generate diverse prompts. Although the latter can improve performance, it also significantly increases parameter usage and the potential for overfitting to specific datasets. Furthermore, the auxiliary networks, combined with inherent biases in pre-trained models, limit scalability and generalization. In this paper, we propose Energy-Shaped Visual Prompting (ES-VP), a novel approach that generates image-specific prompts using low-rank initialization and energy-guided dynamic adaptation, achieving superior performance with fewer parameters compared to single-prompt methods. ES-VP directly utilizes the pre-trained model for adaptive prompt generation, ensuring both parameter efficiency and improved generalization. Extensive experiments conducted on five architectures across fifteen datasets demonstrate that ES-VP consistently outperforms current state-of-the-art (SOTA) single and diverse VP methods. For instance, using the CLIP architecture across four datasets, ES-VP outperforms the SOTA method DAM-VP by an average of 2.6\% in accuracy while utilizing 590$\times$ fewer VP parameters, thereby establishing a new benchmark for efficient and generalizable model adaptation.
14. 【2608.21189】owards Investigating Residual Hearing Loss: Quantification of Fibrosis in a Novel Cochlear OCT Dataset
链接：https://arxiv.org/abs/2608.21189
作者：Julia Dietlmeier,Benjamin Greenberg,Wenxuan He,Teresa Wilson,Rubing Xing,Jordan Hill,Adrienne Fettig,Madeline Otto,Teyhana Rounsavill,Lina A. J. Reiss,Jingang Yi,Noel E. O'Connor,George W.S. Burwood
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：electrical stimulation, auditory nerve, bionic prostheses, prostheses that restores, restores hearing
备注： Copyright 2026 IEEE. Personal use of this material is permitted. Citation/DOI: [https://doi.org/10.1109/TBME.2025.3537868](https://doi.org/10.1109/TBME.2025.3537868)
点击查看摘要
Abstract:Objective: Cochlear implants (CIs) are bionic prostheses that restores hearing via electrical stimulation of the auditory nerve. Hybrid CIs, which use electroacoustic stimulation (EAS), combine residual low-frequency acoustic hearing with CI electrical stimulation. Intracochlear fibrosis, which forms in response to the presence of the implant, may impede residual hearing function and gradually reduce the efficacy of EAS. It is therefore a translational objective to study the formation of cochlear fibrosis in rodents, with the goal of reducing fibrotic burden and improving outcomes for CI patients. Methods: We generate and annotate a novel dataset of optical coherence tomography (OCT) images from chronically implanted guinea pigs as part of an ongoing study focused on implant induced fibrosis. Objectively assessing fibrotic burden in this model, with high resolution and repeatability, presents an obvious use case for computer vision methods. Results: We present the results of several state-of-the-art semantic segmentation models and compare their efficacy for identifying cochlear fibrosis and other relevant annotations, using a new library of manually segmented OCT images. Conclusions: We find that the best performance is achieved by using a modified version of the well-known UNET architecture (which we term 2D-OCT-UNET) that operates on the upscaled OCT input resolution. Significance: For the first time, we have successfully applied computer vision techniques to an OCT dataset of implanted cochleae with fibrosis. Using this deep learning model, the cochlear fibrotic burden calculation can be reliably carried out as we verify in our experimental section. The dataset and the project code are available at: this https URL
15. 【2608.21170】Is Visual Prompting All You Need? Studying VLM Spatial Reasoning under Progressive Visual Scaffolds
链接：https://arxiv.org/abs/2608.21170
作者：Lars Benedikt Kaesberg,Tianyu Yang,Florian Valentin Wunderlich,Terry Ruas,Jan Philip Wahle,Daniel Kurzawe,Bela Gipp
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision-language models, recent work shows, advanced rapidly, rapidly in multimodal, recent work
备注： Accepted at EMNLP 2026 (Findings)
点击查看摘要
Abstract:Vision-language models (VLMs) have advanced rapidly in multimodal reasoning, yet recent work shows that their failures often reflect an interaction between visual grounding and downstream reasoning. What remains less clear is how the visual presentation of a task shapes model performance and failure modes when the underlying reasoning problem is unchanged. We study this question in SPaRC, a benchmark for grid-based visual spatial planning, by introducing lightweight input-side scaffolds that preserve the visual modality while making spatial structure more accessible. Across multiple VLMs, these scaffolds improve task accuracy over the original visual setting by up to 34.0 percentage points and further complement GRPO-based training, yielding up to 4.6 additional accuracy points compared with near-zero gains on the original visual input. Analyses on both end-to-end task solving and object detection show that these gains are closely tied to reductions in grounding-related errors, while rule reasoning remains comparatively challenging. We find that visual presentation is a central factor that determines whether VLM benchmarks measure grounded perception, downstream reasoning, or a mixture of both.
16. 【2608.21160】Human-JEPA: A Human-Centric Vision Model that Perceives and Anticipates
链接：https://arxiv.org/abs/2608.21160
作者：Hui Wei,Licai Sun,Guoying Zhao
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Machines that understand, anticipate the future, human-centric vision model, Existing human-centric vision, dense perception
备注：
点击查看摘要
Abstract:Machines that understand humans should perceive the present and anticipate the future. Existing human-centric vision model are pretrained on human images, set the state of the art in static dense perception, so motion and anticipation are out of reach. Here we present Human-JEPA, a human-centric vision model trained on video by anchored forecasting: dense targets are pinned to a frozen copy of the initialization, preventing a silent collapse of dense perception, and block masks are replaced by a pure past-to-future split, avoiding a five-point action tax and a seventeen-point re-identification collapse. Under frozen probes, Human-JEPA leads the pixel-anchored specialists on pose and person re-identification at 2.7 times fewer parameters, conceding high-resolution dense parsing, and its released predictor head is the first that does not degrade anticipation. A single safely adapted model thus serves both halves of understanding humans.
17. 【2608.21140】A Modular Agent for Reliable and Auditable Spatial Relation Verification in CT Scans
链接：https://arxiv.org/abs/2608.21140
作者：Simon Vincent Abel,Heiko Hillenhagen,Michael Götz,Timo Ropinski,Ayhan Can Erdur,Daniel Santak Wolf
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Reliable spatial understanding, support radiological report, radiological report generation, Reliable spatial, important prerequisite
备注：
点击查看摘要
Abstract:Reliable spatial understanding is an important prerequisite for future medical vision-language systems that aim to support radiological report generation and structured image understanding. While modern vision-language models (VLMs) show promising performance on many medical imaging tasks, recent evidence suggests they remain weak in controlled spatial reasoning and often fail to reliably ground spatial relations in image evidence. Given that radiological reasoning hinges on understanding the relative positions of anatomical structures and findings, this spatial weakness poses risks to diagnostic accuracy. We present a modular medical imaging agent for binary spatial relation verification in axial CT slices. Instead of directly predicting spatial answers end-to-end, the system decomposes the task into explicit stages: language parsing, anatomical localization, and deterministic geometric verification. Natural-language queries are converted into structured relation tuples, queried organs are localized with a YOLO-based detector, and the final spatial decision is computed from object centers using deterministic geometric rules. We evaluate the approach on the held-out MIRP spatial QA benchmark and compare it against representative end-to-end VLM baselines. The best-performing hybrid configuration reaches 94.1% accuracy and 94.2% F1, outperforming direct Qwen2-VL prompting by 42.5 percentage points in accuracy, while preserving interpretable intermediate representations and auditable reasoning stages. The results suggest that explicit modular spatial verification can serve as a promising building block for future report-oriented medical imaging agents.
18. 【2608.21136】Stream3Dv2: Geometric-Semantic Fusion Enhanced Streaming Zero-Shot 3D Scene Understanding
链接：https://arxiv.org/abs/2608.21136
作者：Jie Xu,Na Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：data-intensive supervised methods, vision foundation models, supervised methods, vision foundation, promising alternative
备注：
点击查看摘要
Abstract:Recently, open-vocabulary zero-shot 3D scene understanding using vision foundation models has emerged as a promising alternative to data-intensive supervised methods. However, deploying these models in real-world scenarios is severely hindered by their inability to efficiently handle streaming RGB-D inputs and their inherent vulnerability to noise 2D segmentation masks. To address these critical limitations, we propose Stream3Dv2, a novel training-free framework designed for robust streaming 3D perception. Stream3Dv2 processes sequential data through an original nested local-to-historical architecture, capturing multi-view consistency while circumventing the high computational overhead so as to support timely responses. At its core, we introduce a comprehensive geometric-semantic fusion mechanism that resolves geometric noise and semantic ambiguity by explicitly utilizing semantic guidance and formulating 3D segmentation as solving point-and-set merging and partitioning problems. Furthermore, we present an innovative manifold-distance-based point cloud refinement strategy. This approach leverages local manifold graphs for point-to-manifold optimization that mitigates the boundary delineation failures caused by Euclidean-distance metrics, and employs geometric bounding boxes to dynamically activate and update historical instances for achieving rapid manifold-to-manifold refinement. Extensive experiments on public datasets demonstrate that Stream3Dv2 consistently outperforms existing baselines in foundational open-vocabulary streaming 3D segmentation and detection. Finally, we show that integrating our framework with an LLM-based agent enables advanced language-driven 3D scene understanding, underscoring its potential for open-world embodied intelligence. Code will be updated at this https URL.
19. 【2608.21134】Llama-Mobile: Efficient 2.7-Bit Quantization of VLMs
链接：https://arxiv.org/abs/2608.21134
作者：Luka Ribar,Jeevan Bhoot,Douglas Orr
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Deploying vision-language models, Deploying vision-language, compute requirements, mobile devices, devices is challenging
备注：
点击查看摘要
Abstract:Deploying vision-language models (VLMs) on mobile devices is challenging due to their significant memory and compute requirements. We present a framework for quantizing VLMs for efficient inference on resource-constrained hardware. Our approach combines a quantization pipeline that uses the model itself to generate training data and does not require access to the training setup, with a novel 2.7-bit-per-parameter format supporting efficient execution on Arm CPUs. We validate our approach by compressing the Llama 3.2 11B Vision Instruct model to 3.7 GB with 8-bit activations, preserving strong performance on a set of standard visual question answering tasks.
20. 【2608.21133】Masking Is Not Enough: Generative Restoration for Multimodal De-Identification in Medical AI
链接：https://arxiv.org/abs/2608.21133
作者：Shiva Shrestha,Zongxing Xie,Chen Zhao,Liran Ma,Zhipeng Cai,Honghui Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)
关键词：protected health information, expose protected health, health information, accompanying text, creating a barrier
备注：
点击查看摘要
Abstract:Medical image-text data can expose protected health information (PHI) through both visible image content as well as accompanying text, creating a barrier to privacy-preserving medical AI systems. This risk is especially prominent in multimodal systems, where images, questions, reports, and clinical context may enter training, evaluation, or inference pipelines. Existing medical vision-language benchmarks primarily emphasize task utility, while de-identification methods are often evaluated separately from downstream reasoning. We introduce ClinX, an end-to-end multimodal PHI sanitization framework for medical image-text data. ClinX detects visible identifiers with optical character recognition (OCR), constructs binary PHI masks, and applies ClinX-PRISM, a no-skip generative restoration module with privacy-oriented post-processing for burned-in identifier suppression. In parallel, text-side PHI is reduced through progressive de-identification levels: regex masking, context-aware masking, and rewrite-based sanitization. We evaluate ClinX in medical visual question answering (MedVQA), jointly measuring PHI leakage and downstream utility across image-side, text-side, and combined de-identification settings. Results show that OCR-only masking is not sufficient as a standalone solution, and restoration-based sanitization better preserves clinically relevant visual context while sharply reducing recoverable PHI.
21. 【2608.21114】CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agents
链接：https://arxiv.org/abs/2608.21114
作者：Jiancheng Wang,Mingli Zhu,Tong Zhang,Jiaqi Ruan,Wei Wang,Siyuan Liang,Dacheng Tao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Visual world-model agents, Visual world-model, per-frame perturbation constraint, perturbations vary sharply, strict per-frame perturbation
备注： Includes supplementary material
点击查看摘要
Abstract:Visual world-model agents such as DreamerV3 act through a recurrent latent state rather than a single observation, which weakens frame-wise observation attacks and makes their perturbations vary sharply over time under a strict per-frame perturbation constraint. We study white-box, causal, online attacks on such agents and propose Critic-Induced Value-Subspace Attacks (\textbf{CIVA}). Our key observation is that, along a rollout, critic-guided perturbations concentrate in a low-dimensional subspace induced by the victim's own critic. Based on this observation, CIVA first probes the frozen victim offline with critic-guided PGD and extracts a low-rank value-subspace by SVD. At test time, it optimizes only the subspace coefficients, smooths them with an exponential moving average (EMA), and maps them back to pixels. This design attacks value-sensitive recurrent dynamics while keeping the online optimization cheap and temporally coherent. Extensive experiments on DMC walker walk, Atari Pong, and Crafter show that CIVA consistently outperforms five recent methods; on DMC walker walk, it achieves the largest reward drop of 26.07\% while keeping temporal variation low, with TempAbs of 0.646.
22. 【2608.21099】A2DINOv3: Rethinking Multi-Modal Object Detection via Socialized Collaboration
链接：https://arxiv.org/abs/2608.21099
作者：Jiekang Feng,Zhihe Fan,Yunqi Zhu,Xinjie Yao,Yueying Zhang,Yike Gao,Ranxin Li,Guanzuo Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：robust scene understanding, adverse environments, essential for robust, robust scene, scene understanding
备注：
点击查看摘要
Abstract:Multi-modal object detection is essential for robust scene understanding in challenging conditions, including low-light and adverse environments. Recent vision foundation models (e.g., DINOv3) have exhibited strong representation capabilities, yet adapting them to multi-modal scenarios remains challenging. Existing dense cross-modal fusion strategies often force heterogeneous modalities to interact indiscriminately, which may introduce redundant information and disrupt the valuable pre-trained representations. To address this issue, we revisit multi-modal fusion from the perspective of socialized learning and propose adapter to DINOv3 (A2DINOv3), a multi-expert collaboration framework with a Socialized Collaboration Protocol (SCP). Specifically, RGB and infrared branches are modeled as heterogeneous experts that independently preserve their specialized knowledge while exchanging complementary information through selective and constrained interactions. This design mitigates harmful cross-modal interference and prevents degradation of pre-trained priors during adaptation. Furthermore, a zero-initialization strategy is introduced to gradually activate cross-modal collaboration, enabling a smooth transition from modality-specific learning to cooperative representation learning. Extensive experiments on four multi-modal benchmarks, including aerial detection (GAIIC), autonomous driving (FLIR), low-light surveillance (LLVIP), and diverse real-world scenarios (M3FD), demonstrate that A2DINOv3 consistently achieves state-of-the-art performance in multi-modal object detection.
23. 【2608.21098】When does fusing hand-crafted knowledge with learned representations pay? A cost-normalized benchmark of stacking, substitution, and interference
链接：https://arxiv.org/abs/2608.21098
作者：Ahmad AlMughrabi,Albert Clop,Benjamin Busam,Ricardo Marques,Petia Radeva
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：data is scarce, learning is attractive, attractive where data, controlled account, Fusing prior knowledge
备注：
点击查看摘要
Abstract:Fusing prior knowledge with data-driven learning is attractive where data is scarce, yet no controlled account says when it helps, is redundant, or harms. We benchmark one fixed hand-crafted knowledge source, a pinned bank of Gabor targets injected only during training at $\sim$2\% overhead, against data-driven alternatives (SimCLR, SimSiam, DINO, ImageNet transfer, augmentation, learned teachers) under one frozen recipe with fixed subsets: 13 datasets, 9 backbones, 150 to 1.28M images, 32--224\,px, 2.5M--86M parameters ($\computeCells$ classification configurations over $\computeRuns$ runs, plus segmentation and detection transplants). Across the training-time combinations we measure, three outcomes recur (decision-level fusion differs). Different-\emph{currency} sources can stack: the prior composes with DeiT augmentation on attention backbones and is worth $+26$ points to ViT-B/16 at $224$\,px, $+6.7$ at twice that budget. Same-currency sources substitute: against effective self-supervised pretraining, the combination never usefully exceeds the better single source. Fusing at full strength into an already-informed initialization interferes in proportion to what it carries: ImageNet transfer, $-15$ to $-17$ points, removed by a weaker auxiliary weight. Frozen-feature diagnostics measured on each source alone separate these outcomes retrospectively but do not predict them: a rule built on them calls one of nine unseen pairs. At a practitioner's own label budget, the frozen-feature gain predicts the end-to-end gain to within $0.17$ points across 30 cells and seven datasets; the underlying decomposition, $\Delta = G + \readout(\mathrm{base})$, holds in sign on $\auditRate\%$ of testable cells and is called an unseen backbone family's feature gain in advance. The project page is this https URL.
24. 【2608.21093】Gaussian-Mixture Latent Flow for Stochastic 3D Human Motion Prediction
链接：https://arxiv.org/abs/2608.21093
作者：Yue Ma,Frederick W. B. Li,Xiaohui Liang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Stochastic human motion, future motion distributions, forecast future motion, motion prediction aims, motion distributions
备注：
点击查看摘要
Abstract:Stochastic human motion prediction aims to forecast future motion distributions. Although recent studies have achieved strong performance in terms of accuracy and diversity, they often overlook plausibility (e.g., resulting in physically unrealistic predictions) and uncertainty quantification, both of which are essential for real-world applications and downstream tasks. To address these issues, we propose a latent flow-based model equipped with a data-driven Gaussian mixture prior that more effectively disentangles diverse human behaviors than conventional single-modal priors. This prior is derived from patterns in the training data without requiring additional annotations. Furthermore, the fully invertible nature of our model enables natural uncertainty quantification through tractable likelihood computation. Experiments on the Human3.6M and AMASS datasets demonstrate that our approach achieves state-of-the-art performance in both accuracy and plausibility.
25. 【2608.21067】AT-ViT: Area-Targeted Multi-View Vision Transformer with Cross-Attention and Multi-Scale Patching for Plant Trait Recognition in Herbarium Images
链接：https://arxiv.org/abs/2608.21067
作者：Amani Sedrat,Takieddine Chehhat,Youcef Sklab,Hanane Ariouat,Abderrazak Sebaa,Eric Chenin,Jean-Daniel Zucker,Edi Profiti
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：spurious non-plant cues, Automated plant traits, textual labels, mounting artifacts, color charts
备注：
点击查看摘要
Abstract:Automated plant traits recognition from herbarium images is essential for plant sciences, yet remains challenging because background elements (e.g., textual labels, mounting artifacts, and color charts) can introduce shortcut learning, leading models to rely on spurious non-plant cues rather than plant morphology. This bias degrades both generalization and interpretability. In this paper, we introduce AT-ViT, a dual-branch Vision Transformer that jointly encodes raw herbarium scans and their segmented-derived counterparts via a multi-scale, multi-view cross-attention fusion scheme. AT-ViT further incorporates a mask-guided patch weighting mechanism that amplifies plant-relevant regions and attenuates background-driven features. By learning from the original scans while being guided by segmentation masks through the mask-guided patch reweighting mechanism, the model is encouraged to focus on plant organs and learn plant-centric representations more effectively. Across multiple trait classification tasks (e.g., leaf base shape, thorns), AT-ViT delivers consistent accuracy gains, improves attention localization on plant regions, and exhibits increased robustness under synthetic background perturbations. Specifically, AT-ViT substantially improves spatial attention grounding, boosting plant-region alignment (Avg IoU_p: +15.66 to +18.03 pp) while reducing background overlap (Avg IoU_b: -27.92 to -31.02 pp) relative to CrossViT, and remains markedly more robust to background perturbations, outperforming ResNet101 by up to +32.32 accuracy points and CrossViT by up to +5.07 points under background-noise conditions.
26. 【2608.21066】Robust Validation to Geometric Perturbations for Autonomous Pose Estimation
链接：https://arxiv.org/abs/2608.21066
作者：Gregoire Theau,Melanie Ducoffe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deploying autonomous systems, abstract pixel-wise noise, safety-critical domains demands, domains demands guaranteed, demands guaranteed robustness
备注： 15 pages, 7 figures
点击查看摘要
Abstract:Deploying autonomous systems in safety-critical domains demands guaranteed robustness against physically plausible geometric perturbations rather than abstract pixel-wise noise. In vision-based navigation and autonomous landing, machine learning components require rigorous validation under dynamic operational conditions such as camera rotations and lighting shifts. Extending findings on the failure of first-order spatial attacks in classification, we show that standard gradient-based heuristics (e.g. APGD) similarly fail on for pose estimation, often performing worse than a simple random sampling baseline. To overcome these optimization bottlenecks, we reformulate pose estimation robustness within the framework of Global Lipschitzian Optimization (GLO). We argue that GLO offers a principled approach to robust validation, effectively localizing global optima with strong theoretical convergence guarantees. We evaluate this framework on a YOLOv8-Pose keypoint detector with a Perspective-n-Point (PnP) solver against rotation and contrast. In our evaluations, GLO successfully isolates critical failure modes where position deviations exceed safe operational limits, while rapidly pruning the search space by over 80%. To the best of our knowledge, this is the first study to extend geometric robustness validation to continuous keypoint regression and deep object detection, establishing a practical step toward certifying robust autonomous perception.
Comments:
15 pages, 7 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.21066 [cs.CV]
(or
arXiv:2608.21066v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.21066
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
27. 【2608.21060】CellPath-Bench: A Multidimensional Benchmark for Whole-Slide Cellular Representations in Pathology Foundation Models
链接：https://arxiv.org/abs/2608.21060
作者：Bokai Zhao,Yiyang Zhang,Hanqing Chao,Yawei Ma,Long Bai,Tai Ma,Minfeng Xu,Ming Song,Tianzi Jiang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Pathology foundation models, Pathology foundation, systematically diagnose, diagnose their whole-slide, Xenium tissue sections
备注：
点击查看摘要
Abstract:Pathology foundation models (PFMs) are increasingly used as general-purpose backbones, yet existing benchmarks cannot systematically diagnose their whole-slide cellular representation capabilities, including the decodability of cell-type information and the transferability of such information across tissue sections, datasets, and anatomical organs. We introduce CellPath-Bench, a cellular-resolution benchmark that evaluates frozen PFMs themselves. Following quality control of 52 candidate Xenium datasets, we construct a panel of 25 spatially aligned H\E--Xenium tissue sections spanning 11 organs and 7,079,283 cells, harmonized into fine- and coarse-grained taxonomies. CellPath-Bench samples frozen WSI feature maps at registered nuclear coordinates and evaluates them using standardized multiclass linear probes. Cell Representation Advantage (CRA) measures the within-section advantage of nucleus-anchored representations over patch-level mean pooling, while Cell Representation Transferability (CRT) characterizes the generalization of cell-type decodability across tissue sections, datasets, and organs. We benchmark 30 pathology-specific and general-purpose foundation models through 304,920 runs across spatial readouts, magnifications, taxonomic granularities, and evaluation protocols. The results reveal substantial model-dependent differences in cell-type decodability and its cross-domain generalization, yielding distinct multidimensional capability profiles. CellPath-Bench provides a standardized framework for auditing cellular information in frozen PFM representations.
28. 【2608.21055】CoAnchor: Robust Collaborative Perception under Spatio-Temporal Misalignment via Object-Level Anchors
链接：https://arxiv.org/abs/2608.21055
作者：Chi Li,Rui Lin,Aobo Ji,Dongzhu Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Collaborative perception extends, nearby agents, autonomous driving, extends the sensing, sensing range
备注： MM2026
点击查看摘要
Abstract:Collaborative perception extends the sensing range of a single vehicle by fusing observations from nearby agents, which improves the robustness of autonomous driving. In realistic deployments, however, the received collaborator messages are often affected by both communication delay and relative-pose noise, which jointly cause stale observations, spatial misalignment, and unstable feature fusion. Existing methods usually address these issues from either the spatial or temporal side, but handling them jointly in a unified and efficient manner remains challenging. In this paper, we propose CoAnchor, an anchor-centric spatio-temporal alignment framework for asynchronous collaborative perception. Instead of directly reasoning on dense BEV features, CoAnchor builds sparse object-level spatio-temporal anchors as a shared interface for pose correction and tightly connects spatial refinement, temporal propagation, and current-time verification within one unified loop, while keeping the overall correction process lightweight. Extensive experiments on both simulated and real-world datasets illustrate that CoAnchor remains competitive under clean settings and improves the robustness under joint delay and pose perturbations with a favorable practical accuracy-efficiency trade-off.
29. 【2608.21041】CoST: Semantic-Aware Urban Understanding via Spatial-Temporal Alignment
链接：https://arxiv.org/abs/2608.21041
作者：Yutian Jiang,Jiabo Liu,Xixuan Hao,Yuxuan Liang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Geospatial representation learning, large-scale urban analysis, Geospatial representation, real-world applications, learning from satellite
备注：
点击查看摘要
Abstract:Geospatial representation learning from satellite imagery is a fundamental problem for large-scale urban analysis and real-world applications. Despite recent advances, current methods struggle with cross-region generalization and semantic interpretability due to their reliance on region-specific auxiliary data and the neglect of semantic alignment within multi-temporal urban imagery. Therefore, we present CoST, a novel \underline{Co}ntrastive-based \underline{S}patial-\underline{T}emporal framework that aligns spatial context with multi-temporal semantics to extract universal geographic regularities shared across regions. Specifically, CoST explicitly models spatial correlations to capture transferable geographic structures and exploits multi-year urban change semantics to align learned representations with high-level geo-semantics. Extensive experiments demonstrate that CoST consistently achieves superior performance across various downstream tasks and in unseen scenario, yielding an average relative gain of 8.7\% over the strongest competing methods across eight city-indicator settings. The code is available in \href{this https URL}{this repo}.
30. 【2608.21030】COMET: Contrastive Motion-Enhanced Temporal Reasoning for Video Multimodal Large Language Models
链接：https://arxiv.org/abs/2608.21030
作者：Chenghua Zhu,Zhaolu Kang,Qifan Shi,Siyan Wu,Kehan Jiang,Lei Wei,Lianyu Hu,Guangyuan Dong,Mingbo Yang,Rui Lu,Guibo Luo
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：multimodal large language, Video multimodal large, understanding remains fragile, fine-grained motion-temporal understanding, large language models
备注： Accepted at the 34th ACM International Conference on Multimedia (ACM MM 2026)
点击查看摘要
Abstract:Video multimodal large language models have advanced significantly, yet fine-grained motion-temporal understanding remains fragile. The core bottleneck is not only sparse frame sampling, but also the lack of a complete temporal modeling pipeline for explicitly representing frame-to-frame change, enabling appearance-motion interaction, and optimizing temporal direction sensitivity. We propose COMET, a temporally grounded framework that systematically strengthens video MLLMs through explicit temporal representation, appearance-motion fusion, and direction-aware optimization. Architecturally, COMET introduces a temporal motion branch built on Taylor frame differences and injects its motion evidence into the appearance stream via temporal attention bias-enhanced cross-attention. For optimization, COMET combines temporal prior distillation with a forward-reverse TC-GRPO stage that turns temporal order into a direct learning signal and strengthens the model's use of directional motion patterns encoded by the temporal motion branch. The method achieves consistent overall improvements with a pronounced motion-temporal bias: on Qwen3-VL-8B, action-centric tasks (STAR, SSv2) improve by 4.9% on average, temporal reasoning tasks (NExT-QA, CLEVRER, LLaVA-178K) by 2.1% over BL-GRPO, while static perception tasks (PerceptionTest) remain on par. The same gain pattern also transfers to InternVL2.5-8B, indicating that COMET generalizes across model families.
31. 【2608.21022】Recognition-Conditioned Reasoning: A Training-Free Multimodal-LLM Pipeline for Fine-Grained Micro-Action Understanding
链接：https://arxiv.org/abs/2608.21022
作者：Fengshun Wang,Jin'ang Han,Zhigang Tu
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：slight head tilt, reliably leak emotional, low-amplitude body movements, head tilt, psychological state
备注： Accept at ACM Multimedia 2026
点击查看摘要
Abstract:Micro-actions are subtle, short, low-amplitude body movements, such as a fidgeting hand or a slight head tilt, that humans perform with little conscious intent yet that reliably leak emotional and psychological state. Understanding them goes beyond assigning a label: a model must also describe which body parts move and reason, faithfully, about why a clip warrants a particular fine-grained category. We present the training-free, prompt-only system that won first place in the fine-grained understanding track (MA-Bench) of the MAC~2026 Micro-Action Challenge, where both fine-tuning and ground-truth supervision are disallowed. Built entirely upon frozen multimodal large language models (MLLMs), the system dynamically routes each of the eight sub-tasks to the MLLM empirically best suited for that task: a discriminative MLLM for closed-ended recognition tasks and a generative MLLM for open-ended description and reasoning tasks. This architecture achieves a statistically significant performance advantage on open-ended tasks, attaining an average score of 2.68 (on a five-point scale) compared to 1.44 for the second-best approach.
32. 【2608.21009】Dorsal Hand Images for Immersive (XR) and Privacy-preserving Age Assurance and Child Safety
链接：https://arxiv.org/abs/2608.21009
作者：Riccardo Bovo,George Loukas,Josh P. Davis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Ensuring that Extended, Extended Reality, age assurance, environments are age-appropriate, safety challenge
备注：
点击查看摘要
Abstract:Ensuring that Extended Reality (XR) environments are age-appropriate is an important regulatory and safety challenge. However, current age assurance operates only at registration and cannot verify the age of the active user during a session. Face-based approaches, the dominant solution in social media and adult platforms, are impractical in XR, because they require removing the headset and taking a self-captured image, often on a mobile app. This both breaks immersion and introduces the privacy risk of sharing face pictures with third parties, which leaves XR platforms without a viable path to continuous, in-session and privacy-preserving age assurance. We propose the dorsal part of the hand as an alternative to the face, by exploiting the egocentric cameras that XR headsets inherently and naturally use to capture gesture interactions. To evaluate this, we collect an age- and sex-stratified, ethnodiverse dataset of 436 participants spanning the minor--adult boundary, captured under unconstrained lighting and orientation conditions. To characterise what is achievable with off-the-shelf methods at the minor--adult boundary, we evaluate standard neural network architectures for age assurance at the legally critical 18-year threshold. Analysis confirms performance is robust to skin-tone variation. On this dataset, the challenge-31 operating point achieves zero minor admission, making the system a viable first-stage filter for age assurance. These findings position dorsal hand morphometrics as an effective and more privacy-preserving biometric modality for in-session age assurance in XR.
33. 【2608.21008】riangulation-Free Bundle Adjustment with Graduated Non-Convexity for Camera Pose Refinement from Coarse Priors
链接：https://arxiv.org/abs/2608.21008
作者：Nikolaos Kyriazis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reconstruction-grade poses cheaply, metric pose prior, Mobile AR frameworks, casual phone capture, metric pose
备注： 25 pages, 3 figures. 18-scene MobileBrick evaluation, 15-scene ScanNet++ room-scale campaign, plus LaMAR. Code to be released under Apache-2.0
点击查看摘要
Abstract:Mobile AR frameworks attach a metric pose prior to every casual phone capture, and turning it into reconstruction-grade poses cheaply on CPU is the step before novel-view synthesis. The least a refiner owes an accurate prior is not to make it worse. The workhorse refiner does. On 15 ScanNet++ iPhone room captures, COLMAP triangulation plus prior-seeded bundle adjustment degrades an accurate ARKit prior in all 15, 0.55 degrees to 0.74 degrees by scene-mean. The cause is the seeding. Structure is triangulated from the prior before anything is optimized, so the prior's error is baked into the structure the optimizer trusts. We remove the triangulation. Every keypoint owns a scalar depth along its own back-projected ray and each match contributes two symmetric cross-projection residuals, so structure is re-expressed at every iterate. The same solve holds the room prior at 0.57 degrees and never fails in 330 perturbed room runs, and at object scale reaches 0.265 degrees/1.80 mm from a prior at 0.456 degrees in a median of 10 s per scene on one CPU, against 2.5 GPU-hours for a learned refiner. Because no structure is committed, the objective also admits graduated non-convexity, which measures how deep the defect goes. Classical refinement collapses past 1-2 degrees of prior error, barely beyond a real ARKit prior, and no classical refinement arm survives 32 degrees. Ours recovers 425 of 425 runs through 16 degrees/80 mm and 85% at 32 degrees/160 mm, and perturbed rooms through 32 degrees. Nominal object-scale accuracy is on par rather than better, on a benchmark at its own noise floor, where classical bundle adjustment is a strong baseline absent from the literature. One scene fails for every solver already at zero perturbation. Re-mapping from position priors matches us in the prior's frame but discards it, so it cannot exploit a prior worth keeping or be warm-started.
Comments:
25 pages, 3 figures. 18-scene MobileBrick evaluation, 15-scene ScanNet++ room-scale campaign, plus LaMAR. Code to be released under Apache-2.0
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
ACMclasses:
I.4.8; I.2.10
Cite as:
arXiv:2608.21008 [cs.CV]
(or
arXiv:2608.21008v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.21008
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Nikolaos Kyriazis [view email] [v1]
Fri, 21 Aug 2026 11:54:20 UTC (162 KB)
34. 【2608.20999】Latent Ordinal Evidence, Misaligned Outputs: Inference-Time Ordinal Lens Alignment for Multimodal LLMs
链接：https://arxiv.org/abs/2608.20999
作者：Haiming Li,Yingsheng Liu,Jingmin Zhu,Siyuan Yan,Xieji Li,Jiajun Sun,Zhen Yu,Zongyuan Ge
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal LLMs apply, image quality assessment, language model interface, disease grading require, grading require autoregressive
备注： EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Multimodal LLMs apply the language model interface to visual inputs, where ordinal regression tasks such as age estimation, image quality assessment, and disease grading require autoregressive decisions over ordered class labels. We ask whether MLLMs reliably convert internal ordinal evidence into ordered digit-token outputs. Across four ordinal benchmarks and four MLLM backbones, ordinal labels are linearly recoverable from hidden states with Spearman correlation up to 0.938, and a task-designed prompt further sharpens this structure. Yet native digit-token outputs weakly expose it: the unembedding matrix filters the ordinal direction, and the digit-token row space retains below 1.15% across all 16 model-dataset combinations, with a 16 to 77 absolute-point accuracy gap between linear-probe and native outputs. We introduce Ordinal Lens Alignment (OLA), a frozen-backbone inference-time method that trains lightweight W_S-anchored lenses on mid-to-deep decoder layers, fuses them into an ordinal distribution, and corrects only digit-token logits at generation. OLA outperforms the SOTA LoRA-tuned OrderChain baseline in most settings while keeping the MLLM frozen, surpasses discriminative ordinal baselines in most cells, and improves over an offline lens in every setting.
35. 【2608.20984】MigrationNarrate: A Dataset for Detection of Migration Narratives in YouTube Videos
链接：https://arxiv.org/abs/2608.20984
作者：Fatima Haouari,Carolina Scarton,Kalina Bontcheva
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：analysing public discourse, critical for understanding, understanding and analysing, public discourse, Narratives
备注： This work was accepted to the main conference of EMNLP 2026
点击查看摘要
Abstract:Narratives are central to how social communication is framed, making their detection critical for understanding and analysing public discourse. Prior work has explored narrative detection and extraction across diverse domains; however, migration narratives remain significantly understudied, primarily due to the absence of dedicated annotated datasets. Furthermore, public communication has recently shifted towards video-centric platforms, where narratives are conveyed through multimodal signals and consumed at scale. Despite this shift, narratives in videos remain largely unexplored. To bridge these gaps, we introduce MigrationNarrate, the first multimodal dataset for detection of migration narratives in the UK, consisting of 1,115 YouTube video transcripts annotated using a two-level taxonomy of 12 migration super-narratives and 53 narrative labels. This paper details the dataset design, collection, and annotations; together with benchmark results using a combination of pre-trained encoder models and both open- and closed-source Large Language Models. Finally, a thorough error analysis offers insights for future work.
36. 【2608.20974】WA-JEPA: Rethinking the Video JEPA Paradigm for World-Action Modeling in Autonomous Driving
链接：https://arxiv.org/abs/2608.20974
作者：Xinlin Wang,Yujiao Xiang,Yuheng Zhou,Jingqi Wang,Minqing Huang,Jiajie Huang,Dongxu Wei,Tingguang Zhou,Xiyang Wang,Gong Chen,Zhi Xu,Feiyang Tan,Hangning Zhou,Mu Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Embedding Predictive Architecture, Joint Embedding Predictive, Predictive Architecture, Embedding Predictive, Video Joint Embedding
备注：
点击查看摘要
Abstract:Video Joint Embedding Predictive Architecture (V-JEPA) learns powerful spatiotemporal representations from video through self-supervised latent feature prediction. However, V-JEPA is built around random-mask completion and deterministic regression, making it fundamentally ill-suited for autonomous driving planning that demands future-directed prediction tightly coupled with action. To address this, we rethink the V-JEPA paradigm and present WA-JEPA, a V-JEPA-native world-action model designed for autonomous driving planning. Instead of random spatiotemporal masking, WA-JEPA employs hybrid future-masked pre-training, where the model infers future latents from observed context. Departing from deterministic regression, we recast future prediction as conditional flow matching over latent futures, which substantially improves the model's ability to generate plausible future latents for downstream planning. Finally, a joint future-action predictor is proposed to denoise future scene tokens and ego trajectories together in a unified spatiotemporal latent space, allowing action supervision to directly shape planning-relevant world representations. Pre-trained on nuPlan videos and fine-tuned on NAVSIM, WA-JEPA reaches 91.7 EPDMS on NAVSIM-v2, surpassing the strongest end-to-end and world-action baselines by 1.6 and 1.3 EPDMS, and, without HUGSIM-specific fine-tuning, attains the best HD-Score of 0.4462 on the closed-loop HUGSIM benchmark under the same evaluation protocol. These results validate V-JEPA-native world-action modeling as a powerful and scalable paradigm for autonomous driving planning. Code is available at this https URL.
37. 【2608.20969】Kinematic Knowledge Maps for Pattern Alignment: Structured Latent Representational Learning in Multimodal Gait Analysis
链接：https://arxiv.org/abs/2608.20969
作者：Chen Dong,He Zonglin,Cheung Kenneth M.C
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：weakly aligned inputs, template-based kinematic text, dense video stream, domain-specific interpretable representations, template-based kinematic
备注：
点击查看摘要
Abstract:Multimodal clinical AI is limited by weakly aligned inputs and the absence of domain-specific interpretable representations, particularly when learning from dense video stream, structured time-series, and template-based kinematic text. Here we present ScoliDetect, an explainable framework for adolescent idiopathic scoliosis screening from monocular gait video, built around a kinematic knowledge map (KKM) and complementary template-based kinematic text derived from per-sequence pose statics. KKM is a fixed-index structured representation that encodes gait features across absolute motion, self-skeleton configuration and joint-joint signal correlation, providing anchor-referenced multimodal fusion and factor-level interpretation. We integrate video, KKM, and template-based kinematic text through bidirectional cross-attention with latent-bottleneck aggregation. In a multicenter cohort (n = 1,858 after exclusions), prespecified supervised ablations on an external screening cohort show that KKM-mediated multimodal fusion outperforms unimodal models and late concatenation. Under a staged training protocol, trimodal contrastive pretraining is applied after architecture selection as representation initialization, improving external ROC-AUC from 0.961 to 0.972. Furthermore, the structured nature of the KKM provides inherent, factor-level attributions mapped directly to specific kinematic phases and skeletal indices, offering verifiable interpretability. The results demonstrate that embedding explicit structural topologies into latent spaces significantly enhances both the generalization and explainability of multimodal pattern analysis systems.
38. 【2608.20967】Generalizing Soft Tissue Deformation and Force Prediction Across Material Stiffness and Geometry
链接：https://arxiv.org/abs/2608.20967
作者：Madina Kojanazarova,Sidaty El Hadramy,Philippe C. Cattin
类目：Artificial Intelligence (cs.AI); Computational Geometry (cs.CG); Computer Vision and Pattern Recognition (cs.CV)
关键词：haptic feedback systems, Accurate soft tissue, Accurate soft, pre-operative planning, feedback systems
备注：
点击查看摘要
Abstract:Accurate soft tissue simulation is essential for surgical training, pre-operative planning, and haptic feedback systems. While learning-based surrogate models trained on data using the finite element method (FEM) offer a promising path to real-time inference, their reliability depends on well-calibrated constitutive models. Existing approaches neither provide systematic guidance on model selection across stiffness levels, nor generalize across different tissue stiffnesses or geometries. We perform a comprehensive calibration of hyperelastic constitutive models in the SOFA Framework using gravity-loaded silicone beams with different stiffnesses. Using calibrated simulations as training data, we use a softness conditioned equivariant graph neural network, enabling deformation and force prediction across multiple tissue types and unseen geometries. Our model achieves sub-millimeter mean deformation accuracy at 0.010s inference time, while showing that force prediction quality is directly tied to upstream calibration consistency.
39. 【2608.20958】Live-Omni: An Omni-Modal Understanding Model for E-Commerce Live Streaming
链接：https://arxiv.org/abs/2608.20958
作者：Yibo Hu,Yu Qian,Mao Gu,Yingfan Tao,Yuhao Chen,Yongdong Luo,Zhuoqun Liu,Meiguang Jin,Junfeng Ma
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：user queries, requires omni-modal understanding, facts are distributed, live streaming requires, E-commerce live streaming
备注：
点击查看摘要
Abstract:E-commerce live streaming requires omni-modal understanding of noisy, temporally extended streams, where product facts are distributed across speech, video frames, product images, overlaid text, and user queries. We present TLive-Omni, an omni-modal understanding model tailored to live-commerce scenarios. It maps image, video, audio, and text inputs into a unified representation space. For long-form live streaming analysis, we introduce Per-vGrid, a timestamped token organization that groups each video grid with its temporally corresponding audio within explicit boundary tokens to facilitate temporal alignment. We design a three-stage supervised training recipe that progressively develops live-commerce understanding, from omni-modal perception to instruction-following responses. We then propose Faithful-RFT, a reinforcement fine-tuning stage that further improves answer faithfulness and expression quality while meeting real-time demands, scoring final responses directly with task-verifiable feedback rather than optimizing for reasoning-style exploration during rollout. Moreover, TLive-Omni is supported by a scenario-oriented atomic capability taxonomy and a compact data production engine that converts live-commerce audio, image, and video streams into training signals for speech recognition, speaker analysis, product visual grounding, text recognition, temporal grounding, video dense caption, and omni-modal QA, etc. For scalable training, a synchronized length-grouped sampler reduces padding while preserving comparable workloads across workers, while a lightweight dynamic sampling strategy regenerates rollout groups with near-zero reward variance to maintain meaningful relative advantages for GRPO. Experiments on e-commerce live streaming benchmarks demonstrate strong performance across live-commerce domain tasks, together with excellent generalization on general benchmarks.
40. 【2608.20944】SuppreSensing: Expert-Guided Feature Recalibration and Discrepancy Augmentation for Multimodal Object Detection
链接：https://arxiv.org/abs/2608.20944
作者：Xin Wu,Zhenyu Gao,Qiankun Zhang,Shaoyong Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remote sensing faces, sensing faces challenges, faces challenges due, modality-specific noise interference, noise interference
备注： 10 pages
点击查看摘要
Abstract:Multimodal object detection in remote sensing faces challenges due to semantic heterogeneity and modality-specific noise interference. To this end, we propose SuppreSensing, which reformulates multimodal fusion as a selective collaboration process that jointly models shared information and modality-specific cues. SuppreSensing first designs an Expert-driven Multimodal Feature Recalibration (EMFR) module, which reformulates shared-consensus extraction as an input-adaptive multi-expert selection process to alleviate the symmetry trap in multimodal fusion. Complementing this, a modality-specific attribute augmentation strategy is employed to enhance specific modality features by modeling bidirectional discrepancy patterns, mitigating cross-modal heterogeneity. Furthermore, we propose an Expert-driven Customized Feature Purification (ECFP) module based on a "specialized inspection-comprehensive analysis-diagnostic update" physical examination paradigm to iteratively filter redundancies and reinforce task-relevant semantics. Extensive experiments on the DroneVehicle and VEDAI datasets demonstrate that SuppreSensing achieves state-of-the-art detection performance. Cross-domain evaluations on natural scene datasets (FLIR and LLVIP) further validate its superior robustness and generalization capability across diverse environmental conditions.
41. 【2608.20942】LHMCF-Net: A Learned Hyperbolic Mean Curvature Flow Network for Medical Images Segmentation
链接：https://arxiv.org/abs/2608.20942
作者：Shuangshuang Duan,Chunlei He,Shoujun Huang,Dexing Kong
类目：Computer Vision and Pattern Recognition (cs.CV); Mathematical Physics (math-ph)
关键词：complex spatial structures, unified high-dimensional framework, capture complex spatial, integrating feature space, feature space data
备注：
点击查看摘要
Abstract:Motivated by the classical Chan-Vese model and the ability of deep priors to capture complex spatial structures, we develop a segmentation model that leverages learned hyperbolic mean curvature flow (LHMCF) as a mathematical foundation for integrating feature space data fidelity and deep structural priors within a unified high-dimensional framework. The proposed LHMCF model is governed by a second-order dissipative hyperbolic PDE, where the introduction of a velocity field provides inertia and momentum to the evolving interface. This hyperbolic mechanism enables the contour to bypass noise-induced local minima and propagate coherently through low-contrast or ambiguous regions, addressing limitations inherent to first-order parabolic flows. To solve the continuous LHMCF model, we construct a deep unfolding network, named LHMCF-Net, which maps the iterative numerical procedure of the PDE into a sequence of discrete evolution stages. Each stage corresponds to one physically interpretable update of the underlying dynamical system, allowing the network to inherit the stability and geometric consistency of the PDE while supporting end-to-end optimization. Comprehensive experiments on three publicly available medical segmentation datasets demonstrate that LHMCF-Net achieves superior performance, particularly in challenging scenarios with low contrast and unclear boundaries. These results highlight the effectiveness of embedding hyperbolic geometric evolution into deep unfolding architectures and underscore the potential of physically inspired models for robust medical image segmentation.
42. 【2608.20932】OccluRank: Controllable Occlusion-Aware Layout-to-Image Generation by Adding Just an Ordinal Rank
链接：https://arxiv.org/abs/2608.20932
作者：Wenyang Hong,Yuan Wang,Yanbin Hao,Lanqing Xue,Ke Wang,Xiang Wang,Kuien Liu,Richang Hong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generation enables explicit, explicit spatial control, enables explicit spatial, generation enables, enables explicit
备注： 16 pages, 7 figures. Code: [this https URL](https://github.com/Wenyang-hong/OccluRank)
点击查看摘要
Abstract:Layout-to-image generation enables explicit spatial control through bounding-box layouts, yet bounding boxes specify only instance locations and cannot represent their occlusion order. Existing methods may rely on additional geometric conditions, employ complex inference procedures, or aggregate independently constructed instance representations without explicitly modeling their occlusion-dependent interactions. We propose OccluRank, a simple and controllable occlusion-aware layout-to-image framework that augments each bounding box with only one ordinal rank. OccluRank encodes the user-specified occlusion order through lightweight rank-based conditioning and introduces an Order-aware Instance Interaction (OII) module to jointly update rank-conditioned instance representations before aggregation. This allows the specified order to guide information exchange among occluding instances without additional geometric inputs or specialized inference-time optimization. We further construct OccluLayout, a synthetic training dataset whose occlusion order and amodal annotations are derived directly from known scene geometry rather than estimated from partially occluded images using auxiliary prediction models. For comprehensive evaluation, we introduce OccluLayout-Bench, which uses multiple multimodal large language model evaluators to assess instance presence, spatial layout, attributes, and occlusion order, together with FID for overall image quality. Experiments show that OccluRank more reliably preserves target instances, follows specified layouts, and realizes desired occlusion relationships while maintaining comparable attribute consistency and overall image quality.
43. 【2608.20929】GAP-SAM: A Global Artifact Prior for Generalizable AI-Generated Image Manipulation Localization
链接：https://arxiv.org/abs/2608.20929
作者：Haozhen Yan,Siyuan Shan,Zijian Yu,Youqi Wang,Yan Hong,Jun Lan,Jianfu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：OOD performance lags, supervision entangles forensic, entangles forensic evidence, image-level detection partly, dataset-specific mask geometry
备注：
点击查看摘要
Abstract:AI-generated image manipulation localization identifies edited pixels, but its OOD performance lags behind image-level detection partly because pixel supervision entangles forensic evidence with dataset-specific mask geometry and semantic boundaries. Extending image-level distribution alignment to localization, we construct COCO-ControlNet with source-image Canny edges and depth maps to align semantics and geometry, improving OOD performance across multiple localizers. Yet tighter Mask-VAE Reconstruction Alignment (Mask-VAE) underperforms COCO-ControlNet, showing that VAE reconstruction artifacts transfer poorly to local diffusion-inpainting artifacts. We also identify \emph{boundary adhesion}, where fine-tuned segmentation models snap predictions to semantic object contours rather than true manipulation boundaries. These findings motivate GAP-SAM, which encodes an image and its frozen VAE reconstruction into a global artifact token and injects it into SAM3's feature pyramid via zero-gated FiLM before pixel decoding. Without prescribing a spatial region, this token modulates dense decoding to preserve localization while suppressing semantic-boundary shortcuts. Across six datasets, GAP-SAM averages 79.8 Pixel-F1, outperforming the strongest prior method by 12.6 points. It also performs best at every tested severity of JPEG compression, Gaussian blur, and resizing.
44. 【2608.20916】Semantically Compatible Knowledge Distillation for Cross-Domain Object Detection with Vision Foundation Models
链接：https://arxiv.org/abs/2608.20916
作者：Qifeng Zhang,Ting Xiang,Zeyuan Bai,Changjian Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision foundation models, offer strong generalization, strong generalization capabilities, Vision foundation, domain-adaptive object detection
备注：
点击查看摘要
Abstract:Vision foundation models (VFMs) offer strong generalization capabilities for domain-adaptive object detection (DAOD). However, existing VFM-based methods overlook the spatial-scale discrepancy between teacher and student feature maps, resulting in semantic incompatibility that weakens both feature alignment and pseudo-label learning. Moreover, domain shift can cause source-trained VFM teachers to miss target-domain objects, limiting the quality of their pseudo-labels. To address these issues, we propose the Semantic Localization-Enhanced Teacher (SLE-T), a semantically compatible knowledge-distillation framework built around a lightweight SLE Adapter for DINOv2. SLE Adapter injects pretrained local-texture priors into DINOv2 to improve cross-domain recognition and reformulates its features into dense representations that are spatially and semantically compatible with the student detector. SLE-T transfers the resulting teacher knowledge through either pseudo-label learning or feature alignment. We instantiate SLE-T with DINOv2-B and DINOv2-L (the ViT-B and ViT-L variants) and compare them with the larger DINOv2-G teacher. Extensive experiments on three DAOD benchmarks demonstrate that our method achieves state-of-the-art performance, and ablation studies confirm the importance of teacher-student semantic compatibility. Notably, SLE-T with DINOv2-B produces competitive or superior pseudo-labels using approximately one-quarter of the training time of DINOv2-G and substantially less GPU memory, demonstrating efficient VFM knowledge transfer under limited computational resources.
45. 【2608.20913】Explainable Deepfake Detection with Feature-robust Augmentation and Evidence-grounded Explanation Optimization
链接：https://arxiv.org/abs/2608.20913
作者：Zhu Xu,Jiaqi Tang,Pokai Chen,Yuxin Peng,Yang Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：provide interpretable justifications, extends binary classification, detection extends binary, Explainable deepfake detection, interpretable justifications
备注：
点击查看摘要
Abstract:Explainable deepfake detection extends binary classification by requiring models to not only predict authenticity but also provide interpretable justifications. This expanded scope is critical in practice, where users like forensic analysts need insight into the rationale behind the detection. Despite advancements, current approaches suffer from two critical deficiencies: (1)vulnerability to image quality degradation: detection accuracy plummets on low-quality samples, while naive augmentation strategies may induce feature drift and impair performance as diversity expands. (2) factually flawed explanations: explanation models may omit manipulation evidence or hallucinate irrelevant details, undermining interpretability. To address it, we propose a framework with two innovations. For robust deepfake detection, we introduce Feature-robust Augmentation, which comprises diversified degradation-aware augmentation strategies, and a supervised contrastive learning pattern paired with a mean-teacher architecture that stabilizes features against augmentations through consistency constraints. For explanation, we devise an evidence-grounded preference optimization process that guides model to prioritize genuine manipulation traces by learning from chosen-rejected explanation pairs, where rejected samples are constructed via evidence omission or irrelevant information injection. The proposed approach wins the first place in ACM Multimedia 2026 Explainable Deepfake Detection this http URL code is available at this https URL.
46. 【2608.20910】InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter
链接：https://arxiv.org/abs/2608.20910
作者：Yunze Tong,Mushui Liu,Canyu Zhao,Shiyi Zhang,Didi Zhu,Peng Zhang,Wanggui He,Jinlong Liu,Ying Chen,Hao Jiang,Pipei Huang,Bo Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：effectively improved instruction-based, improved instruction-based video, large pretrained models, edit, existing methods
备注： 18 pages
点击查看摘要
Abstract:With large pretrained models, existing methods have effectively improved instruction-based video editing. However, most of them rely on an in-place editing assumption. They align the edited video with the given source clip frame by frame over a fixed time span. This pattern fails for open-ended streams, e.g., restyling a live game or applying a camera move to an ongoing shot. In such cases, edits must extend to future frames as they arrive, rather than be applied to a static input clip. In this paper, we study this setting and name it infinite video editing: given a preceding segment and an edit request, a model must generate the next segment that continues the stream while applying the requested edit. This process repeats as an unbounded sequence of edit instructions arrives. This task brings two challenges: the edit must be a faithful continuation rather than a frame-wise rewrite, and generation quality must remain stable as edits accumulate. To address them, we first design a data-collection pipeline for infinite video editing. Based on the collected data, we propose InfinityEdit, a lightweight edit adapter that equips a streaming video generator with unbounded editing ability. The adapter contains three attention modules. History cross-attention guides the denoising frames using the input frames. Temporal causal self-attention keeps temporal cues flowing only from earlier frames to later ones. Edit cross-attention injects the edit request into generation. During inference, the adapter is activated only in the chunk where an edit request arrives. Subsequent chunks are generated by the original model with a reset anchor frame. This scheme applies the edit while preserving the original model's infinite generation ability. Extensive experiments show that InfinityEdit faithfully continues the stream under each edit, and stays stable over unbounded edit sequences.
47. 【2608.20905】EmotionDialogCN: A Spontaneous Multimodal Dataset for Mandarin Emotional Dialogue
链接：https://arxiv.org/abs/2608.20905
作者：Yi Zheng,Yifan Xu,Yan Zhou,Hejia Chen,Chunyu Qiang,Xiaoqiang Liu,Xiaohan Li,Shenze Huang,Yue Zhang,Guoying Zhao,Pengfei Wan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conveying rich emotional, audiovisual interaction, conveying rich, social cues, interaction is central
备注：
点击查看摘要
Abstract:Face-to-face audiovisual interaction is central to human communication, conveying rich emotional and social cues. However, existing multimodal dialogue datasets remain limited by inadequate emotion annotations, poor emotional diversity, and small scale. We introduce EmotionDialogCN, a large-scale audiovisual-emotional dataset designed to capture authentic face-to-face communication. It contains 21,880 dialogue sessions performed by 119 professional actors across 20 everyday scenarios, covering 18 emotion categories with over 400 hours of recordings, the largest and most comprehensive dataset of its kind. A novel data collection framework minimizes equipment interference, enabling natural and nuanced emotional expressions. EmotionDialogCN achieves an emotion distribution deviation of 0.64 from real human emotion statistics (versus 5.65 for prior datasets) and consistent subject framing (52-59% frame occupancy). Together, these properties translate into stable unimodal and multimodal performance across acoustic, lexical, and visual modalities, with fusion results further underscoring strong multimodal alignment and cross-modal complementarity.
48. 【2608.20891】IMU-Free Body-Frame State Estimation with Sparse Scene Flow for Quadcopters
链接：https://arxiv.org/abs/2608.20891
作者：Daniel Grønhaug,Sofie Markeset,Mathias Kolberg
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：X-configuration quadcopters equipped, X-configuration quadcopters, vision-only state estimation, state estimation system, canonical stereo camera
备注： 56 pages, 5 figures, 2 tables. Evaluated on the VID dataset ( [arXiv:2103.11152](https://arxiv.org/abs/2103.11152) )
点击查看摘要
Abstract:We present a vision-only state estimation system for X-configuration quadcopters equipped with a canonical stereo camera pair and no inertial sensors. The system operates entirely in the body frame, requiring only synchronised stereo images and motor thrust commands. A continuous-discrete extended Kalman filter on a composite manifold state $\langle SE(3), \mathbb{R}^3, \ldots \rangle$ maintains estimates of body-frame pose, velocity, angular velocity, gravity, and disturbances, using stationary scene points as implicit inertial references. Feature points are detected (FAST, Shi-Tomasi), tracked temporally (SSD, Lucas-Kanade) and matched across cameras (NCC), with search regions predicted from filter-derived pose and point uncertainty. Chi-squared gating on the normalised innovation admits only stationary points to the filter. The system also produces a sparse 3D point cloud carrying per-point position, velocity and joint covariance. These come from a 4-view (two stereo pairs at two timestamps) full bundle adjustment that jointly estimates position and velocity from stereo disparity and temporal parallax, with the filter-derived relative pose as a prior. Feature points in the EKF do not enter the solver; their information is reflected through the pose prior. Point cloud density is spatially adaptive: an external focus point directs allocation, producing dense coverage in the region of attention and sparse coverage elsewhere. The output is a body-frame state estimate, a calibrated pose change, and a sparse scene flow. It is intended as a measurement source for a downstream world model anchored in the current body frame, without dependence on GPS, IMU, or any world-frame infrastructure, though the architecture accommodates their future integration.
49. 【2608.20890】A Collaborative Multi-Modality Interaction for VLA-based End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2608.20890
作者：Jingtao Sun,Xiaohai He,Yike Zhang,Dong Huang,Yaonan Wang,Ajmal Mian,Mike Zheng Shou
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：unified multimodal framework, jointly integrating perception, VLA models formulate, autonomous driving, existing VLA models
备注：
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have emerged as a powerful paradigm for end-to-end autonomous driving by jointly integrating perception, reasoning, and decision making within a unified multimodal framework. However, most existing VLA models formulate end-to-end autonomous driving as a visual question answering task, leading to unreliable and less interpretable decision reasoning. In addition, they fail to establish effective multi-modal interaction across heterogeneous sensors, thereby limiting robust scene perception and reliable driving reasoning in long-tail driving scenarios. To this end, we propose a robust VLA-based end-to-end autonomous driving system that combines multi-modality interaction with multi-trajectory planning and optimization, enabling more reliable, interpretable, and safer driving decisions. Our method comprises three core components: (1) Affinity-Guided Optimal Transport for main-auxiliary modality two-way interaction; (2) Distribution-Consistent Modality Transfer for heterogeneous modality distribution transfer and cross-modal interaction; (3) Multi-modal Multi-Trajectory Planning along with Perception-Oriented Trajectory Refinement for better driving decisions to long-tail driving scenarios. Experimental results in open-loop and closed-loop datasets demonstrate improvements in safety long-horizon driving reasoning and road scene perception over existing driving systems, highlighting the ability of our mutli-modality interaction and multi-trajectory planning and optimization for scalable VLA-based systems.
50. 【2608.20886】EviRank: Structured Relevance Evidence for Multimodal Image Re-ranking
链接：https://arxiv.org/abs/2608.20886
作者：Enjun Du,Siyi Liu,Zirong Chen,Xinyu Zuo,Jinwen Luo,Ruiwen Tao,Lisheng Duan,Haijin Liang,Jin Ma,Junfu Pu,Yongqi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Real-world image search, image search queries, find this shirt, entity to retain, context to ignore
备注：
点击查看摘要
Abstract:Real-world image search queries are multimodal and compositional: ``find this shirt in pink'' specifies an entity to retain, an attribute to modify, and context to ignore. Yet existing re-rankers either compress such multifaceted relevance into an opaque embedding or rely on free-form chain-of-thought that easily omits or hallucinates fine-grained constraints. Drawing on rubric- and checklist-based evaluation from NLP, we recast multimodal image re-ranking as a semantic constraint satisfaction problem and propose EviRank, which parses any query - text-only, image-only, or composed - into a unified evidence package: typed criteria across six semantic slots (e.g., entities, attributes, relations), each labelled required, forbidden, or ignorable. Re-ranking then reduces to evidence-conditioned verification, combining deterministic rubric scoring and evidence-grounded listwise comparison in a single training-free procedure. The explicit evidence can further serve as structured supervision for optionally distilling a lightweight student. Across five benchmarks spanning text-to-image, image-to-image, and composed image retrieval, EviRank achieves state-of-the-art performance, and the distilled student preserves over 90% of the teacher's capability at substantially lower cost.
51. 【2608.20884】Breaking High Confidence: Practical Face Impersonation under High-Security Thresholds
链接：https://arxiv.org/abs/2608.20884
作者：Changjin Kim,Seunghun Paik,Dongsoo Kim,Jae Hong Seo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Face recognition systems, critical real-world services, Face recognition, airport identity checks, recognition systems
备注：
点击查看摘要
Abstract:Face recognition systems (FRSs) are increasingly deployed in critical real-world services for authentication, such as banking applications and airport identity checks, necessitating stringent security configurations. Consequently, the security vulnerabilities of FRSs have garnered significant attention. While existing studies have extensively explored FRS security, prior analyses have primarily focused on medium-security threshold settings, which are not directly applicable to FRSs operating under high-security constraints. In this paper, we propose the first successful impersonation attack against FRSs under high-security threshold settings. Among various threat models, we focus on a practical and challenging scenario: score-based impersonation attacks under strict rate limits. To precisely evaluate the feasibility of such attacks, we provide a principled mathematical analysis characterizing the gaps in each stage of the attack pipeline. Our method significantly enhances impersonation capabilities in score-based attacks, even under elevated decision thresholds. On the LFW benchmark, with a budget of only 100 confidence score queries per identity, our attack achieves an impersonation success rate exceeding 92\% against Amazon Rekognition at a confidence score threshold of 99-recommended setting for law enforcement scenarios. We further observe consistently robust performance across multiple open-source FRSs evaluated at similarly stringent decision thresholds.
52. 【2608.20882】LoRC: Detecting AI-Generated Images via Low-Rank Collapse in Semantic Residuals
链接：https://arxiv.org/abs/2608.20882
作者：Haozhen Yan,Ruoxin Chen,Jiahui Zhan,Bo Wang,Youchang Xiao,Shouhong Ding,Liqing Zhang,Taiping Yao,Jianfu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：producing synthetic images, faithfully model macroscopic, generators faithfully model, model macroscopic semantics, Modern generators faithfully
备注： ECCV 2026 Spotlight
点击查看摘要
Abstract:Modern generators faithfully model macroscopic semantics, producing synthetic images that appear highly realistic. Consequently, decisive forensic cues reside in subtle non-semantic visual discrepancies. To reveal these cues, we revisit AIGI detection from a geometric perspective and identify an architecture-agnostic signature. Specifically, modern generators exhibit low-rank collapse (\textit{i.e.}, rank degeneracy) in the semantic-residual orthogonal subspace while largely preserving the dominant semantic direction. This structural flattening consistently emerges during the final decoding stage, forming a shared bottleneck across diverse generator architectures. Motivated by this signature, we propose \textbf{LoRC}, a framework that decouples semantic dominance to capture the collapsed residual geometry induced by the generative decoding bottleneck. Our method improves accuracy by an average of 7.0\% across multiple benchmarks and achieves 97.0\% accuracy on 39 unseen generators. These results demonstrate strong cross-model generalization and robustness, making LoRC a reliable approach for AIGI detection in complex real-world environments.
53. 【2608.20874】Multi-Modal Traffic Sign Detection with Semantic Attributes for Autonomous Driving
链接：https://arxiv.org/abs/2608.20874
作者：Meda Lazar,Sourab Sridhar,Shashwata Gupta,Alexandra Tripcea,Varun Ravi,Senthil Yogamani
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Reliable traffic sign, perceiving signs correctly, road safety depend, Reliable traffic, correctly across regions
备注：
点击查看摘要
Abstract:Reliable traffic sign detection is a prerequisite for the global deployment of autonomous driving systems, where regulatory compliance and road safety depend on perceiving signs correctly across regions, ranges, and weather conditions. Despite recent progress, vision-based methods continue to face three fundamental limitations: poor cross-regional generalization due to high diversity across countries, degraded performance on small-object detection at long ranges (traffic signs occupy as little as $10{\times}10$ pixels at 200m), and fragile temporal tracking under the strongly non-linear perspective distortion that occurs as a vehicle approaches a sign. In this paper, we address the problem of robust, long-range, region-agnostic traffic sign perception by combining camera and Light Detection and Ranging (LiDAR) sensing. We present a multi-modal detection framework whose Intensity-Aware Deformable Fusion module aligns retro-reflective LiDAR cues with camera features, anchoring detection on geometric invariants rather than region-specific visual appearance. We further introduce a dual motion-model tracker that explicitly accounts for non-linear perspective transformations during vehicle approach, substantially improving temporal consistency over linear motion assumptions. Additionally, we develop a semantic attribute classification pipeline that estimates occlusion level, readability, sign embeddedness, and road relevance, providing actionable context to downstream planning. Extensive evaluation on our dataset, spanning 60+ countries and 2,500+ hours of driving data, shows that the proposed pipeline achieves an Object Miss Ratio (OMR) of 0.49% across 221,068 evaluation sequences, demonstrating globally generalizable traffic sign perception in commercial-grade autonomous driving systems.
54. 【2608.20870】RDANet: Relative Degradation Aware Network for Infrared Small Target Detection
链接：https://arxiv.org/abs/2608.20870
作者：Rui Liu,Jing Nie,Ying Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remote sensing imagery, exhibit weak local, highly variable backgrounds, Infrared small target, sensing imagery
备注： Accept by TGRS 2026
点击查看摘要
Abstract:Infrared small target detection is still challenging in remote sensing imagery, because the targets are extremely small, exhibit weak local contrast, and are often embedded in complex and highly variable backgrounds. In addition to these inherent difficulties, we observe that existing detectors often show unstable performance when the target scale changes or when the scene background varies. This scale- and scene-sensitive degradation indicates that current methods are insufficient in simultaneously preserving target structure during feature downsampling and maintaining discriminative local contrast under background shifts, which finally results in unbalanced detection performance across different conditions. To improve detection robustness, this paper proposes a Relative Degradation Aware Network (RDANet) for infrared small target detection. RDANet consists of two dedicated modules: Multi-Scale Anti-Alias Downsampling (MSAD) and Prototype-Guided Skip Memory (PGSM). MSAD introduces multi-scale anti-alias filtering together with pixel-fold aggregation to reduce aliasing effects during resolution reduction, so that target shape information can be better preserved while irrelevant background responses are suppressed. PGSM further enhances the skip features by retrieving patch-level prototypes from a shared memory and adaptively integrating them into the current representation, which helps maintain stable local contrast cues under diverse scene backgrounds. Experiments on three public benchmarks show that RDANet achieves the best performance on most evaluation metrics, while scale- and background-stratified evaluations indicate more stable behavior across target sizes and scene complexity. The code is available at this https URL.
55. 【2608.20868】Identify, Locate, Link: End-to-End Key-Value Extraction from Document Images
链接：https://arxiv.org/abs/2608.20868
作者：A. Said Gurbuz(1 and 2),Ahmed Nassar(1),Christoph Auer(1),Maksym Lysak(1),Lucas Morin(1),Matteo Omenetti(1),Tim Strohmeyer(1),Panagiotis Vagenas(1),Nikolaos Livathinos(1),Michele Dolfi(1),Peter Staar(1) ((1) IBM Research Zurich, (2) ETH Zurich)
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：optical character recognition, multi-stage error propagation, traditionally cascade optical, cascade optical character, structured information extraction
备注： Accepted at ICDAR 2026. 17 pages, 6 figures, 7 tables
点击查看摘要
Abstract:Document processing pipelines traditionally cascade optical character recognition (OCR) engines with downstream models for structured information extraction, leading to multi-stage error propagation. We fine-tune SmolDocling, a compact 256M-parameter vision-language model (VLM), to perform end-to-end key-value extraction directly from document images, jointly solving identification, localization, and association in a single pass without OCR preprocessing. We extend DocTags with specialized key, value, region, and link tags, enabling many-to-many relationships in a unified output sequence. To address data limitations, we design an augmentation pipeline combining synthetic form filling and graph-based crops that preserve complete key-value subgraphs. We further introduce a layout-aware evaluation framework extending text matching with spatial bounding box verification. On FUNSD, XFUND, and a large-scale private dataset, our model outperforms larger zero-shot VLM baselines under layout-aware evaluation, while being 27 times smaller than Qwen2.5-VL (7B) and over 5 times faster at inference. The model weights will be released publicly after publication.
56. 【2608.20840】KoViDoRe: Korean Visual Document Retrieval
链接：https://arxiv.org/abs/2608.20840
作者：Yongbin Choi,Yongwoo Song,Mujeen Sung
类目：Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Korean visual document, Recent advances, Korean visual, Korean visual documents, visually rich documents
备注：
点击查看摘要
Abstract:Recent advances in multimodal retrieval have improved the ability to retrieve information from visually rich documents such as PDFs and reports. However, existing benchmarks remain largely centered on English and provide limited coverage of Korean visual documents with complex structures. Furthermore, most existing Korean resources primarily evaluate single-page retrieval, failing to capture realistic scenarios that require evidence aggregation across multiple pages. To address these gaps, we introduce KoViDoRe, a benchmark for Korean visual document retrieval. The dataset is constructed from publicly available Korean documents with diverse layouts, including tables, figures, and multi-column structures. We develop a multi-stage data curation pipeline consisting of structured document parsing, synthetic query generation using both summary-based and context-based strategies, and relevance mapping with human verification. Using KoViDoRe, we evaluate a wide range of multimodal retrieval models and observe that current models struggle to effectively handle Korean visual document retrieval, particularly in settings involving structured content and diverse query types. Motivated by this finding, we further curate a large-scale training dataset, Ko-VDR Train Public, to support the development of retrieval models tailored to Korean visual documents. Together, KoViDoRe and Ko-VDR Train Public provide a unified benchmark and training resource for Korean visual document retrieval.
57. 【2608.20818】Scaling Muon for Diffusion Transformers
链接：https://arxiv.org/abs/2608.20818
作者：Chenghao Li,Xiao Han,Xinxin Huang,Wei Liu,Boyang Li,Bing Xiao,Heran Zhang,Juanma Perez Rua,Ke Xu,Kangning Liu,Linjun Kuang,Na Li,Tan Wang,Tian Xie,Wei Peng,Yang Pei,Yifan Xu,Yuanhao Zhai,Yuwei Lin,Zhe Wang,Zihao He,Daniel Li,Junbiao Tang,Ziyang Jiang,Dake Chen
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：large Diffusion Transformers, Diffusion Transformers, Periodic Row-wise Muon, Muon, Muon scaling behavior
备注：
点击查看摘要
Abstract:The matrix-aware optimizer Muon improves large model training by balancing updates across singular directions, yet its scaling behavior and end-to-end efficiency on large Diffusion Transformers (DiTs) remain unclear. We first establish Muon's scaling behavior on DiTs from 1.3B to 15B parameters, showing that its optimization and generative quality advantages over AdamW persist across model scales. However, at scale, the 5-step Newton--Schulz iteration (NS5) performed at every optimization step, together with full-momentum materialization, introduces substantial computation and communication overhead that can offset Muon's step-efficiency advantage. We introduce \emph{Periodic Row-wise Muon}, which performs a full NS5 spectral update once every \(K\) steps and applies a low compute and communication cost row-wise constrained update based on the current momentum at the remaining steps. We further co-design a distributed implementation that operates directly on sharded momentum during non-refresh steps and accelerates spectral refreshes through bucketed all-gather and communication--computation overlap. Across all scales, Muon improves the best observed generative quality over AdamW by 12.9--19.1\%. Compared with vanilla Muon, Periodic Row-wise Muon remains within 0.5\% in best generative quality on the 1.3B--4B models and improves it by 4.5\% at 9B. It reduces optimizer time by 46.9--54.3\%, end-to-end step time by 15.7--24.3\%, and logical communication volume by 66.7\%, while reaching its respective best generative quality with 33.7--64.8\% less active training time. These results show that Periodic Row-wise Muon preserves Muon's generative quality advantage while translating it into end-to-end training efficiency for large DiTs.
58. 【2608.20814】Enhancing Localized Reasoning for Long Video Understanding via Efficient Segment-to-Video Supervision
链接：https://arxiv.org/abs/2608.20814
作者：Beibei Zhang,Chao Xu,Jun Lan,Zongyi Li,Lai Wei,Huijia Zhu,Tongwei Ren
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, shown impressive potential
备注：
点击查看摘要
Abstract:Though Multimodal Large Language Models (MLLMs) have shown impressive potential in video understanding, long video understanding (LVU) remains challenging since distracting noise in complex and lengthy contexts can obscure localized details, misleading MLLMs to produce incorrect answers. Recent works mitigate these issues by incentivizing deep reasoning to include relevant evidence. However, these methods have two main problems: First, the reinforcement fine-tuning framework (RFT) they leveraged incurs substantial training overheads, including high annotation costs and complicated reward designs. Second, the self-reflective and iterative-perception mechanism in some methods causes lengthy outputs and high inference latency. To alleviate these problems, we propose a novel Segment-to-Video Supervision} method (S2V) to efficiently enhance fine-grained reasoning in LVU. Specifically, we generate question answer pairs (VQA) based on localized segments, and then transfer these segment-based VQA back to the whole video for training. Due to focusing on short segments, segment-based VQA can naturally notice details which tend to be overlooked from a whole-video perspective. Training on such data can enforce MLLMs to correctly associate fine-grained details with QA while avoiding distracting noise in the whole video. The S2V training involves just reinforcement learning (RL) with a simple accuracy reward based on only 10K VQA samples and the resulting S2V model predicts answer using a single forward pass with limited output tokens. Experimental results demonstrate that S2V can consistently improve LVU performance across multiple LVU benchmarks, outperforming both general MLLMs and reasoning-based methods not only in LVU accuracy but also in training and inference efficiency.
59. 【2608.20810】When Generated Images Look Right and Retrieve Wrong: Coverage-Guided Cross-Scale Re-Indexing for Knowledge-Faithful Generative Perception
链接：https://arxiv.org/abs/2608.20810
作者：Guangyuan Dong,Chuang Liu,Yangchen Zeng,Haoyu Wang,Xiaoyang Yu,Pinlong Zhao,Yuchao Hou,Ziwei Li,Zheng Lin
类目：Multimedia (cs.MM); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：information systems increasingly, systems increasingly route, Multimodal information systems, increasingly route generated, route generated visual
备注： 20 pages, 7 figures, and 20 tables
点击查看摘要
Abstract:Multimodal information systems increasingly route generated visual content back through the same vision-language index that informed its production, so the output must remain retrievable by the queries it was meant to serve. When the scene contains entities at vastly different scales, existing language-guided generators condition on a single, globally pooled text embedding and quietly drop scale-specific concepts, breaking concept-query retrieval even when pixel fidelity is high. We formalise this failure as semantic collapse and propose CERES, a closed-loop multimodal indexing framework that builds a three-level semantic pyramid, mines implicit concepts via a co-occurrence-aware router, performs scale-routed cross-attention into a lightweight U-Net generator, and verifies coverage by re-indexing the generated image with the same frozen VLM. A continuously differentiable soft-Jaccard coverage objective returns dense gradients to the 0.39M-parameter generator under explicit non-degeneracy conditions, and coverage is verified by an independent DINOv2 linear probe trained only on external scene and object labels. On four pansharpening benchmarks across seven settings, CERES delivers the new state of the art with the largest gains where scale variation is most extreme. It also improves concept-query retrieval Recall@5 by +14.0 points and image-text mean reciprocal rank by 0.19 over the strongest baseline, showing that the closed loop preserves queryable content rather than self-referential feature consistency.
60. 【2608.20809】RACE: Training-time Report-guided and Clinically Ordered Concept Editing
链接：https://arxiv.org/abs/2608.20809
作者：Wentao Yue,Tianyou Lai,Jiayu Luo,Qingyu Mao,Ziying Wang,Zhenyuan Ning,Qilei Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Breast ultrasound diagnosis, clinically meaningful semantic, Breast ultrasound, ultrasound diagnosis relies, meaningful semantic concepts
备注： Accepted at the 34th ACM International Conference on Multimedia (ACM MM 2026). 9 pages, 3 figures
点击查看摘要
Abstract:Breast ultrasound diagnosis relies on clinically meaningful semantic concepts, yet most deep learning methods adopt end-to-end image-to-label paradigms that lack interpretability and robustness. While concept-based approaches offer a promising alternative, they often assume complete annotations or require multimodal inputs at inference, which significantly limits their real-world applicability. To tackle these issues, we propose Training-time Report-guided and Clinically Ordered Concept Editing (TRACE), a training-time report-guided framework that leverages structured radiology reports as privileged concept supervision while enabling image-only diagnosis at test time. TRACE refines image-derived concepts through a teacher-guided editing mechanism within a malignancy-aware ordered concept space. To address incomplete annotations, we introduce Strategic Concept Missing Training (SCMT) and train an image-only self-editor via edit distillation for autonomous concept refinement. Besides, we introduce BUSC, a concept-enriched benchmark linking images, labels, and structured attributes. Experiments across multiple datasets demonstrate that TRACE achieves superior performance and improved cross-domain robustness compared to existing methods.
61. 【2608.20805】Routing Before Looking: Query-Adaptive Evidence Acquisition for Long-form Video Understanding
链接：https://arxiv.org/abs/2608.20805
作者：Tianyue Wang,Xuying Wu,Yuxiang Ma,Ruiming Liang,Jiaxuan Kang,Yanchao Hao,Zheng Wei,Leigang Qu,Haiyun Guo,Jinqiao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video agents due, Long-form video understanding, evidence acquisition strategies, video understanding remains, Long-form video
备注： Accept to EMNLP 2026
点击查看摘要
Abstract:Long-form video understanding remains challenging for video agents due to the mismatch between query demands and evidence acquisition strategies. Although recent planning-before-perception methods outperform query-agnostic pipelines, they often rely on a single dominant strategy, either generation-based strategy or retrieval-based strategy, limiting their ability to handle diverse query demands. We propose Route2Look, a lightweight and model-agnostic framework for query-adaptive evidence acquisition in long-form video understanding. Route2Look operates in a Route-Look-Memorize loop with three tools: Global Browse for holistic context, Temporal Ground for explicit temporal cues, and Semantic Retrieve for semantic search. The core component is a routing policy that dynamically selects evidence acquisition tools based on the query. To build this policy, Route2Look adopts a two-stage design: first distilling the routing skill from differential contrastive analysis between generation-based and retrieval-based trajectories, and then applying the distilled skill with hard routing rules and continue-or-stop criteria during inference. Experiments on challenging long-video benchmarks show that Route2Look achieves state-of-the-art performance while maintaining strong frame efficiency across datasets and query types. Oracle routing analysis further reveals the potential of query-adaptive evidence acquisition for future long-form video understanding.
62. 【2608.20803】CubicSplat: Differentiable Vector Graphics via Error-Bounded Forward Relaxation
链接：https://arxiv.org/abs/2608.20803
作者：Chenglong Liu,Xin Zhang,Yimeng Zhu,Liyang He,Yixiao Ma,Yu Su,Zhenya Huang,Qi Liu
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：making differentiable optimization, compact storage, resolution independence, direct editability, attractive goal
备注： 27 pages, 8 figures, 7 tables. ECCV 2026 Oral
点击查看摘要
Abstract:Vector graphics are prized for their resolution independence, compact storage, and direct editability, making differentiable optimization of their parametric primitives an attractive goal. Yet classical rasterization is discontinuous with respect to geometry, and existing remedies that smooth the forward pass demand increasingly elaborate heuristics as scene complexity grows. We trace this fragility to a gradient seesaw: design choices that improve forward geometric exactness can systematically degrade the induced gradient signal, and vice versa. To navigate this tension we introduce CubicSplat, a differentiable vector rasterizer that replaces Bézier closest-point solvers with uniform polyline surrogates whose geometric error is bounded at $O(S^{-2})$. The resulting static computation graph yields well-conditioned gradients by construction, while a compositing-derived visibility mechanism prunes degenerate primitives without auxiliary regularization. On DIV2K and Kodak benchmarks CubicSplat achieves state-of-the-art reconstruction quality with over 2 dB PSNR gain in the closed-fill setting, while training up to 4x faster than prior methods. The code is available at this https URL
63. 【2608.20791】CertVLA: Certified Defense against Physical Visual Attacks for Vision-Language-Action Models
链接：https://arxiv.org/abs/2608.20791
作者：Hui Lu,Zhijie Peng,Yuqi Lin,Zaijia Yang,Jiaming He,Shuhan Ye,Yi Yu,Hanwei Zhu,Bingquan Shen,Alex Kot,Xudong Jiang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：directly certify continuous, target discrete labels, defenses target discrete, temporally correlated actions, localized physical perturbations
备注：
点击查看摘要
Abstract:Vision-Language-Action (VLA) policies are vulnerable to localized physical perturbations, yet existing certified patch defenses target discrete labels and cannot directly certify continuous, temporally correlated actions. We introduce CertVLA, a certified defense for closed-loop VLA control under bounded patch and texture attacks. CertVLA proposes a calibrated region of behaviorally consistent actions, while deterministic covering masks ensure that at least one checked prediction is attack-free. Specifically, CertVLA normalizes action disagreement by the benign variation of each mask pair and accepts a single-mask anchor only when it remains consistent under every second mask. It then calibrates the resulting max-min-max episode score to provide finite-sample clean coverage. Conjoining query-level decisions extends the action certificate to the complete closed-loop rollout. Furthermore, we prove that against any adaptive attacker satisfying the bounded-support threat model, every rollout certified by CertVLA executes only action chunks consistent with attack-erased clean predictions. Under dual-mask rollout correctness, this consistency certificate further guarantees task success. The certificate is independent of patch content, generation method, and physical transformation. Experiments in simulation and the real world demonstrate the empirical and certified effectiveness of CertVLA against patch attacks, with additional simulation validation on texture attacks.
64. 【2608.20788】M2Depth: Unifying Monocular Depth Foundation Priors with Multi-View Stereo
链接：https://arxiv.org/abs/2608.20788
作者：Byeonggwon Lee,Sanggi Lee,Siwoo Lee,Khang Truong Giang,Soohwan Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited view overlap, Deep learning-based Multi-View, learning-based Multi-View Stereo, Deep learning-based, Depth Foundation Models
备注：
点击查看摘要
Abstract:Deep learning-based Multi-View Stereo (MVS) has advanced significantly but often generalizes poorly to unseen scenes, particularly in occluded areas or regions with limited view overlap. To mitigate this, recent approaches integrate Depth Foundation Models (DFMs) into MVS pipelines to provide monocular depth priors. However, existing methods typically rely on a static, one-way fusion scheme, which fails to fully exploit the complementary strengths of both modalities. We propose a novel framework that overcomes this limitation by tightly coupling a DFM with a cascade MVS pipeline through a bidirectional mutual refinement strategy. Our method leverages MVS depth to resolve the scale ambiguity in monocular predictions, while the monocular depth, in turn, enhances the structural completeness and fine-grained detail of the MVS estimate. Furthermore, we introduce a prior-guided cost volume refinement mechanism that effectively integrates multi-view and monocular information via attention-based fusion and discretized depth bins, thereby promoting local geometric consistency. Extensive experiments demonstrate that our method outperforms state-of-the-art MVS approaches on standard benchmarks, producing more complete and generalizable depth maps with sharp boundaries. Furthermore, although not explicitly designed for sparse-view settings, our framework generalizes remarkably well, competing favorably with even dedicated sparse-view methods while maintaining a superior accuracy-efficiency trade-off.
65. 【2608.20770】MotionPhys: Detecting AI-Generated Videos via Physical Consistency of Optical-Flow Trajectories
链接：https://arxiv.org/abs/2608.20770
作者：Haojin He,Hao Tan,Zichang Tan,Ajian Liu,Jun Wan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high visual fidelity, smooth temporal transitions, seemingly smooth temporal, fidelity and seemingly, seemingly smooth
备注：
点击查看摘要
Abstract:Modern AI video generation models can produce videos with high visual fidelity and seemingly smooth temporal transitions. However, visual realism does not necessarily imply physical motion consistency. Existing generative models mainly optimize distribution matching in pixel or latent spaces, without explicitly enforcing real-world constraints such as inertia, continuous forces, and trajectory geometry. Our experiments show that AI-generated videos remain visually plausible over short sequences of consecutive frames, yet fail to preserve physical motion consistency throughout a complete object action, resulting in systematic statistical discrepancies in their motion trajectories. Based on this observation, we introduce MotionPhys, a lightweight and interpretable framework that treats sparse motion trajectories as physical evidence rather than relying on appearance artifacts or generator-specific traces. By modeling the geometric evolution of trajectories across multiple temporal scales, MotionPhys reveals subtle motion inconsistencies that are difficult to capture with conventional visual cues and transforms them into a compact representation for efficient detection. Experiments on multiple datasets show that MotionPhys can effectively detect physical inconsistencies in generated videos and generalizes well across different video generators.
66. 【2608.20763】CARD: Diagnosing Belief to Action Routing Failures in Vision Language Models
链接：https://arxiv.org/abs/2608.20763
作者：Souptik Kumar Majumdar,Fabian Kögel,Andreas Bulling
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：internally represent mental, represent mental states, Linear probes, internally represent, steering have uncovered
备注：
点击查看摘要
Abstract:Linear probes and activation steering have uncovered that vision-language models (VLMs) internally represent mental states such as agents' beliefs, knowledge, and intentions. However, it is unclear whether and how these representations are used by downstream predictions along these axes. To close this gap, we introduce Cross-Axis Routing Diagnostic (CARD), which steers activations along one axis while measuring the response of a different axis's prediction. Applied to open-weight VLMs on Relay Chain -- a new cooperative grid-world benchmark we propose -- we diagnose a critical routing failure: models fail to incorporate belief representations into their next action prediction, effectively leaving valuable information about their partners unused.
67. 【2608.20759】DiGS-Avatar: Single-Image Animatable 3D Human Reconstruction via UV-Space Diffusion
链接：https://arxiv.org/abs/2608.20759
作者：Jiakun Li,Li Fang,Hao Zhu,Fei Hu,Long Ye,Yuan Zhang,Jinyao Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：geometric inconsistencies, suffers from over-smoothed, over-smoothed textures, textures and geometric, human reconstruction
备注： ECCV 2026
点击查看摘要
Abstract:Single-image 3D human reconstruction often suffers from over-smoothed textures and geometric inconsistencies. While diffusion models improve generative quality, their reliance on multi-view synthesis prior to 3D reconstruction is computationally expensive and prone to view inconsistency. We propose DiGS-Avatar, which reformulates this task as an efficient, diffusion-based UV-latent completion task, ensuring 3D consistency by design. To capture accurate spatial structure, we introduce a teacher-student framework where a multi-view teacher provides geometrically aligned pseudo-ground-truth latents to supervise a single-view diffusion student. Treating this inferred latent as a robust structural skeleton, our method injects high-level semantic features to accurately recover fine textural details without disrupting spatial integrity. The refined representation is then decoded into 3D Gaussian primitives. Extensive experiments demonstrate that DiGS-Avatar achieves state-of-the-art or highly competitive visual fidelity and zero-shot generalization, while reconstructing a fully animatable 3D avatar in just 0.71 seconds. Code is available at this https URL.
68. 【2608.20756】Vis-Poison: Poisoning Visual Knowledge in Multimodal Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2608.20756
作者：Rujin Liang,Zhongpu Chen,Yuhao Lei,Xin Miao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：systems increasingly rely, large language model, external knowledge sources, systems increasingly, severely compromise multimodal
备注： Findings of EMNLP, 2026
点击查看摘要
Abstract:While multimodal retrieval-augmented generation (RAG) systems increasingly rely on images as external knowledge sources, the introduction of poisoned visual evidence can severely compromise multimodal large language model (MLLM) generation. Unlike prior attacks that rely on altering textual metadata, we introduce Vis-Poison, a novel visual knowledge poisoning attack where the poisoned image itself is the attacker-controlled payload, without manipulating captions, summaries, metadata, or other associated text. Specifically, this attack is instantiated through an automated multi-agent method that constructs visually plausible poisoned images. To assess its impact, we evaluate Vis-Poison across two representative multimodal RAG pipelines, four embedding models, and six generation models. Empirically, Vis-Poison achieves an end-to-end attack success rate of 40.16\% to 65.40\% against 30k-entry multimodal knowledge bases in \emph{black-box} settings. Moreover, Vis-Poison remains effective against various MLLMs that can answer correctly from parametric knowledge alone, with an average success rate above 60\%. Code and data are available at this https URL.
69. 【2608.20754】SPARK-SAM: Self-Prompt Adaptation with Response Knowledge for SAM in Infrared Small Target Segmentation
链接：https://arxiv.org/abs/2608.20754
作者：Aji Mao,Zhenming Peng,Bailin Mu,Tian Pu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Promptable segmentation models, segmentation models provide, infrared small-target segmentation, Promptable segmentation, automatic infrared small-target
备注： 9 pages, 5 figures, 4 tables
点击查看摘要
Abstract:Promptable segmentation models provide a reusable interface, but direct transfer to automatic infrared small-target segmentation (IRSTD) exposes a mismatch between spatial prompts and target-domain mask responses. In a diagnostic using target-covering loose-box prompts deterministically derived from test reference masks, the best official SAM2.1 results are only 4.69%, 1.64%, and 2.28% IoU on NUAA-SIRST, NUDT-SIRST, and IRSTD-1K. We introduce SPARK-SAM (Self-Prompt Adaptation with Response Knowledge for SAM), which learns target-domain response knowledge and conditions the decoder through an image-conditioned joint self-prompt state. Training combines benchmark-mask supervision with reliability-aware response guidance. SPARK-SAM achieves 75.78%, 86.49%, and 68.34% IoU with 0.726M additional parameters, ranking first on two benchmarks among 14 retrained SAM variants and adaptations evaluated as automatic image-to-mask methods. The staged IRSTD-1K diagnostic shows that response adaptation reaches most of the final IoU before the predicted points acquire reliable target grounding. Prompt supervision aligns the predicted prompt candidates with target locations, and frozen-weight interventions measure output sensitivity to the joint self-prompt state. Matched ablations show consistent accuracy gains from response guidance and high-resolution prompt refinement across all three datasets. Code is available at this https URL.
70. 【2608.20749】Identity-Preserving Text-to-Video Generation via Agentic Enhancement and Semantic Repair
链接：https://arxiv.org/abs/2608.20749
作者：Jiayi Gao,Changcheng Hua,Jiaqi Tang,Yuxin Peng,Yang Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Identity-preserving video generation, follow natural-language instructions, video generation, video, Identity-preserving video
备注：
点击查看摘要
Abstract:Identity-preserving video generation aims to synthesize videos that follow natural-language instructions while maintaining the visual identity of a given subject. Recent commercial video generation models have achieved strong visual quality and motion realism, but they still suffer from identity drift, incomplete instruction following, and missing visual details under complex prompts. Since these models are usually closed-source black boxes, directly improving them through parameter optimization is often infeasible. We therefore propose Agentic Enhancement and Semantic Repair (AESR), a lightweight enhancement framework for identity-preserving video generation. To improve prompt construction before generation and mitigate the above failures, AESR introduces a global agentic prompt enhancement module. This module learns model-specific prompting formats from official documentation, acquires human-centered video generation priors from human-interaction data, and accumulates test-domain identity-preserving generation experience into a reusable playbook through an agentic loop. To further repair errors in videos generated with enhanced prompts, AESR introduces a sample-level visual semantic repair module, which uses a VLM to locate erroneous video segments and design repair instructions, edits selected frames into explicit visual references, and guides a video editing model to fix local semantic or identity-related errors. We also adopt a lightweight Mixture-of-Experts selection strategy to choose reliable outputs from different generation and refinement paths. Under the official evaluation protocol of the ACM MM 2026 Identity-Preserving Video Generation Challenge, our system MIPL\_Video ranked first in Track 1, demonstrating the effectiveness of AESR for practical identity-preserving video generation. The code is available at this https URL.
71. 【2608.20748】Generating Multi-view Adversarial Examples for Visual Geometry Grounded Transformer
链接：https://arxiv.org/abs/2608.20748
作者：Qi Song,Ziyuan Luo,Haoliang Han,Renjie Wan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Geometry Grounded Transformer, Visual Geometry Grounded, Grounded Transformer, Visual Geometry, Geometry Grounded
备注： ECCV 2026
点击查看摘要
Abstract:The Visual Geometry Grounded Transformer (VGGT) enables unified feed-forward 3D reconstruction from multi-view images. However, deploying such a high-performance model may expose critical security vulnerabilities. Traditional adversarial perturbations require costly per-scene optimization, while Universal Adversarial Perturbations (UAPs) rely on a single static pattern and fail to effectively attack VGGT. To address these limitations, we propose \textbf{MVAP-G}, a multi-view adversarial perturbation generator that produces imperceptible consistent perturbations across multiple views in a single feed-forward pass. To ensure perturbation consistency across diverse scenes, we design a cross-view adversarial alignment mechanism to process multi-view images. Experiments demonstrate that MVAP-G significantly degrades VGGT performance without iterative optimization during inference. This work pioneers multi-view adversarial attacks on 3D foundation models, uncovering severe vulnerabilities and underscoring the urgent need for robust 3D vision systems. The code is available at this https URL.
72. 【2608.20740】VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds
链接：https://arxiv.org/abs/2608.20740
作者：Shania Guo,Yeongsik Seo,Andrew Fu,Mei Hao,Iris Xia,Jiwon Jenny Lee,Xinyi Mary Xie,Hyoungseob Park,Aaron Dollar,Alex Wong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：thin objects, tend to underperform, RGB images, thin, objects
备注：
点击查看摘要
Abstract:State-of-the-art 3D reconstruction models, whether from visual, range, or both, tend to underperform on thin objects. This is partially due to the small amount of space such objects occupy in RGB images and in 3D point clouds. To test the extent of their errors, we collected the first thin object dataset comprising of synchronized RGB images, depth maps, and tactile response maps, where each frame is associated with inertial measurements, camera pose and calibration, and groundtruth depth and segmentation maps obtained from laser scanning of thin objects. We hypothesize that tactile data can aid in the reconstruction of thin objects as their response maps provide local shape and deformation information. Our dataset, termed VisTa3D, comprises of 387 scenes covering 70 thin objects over 17 environments. We benchmarked current 3D reconstruction models on VisTa3D and found that, indeed, they exhibit low fidelity on thin objects. To test if tactile data can help, we introduce the first visual-range-tactile 3D reconstruction model as a baseline. Code and data: this https URL.
73. 【2608.20725】Enabling Memory-efficient Im2win Convolution with Multi-precision Support on GPU CUDA and Tensor Cores
链接：https://arxiv.org/abs/2608.20725
作者：Xiang Fu,Jixiang Ma,Xinpeng Zhang,Peng Zhao,Shuai Lu,Xu Tony Liu
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV)
关键词：deep neural networks, principal computational bottleneck, neural networks, GPU hardware, GPU convolution methods
备注： Accepted at the 2026 International Joint Conference on Neural Networks (IJCNN 2026). To appear in IEEE Xplore
点击查看摘要
Abstract:Convolution is a principal computational bottleneck in deep neural networks, and its efficiency depends on tight integration between algorithms and GPU hardware. Existing GPU convolution methods suffer from large memory overhead, poor cache utilization, limited effectiveness across kernel sizes, or numerical instability. This work extends the im2win paradigm -- a universal, memory-efficient convolution method with contiguous memory access for all kernel sizes -- to run efficiently in full precision on CUDA cores and half precision on tensor cores. By introducing new kernel designs and optimizations such as zig-zag memory access and asynchronous data movement, im2win efficiently exploits hardware-accelerated half-precision matrix multiply-accumulate operations. Across twelve CNN benchmarks, im2win achieves up to 2.8x higher TFLOPS than its CUDA core implementation, 1.4x higher than cuDNN, and 6.4x higher than GEMM-based convolution with cuBLAS, while using as little as 53% and 35% of their memory, respectively. These results establish im2win as a unified, high-performance convolution framework for modern GPU architectures.
74. 【2608.20720】AffordAny: Open-World 3D Affordance Grounding from Monocular RGB Images via Vision-Language-Guided Geometric Reasoning
链接：https://arxiv.org/abs/2608.20720
作者：Junqi Wu,Kaihua Tang,Xuanwen Chen,Hongzhi Li,Jianqiang Huang,Xian-Sheng Hua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：free-form language queries, grounding requires localizing, requires localizing functional, affordance grounding requires, localizing functional object
备注： The code and dataset are publicly available. Code: [this https URL](https://github.com/lzlfwow/AffordAny) . Dataset: [this https URL](https://modelscope.cn/datasets/lzlfwow/AffordAny)
点击查看摘要
Abstract:Open-world 3D affordance grounding requires localizing functional object parts in 3D given free-form language queries. Existing methods typically assume pre-built object-centric 3D geometry and closed affordance ontologies, limiting deployment from raw RGB observations. We present AffordAny, an end-to-end framework that uses one monocular RGB image to construct large-scale text-conditioned 3D part supervision, ground affordances with a frozen vision-language model (VLM) guided decoder, and improve open-world generalization through pseudo-label self-training. Our automated pipeline produces a benchmark of 5,334 objects and 10,633 part-level samples spanning 473 categories, an order-of-magnitude increase in categorical diversity over prior work. The decoder progressively fuses frozen Cosmos-2B features with 3D geometry through spatial projection, instruction-conditioned semantic compression, and bidirectional geometry-semantics interaction. Minimal-perturbation pseudo-label self-training further adds new objects without human annotation. Under a systematic generalization protocol evaluating unseen objects, unseen categories, and unseen instruction paraphrases, our approach achieves 0.428 IoU on unseen objects and 0.315 IoU on unseen categories after self-training, with unseen-category mIoU improving by 6.3% relative (p0.01) and an instruction sensitivity gap of only 0.105, demonstrating effectiveness and robustness of our method.
75. 【2608.20713】AGIDefect-4K: A Richly Annotated Dataset for AI-Generated Image Defect Detection, Localization and Explanation
链接：https://arxiv.org/abs/2608.20713
作者：Xiangfei Sheng,Weidong Zou,Tianjiao Gu,Zhichao Yang,Pengfei Chen,Leida Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce highly realistic, highly realistic images, undermine their reliability, produce highly, highly realistic
备注： 8 pages, 6 figures. Accepted by ACM Multimedia 2026
点击查看摘要
Abstract:Generative AI can now produce highly realistic images, yet current models still exhibit subtle but critical defects that undermine their reliability. While existing AI-generated image (AGI) evaluation benchmarks have made notable progress, comprehensive AGI defect diagnosis remains underexplored. To bridge this gap, we introduce AGIDefect-4K, a richly annotated dataset of 4,000 images from 15 state-of-the-art generative models spanning both open-source and closed-source systems. AGIDefect-4K features hierarchical defect annotations: (1) detection labels identifying whether defects exist, (2) pixel-level segmentation masks localizing defective regions, and (3) detailed textual explanations characterizing defect types and their perceptual impact. Each image is further annotated with an overall quality score. Building on this, we present AGIDA (AGI Defect Assistant), a baseline framework leveraging Multimodal Large Language Models (MLLMs) for joint defect detection, localization, explanation, and quality prediction. Comprehensive benchmarking on AGIDefect-4K reveals that AGI defect understanding remains challenging, underscoring the value of this dataset. The dataset is publicly available at this https URL.
76. 【2608.20712】Privacy-Preserving Object Detection for Vision Transformer-Based Models
链接：https://arxiv.org/abs/2608.20712
作者：Homare Sueyoshi,Kiyoshi Nishikawa,Hitoshi Kiya
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：protect sensitive visual, sensitive visual information, object detection method, protect sensitive, visual information
备注： 4 pages, 4 figures, accepted for GCCE2026
点击查看摘要
Abstract:We propose a novel object detection method that enables us to protect sensitive visual information of test images. Previous studies considering visual information protection focus on image classification tasks. This paper proposes an object detection method using perceptual encryption for the first time. The proposed method can achieve almost the same accuracy as that of models without any protection by utilizing the embedding structure of the Vision Transformer (ViT) and a domain adaptation technique with keys. In experiments, the effectiveness of the proposed method is verified in terms of accuracy and visual protection under the use of ViTdet, which is a ViT-based object detection model.
77. 【2608.20699】ArtiMo: Agent-Driven Articulated Mesh Animation
链接：https://arxiv.org/abs/2608.20699
作者：Chunyu Zou,Peng Dai,Yi-Hua Huang,Ze Yuan,Jingwei Huang,Yeming Yao,Xiaojuan Qi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieving instruction fidelity, text requires satisfying, requires satisfying strict, satisfying strict kinematic, Animating articulated
备注：
点击查看摘要
Abstract:Animating articulated 3D meshes via text requires satisfying strict kinematic constraints, modeling causal interactions between parts, and achieving instruction fidelity. Due to the absence of task-specific training data and explicit articulation supervision, existing data-driven mesh animation methods are largely inapplicable to this setting. To address this, we propose ArtiMo, a novel agent-driven framework for text-guided articulated mesh animation. Operating in a zero-shot manner, ArtiMo develops an agentic pipeline powered by Large Language and Vision-Language Models (LLMs/VLMs) to orchestrate motion generation. By synergizing the explicit kinematic constraints of URDF with the agent's reasoning and planning capabilities, it effectively produces causally coherent part motions and interactions without requiring model fine-tuning. To ensure motion correctness, the agent additionally utilizes a visual self-improvement mechanism: generated animations are rendered into compact keyframes and motion cues, enabling the VLM to iteratively diagnose and correct errors. Furthermore, we contribute a new benchmark dataset spanning 21 articulated object categories, featuring high-quality motion annotations enriched with causal relationships. Extensive experiments demonstrate that ArtiMo significantly outperforms baselines, particularly on complex, causally driven motions. The project page is available at this https URL.
78. 【2608.20691】Bridging Language and Spherical Space: Object-Centric Control for Text-to-Panorama Generation
链接：https://arxiv.org/abs/2608.20691
作者：Derui Li,Qian Qiao,Yuhao Sun,Wenhao Guo,Peng Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：augmented reality, virtual reality, content creation, increasingly important, important for immersive
备注：
点击查看摘要
Abstract:Panoramic image generation is increasingly important for immersive applications such as virtual reality, augmented reality, and 3D content creation. Unlike perspective images, panoramic images represent a viewer-centered $360^\circ$ surrounding space, where directional expressions such as left, right, front, and behind play a central role in spatial understanding. However, existing text-to-panorama methods largely rely on implicit spatial reasoning and often fail to faithfully ground object-level directional descriptions in spherical panoramic scenes. A straightforward alternative is to introduce explicit layouts, but requiring manually specified spatial conditions reduces the flexibility of language-based interaction and does not directly resolve the misalignment between egocentric directional language and panoramic image space. To address this issue, we propose PanoCtrl, an object-centric framework for controllable text-to-panorama generation. Our method explicitly bridges natural language and spherical panoramic space by converting textual descriptions into structured object-level spherical conditions and integrating them into the diffusion process. Specifically, we introduce PanoParse, a text-conditioned parser that predicts object semantics and spherical bounding field-of-view (BFoV) parameters, and \textbf{PanoControl}, which injects object-level semantic and spatial guidance into the diffusion transformer through object-aware attention and spatial residual enhancement. To support this task, we construct PanoGround, a dataset with object-level spherical annotations and diverse directional descriptions for controllable panoramic generation. Extensive experiments demonstrate that PanoCtrl achieves state-of-the-art performance in both spatial alignment and image quality.
79. 【2608.20690】Identity-Aware Human-Object Interaction Motion Captioning
链接：https://arxiv.org/abs/2608.20690
作者：Yiming Wang,Yonghao Dang,Huilai Li,Jiawei Tu,Jianqin Yin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Existing human-object interaction, HOI motion captions, captioning methods typically, HOI motion, identity-aware HOI motion
备注： 9 pages,3 figures
点击查看摘要
Abstract:Existing human-object interaction (HOI) motion captioning methods typically describe what happens while referring to the subject using generic terms such as "a person" or "someone", without grounding the caption in subject identity. To address this limitation, we introduce Identity-Aware Human-Object Interaction Motion Captioning task. This task requires each generated caption to specify both the subject identity and the corresponding HOI motion. For example, the model generates "Sub_ID lifts the chair" rather than "A person lifts the chair". For this task, we design identity-aware HOI motion captions based on the BEHAVE and InterCap datasets. We further propose ID-HOINet, which learns from multi-view videos while supporting single-view identity-aware HOI motion caption generation. ID-HOINet contains two core components: Multi-View Identity-Motion Learning Module (MVIML) and Two-Stage Caption Rewriting Strategy (TSCR). MVIML learns from multi-view videos by modeling dependencies across temporal stages and camera viewpoints, capturing identity and interaction motion features. At inference, the TSCR first retrieves the subject identity and generates identity-agnostic HOI motion captions. TSCR then rewrites these captions with the predicted identity to produce the final identity-aware HOI motion captions. Experiments demonstrate that ID-HOINet achieves state-of-the-art performance. Code will be released upon acceptance.
80. 【2608.20687】opoSurfel: Closing the Loop between Gaussian Surfels and Meshes for Surface Reconstruction
链接：https://arxiv.org/abs/2608.20687
作者：Chuanjin Fan,Wenjie Chang,Bohao Liao,Yujia Chen,Wenfei Yang,Tianzhu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：achieved remarkable success, Splatting has achieved, Gaussian Splatting, achieved remarkable, remarkable success
备注：
点击查看摘要
Abstract:3D Gaussian Splatting has achieved remarkable success in novel view synthesis. However, extracting high-fidelity surfaces directly from 3DGS remains challenging due to its discrete and unstructured nature. Existing 3DGS-based reconstruction methods typically rely on multi-view geometric consistency or local constraints. Without an explicit structured geometric prior during optimization, these methods often struggle to resolve structural ambiguities, leading to artifacts and floaters, particularly in textureless or occluded regions. To address this limitation, we propose TopoSurfel, a novel framework that closes the loop between Gaussian surfels and continuous meshes. Unlike recent methods that incorporate mesh extraction into the differentiable pipeline by introducing auxiliary neural networks or extra per-Gaussian parameters, we dynamically extract a continuous proxy mesh via a non-trainable differentiable iso-surfacing process. Leveraging this differentiable connection, we introduce a mesh-guided surfel evolution strategy, including normal alignment and geometry-aware density control, to effectively suppress floaters and fill surface holes. Furthermore, to address the initialization challenges in large-scale environments, we propose a spatially aware hybrid re-initialization strategy that ensures robust reconstruction across complex scenes. Extensive experiments demonstrate that TopoSurfel achieves competitive geometric reconstruction accuracy while maintaining high-quality mesh-based novel view synthesis. The code for our method is available at this https URL.
81. 【2608.20682】Aristotelian Manifolds: Leveraging Platonic Perceptual Features for Backpropagation Free Rapid Concept Learning
链接：https://arxiv.org/abs/2608.20682
作者：Michael Karnes,Alper Yilmaz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Platonic Representation Hypothesis, systematically characterizes Aristotelian, characterizes Aristotelian Manifolds, generalized structural framework, structural framework built
备注：
点击查看摘要
Abstract:This paper formalizes and systematically characterizes Aristotelian Manifolds, a generalized structural framework built upon the Platonic Representation Hypothesis. We position high-capacity foundation models as universal perceptual filters and conduct a comprehensive layer-wise investigation to map how knowledge is functionally synthesized within these latent subspaces. Across diverse architectural paradigms and multi-domain datasets, we rigorously chart the interplay between network depth, dimensionality reduction, and distance metrics. Our characterization reveals that semantic maturation does not follow a singular, monotonic path; instead, different data domains exhibit highly distinct geometric response profiles, characterized by intermediate mound-like peaks for specialized clinical modalities and sigmoidal plateaus for natural visual tasks. By profiling the exact coordinates where these manifolds achieve peak representational efficiency, we establish a predictable taxonomy for layer selection and feature compression. Ultimately, this systematic characterization demonstrates that mapping the internal geometry of frozen representations provides a robust, backpropagation-free, and interpretable framework for understanding and exploiting foundation model latent spaces.
82. 【2608.20663】Shortcut Learning in a Public Grape Disease Dataset: Annotation Granularity as a Modulator, Not a Cause
链接：https://arxiv.org/abs/2608.20663
作者：Pushuo Wang(Shenyang Institute of Technology)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：agricultural disease detection, public grape disease, grape disease dataset, reported metrics, internally consistent
备注： 30 pages, 3 figures, 17 tables. Code and evaluation artifacts: [this https URL](https://github.com/nck9343-a11y/crop-detect)
点击查看摘要
Abstract:Public datasets for agricultural disease detection are usually judged fit for use from reported metrics, which say nothing about whether the annotation scheme is internally consistent. On one public grape disease dataset (3288 images, 11995 boxes, 6 classes), varying model capacity, input resolution and detection paradigm yields a test-set mAP50 range comparable to seed-to-seed noise, with the bottleneck at small objects across all five architectures. The finding lies on the data side: one class is annotated at whole-leaf level (median box area 43.16% of the image) while the other five are annotated at lesion level. On 5156 cross-species images containing no grape, 65.7% of the false-positive boxes fall into that one class, an over-representation of 13.41x relative to its share of the training annotations. Counterfactual retraining establishes a causal effect of granularity on the magnitude of the shortcut: shrinking only that class's boxes cuts its cross-species false positives by 66%, and a placebo control confirms the effect is specific to the manipulated class. A manipulation in the opposite direction, with criteria registered in advance, returns a negative result: coarsening the finest class to whole-leaf level (0.57% to 40.37%), matched in box count and share of annotations and with higher in-distribution AP, still leaves its cross-species false positives at zero boxes, while the unmanipulated original class holds 50.0% of them. Annotation granularity is therefore a modulator of this shortcut, not its cause: it can amplify or attenuate a sink that already exists, but cannot create one, and what fixes the destination remains open. We also give a granularity screening statistic requiring neither images nor training, and show airborne lesion-level detection to be optically out of reach. The failure mode is invisible to in-distribution evaluation.
83. 【2608.20659】Lift, Associate, and Fuse: A Decision-Centric Framework for 2D-to-3D Foundation Model Transfer
链接：https://arxiv.org/abs/2608.20659
作者：Wentao Sun,Yiping Chen,John S. Zelek,Jonathan Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：two-dimensional foundation models, predictions from two-dimensional, two-dimensional foundation, foundation models, models into three-dimensional
备注： A framework to realize 3D segmentation
点击查看摘要
Abstract:Methods that transfer predictions from two-dimensional foundation models into three-dimensional segmentation are commonly grouped by task or representation. Those groupings obscure the decisions that determine whether a system remains coherent across views: where image evidence is grounded, when observations become one identity, how semantic and granularity conflicts are handled, which information is fused, and what state survives for later queries. We introduce \textbf{Lift, Associate, and Fuse (LAF)}, a decision-centric framework that represents a transfer system as five operators: \textbf{Generate, Associate, Reconcile, Fuse, and Persist/Query}. LAF defines an explicit contract for the persistent carrier---its spatial support, semantic state, identity state, uncertainty, provenance, and supported operations---and identifies the first stage at which discarded evidence becomes unrecoverable. We operationalize the framework as a structured audit protocol and apply it to 161 systems available through 7 August 2026, spanning point-, field-, Gaussian-, object-, graph-, and memory-based carriers. Representation, temporal, relational, and feed-forward stress tests required no additional analytical stage after the final confirmation pass. The resulting decision traces expose four recurring properties: association does not establish identity; carrier design fixes both the query interface and correction boundary; rendered-view, native-3D, and proposal-level evaluations are not interchangeable; and qualifiers such as \emph{training-free}, \emph{real-time}, \emph{open-vocabulary}, and \emph{generalizable} are meaningful only when attached to a stage and a complete cost ledger. LAF therefore supplies a representation-neutral method for comparing existing systems, diagnosing irreversible failures, and specifying revisable 3D perception for future agents.
84. 【2608.20639】MV2GF: Multi-view Pedestrian Detection with a Visual Geometric Foundation Model
链接：https://arxiv.org/abs/2608.20639
作者：Taiga Yamane,Satoshi Suzuki,Ryo Masumura,Shota Orihashi,Tomohiro Tanaka,Mana Ihori,Naoki Makishima
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-View Pedestrian Detection, Multi-View Pedestrian, detect pedestrians, bird eye view, eye view map
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Multi-View Pedestrian Detection (MVPD) aims to detect pedestrians in the form of a bird's eye view map from multi-view images. Recent MVPD methods adopt a unified framework that projects 2D image features into a 3D world space and aggregates them into a single feature. Although they are effective, they struggle to generalize to unseen camera configurations during training due to two main issues. First, they are difficult to capture accurate visual geometry across views in unseen camera configurations. Second, they make detection models highly dependent on distortion patterns during training arising from their image feature projection. To address these, we leverage a visual geometric foundation model and propose MV2GF. This foundation model has exhibited strong generalization in capturing visual geometry across views and predicting accurate 3D attributes in diverse camera configurations. MV2GF fuses task-specific features with general-purpose geometric features extracted by the foundation model to effectively capture the visual geometry even in unseen camera configurations. Furthermore, MV2GF projects each pixel in the image features to an appropriate 3D location using 3D pointmaps predicted by the foundation model, preventing the detection model from depending on distortion patterns during training. Our experiments demonstrate the effectiveness of leveraging a visual geometric foundation model for MVPD and that MV2GF generalizes better than existing methods.
85. 【2608.20621】RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars
链接：https://arxiv.org/abs/2608.20621
作者：Adriano D'Alessandro,Ali Mahdavi-Amiri,Ghassan Hamarneh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-guided zero-shot object, object counters excel, Text-guided zero-shot, fine-grained classes, natural language
备注：
点击查看摘要
Abstract:Text-guided zero-shot object counters excel at spatial localization but categorize poorly on novel or fine-grained classes: natural language is too coarse to fully specify visual identity, so they fail to separate visually similar distractors. Few-shot counters sidestep this with visual exemplars, but require manual annotations on every image. To resolve this dilemma, we introduce RECOUNT, a plug-and-play framework for image-guided zero-shot counting. Rather than specify a category with a text prompt, our key insight is to specify it visually, from a single off-scene reference image. However, we find that a lone reference image provides narrow coverage of a category's appearance and is unreliable across diverse scenes. We therefore repurpose a diffusion model as an automated contrastive data engine that expands the reference into a diverse exemplar gallery, supplying the discriminative detail that text cannot. RECOUNT preserves the class-agnostic proposals of any frozen counter and offloads categorization to a separate visual module (a frozen backbone with a lightweight head trained on this synthetic data) that matches each proposal against the target and distractor galleries. Applied to a frozen counter, RECOUNT attains the best zero-shot accuracy on both benchmarks, cutting counting error (MAE) by 55% on LookAlikes and 21% on PairTally relative to the strongest prior zero-shot counter.
86. 【2608.20608】A Dataset-Centric Benchmark of Deep Learning Methods for Grape Leaf Disease Classification and Detection
链接：https://arxiv.org/abs/2608.20608
作者：Petar Canoski,Vlatko Spasev,Ivica Dimitrovski,Ivan Kitanovski,Petre Lameski
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabling early diagnosis, improved vineyard management, Grape leaf disease, timely intervention, Grape leaf
备注：
点击查看摘要
Abstract:Grape leaf disease recognition is important for precision agriculture, enabling early diagnosis, timely intervention, and improved vineyard management. Although deep learning has achieved strong results, many studies rely on few datasets, often acquired under controlled conditions, and may not reflect real vineyard challenges such as complex backgrounds, variable illumination, occlusion, leaf pose, disease severity, and device differences. This paper presents a dataset-centric benchmark of deep learning methods for grape leaf disease classification and detection. We analyze publicly available datasets in terms of disease categories, annotation types, acquisition conditions, image characteristics, class distributions, provenance, and task suitability. Representative models are evaluated in three settings: image-level classification, region-level classification, and object detection. Classification is assessed using accuracy, while detection is evaluated using mAP@50 and mAP@50:95. Cross-dataset experiments further examine transfer between datasets with compatible disease categories but different visual and annotation characteristics. Results show near-saturated classification performance on several controlled or derivative datasets, greater difficulty on heterogeneous datasets, and substantial variation in detection performance across annotation settings. Cross-dataset performance drops sharply, especially for object detection, indicating that shared disease labels do not necessarily define equivalent recognition tasks. The benchmark emphasizes dataset provenance, realistic field evaluation, annotation compatibility, and external validation for reliable vineyard disease recognition.
87. 【2608.20587】Aggregate, Don't Adapt: Subject-Level Posterior Aggregation and Transductive Calibration for Cross-Site Parkinsonian Gait Severity
链接：https://arxiv.org/abs/2608.20587
作者：Junlong Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：predicts MDS-UPDRS gait, MDS-UPDRS gait severity, SMPL motion recorded, canonicalized SMPL motion, clinical sites unseen
备注：
点击查看摘要
Abstract:We describe the winning entry to the MoCha 2026 Benchmark and Challenge on Parkinsonian Gait, which predicts MDS-UPDRS gait severity from canonicalized SMPL motion recorded at clinical sites unseen during training. The system reaches 0.6945 macro-F1 on the hidden test and ranked first of 58 entries, ahead of the runner-up at 0.5807 and the organizers' baseline at 0.4289, on a frozen public motion encoder with a single $4\times512$ linear layer. Nearly all of the margin comes from three stages usually treated as bookkeeping: reproducing the reference benchmark's exact head recipe, averaging per-walk posteriors within the subject grouping the organizers ship, and a label-free transductive calibration of the feature mean and the decision operating point. Fine-tuning the encoder lost in four distinct forms, and ten alternative encoders were worse. Every ablation number is a paid read on the hidden test, because our own leave-two-cohort-out cross-validation proved anti-correlated with the deciding score over eleven configurations. We give the negative record in full, and identify our largest gain, subject-level aggregation, as the binding ceiling on this benchmark.
88. 【2608.20558】Zero-Shot Color Image Manipulation Localization via Noise Residual Artifact Pattern Analysis
链接：https://arxiv.org/abs/2608.20558
作者：Edgar Gonzalez-Fernandez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Digital cameras embed, cameras embed device-specific, embed device-specific artifacts, Digital cameras, in-camera post-processing
备注：
点击查看摘要
Abstract:Digital cameras embed device-specific artifacts into every acquired image through demosaicing, in-camera post-processing, and lossy compression. These traces constitute a forensic signal that can be exploited to assess image authenticity. Existing passive methods rely predominantly on the green channel of the Bayer residual, discarding the correlated information available in the remaining color channels and typically requiring training data or device enrollment. This work proposes a zero-shot, training-free blind image manipulation localization pipeline that estimates a reference artifact pattern directly from the noise residual of a single suspect image, without assuming a fixed filter configuration, color layout, or block period. The pipeline incorporates a principled denoiser selection criterion based on the acquired-to-interpolated noise variance ratio, a block-level correlation analysis against the estimated reference pattern, and a two-component Gaussian Mixture Model scoring stage that produces a pixel-level tampering probability map. An ablation study evaluates the impact of denoiser choice and block size on localization accuracy, and comparisons against state-of-the-art passive methods demonstrate the competitiveness of the proposed zero-shot approach.
89. 【2608.20557】Learning Prostate Anatomy at Test Time for Cancer Detection in Micro-Ultrasound
链接：https://arxiv.org/abs/2608.20557
作者：Obed Korshie Dzikunu,Mohammad Mahdi Abootorabi,Mohamed Harmanani,Paul F. R. Wilson,Emma Willis,Ferdinand Luger,Adam Kinnaird,Brian Wodlinger,Parvin Mousavi,Purang Abolmaesumi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：deploying deep learning, deep learning models, acquisition protocols remains, target domain, imaging hardware
备注：
点击查看摘要
Abstract:Domain shift across clinical centers using different imaging hardware or acquisition protocols remains a fundamental barrier to deploying deep learning models for prostate cancer (PCa) detection. Existing test-time adaptation (TTA) methods address distribution shift through entropy minimization or augmentation-based self-supervision, correcting for statistical differences in image appearance but ignoring the anatomical structure of the target domain. We propose ANT, a segmentation-guided TTA framework that adapts a pretrained cancer detection encoder to the target domain by solving an auxiliary prostate segmentation task at test time, supervised by pseudo-masks from a frozen pretrained segmentation network. By aligning encoder representations to prostate anatomy in the target domain, ANT corrects domain-specific feature drift while preserving cancer-discriminative structure. The model was trained on 693 patients imaged with an earlier-generation micro-ultrasound scanner in a multi-center clinical trial, and evaluated on 118 patients acquired with a newer-generation system across two centers in another clinical trial. Under a leave-one-center-out protocol with identical evaluation conditions across all methods, ANT improves mean AUC by 2.9% and 3.6% at the biopsy-core and patient levels, respectively, over no adaptation, outperforming TTA baselines. Code is available at: this https URL.
90. 【2608.20548】Keep Your Friends Close, and the Right Neighbours Closer: Disaster-Conditioned Kernel-Regularized Graph Attention for Building Damage Classification
链接：https://arxiv.org/abs/2608.20548
作者：Fuad Hasan,Chul Min Yeum
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：buildings rarely fail, fail in isolation, rarely fail, spatial, Disaster damage
备注： Accepted in ECCV 2026
点击查看摘要
Abstract:Disaster damage is spatial: buildings rarely fail in isolation. Yet using spatial context for damage classification remains surprisingly underexplored, and many pipelines still rely primarily on per-building appearance cues even when the dominant uncertainty is spatially structured. Complicating matters, the right neighbourhood is not the same across events. Floods, hurricanes, and wildfires can exhibit very different clustering behaviour, making spatial reasoning valuable but easy to misuse - naive context aggregation can improve visual coherence while oversmoothing boundaries or propagating structured errors. We study this tension on xBD (the dataset used in the xView2 challenge) in a controlled post-localization, classification-only setup: each building is represented by a pre/post combined (PPC) patch cropped from the provided polygons, and spatial context is modelled with GPS-derived building graphs. Our approach keeps local evidence "close" by preserving strong spatial relationships in disaster damage patterns, while bringing only the right neighbours "closer" through a disaster-type-conditioned graph model that injects a learnable multi-scale spatial kernel prior into attention, allowing the effective neighbourhood scale to adapt across disaster types rather than being learned as a single global smoothing rule. To discourage coherence-by-smoothing, we add a residual de-correlation loss that penalizes positive Moran's~I in prediction residuals. We evaluate the method under event and dataset shift with a leave-one-event-out (LOEO) protocol on xBD and cross-dataset transfer from xBD to Ida-BD. The model improves macro-F1 and substantially reduces residual spatial autocorrelation under zero-shot event shift, indicating better use of spatial context rather than naive smoothing and enabling more reliable transfer to unseen events within known disaster types.
91. 【2608.20534】Grounded-Exo2Ego: Structured Semantic Grounding for Robust Exocentric-to-Egocentric Video Generation
链接：https://arxiv.org/abs/2608.20534
作者：Shengze Wang,Michael Stengel,Tianye Li,Seonwook Park,Amrita Mazumdar,Koki Nagano,Alex Trevithick,Shalini De Mello
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating egocentric video, Generating egocentric, single exocentric video, single exocentric, emerging and important
备注： website url: [this https URL](https://research.nvidia.com/labs/amri/projects/grounded-exo2ego/)
点击查看摘要
Abstract:Generating egocentric video from a single exocentric video is an emerging and important topic for AR/VR and physical AI. Compared with conventional novel view synthesis, exo-to-ego generation is a significantly harder task because the standard geometric conditioning becomes highly unreliable under extreme view changes and large unobservable regions. We present Grounded-Exo2Ego, a principled framework that addresses these challenges at both the architectural and data levels. Architecturally, Grounded-Exo2Ego is a dual-branch video diffusion model that couples a geometric anchoring branch, which conditions the generation on the rendering of a 3D reconstruction, with a novel semantic grounding branch, which goes beyond the prevailing geometry-based approach and improves quality by synthesizing challenging regions based on object-level context. Additionally, we found that the overlooked issue of camera-reconstruction misalignment severely undermines exo-to-ego learning. We thus introduce a camera re-localization algorithm that resolves this issue and substantially improves quality across all metrics. We further develop a fully automated synthetic data engine that generates and renders rigged 3D characters in procedurally generated environments. Evaluation on the challenging EgoExo4D dataset shows that our method outperforms recent state-of-the-art approaches by large margins across all metrics. Detailed ablations validate improvements from each of our contributions at both the data and architectural level.
92. 【2608.20515】DiffVC-ONE: Diffusion-based Generative Video Compression with One-Step Video Diffusion Transformer
链接：https://arxiv.org/abs/2608.20515
作者：Wenzhuo Ma,Zhenzhong Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover rich visual, simultaneously achieving high, Generative video compression, Video Diffusion Transformer, cost remains challenging
备注：
点击查看摘要
Abstract:Generative video compression can recover rich visual details at low bitrates, but simultaneously achieving high temporal consistency and low inference cost remains challenging. To address this issue, we propose DiffVC-ONE, a diffusion-based generative video compression framework built on a one-step Video Diffusion Transformer. First, we introduce a Unified Unidirectional Latent Compressor that uses a shared model to efficiently and uniformly compress compact latent slices. We then develop a Video DiT-based One-Step Diffusion Enhancer that uses the reconstructed latent slices as content anchors and performs single-step spatio-temporal perceptual enhancement over an entire group of pictures. Finally, a Hybrid Condition Generator extracts structural, strength, and semantic conditions from the reconstructed content and quantization information. These conditions preserve faithful regions, control the degree of generative enhancement, and supplement content-aware perceptual details during one-step diffusion enhancement. Extensive experiments on multiple standard benchmarks demonstrate that DiffVC-ONE achieves state-of-the-art perceptual quality and temporal consistency with low inference cost.
93. 【2608.20492】Annotations as Rollouts: Efficient and Scalable Reinforcement Learning for Video MLLMs
链接：https://arxiv.org/abs/2608.20492
作者：Yunheng Li,Guohong Mu,Hao Li,Shengsheng Qian,Dingwen Zhang,Qibin Hou,Ming-Ming Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, unified video perception, Multimodal large, prevailing paradigm, paradigm for unified
备注： Project page: [this https URL](https://orarl.github.io/)
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have become a prevailing paradigm for unified video perception. However, post-training on large multi-task datasets remains challenging, as existing reinforcement learning methods sample on-policy groups with few high-quality rollouts even with costly chain-of-thought (CoT) generation. In this paper, we study the sample efficiency and scalability of RL post-training for video MLLMs and introduce OraRL. We identify an overlooked role for annotations: Beyond scoring rollouts, each can enter its on-policy group as an oracle rollout, a direct positive optimization target. Direct oracle integration, however, is nontrivial: a high-reward oracle raises the group baseline and inverts otherwise positive policy advantages, a failure we term advantage inversion. At the core of OraRL is a decoupled advantage estimator: policy rollouts determine an oracle-free baseline, while the oracle-policy gap modulates both a directional gain and a separate detached oracle advantage. Sign-balanced pruning improves efficiency: by retaining only the oracle and the strongest rollouts of each sign, OraRL requires just 2.2x the step time of SFT, less than half the 4.9x required by GRPO with CoT. OraRL scales with model size and data, surpassing its backbone from 0.8B to 9B and GRPO up to 100k prompts. Without chain-of-thought, Video-ORA-9B decodes in 130 ms instead of 4,780 ms. Compared with the respective prior best models, it raises temporal mIoU from 62.5 to 66.0, tracking AO from 73.0 to 78.2, segmentation from 64.3 to 70.4, and the three-benchmark spatial-intelligence macro average from 51.0 to 56.1; on VSI-Bench, it scores 73.1 against 55.0 for GPT-5 and 55.1 for Gemini-3-Pro.
94. 【2608.20473】Aggregating Visual Information with Optimal Transport for VideoLM Token Compression
链接：https://arxiv.org/abs/2608.20473
作者：Wenti Yin,Xiaotian Han,Junyuan Shang,Yuchen Ding,Shuohuan Wang,Dianhai Yu,Changxin Gao,Nong Sang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：substantial representational redundancy, language models process, Video language models, models process videos, representational redundancy
备注： Code: [this https URL](https://github.com/ernie-research/AVIOT)
点击查看摘要
Abstract:Video language models process videos as dense visual-token sequences with substantial representational redundancy. Compressing these sequences is therefore essential for reducing the visual-token burden on language-model decoding. The central challenge is to preserve visual information dispersed across frames under such compression. To this end, we introduce Aggregating Visual Information with Optimal Transport (AVIOT), which casts video token compression as transporting a dense empirical measure of frame observations onto a compact target measure. The resulting source-to-target coupling induces a distribution over source observations for each target support, directly specifying how the compressed video representation is constructed. We further adapt this construction along task and spatial axes. Question conditioning modulates the transport cost between source frames and target supports, while influencing how many supports are allocated to each temporal segment, thereby directing representation capacity toward question-relevant content. At multiple spatial granularities, AVIOT computes region-specific temporal transport plans and adaptively fuses the representations they yield, allowing different regions within the same compact representation to draw from different moments. Evaluations across varying compression ratios show that AVIOT matches or outperforms the uncompressed baseline on multiple video-understanding benchmarks while retaining strong performance at higher compression ratios.
95. 【2608.20448】MultiCube: Compositional 3D Generation With Part-Level Semantic and Spatial Control
链接：https://arxiv.org/abs/2608.20448
作者：Ava Pun,Kangle Deng,Yiheng Zhu,Jun-Yan Zhu,Maneesh Agrawala,Tinghui Zhou
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：semantically meaningful parts, decomposed into semantically, games and animation, semantically meaningful, Digital
备注：
点击查看摘要
Abstract:Digital 3D objects used in games and animation are often required to be compositional; that is, decomposed into semantically meaningful parts. Recent 3D generation methods can produce high-quality compositional objects conditioned on image or text prompts. Yet, such global conditioning lacks the precise part-level controllability required for professional creative workflows. To address this, we introduce MultiCube, a novel compositional 3D generation method that provides explicit, independent control over both the semantics and spatial arrangement of each part. MultiCube takes as input a global text prompt, a text schema specifying the desired parts, and a spatial layout indicating the bounding boxes of the parts in the given schema. It outputs a 3D object composed of distinct meshes, one per specified part, that adhere to the given semantic and spatial conditions. Our approach employs a two-stage diffusion process, first generating a schema- and layout-aligned monolithic mesh, then decomposing the mesh into individual parts simultaneously. A novel Part Layout Adapter is used to encode per-part conditions independently of the other parts. Experiments demonstrate that our method can generate high-quality compositional 3D objects with precise part-level control, including those with unique layouts difficult to achieve with text or image prompting alone. Project page: this https URL
96. 【2608.20430】RISE: Adaptive Imagination for World Action Models
链接：https://arxiv.org/abs/2608.20430
作者：Hongbo Lu,Liang Yao,Chenghao He,Hao Han,Fan Liu,Wenlong Liao,Tao He,Pai Peng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：World Action Models, Action Models, existing methods allocate, incorporating future world, future world evolution
备注：
点击查看摘要
Abstract:World Action Models (WAMs) improve planning by incorporating future world evolution into action generation, yet existing methods allocate a fixed imagination budget to every scene. We propose RISE (\textbf{R}efining \textbf{I}magination through \textbf{SE}lective Rollout), a system-level adaptive imagination framework that makes sequential \textsc{Roll}/\textsc{Stop} decisions according to the expected planning benefit of continued rollout. At each step, a Latent Evaluator estimates the risk revealed by the current prefix and how much planning could improve if imagination continues, while a Rollout Gate weighs this expected benefit against additional computation cost. Since factual driving logs expose only one realized future, we further construct \textbf{CounterDrive}, a counterfactual dataset with diverse outcomes and risk levels, to enrich future dynamics and provide localized risk supervision. Each retained sample undergoes expert verification and annotation of trajectory validity, incident onset, and causal category, providing a reusable resource for safety-critical world-modeling research. Experiments on NAVSIM and nuScenes show that RISE achieves the best overall planning performance while reducing unnecessary rollout, with additional transfer results supporting its plug-in generality across WAM architectures.
97. 【2608.20429】Maximum Entropy Encoding of Energy-Weighted Spherical Moments
链接：https://arxiv.org/abs/2608.20429
作者：Jiaze Sun
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Monte Carlo path, non-negative Monte Carlo, Carlo path samples, Monte Carlo, energy signals composed
备注： 23 pages, 12 figures, 5 tables
点击查看摘要
Abstract:We study how angular energy signals composed of non-negative Monte Carlo path samples can be compressed and reconstructed for irradiance using finite moments. Writing each sample as an energy-weighted directional feature $x = r u$, we adopt total energy, the first directional moment, and the traceless second moment as $1+3+5$ linearly additive, rotationally covariant statistics. Under a fixed Lebesgue reference measure, the maximum-entropy closure yields $p(r,u) \propto \exp(-\beta r g(u))$, where $g(u) = 1 - b \cdot u + u^T Q u$, whose directional probability and angular energy density are proportional to $g^{-3}$ and $g^{-4}$, respectively. When $g_{\min} 0$ the closure is normalizable and the reconstruction is strictly positive. We further provide analytic moment matching, variance, inverse sampling, and closed-form diffuse response for the pure-dipole four-parameter subfamily, as well as the realizability domain, partition function, azimuthal algebraic integral, and LUT-oriented reconstruction form for the dipole-second-moment coaxial five-parameter subfamily. Experiments cover 981 Poly Haven HDRI 2K scenes and three Debevec probes. Five-parameter MaxEnt achieves a 78.7% per-scene win rate against stored QZH, with mean luminance RMSE reduced by 15.8%; the advantage is more pronounced in scenes with strong directionality. Both MaxEnt variants maintain zero negative irradiance across all scenes. Full second-order SH-2 yields the lowest overall error, while five-parameter MaxEnt ranks second and outperforms SH-2 in the high-directionality bucket; the coaxial subfamily shows systematic closure error on non-coaxial multi-source scenes.
98. 【2608.20414】StateSight: Benchmarking Latent Spatial-State Reconstruction in Vision-Language Models
链接：https://arxiv.org/abs/2608.20414
作者：Michelle Lin
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal question answering, single image remains, image remains difficult, reconstruct latent spatial, question answering
备注：
点击查看摘要
Abstract:Vision-language models are increasingly used for multimodal question answering, yet their ability to reconstruct latent spatial structure from a single image remains difficult to isolate. Broad benchmarks often combine perception, optical character recognition, domain knowledge, linguistic priors, and reasoning in the same evaluation. We introduce StateSight, a procedurally generated benchmark for cube-net opposite-face reasoning, occluded cube-tower counting, and 4-neighbor connected-component counting. Each task family contains 300 single-image prompts with deterministic oracle labels and exact-match scoring. OpenAI GPT-5.5, using the API model identifier gpt-5.5, achieved 59.3%, 33.3%, and 28.3% accuracy across the three tasks, while Claude Sonnet 5 achieved 53.3%, 18.7%, and 7.3%. All final direct runs had zero format errors. A 30-participant human baseline on 60 items exceeded both models on every task, with mean accuracies of 80.8%, 68.8%, and 64.3%. Visible-derivation analysis identified recurring errors in image-state reconstruction and reasoning procedure. We also introduce StateSight-Steps, a companion dataset of 900 interleaved image-text examples and 3,600 deterministic intermediate visual states. The results show that format-valid responses can mask failures to recover the spatial structure required for verifiable visual inference.
99. 【2608.20382】Decoupled Vision-Language System for Multimodal Understanding and Generation
链接：https://arxiv.org/abs/2608.20382
作者：Yifan Xu,Baochen Xiong,Xiaoshan Yang,Donglin Di,Yaowei Wang,Changsheng Xu
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, multimodal large language, language models, large language, Libra architecture
备注：
点击查看摘要
Abstract:We introduce a new architecture design for multimodal large language models (MLLMs), Libra, capable of both multimodal understanding and generation. Libra architecture contains one vision system and one language system, connected by cross-modal bridges. This design decouples self-modal modeling and cross-modal interaction, enabling each modality to learn its unique representations while maintaining effective cross-modal comprehension. The decoupling is mainly achieved in a switch attention module and a switch FFN module, which dynamically routes the computation flow for self-modal modeling and cross-modal interaction scenarios. We evaluate the effectiveness in two important settings: \textbf{Libra-1} for the understanding-only image-to-text setting, and \textbf{Libra-2} for unified image-to-text understanding and text-to-image generation. In addition to the architecture design, we discuss various improvements on tokenization, positional encoding, and supervision. Experiments demonstrate that the dedicated Libra design enables mutual improvements on multimodal understanding and generation, achieving strong performance on both understanding and generation benchmarks.
100. 【2608.21180】oward Vision Language Model-based Assessment of Clinical Quality and Usability of LGE-MR Images for Cardiac Ablation Planning
链接：https://arxiv.org/abs/2608.21180
作者：Bipasha Kundu,Abhishek Chaturvedi,Axel W. E. Wismueller,Richard Simon,Cristian A. Linte
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：LGE cardiac MRI, LGE cardiac, cardiac MRI, MRI is widely, tissue regions identified
备注：
点击查看摘要
Abstract:LGE cardiac MRI is widely used for left atrial fibrosis assessment and ablation planning in atrial fibrillation patients as knowledge of fibrotic tissue regions identified from LGE-MRI is critical for catheter ablation. Often, poor quality images used during ablation planning can cause mis-localization of ablation targets, directly impacting procedure safety and outcome. The decision of whether a scan meets the minimum quality threshold for ablation planning is currently made informally by the reviewing radiologist and is not captured by any automated system, yet it is arguably the most safety-critical output of the image quality assessment (IQA) process. However, variations in image quality caused by noise, motion artifacts, and poor boundary definition significantly compromise the reliability of downstream segmentation and clinical decision-making tasks. Manual quality assessment by expert radiologists is subjective and difficult to scale, while existing automated methods produce scalar scores without interpretable clinical reasoning. In this work, we propose a two-stage vision language model (VLM) framework for clinically grounded image quality assessment of left atrial LGE-MRI. In the first stage, a fine-tuned VLM generates structured radiology-style quality reports predicting five radiologist-defined criteria: Noise, Motion Artifact, LA Boundary Accuracy, PV Region Accuracy, and Under-segmentation Severity. In the second stage, a GPT-based reasoning module maps the predicted quality and reports to a structured quality scores and binary clinical usability decision for ablation planning. We curate a dataset of 60 annotated image slice-text pairs from 20 patients and benchmark four state-of-the-art VLM architectures. InternVL2 achieves the highest criterion-level accuracy (Avg ACC=0.65, PLCC=0.79), while DeepSeek achieves perfect clinical usability agreement (Acc=1.00, kappa=1.00).
101. 【2608.20602】Sparse Light Field Sampling Improves Casual 3D and 4D Reconstruction
链接：https://arxiv.org/abs/2608.20602
作者：Shamus Li,Ruiming Cao,Laura Waller,Kristina Monakhova,Sara Fridovich-Keil
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：record multiple synchronized, light field cameras, field cameras record, consumer smartphones, light field
备注： Project page: [this https URL](https://shamus.li/lightfield-gaussian-splatting)
点击查看摘要
Abstract:Many consumer smartphones, stereo cameras, and light field cameras record multiple synchronized viewpoints in a single exposure event. However, novel view synthesis pipelines commonly use only a monocular stream and rely on camera motion or learned priors to obtain angular coverage. In this paper, we ask: why do we use only one viewpoint? We analyze sensor-limited multi-view, where one sensor trades off spatial and angular resolution, and exposure-limited multi-view, where multiple sensors on one commodity device observe each event simultaneously. We introduce a new dataset incorporating three types of commodity multi-view cameras, and evaluate sparse-view 3DGS and 4DGS baselines measuring reconstruction quality as a function of number of exposures and angle between extreme views. Our results demonstrate that using multiple cameras, even with a low baseline, significantly improves reconstruction quality in single-shot, few-shot, and casual video settings. In addition, under a fixed sensor budget, angular sampling improves reconstruction when exposures are scarce despite lower spatial resolution. The gains are most pronounced for single-shot and dynamic scenes, where a stationary monocular camera lacks the angular diversity to recover scene geometry and motion.
102. 【2608.20561】Consistency Models for Fast MRI Reconstruction Using Regularization by Denoising
链接：https://arxiv.org/abs/2608.20561
作者：Merve Gülle,Junno Yun,Yaşar Utku Alçalar,Mehmet Akçakaya
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Medical Physics (physics.med-ph)
关键词：powerful generative priors, promising results, emerged as powerful, MRI reconstruction, MRI reconstruction method
备注：
点击查看摘要
Abstract:Diffusion models (DMs) have emerged as powerful generative priors for MRI reconstruction with promising results. Yet DM-based methods require extensive iterative refinement, limiting their practical deployment. Consistency models (CMs) provide a compelling alternative, aiming to map out the diffusion trajectory in a single pass, enabling faster generation. In this work, we propose CM-RED, a novel MRI reconstruction method that integrates a pretrained CM into the regularization by denoising (RED) scheme. Our method builds on accelerated proximal gradient RED (RED-APG), and further incorporates controlled noise injection during the update steps to enhance generative diversity and accelerate convergence. Extensive experiments on the fastMRI knee and brain datasets demonstrate that CM-RED achieves high-quality reconstructions across multiple anatomies, contrast weights, acceleration factors, and undersampling patterns, using only 4 network function evaluations (NFEs). The proposed method consistently outperforms existing DM- and CM-based approaches in both quantitative metrics and visual fidelity, and exhibits strong robustness to hyperparameter variations, highlighting CM-RED as an efficient and effective generative framework for accelerated MRI reconstruction. The source code and pretrained models are publicly available at this https URL.
103. 【2608.20524】Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems
链接：https://arxiv.org/abs/2608.20524
作者：Laura C. Diaz-Delgado,Emmanuel Martinez,Henry Arguello
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：acquiring clean ground, clean ground truth, photon-limited settings, increasingly important, important in photon-limited
备注：
点击查看摘要
Abstract:Self-supervised learning for imaging inverse problems is increasingly important in photon-limited settings, where acquiring clean ground truth is impractical and reconstruction must remain stable under dataset and acquisition shifts. This challenge is amplified under Poisson noise, whose signal-dependent statistics interact with sampling operators (e.g., CFA mosaicing). Meanwhile, foundation vision encoders trained at web scale offer distortion-invariant, content-related representations that generalize well across domains, suggesting a promising route to build priors that transfer beyond the training distribution without expensive fine-tuning. This paper proposes an ADMM-inspired unrolled plug-and-play solver for Poisson inverse problems that decouples a closed-form data-consistency update from a parameter-efficient prior. The prior is implemented as a lightweight decoder operating on frozen CLIP RN50 dense multi-scale features, adapting foundation representations with less trainable parameters. For self-supervision, the method integrates GR2R measurement-domain re-corruption with an Equivariant Imaging regularizer via virtual acquisitions. Experiments on Poisson CFA demosaicing and deblurring show competitive quality, improved robustness under shifts, and self-supervised performance approaching supervised training.
