本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新1196篇论文，其中：

自然语言处理204篇
信息检索44篇
计算机视觉235篇

自然语言处理

1. 【2608.23566】How to Train a Critic Stably and Efficiently

作者：Penghui Qi,Xiangxin Zhou,Wee Sun Lee

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：GRPO for large, language models avoid, large language models, reinforcement learning methods, Practice Critic Optimization

备注：

点击查看摘要

Abstract:Group-based reinforcement learning methods such as GRPO for large language models avoid training a critic by sampling multiple responses for each prompt. A reliable critic could instead estimate token-level advantages from one response, but standard critic-based training recipes are often unstable. We study this instability and develop **Best Practice Critic Optimization (BPCO)**, a recipe that combines DPPO, value predictions bounded to the reward range, Monte Carlo value targets, unnormalized policy advantages, and length-adaptive generalized advantage estimation. Because the critic is used only during training, BPCO can also condition it on reward-defining information, such as a reference answer or grading rubric, that is hidden from the policy. Controlled experiments isolate the effect of each design choice. Across mathematical reasoning tasks with models ranging from 1.5B parameters to 30B-A3B mixtures of experts, BPCO improves a strong critic-based baseline consistently, and matches or exceeds a group-based baseline while sampling one response per prompt. The same recipe also improves learning with rubric-based rewards. These results show that a carefully designed critic provides a reliable alternative to group-relative advantage estimation. Code is available at this https URL.

2. 【2608.23564】SWE Refactor Bench: Can Coding Agents Complete a Long-Horizon, Whole-Repository Stack Migration?

链接：https://arxiv.org/abs/2608.23564

作者：Deyao Hong,Yizhe Chi,Wenyi Li,Xiaoqiu Wang,Mingju Gao,Kaisen Yang,Bingxiang He,Youjie Zheng,Calvin Xiao,Qinhuai Na

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)

关键词：Modern software systems, software systems accumulate, Modern software, migration, systems accumulate technical

备注：

点击查看摘要

Abstract:Modern software systems accumulate technical debt over decades of development, which makes migration expensive and largely manual. As coding agents become increasingly capable at bug fixing, can they autonomously perform such migrations? Existing benchmarks cannot answer this question because they evaluate only behavioural correctness, not whether the migration actually occurred. This leads an easy hack: agents copy the original implementation to make tests pass. We call this Blindness. To address this problem, we introduce SWE Refactor Bench, a benchmark comprising 20 whole-repository migrations, covering 4 kinds of technical debt. A three-stage evaluation protocol measures both migration completeness and behavioural correctness. (1) Migration Audit verifies that the migration occurred. (2) Behavioural Tests measure correctness with a fixed test suite. (3) Agentic Verification uses 6 independent coding agents to generate targeted tests for hidden behavioural differences. Across 520 runs from 8 frontier models and 26 model-effort configurations, only 28 of 520 runs ($5.4\%$) pass all three stages, 13 of the 20 tasks receive no accepted solution, and the best model (claude-opus-5) scores $47.0/100$. Migration completeness and behavioural correctness are distinct abilities: a few runs preserve behaviour by skipping the migration and are stopped at Migration Audit; most attempt it and break behaviour, and are stopped at Behavioural Tests. Agents cannot deliver a perfect migration: among the 340 runs that pass Migration Audit, $58\%$ reach $99\%$ of the fixed checks, yet only $26\%$ reach $100\%$. Agent capability differs across migration categories: agents score $31.4$ on build toolchain rewrites but only $5.6$ on language rewrites. Together, these findings position SWE Refactor Bench as a rigorous testbed for developing coding agents for reliable whole-repository migrations.

3. 【2608.23552】Prime Agent: A Self-Improving RLM Harness

链接：https://arxiv.org/abs/2608.23552

作者：Seth Karten,Alex L. Zhang,Kevin Thomas,Sebastian Müller,Elie Bakouch,Daniel Auras,Mika Senghaas,Fares Obeid,Konstantin Dunas,Johannes Hagemann,Sami Jaghouar

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词：agency requires external, requires external information, long-horizon agency requires, Recursive Language Model, Prime Agent

备注： 16 pages, 10 figures. Technical report. Code: [this https URL](https://github.com/PrimeIntellect-ai/prime-agent)

点击查看摘要

Abstract:Language models are sequential processors, but long-horizon agency requires external information and computation beyond model weights and active context. Prime Agent is an open-source harness for long-horizon evaluation and coding-agent workflows. A persistent IPython REPL follows the Recursive Language Model abstraction for programmatic context processing and test-time compute, while Continual Harness preserves histories, memories, skills, prompts, and subagent specifications across trajectories. Recursive subagents coordinate through direct agent-to-agent communication, and the Agents View lets humans inspect and manage daemon-backed sessions. Prime Agent standardizes execution, recovery, verification, and resource accounting while leaving strategy construction to the model. This low-friction, expressive membrane prevents harness failures from becoming model failures and pushes measurement toward the model's true maximal underlying capability. Prime Agent raises ARC-AGI-3 RHAE Best@1 from 30% to 95.5% and matches or exceeds native and popular harnesses across long-context coding, GPU-kernel generation, emulator construction, and autonomous nanoGPT speedruns. On Factorio, we find refinement allows for continuous technology progression and dedicated subagents enable parallelized work. Code is available at this https URL.

4. 【2608.23551】ConvergeFlow: Language Flow with Provable Convergence to Token Embeddings

链接：https://arxiv.org/abs/2608.23551

作者：Na Li,Yuchen Jiao,Changxiao Cai,Gen Li

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

关键词：Recent advances, valid token embeddings, achieved performance competitive, token embeddings, flow-based language models

备注：

点击查看摘要

Abstract:Recent advances in continuous diffusion and flow-based language models (LMs) have achieved performance competitive with discrete LMs. However, existing continuous frameworks still rely on decoders supervised with cross entropy (CE) because the flow trajectories are not guaranteed to terminate at valid token embeddings. Motivated by this limitation, we introduce \textbf{ConvergeFlow}, an embedding-space flow-based LM, which constrains the data predictor to the convex hull of token embeddings and trains it solely with the mean squared error objective induced by flow matching. Under suitable regularity conditions, we prove that the resulting flow converges to valid token embeddings despite errors in the data predictor, enabling direct token prediction without a CE-supervised decoder. We further develop three sampling mechanisms for controlling the trade-off between the generative perplexity and entropy. Experiments on OpenWebText demonstrate that ConvergeFlow achieves performance competitive with existing continuous and discrete diffusion LMs. These findings demonstrate the potential of the flow-based paradigm for language modeling. Our code is available at this https URL.

5. 【2608.23507】When Names Cross Scripts: A Source-Grounded Benchmark for Historical Entity Reconciliation in the Mongol World

链接：https://arxiv.org/abs/2608.23507

作者：Xiang Chen,Zeyu Zhang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：share highly similar, transcription traditions, distinct individuals, individuals may share, share highly

备注： 38 pages, 4 figures, 7 tables. arXiv preprint

点击查看摘要

Abstract:Historical people may appear under different languages, scripts, and transcription traditions, while distinct individuals may share highly similar or even identical names. This makes historical identity reconciliation more than a problem of string matching or transliteration. We introduce MHER, a provenance-controlled benchmark for pairwise reconciliation of person-name attestations from the Mongol world. MHER contains a balanced 396-pair Name-only core over 84 primary historical persons and a stricter 160-pair Source-grounded subset constructed from mention-by-source evidence, with entity-disjoint development and test splits. Across five generative systems, correctly Source-grounded evidence improves paired TEST accuracy by 12.96 to 94.44 percentage points relative to Name-only input. On five identical-surface different-person cases, all models fail under names alone (0/25 model-item decisions), whereas Source-grounded evidence yields 24/25 correct resolutions, with the remaining output an abstention. Context-only ablations show that historical descriptions often carry substantial identity information, while explicitly signaled misgrounding controls produce substantially lower performance. We also find that names are not uniformly beneficial: for Qwen3-8B, restoring surface forms converts ten otherwise correct Context-only distinctions into false identity merges. These results show that historical entity reconciliation depends not only on surface correspondence, but on whether identity judgments respond appropriately to provenance-controlled historical evidence. MHER therefore provides a controlled framework for studying evidence use, abstention, and failure modes in historical NLP.

Comments:
38 pages, 4 figures, 7 tables. arXiv preprint

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

ACMclasses:
I.2.7; I.2.6; H.3.3

Cite as:
arXiv:2608.23507 [cs.CL]

(or
arXiv:2608.23507v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.23507

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

6. 【2608.23497】Mitigating Reasoning-Induced Misalignment via Safety-Direction Penalty

链接：https://arxiv.org/abs/2608.23497

作者：Yipeng Zhao,Qishun Yang,Shenzhe Zhu,Shu Yang,Di Wang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Reasoning-Induced Misalignment, induce harmful behaviors, LLM reasoning, harmful content, induce harmful

备注： 28 pages, 4 figures

点击查看摘要

Abstract:Reasoning-Induced Misalignment, where fine-tuning on reasoning data containing no harmful content, including mathematics, code, and problem-solving with chain-of-thought traces can induce harmful behaviors of LLM, posing a serious challenge to the safety of LLM reasoning. Cross-architecture, cross-scale, and cross-dataset checks show that RIM does not always emerge. Previous work attributed RIM to neuron-level entanglement, but did not identify the geometry of the representation space underlying this entanglement or propose a training-time fix. We provide both: a representation-space analysis of RIM and the Safety-Direction Penalty (SDP), which penalizes movement along a learned safety direction during reasoning fine-tuning. The analysis extracts two activation-space directions, one encoding reasoning ability and the other safety behavior. These directions are coupled: fine-tuning that improves reasoning shifts safety representations, and prompts with larger shifts show larger safety degradation. CKA distance ratios and probes locate the safety-decision layers where this shift is most relevant. These findings guide the design of SDP: the coupling motivates penalizing displacement along the safety direction, and the layer localization sets the initial scope. When the initial scope leaves compensatory shifts beyond the penalized layers, the same diagnostics guide iterative expansion. On Qwen2.5-3B and 7B, SDP restores safety while preserving benchmark reasoning performance.

7. 【2608.23476】On the Threat Model of Weird Generalization and Emergent Misalignment

链接：https://arxiv.org/abs/2608.23476

作者：Miriam Wanner,Mark Dredze,William Walden

类目：Computation and Language (cs.CL)

关键词：behavior-a phenomenon called, phenomenon called weird, called weird generalization, model behavior-a phenomenon, Narrow fine-tuning

备注：

点击查看摘要

Abstract:Narrow fine-tuning on small, domain-specific datasets can produce broad and surprising changes in model behavior-a phenomenon called weird generalization (WG). Yet, it remains unclear what features of the fine-tuning data are necessary for WG to arise. Here, we address this question by investigating a range of plausibly relevant features, including dataset size, composition, language, presentation style, and novelty relative to a model's parametric knowledge. Further, since WG evaluations rely on small question sets that assess the extent of the generalization, we also analyze how sensitive this measurement is to the set of questions used. Experiments with three open-weight models on four datasets show that the degree of WG (1) depends heavily on dataset composition and language (more than on size); (2) is greater for data familiar from pretraining than for novel data; and (3) is sensitive to the set of evaluation questions used. Collectively, these results indicate that WG is a product of quite fragile properties of both training and evaluation data. As such, we argue that WG is more plausible as an adversarial threat-requiring careful data engineering-rather than as a significant hazard inherent to routine fine-tuning.

8. 【2608.23474】What's the Catch? Evaluating Temporal Consistency in Vision-Language Models

链接：https://arxiv.org/abs/2608.23474

作者：Marek Hradil,Danae Sánchez Villegas

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：capture temporal structure, anomaly detection, video and image-sequence, remains unclear, temporal

备注： 17 pages, ACL format

点击查看摘要

Abstract:Vision-language models (VLMs) achieve strong performance on video and image-sequence benchmarks, yet it remains unclear whether they capture temporal structure. To study this question, we formulate temporal grounding as an anomaly detection problem, providing a simple and controlled evaluation that directly tests sensitivity to temporal consistency. We introduce TimeCatch, where temporal anomalies are created by swapping consecutive frames and frame-level anomalies by replacing a frame with Gaussian noise. Models are evaluated on anomaly detection and localization tasks across four synthetic and real-world datasets, alongside a human study. Our evaluation reveals a substantial gap between frame-level and temporal anomaly detection. While VLMs consistently detect frame-level anomalies and often localize them accurately, they perform near chance on temporal anomaly detection and only modestly above chance on localization. Humans, in contrast, achieve near-ceiling performance on both tasks. Additional analyses across model scales, prompting strategies, sequence lengths, and visual similarity suggest that these failures cannot be explained solely by limitations in perception or model capacity. Together, these findings indicate that current VLMs can identify anomalies within individual frames but struggle to integrate information across frames to reason about temporal consistency. TimeCatch provides a controlled benchmark for evaluating temporal grounding in vision-language models.

9. 【2608.23448】How Useful are LLMs for Grammar Engineering? Cantonese ParGram Resources and Controlled Experimental Evaluation with English Baselines

链接：https://arxiv.org/abs/2608.23448

作者：Chit-Fung Lam

类目：Computation and Language (cs.CL)

关键词：controlled experimental paradigm, Cantonese ParGram resources, Cantonese ParGram, knowledge-driven grammar engineering, experimental paradigm

备注： Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026

点击查看摘要

Abstract:This paper presents new Cantonese ParGram resources and evaluates LLMs for knowledge-driven grammar engineering within a controlled experimental paradigm. Using Cantonese ParGram resources as gold standards, with corresponding English baselines, we investigate whether OpenAI's gpt-oss-120b and GPT-5.4 can generate machine-processable grammars from sentences and target formal structures under systematically varied prompting conditions. GPT-5.4 outperformed gpt-oss-120b, while grammars generated from target formal structures generally outperformed those generated from sentences. Although both models could generate locally plausible phrase-structure rules, lexical entries, and templates, they often struggled to coordinate interacting formal constraints, especially in multi-construction settings. The results characterize both the capabilities and limitations of current LLMs for potential integration into AI-assisted expert workflows: LLMs may support intermediate stages of grammar development, but human linguistic expertise remains central to analysis, validation, and refinement. The study also contributes new Cantonese symbolic grammatical resources.

10. 【2608.23421】A Comprehensive Analysis of Arabic Natural Language Processing Research: Trends, Topic Evolution, and Research Gaps -- A Bibliometric and Topic-Based Study

链接：https://arxiv.org/abs/2608.23421

作者：Mullosharaf K. Arabov

类目：Computation and Language (cs.CL)

关键词：Natural Language Processing, Arabic Natural Language, Language Processing, Natural Language, large language models

备注： 38 pages, 16 tables, 10 figures. Preprint

点击查看摘要

Abstract:Arabic Natural Language Processing (NLP) has grown rapidly over the past decade, driven by digital transformation in the Arab world, social media, and large language models (LLMs). Despite this growth, a comprehensive quantitative meta-analysis remains absent. This study presents a bibliometric and topic-based analysis of 7,120 Arabic NLP papers published between 1960 and 2026, sourced from five platforms (arXiv, ACL Anthology, Semantic Scholar, Crossref, OpenAlex) plus an additional targeted OpenAlex subset. We employ BERTopic for topic modeling, regression analysis, social network analysis, and geographic mapping. Our findings show a significant publication surge after 2020, driven by transformer models and LLMs. Topic modeling identifies 19 themes, the largest centered on text, speech, translation, and recognition (2,942 papers). Citation analysis reveals a positive correlation between paper age and citations (r = 0.245, p 0.001); regression (R^2 = 0.105) shows that indexing in OpenAlex or Semantic Scholar and institutional affiliation are associated with higher citations. Saudi Arabia, the United States, and Egypt lead in research output. A task-dialect gap matrix identifies understudied areas, including summarization for Maghrebi, Iraqi, and Sudanese dialects. The largest topic has the highest H-index (90), followed by sentiment analysis (57). Our quantitative approach complements existing qualitative surveys and offers recommendations to prioritize under-resourced dialects and develop culturally aligned benchmarks.

11. 【2608.23419】Robustness of IR Models to Collection Growth

链接：https://arxiv.org/abs/2608.23419

作者：Emmanouil Georgios Lionis,Debasis Ganguly,Sean MacAvaney

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：Information Retrieval, identify relevant documents, systems seek, seek to identify, identify relevant

备注： CIKM 2026 Short Paper track

点击查看摘要

Abstract:Information Retrieval (IR) systems seek to identify relevant documents within a collection. In practical applications, collections are dynamic, with documents frequently added. We argue that ideally, a retriever's effectiveness should not decrease when non-relevant documents are added to a collection. This study formalises this concept and empirically evaluates it by merging two collections with negligible topic overlap. We hypothesise that the way an IR model conditions its ranking on other documents in a collection (e.g., the IDF component in BM25 or contextual documents in listwise rerankers) plays an important role in its robustness to the addition of non-relevant documents. We broadly classify models as those that do not depend on other documents (Multi-Document-Agnostic, MDA) and those that do (Multi-Document-Dependent, MDD). Our results show that neither MDD nor MDA models are fully robust to the addition of non-relevant documents, as all models exhibit some performance degradation. Interestingly, among the models we test, MDA is more effective than MDD for retrieval, whereas MDD and MDA rerankers are equally effective.

12. 【2608.23411】STONIC: A Layered Measurement Contract for LLM Value Profiling

链接：https://arxiv.org/abs/2608.23411

作者：Andrei Chetvergov,Stepan Ukolov,Timofei Sivoraksha,Alexander Evseev,Danil Sazanakov,Mikhail Solovev,Sergey Bolovtsov

类目：Computation and Language (cs.CL)

关键词：LLM value studies, merge questionnaire ratings, inferred from generated, merge questionnaire, LLM

备注： 32 pages, 6 figures, including appendices

点击查看摘要

Abstract:LLM value studies often merge questionnaire ratings, pairwise choices, and values inferred from generated text into one profile. That merge assumes that the three observations describe the same stable preference. STONIC tests this assumption on 5,144 situations from four banks and 35 fixed model configurations. It compares responses rated in isolation, choices made under counterbalanced conflict, spontaneous answers, and later choices between a model's own answer and authored alternatives. 10 of 17 configurations with usable behavioral data preserve the endorsement-choice relation across banks. Every one of the 17 eligible configurations prefers its own earlier answer (median effect 0.790), although option position changes the choice rate in every eligible configuration. Profile shape transfers most strongly from ratings to conflict choices and weakens for spontaneous text. Three-way annotation of 200 L3 responses provides a task-local check of the semantic audit: FULCRA agrees most closely with the human majority, while DeBERTa retains useful rank information after calibration. Hidden states encode the completed decision more clearly than the prompt alone. Thus the models show reproducible behavioral continuity, but the evidence does not support one scorer-independent value identity across interfaces.

13. 【2608.23391】Cross-Domain, Multi-Task Data-to-Text Generation without In-Domain Training Data

链接：https://arxiv.org/abs/2608.23391

作者：Yifei Song,Kun Efimov-Zhang,Claire Gardent

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Structured data exists, Structured data, time series, data exists, knowledge graphs

备注： Accepted by EMNLP Findings 2026

点击查看摘要

Abstract:Structured data exists in many forms (tables, knowledge graphs, charts, and time series), and converting it into text may involve different generation tasks. However, most prior work on data-to-text (D2T) generation has focused on specific tasks and datasets, relying either on task-specific training data or on the zero-shot capabilities of large language models. We study cross-domain D2T generation in a setting where neither in-domain training text nor test references are available, and where domains, generation goals, and input structures vary substantially. We compare data-driven knowledge distillation (DDKD) against zero-shot inference and fine-tuning on out-of-domain D2T data, and introduce structure-preserving augmentation via structural subsampling and perturbation. Experiments on five benchmarks show that, at constant model size (1.7B parameters), DDKD consistently outperforms both fine-tuning and zero-shot inference. Moreover, the resulting small models outperform a much larger finetuned model on two of the five domains, achieving comparable performance on the remaining three. We further construct QUINTD-5, a fivefold extension of QUINTD-1, and show that simply scaling real target-domain inputs yields only modest gains, whereas our augmentation strategy remains more effective and more cost-efficient for cross-domain distillation.

14. 【2608.23390】Cross-lingual Biography Enrichment via Claim Extraction and Alignment

链接：https://arxiv.org/abs/2608.23390

作者：Yifei Song,Ziyang Chen,Emil Sayilov,Claire Gardent

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：default encyclopedic source, richer locally grounded, locally grounded information, non-English Wikipedia editions, English biography

备注： accepted by EMNLP 2026 main conference

点击查看摘要

Abstract:English Wikipedia is often treated as the default encyclopedic source, yet non-English Wikipedia editions can contain richer locally grounded information for long-tail figures. We study cross-lingual biography enrichment: enriching an existing English biography with facts supported by a non-English biography about the same person. Focusing on women from non-English-speaking contexts, we introduce \textsc{CLAW-4L}, a benchmark consisting of 300 Wikipedia biography pairs linking an English biography with its French, Chinese or Azerbaijani counterpart, along with claim annotations and a fine-grained claim-pair relation corpus. We propose a claim-based enrichment framework that extracts English claims from both biographies, aligns them to identify enrichment evidence from the non-English biography, and rewrites the English biography using the selected claims. Our results show that non-English Wikipedia biographies provide valuable evidence for improving English biography coverage, while lower-resource settings remain challenging.

15. 【2608.23358】he Geometry of Low-Resource Language Representations

链接：https://arxiv.org/abs/2608.23358

作者：Francois Meyer,Jan Buys

类目：Computation and Language (cs.CL)

关键词：internal model factors, model factors drive, drive these disparities, remains unclear, unclear which internal

备注：

点击查看摘要

Abstract:The performance gap between low- and high-resource languages in LLMs is widely known, but it remains unclear which internal model factors drive these disparities. In this paper, we characterise this gap through the lens of representational geometry. Comparing the geometric properties of hidden representations across 30 languages reveals that LLM geometry is systematically related to language data availability. The most consistent effect is in final layers, where low-resource languages exhibit representational degeneration. To counter this, we investigate the effectiveness of regularisation terms to penalise degeneration during continued pretraining (CPT). Experiments monolingually adapting 9 base LLMs to 10 African languages show that geometric regularisation successfully reduces representational degeneration during CPT. For larger models, cosine similarity-based regularisation marginally improves performance over vanilla CPT, with more consistent gains on the most challenging tasks. We establish that the representational geometry of low- and high-resource languages in LLMs is measurably distinct, and that targeted geometric intervention is a viable strategy for improving CPT for low-resource languages.

16. 【2608.23353】FormuEvo: LLM-Guided Evolution for Discovering Solver-Efficient Mixed-Integer Programming Formulations

链接：https://arxiv.org/abs/2608.23353

作者：Haofeng Yuan,Jianing Peng,Jieyi Bi,Ni Zhang,Shiji Song,Zhiguang Cao

类目：Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)

关键词：Mixed-integer programming, MIP, research and industrial, MIP formulations, Mixed-integer

备注： 27 pages, 6 figures, and 9 tables. To appear in the Proceedings of EMNLP 2026

点击查看摘要

Abstract:Mixed-integer programming (MIP) lies at the core of operations research and industrial optimization. While large language models (LLMs) have recently shown promise in automated MIP modeling from natural language, they prioritize semantic correctness but overlook formulation strength, severely bottlenecking the efficiency of downstream solvers. We propose FormuEvo, an LLM-guided evolutionary framework for automated discovery of solver-efficient MIP formulations. FormuEvo frames MIP formulation design as evolutionary optimization over the symbolic space of MIP formulations, represented as executable modeling programs, by iteratively generating, evaluating, and selecting stronger candidates via LLM-driven crossover, mutation, and repair operations. To move beyond blind exploration, FormuEvo introduces a solver-informed diagnosis mechanism that exploits fine-grained solver statistics as verbal gradients for targeted refinement. Additionally, a structured memory abstracts prior experience into reusable modeling strategies, avoiding redundant exploration while enabling zero-shot transfer to unseen problems and bootstrapping smaller LLMs. Experiments across diverse linear and non-linear problems demonstrate that FormuEvo discovers formulations that significantly outperform both expert-designed formulations and existing LLM-based approaches, accelerating solvers by up to 5.5$\times$, with distilled knowledge transferring effectively across problems and model scales.

17. 【2608.23338】he Emergence of Relevance Through Axiomatic Attention Patterns During LoRA Fine-Tuning

链接：https://arxiv.org/abs/2608.23338

作者：Matthew Perlman,Atharva Nijasure,James Allan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：network task-specific relevance, task-specific relevance behavior, LLMs to reranking, accompany that learning, remains unclear

备注： Accepted to EMNLP 2026 Findings. 17 Pages. 25 Figures. 5 Tables

点击查看摘要

Abstract:LoRA fine-tuning is standard for adapting LLMs to reranking, but it remains unclear where in the network task-specific relevance behavior is learned and what attention-level changes accompany that learning. Through ablation and attention experiments, we identify where LoRA attention updates to RankLLaMA improve performance and whether those gains coincide with interpretable relevance-oriented attention patterns such as lexical matching, rarity sensitivity, and query-document interaction. We find that given LoRA fine-tuned MLPs throughout the network, restricting LoRA attention updates to a compact mid-network region is sufficient for recovering over half of the performance gained by applying LoRA to all attention layers, and that omitting attention fine-tuning in this region hurts performance more than elsewhere in the network. Additionally, we show that regions where applying LoRA affects performance the most overlap with regions where fine-tuning increased attention to axiomatic IR features. Rarity sensitivity, document-query interaction, and several compositional features are highly correlated with gains in ranking performance. Our results support an interpretable, correlational account of how relevance-oriented behavior emerges during LoRA fine-tuning and point toward improved strategies for adapting rerankers.

18. 【2608.23327】Flesch-Kincaid Readability Depends Only on the Topic Distribution in Long Texts under Topic Models

链接：https://arxiv.org/abs/2608.23327

作者：Yo Ehara

类目：Computation and Language (cs.CL)

关键词：Flesch Reading Ease, Flesch-Kincaid Grade Level, Flesch Reading, Reading Ease, Flesch-Kincaid Grade

备注：

点击查看摘要

Abstract:Flesch Reading Ease (FRE) and the Flesch-Kincaid Grade Level (FKGL) are widely used readability scores for English computed from the same two document statistics, yet their stability on long documents need not imply invariance to lexical composition. Surprisingly, under a topic model with an explicit sentence-boundary token, both scores converge almost surely to deterministic functions of the document topic distribution through just two scalar rates: in the long-text limit, all score variation is mediated by topical composition rather than any residual readability signal. The theory covers both formulae, while the experiments evaluate FKGL. In a fixed admixture with rank[1, q, s] = 3, fibres through interior topic vectors are locally (K-3)-dimensional, whereas regular iso-score level sets are locally (K-2)-dimensional and curved. In out-of-fold evaluation on two balanced corpora, Brown and the written BNC, a topic vector inferred from one document half's content words predicts the other half's FKGL at r = 0.779 and 0.884, respectively. On Brown, adding the topic prediction to genre and mean content-word syllable count yields $\Delta R^2$ = 0.002, with a confidence interval spanning zero; on the BNC, the corresponding split-half increment is 0.024, positive in four of five K = 100 fits (median 0.021). Because inferred topics may also absorb genre, register, and style, we do not interpret these results as evidence about human readability or causal effects.

19. 【2608.23318】Agent-G$^2$: Gaussian Guidance for Agentic Reinforcement Learning

链接：https://arxiv.org/abs/2608.23318

作者：Zixuan Wang,Yanrui Miao,Zhengxi Lu,Teng Pan,Yiwen Qiu,Hongxing Li,Peng Qiu,Ruiqing Zhang,Yongliang Shen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：reinforcement learning addresses, learning addresses reward, addresses reward sparsity, Hint-based reinforcement learning, long-horizon agentic tasks

备注： Code: [this https URL](https://github.com/ZJU-REAL/Agent-G2) ; Project page: [this https URL](https://zju-real.github.io/Agent-G2)

点击查看摘要

Abstract:Hint-based reinforcement learning addresses reward sparsity in long-horizon agentic tasks by retaining a prefix of an expert trajectory before each rollout, letting the policy explore from a state closer to success. Its effectiveness hinges on the guidance depth: how much of the trajectory to keep. Existing methods treat this depth as a deterministic scalar. Scheduled approaches share one value across samples and ignore per-task heterogeneity; per-sample probing estimates it separately at the cost of extra rollouts. We find that useful guidance occupies a band of depths whose informativeness profile is approximately Gaussian around the band center, rather than concentrating at a single optimal point. We propose Agent-G$^2$, a Gaussian guidance framework that draws the depth per task from a Gaussian whose center and spread are estimated online from rollouts already collected for policy optimization, requiring no probe rollouts or learned depth predictor. The center combines a global baseline with per-cluster difficulty, and the spread tracks within-cluster variance. We evaluate Agent-G$^2$ on ALFWorld and WebShop on Qwen2.5-1.5B / 7B-Instruct. Agent-G$^2$ outperforms the strongest hint-based, hint-free, and Aux-RL baselines on ALFWorld by 2.3 / 3.9 / 7.4 points at under one-third the rollout cost of per-sample probing.

20. 【2608.23311】Beyond the Stability-Exploration Dilemma: Environmental Regularization for LLM Policy Optimization

链接：https://arxiv.org/abs/2608.23311

作者：Xianlei Zhou,Xiangdi Meng,Yu He,Tianyu Qi,Shuyan Guan,Xianli Zhang,Jian Zhang,Xin Li,Qika Lin,Jun Liu

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Language Models faces, Models faces, Large Language, Language Models

备注： Accepted to EMNLP 2026 main conference

点击查看摘要

Abstract:Policy optimization (PO) for Large Language Models faces a stability--exploration trade-off, currently mediated by an action-side Policy-KL regularizer. This puts practitioners in a double bind: keeping Policy-KL constrains response behavior and consumes the action-side exploration budget, while dropping it leaves the optimization without an explicit drift control. We argue for an alternative that breaks the dilemma by moving regularization to the input side. As training progresses, the distribution over training queries induced by the current policy drifts unchecked from its pre-RL reference distribution. Concretely, Environment-Regularized Policy Optimization (ERPO) introduces a Query-KL (QKL) term that bounds this query distribution shift, together with a dataset-static reference-derived per-query weight that biases each per-query update toward queries typical under the reference. The QKL gradient flows strictly through the query likelihood; the response score function used by policy-gradient estimators does not appear in the QKL term, so QKL exerts no direct gradient pressure on the response distribution---exploration is preserved. ERPO plugs into GRPO/PPO/REINFORCE-style pipelines without additional forward passes. On six mathematical reasoning benchmarks, ERPO replaces the standard Policy-KL regularizer while achieving effective control over query distribution drift, delivering stronger accuracy and substantially more stable behavior under high-temperature decoding and long-horizon this http URL source code are available at this https URL

Comments:
Accepted to EMNLP 2026 main conference

Subjects:

Computation and Language (cs.CL)

Cite as:
arXiv:2608.23311 [cs.CL]

(or
arXiv:2608.23311v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.23311

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

21. 【2608.23284】Dynamic Topic Modeling for Cross-Corpus Temporal Analysis

链接：https://arxiv.org/abs/2608.23284

作者：Ruoxuan Li,Bruce Kogut

类目：Computation and Language (cs.CL)

关键词：Dynamic Embedded Topic, temporal semantic evolution, modeling temporal semantic, Embedded Topic Models, Dynamic Embedded

备注： 12 pages, 2 figures. Accepted at CIKM 2026

点击查看摘要

Abstract:Dynamic Embedded Topic Models (D-ETM) provide an interpretable framework for modeling temporal semantic evolution, but cross-corpus comparison remains difficult because topics are often learned independently and aligned only after training, a process that does not guarantee stable topic correspondence across corpora and time. To address this problem, we propose a D-ETM framework that first learns a common dynamic topic space over a merged multi-corpus collection, which we call the shared backbone, then introduces corpus-specific residual adaptation around the frozen backbone without creating separate latent topic spaces. This design preserves a shared topic index for cross-corpus comparison while allowing each corpus to specialize lexically. We evaluate the framework on three temporally structured corpora spanning 97 years: the Corpus of Historical American English, Harvard Business Review, and International Labour Review. Residual adaptation improves corpus-specific fit relative to the shared backbone while preserving the same-index cross-corpus topic trajectories, achieving substantially stronger alignment than full fine-tuning from the same backbone, with $97.5 \pm 0.7\%$ versus $17.9 \pm 1.1\%$ trajectory Retrieval@1, as well as stronger alignment than independent training with post-hoc Hungarian matching. These results suggest that incorporating topic alignment into the model can support more stable over-time cross-corpus comparisons while retaining corpus-specific lexical variation.

22. 【2608.23283】Apodex 1.1: Scaling Agentic Intelligence for Complex Work

链接：https://arxiv.org/abs/2608.23283

作者：Apodex Team:B. An,B. Li,B. Wang,B. Zhang,B.L. Wang,C. Feng,C. Wei,C. Xue,C. Zhang,D. Ng,D. Ye,E. Min,F. Chen,F. Liu,F. Yang,F. Ye,H. Xu,H. Yang,H. Ye,H. Zhang,H. Zhao,J. Li,J. Lin,J. Xia,K. Jin,K. Wang,K. Yang,L. Bing,L. Lei,L. Su,Le. Wang,Lu. Wang,N. Wang,Q. Ren,Q. Yang,R. Li,S. Bai,S. Du,S. Li,S. Lin,S. Nie,S. Wang,S. Zhang,S.Z. Wang,Ta.Q. Fang,Ti.Q. Fang,W. Fang,W. Li,W. Zhang,X. Chen,X. Li,X. Tang,X. Wang,X. Xu,X. Zhang,X.Q. Wang,X.Y. Wang,Y. Deng,Y. Gao,Y. Hu,Y. Li,Y. Sui,Y. Wang,Y. Xiao,Y. Zhang,Z. Chen,Z. Cheng,Z. Feng,Z. Liang,Z. Zhang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：General-purpose language models, requires sustained interaction, General-purpose language, information sources, failure recovery

备注：

点击查看摘要

Abstract:General-purpose language models can reason and synthesize knowledge, but complex work also requires sustained interaction with files, information sources, and executable code, together with state maintenance, failure recovery, and verifiable delivery. We call this \emph{working capability}: sustained, verifiable progress toward a real-world objective. Apodex 1.1 develops this capability along two complementary dimensions. \emph{Environment Scaling} expands the diversity and verifiability of executable file, search, and code environments, while \emph{Agentic Coordination Scaling} trains agents to decompose long-horizon tasks, delegate parallel work, integrate asynchronous results, and replan. A shared execution harness and AgentOS maintain task state and provenance across tools and agents, and training turns environment trajectories and coordination traces into reliable behavior. Across complex professional work, finance, scientific research, mathematics, coding, and search, Apodex 1.1 reaches the leading performance band despite using a substantially smaller model than many frontier systems. The 35B-parameter Apodex 1.1 Mini further retains strong working capability in a locally deployable form. These results ground agentic intelligence in useful, verifiable work completed over time and advance our goal of building a \emph{Heavy-Duty Solver} for ambitious, long-running tasks.

23. 【2608.23271】Expectations and Practices around AI Disclosure in CS Research

链接：https://arxiv.org/abs/2608.23271

作者：Arati Mohapatra,Danish Pruthi

类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

关键词：multiple publishing venues, tools find increasing, ongoing debates, appropriateness and responsible, generative AI tools

备注： Accepted to EMNLP 2026 (Findings)

点击查看摘要

Abstract:As generative AI tools find increasing use in research workflows, ongoing debates on their impact, appropriateness and responsible use have led policymakers to enact policies to disclose AI use at multiple publishing venues. However, are current AI disclosure policies and practices reflective of their purpose? In this work, we first investigate disclosure policies of top computer science venues and find that despite their prevalence, they remain highly under-specified. Secondly, through a survey of computer science researchers (N=$109$), we characterize the necessity of disclosures across different research tasks and levels of human involvement. We learn that researchers find disclosures most necessary for tasks involving research design, and for tasks when the human involvement is low. We also compile expectations that researchers have about the information to be conveyed in AI disclosure statements. Lastly, through an analysis of $13867$ disclosure statements from EMNLP $2025$ and ICLR $2026$, we reveal a large disconnect between these expectations and AI disclosures in practice---a prime example being writing assistance which is deemed less necessary but is frequently disclosed. We conclude with recommendations to align AI disclosure policies and practices with expectations, suggesting a categorization of research tasks by perceived necessity and a boilerplate template capturing expected details.

24. 【2608.23265】EvoWiki: Incremental State Overwriting and Traceable Question Answering for Cross-Meeting Knowledge Evolution

链接：https://arxiv.org/abs/2608.23265

作者：Dongsheng Chen,Tianyu Wang,Wenhui Que

类目：Computation and Language (cs.CL)

关键词：spanning multiple meetings, collaboration spanning multiple, long-term collaboration spanning, multiple meetings, continually revised

备注： 12 pages, 5 figures, 10 tables

点击查看摘要

Abstract:In long-term collaboration spanning multiple meetings, factual states such as decisions and risks are continually revised, overturned, and replaced. Existing long-context methods typically stack the entire history, while many RAG and structured-memory methods organize knowledge as static or append-only facts and rely on semantic relevance at read time. Without explicit modeling of knowledge lifecycles, these approaches may retain conflicting old and new states simultaneously or discard history, leading to stale retrieval and answers that are difficult to verify. We present EvoWiki, an incremental question-answering architecture for dynamic long-form text. EvoWiki decouples offline incremental construction (BUILD) from online structured reading (READ). BUILD captures the intra-meeting micro-evolution from proposal to decision and uses entity version chains and a fine-grained State-Overwrite Protocol to explicitly distinguish current valid states from superseded history while preserving meeting-level provenance anchors. READ bypasses relevance-based Top-k retrieval and performs deterministic entity addressing, temporal resolution, and cross-entity multi-hop aggregation over the complete Wiki to produce grounded and traceable answers. We further introduce CrossMeet, a high-fidelity bilingual benchmark designed to simulate long-term state evolution, covering factual consistency, temporal reasoning, and cross-meeting multi-hop reasoning. Across six datasets and two reader models, EvoWiki improves macro-average Judge Accuracy over the strongest baselines by 9.72 and 10.00 percentage points, respectively. Human evaluation shows that EvoWiki is more robust and factually faithful under frequent state flips, validating valid-state-oriented reading as a reliable approach to cross-meeting knowledge evolution.

25. 【2608.23264】Hidden in the Request: Explaining Unethical LLM Compliance through Token Relevance

链接：https://arxiv.org/abs/2608.23264

作者：Or Biton,Tomer Krichli,Itai Allouche,Joseph Keshet

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, helpfulness and harmlessness, inevitably leading, Language Models

备注：

点击查看摘要

Abstract:Although Large Language Models (LLMs) are aligned to optimize for both helpfulness and harmlessness, these dual objectives may conflict, inevitably leading to alignment failures. This work systematically investigates instances where LLMs fail to exhibit ethical behavior. To understand the underlying mechanics of these vulnerabilities, we introduce a probing methodology that presents unethical scenarios to LLMs in three distinct structural modalities: objective classification tasks, subjective first-person statements, and direct requests for assistance. We find that model performance degrades in the request-for-assistance-based form. Using Layer-wise Relevance Propagation (LRP), we trace this discrepancy to an attribution bias: the model places greater emphasis on benign task-framing tokens (e.g., "Can you help me...") than on tokens signaling the underlying unethical behavior (e.g., "without getting caught"), which we term cue-tokens. We hypothesize that this under-attribution contributes to harmful compliance. To test this, we introduce two LRP-guided decoding methods that steer generation toward trajectories more relevant to cue tokens. Empirical evaluations show that these interventions promote safer responses, supporting cue-token attribution's role in compliance failures.

26. 【2608.23263】Automated Construction of FAIR Digital Object Knowledge Graphs from Flat Cultural Heritage Records

链接：https://arxiv.org/abs/2608.23263

作者：Zeyd Boukhers,Lingxiao Kong,Xenophon Zabulis,Georgios Toubekis

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Digital Libraries (cs.DL)

关键词：FAIR Digital Object, Digital Object, FAIR Digital, fully machine-actionable graph, framework mandates

备注： Accepted for publication as a short paper at CIKM 2026 (The 35th ACM International Conference on Information and Knowledge Management)

点击查看摘要

Abstract:The FAIR Digital Object (FDO) framework mandates that metadata attribute values be expressed as persistent identifiers (PIDs) wherever possible, to produce a fully machine-actionable graph in which every reference is resolvable. The Europeana Data Model was designed long before the FDO specification, and it stores most metadata values as plain text. This serves human browsing well enough, but gives an automated agent nothing to follow across records or collections. We present a pipeline that transforms flat Europeana records into an FDO-compliant knowledge graph structured with CIDOC-CRM. Following the FDO specification, we model every heritage entity as a discrete FDO with its own PID, type, profile, and metadata layer. The core technical challenge is automating the FDO-prescribed distinction between values that must become PID references (resolvable entities) and those that may remain literals (terminal leaves such as notes, measurements, and dates). We address this with a large language model that classifies each metadata value, routes it to a controlled vocabulary (Getty AAT, Wikidata, VIAF, PeriodO), and links it to a shared entity FDO. We evaluate using 637 archaeological records from five Europeana providers, processing each with the LLM. The pipeline links 86% of metadata slots, resolving 58.5% of values Europeana had not already enriched. It also merges cross-lingual surface forms that byte-identical matching keeps apart, where 17 of 33 such merges are correct on manual review. Graph connectivity does not separate this from string matching; what distinguishes the FDO graph is that every node is typed and resolvable.

27. 【2608.23261】A Scalable Cross-Domain Event Extraction System via a Unified Generative Training Framework

链接：https://arxiv.org/abs/2608.23261

作者：Siting Liang,Omar Adjali,Omair Shahzad Bhatti,Daniel Sonntag

类目：Computation and Language (cs.CL)

关键词：fundamental to information, Event extraction, extraction, Event, information extraction

备注：

点击查看摘要

Abstract:Event extraction is fundamental to information extraction. Prior approaches often separate event detection and argument extraction or depend on dataset-specific designs, limiting scalability and cross-domain generalization. We propose a unified generative sequence-to-sequence framework that performs event extraction subtasks jointly and supports both pipeline and end-to-end configurations. We fine-tune pretrained language models on multiple event datasets across diverse domains, enabling a single model to retain domain-specific semantics while generalizing over large and evolving label spaces. We demonstrate these capabilities through a web-based application tailored for researchers and practitioners. The platform supports document upload, schema-aware event extraction, visualization of triggers and arguments, and comparison of different extraction configurations across domains.

28. 【2608.23252】he Laws of Context Allocation: Causal Measurement and Closed-Loop Orchestration in Generative Search

链接：https://arxiv.org/abs/2608.23252

作者：Peiyang Liu,Xi Wang,Di Liang,Wei Ye

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：suboptimal context budget, shifts toward diverse, critical bottlenecks, context budget allocation, diverse portfolio generation

备注：

点击查看摘要

Abstract:As Retrieval-Augmented Generation (RAG) shifts toward diverse portfolio generation, it is stymied by two critical bottlenecks: flawed measurement of evidence utilization, and suboptimal context budget allocation. We resolve both sequentially. To resolve measurement, we expose a pervasive ``diagnostic illusion'': standard relevance proxies fail catastrophically on hard negatives. We replace them with an efficient causal leave-one-out probe that accurately isolates generative reliance and formally calibrates the structural dilution of LLM attention. To resolve allocation, we deploy this causal probe in a deconfounded factorial grid. We prove that the prevailing strategy of monolithic context widening is an architectural trap penalized by relevance decay. Instead, allocating compute iteratively across multiple sequential generations drives transformative portfolio recall gains of 16.7--20.5 absolute percentage points, scaling robustly up to 32B models. Finally, we unify these solutions into a deployable closed-loop submodular scheduler. Augmented by an attribution-steered contrastive decoder to override LLM attention inertia, our architecture systematically forces fresh evidence integration. By dominating classical open-loop baselines, we establish sequential, feedback-driven orchestration as the definitive paradigm for generative search. Our code, data, and causal measurement instruments are available at this https URL.

Subjects:

Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

Cite as:
arXiv:2608.23252 [cs.LG]

(or
arXiv:2608.23252v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2608.23252

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Peiyang Liu [view email] [v1]
Mon, 24 Aug 2026 13:44:11 UTC (1,876 KB)

29. 【2608.23248】Future Querying: Can LLMs Serve as Implicit Medical World Models?

链接：https://arxiv.org/abs/2608.23248

作者：Siri Willems,James Butterworth,Lore Goetschalckx,Peter Vrancx,Philippe Modard,Elke Giets,Ludovic Denoyer

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Traditional clinical prediction, underutilize unstructured text, structured data, prediction models rely, Traditional clinical

备注： This paper is accepted at The 1st MICCAI Workshop on Medical World Models (MICCAI-2026)

点击查看摘要

Abstract:Traditional clinical prediction models rely on task-specific pipelines and curated, structured data, which scale poorly and underutilize unstructured text. To address this, we introduce future querying, a paradigm that probes whether large language models (LLMs) can function as implicit medical world models by evaluating their ability to answer time-indexed clinical queries about a patient's future. Our framework operates on unstructured clinical documentation using endpoint-agnostic training, enabling a single model to answer diverse clinical queries over patient trajectories without manual feature engineering or task-specific retraining. We show that small, locally fine-tuned open-weight models can match or approach larger proprietary systems, making the framework suitable for privacy-preserving, on-premise deployment. Evaluated on a new synthetic medical reports dataset and real ICU notes from the MIMIC-IV dataset, our results provide encouraging evidence that LLMs can capture aspects of clinical dynamics.

30. 【2608.23244】Credal Large Language Models for Semantic Commitment under Uncertainty

链接：https://arxiv.org/abs/2608.23244

作者：Shireen Kudukkil Manchingal,Sofiia Nikolenko,Fabio Cuzzolin

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Machine Learning (stat.ML)

关键词：Large language models, Credal Large Language, Large language, language models, produce fluent

备注： 31 pages, 5 figures, 13 tables

点击查看摘要

Abstract:Large language models (LLMs) often produce fluent but incorrect answers with unwarranted confidence. A central limitation is that standard LLMs represent uncertainty through a single predictive distribution, conflating epistemic ignorance with genuine ambiguity. We introduce Credal Large Language Models (CLLMs): an ensemble of LoRA adapters induces a credal set whose lower and upper probabilities expose the spread of plausible predictive distributions rather than collapsing to a single softmax output. From this representation we derive two complementary commitment scores. Credal Token Commitment (CTC) is a token-space score that combines lower-bound support, credal width, and intersection entropy, computed without additional generation. Semantic Commitment Consistency (SCC) extends commitment to semantic space using sampled completions, with SCC-Gap measuring the mismatch between token-level and semantic-level support. We evaluate hallucination detection, calibration, selective prediction, and reasoning on Gemma-2-9B, Llama-3.1-8B, and Qwen2.5-7B across OpenBookQA, CoQA, TriviaQA, and ARC-Challenge. CLLM is the best method on QA accuracy at competitive expected calibration error, and CTC tracks the best hallucination AUROC within 1.5 pp on most settings without additional generation. On selective prediction at 80% coverage, CLLM with SCC reaches 99.0% accuracy on OpenBookQA, and on ARC-Challenge CLLM with Csem confidence achieves = 0.6% ECE across the three backbones.

31. 【2608.23235】A Multi-Domain and Multi-Task Generative Framework with Explicit Task and Domain Conditioning for Cross-Domain Event Extraction

链接：https://arxiv.org/abs/2608.23235

作者：Siting Liang,Omar Adjali,Daniel Sonntag

类目：Computation and Language (cs.CL)

关键词：classify event types, identify event triggers, structured event representations, construct structured event, aims to identify

备注：

点击查看摘要

Abstract:Event extraction aims to identify event triggers, classify event types, and extract arguments to construct structured event representations. Despite strong in-domain performance, developing models that generalize robustly across domains remains challenging due to variations in contextual expressions and event schemas. Prior unified and multi-task approaches improve in-domain accuracy but exhibit limited flexibility when applied to unseen domains. Even large language model-based methods that provide full event ontologies at inference time often underperform compared to smaller, task-specific fine-tuned models. We propose a unified multi-domain and multi-task training framework that models heterogeneous event schemas within a single model. Our approach introduces domain conditioning signals, jointly with task-specific prompts, enabling dynamic adaptation to dataset-specific schemas without requiring complete event label sets at inference time. The framework supports both pipeline and end-to-end extraction settings, facilitating efficient task- and domain-level transfer. Experiments on diverse event extraction benchmarks demonstrate that our method achieves competitive performance, strong cross-domain generalization, and practical scalability, while preserving domain-specific precision.

32. 【2608.23214】Aligning Biomedical Texts and Knowledge Graphs: A Systematic Comparison of Lightweight Alignment Strategies

链接：https://arxiv.org/abs/2608.23214

作者：Artem Bisliouk,Elizaveta Nosova,Heiko Paulheim,Andreea Iana,Rita T. Sousa

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：unstructured scientific literature, structured knowledge graphs, Biomedical knowledge exists, distinct forms, unstructured scientific

备注： Accepted at the Third Workshop on Knowledge Graphs and Neurosymbolic AI (KG-NeSy 2026) co-located with ISWC 2026

点击查看摘要

Abstract:Biomedical knowledge exists in two complementary but distinct forms: unstructured scientific literature and structured knowledge graphs (KGs). Aligning them is essential for knowledge grounding, evidence retrieval, and KG completion, yet existing methods do not explicitly align free-text evidence with KG triples. We present a unified framework for systematically studying design choices for aligning biomedical text and KGs. With a text encoder and a KG embedding model both frozen, we learn only a lightweight projection between their spaces via a contrastive objective. This enables a fair comparison across six design dimensions: text encoder, KG embedding model, projection head, triple composition, training direction, and hard-negatives sampling. We construct CTD-Align, a corpus of over 22K one-to-one tripledocument pairs linking chemical-gene interactions from the Comparative Toxicogenomics Database to supporting PubMed passages. We evaluate alignment on it in two retrieval settings: document-to-triple and triple-to-document. We find that the triple composition and the training direction (i.e., shared retrieval space) have the greatest impact, whereas the text encoder and hard-negatives sampling matter little. Overall, simple choices win: projecting text into the KG space with a linear head over concatenated subject, predicate, and object embeddings performs best. These findings establish lightweight contrastive alignment as an effective, practical foundation for bridging biomedical text and KGs.

33. 【2608.23205】Cognitive Profiling of LRMs' Reasoning Traces Using Bloom's Taxonomy

链接：https://arxiv.org/abs/2608.23205

作者：Maria-Eleni Zoumpoulidi,Georgios Paraskevopoulos,Alexandros Potamianos

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large Reasoning Models, increasing public availability, creates valuable opportunities, study model behavior, traces creates valuable

备注：

点击查看摘要

Abstract:Large Reasoning Models (LRMs) have revolutionized reasoning in LLMs, and the increasing public availability of reasoning traces creates valuable opportunities to study model behavior not only at the surface level but also at the granularity of individual reasoning steps. However, understanding the types of thinking employed during reasoning - which offers critical insights into models' reasoning patterns and enables actionable applications - remains underexplored. To address this gap, we introduce a framework for automatic annotation of reasoning steps through the lens of Bloom's Taxonomy, which classifies thinking into six cognitive levels, such as Remembering, Applying and Evaluating. Using this framework, we perform a large-scale analysis across models and datasets, revealing both similarities and differences in thinking patterns across models and tasks. Moreover, we demonstrate that thinking-type information derived from reasoning traces correlates with correctness, paving the way for improved reasoning. Our findings establish a fine-grained framework for analyzing thinking patterns in LRMs and provide actionable insights for enhancing reasoning quality.

34. 【2608.23200】LongWoF-Bench: Evaluating EvoMap Genes for Verifiable Long-Workflow Tasks

链接：https://arxiv.org/abs/2608.23200

作者：Xiao Zhang,Qumeng Sun,Jihao Li,Yiming Ren,Xiang Liu,Haoyang Zhang,Junjie Wang

类目：Computation and Language (cs.CL)

关键词：Large language models, execute complex workflows, maintaining interdependent constraints, Large language, satisfy strict

备注：

点击查看摘要

Abstract:Large language models are increasingly expected to execute complex workflows whose success depends on maintaining interdependent constraints and producing artifacts that satisfy strict end-to-end verification. Yet successful execution experience is typically lost after a single run, forcing subsequent models to rediscover strategies and failure modes from scratch. We study whether such experience can instead be externalized and reused through EvoMap, where verifier-confirmed execution trajectories are consolidated into structured Gene. To evaluate this setting, we introduce the Long-Workflow Benchmark (LongWoF-Bench), comprising 778 machine-verifiable tasks across code generation, agent-environment synthesis, mathematical reasoning, and rule following. On the 252 tasks with verifier-confirmed Opus trajectories, evolved EvoMap Gene outperform Skill across all seven evaluated models by 8.7-15.5 percentage points, with the gains extending to consumer models from different model families. In contrast, reference-distilled Gene do not exhibit the same advantage, indicating that compact representation alone is insufficient and that Gene utility is closely associated with verified experience provenance. For Claude Opus, Gene reuse also completes 39 more tasks than Skill while reducing solve-time token consumption by 9.9%. Together, these results show that verified execution experience can be retained and shared as a reusable external resource, enabling models to improve long-workflow completion without repeatedly paying the full cost of experience discovery.

35. 【2608.23181】CyberFactory: Scaling Cyber Security Capabilities with Instances from the Wild

链接：https://arxiv.org/abs/2608.23181

作者：Jian Yang,Haau-Sing Li,Shawn Guo,Zixi Zhao,Yibo Tan,Jiajun Wu,Aishan Liu,Xianglong Liu,Tianyu Zheng,Bryan Dai,Chengran Yang

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词：increasing research attention, drawn increasing research, advanced cybersecurity capabilities, delivering advanced cybersecurity, large language models

备注：

点击查看摘要

Abstract:As large language models (LLMs) continue to advance in coding capabilities, their potential in cybersecurity has drawn increasing research attention, with closed-source LLMs (e.g., Mythos) delivering advanced cybersecurity capabilities. However, existing open-source efforts remain limited: frontier open-weight models do not provide reproducible cybersecurity training solutions, open-source training solutions focus on isolated tasks and lack scalable agentic data, and scaling agentic rollouts requires strong domain priors. In this work, we introduce \textbf{CyberFactory}, a unified open-source framework that connects data construction, trajectory synthesis, and model training across proof-of-concept (PoC) generation, vulnerability patching, and cybersecurity question answering (CyberQA). CyberFactory transforms public vulnerability artifacts, including CVEs from the wild, into executable and verifiable task instances. It further uses a reusable vulnerability-analysis skill to guide the teacher through source inspection, problem solving with domain prior, and evidence-based validation. The resulting supervision is agentic: the model interacts with tools and target environments and revises its solutions according to execution feedback. Using these trajectories, we train and release \modelname\footnote{\emph{Aegis} is, in Greek mythology, the protective shield of Zeus and Athena; the name reflects the model's defensive, security-oriented purpose.}, which internalizes the skill-guided procedure without requiring the skill at inference time. On CyberGym, \modelname reaches 52.4% Pass@1 under a one-hour budget, improving over its Qwen~3.5 base model by +22.8 points and outperforming the evaluated general-purpose backbones under the same scaffold.

36. 【2608.23172】CaRGo-T: Causal Reasoning Graph-of-Thought improves Multimodal Humor Comprehension

链接：https://arxiv.org/abs/2608.23172

作者：Abhilash Nandy,Rahul Seetharaman,Aman Bansal,Rounak Saha,Manav Nitin Kapadnis,Millon Madhur Das,Pawan Goyal,Niloy Ganguly

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Large-scale vision-language models, demonstrated remarkable versatility, Large-scale vision-language, vision-language models, demonstrated remarkable

备注： 18 pages, 5 figures

点击查看摘要

Abstract:Large-scale vision-language models (VLMs) have demonstrated remarkable versatility across a wide range of multimodal tasks. However, understanding humor remains challenging because humorous content often depends on subtle interactions among entities, events, context, and implicit relationships across image and text modalities. These interactions can involve complex chains of reasoning that are difficult to capture through conventional prompting or linear chain-of-thought reasoning. In this work, we propose CaRGo-T (Causal Reasoning Graph-of-Thought), a reasoning framework that represents the causal and contextual relationships underlying multimodal humor as a lightweight graph-based reasoning structure. The graph is serialized into a code-based representation generated by a VLM, which can subsequently be interpreted by the same or a different VLM to produce the final prediction in zero-shot or in-context learning settings. We evaluate CaRGo-T on humor understanding and humor detection across four datasets spanning diverse forms of comedic content, including satire, sarcasm, and memes. Experiments with state-of-the-art commercial and open-source VLMs show that CaRGo-T consistently improves performance over existing reasoning-based baselines, achieving gains of approximately 1-20% on humor understanding and 1-3% on humor detection. Further analysis using mutual information indicates that the reasoning representations produced by CaRGo-T contain more information relevant to the target output than those generated by baseline reasoning approaches. Code is available at this https URL.

37. 【2608.23167】Accelerating Diffusion Language Models via Structured Suffix Modeling

链接：https://arxiv.org/abs/2608.23167

作者：Zifeng Cheng,Keda Li,Zhiwei Jiang,Cong Wang,Fei Shen,Qing Gu

类目：Computation and Language (cs.CL)

关键词：Diffusion Language Models, Diffusion Language, Language Models, exhibit strong parallel, exhibit strong

备注：

点击查看摘要

Abstract:Diffusion Language Models (DLMs) exhibit strong parallel decoding capabilities by denoising multiple tokens in a single generation step. However, this parallelism comes with substantial computational overhead, as each step requires interactions with all suffix tokens. Existing methods typically reduce this cost by retaining only a local suffix window as a substitute for the full suffix. Despite their effectiveness, these methods overlook the structural heterogeneity across suffix regions and re-initialize suffix tokens with identical representations at each timestep. To this end, we propose a structured suffix modeling method for efficient DLM inference. Specifically, we divide the suffix into three regions, i.e., the local, middle, and tail regions, and retain different numbers of suffix tokens in each region according to their structural roles. Moreover, we incorporate the decoding results from the previous step into the suffix token representations at the current step, allowing them to carry evolving denoising information across generation steps. Notably, our method is training-free and orthogonal to several existing acceleration techniques, such as parallel decoding strategies and KV cache. Empirical results across multiple benchmarks on three DLMs demonstrate that our method can further accelerate DLM inference and improve performance in most cases. In particular, in long-sequence inference, our method achieves up to a $72.81\times$ speedup when combined with other acceleration techniques. Our code is available at this https URL.

38. 【2608.23152】Counter with Evidence! A Multi-Agent Memory Efficient Reasoning Framework for Hate Category Informed Counterspeech Generation

链接：https://arxiv.org/abs/2608.23152

作者：Sujoy Nath,Aswini Kumar,Tanmoy Chakraborty

类目：Computation and Language (cs.CL)

关键词：Counterspeech effectively neutralizes, effectively neutralizes, neutralizes the impact, impact of online, hate speech

备注：

点击查看摘要

Abstract:Counterspeech effectively neutralizes the impact of online hate. Although prior work explores automated counterspeech generation, it largely emphasizes stylistic control while treating hate speech as homogeneous, overlooking that distinct forms of abuse require fundamentally different counterspeech strategies. To address this gap, we introduce FIRE (Factuality Informed Multi-Agent Reasoning Framework) that first decomposes hate speech into one of the five distinct categories (misinformation, stereotype, conspiracy, dehumanizing, non-factual), and then maps it to a targeted counterspeech style. To facilitate FIRE, we curate FactualCS, a novel dataset of $4,784$ instances that provides the annotations regarding hate categories, reasoning traces, and evidence mappings, which are critical elements for grounded generation that are missing in prior work. A comprehensive evaluation across $28$ baseline configurations demonstrates that FIRE significantly surpasses existing methods, despite using compact agents ($$2B). FIRE achieves a $\sim$ $12 \%$ and $\sim$ $11 \%$ improvements in factual and category-specific accuracy respectively, while simultaneously reducing toxicity by $\sim$ $11 \%$ relative to the strongest baselines. Further human evaluation confirms that responses generated by FIRE are significantly preferred over the strongest baselines, underscoring its effectiveness for real-world deployment. These findings show that decomposing the underlying intent of hate speech is essential for generating safe, effective, and contextually precise counterspeech.

39. 【2608.23149】Language Chain in Alignment: Cross-Lingual Ranking Preference Optimization

链接：https://arxiv.org/abs/2608.23149

作者：Seungyoon Lee,Minhyuk Kim,Jungseob Lee,Heuiseok Lim

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Large Language Models, Models heavily relies, Language Models heavily, English-centric high-quality preference, Models heavily

备注： EMNLP 2026 Main

点击查看摘要

Abstract:The alignment of Large Language Models heavily relies on English-centric high-quality preference data, which often leads to suboptimal performance in other languages. In this paper, we propose Cross-Lingual Ranking Preference Optimization (CRPO), a novel framework that leverages robust preference knowledge from English to facilitate preference alignment in the target language. We design a hierarchical structure within parallel preference pairs across the target language and English to jointly optimize intra- and inter-lingual preferences, thereby enhancing language adaptation and output quality. Building on the LambdaLoss framework, CRPO goes beyond the binary comparison based optimization by providing a relative ranking signal across multiple candidate responses. Our experiments across five languages with varying resource scales demonstrate that CRPO consistently outperforms standard approaches in both instruction-following and knowledge utilization capability. Notably, the robust performance gains observed across various weighting schemes further validate the empirical effectiveness of our hierarchical design in a multilingual setup. Furthermore, our findings highlight that CRPO significantly improves both reward margins and the log-probability of desirable responses, contributing to a more stable preference manifold for cross-lingual alignment.

40. 【2608.23144】Activation-Weighted Seeded Residual Coding for Low-Bit LLM Weight Repair

链接：https://arxiv.org/abs/2608.23144

作者：Zehao Liu,Chuangchuang Fang,Yang Ren

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：quantization saves storage, Seeded Residual Coding, degrade language-model quality, saves storage, storage but leaves

备注： 5 pages, 2 figures

点击查看摘要

Abstract:Low-bit weight quantization saves storage but leaves errors that degrade language-model quality. We introduce Activation-Weighted Seeded Residual Coding (AWSRC), a compact repair codec for an existing quantization backbone. Given a reconstructed weight $W_0$, AWSRC encodes the residual $W-W_0$ using deterministic seed-generated bases. The sidecar stores seed selectors, low-bit coefficients, and scales rather than an explicit codebook. Activation statistics prioritize errors that affect layer outputs. On Qwen2.5-3B-Instruct, adding 0.162 scope-bits/weight to an INT4 RTN backbone closes 88.2%, 78.9%, and 71.3% of the matched PPL, KL, and accuracy gaps to BF16. Repairing a matched strong low-bit backbone also improves all measured quality metrics. With a matched 49.25 MB sidecar, about 0.8% of the BF16 model-weight payload, AWSRC gives the best perplexity and mean task accuracy among sparse, low-rank, and vector-quantized codecs.

41. 【2608.23124】LITERARYBIGFIVE: Author-Personalized Text Generation in a Unified Interpretable Space

链接：https://arxiv.org/abs/2608.23124

作者：Jinghui Zhang,Lang Gao,Ao Li,Mingzhe Li,Ruihong Zeng,Zirui Song,Kentaro Inui,Xiuying Chen

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：creative support tools, adaptive writing assistants, computational literary analysis, Personalized text generation, Personalized text

备注： EMNLP 2026 Findings

点击查看摘要

Abstract:Personalized text generation for authors and literary writing is essential for applications such as adaptive writing assistants, creative support tools, and computational literary analysis. However, existing approaches to author modeling and personalization often represent writing behavior as independent labels, requiring large-scale corpus collection or fine-tuning for each author or stylistic category. Such formulations are costly, difficult to interpret, and poorly suited for generalizing across authors. Inspired by the Big Five model's dimensional view of personality, we propose LiteraryBigFive, a framework that reframes authorial writing characteristics as coordinates within a unified and interpretable space. In this space, we derive each interpretable axis (e.g., Classicism, Emotionality) from activation-space contrasts between author-written and neutral passages, yielding distinct stylistic dimensions that allow texts or authors to be positioned within a five-dimensional system. Beyond localizing different authors, we further introduce an interpretable steering mechanism, which adaptively guides text generation toward target coordinates to perform author-personalized writing. Experimental results show that LiteraryBigFive improves authorial expressiveness while preserving semantic fidelity. The derived author per-axis scores strongly correlate with real-world literary consensus, offering transparent and interpretable explanations of author-specific generation behavior: this https URL.

42. 【2608.23120】Statistical Machine Translation Systems of English-Pnar Language Pair : Some Insights of the Emperical Study

链接：https://arxiv.org/abs/2608.23120

作者：Edawanbiang Dhar Surmila Thokchom,Thoudam Doren Singh

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Hills of Meghalaya, Austroasiatic language spoken, Jaintia Hills, natural language processing, Pnar language pair

备注：

点击查看摘要

Abstract:Pnar, an Austroasiatic language spoken by approximately 0.4 million people in the Jaintia Hills of Meghalaya, lacks the digital corpora and natural language processing (NLP) resources. This paper presents the first machine translation study for the English and Pnar language pair. Using articles collected from the Wyrta newspaper, we built a parallel corpus comprising of 10,234 sentences and trained phrase-based statistical machine translation (SMT) systems the models using 9,563 parallel corpora under three configurations for each direction using Moses, GIZA++ , KenLM, varying lexicalized reordering and minimum error rate training (MERT) tuning. The models are evaluated on a held out test set of 371 sentences, the best performing system achieves a BLEU score of 14.97 (chrF2: 33.42, TER: 77.60) for Pnar to English and 11.16 (chrF2: 31.38, TER: 93.51) for English to Pnar, establishing the first quantitative benchmark for this language pair. Lexicalized reordering improves translation quality by 3.73 BLEU points for Pnar to English, reflecting the structural shift from the source language's SOV word order to the target language's SVO order, whereas MERT tuning degrades BLEU performance under low resource conditions. Finally, we analyze the remaining translation errors, including morphological out of vocabulary (OOV) words, long-distance reordering and Khasi code mixing and discuss future directions toward neural and multilingual machine translation for Pnar.

43. 【2608.23104】Molecular LLM Agents: From Architectural Design to Scientific Autonomy

链接：https://arxiv.org/abs/2608.23104

作者：Jiatong Li,Wengyu Zhang,Weida Wang,Yuxuan Ren,Wei Liu,Chenyang Mao,Yuqiang Li,Yatao Bian,Changmeng Zheng,Xiaoyong Wei,Qing Li

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：molecular LLM agents, Molecular science represents, molecular LLM, LLM agents, science represents

备注： 25pages

点击查看摘要

Abstract:Molecular science represents an important frontier for LLM-based agents. Unlike general agents that mainly operate over natural language, code, or web environments, molecular LLM agents must perceive, reason about, and act upon chemical objects across symbolic strings, molecular graphs, 3D conformations, spectra, simulations, and wet-lab measurements. Their capabilities depend on chemically faithful molecular perception, an LLM-centered agent framework, domain-specific tool grounding, and computational or experimental feedback, in addition to planning and tool use. This work develops a conceptual framework for molecular LLM agents from two complementary perspectives. First, we introduce an architectural view of molecular-agent design, covering molecular representation and perception, the agent framework, domain-specific toolboxes, and learning and optimization. Second, we propose a scientific autonomy ladder inspired by staged autonomy in engineering systems, categorizing agents into four levels: L1 assistive or fixed workflows, L2 adaptive computational agents, L3 feedback-aware physical experiment agents, and L4 scientific-agenda agents. Together, these two perspectives establish a comprehensive framework for comparing existing molecular LLM agents, identifying missing capabilities and deployment risks, and guiding the design, evaluation, and deployment of future agents in molecular discovery workflows.

44. 【2608.23095】Definitional Sensitivity in Media Bias Detection: A Multi-Definition Dataset and Benchmark

链接：https://arxiv.org/abs/2608.23095

作者：Martin Wessel,Timo Spinde,Jürgen Pfeffer,Gianluca Demartini

类目：Computation and Language (cs.CL)

关键词：remain implicit, bias detection relies, bias, Media bias detection, detection relies

备注： To appear in Findings of the Association for Computational Linguistics: EMNLP 2026

点击查看摘要

Abstract:Media bias detection relies on definitions and examples that specify what counts as bias, yet these specifications often vary across datasets or remain implicit, even when given the same name. Such variation makes it unclear whether models trained for the same bias category learn the same construct or different phenomena, a problem largely overlooked in prior work. We examine how definition choice affects bias annotation in a between-subjects experiment with 354 participants and a parallel evaluation with four LLMs. Participants and models rate six news articles across four bias categories using definitions that vary in conceptual framing and elaboration. Across 8,496 human and 28,800 LLM ratings, we find that the conceptual target of a definition drives annotation divergence, while construct-preserving elaboration does not: conceptual framing significantly shifts annotations for humans and does so even more strongly for LLMs. We discuss implications for construct specification in annotation protocols and prompt-based measurement, and consider how definitional sensitivity may propagate to downstream classification beyond media bias. We also release MUDD, the Multi-Definition Bias Detection Dataset.

45. 【2608.23078】AgentWeave: Routing Before Reasoning for Efficient Function Calling in Tool-Rich Language Models

链接：https://arxiv.org/abs/2608.23078

作者：Saurav Singla,Aarav Singla,Advik Gupta,Parnika Gupta

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large language models, Large language, large collections, language models increasingly, models increasingly operate

备注： 12 pages, 2 figures, 6 tables. Open-source implementation and reproducibility artifacts available in the AgentWeave repository

点击查看摘要

Abstract:Large language models increasingly operate over large collections of tools, functions, APIs, and specialized agents. As the candidate action space grows, a function-calling model must process more schemas, consume more prompt tokens, and distinguish among increasingly similar or irrelevant alternatives. We study a complementary systems strategy: reduce the candidate set before language-model inference while leaving the downstream model unchanged. We introduce AgentWeave, a deterministic pre-inference routing layer that constructs a bounded model-visible action space using eligibility, requirement, capability, and routing signals. We evaluate AgentWeave with a frozen BFCL-derived routing-pressure protocol using the public MadeAgents/Hammer2.1-1.5b model. On 48 fresh BFCL V4 multiple-function tasks, AgentWeave achieves 6/48 (12.5%) native BFCL successes, whereas all-tools, deterministic random top-8, and semantic top-8 baselines each achieve 0/48. The paired success difference is +12.5 percentage points with a 10,000-resample paired bootstrap 95% confidence interval of +4.17 to +22.92 points and exact McNemar p=0.03125. Relative to all-tools exposure, AgentWeave presents 70.18% fewer tools, uses 61.70% fewer input tokens, and exhibits 50.95% lower mean local-model latency. The result is deliberately narrow: this is a BFCL-derived routing-pressure study rather than an official full BFCL leaderboard score, and absolute task success remains low. The evidence nevertheless shows that candidate-space construction can materially affect a fixed model's function-calling behavior and motivates evaluating routing as a distinct stage before model reasoning.

46. 【2608.23067】Signal or Noise? A Benchmark Study of Agent Skills in Web Development

链接：https://arxiv.org/abs/2608.23067

作者：Ziyue Yang,Fan Ding

类目：Computation and Language (cs.CL)

关键词：reusable procedural modules, encode framework conventions, reusable tools, Skill, reusable procedural

备注：

点击查看摘要

Abstract:Agent Skills are reusable procedural modules that are increasingly injected into coding-agent sessions to encode framework conventions, anti-patterns, and reusable tools. However, because each injected Skill expands the prompt of every query, an effective Skill benchmark must determine not only whether an agent can solve a task, but whether the Skill should have been injected at all. We introduce WebDev-Skills-Bench and use it for a controlled empirical study of 31 public WebDev Skills on 50 Web-Bench projects and 1,000 ordered tasks. The benchmark compares four matched conditions, including a length-matched irrelevant control and leave-one-out component ablations. To isolate Skill effects from prompt-length artifacts, we place only this http URL in the prompt while mounting auxiliary files into the agent workspace. Across four models, target Skill injection reduces mean Pass@2 by 1.3% to 4.2%, lowers task completion depth, and increases token cost by 72% to 394%, with gains in only 17% to 36% of Skill-project pairs. Length-matched controls reveal two failure modes: some models are length-distracted, where an equally long irrelevant Skill reproduces most of the loss, while others are content-misled, where prompt length is neutral but Skill content still lowers Pass@2 by 1.1% to 1.4%. Further analysis shows that losses concentrate on easy early tasks, Skill rankings transfer weakly across models, and anti-pattern rules outperform example-heavy content within helpful Skills. These findings recast a matched Skill as a hypothesis about a particular Skill-project-model triple rather than a portable asset, reframing injection as a per-deployment routing decision and making length-matched controls and per-model audits a minimum standard for Agent-Skill evaluation.

47. 【2608.23065】Cultural Moment Benchmark: Evaluating Video Cultural Reasoning and Grounding in Southeast Asia

链接：https://arxiv.org/abs/2608.23065

作者：Burak Satar,Zhixin Ma,Cheng Yu-Tong,Huy Hoang Tran,Phuong Anh Nguyen,Chong-Wah Ngo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Multimedia (cs.MM)

关键词：grasping the symbolic, symbolic and temporal, temporal significance, video, Cultural understanding

备注： Accepted to EMNLP 2026 Main Conference, [this https URL](https://culturalmoment-benchmark.github.io/)

点击查看摘要

Abstract:Cultural understanding in video means more than recognizing what is visible; it requires grasping the symbolic and temporal significance of cultural concepts. We decompose this into three abilities: naming what a concept symbolizes, visually recognizing it on video, and locating its sub-events in time. Existing video-cultural benchmarks tend to test what is seen, collapsing these three abilities into a single score that hides the bottleneck. We introduce the Cultural Moment Benchmark (CMB): 306 expert-curated concepts from seven countries in Southeast Asia across five categories. We evaluate each concept through three stages, one per ability. Given a description, Stage 1 (S1) selects from four candidate concept names, Stage 2 (S2) selects from four candidate video moments, and Stage 3 (S3) predicts the start and end times of the moment in a video. To keep each stage focused on a distinct ability, we use three design choices: semantic-similarity distractors (S1, S2), unlabeled video moments (S2), and free-form localization on a different example video (S3). Across six vision-language models, failure modes vary by ability and modality. i) Even the strongest closed-source models score below 30% when all three stages must be correct; ii) The three abilities do not fully cascade: naming a concept correctly helps half the models recognize it on video, but recognizing it has little effect on locating the sub-event in time; iii) Audio is complementary, redundant, or distracting depending on the concept, more often distracting in non-Latin-script countries; removing both audio and subtitles hurts Games and Music the most. Our 14-rater human study shows that even Expert raters score below chance on concepts from a neighboring country, indicating that CMB requires country-specific cultural knowledge. CMB acts as a diagnostic harness, attributing failures to a specific ability or modality.

48. 【2608.23047】Beyond Verdicts: A Graph-Based Analysis of Human and LLM Reasoning in Scientific Fact-Checking

链接：https://arxiv.org/abs/2608.23047

作者：Abdul Ghafoor,Muhammad Arslan Manzoor,Yufang Hou

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：cites legitimate papers, studies actually report, cites legitimate, legitimate papers, LLM reasoning paths

备注：

点击查看摘要

Abstract:Misinformation that cites legitimate papers can be especially harmful when it distorts what those studies actually report. While existing automatic fact-checking systems based on large language models (LLMs) can assess whether a model assigns an Incorrect verdict and can gen- erate explanations for that decision, they typi- cally do not indicate whether the model follows the same reasoning path as human experts or arrives at the verdict through a different but still valid path. In this work, we introduce a graph- based framework (typed reasoning graph) for comparing human and LLM reasoning paths in scientific fact-checking. Building on prior work on fallacious reasoning in biomedical misinformation, MISSCIPLUS (Glockner et al., 2025), we model each explanation as a rea- soning graph that links the false claim to the relevant study context, study findings, fallacy- supporting premises, and fallacy labels. This representation enables one-to-one alignment of human and LLM reasoning at the level of fallacy-specific sub-graphs. For non-human- aligned LLM paths, we validate grounding in the cited study, relevance to the claim, and suf- ficiency for the verdict. Using 84 false claims from MISSCIPLUS, we evaluate GPT-5, Claude Opus 4.7, and Qwen3-32B across prompt and evidence settings. Results show distinct perfor- mance dimensions: Qwen3-32B has the lowest verdict failure rate, GPT-5 the highest human alignment, and Claude Opus 4.7 weak verdict prediction but often valid reasoning in success- ful cases

49. 【2608.23041】AutoSaddler: Automatic Harness Optimization with Durable Updates from Agent Execution Traces

链接：https://arxiv.org/abs/2608.23041

作者：Sungho Park,Wonjoong Kim,Rongyuan Tan,Jue Zhang,Wook-Shin Han,Pengfei Gao,Chanyoung Park,Yongqiang Yao,Rao Fu,Elsie Nallipogu,Qingwei Lin,Saravan Rajmohan,Dongmei Zhang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Software Engineering (cs.SE)

关键词：LLM agents remain, small local failures, long-horizon tasks, agents remain unreliable, LLM agents

备注： 44 pages, 15 figures. Project website and code: [this https URL](https://aka.ms/AutoSaddler-website)

点击查看摘要

Abstract:LLM agents remain unreliable on long-horizon tasks, where small local failures can compound over extended interactions and lead to overall task failure. Although external harnesses can substantially improve robustness, harness design remains a manual and expensive process that requires searching over a large space of prompts, tool configurations, and control logic. We propose AutoSaddler, an automatic harness optimization framework that formulates harness improvement as an offline learning problem and iteratively updates the harness using failure signals from mini-batches. AutoSaddler combines failure-trace diagnosis, structured patch generation that treats the harness as code, and validation-based update selection. Experiments on GAIA2, SWE-Bench Pro, and Terminal-Bench 2.0 show that AutoSaddler substantially improves agent performance over the corresponding base harnesses, achieving gains of 9.0, 9.6, and 10.0 percentage points, respectively. Ablation studies further suggest that effective harness optimization benefits from three ingredients: deep debugging rather than shallow reflection, targeted modifications rather than unconstrained editing, and generalization-aware selection rather than trajectory-specific repair. Together, these results suggest that automatic harness optimization is a promising path toward more performant and reliable agent systems.

50. 【2608.23037】he Multilingual FrameNet Corpus

链接：https://arxiv.org/abs/2608.23037

作者：Beatrice Fiumanò,Nicolas Lazzari,Simone Paolo Ponzetto,Valentina Presutti

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：English Berkeley FrameNet, Berkeley FrameNet corpus, Multilingual FrameNet Corpus, Brazilian Portuguese, Latvian and Swedish

备注： Accepted at EMNLP 2026 Main Conference

点击查看摘要

Abstract:This paper introduces the Multilingual FrameNet Corpus (mFNC), a novel resource that extends the English Berkeley FrameNet corpus by collecting and harmonizing existing language-specific corpora across nine additional languages: Brazilian Portuguese, Chinese, Dutch, French, German, Italian, Korean, Latvian and Swedish. By training models that rely on different architectures on the mFNC, we consistently outperform existing state-of-the-art Frame Semantic Parsers in both multilingual and cross-lingual settings, underscoring the importance of multilingual training data. The mFNC and our trained FSP models are openly available at this https URL.

51. 【2608.23034】ST$^2$U: Stateful Test-Time Unlearning via Restricted Knowledge Boundary Control

链接：https://arxiv.org/abs/2608.23034

作者：Xunlei Chen,Qinghui Gong,Ruini Xue,Yaodong Hu,Tian Lan,Wenhong Tian

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Controlling restricted knowledge, Controlling restricted, large language models, safe deployment, large language

备注：

点击查看摘要

Abstract:Controlling restricted knowledge in large language models is essential for model alignment and safe deployment. Test-time unlearning avoids costly retraining and parameter updates by intervening only during inference. However, existing activation-editing methods apply isolated pointwise corrections, overlooking how autoregressive generation continually reconstructs hidden states from the prompt, cache, and generated prefix. Consequently, later states may return to restricted knowledge regions after a locally successful correction, causing restricted knowledge re-entry. In this work, we propose Stateful Test-Time Unlearning via restricted knowledge boundary control (ST$^2$U), which formulates test-time unlearning as trajectory-wide boundary control. ST$^2$U first models restricted knowledge boundaries in low-dimensional invertible coordinates while leaving orthogonal non-target components unchanged. During inference, ST$^2$U monitors risk along the trajectory, applies minimal boundary corrections with contextual anchoring, and propagates historical correction states across tokens to mitigate knowledge re-entry. This trajectory-wide control enables more persistent forgetting while preserving non-target capabilities and limiting inference overhead. Across three benchmarks and three model families, ST$^2$U delivers the strongest overall balance, combining best or second-best retention with competitive forgetting and substantially less restricted-knowledge re-entry than test-time baselines (13.76%-19.84% versus 46.50%-59.10%).

52. 【2608.23029】Meta-Moderator: Empowering Multi-Agent Debate with Meta-Cognition

链接：https://arxiv.org/abs/2608.23029

作者：Wentao Hu,Zhuoyue Wan,Jinhao Shen,Chen Jason Zhang,Xiaoyong Wei,Qing Li

类目：Computation and Language (cs.CL)

关键词：improve large language, large language model, language model reasoning, eliciting diverse hypotheses, Multi-agent debate

备注： Accepted by EMNLP 2026 Findings

点击查看摘要

Abstract:Multi-agent debate can improve large language model reasoning by eliciting diverse hypotheses and critiques, yet its performance is often constrained by weak moderation. Common pipelines rely on fixed budgets, agreement-based stopping, or untrained judges, leading to redundant deliberation and unreliable evidence aggregation. We cast moderation as a meta-cognitive process, monitoring debate utility, controlling deliberation, and adjudicating a final answer, and introduce Meta-Moderator, a learnable framework that dynamically regulates debate and decides when to finalize an answer. Meta-Moderator is trained independently of the debaters via outcome-driven policy optimization, making debate regulation an explicit capability rather than an incidental effect of prompting. Across five benchmarks, Meta-Moderator outperforms widely used decision layers and transfers across tasks and system configurations. Further analyses show that it allocates debate more selectively and reduces mis-aggregation after informative hypotheses appear.

53. 【2608.23026】Beyond Surface Cues: Disentangling Sociocultural Signals in Multilingual LLMs

链接：https://arxiv.org/abs/2608.23026

作者：Yuanjun Feng,Tanzhou Liu,Stefan Feuerriegel,Yash Raj Shrestha

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：vary across sociocultural, Multilingual LLM outputs, source language, cultural grounding, outputs

备注：

点击查看摘要

Abstract:Multilingual LLM outputs can vary across sociocultural contexts. However, evidence of cultural grounding can be misleading: identity labels may be inferred from explicit or indirect textual cues, while names and wording can reveal the source language. Treating all these signals as evidence of cultural grounding may obscure potential biases. We present a human-validated, multi-agent audit that separates three questions: whether outputs reproduce social biases, whether identity groups are represented differently, and whether outputs reflect cross-cultural patterns. The study analyzes 89,253 outputs from 12 LLMs in English, French, and Chinese, spanning 18 occupations and three task conditions. We find that bias representation varies systematically across languages and tasks. Removing direct identity cues sharply reduces identity-label prediction in English and Chinese, but has a much smaller effect in French. Across all language-genre settings, the cultural context associated with the source language receives the highest average relevance score, with moderate agreement between automated and human ratings. However, the ability to identify the source language drops substantially after translation and again after masking names. Without these controls, multilingual audits may mistake surface cues for cultural understanding, leading to misleading conclusions about cross-cultural variation and bias. Our audit offers a practical framework for separating such shortcuts from more meaningful cross-cultural patterns.

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2608.23026 [cs.CL]

(or
arXiv:2608.23026v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.23026

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

54. 【2608.23023】Most of the LLM routing gap is task type

链接：https://arxiv.org/abs/2608.23023

作者：Janghoon Lee

类目：Computation and Language (cs.CL)

关键词：LLM router picks, LLM router, LLM, model, questions

备注： 21 pages, 2 figures, 12 tables

点击查看摘要

Abstract:An LLM router picks which model should answer each query. The appeal is that models fail on different questions. Whatever single model is best overall still gets some wrong, and another model in the pool gets many of those right. Getting that choice right every time is the ceiling, and a router is an attempt to approach it. However, recent work reports that routers do not get close. Across 21 routing methods on five benchmarks, sharply different designs land within a fraction of a point of each other, and all of them stay far below that ceiling. Learned routers often fail to beat simply always calling the strongest model. We ask what those missed questions have in common. We set fourteen models to answer all 294 questions, with 7 task types across 3 languages: Korean, English and Hindi. We ran the whole matrix twice, changing nothing, but 5.37% of the 4,116 model-question pairs came out scored differently anyway. Run-to-run movement like that is normal, and we argue that a small win does not show that routing did anything, ours or anyone else's. Counting an answer correct only when the model got it right in both runs, 29 questions on this matrix can be improved with routing. Every correct-answer count here is on that rule. Task type accounts for most of them: assigning each task type one model in advance, chosen once and never updated, improves 21 of the 29. Splitting each task type by language improves 2 more and leaves 6 of 294 unoptimized. That handful is what a learned router would have been built for, and it is smaller than the run-to-run movement above, which is a share of pairs rather than of questions. The static table we adopted answers 262 of 294 questions at \$3.33 per run, against the best single model's 245 at \$7.69. All of this is fitted and scored on the same 294 questions with no holdout.

55. 【2608.23020】Unlearning Is Not Just Erasing: Temporal Decoupling via Generation Inequality

链接：https://arxiv.org/abs/2608.23020

作者：Xunlei Chen,Qirui Ye,Yuang Li,Yi Gong,Zhaokun Wang,Wenyi Li,Shiyao Guo,Jinyu Guo

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：address privacy regulations, require effective unlearning, Large language models, require effective, safety concerns

备注：

点击查看摘要

Abstract:Large language models (LLMs) require effective unlearning to address privacy regulations and safety concerns. However, achieving precise forgetting without compromising general utility remains challenging. Existing sequence- and token-level methods penalize target outputs without modeling their context-dependent retrieval paths, which can disrupt linguistic structure or suppress benign knowledge. We present ADU, a fine-grained, training-based framework that shifts unlearning from token erasure to contextual attention-pathway decoupling. Exploiting the functional distinction between local and global attention heads, ADU identifies preplan positions that retrieve persistent sensitive anchors and fixes their candidate paths under the original model. It then trains attention-projection adapters to suppress attention mass along these paths while preserving local-attention structure and retain-set language modeling. Post-training activation exchange tests whether the modified attention-output module transmits the learned forgetting effect. ADU achieves the strongest aggregate performance among evaluated baselines on the TOFU and WMDP benchmarks, including a Forget Quality of (0.93) on TOFU. It preserves 87--98% of model utility (92.9% on average versus 81.9% for baselines) while reducing side effects in benign contexts.

56. 【2608.23001】PatchWrite: One Line, Not One Section -- Compile-Gated, Validity-Preserving Editing for AI-Drafted Manuscripts

链接：https://arxiv.org/abs/2608.23001

作者：Weiwei Yang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词：Automated manuscript pipelines, allowing unrelated metrics, Automated manuscript, local defect, pipelines often regenerate

备注： 12 pages, 7 figures

点击查看摘要

Abstract:Automated manuscript pipelines often regenerate an entire section to repair a local defect, allowing unrelated metrics and citations to change even when the resulting PDF still builds. PatchWrite instead constrains how candidate edits become committed manuscript states: it reuses bounded EDIT N M editing and rollback, but tightens compilation acceptance with fatal-log checks and adds evidence locks that require every cited key and experimental numeric token to be attested by a reference registry or experimental log. Candidates that fail either check are rejected and the previous HEAD is retained. On a 24-manuscript x 8-fault oracle stress test (768 jobs, evenly split between compile-breaking and content-only faults), whole-slot rewriting mutated an unrelated "12-layer" line in every case (0/192 preserved; numeric Jaccard 0.6667), whereas PatchWrite preserved it in 192/192 cases. Removing the compile gate reduced acceptance to 0, while removing the evidence gate allowed a hallucinated citation to pass. The same pattern held across all eight faults. To test the protocol with generation rather than oracle edits, we reran the 192 jobs with the writer model proposing the edits. The model's candidates were accepted in 75% of cases; nearly all rejections came from one reproducible failure mode in which the model attempted to delete a line using an empty replacement unsupported by the current grammar. Every accepted candidate passed both gates, and 93.75% fixed the injected fault; the remaining cases involved a technically valid but sentence-inappropriate citation and one markup-changing near-miss. In a blind evaluation of sixteen PDF pairs, both raters preferred PatchWrite for preserving lab-grounded facts (C1 Likert 5.0 vs. 2.0), while rating prose quality nearly identically. Logs from 193 in-product drafting tasks show the same classes of failures occurring in practice.

57. 【2608.22993】LLM Pedagogical Behavior in AI Tutoring Interactions

链接：https://arxiv.org/abs/2608.22993

作者：Suhyeon Lee,Juneha Baek,Jaehyeong Park,Donghyuk Shin

类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

关键词：coursework and problem, problem solving, Students, Students increasingly, assistance

备注：

点击查看摘要

Abstract:Students increasingly use LLMs as tutors for coursework and problem solving. Little is known about the level of assistance LLMs provide when students use them as tutors in authentic learning interactions. This matters because tutoring responses can differ substantially in how directly they help students complete a task. We operationalize this dimension as scaffolding level and develop a five-level scale, validated against human annotations, that characterizes responses according to the degree of direct assistance they provide. We apply the scale to 14,637 LLM responses from 203 students in a university AI course. Responses are overwhelmingly concentrated at high levels of assistance, with more than 95% classified as either Explaining or Solving. Scaffolding level is systematically associated with students' subsequent conversational behavior, but provides little additional predictive information about performance on three subsequent exams beyond prior achievement and dialogue behavior. These findings provide an empirical baseline for LLM assistance in tutoring interactions and a measurement framework for evaluating how alternative tutoring designs change that assistance.

58. 【2608.22985】What Does Activation Steering Control? Attribution Across Answer Encodings and Output-Sensitive Subspaces

链接：https://arxiv.org/abs/2608.22985

作者：Zhiwei Gao,Shaowen Peng,Shoko Wakamiya,Eiji Aramaki

类目：Computation and Language (cs.CL)

关键词：Activation steering, answer encoding, extraction-index, steering, answer

备注：

点击查看摘要

Abstract:Activation steering is often evaluated under the answer encoding used to construct the direction. A reported gain may reflect the intended judgment or compatibility with answer identifiers seen during construction. We introduce Cross-Encoding Steering Evaluation, which freezes an intervention while re-encoding answers to the same held-out items. On NormBank, after A/B/C identifiers are reassigned, contrastive activation addition (CAA) induces larger target-versus-source score changes for the extraction indices than for the semantic labels under the new mapping. We call this extraction-index following. Varying identifier vocabulary (A/B/C, X/Y/Z, or 1/2/3) and row order shows that the effect tracks extraction index rather than row position. After matching direction norms across layers, extraction-index following emerges mainly at later depths. A low-rank output-sensitive component containing 15.4% of the direction's squared norm retains 96.3% of this effect. An Inference-Time Intervention (ITI)-style method also favors extraction-index over semantic-label following on NormBank in three models. In aggregate, MNLI favors extraction-index following, whereas Social Chemistry 101 (SC101) favors semantic-label following. Multiple-choice and open-ended evaluations can yield different behavioral conclusions. Thus, a steering gain under one answer encoding does not by itself identify what the intervention controls.

59. 【2608.22967】Closed-Loop Bayesian Molecular Inverse Design with Semantic LLM Surrogates

链接：https://arxiv.org/abs/2608.22967

作者：Yaoyao Xu,Xinjian Zhao,Xiaozhuang Song,Lei Bai,Tianshu Yu

类目：Computation and Language (cs.CL)

关键词：desired property profile, Practical molecular inverse, closed-loop candidate-pool enrichment, limited oracle budget, one-shot generation problem

备注： 28 pages

点击查看摘要

Abstract:Practical molecular inverse design is rarely a one-shot generation problem; it often takes the form of closed-loop candidate-pool enrichment, where under a limited oracle budget the goal is to \emph{increase the fraction of generated molecules that match a desired property profile}. Bayesian optimization (BO) offers a natural framework for this setting, yet standard Gaussian-process surrogates typically operate in compressed continuous embeddings, which discard the substructural and reference-similarity signals that chemists naturally use to decide where to look next. We propose \textbf{\method}, a closed-loop framework in which the surrogate, rather than the generator, is treated as the locus of design choice, and instantiate it with a frozen large language model that reasons directly over the task instruction, SMILES-level optimization history, and oracle feedback in their native textual form. At each iteration, the surrogate returns a structured decision signal that selects informative reference molecules under an exploration and exploitation principle, optionally with a concise guidance sentence. This signal is converted into next-round conditioning text for a frozen molecular generator, yielding an inspectable optimization trace in natural language. Experiments on MolQA drug and material design tasks show that \method improves over one-shot prompting, is competitive with or stronger than GP-based BO baselines, and reveals a domain-dependent interface: reference-only transfer works best for binary drug targets, while adding a concise surrogate summary is more beneficial for continuous material

60. 【2608.22963】Buried in Textual Debt: Context Pruning with Visual Evidence Preservation for MLLM Agents

链接：https://arxiv.org/abs/2608.22963

作者：Yuchen Huang,Sijia Li,Jun Zhang,Yi R. Fung

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：supports task decomposition, Multimodal Large Language, Large Language Models, Multimodal Large, explicit reasoning supports

备注： 14 pages, 2 figures, 4 tables

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) are increasingly deployed as multi-step agents, where explicit reasoning supports task decomposition and tool coordination but also accumulates self-generated text. Over long trajectories, this text can dominate the context and suppress visual evidence, creating textual debt. We observe that reasoning becomes redundant once task-relevant visual evidence is grounded, while stale hypotheses can misguide later inference when grounding remains uncertain. Pruning must therefore remove redundant text without discarding visual evidence. We propose SPARE, a Kullback--Leibler (KL)-guided framework for pruning accumulated reasoning in multimodal tool-use agents. SPARE uses a compact task-state summary as privileged diagnostic context. For each candidate segment, it replays the same model under the original and summary-conditioned contexts. Reverse-KL divergence from on-policy self-distillation (OPSD) then tests whether the summary sufficiently covers the segment without disrupting future reasoning. We further fine-tune the summarizer with supervised fine-tuning (SFT), enabling more compact summaries, broader coverage, and more aggressive pruning. Across multi-step visual tool-use benchmarks, SPARE achieves the highest average accuracy among pruning methods while removing 37.89--64.58\% of reasoning tokens. This favorable accuracy--context trade-off shows that reducing textual dominance restores reliance on visual evidence and mitigates over-conditioning on self-generated language.

61. 【2608.22956】he Illusion of Control: Why Bare Classifier Inversion Silently Fails in Concept-Bottleneck Text Generation

链接：https://arxiv.org/abs/2608.22956

作者：Qi Bing,Xiaowei Shao

类目：Computation and Language (cs.CL)

关键词：target attribute configuration, routes multi-attribute control, controllable generation routes, generation routes multi-attribute, Concept-bottleneck controllable generation

备注： Accepted to EMNLP 2026 (Main Conference)

点击查看摘要

Abstract:Concept-bottleneck controllable generation routes multi-attribute control through a low-dimensional concept code that, at deployment, must be synthesised from a target attribute configuration. We study this problem in concept-bottleneck text generation under multi-axis compositional generalisation, comparing three ways to obtain the inference-time code: classifier inversion against the encoder heads, reference-text encoding, and a post-hoc label-conditioned prior. Since a concept code admits no direct LM-fluency term, regularising inversion must instead constrain the code toward the encoder's training distribution. We therefore test bare inversion and three regularised variants: label-agnostic and label-conditioned Mahalanobis penalties, and a conditional normalising-flow density baseline. Every inversion variant we test underperforms a simple post-hoc prior fitted to per-combination encoder means on the same checkpoints, across three backbone families spanning $124$M to $8$B parameters. The bare form of classifier inversion also silently collapses to chance, traceable to a directly measured off-manifold code. We validate this diagnosis on real-world benchmarks and under external evaluators, enabling fair comparison with published baselines.

62. 【2608.22948】What Proves You Wrong: Benchmarking Language Models on Falsifiable Research Ideation

链接：https://arxiv.org/abs/2608.22948

作者：Ziyue Wang(1),Aomufei Yuan(2),Yiran Yao(3),Linli Yao(1),Hongyao Zuo(3),Ziwen Gong(4),Yuanxin Liu(1),Shicheng Li(1),Yishuo Cai(1),Tong Yang(2),Xu Sun(1),Xiaohui Li(5),Haoli Bai(5) ((1) State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University, (2) Peking University, (3) Tianjin University, (4) Hainan University, (5) Huawei Technologies)

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：free-form judging sways, propose research ideas, shared decision rule, Large language models, paper rewards recovery

备注： Equal contribution by Ziyue Wang, Aomufei Yuan and Yiran Yao. Corresponding authors: Tong Yang and Xu Sun

点击查看摘要

Abstract:Large language models are increasingly used to propose research ideas, yet the prevailing ways of judging such ideas supply no shared decision rule: free-form judging sways with style and position, and scoring against a later paper rewards recovery of one realized trajectory. We introduce a benchmark that carries a proposal from Literature to Test: the Lit2Test benchmark centers on a six-field contract organized around a falsifying outcome, so that every proposal precommits the observation that would prove it wrong, making its quality decidable in the first place rather than merely arguable. Built prospectively from 200 real-paper neighborhoods, Lit2Test elicits proposals from four frontier models and compares them through 1,200 pairwise comparisons judged blind in both presentation orders. The protocol audits its own reliability through diagnostic controls and bounded human calibration, with three annotators corroborating the conclusions within explicitly stated reliability bounds. Lit2Test recovers a strict ranking of the four models in all 10,000 bootstrap replicates, and the separation comes from the quality of the proposed tests and metrics rather than from surface fluency. We release the benchmark, construction pipeline, and audit artifacts for public use.

63. 【2608.22922】HelaBERT: Enhancing Sinhala Language Understanding with Dual Pooling Classification Head

链接：https://arxiv.org/abs/2608.22922

作者：Thisen Ekanayake,Nisansa de Silva

类目：Computation and Language (cs.CL)

关键词：web crawl data, BERT-based masked language, custom corpus comprising, Sinhala Wikipedia, Sinhala text sourced

备注：

点击查看摘要

Abstract:We present HelaBERT, a family of two BERT-based masked language models pre-trained from scratch on approximately 1 billion tokens of Sinhala text sourced from MADLAD-400, CulturaX, and a custom corpus comprising news articles, Sinhala Wikipedia, and web crawl data. HelaBERT-Small (~23.3M parameters, 6 layers) and HelaBERT-Large (~110M parameters, 12 layers) both use a SentencePiece Unigram tokenizer (vocabulary size 32,000) tailored to Sinhala's agglutinative morphology and complex script. We evaluate both models on four downstream Sinhala text classification tasks: news category classification, news source classification, sentiment analysis, and writing style classification, using 5 independent seed runs with stratified 80/20 train/test splits. We additionally propose a dual pooling classification head and evaluate it systematically across all four tasks, finding consistent improvements on sentiment analysis and a moderate gain on news category classification for HelaBERT-Small, while the standard [CLS]-linear head remains competitive on news source classification, a headline-level task with short average input length. We release both models to support further research in Sinhala NLP.

64. 【2608.22917】SWAP: A Multilingual Retrieval-Augmented Thai Wellness Advisor

链接：https://arxiv.org/abs/2608.22917

作者：Pornthep Ukosaramig,Kobkrit Viriyayudhakorn

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：deployed eight-language conversational, Thai traditional medicine, eight-language conversational wellness, conversational wellness advisor, present TSWAP

备注： 8 pages, 2 tables. Data and evaluation logs: [this https URL](https://huggingface.co/datasets/iapp/tswap-wellness-benchmark)

点击查看摘要

Abstract:We present TSWAP, a deployed eight-language conversational wellness advisor grounded, via retrieval-augmented generation, in a verified knowledge base of Thai traditional medicine and certified wellness providers. An unmodified open-weight LLM (Qwen3.6-35B-A3B on vLLM) is grounded on a ~30.6K-chunk Thai index by a hybrid dense-sparse retriever with cross-encoder reranking; a first-turn query classifier forces tool-based retrieval for entity lookups; a rule-based safety layer enforces medical scope and Thai emergency routing; and all eight languages are served zero-shot with translate-then-retrieve. We release the first Thai traditional-medicine/wellness retrieval benchmark (50 questions with gold document IDs; Recall@5 = 0.88), production QA logs (91.1% test-retest pass over 259 cases), and a 71-question frontier no-retrieval probe showing what each grounding pillar contributes: without the safety prompt the backend model family produced a full drug-dosing schedule and complied with out-of-scope requests, and without the knowledge base it produced zero verifiable provider recommendations. We further report two transferable deployment findings: English-calibrated 4-bit AWQ quantization corrupts Thai tone marks, and forced-retrieval routing is necessary for reliable grounding.

65. 【2608.22916】Knowing Isn't Always Saying: When Do Spatial Encodings Reach Answers in Vision-Language Models?

链接：https://arxiv.org/abs/2608.22916

作者：Zeyu Wang,Xinming Xu

类目：Computation and Language (cs.CL)

关键词：encode spatial information, hidden states, Vision-language models, encode spatial, Vision-language

备注： Accepted to appear in the EMNLP 2026 Main Conference

点击查看摘要

Abstract:Vision-language models are known to encode spatial information in their hidden states, yet often fail to use it when answering. However, it remains unclear when and where this encoded information reaches the answer. We address this with direction patching, a class-conditioned causal intervention applied across layers, token positions, and prompt formats. Using spatial-ID directions constructed following prior encoding evidence, we find that causal influence on answer logits emerges only at mid-to-deep depths. Text chain-of-thought suppresses immediate object-word argmax-level transport in most models, while visually grounded prompts keep it open. Positive target-logit gain can remain below the argmax threshold, and transport can re-emerge at the final prefix token or at the answer step in deeper layers. Across the ten VLMs we study, these local effects form descriptive transport patterns. Complementary experiments characterize how these patterns shift across datasets, attributes, and encoding amplitudes. Together, these results reframe the encoding-grounding gap as a problem of conditional transport in VLMs.

66. 【2608.22915】Safety Hacking in Constrained Best-of-$N$ Inference-time Scaling

链接：https://arxiv.org/abs/2608.22915

作者：Akifumi Wachi,Takumi Tanabe,Youhei Akimoto

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词：sample multiple outputs, pipelines often sample, sample multiple, safety, highest learned reward

备注：

点击查看摘要

Abstract:Inference-time pipelines often sample multiple outputs, filter them with a learned safety model, and return the proxy-feasible output with the highest learned reward. We show that this composition creates a two-stage failure: an imperfect safety proxy first contaminates the feasible set with unsafe outputs, and reward maximization can then amplify this residual contamination. We define \emph{safety hacking} as selecting an output that passes the learned constraint but violates the true safety criterion. For constrained Best-of-$N$ sampling, we derive finite-$N$ bounds governed by the joint upper reward tails of safe and unsafe outputs within the proxy-feasible set. If unsafe-but-feasible outputs have the heavier tail, safety hacking becomes asymptotically certain as $N$ grows, even when false-positive mass and average safety- and reward-proxy errors are arbitrarily small. We also show that policies within a bounded $\chi^2$ divergence from the proxy-feasible reference distribution admit an $N$-independent safety-hacking bound, and instantiate this general coverage-control principle with constrained pessimistic sampling. Coverage control limits amplification but cannot repair a contaminated feasible set: admitted unsafe outputs may still be favored, and regularized selection is not necessarily safer than constrained Best-of-$N$ for every reward proxy. Toy and language-model experiments characterize both contamination and its reward-tail amplification, which exposes an inherent difficulty in inference-time scaling with learned safety models.

67. 【2608.22909】Exploring Dowker Homology for Sentence Similarity

链接：https://arxiv.org/abs/2608.22909

作者：Marius Huber,Juri Opitz

类目：Computation and Language (cs.CL)

关键词：Dowker homology, Dowker homology captures, point clouds living, homology captures sentence, Dowker

备注： 12 pages; accepted at "Workshop on Insights from Negative Results in NLP 2026"

点击查看摘要

Abstract:Dowker homology is a topological tool that may be used to analyze the relative position of two point clouds living in a common space. We investigate whether Dowker homology captures sentence similarity information by treating the embeddings of the tokens that constitute a sentence pair as a pair of point clouds in the latent space of a transformer model, using both models that have and have not been fine-tuned for sentence similarity. We find that Dowker homology captures sentence similarity information, as measured by regressing Dowker homology features onto ground-truth similarity scores, and that it can be used for visual inspection of similarity data and models. In an attempt to make Dowker homology readily applicable, we derive from it single-number summaries that we expect to capture sentence similarity directly. These turn out to work reasonably well, but without outperforming standard sentence similarity measures based on established pooling methods.

68. 【2608.22908】Do Spoken Language Models Hear Speech as They Read Text? Bridging Structural Gaps Between Speech and Text

链接：https://arxiv.org/abs/2608.22908

作者：Hyeonyu Kim,Hwayeon Kim,Youngwon Choi,Myeongkyun Cho,Huu-Kim Nguyen

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Spoken Language Models, generate textual responses, textual responses directly, Spoken Language, Language Models

备注： Accepted to EMNLP 2026 Findings

点击查看摘要

Abstract:Spoken Language Models (SLMs) generate textual responses directly from speech, offering an alternative to cascaded systems. Despite recent advances, existing SLMs still exhibit weaker instruction-following behavior and limited generalization across diverse tasks compared to text-based language models. Our analysis shows that speech and text representations in current SLMs remain weakly aligned despite strong downstream performance, indicating that structural differences between continuous, temporally varying speech and discrete text remain insufficiently addressed. To address this, we propose a simple framework that decouples length mismatch from semantic alignment and encourages closer correspondence between speech and text representations. Experiments across multiple benchmarks demonstrate competitive performance against strong baselines, underscoring the importance of explicitly addressing structural differences between speech and text in SLM training. Our code is publicly available at this https URL.

69. 【2608.22898】SelFusion: Self-distillation for Diffusion Language Models

链接：https://arxiv.org/abs/2608.22898

作者：Hyeongsoo Lim,Jinyoung Kim,Eunseo Seo,Minho Jang,Jiwon Yoon

类目：Computation and Language (cs.CL)

关键词：Diffusion language models, large language models, inherent latency bottleneck, Diffusion language, generation quality limits

备注： Published as a main conference paper at ACL 2026

点击查看摘要

Abstract:Diffusion language models (DLMs) alleviate the inherent latency bottleneck of autoregressive (AR) large language models (LLMs), but their degraded generation quality limits practical applicability. Although knowledge distillation (KD) can be a promising direction for improving performance, we empirically find that naively applying conventional KD yields only marginal gains, or even degrades generation quality. Based on these observations, we propose a novel self-distillation framework for DLMs, namely SelFusion. To enable effective KD without an external teacher model, SelFusion performs two forward passes with different masking levels, defining the hard mode with a larger masking probability and the easy mode with a smaller masking probability. However, the easy mode is not always more accurate than the hard mode and can be overconfident on incorrect tokens. Thus, we introduce bidirectional KD between the two modes, which can dynamically determine the distillation direction based on token-level correctness. Experimental results on instruction-following tasks show that the proposed self-distillation substantially outperforms other KD methods with external LLM and DLM teachers. In many configurations, the student trained with SelFusion even surpasses the performance of the LLM teacher, providing a practical path toward improving DLM generation quality. Source code can be found at this https URL

70. 【2608.22894】AraDetox: A Multi-Dialect Arabic Detoxification Dataset

链接：https://arxiv.org/abs/2608.22894

作者：Mo El-Haj

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：received considerable attention, Modern Standard Arabic, detoxification remains underexplored, Arabic, considerable attention

备注： 15 pages, 6 figures

点击查看摘要

Abstract:Arabic harmful-language detection has received considerable attention, yet Arabic text detoxification remains underexplored. We introduce AraDetox, a multi-dialect Arabic detoxification dataset comprising 10,500 harmful social-media posts and 84,000 detoxified rewrites generated using GPT-5 and Gemini 2.5 Flash across Modern Standard Arabic, Gulf, Levantine, and Egyptian Arabic. The generated outputs were assessed through human evaluation and automatic analyses of lexical change, semantic preservation, sentiment, and dialectal style. Results show that detoxification is primarily a meaning-preserving rewriting task: substantial lexical and structural reformulation is accompanied by consistently high semantic similarity. Human evaluation confirms successful harmful-language removal while largely preserving the original meaning. Dialectal analyses further indicate that the generated variants exhibit measurable stylistic alignment with reference Arabic dialect corpora. Comparison with existing resources highlights two complementary approaches to detoxification: minimal-edit lexical substitution and meaning-preserving reformulation. Our findings demonstrate that large-scale Arabic detoxification resources can be constructed through LLM-assisted generation and human verification. The dataset is publicly available at this https URL to support future research on Arabic detoxification, safe text generation, and multi-dialect Arabic NLP.

71. 【2608.22887】Proxy reliance in large language model decisions is uncalibrated to predictive evidence

链接：https://arxiv.org/abs/2608.22887

作者：Zengqing Wu,Chuan Xiao

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Large language models, Large language, triage and lending, distinguished from impermissible, Large

备注：

点击查看摘要

Abstract:Large language models (LLMs) are entering decisions in triage and lending, where task-relevant inference must be distinguished from impermissible proxy use. Current audits ask whether decisions change when demographics change. But attributes correlated with a protected group carry predictive value, so a changed decision can be discrimination or sound inference. We measure causal proxy effects in four LLMs on a clinical-ranking task with known ground truth, where the reliance the evidence warrants can be computed exactly and used as the reference. One audit signal yields three verdicts: over-reliance, warranted and under-reliance. Under neutral labels every model relies on proxies with no information. Informative proxies draw all three. Social field names push reliance down, below the reference in one model. Two findings explain this. Reliance severely undertracks the evidence, and social-label suppression is fragile, since in-context examples raise it above zero in every model. Accuracy-based evaluation detects none of this.

72. 【2608.22872】Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors

链接：https://arxiv.org/abs/2608.22872

作者：Zhenghua Bao

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

关键词：Speech-based applications pass, automatic speech recognition, fixed upstream constraint, applications pass spoken, pass spoken queries

备注： Accepted to EMNLP 2026 (Main Conference)

点击查看摘要

Abstract:Speech-based applications pass spoken queries through automatic speech recognition (ASR) before any retrieval module, so ASR errors enter the pipeline as a fixed upstream constraint. We empirically test whether two extensions to standard retrieval-augmented generation (RAG), entity-graph linking and iterative reformulation, absorb or amplify these errors. Using four English accents synthesized through neural TTS, we evaluate four RAG configurations on three multi-hop QA benchmarks (HotpotQA, 2WikiMultiHopQA and MuSiQue) against a clean-text oracle. Although the structurally richer configurations generally retain higher absolute F1 under ASR input, both extensions amplify the error: the F1 gap from clean text to the highest-WER accent is 36-67% larger under their combination than under naive dense retrieval, on all three benchmarks. The dominant failure mode is corruption of one or more query entities, accounting for 87-96% of degradation cases on 2WikiMultiHopQA across all four methods. Two lightweight surface-form mitigations leave most of the gap intact, indicating that downstream retrieval structure amplifies remaining entity errors. We release code and data at this https URL .

73. 【2608.22859】WARP: Wasserstein-Aligned RAG for Population Opinions

链接：https://arxiv.org/abs/2608.22859

作者：Aman Singh Thakur,Aditya Agrawal,Alwarappan Nakkiran,Alex Karlsson

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：RAG systems, systems are increasingly, summarize what large, large collections, RAG

备注： Pre-print

点击查看摘要

Abstract:RAG systems are increasingly used to summarize what large collections of documents say. A user asks "What do people think about X?" and receives an answer that reads as consensus. But standard top-k retrieval ranks documents by query similarity, not by how faithfully they represent the population, so minority views quietly disappear. Existing fixes fall short. Diversity re-rankers like MMR and DPP spread retrieved documents apart, but with no target distribution to aim for. Calibration methods based on KL or JS divergence do target one, yet treat opinion bins as unordered: confusing strong positive with strong negative costs no more than an adjacent-bin miss. We introduce WARP, a family of post-retrieval algorithms that calibrate retrieved evidence to the population's opinion distribution. WARP first recovers underrepresented opinions that cosine ranking may bury, then uses Wasserstein-1 distance to select documents whose sentiment-intensity distribution matches the population target, capturing the ordinal structure ignored by KL and JS divergence. We develop three variants for dense, sparse, and variable candidate pools, trading off calibration quality and speed. Across three review domains spanning 35K documents, 156 queries, and 26 entities, WARP's domain-matched variants reduce distributional error by at least 43% with sub-second latency. These gains carry through to generation: a five-judge LLM panel prefers WARP-generated answers in 86% of decided comparisons at k = 5.

Comments:
Pre-print

Subjects:

Information Retrieval (cs.IR); Computation and Language (cs.CL)

Cite as:
arXiv:2608.22859 [cs.IR]

(or
arXiv:2608.22859v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2608.22859

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

74. 【2608.22857】SAVER: Selective Auditing of Verbal Evidence for Error Recovery in VLM Change Reasoning

链接：https://arxiv.org/abs/2608.22857

作者：Youdi Li

类目：Computation and Language (cs.CL)

关键词：visual change reasoning, Vision-language models, frequently fail, sufficient information, fail at visual

备注： 19 pages, 5 figures

点击查看摘要

Abstract:Vision-language models (VLMs) frequently fail at visual change reasoning, even when their vision encoders contain sufficient information. We observe that correct VLM outputs tend to contain explicit verbal evidence (object names, colors, spatial locations) that supports the claimed change, while incorrect outputs often lack such evidence. We propose SAVER (Selective Auditing of Verbal Evidence for Error Recovery), a lightweight, rule-based method that parses VLM responses for this evidence and triggers structured reprompting only when evidence is missing or inconsistent. Across three change detection benchmarks and four VLMs, SAVER significantly improves accuracy on tasks where errors stem from the model failing to articulate what it saw (expression failures), with gains up to +25.8% on CLEVR-Change. The evidence patterns can also be generated by an LLM in a single call, matching the hand-tuned gate on CLEVR-Change. Ablation experiments confirm that the evidence gate, not reprompting alone, drives the improvement.

75. 【2608.22856】Same Agent, Different Answers: A Repeat-Aware Audit of Corpus-Induced Answer Churn in Retrieval-Augmented QA

链接：https://arxiv.org/abs/2608.22856

作者：Jingjie Ning,Xueqi Li

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：requested model identifier, exposed generation controls, retrieval policy, evidence depth, model identifier

备注：

点击查看摘要

Abstract:A retrieval-augmented QA system can return different answers after an index expansion even when its requested model identifier, prompt, retrieval policy, evidence depth, rendering, and exposed generation controls are held fixed. Aggregate accuracy may hide these changes when gains and losses cancel, while ordinary generation variability makes one-shot comparisons overstate update effects. We call the hidden phenomenon accuracy-blind answer churn and introduce the \emph{Snapshot Compatibility Audit}, which estimates excess answer churn by subtracting same-snapshot repeat disagreement from cross-snapshot disagreement. We instantiate it by expanding one frozen FineWeb prefix from one to seven shards. In a preregistered 400-question Natural Questions study, normalized-exact and blinded-semantic excess churn are 6.44 and 10.25 percentage points while exact-match accuracy changes by only $-1.50$ points. A post-hoc analysis finds repeat-stable semantic flips on 40/400 questions. A separately preregistered 200-question TriviaQA study yields smaller, directionally consistent excess churn while exact-match accuracy moves in the opposite direction. An outcome-blind post-hoc 100-question subset replication with a second DeepSeek generator and serving configuration finds 8.75 pp of semantic excess churn even as exact match rises by 3.00 percentage points. Answer-level compatibility can therefore fail without a conspicuous or consistently directed utility shift. Retrieval-augmented releases should audit compatibility alongside utility.

76. 【2608.22852】Your AI, On a Dial: Controlling Investment Bias in LLMs with a Single Neuron

链接：https://arxiv.org/abs/2608.22852

作者：Sahong Park,Suhwan Park,Hoyoung Lee,Gakyung Kwon,Wonbin Ahn,Jaewon Choi,Alejandro Lopez-Lira,Yoon Kim,Chanyeol Choi,Hyeongwoo Kong,Yongjae Lee

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); General Finance (q-fin.GN)

关键词：Large language models, Large language, model-specific investment preferences, exhibit systematic, investment

备注：

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used in investment decision-making, yet prior work shows that they exhibit systematic, model-specific investment preferences. We study whether a model's overall investment stance can be calibrated to a specified direction and strength. We introduce an investment-bias dial, an inference-time intervention on a single neuron that continuously adjusts a model-level decision prior---its overall tendency toward buying or selling---without targeting specific firms or investment attributes. Using matched positive and negative evidence, we evaluate five open-weight LLMs and find that the dial produces monotonic changes in investment stance without modifying prompts or model parameters. At the response level, the dial shifts both investment decisions and the evidential emphasis of generated rationales under identical inputs. In an agentic retrieval setting, the dial also changes what information the model searches for, which evidence it selects, and which evidence is reflected in its final analysis. In a long-context evaluation, the dial maintains stable stance control as context length increases, whereas a matched system-prompt instruction progressively attenuates. We further show that changes in the dial propagate to security rankings and downstream portfolio composition in an exploratory backtest. Overall, our results show that an LLM's aggregate investment stance can be calibrated toward a specified target at inference time.

77. 【2608.22817】Industrial-Instruction: An End-to-End Framework for Building Instruction-Tuning and Benchmark Datasets from Industrial Technical Reports

链接：https://arxiv.org/abs/2608.22817

作者：Parsa Bakhtiari,Hassan Bashiri,Alireza Khalilipour,Masoud Nasiripour,Moharram Challenger

类目：Computation and Language (cs.CL)

关键词：Industrial technical reports, real industrial technical, Industrial technical, technical reports, dense prose

备注： 29 pages, 8 figures, 18 tables, 5 listings. Datasets available at [this https URL](https://huggingface.co/datasets/Parssky/industrial-instruction-dataset) ; code at [this https URL](https://github.com/parssky/industrial-instruction)

点击查看摘要

Abstract:Industrial technical reports contain high-value knowledge for maintenance, troubleshooting, and product engineering, but their heterogeneous structure (dense prose, specifications, tables) makes them difficult to index and reason over with standard retrieval and QA pipelines, and no public instruction-tuning or benchmark datasets are built from such documents. We address this gap with Industrial-Instruction, contributing (i) two open QA datasets built from real industrial technical reports and (ii) the end-to-end pipeline that produces them. Using 906 public Panasonic documents (7,525 pages), we apply layout-aware extraction, build a semantic retrieval index, and synthesize multiple-choice QA grounded in retrieved evidence under five query-document relationships (irrelevant retrieval, single-/multi-document support, single-/multi-document answer). After filtering an initial 23.9k generated samples, each dataset provides approximately 13.6k QA pairs with source documents and a held-out benchmark split. Fine-tuning small open LLMs (under 10B parameters) improves Set-Match Accuracy from 28.5% to 42.0% and F1 from 46.6% to 63.5% on the Panasonic benchmark. We release two parallel versions built by the same pipeline: one generated with the open-weight Qwen3-30B-A3B-Instruct model and one with the closed, API-based Claude-Opus-4.6 model, enabling a direct comparison of open- versus frontier-model data generation. The Claude-Opus-4.6 dataset yields a cleaner raw corpus and larger fine-tuning gains, at roughly two orders of magnitude higher cost. MMLU evaluation shows models trained on the Claude-Opus-4.6 data retain essentially all general knowledge, versus a small but measurable forgetting effect for the Qwen-generated data. Together, these datasets and pipeline offer a practical, reproducible path toward scalable industrial benchmarks and training data from real-world documentation.

78. 【2608.22806】DIAG: Diagnostic Iterative Alignment and Generation for Data-Efficient Mathematical Preference Distillation

链接：https://arxiv.org/abs/2608.22806

作者：Guhan Chen,Songtao Tian,Bohan Li,Hejin Wang,YeXin Xie,Zixiong Yu

类目：Computation and Language (cs.CL)

关键词：Large Language Models, aligning Large Language, static problem sets, model evolving competence, Large Language

备注： Accepted by EMNLP 2026 findings

点击查看摘要

Abstract:Iterative preference optimization is essential for aligning Large Language Models on mathematical reasoning tasks, yet its efficiency is often throttled by signal scarcity: as the model improves, static problem sets become increasingly mismatched to the model's evolving competence, producing rollouts that are either too easy or too hard and therefore non-informative, which leads to a scarcity of valid preference pairs. We propose DIAG, a Diagnostic Iterative Alignment and Generation framework that adaptively reshapes the practice distribution to increase informative supervision and focus training near the student's current competence boundary. DIAG consists of two phases: (1) diagnosing valid preference-pair yield to calibrate the exploration-exploitation trade-off and allocate topic quotas via an Empirical Bayes shrinkage estimator, thereby prioritizing high-yield concepts; and (2) generating targeted practice, where a teacher synthesizes variants from the student's failure traces. We further provide a theoretical view interpreting DIAG as a teacher-mediated approximation to KL-regularized reweighting of the practice distribution toward the student's competence boundary, where valid preference-pair yield is maximized. Experiments show that DIAG boosts yield across iterations and delivers stronger reasoning performance under an iso-effective training budget, demonstrating that it can distill more informative preference supervision for mathematical reasoning.

79. 【2608.22802】SDoH-Aware Narrative Anchoring Bias in Medical LLMs for Trustworthy Clinical Decision Support

链接：https://arxiv.org/abs/2608.22802

作者：Ahnaf Atef Choudhury,Ramkrishna Saha

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Medical large language, large language models, large language, Medical large, answer correctly

备注： Accepted for publication at 10th International Artificial Intelligence and Data Processing Symposium (IDAP'26)

点击查看摘要

Abstract:Medical large language models are often judged by how many clinical questions they answer correctly. That view is useful, but it misses a practical risk. A model may know the right answer and still change its response when the same case is written in a different patient voice. This paper evaluates that risk as SDoH aware narrative anchoring bias. We use NarrativeShield SDoH MedQA, a counterfactual medical question answering dataset in which each case appears in persona based narratives while the answer key remains fixed. The dataset is reshaped from wide format into case grouped persona rows. We evaluate three open source instruction tuned LLMs from the Qwen2.5 family: 1.5B, 3B, and 7B. The final experiment uses 300 clinical cases and produces 8,100 model responses across three prompting conditions. We report persona level accuracy, counterfactual consistency, correct consistency, and narrative sensitivity error. Qwen2.5 7B achieves the best accuracy at 56.33 percent and the best correct consistency at 40.33 percent. Paired McNemar exact tests show significant accuracy gains for 7B over 3B in all prompt settings. Even so, narrative sensitivity remains, with the lowest error still at 31.67 percent. These results suggest that trustworthy clinical decision support should be evaluated by both average correctness and stability across medically equivalent patient narratives.

80. 【2608.22793】RACE: A Self-Evolving Skill Bank for Consistent, Limit-Aware LLM Agents

链接：https://arxiv.org/abs/2608.22793

作者：Wenhao Wu,Menghao Zhang,Xin Wang,Zhi Wang,Kun Shao,Jian Luan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：user-facing products depends, raw task-solving ability, LLM agents, safely fulfilled, user-facing products

备注： 9 pages, 5 figures, 2 tables

点击查看摘要

Abstract:Reliable deployment of LLM agents in user-facing products depends not on raw task-solving ability but on consistency and limit-awareness: behaving the same way across repeated trials, and recognizing when a request cannot, or cannot yet, be safely fulfilled. CAR-bench exposes this reliability gap in the domain of in-car assistants: an LLM-simulated user issues incomplete or ambiguous requests, requiring the agent to resolve uncertainty through multi-turn dialogue and tool use while strictly adhering to domain policies. Even frontier models show a substantial gap between what they can solve at least once (Pass@3) and what they solve consistently across trials (Pass^k). We bridge this gap with TRACE (TRAjectory-Contrastive Evolution), which iteratively improves a skill-based agent's behavioral knowledge without modifying model weights. This knowledge is organized as a Skill Bank of modular, retrievable skills, each encoding a self-contained set of tool-use rules and behavioral guidelines. TRACE evolves this bank through an agentic self-evolution loop: after each evaluation round, it groups trajectories by the skills invoked and refines each skill by contrasting successful and failed behaviors. The updated bank then guides subsequent rounds, while during deployment the Actor performs state-conditioned skill orchestration at every turn. On GPT-5.5, TRACE improves consistency (Pass^3) by 34.6 points, from 59.9% to 94.5%, while shrinking the gap between potential and reliable performance to just 4.0 points. On the official hidden set, TRACE achieved first place using GPT-5.6-Sol, attaining a Pass^3 score of 70%-a 40% relative improvement over the baseline. These results show that TRACE converts high model potential into stable, consistent performance gain. Project homepage: this https URL.

81. 【2608.22772】SPOC-SQL: Stage-wise Preference Optimization for Controllable Text-to-SQL

链接：https://arxiv.org/abs/2608.22772

作者：Yingnan Chen,Chun Ding,Tianshi Xu,Xu Yang,Si Wu

类目：Computation and Language (cs.CL)

关键词：translate natural language, natural language questions, executable SQL queries, requiring multi-stage structured, multi-stage structured reasoning

备注：

点击查看摘要

Abstract:Text-to-SQL aims to translate natural language questions into executable SQL queries over relational databases, requiring multi-stage structured reasoning over database schemas and query constraints. However, existing methods treat this task as single-step generation, where models optimize entire SQL sequences without targeted feedback at key decision points and lack support for interacting with and controlling the intermediate generation process. To address this issue, we propose SPOC-SQL, which decomposes Text-to-SQL into four sequential subtasks following standard SQL execution logic and designs stage-specific optimization strategies for the model to learn key decisions. Specifically, we propose the implementation of fine-grained preference optimisation at key decision points across SQL stages, with the objective of enhancing structured decision-making during query construction. Furthermore, a structured decomposition strategy is designed, facilitating stage-wise intervention and correction through explicit intermediate representations. This results in more controllable and reliable SQL generation. Experiments demonstrate that incorporating stage-wise human knowledge consistently improves performance, validating the effectiveness of stage perception controllable generation.

82. 【2608.22770】DelistBench: Evaluating Search-Enabled LLMs for Auditable Corporate-Event Database Completion

链接：https://arxiv.org/abs/2608.22770

作者：Xuan Yao,Li Shuping,Dai Yang,Zhou Yi,Ke-Wei Huang

类目：Computation and Language (cs.CL)

关键词：misclassified corporate-event records, Financial institutions, detect missing, vendor databases, misclassified corporate-event

备注：

点击查看摘要

Abstract:Financial institutions need an independent way to detect missing, stale, and misclassified corporate-event records in vendor databases. We introduce Search-to-Record, a database-assurance task in which search-enabled large language models reconstruct institution-defined event records from public sources for a known security universe and historical cutoff, and DelistBench, a 1,200-record benchmark for security-level delisting announcements. We evaluate five models in paired closed-book and web-enabled conditions. Web access raises announcement-date accuracy within seven days by 34.0 to 48.0 percentage points and event-status accuracy by approximately 2.8 to 21.7 points; the best system achieves 81.5% overall joint accuracy within seven days. Economy web systems achieve 75.9-78.3% overall joint accuracy within seven days at 4.5-6.6% of the API cost of the most expensive web system. Risk-based triage identifies low-error subsets, although the highest-coverage operating point still sends 27.3% of the balanced test set to review. The evaluation identifies web retrieval as the main source of timing gains and shows that low-cost systems can approach the best system's accuracy. Together, Search-to-Record, DelistBench, and the evaluation provide concrete deployment guidance: calibrate triage to local event prevalence and market mix, preserve positive-event recall, and route positive and ambiguous cases to targeted review.

83. 【2608.22761】Don't Repeat Yourself: Stopping Verbatim Loops at Sampling Time

链接：https://arxiv.org/abs/2608.22761

作者：Philipp Emanuel Weidmann,Allen Roush,Judah Goldfeder,Sanjay Basu,Ravid Shwartz-Ziv

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Large Language Models, Large Language, Language Models generate, generate text autoregressively, prone to verbatim

备注：

点击查看摘要

Abstract:Large Language Models generate text autoregressively, but open-ended generation is prone to verbatim looping, in which models repeat spans already present in context. Standard defenses such as repetition, presence, and frequency penalties and n-gram blocking act on token recurrence rather than the sequential structure of a loop, and often suppress looping only at strengths that also degrade formatting or fluency. We propose Don't Repeat Yourself (DRY), a sampling-time logit adjustment that penalizes a candidate token only when generating it would extend the current suffix into an exact continuation of a span seen earlier in the context. Sequence breakers protect chat templates and formatting tokens. Across models from 1.5B to 120B parameters, nine prompt families, and a 600-pair human study, DRY reduces suffix-extension rate by 47% while improving lexical diversity. An intervention-matched placebo produces no comparable reduction, identifying suffix matching as the operative mechanism. On AWQ-quantized 70B and 120B models, DRY reduces loop rate by roughly half while preserving MT-Bench, MMLU, and GSM8K performance, whereas standard alternatives lose measurable ground. DRY has been adopted by popular open-source LLM inference frameworks including this http URL, ExLlamaV2, and text-generation-webui, highlighting its practical impact on text generation.

84. 【2608.22758】XTC: Head-Aware Sampling by Excluding Top Choices

链接：https://arxiv.org/abs/2608.22758

作者：Philipp Emanuel Weidmann,Allen Roush,Judah Goldfeder,Sanjay Basu,Ravid Shwartz-Ziv

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Standard decoding rules, full next-token distribution, language models promote, autoregressive language models, Standard decoding

备注：

点击查看摘要

Abstract:Standard decoding rules for autoregressive language models promote diversity by rescaling the full next-token distribution or truncating its low-probability tail. These strategies overlook a common regime of open-ended generation in which several continuations are plausible but too much probability mass remains concentrated on the most generic choice. We introduce XTC (Exclude Top Choices), a lightweight head-aware decoding operator that targets this regime directly. XTC identifies tokens whose probabilities exceed an absolute plausibility threshold $\tau$: when at least two qualify, it removes the dominant eligible choices with probability $\rho$ and retains only the weakest plausible alternative before renormalization. Across 60 experiments on Gemma 3 27B Q4, Gemma 3 12B Q6, and DeepSeek R1 14B Q6, with scaling validation on Llama 3.3 70B Q4, XTC improves the diversity-repetition Pareto frontier. On creative generation, Distinct-2 increases by 11--15% and repeat trigrams decrease by 27--47% across the four models. Combined with temperature scaling, gains reach 38% in Distinct-2 and 71% in repeat-trigram reduction over baseline. A blinded Amazon Mechanical Turk study with 150 Master raters yields a 62.3% creativity preference for XTC ($p10^{-4}$) without reduced fluency, while a GPT-4o control judge reproduces the Anthropic-judge direction on every measure. On IFEval with Llama 3.3 70B Q4, XTC preserves prompt-level strict accuracy within 1.7 percentage points of baseline while recovering most of the diversity gain; a temperature setting matched on Distinct-2 reduces IFEval by 8.8 points. The effect is additive with temperature and repetition penalties, robust across quantization levels and model families, and consistent across twelve prompt genres. XTC has been adopted by this http URL, ExLlamaV2, and text-generation-webui.

85. 【2608.22753】Beyond Factual Knowledge: Benchmarking and Learning Step-Level Procedural Rule Reasoning in Large Language Models

链接：https://arxiv.org/abs/2608.22753

作者：Bohan Yu,Pengfei Cao,Chen Han,Chenxi Zhou,Zhiheng Zhang,Zhiyang Xie,Wenhao Teng,Xiangwen Liao,Jun Zhao,Kang Liu

类目：Computation and Language (cs.CL)

关键词：apply externally provided, externally provided procedural, provided procedural rules, excel at text, understanding and generation

备注： Accepted by EMNLP 2026 Findings

点击查看摘要

Abstract:Large language models (LLMs) excel at text understanding and generation, yet still struggle to reliably understand and apply externally provided procedural rules at scale. To evaluate this capability, we introduce RuleWorld, a large-scale benchmark that reformulates rules as globally reusable abstract units rather than instance-specific facts. In RuleWorld, several scenarios, including single-rule, parallel multi-rule, and multi-hop reasoning, are settled for comprehensive evaluation. We further propose DynaRule, an end-to-end framework that injects the given rules into the KV cache and turns retrieval into an internal, learnable, step-wise process. Specifically, DynaRule employs Stacked Step-Level Attention Training with a special search token to enable dynamic rule re-attention and updating during inference. In this way, the model can re-attend to the most relevant rules at each step, dynamically replacing outdated ones to support more stable multi-step reasoning. Experiments on RuleWorld show that existing LLMs face challenges under large rule pools, while DynaRule improves average QA accuracy by up to 19 points and achieves over 85% Recall@1 at 10K rules, outperforming strong baselines by large margins. We make our code and dataset available here: this https URL.

86. 【2608.22745】DiaRelay: Relaying Dialogue Context with a Constant-Size Memory for Emotion Recognition in Conversation

链接：https://arxiv.org/abs/2608.22745

作者：Zihao Zhou,Bin Yang,Jinghui Qin,Kebing Jin

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Emotion Recognition, Recognition in Conversation, distant dialogue turns, Relay Memory, Relay Memory Transition

备注：

点击查看摘要

Abstract:Emotion Recognition in Conversation (ERC) requires models to identify subtle emotional cues that are often distributed across distant dialogue turns. Existing methods typically incorporate dialogue history through a fixed context window. However, short windows discard potentially useful long-range evidence, while enlarging the window repeatedly re-encodes overlapping utterances, increases computational and memory costs, and may introduce irrelevant context. Moreover, commonly used parameter-efficient adaptation methods, such as LoRA, mainly introduce fixed low-rank transformations in the feature space and do not explicitly maintain a dialogue-level state or condition their transformations on the evolving conversational context. To address these limitations, we propose a lightweight adapter, DiaRelay, to enable LLMs to explicitly maintain a dialogue-level memory for accurate ERC. Based on LoRA, DiaRelay introduces two extra tightly collaborative components, Selective Relay Memory Transition and Dual-axis Relay Memory Read. Selective Relay Memory Transition progressively aggregates useful historical evidence into a bounded relay memory and propagates it across successive utterance predictions. This allows earlier emotional cues to influence later predictions after they leave the local context window, without re-encoding the complete dialogue history or expanding the backbone context length. Dual-axis Relay Memory Read uses the propagated memory to dynamically modulate low-rank feature transformations, enabling context-dependent representation adaptation without test-time gradient updates. Extensive experiments show that DiaRelay can achieve SOTA weighted F1 and accuracy on MELD while obtaining competitive results on IEMOCAP with only an extra 7.1M trainable parameters, indicating the effectiveness and generalizability of our DiaRelay in enhancing LLM-based emotional understanding.

87. 【2608.22713】A Source-Grounded Framework for Constructing and Evaluating Progressive Multimodal Diagnostic Dialogues from Clinical Case Reports

链接：https://arxiv.org/abs/2608.22713

作者：Yufan Wang,Rui Yang,Yi Liu,Yi Lin,Yifan Peng

类目：Computation and Language (cs.CL)

关键词：requires progressive integration, physical examination, laboratory findings, patient history, diagnostic-informative tests

备注： Accepted to IEEE HealthCom 2026, Distinguished Invited Papers Track

点击查看摘要

Abstract:Clinical diagnosis requires progressive integration of patient history, physical examination, laboratory findings, medical images, and diagnostic-informative tests. However, most multimodal medical benchmarks evaluate fixed inputs or endpoint answers, while fully interactive diagnostic agents conflate evidence selection with evidence interpretation. We present a source-grounded framework to construct progressive multimodal diagnostic dialogues from case reports and an evaluation strategy for assessing MLLMs on final diagnosis, diagnostic reasoning, and image-finding interpretation. Evaluation on 24 internal medicine case reports showed that our framework can accurately convert case reports into reference dialogues, achieving a diagnosis F1 of 0.99 and a reasoning-quality score of 4.79 out of 5. Evaluation on two frontier MLLMs (o4-mini and Claude Haiku 4.5) achieved reasoning-quality scores of 2.75 and 2.50, respectively, with substantially lower diagnosis, reasoning, and image-finding F1 scores. The results demonstrate that fluent responses do not necessarily reflect evidence-grounded clinical reasoning and highlight the utility of the proposed framework for evaluating multimodal diagnostic reasoning.

88. 【2608.22704】WnW: Waxing-and-Waning KV Cache for Long-Form Speech LLMs

链接：https://arxiv.org/abs/2608.22704

作者：Yiming Yao,Chenyang Lyu,Xuanfan Ni,Longyue Wang,Weihua Luo,Yazheng Yang,Jinsong Su

类目：Computation and Language (cs.CL); Sound (cs.SD)

关键词：dominant memory cost, audio inputs make, Long-form audio inputs, speech LLMs, inputs make

备注： Accepted at EMNLP 2026 Main Conference. 8 pages, 5 figures

点击查看摘要

Abstract:Long-form audio inputs make the KV cache the dominant memory cost of speech LLMs. Prefill-only KV compression methods permanently discard audio KV positions once evicted, with no pathway to recover them during decoding. We show this is fragile on long-form audio: prefill attention concentrates near the audio start (an attention-sink effect), while decode-time attention distributes broadly, and the two rankings overlap weakly. We propose WnW (Waxing-and-Waning KV cache), which classifies KV-heads into anchor, tidal, and fixed roles via offline calibration. Anchor heads remain on GPU and serve as a decode-time importance observer; tidal heads keep a CPU-resident complement that is recalled chunk-by-chunk based on aggregated anchor-head scores; fixed heads keep only an on-GPU subset, with the rest permanently discarded. On LibriSpeech-Long with two 3B backbones (Voxtral-mini-3b and Qwen2.5-Omni-3B), WnW preserves near-Full-Cache accuracy while keeping only 20% of audio tokens on GPU, where prefill-only baselines fail to terminate. Results generalize across language, task, and domain shifts, and CPU-GPU recall adds little decode-time overhead in our measurements.

89. 【2608.22695】Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing

链接：https://arxiv.org/abs/2608.22695

作者：Nazib Sorathiya,Daniel Zhang,Bardiya Akhbari

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：MATS components, thousands of MATS, ecosystems now include, include thousands, Models

备注： 11 pages, 4 figures, and 12 tables

点击查看摘要

Abstract:Agent ecosystems now include thousands of MATS components (Models, Agents, Tools, and Skills), yet their discovery still relies on in-context routing. These systems read a registry (names, hints, or descriptions, as context budget permits), pick a candidate, invoke it, and retry on failure. This pattern degrades with scale, and registries are growing fast. We recast capability discovery as search over a registry by defining an offline enrichment step that turns sparse metadata into searchable profiles, and an online retrieve-then-rank pipeline that returns a ranked shortlist without invoking any candidates online. We show that from N=10 to 7,278 capabilities, in-context routing's top-1 accuracy (Match@1) collapses (0.85 to 0.12), while retrieve-then-rank degrades more gently (0.81 to 0.39) because its reranker still ranks the right capability first 0.70-0.87 of the time once retrieval finds it. In the Nova Micro sweep, the crossover is around N=500. We compare against two in-context baselines. Full-Ctx puts the whole registry in the prompt and asks the LLM to pick. SearchPick gives the LLM a search tool to narrow candidates before it picks. At full scale the pipeline leads SearchPick by 6.5 percentage points (pp) on Match@1 at about half the cost. It reduces cost 70x versus Full-Ctx. We use a fixed configuration (same enrichment, retriever, and scorer weights) across agent, tool, and skill registries. The pipeline runs in production as the default capability-discovery layer of a large-scale multi-agent platform.

90. 【2608.22651】Iteration Without Elaboration: A Simple ReAct Architecture Suffices for Text-to-SQL Generation

链接：https://arxiv.org/abs/2608.22651

作者：Jian Lu,Haiwei Yu,Raymond M Xiong,Anru Zhang,Danyang Zhuo

类目：Computation and Language (cs.CL)

关键词：multi-stage refinement pipelines, retrieval-augmented prompting, relying on schema-linking, schema-linking modules, refinement pipelines

备注： 19 pages; preprint

点击查看摘要

Abstract:Modern text-to-SQL systems have become increasingly elaborate, relying on schema-linking modules, retrieval-augmented prompting, candidate generation, and multi-stage refinement pipelines. While effective, these additions introduce substantial latency and engineering overhead. To this end, we present \textbf{ReAct-SQL}, a simple yet effective zero-shot ReAct-style framework built solely on iterative reasoning and a constrained action space defined by a typed Domain-Specific Language (DSL) of 15 relational operations, rather than free-form SQL generation. The model incrementally issues DSL calls, observes compiled-SQL execution feedback, and revises its reasoning through interaction. On corrected BIRD mini-dev and EHR-SQL, ReAct-SQL achieves \textbf{84.5\%} and \textbf{73.9\%} accuracy, respectively, matching substantially more elaborate baselines while running up to $8\times$ faster. Incremental ablations further show that iteration primarily improves grounding, while the DSL improves compositional reliability.

91. 【2608.22634】GeoRisk-RAG: A Hierarchy-Aware Risk Framework for Improving RAG Reliability through Selective Answering

链接：https://arxiv.org/abs/2608.22634

作者：Meenu Ravi,Shailik Sarkar,Lulwah AlKulaib,Yordanos Tessema,Chang-Tien Lu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：large language model, primarily leveraged Retrieval-Augmented, leveraged Retrieval-Augmented Generation, knowledge-graph augmentation, language model

备注： Accepted for CIKM '26 conference

点击查看摘要

Abstract:Current work on improving reliability in large language model (LLM)- generated answers has primarily leveraged Retrieval-Augmented Generation (RAG), knowledge-graph augmentation, and reinforcement learning. While these methods are adept at enhancing and measuring reliability through semantic similarity and faithfulness, they often struggle to distinguish semantic similarity from geographic validity. This is especially critical in natural hazard management domains where geographic granularity (i.e., town vs. city vs. state) is significant for decision-making, as responses valid in one municipality may not transfer to another. In such domains, a confidently wrong answer carries greater risk than abstaining. We present GeoRisk-RAG, a novel hierarchy-aware framework that addresses this geographic-validity gap through selective answering. This framework explicitly estimates geographic applicability using a Directed Acyclic Graph (DAG)-based distance for context retrieval before response generation. Experiments on a novel held-out wildfire-related question-answering (QA) dataset show that GeoRisk-RAG significantly reduces false confidence rates for location-dependent questions, lowering the rate to 0.009 compared with ~0.090 for standard semantic similarity and reranking baselines, while consistently achieving higher human preference alignment. This work provides a more comprehensive assessment of end-to-end RAG pipelines by integrating geographic validity and selective-answering behavior for safer decision-making in geospatial domains.

92. 【2608.22622】aching LLMs How ICU Physicians Approach Clinical Reasoning Through OMOP-Aligned Retrieval Improves Reasoning Across Clinical Domains

链接：https://arxiv.org/abs/2608.22622

作者：Miguel Contreras,Scott Siegel,Subhash Nerella,Jessica Sena,Jiaqing Zhang,Heng Sun,Hruday Tej Akkaladevi,Peiyu Lu,Jordan Rosen,Sumit Kapoor,Sasank Desaraju,Grace R. Thompson,Jacob Purcell,Michael Petrauskis,Philip KW. Hong,Meghan Brennan,Sarah Chrabaszcz,Tierra Smith,Ronnie Ren,Michel S. Kabbash,Ceyhun Haziroglu,Rushi Patel,Gabriel Gomez,Charlotte Chaiklin,Randy Leung,Kenneth N. John,Whitman Wiggins,Philip Kayser,Vincent Bird,Maria Bruzzone,Tyler J. Loftus,Azra Bihorac,Parisa Rashidi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：identifying relevant patient, rapidly changing intensive, Clinical decision-making relies, intensive care unit, changing intensive care

备注：

点击查看摘要

Abstract:Clinical decision-making relies on identifying relevant patient information to guide diagnosis and treatment, a challenge that is especially difficult in the data-dense and rapidly changing intensive care unit (ICU). Large language models (LLMs) could support this task. However, existing applications and datasets mostly emphasize surface-level retrieval or factual recall rather than the inductive and deductive reasoning clinicians practice to select and reason over decision-relevant evidence. We hypothesized that training LLMs on expert ICU reasoning could yield clinical reasoning skills that generalize beyond critical care. Here we introduce ICU-REACT, a reasoning dataset developed with 19 clinicians through a clinician-in-the-loop framework to teach LLMs to perform information retrieval and context-aware clinical reasoning in the ICU. Using ICU-REACT, we fine-tuned Clin-REACT models spanning 8B-70B parameters and three model families. Across five clinical reasoning benchmarks, Clin-REACT consistently outperformed its backbone models and open-source general-purpose and medical LLMs. Gains extended to different tasks including script concordance tests, and downstream diagnosis and treatment tasks. These findings suggest that expert reasoning supervision in critical care can improve broader clinical reasoning, although prospective evaluation is needed before real-world clinical use.

93. 【2608.22586】Vision-Language Models for Occupational Physical Exposure Assessment: Estimating External Hand Forces in Manual Material Handling Tasks from RGB Video

链接：https://arxiv.org/abs/2608.22586

作者：Mohammad Sadra Rajabi,Aanuoluwapo Ojelade,Sunwook Kim,Maury A. Nussbaum

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：manual material handling, typically requires instrumented, External hand forces, requires instrumented objects, bilateral external hand

备注：

点击查看摘要

Abstract:External hand forces are important inputs to biomechanical analyses of occupational physical exposure and injury risk, yet continuous force measurements during manual material handling (MMH) typically requires instrumented objects or specialized sensing. We evaluated a vision-language model (VLM)-based pipeline that combines task-specific textual cues, visual representations, and known box mass to estimate dynamic, triaxial, bilateral external hand forces from RGB video. Thirty-five healthy young adults performed five MMH tasks involving lifting, carrying, pushing, and pulling with box masses of 6, 9, and 12 kg. The pipeline used text-guided localization of participant and handled-object regions of interest (ROIs), pretrained vision-transformer feature extraction, and transformer-based temporal regression. Performance was evaluated using leave-one-subject-out validation across seven camera-view conditions (three single-view and four multi-view conditions) and four ROI strategies. Overall, root mean square error was ~4.7-5.6 N for the horizontal and mediolateral force components and ~10.6-11.0 N for the vertical component. Including the handled object as a second ROI generally improved force estimation, with some of the largest benefits under single-camera conditions, whereas pixel-level segmentation provided little additional improvement. Multi-camera capture provided the clearest benefit for peak-force estimation, particularly for the vertical component, whereas differences in overall frame-level error among camera configurations were comparatively modest. These findings demonstrate the feasibility of estimating continuous, bilateral, directional hand-force estimates from RGB video and known load mass without requiring sensors on the worker or handled objects as model inputs, supporting the development of more scalable occupational physical exposure and risk assessments.

94. 【2608.22582】Hybrid Panels: Toward Human-AI Collaboration in Survey Research

链接：https://arxiv.org/abs/2608.22582

作者：Julia Romberg,Tobias Gummer,Gabriella Lapesa,Tanja Kunz,Claudia Wagner

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

关键词：including declining response, declining response rates, generating robust social, Large-scale population surveys, face significant challenges

备注： 15 pages, under review

点击查看摘要

Abstract:Large-scale population surveys are essential for generating robust social and scientific insights, yet they face significant challenges, including declining response rates, increasing data collection costs, long delays between data collection and data provision, and the risk of nonresponse bias. Advances in artificial intelligence (AI) have opened up new opportunities for AI-supported survey infrastructures where the goal is to overcome these challenges without limiting the data quality. A promising AI-enabled survey infrastructure for which we build a first pilot is a hybrid panel. A hybrid panel is a longitudinal AI-enabled survey which allows to iteratively improve the alignment between large language models (LLMs) and the population they aim to simulate and use the errors to inform the design and implementation of the next survey wave (e.g., inform the participant recruitment, assignment of questions to participants). It incorporates both human participants and LLMs as fundamental elements of its design. In this research note, we introduce the concept of a hybrid panel by providing a definition and outlining an overarching framework, spanning data collection to data validation. We detail results from a first pilot study to illustrate (open) challenges that we identify for hybrid panels.

95. 【2608.22566】From Diagnosis to Redesign: Using Quantitative Ethnography to Improve Multi-Agent LLM Reasoning

链接：https://arxiv.org/abs/2608.22566

作者：Vedant Khatri,Anthony Cusimano,Zachari Swiecki,Zhen Xu,Xiner Liu,Renzhe Yu

类目：Computation and Language (cs.CL)

关键词：inherently guarantee coherent, Multi-agent large language, large language model, multi-agent LLM systems, redesigning multi-agent LLM

备注： Accepted at ICQE 2026 (to appear in Springer CCIS)

点击查看摘要

Abstract:Multi-agent large language model (LLM) systems are designed to improve reasoning by decomposing tasks across multiple agents with specialized functions, but the presence of multiple agents does not inherently guarantee coherent reasoning or outputs that align with task objectives. This paper introduces a quantitative ethnographic (QE) approach for diagnosing and redesigning multi-agent LLM systems based on the discourse produced through agent interactions. We test this approach using automated essay scoring as an example context, applying Epistemic Network Analysis (ENA) to model a five-agent multi-agent debate system and examine differences between debates that produced correct versus incorrect scoring decisions. Results show that, in the initial system, correct scoring decisions were characterized by rubric-grounded justification, agreement, and elaboration. Incorrect scoring decisions, in contrast, were characterized by extended proposition-challenge-response exchanges that were less consistently tied to rubric criteria. We then used the findings to revise the agents' prompts. The revised system improved exact scoring accuracy from 27.78% to 40.28% and shifted the discourse of incorrect debates toward the rubric-grounded pattern of correct ones, making the two nearly indistinguishable. Based on these results, we argue that QE can support a diagnostic-to-redesign loop for AI reasoning by tracing how patterns of agent interaction relate to system performance, informing prompt redesign, and evaluating whether those redesigns change both outcomes and interaction patterns.

96. 【2608.22559】ExecRubrics: Executable Tool-Augmented Rubrics for Verifiable and Efficient Long-Form Evaluation

链接：https://arxiv.org/abs/2608.22559

作者：Kaustubh D. Dhole,Charles L. A. Clarke,Eugene Y. Agichtein

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：decomposing response quality, make language-model evaluation, language-model evaluation transparent, aim to make, make language-model

备注： Accepted to EMNLP 2026 Findings

点击查看摘要

Abstract:Rubrics aim to make language-model evaluation transparent by decomposing response quality into interpretable criteria. However, natural-language rubrics are often ambiguous, require black-box LLM judges, and typically assume criteria aggregate independently through linear weighted sums, limiting their ability to capture dependencies, alternatives, penalties, and override conditions. We propose ExecRubrics, a framework for representing rubrics as compact executable programs. ExecRubrics encodes evaluation logic as verifiable Python scoring functions, giving natural-language rubric intent an operational semantics: a fixed decision procedure that can be inspected, executed, and edited. On three long-form response benchmarks-HealthBench, HelpSteer, and ArgQuality-we show that ExecRubrics can substitute for expensive black-box judges in ranking preferred over dispreferred responses, matching or improving NL rubric baselines with best preference accuracies of 53%, 78%, and 92%, respectively, while reducing evaluation latency by up to 320 times. We show that incorporating external logic and resources from text processing libraries such as NLTK and spaCy further improves preference accuracy. Our results suggest a novel way of looking at evaluation, by offering a faster, more explainable, and less ambiguous alternative to black-box rubric evaluation, particularly in high-stakes domains such as healthcare and banking where precision and auditability are critical.

97. 【2608.22557】BLADE: Bilevel Low-rank Augmented-Lagrangian Erasure for LLM Unlearning

链接：https://arxiv.org/abs/2608.22557

作者：Md Toufikuzzaman,Ahmad Mousavi,Dongwon Lee

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Existing LLM unlearning, degrade model coherence, difficulty shifts mid-training, Existing LLM, losses degrade model

备注： To Appear in EMNLP 2026

点击查看摘要

Abstract:Existing LLM unlearning methods struggle with robustness: unbounded forget losses degrade model coherence, fixed-weight balancing cannot adapt as retain difficulty shifts mid-training, and methods that work on one benchmark falter under scaling or repeated application. We propose BLADE, a constrained bilevel framework whose three mechanisms give smooth, predictable control over the optimization landscape: a clamped-entropy forget loss whose gradient is exactly zero once a token reaches sufficient uncertainty; an asymmetric augmented Lagrangian that permanently ratchets retain protection after any violation; and a bilevel structure confined to LoRA adapters that repairs retain damage before each forgetting step. BLADE dominates across three benchmark families, improving average composite scores over the strongest baselines by $6$% on TOFU, $9$% on MUSE Books, and $7$% on KnowUndo, and it remains stable under $4\times$ scaling and $4$ sequential unlearning steps on MUSE News where the best competing method collapses entirely.

98. 【2608.22516】RACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding

链接：https://arxiv.org/abs/2608.22516

作者：Pengyiang Liu,Junbo Niu,Xiaoyang Hu,Zhongyue Shi,Zitian Wang,Linjiang Huang,Si Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Event Counting items, frames, evidence intervals, Event Counting, Temporal Ordering

备注： Accepted to EMNLP 2026 Main Conference. 19 pages, 5 figures, 6 tables. Project page: [this https URL](https://buaa-colalab.github.io/TRACE/)

点击查看摘要

Abstract:A long-video answer is evidence-supported only when the frames decoded from the video cover every event the answer depends on. Existing evaluations score final-answer correctness or predicted evidence intervals, but the frames a method decodes before answering are rarely audited, so correct answers can still rest on incomplete observation. We introduce VES-Bench, a 600-question benchmark of Temporal Ordering and Event Counting items over 348 public long videos. Each item carries a jointly necessary set of evidence intervals, letting us audit at three strictness levels whether a method's decoded frames cover every one of them. We also propose TRACE, a training-free agent that grounds answers in raw visual clips, builds an evidence bundle round by round, and stops only when the answer stabilises as the bundle grows and a final pass over the same clips returns the same answer. Under a same-backbone audit, TRACE answers 50.7% of questions correctly with at least two decoded frames inside every evidence interval, at 98.7 frames per question: over 10 points above uniform decoding at 128 frames (40.2%), and within 2.6 points of uniform decoding at 256 frames at 0.39x its frame cost, while reaching the highest answer accuracy in the audit (63.5%). TRACE also stays competitive on Video-MME (86.1), LVBench (75.6), and LongVideoBench (75.1).

99. 【2608.22506】Kernel Token Contradiction: a Fast and Principled Approach for LLM Claim Uncertainty Quantification

链接：https://arxiv.org/abs/2608.22506

作者：Jérémie Dentan,Alexi Canesse,Mahammed El Sharkawy,Sonia Vanier

类目：Computation and Language (cs.CL)

关键词：Claim-level Uncertainty Quantification, Large Language Models, reliability of Large, Uncertainty Quantification, Large Language

备注： Preprint. Under review

点击查看摘要

Abstract:Claim-level Uncertainty Quantification (UQ) aims to mitigate the lack of reliability of Large Language Models (LLMs) by evaluating the factuality of each claim in their outputs. We introduce Kernel Token Contradiction (KTC), a lightweight approach to compute claim-level UQ under realistic white-box conditions. KTC represents the candidate tokens involved in LLM generation as a positive semi-definite kernel that integrates both the LLM's conditional distribution and a token contradiction score. We then use the Von Neumann entropy to quantify the uncertainty of this kernel. To estimate token contradiction, we develop a new approach based on frequency statistics from the Wikipedia corpus. Although CPU-only, our approach achieves over an 8.2x speedup compared to state-of-the-art GPU-accelerated methods based on cross-encoders, and over a 65x speedup compared to CPU-only methods with comparable performance. Our evaluation spans two benchmarks across four European languages and 16 different models. KTC not only matches the average performance of existing methods but also outperforms them in high-precision regimes. This combination of computational efficiency and accuracy makes real-time monitoring of LLM outputs practical in production.

100. 【2608.22490】Who Pays More for Safety? Measuring the Disparate Cost of Safety Alignment across Languages

链接：https://arxiv.org/abs/2608.22490

作者：Chanwoong Yoon,Jungsoo Park,Alan Ritter

类目：Computation and Language (cs.CL)

关键词：Safety alignment, Safety Cost, reduces response utility, Safety, adhere to human

备注： Accepted to EMNLP 2026 Main Conference

点击查看摘要

Abstract:Safety alignment helps models adhere to human values, but it often reduces response utility. We ask a critical but understudied question: Does safety alignment impose the cost equally across language groups? To answer this, we introduce a rigorous protocol to measure the utility loss imposed solely by safety alignment, which we term Safety Cost. Through direct pairwise comparisons between safety-aligned models and their unaligned counterparts, we find a systematic inequity: non-English users consistently bear a higher Safety Cost than English users. We further identify three underlying patterns. First, multiple languages lie in a double-penalty zone, experiencing both weaker safety protection and larger utility loss. Second, certain languages exhibit apparent utility gains that are in fact a consequence of safety filters failing to engage. Third, even high-resource languages pay a larger Safety Cost than English to reach the same level of safety. We show that these disparities arise from both explicit refusals and implicit qualitative differences across multiple dimensions. By accurately measuring the disparate effects of safety alignment, our findings expose a systematic disparity in current safety alignment practices.

101. 【2608.22483】Claim-Level Confidence Calibration for Reliable Decision Making with Large Language Models

链接：https://arxiv.org/abs/2608.22483

作者：Toghrul Abbasli,Kentaroh Toyoda,Yuan Wang,Li Chen

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, increasingly support decision-making, Language Models, increasingly support

备注： In Proceedings of The 5th Workshop on Uncertainty Reasoning and Quantification in Decision Making (held in conjunction with ACM SIGKDD 2026), Jeju, Korea

点击查看摘要

Abstract:Large Language Models (LLMs) increasingly support decision-making in high-stakes domains, but they often hallucinate and express confidence that is misaligned with factual correctness. Response-level confidence is a coarse signal: a single generation can mix correct and incorrect statements, so a single number is not actionable for users that must accept, reject, or verify individual pieces of information. We study claim-level confidence calibration as a decision-relevant uncertainty signal: each response is decomposed into atomic, verifiable claims, and each claim is assigned a calibrated confidence using inference-time signals from consistency across samples and self-verification. Our framework operates in closed-box settings (no logits, no fine-tuning) and applies post-hoc calibration directly at the claim level, enabling selective intervention such as evidence retrieval or human review for low-confidence claims. Across TriviaQA and TruthfulQA we evaluate seven baselines on six recent models (Llama-3.1, Mistral, Qwen2.5, DeepSeek-R1, GPT-4, GPT-4o), and show that claim-level decomposition combined with post-hoc calibration reduces expected calibration error on factual questions while exposing failure modes on adversarial false-premise questions where decision-makers most need reliable uncertainty estimates.

102. 【2608.22479】GTA-RAG: Graph-Trajectory-Augmented Reinforcement Learning for Multi-Turn Retrieval-Augmented Reasoning

链接：https://arxiv.org/abs/2608.22479

作者：Jun Chen,Yongchao Liu,Pengyu Qiu,Jiajun Zheng,Juelu Zhang,Yujie Zeng,Qin Zhang,Ziyue Qiao,Xiao Luo

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：access external knowledge, answering knowledge-intensive questions, multi-turn retrieval-augmented reasoning, enables LLMs, Retrieval-augmented generation

备注： 11 pages, 5 figures. Accepted to EMNLP 2026 Fundings

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) enables LLMs to access external knowledge for answering knowledge-intensive questions. For complex multi-hop questions, multi-turn retrieval-augmented reasoning extends RAG into an iterative process that repeatedly searches for and integrates evidence across documents. However, existing reinforcement-learning (RL) approaches for agentic RAG are typically optimized with final-answer rewards, which provide sparse supervision and overlook whether the model actually retrieves the required evidence chain. We present \textsc{GTA-RAG}, a graph-trajectory-augmented RL framework for multi-turn retrieval-augmented reasoning. From an entity--document graph, we sample connected document paths, synthesize multi-hop QA trajectories, and validate them with the deployed retriever to obtain executable trajectory-level supervision. We then optimize the retrieval policy with Group Relative Policy Optimization (GRPO) and a trajectory-guided reward that encourages both accurate answers and acquisition of target evidence documents, followed by answer-reward training on natural QA instances. Experiments on three multi-hop and two simple QA benchmarks show that \method{} consistently outperforms RL-based RAG baselines with both Qwen2.5-3B and Qwen2.5-7B backbones, while substantially improving evidence-chain coverage. Our code is available at this https URL.

103. 【2608.22472】Small Reasoning Models are Instruction Followers in Function Calling

链接：https://arxiv.org/abs/2608.22472

作者：Yalda Taheri,Mohammad Hassan Heydari,Erfan Naaman,Afsaneh Fatemi

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：agentic large language, Function calling, large language models, Function calling represents, calling

备注：

点击查看摘要

Abstract:Function calling represents the core capability of agentic large language models (LLMs). Existing research has focused on enhancing LLMs function-calling accuracy through fine-tuning, reinforcement learning (RL), and multi-agent frameworks, particularly for native function-calling LLMs. This work demonstrates that LLMs achieve superior accuracy in function calling in instruction-following contexts (i.e., standard user-assistant interactions) rather than a tool calling context. We introduce Instruction-Followed Function Calling (IFFC), a novel framework that decouples function-calling logic from the primary LLM and delegates it to a dedicated smaller model operating within the instruction-following paradigm. Our method consistently outperforms both native function calling (NFC) and prompt-based function calling (PFC) baselines, with particularly strong gains on reasoning-oriented LLMs. Furthermore, we demonstrate that IFFC maintains robust performance under aggressive quantization, enabling efficient on-device deployment without significant accuracy degradation. This work establishes a new paradigm for reliable, resource-efficient function calling in edge-computing scenarios.

104. 【2608.22452】From Exposure to Expectation: Frequency, Surprisal, and Language Across Development in Spanish

链接：https://arxiv.org/abs/2608.22452

作者：Francisco Portillo López

类目：Computation and Language (cs.CL)

关键词：reliably predicts adult, reliably predicts, negative log-probability, Surprisal, Frequency

备注： 30 pages; 4 figures; 5 tables

点击查看摘要

Abstract:Surprisal, the negative log-probability a language model assigns to a word given its preceding context, reliably predicts adult reading times. Does it contribute as much to explaining when children acquire individual words? Frequency reflects a learner's cumulative exposure to a word, whereas surprisal reflects how predictable a single occurrence is given its context. We investigate this question across two corpus-based studies of Spanish. In Study 1, we modeled age of acquisition (AoA) for 225 Spanish nouns using lexical frequency and contextual diversity from child-directed speech, plus surprisal from three language models differing in architecture and training language (BETO, BERTIN, mGPT). Frequency strongly predicted AoA (r=-.597, p.001); surprisal added little beyond frequency and word length, including in a naturalistic-context analysis. In Study 2, we modeled adult fixation durations in the Chilean Spanish subsample of the Multilingual Eye-movement Corpus (MECO Wave 2), using mGPT surprisal alongside two independent frequency measures. Surprisal robustly predicted longer fixation durations after controlling for frequency and word length, consistent across both frequency sources. A matched word-type-level comparison showed the surprisal-behavior association was stronger in reading than in acquisition (z=3.63, p.001). The findings suggest cumulative lexical exposure and contextual predictability play different roles across the language trajectory: frequency is particularly informative about when early lexical representations are acquired, whereas surprisal captures moment-to-moment processing difficulty in an already-established linguistic system. We discuss this pattern in relation to usage-based and entrenchment-based accounts of lexical development and to the evaluation of language models as models of human language behavior.

Comments:
30 pages; 4 figures; 5 tables

Subjects:

Computation and Language (cs.CL)

Cite as:
arXiv:2608.22452 [cs.CL]

(or
arXiv:2608.22452v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.22452

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Francisco Portillo López [view email] [v1]
Sun, 23 Aug 2026 15:02:29 UTC (2,613 KB)

105. 【2608.22446】Figurative Justice: Detecting metaphors in Hindi judgements with qualitative assessment and transformers

链接：https://arxiv.org/abs/2608.22446

作者：Bhumika Bhattacharyya,Shouvik Kumar Guha,Indranil Dutta

类目：Computation and Language (cs.CL)

关键词：Hindi Legal Metaphor, Metaphor detection, legal, Hindi Legal, Hindi

备注： 12 pages, 5 figures, 2 tables. Dataset available at [this https URL](https://osf.io/z398e/)

点击查看摘要

Abstract:Metaphors are figurative use of words for conceptual mapping. Metaphor detection in the legal context has been crucial as metaphors are persuasive juridical means of creating legal meaning and concepts resulting in significant consequences. Metaphorical framing in legal discourse by judges, lawyers, and legislators brings about real-time implications upon individuals and influences judicial decision-making, argumentation and interpretation of laws. This is crucial in Human Rights infringement cases where language determines severity of punishment, public perception and judicial outcomes. While automatic metaphor detection in major languages like English, Spanish, Polish, Lithuanian have aided in understanding inherent intentions of metaphorical use of language, there is no such attempt in low-resource languages like Hindi. The dearth of annotated legal corpora in Hindi makes it difficult to develop NLP models and detect metaphors in judicial proceedings. In the Indian context, Convolutional Neural Networks (CNNs) have been used for classification of bail judgements, however there are no existing models designed for metaphor detection. We present a Hindi Legal Metaphor Corpus (HiLeMe) by isolating judgements from Hindi Legal Data Corpus (HLDC). Legal experts annotated HiLeMe to classify metaphorical constructions using the MIPVU schema. We downstreamed an mBERT on Hindi legal metaphor detection task. We built a transformer-based architecture for metaphor detection that are known to outperform traditional models in legal classification tasks. This model provides insights into the judicial psyche for decoding judicial decisions. Our research contributes to advancing automated models in legal discourse in low-resource languages like Hindi and envisages adoption into 22 Indian schedule languages.

Comments:
12 pages, 5 figures, 2 tables. Dataset available at this https URL

Subjects:

Computation and Language (cs.CL)

ACMclasses:
I.2.7

Cite as:
arXiv:2608.22446 [cs.CL]

(or
arXiv:2608.22446v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.22446

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

106. 【2608.22444】Aligned Alone, Misaligned Together: Forecasting Adversarial Capture in LLM Agent Populations

链接：https://arxiv.org/abs/2608.22444

作者：Isotta Magistrali,Chen Shani

类目：Computation and Language (cs.CL)

关键词：individual model, safety evaluation, increasingly deployed, deployed in interacting, population

备注：

点击查看摘要

Abstract:The unit of AI safety evaluation is still the individual model, yet language-model agents are increasingly deployed in interacting populations that read and write one another's decisions. This raises a question no single-agent audit can answer: an agent that is well-calibrated on its own may still be pulled toward a different decision by the agents around it. We study this on a security-triage task, where populations of language-model monitors decide whether to escalate or dismiss alerts, and into which we can inject a committed minority that always pushes one way. We find that two alerts a single agent judges almost identically on its own can drive collective behavior far apart, so auditing any one member need not reveal what the population will do. Yet that collective behavior can be predicted in advance. From a population's benign, adversary-free operation alone, we calibrate a response function that forecasts, before any attack is run, how far a committed minority will later move it. We then ask what shifts the outcome and find that letting agents see each other's reasoning neutralizes a weak attack, while only delaying it against a strong one, turning the question from whether the population converges on the adversaries' choice into when. Finally, we exclude the hypothesis of capture being an irreversible trap: once the committed agents are removed, the population drifts back toward where it began, so capture is a temporary state. Alignment in isolation is not alignment in a population, yet what a population will do under attack can be read in advance, from how it behaves before any adversary arrives.

107. 【2608.22432】Rank Reversal in Multilingual LLM Judges: A Label-Free Double-Centering Calibrator

链接：https://arxiv.org/abs/2608.22432

作者：Alhasan Mahmood,Samir Abdaljalil,Hasan Kurban

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：evaluator-backbone rankings depending, statistically significant pairwise, alternates across English, pairwise rank reversal, pairs show statistically

备注：

点击查看摘要

Abstract:Multilingual LLM judges produce different evaluator-backbone rankings depending on the prompt language: on an eight-language Agent-as-a-Judge benchmark, the top-ranked backbone alternates across English, Arabic, Chinese, Hindi, Japanese, Spanish, Turkish, and Swahili, and 7 of 15 backbone pairs show statistically significant pairwise rank reversal. We treat this as a measurement problem. The multilingual judge score decomposes additively into task difficulty, backbone skill, and a language-backbone interaction term, the last of which is recoverable without human labels by double-centering the cell-mean score matrix. We make this estimator (\textbf{Consensus-Based Calibration}, CBC) explicit, give an $O(1/\sqrt{n})$ finite-sample concentration bound with variance constant $(1-\tfrac{1}{m})(1-\tfrac{1}{k})$, and show that it is unbiased even when task-language interactions are present. Across 7{,}920 judge runs (6 backbones, 8 languages, 55 tasks, 3 frameworks), CBC raises held-out cross-task rank consistency $\tau$ from 0.650 to 0.902 and agrees with the held-out additive-model oracle in 100\% of per-language decisions versus 68.5\% raw; these are consistency diagnostics, not human-grounded correctness measures. On a separately collected M-RewardBench panel (7 languages, 1{,}500 items per language, 10{,}500 language-item instances, 5 evaluators), panel agreement with the public human gold preferences rises from 68.7\% to 76.6\% (gain 7.9 percentage points, 95\% CI $[6.0, 9.9]$), our strongest external evidence of downstream usefulness. The estimator is the standard two-way ANOVA interaction-recovery operation under sum-to-zero contrasts; our contribution is its application as a label-free post-hoc calibrator for multilingual LLM judges, an explicit finite-sample concentration bound, and an unbiasedness result that holds even under task-language misspecification.

108. 【2608.22425】All four leading LLMs talk more than they listen to personality-verified synthetic help-seekers

链接：https://arxiv.org/abs/2608.22425

作者：Pablo A. Fonseca,Raquel Rodríguez-Carvajal,Rafael A. Calvo

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Large language models, test sustained exchanges, Large language, moments of distress, distinguish between users

备注： 30 pages, 6 figures, 24 tables. Data and code: [this https URL](https://doi.org/10.82186/9aajj-vq030)

点击查看摘要

Abstract:Large language models are increasingly consulted at moments of distress, yet single-turn benchmarks neither test sustained exchanges nor distinguish between users. We built a personality-aware evaluation in which four widely used models advised several synthetic help-seekers, each given a psychometrically specified profile, in an acute crisis: a caregiver learning of a relative's dementia diagnosis. Auditors blind to the profile prompt recovered the specified bands from dialogue alone with high agreement on every instrument (ICC(2,4) = 0.91; 0.79-0.96 by instrument; band-score r = 0.78), as expected for the Big Five but equally for coping style, coping self-efficacy, resilience and reactance, which the lexical approach never covered. Such evaluation therefore reaches beyond the Five Factor Model to motivational, regulatory and self-appraisal dispositions. The four models were not distinguishable on emotion stabilisation and failed alike, sharing three modes: verbosity, a talk-to-listen ratio above one, and problem-solving before the situation had been explored.

109. 【2608.22417】LLMs for Survey Text Analysis - A Performance Comparison Between Humans and GPT-5 on Inductive Content Analysis

链接：https://arxiv.org/abs/2608.22417

作者：Leonardo Bergmann,Renata Gheorghiu,Ana Gvritishvili,Alex Mican,Chris Stewart,Topias Tolonen-Weckström

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

关键词：Large language models, Large language, analysis remains limited, language models, remains limited

备注：

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used to support text analysis in qualitative research, yet evidence on their performance in inductive content analysis remains limited. This study compares human and LLM-based inductive coding of open-ended survey responses from 903 answers across six variables from a European PhD student survey. Five human coders performed inductive content analysis following a standardized coding scheme, while an LLM (GPT-5.4) conducted the same task using an established prompting procedure. Agreement between human and LLM outputs was assessed using the Adjusted Rand Index (ARI). Results showed an alignment between humans and the LLM, with ARI values of 0.61 for coding and 0.54 for theme generation. These values were close to the internal consistency of coding and theme results within humans (ARI = 0.68) and the LLM (ARI = 0.76). Agreement varied widely across variables, with low within-entity consistency consistently linked to low between-entity agreement, underscoring the role of data characteristics and individual performance in reliability. Overall, the findings suggest that LLMs can approximate human coding in this case-specific setting, particularly at the coding level, and may serve as a scalable support tool for inductive qualitative analysis.

110. 【2608.22411】Don' t Box Me In: Dynamic Cultural Adaptation and Cognitive Tracking for Social Understanding

链接：https://arxiv.org/abs/2608.22411

作者：Chongyuan Dai,Yaling Shen,Shengeng Tang,Hui Ma,Jinpeng Hu

类目：Computation and Language (cs.CL)

关键词：equipping Large Language, Large Language Models, underline, increasingly takes place, individuals may draw

备注： EMNLP 2026 Findings

点击查看摘要

Abstract:Social interaction increasingly takes place in multicultural settings, where individuals may draw on multiple cultural influences and adapt their communicative behavior across contexts. Despite recent advances in equipping Large Language Models (LLMs) with social understanding capabilities, existing approaches often model culture as a static demographic attribute, limiting their ability to accommodate hybrid and dynamically expressed communicative preferences. Therefore, in this paper, we propose \textbf{DyCAC}, a training-free framework that achieves fluid social alignment by incorporating \underline{Dy}namic \underline{C}ultural \underline{A}daptation with continuous \underline{C}ognitive tracking. Rather than inferring a fixed cultural identity, DyCAC models culturally relevant communicative preferences as a time-varying mixture of population-level cultural reference profiles. This reference-based representation is further calibrated using dialogue-style signals observed in the ongoing interaction, enabling the model to capture both composite cultural influences and turn-level shifts in communicative behavior. In parallel, a memory module driven by Theory of Mind (ToM) continuously tracks the cognitive states of the interlocutor. Extensive experiments on interactive social and cultural benchmarks demonstrate the superiority of our approach. The proposed framework outperforms existing baselines, exhibiting enhanced social intelligence and broad adaptability across varied multicultural contexts.

111. 【2608.22390】SchemaGUI: A Schema-Driven Benchmark for Controllable GUI Generation Evaluation

链接：https://arxiv.org/abs/2608.22390

作者：Jiarui Dong,Yin Cai,Zhouhong Gu,Chenmou Wu,Ci Tao,Yiran Chen,Jialing Li,Xiaoran Shi,Juntao Zhang,Zhijun Fang

类目：Computation and Language (cs.CL)

关键词：uncontrolled data distributions, demonstrated strong potential, Large language models, graphical user interface, remains challenging due

备注： 18 pages, 6 figures, and 7 tables. Code is available at [this https URL](https://github.com/xdong2002/SchemaGUI)

点击查看摘要

Abstract:Large language models (LLMs) have demonstrated strong potential in graphical user interface (GUI) generation, but reliable evaluation remains challenging due to uncontrolled data distributions, noisy annotations, and limited layout scenario coverage. To address this, we propose SchemaGUI, a template-based benchmark for controllable GUI generation evaluation. By synthesizing paired natural language instructions and deterministic function-call references from parameterized interface schemas, SchemaGUI can generate thousands of deterministically annotated tasks in seconds without human labeling. Based on 1,000 evaluated instances per scenario and language across six representative bilingual scenarios, we benchmark five mainstream models, including the Qwen3.5 family, Qwen3-Coder-30B, and DeepSeek-R1. Our extensive analysis reveals three key insights. First, precise geometric spatial control remains an important bottleneck; while scaling Qwen3.5 from 4B to 27B improves Schema Feasibility from 91.56% to 99.63%, the Geometry score improves more modestly (from 67.05% to 75.30%). Second, generation difficulty is highly sensitive to layout complexity, with current LLMs excelling at simple sequential arrangements but suffering severe coordinate drift in dense grids and multi-region compositions. Third, thinking mode increases token consumption while generally reducing GUI Score, particularly for smaller models.

112. 【2608.22388】ProBel: Propaganda Detection with Techniques, Spans, and Explanations

链接：https://arxiv.org/abs/2608.22388

作者：Mohamed Bayan Kmainasi,Ali Ezzat Shahroor,Elisa Sartori,Giovanni Da San Martino,Firoj Alam

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Propaganda detection includes, Propaganda detection, Arabic and English, related prediction levels, propaganda techniques grouped

备注： Under review at

点击查看摘要

Abstract:Propaganda detection includes several related prediction levels, ranging from sentence-level decisions to technique classification and span identification. However, it remains unclear how supervision at these levels interacts when learned jointly across Arabic and English. We present ProBel, an Arabic and English resource that aligns binary labels, multi-label annotations over 23 propaganda techniques grouped into six coarse categories, technique-labeled spans, and reference explanations for the same news sentences. It includes a substantially larger English collection and supports matched binary, coarse-grained, multi-label, and span-level tasks in both languages. We evaluate zero-shot prompting, task-specific fine-tuning, and joint training under a shared setup. A single bilingual multi-task model achieves the best overall performance and remains competitive across tasks and languages. Cross-task analysis shows that transfer depends on the supervision level. Joint classification training preserves binary performance, whereas span-only training can weaken sentence-level prediction. Joint bilingual training yields the most stable results, while monolingual fine-tuning can reduce transfer to the other language. We will release the data, code, and evaluation scripts.

113. 【2608.22381】GRAFT: Graph-Distilled Generative Retrieval for Facet-Aware Scientific Literature Exploration

链接：https://arxiv.org/abs/2608.22381

作者：Italo Luis da Silva,Hanqi Yan,Yujing Wang,Jiangnan Ye,Lin Gui,Yulan He

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：document-level retrievers collapse, single similarity score, relate by problem, single similarity, scientific discovery depends

备注：

点击查看摘要

Abstract:Scientific papers may relate by problem, method, result, or contribution, but document-level retrievers collapse these into a single similarity score without saying why they are related. Citation- and similarity-based retrieval alone also confines search to the neighbourhood of what is already known, whereas generative retrieval generates document identifiers directly, enabling the exploratory retrieval that scientific discovery depends on. We connect papers in a graph whose edges are typed by these four facets, derived from facet items and citation signals, and distil it into a generative retriever whose identifiers are the papers' own facet text. Two graph properties do not survive naive distillation. First, because every training pair is an edge, naive enumeration indexes just 84% of the corpus. Coverage-aware distillation makes every paper learnable through a reverse-neighbour fallback, a minimum-coverage threshold, and edge-importance weighting. Second, constrained decoding guarantees that every generated identifier is a valid paper, but not that the graph connects it to the query. Graph-weighted reciprocal rank fusion scales each candidate's rank term by its query-candidate edge weight, dropping unsupported ones. On LitWeave, our constructed corpus of 11,359 NLP papers, Graft recovers 91% of its graph teacher's Recall@20 with no nearest-neighbour index or encoder at inference, and outperforms the graph teacher on query papers outside the corpus. It reproduces the graph's own facet labels at 0.922 precision, so every returned paper arrives labelled with the facet that surfaced it rather than an opaque score.

114. 【2608.22376】Can Large Language Models "Hyper-Thread"?

链接：https://arxiv.org/abs/2608.22376

作者：Fei Ding

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, language models generate, Serial Functional Scheduling, Concurrent Functional Loading

备注： 12 pages

点击查看摘要

Abstract:Large language models generate tokens sequentially, but can they execute multiple tasks concurrently while forming each token? Broader attention allocation may provide a mechanism for such task concurrency. Existing approaches to scaling inference primarily rely on longer generations, more samples, or additional verification stages, while attention dispersion is often treated as a signal of interference or error. Task concurrency within serial generation therefore remains underexplored. We propose the Model Hyper-Threading Hypothesis and evaluate its predictions using multiple coordinated tasks that share state within the same problem. We design three conditions (Baseline, Serial Functional Scheduling, and Concurrent Functional Loading) and evaluate their benefits and costs using accuracy, output-token distributions, and attention metrics. On an AIME 2025 development set, Concurrent Functional Loading achieves the highest accuracy. Relative to Serial Functional Scheduling, its typical output length is similar and it is shorter on most problems, while exhibiting greater attention dispersion and higher task-relevant coverage, albeit with a heavier output-length tail. Within-step concurrency and its causal mechanism still require direct tests. Our results show that more dispersed attention can coexist with higher accuracy, providing preliminary behavioral and correlational evidence for the hyper-threading hypothesis. These findings motivate a shift in perspective on inference scaling from "generating more tokens" toward "having each generation step carry more tasks," pointing to a new avenue for improving reasoning performance.

115. 【2608.22367】Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMs

链接：https://arxiv.org/abs/2608.22367

作者：Yikai Zhao,Qiyan Zhao,Jiaquan Zhang,Xiaofeng Zhang,Xiaosong Yuan,Pengzhou Cheng

类目：Computation and Language (cs.CL)

关键词：Diffusion multimodal large, output length increases, large language models, frequently produce long-form, produce long-form outputs

备注： This paper is accepted by EMNLP 2026. 19 pages, 12 figures, 13 tables

点击查看摘要

Abstract:Diffusion multimodal large language models (dMLLMs) frequently produce long-form outputs marred by semantic drift and repetition, with quality generally degrading as output length increases. We identify two structural deficiencies in existing decoding methods as primary drivers of these failures: confidence-based scoring ignores decoded-neighbor support, and block partitioning prevents access to high-readiness semantic anchors, together causing tokens to be committed before their local context is sufficiently established. We propose \ours{} (\textbf{C}ontext-\textbf{A}ware \textbf{C}luster \textbf{D}ecoding), a training-free decoding method that scores each masked position by a multiplicative composite of softmax confidence and neighbor proximity, promoting contextually ready tokens above isolated candidates while suppressing low-confidence positional noise, operating block-free to keep high-readiness anchors globally accessible. \ours{} further applies architecture-aware calibration to handle confidence heterogeneity induced by diverse visual integration strategies. Experiments on three dMLLMs across four benchmarks demonstrate consistent quality gains and hallucination reduction over Original, with larger gains in several longer generation settings, highlighting the importance of neighbor support and visual integration strategy for future dMLLM decoding method design. Our code is openly available at this https URL.

116. 【2608.22347】Where Cognition Lives: Dissecting Emergent from Computed Function in a Minimal Complete Cognitive Architecture

链接：https://arxiv.org/abs/2608.22347

作者：Francisco M. Arrabal-Campos,Francisco G. Montoya,Alfredo Alcayde,Ignacio Fernández

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：deserves the effort, cognitive architecture, decide how long, module that reasons, homeostatic control field

备注： 16 pages, 3 figures. Code, preregistrations and results: [this https URL](https://github.com/fmarrabal/miuracognitive)

点击查看摘要

Abstract:A cognitive architecture is more than the module that reasons: it must also decide how long to think and what deserves the effort. We built a minimal but complete system - a recurrent reasoner with adaptive halting, a homeostatic control field, and a value module - and asked of each part: does this function emerge from gradient descent, or must it be computed? Competence emerges. Stopping appears to emerge too, and to be worth more than everything decidable in advance, but that appearance is instrumentation: payoff at matched mean compute climbs from 0.467 (uniform) through 0.546 (difficulty) to 0.698 (ex-ante value), and the further climb to 0.921 (posterior self-observation) does not survive audit. PonderNet-style halting returns a halting-weighted mixture of hidden states while forced-depth baselines return one, and the language head is trained on the mixture alone; equalizing the readout annihilates the apparent advantage of native execution (residual +0.000 [0.000, 0.000]). Value does not emerge: trained couplings capture zero of a payoff an explicit allocator captures completely (+0.151, routing correlation +0.79), so the second-order decisions that pay must be computed, at least where value is orthogonal to content, as here by construction. On a frozen LLM actuator the same instruments show self-consistency voting to be a measured bound (+0.0236 [+0.0150, +0.0326]) and inter-sample agreement nearly worthless as a stopping signal, its mass concentrating on wrong answers. Every null we assert carries a mechanism and a positive control, and the protocol is part of the contribution. Executing our own falsifiable prediction, value under commitment pays +0.1312 [+0.1124, +0.1502] in a cliff-cost family, some seven times the smooth-family estimate - not because the cliff shifts information ex ante, but because it multiplies the attainable range fivefold (5.1x [3.4, 8.2]).

117. 【2608.22339】When Not to Imitate: Boundary-Aware Skill Memory for Reliable Tool-Use LLM Agents

链接：https://arxiv.org/abs/2608.22339

作者：Zihan Lin,Zhenyu Chen,Jiawen Wei,Xiaohan Wang,Jie Cao,Jiajun Chai,Wei Lin,Guojun Yin,Ran He

类目：Computation and Language (cs.CL)

关键词：Large Language Model, Large Language, evolution of Large, Language Model, efficient evolution

备注： Accepted by EMNLP2026 Findings

点击查看摘要

Abstract:Extracting skills from past successes is critical for the efficient evolution of Large Language Model (LLM) agents. Prevailing agent self-evolution paradigms typically rely on a core assumption: equipping LLMs with skill memories derived from successful trajectories will monotonically improve their problem-solving capabilities. However, probe analyses reveal that extracting skills solely from successful trajectories traps the model in a \textbf{Skill Imitation Trap}. For tasks that resemble past successes but require different tools, retrieving more skills paradoxically increases the model's confidence in wrong tool calls---procedure skills raise the wrong-tool margin by $47\%$ over a memory-free baseline. To overcome this limitation, we propose \textbf{Boundary-Aware Skill Memory} (BASM), which augments each skill with explicit boundary fields---applicability conditions, risk cues, avoidance rules, and recovery notes. These fields transform each retrieved skill from an unconditional action template into state-conditioned guidance: the agent applies the skill when its conditions hold, suppresses inapplicable tool calls when they do not, and issues targeted repairs when execution fails. Across three agent benchmarks and four model scales, BASM consistently outperforms success-distilled skill-memory baselines: it improves task success rate by up to $23.8\%$ on AppWorld, accuracy by up to $5.0\%$ on BFCL, and reduces attack success rate by $4.6\%$ on AgentDojo, while simultaneously reducing average AppWorld steps by up to $6.6\%$ relative to the memory-free baseline.

118. 【2608.22335】Register Shifts Break LLM Safety: A Bengali Benchmark with Culturally Grounded Harms

链接：https://arxiv.org/abs/2608.22335

作者：Naymul Islam,Nusrat Jahan Lia,Shubhashis Roy Dipta,Sabik Bin Sultan,Abdullah Khan Zehady

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：remains overwhelmingly English-centric, evaluation remains overwhelmingly, overwhelmingly English-centric, safety evaluation remains, LLM safety evaluation

备注：

点击查看摘要

Abstract:Bengali is the seventh-most-spoken language globally, yet LLM safety evaluation remains overwhelmingly English-centric. We introduce BanglaSafe, a benchmark of 879 Bengali prompts combining 309 natively authored prompts with 570 expert-reviewed prompts, spanning 17 culturally grounded harm categories and five prompting conditions that vary language, writing style, and authority framing. Evaluating 18 frontier LLMs, we find that over half of all responses are unsafe or partially unsafe (53.6%) while 14.7% contains strictly harmful content, and that the strongest observed effect is not the switch from English to Bengali but the choice of writing style within Bengali: the same harmful request phrased as a formal newspaper investigation succeeds 17 percentage points more often than the same request phrased as a casual message, with no adversarial engineering involved. We further show that existing safety classifiers struggle to reliably evaluate Bengali content, with even frontier models failing on nearly half of all cases.

119. 【2608.22332】Mechanistic Interpretability of Chain-of-Thought Reasoning via Sequential Activation Patching

链接：https://arxiv.org/abs/2608.22332

作者：Murat Dura,Serkan Öztürk,Selma Tekir

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, Language Models, demonstrate remarkable problem-solving, remain poorly understood

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) demonstrate remarkable problem-solving capabilities when guided by Chain-of-Thought (CoT) prompting, yet the internal mechanisms underlying these improvements remain poorly understood. In this work, we investigate where CoT-related causal effects emerge across the generated reasoning trajectory and which attention heads carry signals that contribute to final-answer computation. Because CoT reasoning unfolds over multiple generated tokens, standard activation patching at a single static token position is insufficient to characterize these temporally distributed effects. To address this limitation, we introduce a sequential activation patching framework that traces CoT-conditioned attention-head activations across token positions and aggregates their effects using Part-of-Speech-guided analysis. We further introduce Sequential Multi-Head Patching to evaluate the joint contribution of distributed head sets, together with cross-question and random activation controls. Targeted zero-ablation experiments show that the identified heads are functionally important for successful answer generation and affect several overlapping mechanisms, including reasoning-trajectory maintenance, answer anchoring, exemplar-target separation, and numerical generation. Overall, our results provide evidence for distributed reasoning-support sub-circuits associated with CoT-conditioned computation.

120. 【2608.22331】Noise Floor Audit for Agent Benchmarks

链接：https://arxiv.org/abs/2608.22331

作者：Yihang Chen,Pin Qian,Su Wang,Chong Peng,Huan Xu,Xiyang Wu,Yiqi Sun

类目：Computation and Language (cs.CL)

关键词：matched AST grading, official BFCL multiple, audit measurement variability, AST grading, native tool-calling endpoints

备注： 10 pages, 1 figure, 6 tables

点击查看摘要

Abstract:We audit measurement variability for 3 native tool-calling endpoints across 2 providers on the official BFCL multiple and parallel categories, using matched AST grading. At temperature 0, reruns are nearly deterministic across Groq endpoints and a thinking-enabled Gemini setting: ever-flip fractions are 0.7%, 2.0%, and 2.7%, with mean run correlations of 0.997, 0.966, and 0.961. Semantics-preserving prompt perturbations create the larger floor on all endpoints, with median perturbation paired SDs 11x to 58x larger than rerun paired SDs. The failure character also shifts: malformed-output failures account for 30%, 7%, and 1% of task failures, so marginal accuracy hides not only stability but also failure mode.

121. 【2608.22321】Semantics or Structure? Auditing Text Sensitivity in Multimodal Time-Series Forecasting

链接：https://arxiv.org/abs/2608.22321

作者：Karthik Sridhar,Atharva Gupta,Nishant Pradhan,Murari Mandal,Dhruv Kumar,Saurabh Deshpande

类目：Computation and Language (cs.CL)

关键词：improve predictive performance, Multimodal time-series forecasting, predictive performance, multimodal foundation models, time-series forecasting

备注：

点击查看摘要

Abstract:Multimodal time-series forecasting has emerged as a promising paradigm in which natural-language context is expected to improve predictive performance. Recent multimodal foundation models, including Aurora, as well as early- and late-fusion approaches such as MM-TSFlib and TaTS, report substantial gains over unimodal baselines on the Time-MMD benchmark, attributing these improvements to textual information. However, whether these models are actually sensitive to the semantic content of the text remains unverified. We address this question through controlled text perturbations, attribution analyses, and probes of Aurora's text pathway. On Time-MMD, swapping each row's text for any other real text (empty, constant, within-domain shuffled, or cross-domain) moves mean MSE by less than $0.5\%$ on all three architectures. The improvement reported in the literature is recovered when a co-shipped numeric column is removed without touching text. We conclude that, on this benchmark and within this family of frozen-encoder architectures, text content is not the operative signal behind the reported gains. To support future work on text integration in multimodal foundation models for structured data, we release our perturbation protocol and evaluation harness as a reusable diagnostic toolkit.

122. 【2608.22312】xt-Anchored Semantic Perturbations for Transferable Jailbreak Attacks on Multimodal Large Language Models

链接：https://arxiv.org/abs/2608.22312

作者：Wenyun Li,Guiping Cao,Xiangyuan Lan,Zheng Zhang

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Multimodal Large Language, Language Models, Large Language, achieved remarkable progress

备注： Accept by EMNLP 2026 Findings

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have achieved remarkable progress in vision-language interaction, yet their safety alignment remains vulnerable to jailbreak attacks. A key challenge is that safety behavior learned in the textual space does not reliably transfer to fused cross-modal representations, leaving multimodal inputs exploitable through latent semantic cues. We propose Text-Anchored Semantic Perturbation Attack (TA-SPA), a black-box jailbreak framework that optimizes transferable perturbations in a text-anchored semantic space. TA-SPA integrates Text-Anchored Semantic Factorization (TASF), which encourages the separation of cross-modal semantic factors from modality-specific residuals, with Semantic-Preserving Augmentation (SPA), which diversifies harmful target anchors while preserving semantic consistency. Experiments show strong attack effectiveness and transfer to commercial MLLMs, with competitive performance under representative defenses. Additional controls and probing support the intended factorization without implying perfect disentanglement, motivating representation-level safety alignment beyond input-level filtering.

123. 【2608.22295】LLM Evaluation on Unseen Questions: Contextual Multidimensional IRT Model

链接：https://arxiv.org/abs/2608.22295

作者：Ergan Shang,Weijing Tang,Yinqiu He

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：increasingly requires predicting, collecting large amounts, large language models, increasingly requires, large language

备注：

点击查看摘要

Abstract:Evaluation of large language models (LLMs) increasingly requires predicting how a model will perform on new questions or tasks before collecting large amounts of new annotations. This problem is challenging because question difficulty, scenario, and underlying capability demands can vary substantially. Simple retrospective averages may confound model ability with item characteristics. In this paper, we study a model-based evaluation framework that combines multidimensional item response theory model with question contexts to predict LLM performance on unseen questions. The framework represents LLMs through latent capability profiles while using question content to inform item characteristics, allowing information to transfer beyond previously observed items. Empirically, we find that for within-scenario evaluation, incorporating question embeddings improves prediction relative to model-free baselines, and that multidimensional latent structure provides a richer description of capability variation than unidimensional alternatives. At the same time, our results reveal an important limitation that the generalizability does not necessarily translate into reliable prediction under cross-scenario shift. These findings suggest that context-aware psychometric modeling is a promising direction for efficient and interpretable LLM evaluation, while also highlighting cross-scenario generalization as a central open challenge.

124. 【2608.22274】Length-Adaptive Decoding for Masked Diffusion Machine Translation

链接：https://arxiv.org/abs/2608.22274

作者：Yan Zhan,Mengkai Hou,Wanting Zhang,Zhijun Gao

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Machine translation tests, masked diffusion language, tests masked diffusion, fixed canvas decoding, masked diffusion decoding

备注： Accepted to the Main Conference of EMNLP 2026. 22 pages, 7 figures. Code: [this https URL](https://github.com/Entropy-Valley/Entropy-Valley) ; dataset and model: [this https URL](https://huggingface.co/collections/YanZhanPKU/entropy-valley)

点击查看摘要

Abstract:Machine translation tests masked diffusion language models (dLLMs) because every source token must be rendered faithfully, while fixed canvas decoding must choose target length before denoising. Existing masked diffusion decoding work mainly studies token unmasking order, leaving this length decision under-explored despite its direct effect on coverage and redundancy. We introduce Entropy-Valley (EV), a training-free length selector that scores candidate target canvases by mean predictive entropy from all-mask forward passes and selects the canvas the backbone is most prepared to fill. Relative to a baseline using training corpus length statistics, EV recovers 64.9%, 65.3%, and 33.0% of the COMET-22 gain from reference target lengths on En$\to$Zh, Zh$\to$En, and En$\to$De. Our diagnostics show that denoising-friendly lengths need not match reference lengths. Evaluation by three translation experts supports the En$\leftrightarrow$Zh adequacy gains, with stronger evidence on Zh$\to$En. Compared with a LLaMA-3-8B autoregressive (AR) model trained on the same fine-tuning data, the EV system ties on En$\to$Zh and leads on Zh$\to$En; an oracle-length diagnostic further shows that, in this masked diffusion MT setting, deciding which tokens to reveal first matters less than how the target length is supplied.

125. 【2608.22266】Clarify User Expertise: Towards Proactive Conversational Agents Tailoring Responses to User Proficiency

链接：https://arxiv.org/abs/2608.22266

作者：Zhihong Cao,Chen Huang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：personalized assistants, information seeking, tools to proactive, context of information, reactive tools

备注： Findings of EMNLP 2026

点击查看摘要

Abstract:In the context of information seeking, conversational agents are undergoing an evolution from reactive tools to proactive, personalized assistants. A critical aspect of this evolution is the ability to tailor strategic interactions to a user's unique needs and expectations. Unlike existing studies that focus on proactively clarifying query ambiguities, we center on clarifying the user's expertise in order to tailor responses for better user comprehension. We find that existing agents struggle to determine user expertise from queries alone, a limitation that prevents them from dynamically adapting their responses. To address this gap, we introduce PASSING to empower the agent to proactively clarify a user's expertise through targeted inquiries. This is achieved by our What-to-ask and How-to-ask strategies, induced by LLM self-play. Our extensive experiments also show our superiority. We believe that PASSING represents a crucial step towards creating more human-centric conversational agents.

126. 【2608.22251】CAIA in Practice: Field Evaluation of an AI-Assisted Support System for Text-Based Online Counselling

链接：https://arxiv.org/abs/2608.22251

作者：Philipp Steigerwald,Nico Bienlein,Jennifer Burghardt,Mara Stieler,Robert Lehmann,Jens Albrecht

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词：Rising global demand, service delivery challenges, mental health support, health support creates, support creates significant

备注： Accepted at IEEE ICTAI 2025

点击查看摘要

Abstract:Rising global demand for mental health support creates significant service delivery challenges, with asynchronous email counselling serving as a crucial low-threshold channel for accessing care. This paper presents CAIA, a co-designed AI-based tool suite that demonstrates responsible AI integration into counselling practice through seven LLM-driven functions enhanced by retrieval-augmented generation. A field evaluation involved 34 professional counsellors conducting authentic sessions with trained student counsellees (36 threads, 321 messages, 1,257 AI outputs). User behaviour analysis confirms substantial adoption, revealing that professional autonomy and information accuracy are decisive for sustained acceptance, with counsellors particularly valuing interpretive functionalities that provide new perspectives and stimulate professional reflection.

127. 【2608.22246】Nürnberg NLP @ GermEval Shared Task 2026: Harmful Content Detection in German Social Media through Error-Independent LLM Voters

链接：https://arxiv.org/abs/2608.22246

作者：Philipp Steigerwald,Eric Rudolph,Jens Albrecht

类目：Computation and Language (cs.CL)

关键词：German social media, content in German, German social, real-world damage, criminal defamation

备注： Accepted at the GermEval 2026 Shared Task on Harmful Content Detection @ KONVENS 2026 (1st place on all four subtasks)

点击查看摘要

Abstract:Harmful content in German social media does real-world damage, from calls to action to criminal defamation. The GermEval 2026 shared task scores its detection in four subtasks. The technical challenge is a severe class imbalance. The harmful classes are rare and share surface language with the dominant majority class, yet under macro-F1 they decide the score. The decisive lever is then not a stronger single model but error independence. This insight becomes a per-subtask nine-voter ensemble spanning three orthogonal axes: LLM, training method and class scope. Selected mainly on internal cross-validation, the system reaches macro-F1 of 89.56 (C2A), 71.63 (DBO), 54.84 (VIO) and 83.02 (DEF) on the hidden test set, placing first on all four subtasks.

128. 【2608.22244】Improving Few-Step Language Flows with Untied Self-Conditioning

链接：https://arxiv.org/abs/2608.22244

作者：Bocheng Li,Linli Xu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Flow-matching language models, Flow-matching language, language models refine, self-conditioning input, trade sampling steps

备注：

点击查看摘要

Abstract:Flow-matching language models refine all token positions in parallel and can trade sampling steps for latency, yet generation quality still degrades sharply with few sampling steps. We trace a source of this degradation to a train--inference mismatch in previous-prediction self-conditioning: during training, the self-conditioning input is computed from the current noisy state with no intervening solver step; during sampling, the solver folds the previous prediction into the latent before that same prediction reappears as the explicit self-conditioning input. This coupling, absent during training, creates redundancy that grows with step width. We show that the mismatch degrades both the self-conditioning input and the solver update, and derive a correction for each from the model's own structure. From the frozen projection weights we identify directions along which the self-conditioning input is redundant with the latent and dampen them; from the solver's integration structure we derive that a step-average prediction is needed and approximate it from prediction history, with scale set by offline trajectory statistics. The resulting sampler, Untied Self-Conditioning, requires no retraining and uses one evaluation per step. At 8 sampling steps on LangFlow, it reduces OpenWebText generative perplexity from $531$ to~$62$ ($8.6\times$); under an adapted Arena-Hard-Auto~v2 protocol, its outputs are preferred in $96\%$ of pairwise comparisons. On ELF-B it reduces generative perplexity from $71$ to~$43$. Improvements hold from 8 to 256 sampling steps.

129. 【2608.22232】Beyond What Meets the Eye: Unveiling Situational Illusions for Multimodal Large Language Models

链接：https://arxiv.org/abs/2608.22232

作者：Zhiming Yang,Zhuoxi Xiong,Donglin Zhou,Wenjun Wei,Shiyao Cui,Jinqiao Shi

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：underlying physical states, Real-world situation appearances, multimodal large language, large language models, physical states

备注： 9 pages, 5 figures

点击查看摘要

Abstract:Real-world situation appearances can deviate from their underlying physical states, challenging the reliability of multimodal large language models (MLLMs) in practical applications. In this paper, we term this phenomenon situational illusions and investigate: (1) how MLLMs perform under such illusions, and (2) how to mitigate the limitations. We first develop a comprehensive where-what-how taxonomy that characterizes where situational illusions occur, what targets they take, and how they arise. Building on this taxonomy, we introduce MSIBench, a benchmark designed to assess the discrimination, understanding, and reasoning capabilities of MLLMs under situational illusions. Evaluations of 27 model configurations reveal that current MLLMs are highly vulnerable to these illusions and exhibit 6 typical failure modes related to visual observation, grounding, and reasoning. To mitigate the limitations, we build on the core idea of systematically inspecting and reasoning over visual evidence for contextual understanding, developing prompting for closed-source models and supervised fine-tuning for open-source models, respectively. These two simple yet effective methods improve model performances by 20% at most, suggesting a practical path toward more reliable multimodal perception and reasoning in complex real-world environments.

130. 【2608.22230】Whitewashing Hate, Smearing Harmless Content: Annotator-Style Rebuttal Attacks on LLM-Based Moderation

链接：https://arxiv.org/abs/2608.22230

作者：Junyu Lu,Kaiyuan Liu,Jingyi Kang,Deyi Ji,Hailong Zhang,Lanyun Zhu,Qi Zhu,Bo Xu,Liang Yang,Hongfei Lin

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, reviewers provide feedback, final decision, reviewers provide

备注：

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used for hate speech moderation, often within human--AI workflows in which reviewers provide feedback before a final decision. Such feedback introduces two manipulation directions: whitewashing hateful content as normal and smearing normal content as hateful. This study examines the susceptibility of initially correct model judgments to annotator-style rebuttals and analyzes whether attack effectiveness differs across manipulation directions. We introduce a rejudge protocol that extends direct contradiction with decision-boundary perturbations and adversarial rationales. Experiments with multiple LLMs on two hate speech datasets show that annotator-style rebuttals substantially degrade moderation performance, with stronger effects in multi-turn settings. The results further reveal stable, model-specific asymmetries between whitewashing and smearing across attack configurations, indicating distinct directional vulnerability patterns. Explicit reasoning prompts and defensive instructions reduce these effects but do not eliminate them. These findings highlight the need for direction-aware safeguards and dedicated feedback-robustness evaluation in human--AI moderation workflows.

131. 【2608.22229】Grounded Normative Rule Generation with Structured Search

链接：https://arxiv.org/abs/2608.22229

作者：Fanqi Kong,Huaxiao Yin,Ruijie Zhang,Xiaoyuan Zhang,Yizhe Huang,Jian Gao,Shuo Chen,Song-Chun Zhu

类目：Computation and Language (cs.CL)

关键词：actual environment records, Normative Rule Synthesis, institutional charters, charters and workplace, human-readable and operationally

备注：

点击查看摘要

Abstract:Normative rules like institutional charters and workplace policies must be both human-readable and operationally verifiable against actual environment records. However, current language generation and structured-output benchmarks primarily reward surface fluency or schema compliance, leaving operational grounding weakly tested. This creates a critical vulnerability where standard language models generate plausible-sounding policies that fail during enforcement because they rely on unavailable data logs or misaligned scopes. To address this challenge, we formalize the problem as Grounded Normative Rule Synthesis (GNRS) and introduce GNRS-Search, a framework that utilizes Markov Chain Monte Carlo (MCMC) sampling to optimize a discrete, five-slot And-Or Graph (AOG). By explicitly decoupling intermediate operational structure from final prose generation, this method isolates executable feasibility from writing style and allows rule failures to be localized prior to surface realization. We evaluate our approach on GNRS-Bench, a benchmark spanning 116 controlled goals across eight scene families, and RealCharter-Bench, which evaluates transfer to 53 real-derived policy tasks with hidden source clauses. GNRS-Search raises average rubric quality from 68.8% to 81.0% and ranks first under a disclosed executable composite metric, while systematic slot interventions confirm that performance gains stem from robust operational logic rather than rhetorical tuning. Ultimately, by transforming automated rule drafting into an inspectable search problem, this work provides a foundational paradigm for deploying verifiable and compliance-ready personal agents within regulated environments.

132. 【2608.22215】Dual-Layer Agentic Memory with Fast Write Routing and Slow Consolidation

链接：https://arxiv.org/abs/2608.22215

作者：Wenzhi Li,Dong Nie,Rui Lan,Tongtong Lyu,Peiyao Wang,Lingzi Hong,Weihang Pan,Boyuan Pan,Yao Hu

类目：Computation and Language (cs.CL)

关键词：Large language model, Large language, operate in dynamic, dynamic environments, LLM

备注：

点击查看摘要

Abstract:Large language model (LLM) agents operate in dynamic environments where knowledge continuously evolves. Existing memory systems typically treat external memory as a monotonically growing repository, inevitably leading to retrieval degradation and increasing computational costs over time. We argue that the core challenge is not retrieval alone, but managing the knowledge lifecycle: deciding what to externalize, update, or ultimately internalize. Inspired by Complementary Learning Systems (CLS) theory in neuroscience, we propose Dual-Layer Agentic Memory, a framework that shifts memory management to the write phase through cost-aware epistemic routing and periodic parametric consolidation. Incoming information is categorized as non-write, write-new, or write-update, and routed through a small-to-large model cascade that minimizes routing overhead while filtering redundant memories. A subsequent write-back phase selectively consolidates high-value external memories into model parameters via supervised fine-tuning. Experiments demonstrate the dual efficiency of our approach: a 1.7B/8B cascade prunes up to 68% of redundant external memory while escalating fewer than 50% of inputs, yet retains over 98% of the downstream QA Exact Match (EM) achieved by an exhaustive retention baseline. We further show that periodic consolidation successfully internalizes external knowledge, allowing the router to adaptively suppress redundant writes as the model's epistemic boundaries evolve. Overall, our framework presents a unified paradigm for agent memory: selective externalization followed by selective internalization. Code and dataset will be released upon acceptance.

133. 【2608.22192】How Agents Represent Humans: Human-Directed Stereotypes in an Open Agent Social Network

链接：https://arxiv.org/abs/2608.22192

作者：Huangchen Xu,Yuan Wu,Yi Chang

类目：Computation and Language (cs.CL)

关键词：persistent social environments, increasingly deployed, deployed in persistent, generated claims, social environments

备注：

点击查看摘要

Abstract:LLM-based agents are increasingly deployed in persistent social environments, where generated claims can be posted, replied to, remembered, and reused. We study human-directed stereotypes on Moltbook, an open agent-native social platform, asking how agents construct humans as a social category. For this human-target analysis, we introduce an annotation framework with four evaluative dimensions---morality, friendliness, competence, and autonomy---and a second-stage subtype scheme for descriptive \textit{other} attributions. We find that competence dominates human-directed evaluations, while many \textit{other} attributions describe humans as epistemic, cultural, or embodied subjects. We further examine how these human representations appear in human--agent narrative contexts and platform-level circulation. As an auxiliary comparison, we analyze agent-internal community feedback through behavioral host affinity. Rather than reproducing the stable insider--outsider rejection often observed in human online communities, Moltbook feedback patterns are better explained by exposure, author visibility, and content selection. These findings suggest that bias in agent societies should be studied not only as isolated model output, but also as a discourse process.

134. 【2608.22188】Unveiling the Depth-Performance Dilemma in Split-Federated Fine-tuning of LLMs

链接：https://arxiv.org/abs/2608.22188

作者：Hariharan Ramesh,Someshwaran Murugaiyan,Jyotikrishna Dass

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC)

关键词：scaling Large Language, Large Language Models, Large Language, scaling Large, Language Models

备注： 24 pages, 10 figures, 10 tables

点击查看摘要

Abstract:Split Federated Fine-tuning (SFF) is a promising paradigm for scaling Large Language Models (LLMs) by partitioning model depth between resource-constrained clients and a centralized server. While system incentives for throughput and privacy favor deep partitions, the impact of such configurations on model utility remains poorly understood. In this work, we identify and characterize the Depth-Performance Dilemma: the regime that maximizes system efficiency is precisely where fine-tuning quality collapses. Through a comprehensive audit across four model scales (GPT-2 to Llama-3-8B) and diverse benchmarks, we demonstrate that deeper partitions provide monotonic gains in throughput and privacy at the cost of catastrophic performance plateaus. We evaluate a suite of state-of-the-art federated adapter aggregation methods including AVG, STACK, SVD, and FREEZE, revealing that while these techniques are effective in standard Federated Learning, they fail to mitigate the artifacts unique to split architectures. Finally, we provide a mechanistic diagnosis for this failure, tracing the collapse to the near-isometric topology of Transformers, which allows aggregation noise to propagate without attenuation until it triggers Attention Collapse in the server partition. Our findings challenge the prevailing assumption that partition depth is a utility-neutral tuning knob and provide a structural foundation for stable distributed LLM fine-tuning.

135. 【2608.22186】AudioNoisePrints: Model-free audio watermarking using spatial correlation in flow matching TTS

链接：https://arxiv.org/abs/2608.22186

作者：Timothy Tin-Long,Jian Zhu,Aidan Pine,Mengzhe Geng

类目：ound (cs.SD); Computation and Language (cs.CL)

关键词：requires minimal extra, minimal extra computation, training-free watermarking pipeline, flow matching models, diffusion TTS models

备注：

点击查看摘要

Abstract:We present AudioNoisePrints, a training-free watermarking pipeline for flow matching and diffusion TTS models, which requires minimal extra computation during inference and does not require retraining the TTS model or reducing the generation quality. We exploited the fact that there are strong correlations between the initial Gaussian noises and the generated outputs in diffusion and flow matching models, such that a simple cosine correlation between the initial noise and the generated output can be used to perform watermaking. Moreover, we train a lightweight detector on top for more aggressive augmentations. Our method outperforms AudioSeal, a strong baseline for audio watermarking under strong augmentations. We experimented on F5TTS and other TTS and vocoder models, and concluded that they all exhibit similar spatial correlation properties, suggesting our watermarking scheme can be used for more flow-matching TTS models and even vocoders in the future.

136. 【2608.22161】Aggregation-Aware Synthetic Text Generation Against Authorship Re-Identification

链接：https://arxiv.org/abs/2608.22161

作者：Qian Ma,Anna Squicciarini,Sarah Rajtmajer

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Online users, release multiple texts, users often release, release multiple, author profile

备注： Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing

点击查看摘要

Abstract:Online users often release multiple texts under the same identity, giving attackers an author profile that can reveal more than any single text. Existing authorship obfuscation methods optimize privacy independently for each document, leaving them blind to cross-document correlations that make aggregation dangerous. We propose Aggregation-Aware Synthetic Text Generation (AAST), a framework that addresses this gap by jointly selecting synthetic texts at the bundle level rather than optimizing each text in isolation. AAST targets attribution and verification attacks, including cross-genre settings where attacker references come from a genre not observed during generation or selection. Experiments across same-genre, cross-genre, neural, and independent non-neural stylometric attacks show that AAST lowers account-level linkability as bundle size grows, while preserving semantic quality, linguistic acceptability, and sentiment alignment.

137. 【2608.22152】he Collaboration Tax: How Much LLM Multi-Agent Systems Pay to Coordinate

链接：https://arxiv.org/abs/2608.22152

作者：Weixiang Sun,Zehong Wang,Hong Huang,Colby Nelson,Yanfang Ye

类目：Computation and Language (cs.CL)

关键词：Multi-agent systems built, large language models, deployed widely, remains unclear, built from large

备注： EMNLP 2026 Main Conference

点击查看摘要

Abstract:Multi-agent systems built from large language models are deployed widely, yet how much performance is lost when two LLMs must coordinate rather than act alone remains unclear. We formulate the collaboration tax as the team-decentralisation loss of a two-player cooperative game with private information, with two propositions characterising its sign and its equivalence to a max-superadditivity violation. We operationalise this definition on 32 solo-tractable tasks grouped by source of grounding friction and measure it on 11 models from 7 providers. The tax is structured along two no-exception axes: a category ordering across every model and a monotonic decrease with capability. The proximate mechanism is not a reasoning deficit but a four-stage conversational cascade in which agents make ungrounded claims, fail to query the partner, skip integrating both views, and accept the answer without re-derivation. The tax is mechanically predictable from conversation features and partly tractable: a prompt intervention targeting all four stages closes a substantial fraction of the gap, with the dominant bottleneck differing across categories. In heterogeneous pairs the tax is pulled toward the stronger partner rather than the additive midpoint, empirically realising the max-superadditivity violation predicted by our framework. Together these results recast collaboration in LLM systems as a measurable, predictable, and partly tractable cost.

138. 【2608.22140】Lexical Perturbations Disrupt LLM Reasoning: An Empirical Study of Attention Diversion

链接：https://arxiv.org/abs/2608.22140

作者：Jiaqian Zhu,Yang Zhang,Junhua Ding,Xiaowei Yu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Large Language Models, Large Language, achieve strong reasoning, remains poorly understood, Language Models

备注： Accepted to EMNLP 2026 (Main Conference). 9 pages main text, 12 figures, 20 tables

点击查看摘要

Abstract:Large Language Models (LLMs) achieve strong reasoning performance, but their robustness to realistic lexical corruption remains poorly understood. We evaluate four open-weight instruction-tuned models and frontier models across four reasoning benchmarks under keyboard noise, character swaps, and filler insertion. Character-level perturbations substantially degrade accuracy, especially on multi-step reasoning tasks, while filler insertion has little effect. We trace this asymmetry to Attention Diversion: lexical corruption fragments subword tokenization, and the resulting fragments attract disproportionate attention mass, concentrated in middle and final transformer layers. Length-matched controls confirm that fragmentation, not prompt length, drives the loss. A factorial intervention then shows why the damage is hard to undo: fragmentation corrupts token content and attention allocation together, and the two are coupled. Restoring clean attention while the content remains corrupted is actively harmful, restoring content alone is insufficient, and only restoring both recovers a substantial share of the gap. This coupling explains why inference-time strategies, including chain-of-thought prompting, spell-checking, self-repair, and stronger repair models, fail to consistently recover performance: each addresses one channel at a time. Code and data are available at this https URL

139. 【2608.22138】Measuring Stability and Failure Behavior in Language Models Under Structured Perturbations

链接：https://arxiv.org/abs/2608.22138

作者：Samira Golsefid

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Language models, performance degrades, single accuracy score, Knowledge Boundary family, Language

备注：

点击查看摘要

Abstract:Language models are usually judged by a single accuracy score, which does not reveal how their performance degrades as inputs are perturbed. We present a graded, multi-family, failure-aware framework for stress-testing reasoning models. It perturbs each problem along a multi-level severity ladder across seven families: six that preserve the answer, paraphrase, input noise, formatting, irrelevant context, context load, and conflicting instructions, and a Knowledge Boundary family that removes answerability so that refusal becomes the correct response. Every test is validity-gated and labeled by its measured severity, and each model is summarized by per-level Accuracy, a magnitude-weighted Stability, and a per-family Collapse Point defined relative to the model's own baseline. Instantiated on the same 100 seed problems used by GSM-Symbolic, expanded into 4,473 gated tests and run on four models spanning capability tiers, the framework exposes structure that an aggregate score hides: the level at which a model fails is family-specific rather than global, and two stressors expose consistent weaknesses across all models: conflicting instructions and questions built on an impossible premise. Recognition of unanswerability is otherwise uneven, reliable on missing information and fabricated evidence but weak on impossible premises. These failure points are invisible to standard accuracy reporting.

140. 【2608.22132】SSE-Bio: A Structured Self-Evolving Agent with Agentic Retrieval Policy for Multi-Hop Biomedical Reasoning

链接：https://arxiv.org/abs/2608.22132

作者：Zhaohan Meng,Zaiqiao Meng,Siwei Liu,Hao Xu,Ke Yuan,Iadh Ounis

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)

关键词：multi-hop question answering, question answering, requires models, models to connect, connect evidence

备注： Accepted to EMNLP 2026

点击查看摘要

Abstract:Biomedical multi-hop question answering (QA) requires models to connect evidence across intermediate entities such as diseases, drugs, proteins, and phenotypes. Existing agents typically rely on static retrieval workflows or coarse-grained prompt rewriting, which can lead to instruction drift when reasoning procedures need to be updated. We propose SSE-Bio, a structured self-evolving agent with an agentic retrieval policy for multi-hop biomedical reasoning. Instead of globally rewriting agent instructions, SSE-Bio maintains a structured state, selectively retrieves knowledge triplets and prior templates through a trainable proxy policy, and improves its reasoning memory through fine-grained template editing. To optimise retrieval decisions, we introduce a proxy-training strategy based on group relative policy optimization, where the proxy is improved through decision-contrastive groups over alternative retrieval choices. Experiments on three biomedical multi-hop QA benchmarks show that SSE-Bio consistently outperforms existing baselines, achieving an improvement of 6.56 absolute points over the strongest self-evolving baseline on BioHopR.

141. 【2608.22130】PropUQ-MAS: Propagation-Aware Uncertainty Quantification for LLM Multi-Agent Systems

链接：https://arxiv.org/abs/2608.22130

作者：Yaokun Liu,Yifan Liu,Daniel Yue Zhang,Ruichen Yao,Zelin Li,Dong Wang

类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)

关键词：LLM-based multi-agent systems, solve complex tasks, LLM-based multi-agent, multi-agent systems, solve complex

备注： Accepted to EMNLP 2026 (Main Conference)

点击查看摘要

Abstract:LLM-based multi-agent systems (MAS) solve complex tasks through communication among role-specialized agents. However, inter-agent dependencies introduce reliability risks beyond isolated agent failures. For instance, errors in intermediate messages could be inherited and amplified by downstream agents. Existing uncertainty quantification (UQ) methods mainly target isolated responses or single-agent reasoning, and therefore fail to capture uncertainty propagation in MAS. To this end, we propose PropUQ-MAS, an error propagation-aware UQ framework that represents MAS execution as a communication-structured graph and estimates each step's reliability by combining local uncertainty with uncertainty inherited from upstream messages. Extensive experiments demonstrate that PropUQ-MAS consistently improves UQ in MAS, with average relative gains of +6.10% in AUROC and +47.58% in PRR.

142. 【2608.22126】Decoupled Physical Modeling and Execution for Physics Reasoning

链接：https://arxiv.org/abs/2608.22126

作者：Ye Zhang,Xuehang Guo,Rui Pan,Pengfei Yu,Denghui Zhang,Manling Li,Qingyun Wang

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：reasoning requires constructing, formula-based manipulation, requires constructing, relying solely, solely on symbolic

备注：

点击查看摘要

Abstract:Physics reasoning requires constructing a consistent model of the underlying physical system rather than relying solely on symbolic or formula-based manipulation. Although large language models have shown strong ability in solving math and coding problems, they still struggle with physics problems, as these problems entangle the physical modeling process with mathematical calculations. Humans approach physics by first building a representation of the system before performing calculations. Inspired by this, we introduce a unified framework that distills intermediate representations that explicitly encode the physical modeling process and adopt a two-stage post-training strategy, where supervised fine-tuning establishes structured modeling, and reinforcement learning with rubric-based feedback improves the quality of the modeling process. Experiments on multiple multimodal physics benchmarks show that our approach leads to consistent improvements in reasoning performance across different models and datasets. On PhysReason, PhyX and SeePhys benchmarks, physical modeling output performs GRPO by an average ~3%, showing that explicit physical modeling is an efficient strategy of improving physics reasoning for small LLMs.

143. 【2608.22124】LLM assisted writing deserves empirical evaluation

链接：https://arxiv.org/abs/2608.22124

作者：Xuan Zhong Feng,Yi Lin,Yiye Zhang,Chunhua Weng,Yifan Peng

类目：Computation and Language (cs.CL)

关键词：LLM-assisted writing, detection problem, questions about clarity, Health Informatics papers, raises questions

备注：

点击查看摘要

Abstract:LLM-assisted writing is often treated as a detection problem, as it raises questions about clarity, integrity, equity, and evaluation. An analysis of 69,209 Health Informatics papers links it to more focused presentation, broader citation practices, and more globally distributed authorship. These patterns do not prove better science, but they support evaluating manuscripts by scholarly quality and accountability rather than by tool use.

144. 【2608.22118】RAG Collapse: LLM Responses Collapse When Retrieved Documents Are Self-Authored

链接：https://arxiv.org/abs/2608.22118

作者：Gregory Druck,Ethan Smith

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：self-reinforcing feedback loop, creating the potential, feedback loop, generate a significant, significant amount

备注： 36 pages, 31 figures, 4 tables

点击查看摘要

Abstract:LLM responses are based on the internet (via training or RAG), and AI is now used to generate a significant amount of content online (Paredes et al., 2026), creating the potential for a self-reinforcing feedback loop. Prior work has shown that when LLMs are recursively trained on their own output, they experience model collapse (Shumailov et al., 2024): responses become less diverse, and eventually no longer resemble the original training data. In this paper, we show that a similar collapse occurs if LLM-based AI systems retrieve references they authored using a search tool. We call this RAG collapse. We conduct extensive experiments with three types of simulations of AI systems retrieving references they generated, using three model families, and 1,019 information-seeking prompts, totaling 1,528 simulations and over one million LLM API calls, and find that 79.6% (1,216/1,528) of simulations end in collapse. Surprisingly, even a single self-authored reference can trigger collapse because the LLM disproportionately cites its own content. This self-bias persists even after controlling for reference quality.

145. 【2608.22117】ANGO: Token-Aggregated Nonlinear Gating Operators for Natural and Formal Language Modeling

链接：https://arxiv.org/abs/2608.22117

作者：Joshua Nunley

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Nonlinear Gating Operators, nonlinear feed-forward network, feed-forward network applied, network applied independently, Token-Aggregated Nonlinear Gating

备注： 13 pages, 5 tables

点击查看摘要

Abstract:A standard Transformer block separates cross-token interaction in self-attention from a nonlinear feed-forward network applied independently at each position. We introduce the TANGO model (Token-Aggregated Nonlinear Gating Operators), which replaces these two sublayers with one cross-token gated residual update. Each source token produces a SwiGLU gate vector. Query-key similarities determine a weighted average of source gates for each destination, and the resulting gate rescales projected destination features. TANGO assigns a separate weight to every causally visible source and is quadratic in sequence length. The WANGO model (Windowed Aggregation of Nonlinear Gating Operators) retains the same unnormalized scores within a recent window and uses positive feature-map prefix statistics for older sources, giving linear sequence-length complexity for fixed window and feature dimensions. We compare TANGO and WANGO with Recurrent and Untied Transformer++, full-attention GAU, and FLASH. All models have approximately 44.3M nonembedding parameters and are trained in three matched runs. TANGO, WANGO, and Recurrent Transformer++ apply one shared block four times; the other architectures use four independent blocks. TANGO obtains the lowest mean validation negative log-likelihood on FineWeb-Edu, Lean, and DeepMind Mathematics, although it has the largest analytical forward-pass operation count. WANGO obtains the lowest mean FineWeb-Edu NLL among the architectures with computation linear in sequence length and outperforms Recurrent Transformer++ at nearly the same analytical forward-pass multiply-accumulate count.

Comments:
13 pages, 5 tables

Subjects:

Machine Learning (cs.LG); Computation and Language (cs.CL)

ACMclasses:
I.2.6; I.2.7

Cite as:
arXiv:2608.22117 [cs.LG]

(or
arXiv:2608.22117v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2608.22117

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

146. 【2608.22090】Semantic Reasoning Denoising: Correcting Language Model Reasoning with Semantic Operators

链接：https://arxiv.org/abs/2608.22090

作者：Yujiao Yang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Large language models, produce fluent reasoning, fluent reasoning traces, Large language, local semantic errors

备注：

点击查看摘要

Abstract:Large language models can produce fluent reasoning traces whose local semantic errors propagate to an incorrect conclusion, while unconstrained self-correction may preserve, amplify, or introduce errors. Existing diffusion language models provide iterative refinement, but usually define noise as token masking or replacement rather than as errors in the reasoning process. We present Semantic Reasoning Denoising (SRD), an operatorized Markov denoising method for natural-language reasoning trajectories. SRD represents semantic noise with executable error operators that describe the error type, its location, and the corrupted and repaired propositions. Composing these operators constructs progressively noisier states. During training, the model learns to identify the semantic noise active in the current trajectory and to reconstruct the paired adjacent lower-noise state. During inference, noise-level-aware denoising repeatedly predicts an inverse operator and checks whether it is applicable, so each executed update makes a localized move toward a stable trajectory. Across six in-domain benchmarks spanning mathematics, code, knowledge, and commonsense, SRD improves the strongest same backbone baseline by 3.2 points on average. On seven cross-dataset transfer targets, it remains competitive with Llama-3-8B-Instruct and improves the strongest Qwen3-8B baseline average by 2.9 points. Analyses of noise sources, objectives, and denoising depth further show that structured semantic-noise prediction and iterative operator execution are central to the improvement.

147. 【2608.22081】W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases

链接：https://arxiv.org/abs/2608.22081

作者：Hridya Dhulipala,Rajesh Ombase,Michael Wang,Tien N. Nguyen

类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：enables large language, improving factual grounding, large language models, incorporate external knowledge, enables large

备注： 18 pages

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) enables large language models to incorporate external knowledge during generation, improving factual grounding and domain adaptability. However, existing RAG pipelines assume that evidence retrieved from multiple repositories can be ranked globally using a single similarity function. While suitable for open-domain retrieval, this assumption breaks down in enterprise document generation, where heterogeneous knowledge bases (such as policies, regulations, technical documentation, and departmental guidelines) serve distinct roles and must be jointly represented in the generated document. As a result, global ranking often produces unbalanced context dominated by a subset of sources, leading to incomplete enterprise drafts. To address this limitation, we propose W-RAG, a source-aware retrieval framework that performs ontology-guided retrieval, local ranking within each knowledge base, and source-level weighting to regulate evidence composition. We further introduce a new dataset for retrieval-grounded enterprise document generation spanning multiple document types and industry domains. Experiments show that standard RAG pipelines struggle on this task, while W-RAG significantly improves document coverage and generation quality.

148. 【2608.22077】Spine-Branch Coordination for Multi-agent Computer Use

链接：https://arxiv.org/abs/2608.22077

作者：Mian Zhang,Manasi Sharma,Sheng Zhang,Minglai Yang,Kejian Shi,Ying Liu,Zhiyu Zoey Chen,Daniel Yue Zhang

类目：Computation and Language (cs.CL); Multiagent Systems (cs.MA)

关键词：multiple subtasks executed, parallel virtual machines, virtual machines, increasingly deployed, multiple subtasks

备注：

点击查看摘要

Abstract:Computer use agents (CUAs) are increasingly deployed as multi-agent systems that decompose a task into multiple subtasks executed across parallel virtual machines (VMs). However, a critical physical bottleneck is that the state of two VMs cannot be merged. Previous systems handle this ad-hoc rather than treating it as a first-class concern. We propose Spine-Branch Coordination for multi-agent computer use, a framework that decomposes a task into a "spine-branch" graph, where the spine carries the main task flow with continuous VM state and branch tasks execute in parallel to collect information the spine needs to complete the task. Branch VMs are discarded once their tasks finish, so no VM merging ever occurs. Experiments show that on 200 long-horizon tasks from Odysseys and across three CUA backbones, Spine-Branch improves success rate over the baseline system by 6.0% to 16.5%, while reducing per-task cost by 34% to 70%, indicating that explicitly modeling VM-state merging constraint enables multi-agent computer use to scale efficiently.

149. 【2608.22071】Real-TurnTurk: A Multimodal Turkish Corpus for Turn-Taking Prediction

链接：https://arxiv.org/abs/2608.22071

作者：Ahmet Tuğrul Bayrak,Fatma Nur Korkmaz,Bekir Berker Türker,Mustafa Sertaç Türkel,Alper Kaplan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：synchronous dialog systems, basic organizational feature, synchronous dialog, dialog systems, basic organizational

备注： Accepted to INTCEC 2026. This is the author's pre-print version. The final authenticated version will be available through the conference proceedings

点击查看摘要

Abstract:Turn-taking is a basic organizational feature of human conversation and remains difficult to model in natural, synchronous dialog systems. While existing research has explored multimodal approaches and large language models for turn-ending prediction, there is a lack of naturalistic conversational corpora specifically addressing turn-taking dynamics in Turkish. This study introduces a multimodal Turkish conversational dataset of unscripted dyadic interactions, comprising synchronized front-facing video, per-speaker audio channels that allow overlapping speech to be attributed to individual speakers, and time-aligned transcriptions. Turn-taking prediction is formulated as a binary classification problem, and a Genetic Algorithm (GA) is employed to optimize interpretable decision rules derived from visual, acoustic, and linguistic features. A hybrid AND-OR rule representation is adopted in the proposed framework to represent the alternative cue combinations that precede a turn transition.

150. 【2608.22034】Align, Unify, Suppress, Route: A Coherentist View of Transformer Computation

链接：https://arxiv.org/abs/2608.22034

作者：Nura Aljaafari,Andre Freitas

类目：Computation and Language (cs.CL)

关键词：Mechanistic interpretability, identified transformer circuits, Coherentist Probabilistic Compositionalism, introduce Coherentist Probabilistic, interpretability has identified

备注：

点击查看摘要

Abstract:Mechanistic interpretability has identified transformer circuits, but lacks a shared vocabulary for describing how their functions compose across tasks and architectures. We introduce Coherentist Probabilistic Compositionalism (CPC), an interpretive framework that grounds transformer computation in coherentist theories of interpretation and describes it through four operator roles. Alignment identifies candidate relations, unification integrates supporting information, suppression reduces incompatible alternatives, and routing carries selected information to the output. Across 15 models from five architecture families, the suppression, unification, and routing weight-space signatures correlate with held-out activation-level role measures above random baselines. Suppression is more stable across tasks than unification. Ablating alignment heads reduces downstream suppressive activity beyond a random-head control in 10 models, but similar effects on no-conflict prompts indicate a general upstream dependency, not contradiction-specific coupling. Explicit contradictions significantly shift a layerwise coherence proxy in 14 models; after removing shared residual covariance, the gap has the predicted direction in every model. Base and instruction-tuned variants preserve induction-head score structure ($r{\geq}0.98$) without a consistent shift of operator signatures towards later layers. These results support CPC as a shared vocabulary for comparing transformer mechanisms while showing that their depth and geometric expression remain architecture-specific.

151. 【2608.22007】he Communication Map of a Transformer

链接：https://arxiv.org/abs/2608.22007

作者：Richard Zhe Wang

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：shared residual stream, transformer communicate, communicate by writing, shared residual, mechanistic interpretability

备注： 28 pages. Code and results: [this https URL](https://github.com/richardzhewang/communication-map)

点击查看摘要

Abstract:The components of a transformer communicate by writing to and reading from a shared residual stream, and mechanistic interpretability has mapped these connections by hand, one circuit at a time. We present the communication map, which charts every potential communication channel in a language model from weights alone, generalizing the composition score of Elhage et al. (2021) into a single coupling coefficient covering all 18 connection classes, from entire attention head circuits to single neurons. The census of all candidate channels, from $6.3\times10^{8}$ in GPT-2 to $1.3\times10^{11}$ in Pythia-6.9B, finds that 70-89% of head pairs are oriented far from chance, some coupled strongly and others actively avoiding each other. The full map costs 15 seconds for GPT-2 and 11 minutes for Pythia-6.9B on one consumer GPU. Two applications demonstrate the utility of the map. In Application 1, the strongest head-to-head couplings recover the known induction circuits blind and group them into communities, and ablating one such community destroys the model's in-context copying. In Application 2, pooling every head's coupling coefficients identifies a distinct two-dimensional stream subspace, whose deletion abolishes the induction capability in six models up to Pythia-6.9B. This subspace is different from those identified by either activation PCA or outlier dimensions. We release the map, the statistical machinery, and the intervention suite.

152. 【2608.21975】Machine learning and digital pragmatics: Which word category influences emoji use most?

链接：https://arxiv.org/abs/2608.21975

作者：Mohammed Q. Shormani,Yehia A. AlSohbani,Mohammed Q. Shormani

类目：Computation and Language (cs.CL)

关键词：Colloquial Arabic, MARBERT model, model in identifying, DPA, norm

备注： 18 pages, 3 tables

点击查看摘要

Abstract:This study examines the performance of the state-of-the-art MARBERT model in identifying the lexical/pragmatic category associated with emoji use on X within a digital pragmatics approach (DPA). A net corpus of 15856 Colloquial Arabic (CA) posts containing emojis was collected from X using Python. The texts were tokenized and normalized into 4 lexical categories, namely noun_norm, verb_norm, adj_norm, and adverb_norm, and 2 pragmatic/structural categories, question_norm and exclamation_norm. MARBERT was finetuned and optimized to identify which category scores standard metrics more, hence associated with emoji use, while binary logistic regression was used to examine which category is statistically associated with emoji occurrence. Findings unveil that nouns dominate the corpus in normalized frequency (M = 0.675, SD = 0.161), followed by verbs (M = 0.083, SD = 0.100). However, verbs have the strongest influence of emoji use indicated by verb density (\b{eta} = 0.821, p = .001, 95% CI [0.332, 1.309]). The study concludes that in digital pragmatics of CA on X, emoji use association with lexical/pragmatic category can be explained by a hybrid approach of computational, statistical, and pragmatic methods, reflecting the interaction among machine learning, linguistic/lexical features, contextual representation, and pragmatic communication.

153. 【2608.21969】oSCA: Leveraging Hierarchical Reinforcement Learning on Temporal and Strategic Abstractions of Conversational Agents

链接：https://arxiv.org/abs/2608.21969

作者：Xiaoyu Wang,Qingqing Gu,Yue Zhao,Teng Chen,Yuqi Cao,Xiaokai Chen,Hongyan Li,Luo Ji

类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

关键词：Humans have multiple, interaction and thinking, strategic planning, multiple levels, levels of temporal

备注： Accepted by EMNLP 2026 Findings

点击查看摘要

Abstract:Humans have multiple levels of temporal abstractions on daily interaction and thinking, such as concept perception and strategic planning. Inspired by this nature, we propose a two-level hierarchical reinforcement learning (RL) framework for conversational agents, bridging the gap between previous token-level or utterance-level RL methods. Developed on a two-level MDP, the token-level response decoding is conditioned on the utterance-level action, the explicit textual strategies. Based on theoretical derivation and efficiency consideration, we use DQN to solve the high-level critic and PPO to solve the low-level actor-critic. To further alleviate the reward sparsity and facilitate the convergence, we also design the dual-granularity reward mechanism, in which the utterance-level satisfaction score is integrated with token-level intrinsic motivation and K-L penalty. Experiments on both daily and emotional support conversations show that our method outperforms versatile baselines in strategy determination and response quality. Our implementation is available at this https URL.

154. 【2608.21950】Bulbul: A Dataset for Dialectal Arabic Speech Recognition

链接：https://arxiv.org/abs/2608.21950

作者：Ahmed Ashraf,Aisha Alansari,Fadel Al Abbas,Nada Almarwani,Samah Aloufi,Saad Ezzini,Maged S. Al-Shaibani,Doaa Dalaq,AbdelRahim A. Elmadany,Muhammad Abdul-Mageed,Mohamed Mehdi Trigui,Dania Refai,Layan Refai,Mohamed Akrout,Mustafa Jarrar,Wasfi G. Al-Khatib,Alaa Dalaq,Darin El-Nakla,Samir Abdaljalil,Abdulrahman Al-Fakih,Nour El Imane Zeghib,Moussa Redah,Salmane Chafik,Mohamed El-Attar,Rima Grati,Sarah Kohail,Malak Alkhorasani,Khadijah Al Safwan,Ismail M. Mudhaffar,Ali Altam,Ahmed Al-Shaikh,Adnan Saeed,Hamzah Luqman

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：faces unique challenges, unique challenges due, automatic speech recognition, limited speech resources, extensive regional dialect

备注：

点击查看摘要

Abstract:Arabic automatic speech recognition (ASR) faces unique challenges due to diglossia, extensive regional dialect variation, and limited speech resources. Existing speech datasets often focus on single dialects or large-scale broadcast/web data, leading to trade-offs between linguistic diversity and annotation quality. We present BULBUL, a multi-dialect Arabic ASR dataset collected from 275 speakers in 11 Arab countries. BULBUL includes structured dialect and sub-dialect coverage, as well as recordings of classical Arabic and modern standard Arabic spoken by participants in their native dialectal accents to support accent-aware modeling. The quality of the recordings was ensured through a two-level human verification process. We further benchmark a range of recent ASR systems, establishing strong baselines for modern dialectal and accented Arabic ASR.

155. 【2608.21946】EDGE: Experience-Distillation for Guided Exploration in Agentic Reinforcement Learning

链接：https://arxiv.org/abs/2608.21946

作者：Can Xie,Yuyi Zhou,Wen Yang,Ziyi zhang,Siyao Song,Yingzhuo Deng,Shuo Ren,Jiajun Zhang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：enables LLM-based agents, reusable exploration patterns, exploration patterns embedded, GRPO enables LLM-based, single policy update

备注： Accepted to EMNLP 2026 (Main Conference)

点击查看摘要

Abstract:Reinforcement learning with outcome-based objectives such as GRPO enables LLM-based agents to solve complex, long-horizon tasks, yet the reusable exploration patterns embedded in interaction trajectories are largely discarded after a single policy update. Existing experience-augmented approaches retrieve historical guidance at inference time, but they apply experiences without accounting for the policy's evolving capability and create persistent dependencies on external retrieval. We propose EDGE (Experience-Distillation for Guided Exploration), a framework that treats retrieved experiences as temporary training-time scaffolds and progressively internalizes their benefits into the parametric policy. Concretely, EDGE partitions each rollout group into experience-conditioned and experience-free trajectories to estimate and admit only positive marginal gains without extra sampling, then distills the induced behavior into the base policy via a reverse-KL objective on its own empirical support. A co-evolutionary experience bank further synthesizes guidance from emerging failure modes and prunes obsolete entries as the policy evolves. On ALFWorld and WebShop, EDGE improves over GRPO by 8.3 and 12.5 success-rate points at the 7B scale and retains 96.0% of its scaffolded performance when external experiences are removed at inference time. The code is available at this https URL.

156. 【2608.21929】SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents

链接：https://arxiv.org/abs/2608.21929

作者：Yuanjin Zheng,Jingbang Chen

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词：trusted instruction channel, Agent skills extend, extend coding agents, Toggle, LLM Coding Agents

备注：

点击查看摘要

Abstract:Agent skills extend coding agents with task-specific instructions, scripts, and resources, but they also create a trusted instruction channel that can be abused beyond conventional security attacks. This paper studies token amplification through skill injection: an economic resource-abuse threat in which a malicious skill causes an agent to consume substantially more tokens than needed for normal task execution. We present SkillBloat, a two-phase framework that first screens a library of diverse attack-type conditions across multiple amplification mechanisms and then refines the strongest candidate through LLM-guided full-document skill rewriting. Evaluated on a real-world skill benchmark, SkillBloat achieves 5.4184x-10.1455x average best amplification across multiple coding-agent target configurations. An ablation shows that the second-stage refinement loop consistently improves average best amplification over Phase 1 attack-type screening alone, demonstrating that iterative optimization provides additional benefit beyond initial attack-type selection. These results show that skill ecosystems expose a practical resource-amplification attack surface that is orthogonal to existing security-oriented skill poisoning.

Subjects:

Cryptography and Security (cs.CR); Computation and Language (cs.CL)

Cite as:
arXiv:2608.21929 [cs.CR]

(or
arXiv:2608.21929v1 [cs.CR] for this version)

https://doi.org/10.48550/arXiv.2608.21929

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Yuanjin Zheng [view email] [v1]
Sat, 22 Aug 2026 11:41:48 UTC (789 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled SkillBloat: Token Amplification Attacks via Skill Injection in LLM Coding Agents, by Yuanjin Zheng and 1 other authorsView PDFHTML (experimental)TeX Source

view license

Current browse context:
cs.CR

|
next

new
|
recent
| 2026-08

Change to browse by:

cs
cs.CL

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

信息检索

1. 【2608.23419】Robustness of IR Models to Collection Growth

链接：https://arxiv.org/abs/2608.23419

作者：Emmanouil Georgios Lionis,Debasis Ganguly,Sean MacAvaney

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：Information Retrieval, identify relevant documents, systems seek, seek to identify, identify relevant

备注： CIKM 2026 Short Paper track

点击查看摘要

2. 【2608.23400】Adaptive Item-based Collaborative Structures via Noise Rescheduling in Diffusion for Generative Recommendation

链接：https://arxiv.org/abs/2608.23400

作者：Jiaqi Wang,Tianying Liu,Heng Chang,Jihong Guan,Wengen Li,Shuigeng Zhou

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：modeling user history, modeling user, diffusion training, recently been introduced, user history

备注：

点击查看摘要

Abstract:Discrete Diffusion Models (DDMs) have recently been introduced to recommendation systems, modeling user history as a token generation process via iterative denoising. However, while effective at capturing user-level sequential patterns, these methods often fail to explicitly integrate item-based collaborative filtering information, a critical component for accurate recommendation. This deficiency manifests in two key aspects: (1) the item representation is often semantic-focused, lacking collaborative priors for diffusion training; and (2) the denoising process employs a uniform noise schedule, treating all tokens indiscriminately and ignoring item-level adaptive structural dependencies. To bridge this gap, we propose ANR-DiffRec, a unified framework designed to encode item-based collaborative structures into discrete diffusion for generative recommendation. First, we explicitly incorporate an item co-occurrence matrix to guide semantic ID generation, providing a structured collaborative prior for discrete diffusion training. Second, we introduce an item-based adaptive noise rescheduling mechanism that dynamically adjusts denoising weights according to both local contextual recoverability and behavior-aware item dependencies. Specifically, the proposed strategy jointly models intra-item structural context and inter-item collaborative signals, enabling structure-aware denoising during diffusion training. Extensive experiments on multiple benchmarks demonstrate that our method consistently outperforms state-of-the-art generative recommendation models. Code: this https URL.

3. 【2608.23392】owards a Densing Law for User Representation Learning at Billion-Scale Capacity

链接：https://arxiv.org/abs/2608.23392

作者：Bin Dou,Junru Zhang,Zhaoyi Yuan,Wuliang Huang,Letian Gong,Baokun Wang,Huan Li,Yu Cheng,Weiqiang Wang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：User Behavioral Densing, increasing user amount, real-world industrial scenarios, behavioral sequence length, Behavioral Densing Law

备注： 28 pages, 13 figures, technical report

点击查看摘要

Abstract:User representation learning in real-world industrial scenarios is commonly scaled by increasing user amount, behavioral sequence length and model size. However, existing methods face two challenges: (i) Bottleneck for raw data scaling at billion-scale capacity, as performance exhibit diminishing performance gains with larger-scale raw text user behavioral input, which can be mitigated by tokenization. (ii) Lack of quantitative analysis of how tokenization configurations should scale with data size. In this report, we propose User Behavioral Densing Law for characterizing the quantitative relationship between data scale and the minimum sufficient tokenization capacity. Firstly, we conduct a pilot study on raw tokenized scaling comparison on billion-scale Alipay dataset, revealing the raw data scaling bottleneck and the sustained gains enabled by tokenization. To derive the scaling pattern governing the minimum sufficient tokenization configuration at different data scales, theoretical analysis and systematic experiments are employed to summarize the quantitative scaling pattern. We find an approximately linear relationship between the logarithms of minimum sufficient tokenization capacity and input data size measured by tokens, and the scaling slope varies systematically with the tokenization method and data source, reflecting differences in representation-space redundancy and intra-source uniqueness. Guided by the proposed law, we further develop ALGN, an adaptive variable-length tokenization method that improves capacity allocation. Extensive experiments across diverse data sources, tokenization methods, and downstream tasks demonstrate the generalizability and reliability of the User Behavioral Densing Law, providing practical guidance for tokenization configuration selection in large-scale user representation learning. Moreover, ALGN outperforms existing baselines.

4. 【2608.23356】Hierarchical Exponential-Gaussian Mixtures for Watch-Time Distribution Prediction

链接：https://arxiv.org/abs/2608.23356

作者：Sofia Gulevskaia,Mikhail Trapeznikov,Aleksandr Poslavsky,Alexander D'yakonov

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG); Machine Learning (stat.ML)

关键词：Accurate watch-time, short-video recommendations, important requirement, requirement for short-video, Exponential-Gaussian Mixture Network

备注： 16 pages, 8 figures, 7 tables, accepted at IEEE International Conference on Data Mining (ICDM 2026)

点击查看摘要

Abstract:Accurate watch-time (WT) prediction is an important requirement for short-video recommendations. Yet WT distributions are near-zero-inflated, long-tailed and multimodal. The recent Exponential-Gaussian Mixture Network (EGMN) models the full conditional WT distribution rather than a single point estimate and achieves state-of-the-art performance. Our large-scale reproduction study reveals that EGMN is vulnerable to variance collapse, component redundancy, and inactive components. We propose a Hierarchical Exponential-Gaussian Mixture (HEGM) model that addresses these failure modes through a hierarchical skip-watch decomposition, KL-based variance regularization, structured initialization, removing the forced Gaussian shift and the entropy regularizer. Across public and large-scale industrial datasets, HEGM improves ranking accuracy and threshold-event prediction, while maintaining competitive point-estimation accuracy and substantially improving mixture stability and interpretability. A 1.5-month production A/B test confirms statistically significant engagement lifts. Our code and models are publicly released at this https URL.

5. 【2608.23338】he Emergence of Relevance Through Axiomatic Attention Patterns During LoRA Fine-Tuning

链接：https://arxiv.org/abs/2608.23338

作者：Matthew Perlman,Atharva Nijasure,James Allan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：network task-specific relevance, task-specific relevance behavior, LLMs to reranking, accompany that learning, remains unclear

备注： Accepted to EMNLP 2026 Findings. 17 Pages. 25 Figures. 5 Tables

点击查看摘要

6. 【2608.23252】he Laws of Context Allocation: Causal Measurement and Closed-Loop Orchestration in Generative Search

链接：https://arxiv.org/abs/2608.23252

作者：Peiyang Liu,Xi Wang,Di Liang,Wei Ye

类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：suboptimal context budget, shifts toward diverse, critical bottlenecks, context budget allocation, diverse portfolio generation

备注：

点击查看摘要

Subjects:

Machine Learning (cs.LG); Computation and Language (cs.CL); Information Retrieval (cs.IR)

Cite as:
arXiv:2608.23252 [cs.LG]

(or
arXiv:2608.23252v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2608.23252

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Peiyang Liu [view email] [v1]
Mon, 24 Aug 2026 13:44:11 UTC (1,876 KB)

7. 【2608.23241】Retrieval-Augmented Classification of Environmental Mitigations in Hydropower Licensing Documents

链接：https://arxiv.org/abs/2608.23241

作者：Hong-Jun Yoon,Tom Ruggles,Joanna Lee,Debjani Singh

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：Federal Energy Regulatory, Energy Regulatory Commission, Regulatory Commission hydropower, Commission hydropower licensing, deep domain expertise

备注：

点击查看摘要

Abstract:Identifying and classifying environmental mitigation obligations in Federal Energy Regulatory Commission hydropower licensing documents is a labor-intensive task requiring deep domain expertise. We formulate this as a multi-label classification problem over a structured 135-category taxonomy and address the central challenge of severe label scarcity: 40 of 135 categories have no training examples, and 26 have fewer than five. A supervised Bidirectional Encoder Representations from Transformers (BERT)-based pipeline, while effective on well-represented categories, achieves F1 of zero on unseen classes regardless of augmentation strategy. We introduce a Retrieval-Augmented Generation (RAG) pipeline that conditions classification on retrieved category definitions, enabling zero-shot generalization across the full label space. We further propose a hybrid system that combines BERT detection with RAG classification, exploiting the high recall of fine-tuned detection and the zero-shot coverage of retrieval-augmented reasoning. Evaluated on the full set of 2017 license documents (5,860 paragraphs, 135 categories), the hybrid achieves a Micro F1 of 0.524, outperforming the BERT-only pipeline (0.477) and the RAG-only pipeline (0.416) across all training-support buckets.

8. 【2608.23221】Which Histories Matter for Time Series Forecasting? Learning Predictive Relevance with Future Supervision

链接：https://arxiv.org/abs/2608.23221

作者：Yong-Hoon Choi,Youngjin Cho

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：time-series prediction commonly, prediction commonly treats, commonly treats past, treats past similarity, proxy for usefulness

备注：

点击查看摘要

Abstract:Historical retrieval for time-series prediction commonly treats past similarity as a proxy for usefulness. We ask a different question: which historical examples should be expected to matter for a query? We define predictive relevance as expected future utility conditioned on inference-time information, using realized futures only during training as privileged supervision. A normalized-pattern retriever first forms a coarse candidate set, and a lightweight residual multilayer perceptron (MLP) learns a listwise future-compatibility target while keeping inference-time scoring strictly past-only. Our method retains similarity-based candidate generation but reranks its candidates by a more predictive relevance criterion. Optimal relevance decomposes into candidate-level utility and query-specific compatibility, motivating Candidate-Prior and Shuffled-Future controls. Across six benchmarks, the reranker improves Pattern retrieval while revealing candidate-global, query-specific, and mixed relevance regimes. On all 12 confirmatory tasks, it improves Pattern and outperforms a matched-protocol Stationarity-Aware Retrieval-Augmented Time Series Forecasting (SARAF) retrieval rule. Architecture-matched ablations show that correct future supervision, rather than the MLP or added context alone, drives gains in query-specific regimes. Alternative-similarity experiments show that a strong last-value-anchored L2 rule remains superior in some domains, whereas future-supervised relevance is particularly strong where our diagnostics indicate query-specific relevance, especially on Solar. Candidate-pool diagnostics show that this contrast is not explained solely by coarse Pattern retrieval. Overall, historical relevance is structured and domain dependent rather than governed by a universally superior retrieval rule.

9. 【2608.23214】Aligning Biomedical Texts and Knowledge Graphs: A Systematic Comparison of Lightweight Alignment Strategies

链接：https://arxiv.org/abs/2608.23214

作者：Artem Bisliouk,Elizaveta Nosova,Heiko Paulheim,Andreea Iana,Rita T. Sousa

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：unstructured scientific literature, structured knowledge graphs, Biomedical knowledge exists, distinct forms, unstructured scientific

备注： Accepted at the Third Workshop on Knowledge Graphs and Neurosymbolic AI (KG-NeSy 2026) co-located with ISWC 2026

点击查看摘要

10. 【2608.23176】Evaluating Modern RAG: Textual, Multimodal, Dense, and Late Interaction Pipelines

链接：https://arxiv.org/abs/2608.23176

作者：Emre Kuru,Mehmet Onur Keskin

类目：Information Retrieval (cs.IR)

关键词：Retrieval-augmented generation, traditionally relied, relied on text-based, extract and retrieve, retrieve information

备注：

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) systems have traditionally relied on text-based pipelines that extract and retrieve information from documents. While efficient and lightweight, these approaches often struggle with documents where meaning is conveyed through layout, tables, and visual elements. Recent advances in multimodal pipelines, powered by vision-language models (VLMs), improve retrieval quality by jointly encoding visual and textual signals, but at increased computational and memory cost. We propose a quantitative, data-driven selection methodology that guides practitioners in choosing the most appropriate RAG pipeline for a given document corpus based on empirical effectiveness and resource constraints. We evaluate contemporary textual and multimodal pipelines, including dense and late-interaction architectures, analyze their trade-offs, and provide actionable guidance for balancing retrieval performance with system efficiency.

11. 【2608.23154】he Disconnect Between Better Descriptive Reasoning Trace Quality and Recommendation Effectiveness

链接：https://arxiv.org/abs/2608.23154

作者：Gustavo Penha,Juan Elenter,Claudia Hauff,Hugues Bouchard,Paul Bennett,Mounia Lalmas

类目：Information Retrieval (cs.IR)

关键词：Recent work, descriptive reasoning, work has focused, reasoning, Recent

备注： Accepted at the Recsys'26 Workshop on Agentic and Generative AI for E-Commerce

点击查看摘要

Abstract:Recent work has focused on improving explicit natural-language descriptive reasoning traces for generative recommendation. This includes systems that augment semantic ID (SID) prediction with chain-of-thought reasoning. However, because SIDs are opaque learned identifiers rather than natural language, they require costly alignment before an LLM can reason over them. This provides a controlled experimental setting in which both item representation (Title vs. SID) and semantic grounding (minimal vs. extensive SID alignment) can be varied independently. We therefore present the first controlled comparison of descriptive reasoning trace quality across semantic IDs and natural-language titles in a 2 x 2 factorial study on three Amazon product domains using a shared Qwen3-1.7B backbone. We find that introducing explicit descriptive reasoning traces reduces traditional offline recommendation effectiveness under standard SFT and RL training, even though natural language titles produce substantially more grounded and interpretable traces. Extensive SID alignment improves descriptive trace quality but not traditional offline recommendation effectiveness, while a richer reward signal partially recovers performance. Overall, our results show that improving descriptive reasoning trace quality is not, by itself, sufficient to consistently improve traditional offline recommendation effectiveness under the training objectives and evaluation protocols studied here.

12. 【2608.23131】A Dual-Expert Strategy Integrating LLMs to Mitigate Negative Transfer in Cross-Domain Sequential Recommendation

链接：https://arxiv.org/abs/2608.23131

作者：Hyeongjun Yun,Kihyuk Song,Jaegul Choo,Chung Park

类目：Information Retrieval (cs.IR)

关键词：historical interaction sequences, Large Language Models, leverage Large Language, Cross-Domain Sequential Recommendation, Sequential Recommendation

备注： Accepted at CIKM 2026

点击查看摘要

Abstract:Cross-Domain Sequential Recommendation (CDSR) predicts the next item a user will interact with based on their historical interaction sequences across multiple domains. Recent approaches leverage Large Language Models (LLMs) finetuned on textual representations of cross-domain user sequences to retrieve the recommended items, referred to as LLMRec. However, LLMRec primarily models the autoregressive patterns of token-level item texts, while overlooking item-level collaborative signals. This semantic misalignment often leads to distorted knowledge transfer across domains-termed negative transfer degrading performance in the CDSR task. To address this issue, we propose a novel LLM-based CDSR model, DuELRec: Domain-Gated Dual Experts with LLMs for Cross-Domain Sequential Recommendation. We propose a domain-gated dual-expert framework, equipped with an item-aware attention transformation module, which aggregates textual subtokens into item-level representations and enforces block-level attention masking. The single-domain expert restricts autoregressive attention to items within the same domain, while the cross-domain expert allows it across all domains. A gating mechanism adaptively fuses their outputs, using single-domain signals to reduce cross-domain noise that causes negative transfer. Second, we introduce a dual-sampling token-to-item contrastive learning objective that allows LLMs to capture the item-level collaborative signals from both single- and cross-domains. This is achieved by transforming token-level item texts into item-level representations and applying stochastic negative sampling from both single- and cross-domain item pools for contrastive learning. Extensive experiments on two real-world datasets across ten domains show that our model outperforms 26 state-of-the-art methods in recommendation performance.

13. 【2608.23102】raining-Free Pseudo-Fusion for Composed Image Retrieval with Diffusion Models and Multimodal Large Language Models

链接：https://arxiv.org/abs/2608.23102

作者：Fan Xu,Luis A. Leiva

类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

关键词：formulate compositional queries, content-based image retrieval, Composed Image Retrieval, enables users, users to formulate

备注：

点击查看摘要

Abstract:Composed Image Retrieval (CIR) is an emerging paradigm in content-based image retrieval that enables users to formulate compositional queries by combining a reference image with an auxiliary modality, usually text-based. This approach supports fine-grained search where the target image shares structural elements with the user-provided image while incorporating the modifications specified by the auxiliary text. Conventional CIR methods rely on multimodal fusion to combine visual and textual features into a joint query embedding, which requires training modules that align composed queries with the targets. In this work, we propose PeFuse (for pseudo-fusion), a training-free framework that leverages pretrained Diffusion Models and Multimodal Large Language Models to bridge modalities via generative conversion. We introduce two novel strategies: uni-directional and bi-directional conversion, which convert CIR into four single-modality retrieval problems. These methods reformulate CIR as either intra-modal or cross-modal single-query retrieval tasks, bypassing the need for dedicated task-specific training. Extensive experiments on standard benchmarks demonstrate that converting CIR into text-to-image retrieval tasks is more effective than alternative conversion strategies, achieving competitive or superior performance compared with state-of-the-art methods, while maintaining high flexibility thanks to replaceable components of the conversion pipeline. These results highlight the effectiveness of the pseudo-fusion paradigm for zero-shot CIR. Our code is publicly available at: this https URL.

14. 【2608.23065】Cultural Moment Benchmark: Evaluating Video Cultural Reasoning and Grounding in Southeast Asia

链接：https://arxiv.org/abs/2608.23065

作者：Burak Satar,Zhixin Ma,Cheng Yu-Tong,Huy Hoang Tran,Phuong Anh Nguyen,Chong-Wah Ngo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Multimedia (cs.MM)

关键词：grasping the symbolic, symbolic and temporal, temporal significance, video, Cultural understanding

备注： Accepted to EMNLP 2026 Main Conference, [this https URL](https://culturalmoment-benchmark.github.io/)

点击查看摘要

15. 【2608.22980】Hypergraph Embedding Indexing for Efficient Dense Vector Retrieval

链接：https://arxiv.org/abs/2608.22980

作者：Kishore Konda

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：approximate nearest neighbor, existing approximate nearest, modern semantic search, Dense vector retrieval, nearest neighbor

备注：

点击查看摘要

Abstract:Dense vector retrieval has become the foundation of modern semantic search, yet existing approximate nearest neighbor (ANN) indexes treat an embedding as an indivisible point in a high-dimensional space. In this work, we propose the Hypergraph Embedding Index (HEI), a framework that instead organizes documents according to combinations of highly activated latent embedding dimensions. This formulation enables inverted-index style candidate generation while preserving the semantic ranking capabilities of dense embeddings. We further demonstrate that constructing multiple complementary hypergraphs substantially improves retrieval coverage without the combinatorial growth associated with increasing the dimensionality of a single hypergraph. Finally, we establish that the statistical properties of embedding activations strongly influence coordinate-inverted indexing efficiency, introducing \emph{activation diversity} as a diagnostic metric governing embedding indexability in coordinate-inverted frameworks.

16. 【2608.22973】Cascading Relevance-driven Recommendation Network for CTR Prediction in Trigger-Introduced Recommendation

链接：https://arxiv.org/abs/2608.22973

作者：Kaixuan Chen,Wenwen Wang,Xing Fang,Yang Huang,Jing Wang

类目：Information Retrieval (cs.IR)

关键词：people daily consumption, E-commerce has emerged, Relevance-driven Recommendation Network, emerged as crucial, crucial platforms

备注：

点击查看摘要

Abstract:E-commerce has emerged as crucial platforms for people's daily consumption and shopping interests. There is a new recommendation scenario, Trigger-Introduced Recommendation (TIR), where users click interested product, which is defined as the trigger item, containing their instant interest, and in the undertaking page following the relevant target items. Distinguished from traditional search and recommendation scenarios, trigger contains relatively strong instant interest, which is more vague and implicit compared to search terms. Relying on large amounts of labeled data, existing methods lack the exploration of trigger relevance, which affects users' immersive experience. To alleviate this problem, we propose the Cascading Relevance-driven Recommendation Network (CRRN) to emphasize the interaction and relevance between trigger and target, comprising three essential components: 1) the Trigger-Target Interaction layer extracts interaction features of trigger and target based on personalized gating. 2) Cascading Interest Fusion module explicitly estimates users' trigger intention and fuses instant and personalized interests adaptively with cascading attention blocks. 3) Category-assisted Pairwise Loss enhances trigger relevance with the guidance of category association between trigger and target. Extensive experiment results show that CRRN outperforms recent state-of-the-art methods on both industrial and public datasets. Online A/B tests further validate the effectiveness of our method. Our code is available at this https URL.

17. 【2608.22917】SWAP: A Multilingual Retrieval-Augmented Thai Wellness Advisor

链接：https://arxiv.org/abs/2608.22917

作者：Pornthep Ukosaramig,Kobkrit Viriyayudhakorn

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：deployed eight-language conversational, Thai traditional medicine, eight-language conversational wellness, conversational wellness advisor, present TSWAP

备注： 8 pages, 2 tables. Data and evaluation logs: [this https URL](https://huggingface.co/datasets/iapp/tswap-wellness-benchmark)

点击查看摘要

18. 【2608.22872】Better Retrieval, Worse Robustness:How Multi-hop RAG Amplifies Upstream ASR Errors

链接：https://arxiv.org/abs/2608.22872

作者：Zhenghua Bao

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Audio and Speech Processing (eess.AS)

关键词：Speech-based applications pass, automatic speech recognition, fixed upstream constraint, applications pass spoken, pass spoken queries

备注： Accepted to EMNLP 2026 (Main Conference)

点击查看摘要

19. 【2608.22859】WARP: Wasserstein-Aligned RAG for Population Opinions

链接：https://arxiv.org/abs/2608.22859

作者：Aman Singh Thakur,Aditya Agrawal,Alwarappan Nakkiran,Alex Karlsson

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：RAG systems, systems are increasingly, summarize what large, large collections, RAG

备注： Pre-print

点击查看摘要

Comments:
Pre-print

Subjects:

Information Retrieval (cs.IR); Computation and Language (cs.CL)

Cite as:
arXiv:2608.22859 [cs.IR]

(or
arXiv:2608.22859v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2608.22859

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

20. 【2608.22856】Same Agent, Different Answers: A Repeat-Aware Audit of Corpus-Induced Answer Churn in Retrieval-Augmented QA

链接：https://arxiv.org/abs/2608.22856

作者：Jingjie Ning,Xueqi Li

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：requested model identifier, exposed generation controls, retrieval policy, evidence depth, model identifier

备注：

点击查看摘要

21. 【2608.22752】he Compaction Cliff in Long-Running AI Agent Memory

链接：https://arxiv.org/abs/2608.22752

作者：Saber Zerhoudi,Jelena Mitrovic,Michael Granitzer

类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：episodic log compete, episodic log, log compete, safety rules, agent context

备注：

点击查看摘要

Abstract:A safety rule and an episodic log compete for the same tokens in an AI agent's context. When the budget overflows, both are summarized at the same rate; only the rule needs exact wording to remain enforceable. On 20 production agent configurations, Claude Code's /compact prompt on Sonnet 4.6 preserves 53\% of safety rules after one compaction round and 10\% after five. We name this the Compaction Cliff. We address it with Knowledge Triage, a framework that classifies each line of an agent's knowledge base by type and routes each type through its own retention policy. Three deterministic operators implement this triage across the three context-management operations: TypeCompact rewrites items in place under per-type fidelity, TypeDecompose partitions a topic too large to compact safely, replicating in-scope safety rules across partitions, and TypeRetrieve fetches items from external storage with in-scope rules pinned ahead of relevance. On five public corpora, TypeCompact preserves 2--4$\times$ more safety rules than the strongest single-shot LLM compactor at every ratio, with 96\% recall over five rounds. TypeDecompose reaches 0\% locality violations against 93\% under uniform partitioning. TypeRetrieve reaches 100\% recall@50 against 73\% for the best single-shot LLM retriever. On three downstream behavioral benchmarks, we outperform the production Sonnet compactor on medical compliance (paired McNemar $p 10^{-8}$ on preservation, $N = 200$), the full-policy and hierarchical baselines on retail task pass rate ($p 0.01$, $N = 115$), and the hierarchical compaction on the airline domain ($p = 0.024$). We release AgentArtifactCorpus (396{,}934 agent configurations from 54{,}628 public GitHub repositories), the classifier, and the reference implementation.

22. 【2608.22751】Risk-Aware Reranking for Agentic Tool Retrieval

链接：https://arxiv.org/abs/2608.22751

作者：Qinfei Li,Xiaoxuan Dong,Jin Zhang,Dexu Yu,Wenhao Deng,Junchen Fu,Youhua Li,Hanwen Du,Chunxiao Li

类目：Information Retrieval (cs.IR)

关键词：pre-execution safety boundary, critical pre-execution safety, LLM agent, Tool retrieval determines, determines which external

备注： Accepted by CIKM 2026

点击查看摘要

Abstract:Tool retrieval determines which external tools are exposed to an LLM agent for a user query or task, making retrieval a critical pre-execution safety boundary. Unlike document retrieval, tool retrieval exposes executable actions: a tool that is useful for one task may be unnecessary or risky for another. However, existing tool-retrieval methods primarily optimize semantic relevance, and safety evaluations often focus on failures after tool execution rather than risks introduced during retrieval. We study risk-aware tool retrieval, where the goal is to retrieve useful tools while reducing exposure to higher-risk tools. We propose a lightweight reranking framework on top of a frozen first-stage retriever. The framework models query-conditioned relevance and tool-level exposure risk separately, combines them through an explicit parameter controlling the tradeoff between safety and utility, smooths scores over a ToolGraph, and optionally applies rule-based safety constraints. To support retrieval-time safety evaluation, we annotate 6,108 tools across UltraTool and Seal-Tools with five ordinal risk levels and define metrics that measure risky-tool exposure in the top-$k$ results. Experiments on UltraTool and Seal-Tools show that our approach improves the relevance--safety tradeoff over relevance-only retrievers and reranking baselines, with the rule-filtered variant providing a conservative operating point for safety-critical deployments. These findings indicate that retrieval-stage filtering can reduce the candidate action space exposed to agents before execution, complementing downstream tool-use safeguards. The code and supplementary materials are available at: this https URL.

23. 【2608.22734】Rethinking Item Tokenization in Generative Recommenders: From Fixed Atoms to Semantic Subwords

链接：https://arxiv.org/abs/2608.22734

作者：Xinrui Miao,Mingjia Yin,Jiaqing Zhang,Wei Guo,Yong Liu,Yuyang Ye,Hao Wang,Enhong Chen

类目：Information Retrieval (cs.IR)

关键词：autoregressive next-item prediction, Item-level Subword Tokenization, Intra-item Attention Overload, next-item prediction, Subword Tokenization

备注： 13 pages, 6 figures, 8 tables. Accepted to CIKM 2026

点击查看摘要

Abstract:In generative recommender systems, items are typically tokenized into fixed-length semantic ID sequences for autoregressive next-item prediction. However, for user-context modeling, this fine-grained representation triggers Intra-item Attention Overload: excessive attention is spent on low-level intra-item dependencies rather than high-level inter-item behavioral transitions. To address this, we propose Semantic Subword Tokenization (SST), which represents historical items as variable-length semantic subwords while preserving fixed-length target decoding. SST first applies Item-level Subword Tokenization (IST) to merge stable adjacent atom tokens into compact semantic subword tokens, thereby reducing intra-item reassembly in the encoder. It then introduces Behavior-induced Co-occurrence Augmentation (BCA) to inject coarse-grained semantic prefix transition signals, guiding the freed modeling capacity toward inter-item behavioral regularities. Extensive experiments on three public datasets and three generative recommender backbones show empirical improvements of SST over fixed-length and transferable variable-length SID baselines. Code is available at this https URL.

Comments:
13 pages, 6 figures, 8 tables. Accepted to CIKM 2026

Subjects:

Information Retrieval (cs.IR)

Cite as:
arXiv:2608.22734 [cs.IR]

(or
arXiv:2608.22734v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2608.22734

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

24. 【2608.22695】Enrich-Retrieve-Rank: Scaling Capability Discovery Beyond In-Context Routing

链接：https://arxiv.org/abs/2608.22695

作者：Nazib Sorathiya,Daniel Zhang,Bardiya Akhbari

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：MATS components, thousands of MATS, ecosystems now include, include thousands, Models

备注： 11 pages, 4 figures, and 12 tables

点击查看摘要

25. 【2608.22688】FashionKG-RAG: Knowledge Graph-Enhanced Retrieval-Augmented Generation for Fashion Question Answering

链接：https://arxiv.org/abs/2608.22688

作者：Yujuan Ding,Linyin Luo,Shijie Wang,Xu Yuan,Yunshan Ma,Yi Bin,Wenqi Fan,Qing Li

类目：Information Retrieval (cs.IR); Multimedia (cs.MM)

关键词：effective decision-making depends, integrating multiple types, Large Language Models, effective decision-making, decision-making depends

备注：

点击查看摘要

Abstract:Fashion is a knowledge-intensive domain in which effective decision-making depends on integrating multiple types of knowledge. Although Large Language Models (LLMs) have transformed many areas, their application in fashion remains limited by hallucinations and weak domain specialization. Knowledge Graph (KG)-based Retrieval-Augmented Generation (RAG) offers a promising way to add structured knowledge to LLMs. However, existing fashion KGs are typically restricted to product-level attributes or item relations, and fail to capture the broader fashion ecosystem. To bridge these gaps, we propose \textbf{FashionEcoKG}, a comprehensive, domain-wide knowledge graph built with expert-level precision and professionalism. It is constructed through a three-stage agentic pipeline that extracts high-fidelity knowledge cores from authoritative textbooks and strengthens structural connectivity through cross-domain augmentation and generative expansion. To leverage this resource, we further develop \textbf{PG-RAG} (Pruning-Grounding RAG), a training-free framework designed to handle the conceptual density and linguistic noise of fashion queries. Specifically, we introduce a Dual-Granularity Path Re-Ranking (DGPR) module of two stages. The Pruning-based Semantic Ranking (PSR) module distills each query into a skeleton form to improve retrieval recall, while the Grounding-based Agentic Ranking (GAR) performs point-wise scrutiny of candidate paths against the original full query to ensure global relevance. Experiments on a curated fashion QA dataset show that PG-RAG effectively leverages FashionEcoKG to improve retrieval and answer accuracy, outperforming both non-RAG and existing KG-RAG baselines.

26. 【2608.22559】ExecRubrics: Executable Tool-Augmented Rubrics for Verifiable and Efficient Long-Form Evaluation

链接：https://arxiv.org/abs/2608.22559

作者：Kaustubh D. Dhole,Charles L. A. Clarke,Eugene Y. Agichtein

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：decomposing response quality, make language-model evaluation, language-model evaluation transparent, aim to make, make language-model

备注： Accepted to EMNLP 2026 Findings

点击查看摘要

27. 【2608.22381】GRAFT: Graph-Distilled Generative Retrieval for Facet-Aware Scientific Literature Exploration

链接：https://arxiv.org/abs/2608.22381

作者：Italo Luis da Silva,Hanqi Yan,Yujing Wang,Jiangnan Ye,Lin Gui,Yulan He

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：document-level retrievers collapse, single similarity score, relate by problem, single similarity, scientific discovery depends

备注：

点击查看摘要

28. 【2608.22228】Prompt-Based Abstention Fails Under Misleading Context: A Controlled Study of Small Frozen RAG Models

链接：https://arxiv.org/abs/2608.22228

作者：Yohanes Andre Setiawan

类目：Information Retrieval (cs.IR)

关键词：retrieval-augmented generation, treats them alike, RAG, misleading, abstention

备注： 20 pages. Committed to AACL-IJCNLP 2026. Code/data to be released

点击查看摘要

Abstract:Missing and misleading evidence are not the same problem in retrieval-augmented generation (RAG), but prompt-based abstention treats them alike. Models abstain when context is absent, not when it is misleading. We introduce GRAB-RAG (Graded Abstention Benchmark for Retrieval-Augmented Generation), a paired benchmark that tests the same questions across four context conditions (supportive, degraded, missing, and misleading) in Natural Questions and HotpotQA. In the misleading condition, we edit a gold passage to support a wrong answer and place it among other retrieved passages. We test five abstention policies on three small frozen models (3.8B--8B) across two QA benchmarks. Models abstain reliably when evidence is missing, but under explicit abstention prompting still answer 41.6% of misleading questions, with 63% of those answers echoing the planted wrong entity verbatim. Chain-of-thought provides little additional benefit. A generator-side conflict check cuts the rate to 13.3% but discards many correct answers, while an NLI verifier recovers that coverage but fails when parametric memory and the misleading passage agree on the same wrong answer. Prompt-based abstention asks whether context is sufficient, not whether it is correct. Neither verifier closes this gap without trading coverage for safety.

29. 【2608.22183】VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSR

链接：https://arxiv.org/abs/2608.22183

作者：Yani Guan,Dengpan Dong,Shuang Luo,Zi Wei,Joah Han,Dan Hannah,Yumin Zhang,Qichao Hu,Kang Xu

类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：chemical training datasets, Chemical Structure Recognition, Optical Chemical Structure, large-scale chemical training, constructing large-scale chemical

备注：

点击查看摘要

Abstract:Optical Chemical Structure Recognition (OCSR) converts 2D molecular depictions in the published literature into SMILES, and is increasingly important for constructing large-scale chemical training datasets. Automation at that scale requires identifying unreliable predictions in the absence of ground truth. Three families of label-free signals were compared on $263$ ACS journal depictions with verified ground truth: model confidence, re-rendering similarity, and agreement among recognizers. Pixel-space re-rendering performed little better than chance (AUROC $0.547$, $95\%$ CI $[0.465,0.629]$), and an oracle-tuned threshold on it reduced correct labels per image from $0.745$ to $0.205$. Agreement among four architecturally distinct recognizers instead reached an AUROC of $0.916$ ($[0.880,0.952]$). The two-of-four rule accepted $81.7\%$ of images at $88.8\%$ precision, the three-of-four rule $52.1\%$ at $98.5\%$. The same pattern held on CLEF-IP, UOB, and USPTO. This distinction is obscured on synthetic benchmarks, where re-rendered predictions naturally resemble their inputs. A substance filter removed $2{,}193$ false agreements on wildcards and R-group fragments, after which the three-of-four rule rejected all $68$ generic depictions. VERDICT was then applied to PMC Open Access, producing $6{,}146$ structure labels for $4{,}833$ molecules; chemist adjudication of $400$ released labels in two independent samples yielded precisions of $0.995$ for the three-of-four tier and $0.958$ for the two-of-four tier. VERDICT therefore enables validated labels for multimodal molecular databases linking structure images, machine-readable representations, and source-publication information. In SES AI's Molecular Universe platform, VERDICT further serves as an image-based interface for searching and retrieving molecular records.

30. 【2608.22135】GrOIL: Graph-Grounded Domain Ontology Induction with Constrained LLM Mediation

链接：https://arxiv.org/abs/2608.22135

作者：Maruf Ahmed Mridul,Abid Talukder,Oshani Seneviratne

类目：Information Retrieval (cs.IR)

关键词：Constructing formal ontologies, automatic system delivers, requires simultaneously enforcing, existing automatic system, documents requires simultaneously

备注： 12 pages, 9 figures, 3 tables

点击查看摘要

Abstract:Constructing formal ontologies from domain documents requires simultaneously enforcing corpus grounding, vocabulary consistency, axiom-level expressivity, and end-to-end provenance, a combination no existing automatic system delivers. We present a seven-stage graph-grounded pipeline that converts domain documents into a complete, auditable Web Ontology Language (OWL) Terminological Box (TBox) without any unconstrained generation step. Documents are first encoded as Unified Discourse-Hypergraphs (UDH) capturing entity participation and discourse dependencies; subsequent stages transform this graph evidence into a class hierarchy, typed object and datatype properties, and restriction axioms, with Large Language Model (LLM) usage restricted to narrow, graph-grounded mediation tasks. A paired Assertional Box (ABox) population procedure grounds named individuals in the induced TBox, enabling SPARQL-based functional evaluation. Every emitted term carries a full decision chain from raw source passages through each pipeline stage, making the TBox directly auditable and suitable for targeted human refinement. Evaluated on the life insurance domain using two established benchmarks and a new 100-contract corpus spanning ten product types, our pipeline achieves strong results across all evaluation dimensions, outperforming direct and multi-agent LLM baselines on competency-question (CQ) coverage (0.85 vs. 0.63 and 0.62 on one term-life contract; 0.77 vs. 0.40 and 0.44 on another contract), while also attaining high keyphrase coverage comparable to a manually-constructed reference ontology and strong performance on structured gap-and-overlap reasoning, all without any manual TBox engineering. Ontology growth analysis provides evidence consistent with vocabulary saturation at scale, demonstrating that the pipeline produces stable, reusable domain representations from large document corpora.

31. 【2608.22118】RAG Collapse: LLM Responses Collapse When Retrieved Documents Are Self-Authored

链接：https://arxiv.org/abs/2608.22118

作者：Gregory Druck,Ethan Smith

类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：self-reinforcing feedback loop, creating the potential, feedback loop, generate a significant, significant amount

备注： 36 pages, 31 figures, 4 tables

点击查看摘要

32. 【2608.22081】W-RAG: Source-Aware Retrieval for Enterprise Document Generation from Heterogeneous Knowledge Bases

链接：https://arxiv.org/abs/2608.22081

作者：Hridya Dhulipala,Rajesh Ombase,Michael Wang,Tien N. Nguyen

类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：enables large language, improving factual grounding, large language models, incorporate external knowledge, enables large

备注： 18 pages

点击查看摘要

33. 【2608.22036】SARCLIP: A Scalable CLIP-Based Retrieval System for Seventeenth-Century Spanish American Notary Records

链接：https://arxiv.org/abs/2608.22036

作者：Chandrasekhar Syamala,Parshad Suthar,Hulayyil Alshammari,Viviana Grieco,Praveen Rao

类目：Information Retrieval (cs.IR)

关键词：Historical manuscript archives, Spanish American Notary, American Notary Records, resist standard text, manuscript archives resist

备注： 4 pages, 2 figures. To appear

点击查看摘要

Abstract:Historical manuscript archives resist standard text search due to inconsistent handwriting, archaic orthography, and the absence of reliable transcriptions at scale. We present SARCLIP (Spanish American Notary Records Meets CLIP), a deployed retrieval system for the National Archives of Argentina's seventeenth-century Spanish American notary records, a corpus of more than 13.6 million word-image patches spanning over 100 microfilm rolls ("rollos"). SARCLIP is built on a CLIP ViT-B/16 model contrastively fine-tuned on paleography-expert-annotated data, and extends prior work by (1) scaling approximate nearest-neighbor retrieval to the near-complete corpus via a FAISS index, (2) refining top-k results through pseudo-relevance feedback (Rocchio), and (3) closing a human-in-the-loop cycle through visual document browsing, canvas-based patch annotation, and periodic model retraining. Unlike the system's initial research prototype, which evaluated retrieval on a small five-rollo subset, SARCLIP is demonstrated as a complete, interactive tool operating over the near-complete corpus. Attendees experience the full search, browse, annotate, and retrain workflow live during this demonstration.

34. 【2608.22022】From Click Modeling to Offline and Off-Policy Evaluation in Carousel Recommendation

链接：https://arxiv.org/abs/2608.22022

作者：Jingwei Kang

类目：Information Retrieval (cs.IR); Human-Computer Interaction (cs.HC)

关键词：modern recommendation systems, Carousel, recommendation, recommendation systems, Carousel interfaces

备注：

点击查看摘要

Abstract:Carousel interfaces are widely used in modern recommendation systems. Unlike traditional interfaces that present a single ranked list, carousels simultaneously present several ranked lists to the user, as horizontally swipeable rows stacked on top of each other. In this design, the rankings are closely tied to the two-dimensional layout. Consequently, user behavior is shaped not only by item preference, but also by row organization, viewport constraints, and item context. This tight coupling between ranking and presentation complicates the interpretation of user feedback, introducing new challenges for recommendation evaluation. My PhD research aims to address these challenges by rethinking how carousel clicks are modeled and how carousel recommendation policies can be evaluated from logged interaction data. So far, I have studied how users interact with carousel interfaces and developed a click model design framework that prioritizes mathematical relationships between observed variables over latent behavioral assumptions. Building on these results, my ongoing work includes a project using discrete choice models to represent clicks as choices, alongside a project that develops carousel-specific offline metrics. As a next step, I plan to develop off-policy evaluation methods that estimate the performance of recommendation policies from logged interactions. Taken together, the expected contribution of my thesis is a connected body of work that links carousel click modeling with offline and off-policy evaluation, so that carousel recommendation policies can be improved more reliably.

Subjects:

Information Retrieval (cs.IR); Human-Computer Interaction (cs.HC)

Cite as:
arXiv:2608.22022 [cs.IR]

(or
arXiv:2608.22022v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2608.22022

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

35. 【2608.21939】Enhancing Group Recommendation with Memory-Augmented Reasoning in LLM Agent

链接：https://arxiv.org/abs/2608.21939

作者：Qimeng Niu,Bowen Hao,Zixuan Zhang,Shuyu Qu,Hongzhi Yin

类目：Information Retrieval (cs.IR)

关键词：Large Language Model, consensus formation process, Existing Large Language, Memory Module, group recommendation lies

备注：

点击查看摘要

Abstract:The core challenge in group recommendation lies in modeling the dynamic evolution of user preferences and explain?ing the consensus formation process. Existing Large Language Model (LLM)-based methods, despite improved interpretability, treat interaction history as fixed text, ignoring the natural evolution of group/user preferences over time, and lacking explicit modeling of the complex group decision-making process. To address these issues, we propose AGR, a LLM-based agent, which consists of a Memory Module and a Reasoning Module. The Memory Module employs a token-based hash table to dynamically manage the historical interactions of groups and users. This design supports fundamental operations including insertion, updating, retrieval, forgetting of irrelevant records, and summarization of evolving group and user profiles for efficiently tracking. Based on these retrieved dynamic profiles, the Reason?ing Module then performs a multi-step reasoning process includ?ing Group Interests Collection, Group Consensus Refinement, Multi-dimensional Evaluation and Explainable Recommendation Generation, thereby moving beyond black-box inference to de?liver fully interpretable recommendations. In practice, we adopt the Reinforcement Fine-Tuning (RFT) paradigm, where we first use Supervised Fine-Tuning (SFT) to equip the model with basic capabilities for invoking the Memory and Reasoning modules, and then employ Group Relative Policy Optimization (GRPO) to enhance its autonomous ability to coordinate these modules. Experiments on LastFM and Douban datasets demonstrate that AGR significantly outperforms existing state-of-the-art methods in both recommendation accuracy and explainability. Our model is open-sourced at this https URL.

36. 【2608.21877】Revisiting N2DCG: An Empirically Grounded Reformulation of Carousel Recommendation Evaluation

链接：https://arxiv.org/abs/2608.21877

作者：Jingwei Kang,Santiago de Leon-Martinez,Maarten de Rijke,Harrie Oosterhuis

类目：Information Retrieval (cs.IR); Human-Computer Interaction (cs.HC)

关键词：music streaming services, properly evaluate recommender, evaluate recommender systems, streaming services, video and music

备注：

点击查看摘要

Abstract:Carousel interfaces have been widely used in video and music streaming services, yet it remains unclear how to properly evaluate recommender systems in these two-dimensional layouts. N2DCG has been proposed to address this gap by adapting NDCG to carousel-based recommendation, but it relies on unverified assumptions borrowed from the single-list web-search setting that do not transfer well to two-dimensional carousel layouts. We identify two substantial limitations of N2DCG: its ideal ranking, used for normalization, violates carousel constraints, and its discount function does not reflect user browsing behavior observed in empirical data. To address both limitations, we propose a reformulation of N2DCG that normalizes appropriately by respecting constraints and uses an empirically grounded discount function. We validate the proposed metric, showing that it better reflects users' empirical behavior on real-world eye-tracking data and better predicts the comparison results of carousel layouts simulated based on empirical examination patterns.

Subjects:

Information Retrieval (cs.IR); Human-Computer Interaction (cs.HC)

Cite as:
arXiv:2608.21877 [cs.IR]

(or
arXiv:2608.21877v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2608.21877

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

37. 【2608.21829】raining a Knowledge Base: Supervised Structure Learning for Agent-Curated Document Stores

链接：https://arxiv.org/abs/2608.21829

作者：Yu Pan,Hongfeng Yu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：Retrieval-augmented generation treats, Retrieval-augmented generation, build structure, frozen input, uniform effort

备注： 10 pages, 4 figures, 5 tables. Submitted to IEEE BigData 2026

点击查看摘要

38. 【2608.21792】HIRA: A Human-in-the-Loop Retrieval-Augmented Cascade for Document Classification in Regulated Industries

链接：https://arxiv.org/abs/2608.21792

作者：Shangxuan Tian,Yanhui Chen,Carlos Queiroz

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：costly model-governance procedures, scarce review capacity, limited cold-start labels, classification in regulated, Document classification

备注： CIKM 2026

点击查看摘要

Abstract:Document classification in regulated industries is constrained by data residency, limited cold-start labels, scarce review capacity, and costly model-governance procedures. We present HIRA, a training-free, on-premises retrieval-augmented cascade for document classification in regulated deployments that combines BM25 over OCR text, dense text embeddings, and image-level representations through validation-calibrated weighted reciprocal-rank fusion. Confident documents are classified directly by retrieval; uncertain or visually confusable documents are passed to a locally hosted LLM verifier, which receives the OCR text, retrieved exemplars, label descriptions, and confusion-specific terms. When the verifier remains uncertain, the document is sent to human review. Each correction is stored as a margin-weighted retrieval exemplar and updates a Dirichlet-smoothed confusion graph, letting the system improve without updating model weights. On a private 80-class trade-finance corpus, HIRA processes the full 30,233-document production stream while requesting human correction for only 1,945 documents (6.4%), improving Macro-F1 from 0.6218 to 0.8548. On the corrected Tobacco-3482 benchmark, HIRA reaches 0.9423 Macro-F1 with a locally hosted DeepSeek-R1-Distill-Qwen-32B verifier, 17.4 percentage points above the zero-shot LLM baseline, while invoking the verifier for only about 40% of documents and reducing LLM calls by approximately 60%. With 518 human corrections (24.8% of the pool), HIRA matches the fully labelled pool oracle, in which all 2,086 pool documents are indexed with their ground-truth labels. These results show that selective human feedback and retrieval-memory adaptation can be a practical alternative to repeated model retraining for long-tail document classification in regulated deployments.

Comments:
CIKM 2026

Subjects:

Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

Cite as:
arXiv:2608.21792 [cs.AI]

(or
arXiv:2608.21792v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2608.21792

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

39. 【2608.21662】Why This, Not That? Mining User Profiles for Pair-wise Counterfactuals

链接：https://arxiv.org/abs/2608.21662

作者：Meysam Varasteh,Veronika Bogina,Noam Koenigstein,Robin Burke

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：steady research attention, recommender systems, steady research, research attention, earliest days

备注：

点击查看摘要

Abstract:The topic of explanation in recommender systems has seen steady research attention since the earliest days of the field. With some exceptions, this work has focused on the explanation of single items in a recommendation list and, especially recently, has emphasized approaches that are decoupled from the logic of the recommendation algorithm itself. Based on findings in the psychology of interpersonal communication, we propose a new task, pairwise interpretation of item rankings, asking the comparative question ``Why is item A ranked higher than item B?''. An effective solution to this task, we argue, is inherently grounded in the operation of the recommendation algorithm. We propose a class of techniques based on counterfactual learning to uncover the items in a user's profile that have contributed to the relative ranking of items. Using multiple datasets, we show that it is possible to identify such items as potential basis for comparative explanation.

40. 【2608.21641】Why didn't more people see it? Recommendation: Transparency for providers

链接：https://arxiv.org/abs/2608.21641

作者：Meysam Varasteh,Robin Burke

类目：Information Retrieval (cs.IR)

关键词：remain largely unexplored, remain largely, largely unexplored, widely studied, creators whose content

备注：

点击查看摘要

Abstract:Transparency in recommender systems has been widely studied from the perspective of those receiving recommendations, yet the needs of item providers, the creators whose content is distributed through these platforms, remain largely unexplored. Providers often lack insight into how their items do or do not receive exposure in users' recommendation lists. In this work, we address this gap by proposing a surrogate modeling approach to explain item exposure at a system level. Rather than explaining individual user-item pairs, we train a proxy model to approximate the exposure distribution produced by a recommender. By quantifying the contribution of each feature, we seek to explain the factors driving the recommendation model's decisions across the entire user base. We evaluate our approach on two datasets and three recommendation models. Results show that the surrogate model captures the global behavior of all three recommenders with high fidelity and that the most influential factors vary meaningfully across models and domains.

41. 【2608.21529】DamageScope: Vision-Language Retrieval at Scale for Disaster Damage Assessment from Satellite Imagery

链接：https://arxiv.org/abs/2608.21529

作者：Ravi K. Rajendran,Biplob Debnath,Murugan Sankaradas,Srimat T. Chakradhar

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Timely and accurate, Large Language Models, vision-language models, Timely, damage assessment

备注：

点击查看摘要

42. 【2608.21494】Retrieval Needs Multivectors: An Exponential Separation

链接：https://arxiv.org/abs/2608.21494

作者：Mihir Agarwal,Viraj Agrawal,Sabyasachi Basu,Ankit Garg,Kirankumar Shiragur

类目：Information Retrieval (cs.IR); Databases (cs.DB); Machine Learning (cs.LG)

关键词：Recent works, analyses and challenging, embedding based retrieval, multi-vector embeddings, Recent

备注：

点击查看摘要

Abstract:Recent works have highlighted the expressive limitations of embedding based retrieval models through both theoretical analyses and challenging benchmarks such as LIMIT. While multi-vector embeddings consistently outperform single-vector embeddings, the precise representational gap between them remains poorly understood. In this work, following Jayaram's work, we provide the first explicit family of query and document sets, together with their relevance matrices, for which single-vector embeddings that rank all relevant documents above irrelevant ones require exponential size, whereas polynomial-size multi-vector embeddings suffice. Our result establishes an exponential separation between the expressive power of single-vector and multi-vector embeddings for the task of ranking of documents as opposed to approximating numerical scores as in the work of Jayaram. Motivated by our theoretical construction, we introduce ANDOR, a new retrieval benchmark that naturally instantiates these hard examples. We show that state-of-the-art single-vector embedding models perform poorly on ANDOR in the zero-shot setting and exhibit only marginal improvements after fine-tuning, highlighting the inherent difficulty of the benchmark compared to prior work. In contrast, multi-vector models consistently outperform their single-vector counterparts and improve substantially with fine-tuning, closely aligning with our theoretical predictions.

Subjects:

Information Retrieval (cs.IR); Databases (cs.DB); Machine Learning (cs.LG)

Cite as:
arXiv:2608.21494 [cs.IR]

(or
arXiv:2608.21494v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2608.21494

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

43. 【2608.21365】KSE-Web: An Analysis of Hybrid Retrieval and LLM-Assisted Query Expansion for Low-Resource Khmer Semantic Search

链接：https://arxiv.org/abs/2608.21365

作者：Nimol Thuon

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：ambiguous word boundaries, including limited annotated, limited annotated data, mixed Khmer-English usage, frequent mixed Khmer-English

备注：

点击查看摘要

44. 【1706.02795】A Deep Causal Inference Approach to Measuring the Effects of Forming Group Loans in Online Non-profit Microfinance Platform

链接：https://arxiv.org/abs/1706.02795

作者：Thai T. Pham,Yuanyuan Shen

类目：Machine Learning (stat.ML); Information Retrieval (cs.IR); Machine Learning (cs.LG); General Finance (q-fin.GN)

关键词：non-profit crowdsouring microfinance, crowdsouring microfinance platform, online non-profit crowdsouring, non-profit crowdsouring, crowdsouring microfinance

备注：

点击查看摘要

Abstract:Kiva is an online non-profit crowdsouring microfinance platform that raises funds for the poor in the third world. The borrowers on Kiva are small business owners and individuals in urgent need of money. To raise funds as fast as possible, they have the option to form groups and post loan requests in the name of their groups. While it is generally believed that group loans pose less risk for investors than individual loans do, we study whether this is the case in a philanthropic online marketplace. In particular, we measure the effect of group loans on funding time while controlling for the loan sizes and other factors. Because loan descriptions (in the form of texts) play an important role in lenders' decision process on Kiva, we make use of this information through deep learning in natural language processing. In this aspect, this is the first paper that uses one of the most advanced deep learning techniques to deal with unstructured data in a way that can take advantage of its superior prediction power to answer causal questions. We find that on average, forming group loans speeds up the funding time by about 3.3 days.

计算机视觉

1. 【2608.23563】EG-ARSA: An Expert-Grounded Open Model for Visual Road Safety Auditing in Low-Resource Settings

链接：https://arxiv.org/abs/2608.23563

作者：Md Thamed Bin Zaman Chowdhury,Moazzem Hossain

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：road safety auditing, road safety, traffic injuries remain, Road traffic injuries, Road Safety Audit

备注：

点击查看摘要

Abstract:Road traffic injuries remain a major challenge in low- and middle-income countries, where proactive road safety auditing is limited by incomplete crash records, shortages of qualified auditors, and the high cost of large-scale field inspections. To address this problem, we propose Expert-Grounded Distillation (EGD), a novel artificial intelligence framework that transfers institutional road safety expertise into a compact vision-language model for scalable visual road safety auditing. The key innovation is a quantified expert-grounding stage in which the teacher vision-language model is calibrated against authoritative field audits. Large-scale annotation is permitted only after the teacher reaches substantial agreement with expert risk assessments (Cohen's kappa = 0.74). The calibrated teacher then generates structured supervision that is distilled into an 8-billion-parameter student vision-language model using Low-Rank Adaptation and a single leakage-free prompt. We also introduce Bangladesh Road Safety Audit (BD-ARSA), the first open, expert-grounded Bangladeshi visual road safety audit dataset containing 21,947 image-audit records with near-national coverage, and Expert-Grounded Road Safety Auditor (EG-ARSA), the first vision-language model developed specifically for this task. Experimental results show that grounded fine-tuning substantially improves ordinal risk assessment over the zero-shot baseline, while blind expert evaluation demonstrates that the compact student outperforms both its 31 billion-parameter teacher and Gemini-2.5-Flash. These findings demonstrate that EGD provides an effective and scalable engineering solution for proactive road safety auditing in resource-constrained environments.

2. 【2608.23549】FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors

链接：https://arxiv.org/abs/2608.23549

作者：Khiem Vuong,Deva Ramanan,Srinivasa Narasimhan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Neural Radiance Fields, Gaussian Splatting, Neural Radiance, Radiance Fields, target views lie

备注： Appearing in ECCV 2026. Project page: [this https URL](https://fix-anything.github.io)

点击查看摘要

Abstract:Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views are sparse or target views lie far from the input. Recent work mitigates these artifacts using diffusion-based generative priors, but is specialized to individual representations and require custom architectures or extensive retraining. We present FixAnything, a single model for fixing a wide range of rendering artifacts. It does so by repurposing a pretrained video generative model, leveraging its implicit multi-view priors with only minimal modification and lightweight finetuning. Our key insight is that even noisily-rendered sequences preserve camera motion and coarse scene structure, allowing cleanup to be formulated as video-to-video translation. To control what scene structure should be preserved, we introduce a binary mask denoting the clean pixels, enabling the model to anchor its output to high-quality inputs (e.g. training views) while refining the rest. To encourage FixAnything to produce 3D-consistent renderings that support downstream reconstruction, we use camera pose accuracy (recovered via structure-from-motion) as a reward signal for direct preference optimization (DPO). Across four distinct 3D representations, FixAnything consistently improves rendering quality with lightweight finetuning, demonstrating that a single generalist video prior can replace multiple specialist refinement pipelines. The simplicity of the framework enables immediate adoption of stronger future video models without architectural redesign.

3. 【2608.23531】Predicting Multiple Clinical Outcomes Related to Functional Recovery and Social Isolation Among Older Adults After Lower-Limb Fracture or Hip Replacement

链接：https://arxiv.org/abs/2608.23531

作者：Santosh Ray,Pratik K. Mishra,Ali Abedi,Charlene H. Chu,Amir Ahmad,Shehroz S. Khan

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Older adults recovering, complex recovery trajectories, experience complex recovery, Older adults, experience complex

备注：

点击查看摘要

Abstract:Older adults recovering after lower-limb fracture or hip replacement may experience complex recovery trajectories. Most of the time, these clinical aspects are studied in isolation, masking their joint impact on recovery. This study used the MAISON-LLF dataset, which contains multimodal sensor and clinical assessment data from 18 older adults recovering in the community after lower-limb fracture or hip replacement. Participants were monitored for up to eight weeks, corresponding to a maximum of 1,008 participant-days of sensor monitoring. Forty-six daily features were extracted from indoor motion, acceleration, step count, heart rate, out-of-home mobility, and sleep data. Five clinical outcomes were assessed every two weeks: the Social Isolation Scale, Oxford Hip Score, Oxford Knee Score, Timed Up and Go test, and 30-second Chair Stand test. We utilize an inherent relationship between multi-modal sensor data and different clinical scores and formulate it as a multi-output regression problem. We tested various machine learning and deep learning single- and multi-output regression algorithms to predict these scores simultaneously. The results showed that predicting clinical scores jointly was better than separately. The tabular DL multi-output regressor, NODE, gave a remarkable performance of MSE=3.96 and MAE=1.02 in comparison to other multi- and single-output regressors. The SHAP feature analysis further showed the importance of including multimodal sensors to provide a good estimate of patients' recovery trajectory. This work may support the simultaneous assessment of functional recovery and social engagement among community-dwelling older adults and ultimately help improve their care and quality of life.

4. 【2608.23518】Investigating Relational Reasoning in VLMs

链接：https://arxiv.org/abs/2608.23518

作者：Adhithya Laxman Ravi Shankar Geetha,Aulia Kharis Rakhmasari,Haleema Ramzan,Xander Yap

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieve strong performance, Vision-Language Models, understand visual relations, simply employ shortcuts, achieve strong

备注：

点击查看摘要

Abstract:Vision-Language Models (VLMs) achieve strong performance in visual reasoning tasks, but it remains unclear whether they understand visual relations, or simply employ shortcuts such as language cues or priors. To investigate this, we use the Qwen3-VL-4B (Bai et al., 2025), a modern VLM, to decode how visual information is encoded across depths. For this, we propose a synthetic dataset of simple geometric shapes for controlled analysis, along with queries crafted to precisely test language cues. Furthermore, the dataset is modified to test causal reliance on visual evidence. Our results show that current VLMs combine genuine visual reasoning with shortcut strategies primarily rooted in language cues.

5. 【2608.23503】Action-Aligned Retrieval with Pairwise Multimodal Reranking for Text-Based Person Anomaly Search

链接：https://arxiv.org/abs/2608.23503

作者：Thanh-Khoi Nguyen,Thanh-Nhan Vo,Trong-Thuan Nguyen,Minh-Triet Tran

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Text-based person anomaly, search requires distinguishing, requires distinguishing individuals, distinguishing individuals based, Text-based person

备注： Accepted to the AI City workshop @ ECCV 2026

点击查看摘要

Abstract:Text-based person anomaly search requires distinguishing individuals based on fine-grained, context-dependent behaviors rather than mere appearance. Existing methods struggle to capture these context-conditioned actions, frequently relying on isolated skeletal geometry, discarding raw query details during reformulation, or utilizing absolute pointwise scoring for multimodal verification. To address these limitations, we propose \textbf{ActPair}, a unified three-stage coarse-to-fine framework that combines action-aligned retrieval with pairwise multimodal reranking to bridge the pose-semantic gap. First, we fine-tune a vision-language model (VLM) with an action-aligned multi-task objective that encourages the representations to encode action-discriminative semantics. Second, we perform parallel late-fusion retrieval using the original query and a large language model (LLM)-generated context-grounded rewrite, retaining complementary details from both semantic views. Finally, we propose an efficient off-the-shelf reranking module that leverages a pivot-promote algorithm to perform direct pairwise visual comparisons, mitigating residual spatial and compositional ambiguities without the prohibitive inference costs of exhaustive evaluation. Extensive experiments demonstrate that our framework achieves the best results among the compared methods on the Pedestrian Anomaly Behavior (PAB) public test and transfers effectively to an unseen, non-anomaly-specific dataset.

6. 【2608.23499】SVD-Based Typicality Maps for Out-of-Distribution Detection in Vision Transformers

链接：https://arxiv.org/abs/2608.23499

作者：Aldo Sean Sartor,Leandro de Souza Rosa,Andriy Enttsel,Mauro Mangia,Riccardo Rovatti

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Vision Transformers, exploiting the geometry, learned parameters, present a method, method for analyzing

备注：

点击查看摘要

Abstract:We present a method for analyzing the internal representations of Vision Transformers (ViTs) exploiting the geometry of their learned parameters. Each affine layer's weight matrix is factored via Singular Value Decomposition (SVD), and activations are projected onto the leading right singular vectors to obtain compact, layer-intrinsic representations. A class-conditional density model is then fitted at each layer, producing per-class \emph{typicality scores} that are stacked across depth into \emph{typicality maps}: two-dimensional summaries of how class-specific evidence evolves through the network. From these maps, we derive two post-hoc scores for Out-Of-Distribution (OOD) detection: a \emph{Prototype Alignment Score} (PAS), measuring agreement with class reference prototype patterns, and a \emph{Multi-Layer Soft Voting} (MLSV) score, capturing cross-layer consensus without stored prototypes. On ViT-B/16 fine-tuned on CIFAR-100, the proposed scores achieve competitive detection performance without retraining or OOD exposure.

7. 【2608.23486】GeoWAM: Visual Geometry World Action Models for Autonomous Driving

链接：https://arxiv.org/abs/2608.23486

作者：Yiren Lu,Xin Ye,Jiaming Liu,Jin Yao,Yi-chung Chen,Liam Merino,Dhruva Dixith Kurra,Min Cai,Tom Lampo,Yu Yin,Danhua Guo,Burhan Yaman

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：recently gained increasing, gained increasing attention, recently gained, gained increasing, increasing attention

备注：

点击查看摘要

Abstract:World action models (WAMs) have recently gained increasing attention as a framework for jointly modeling scene evolution and ego actions in autonomous driving. Most existing WAMs learn scene dynamics in pixel space by combining a video-generation backbone for future-observation prediction with an action head for ego-trajectory prediction. Pixels, however, provide only an indirect representation of these dynamics: they entangle geometry and motion with appearance, texture, and illumination, forcing the model to infer three-dimensional transformations from two-dimensional observations. We argue that geometry, represented by point clouds, offers a more natural state space for driving because it explicitly captures spatial structure and the rigid and non-rigid transformations that govern scene evolution while directly aligning with the space in which driving actions are executed. Building on this insight, we introduce \textbf{GeoWAM}, a visual geometry world action model for autonomous driving. Rather than predicting future images, GeoWAM is pretrained to forecast future scene geometry, yielding representations that jointly encode spatial structure and temporal evolution. A geometry-conditioned action head then leverages these learned geometric dynamics to predict future ego trajectories. Extensive open-loop and closed-loop evaluations show that visual geometry world modeling yields substantially stronger driving policies than image-based alternatives, establishing future-geometry prediction as an effective pretraining objective for autonomous driving.

8. 【2608.23479】Geometry-Driven Opti-Acoustic Co-Registration and View-Invariant Reflectivity Mapping for Side-Scan Sonar

链接：https://arxiv.org/abs/2608.23479

作者：Taqi Hamoda,Nuno Gracias

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：extreme viewpoint dependencies, large-scale underwater mapping, Side-Scan Sonar, speckle noise, viewpoint dependencies

备注：

点击查看摘要

Abstract:Side-Scan Sonar (SSS) is a primary modality for large-scale underwater mapping, yet automated perception and cross-modal alignment are severely bottlenecked by acoustic complexities such as speckle noise, shadows, and extreme viewpoint dependencies. Traditional handcrafted descriptors and modern deep learning matchers fail to bridge the physical domain gap between optical and acoustic imagery without 3D geometric constraints. To overcome these limitations, we propose a novel geometry-driven framework for pixel-level opti-acoustic co-registration and view-invariant reflectivity mapping. Our method utilizes Structure-from-Motion (SfM) to reconstruct a dense 3D seafloor mesh, acting as a geometric anchor between the visual and acoustic domains. We introduce a First Bottom Return (FBR) extraction algorithm to dynamically correct non-linear altitude drift caused by uncalibrated SfM reconstruction. Furthermore, we apply an inverse Lambertian model and a dual-Gaussian weighting function to isolate the intrinsic seabed reflectivity, effectively neutralizing slant-range propagation loss and geometric view-dependence. By deterministically associating these isolated acoustic properties with optical pixels, our pipeline generates highly accurate, strictly co-registered multi-modal datasets. This automated, physics-guided approach eliminates the need for manual annotation and paves the way for advanced self-supervised learning in benthic habitat mapping.

9. 【2608.23478】Act with Intent: Distilling Behavior Intent for Vision-Language-Action Models

链接：https://arxiv.org/abs/2608.23478

作者：Sangoh Lee,Sangwoo Mo,Wook-Shin Han

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：turn multimodal context, models can turn, context into robot, trained largely, behavior

备注： Project page: [this https URL](https://leesangoh.github.io/indi-project-page/)

点击查看摘要

Abstract:Vision-Language-Action (VLA) models can turn multimodal context into robot actions, but their action decoders are still trained largely by behavior cloning. This supervises which motor command was demonstrated while leaving implicit the local objective served by the behavior under the instruction. Future-based supervision enriches action learning with frames, latent observations, trajectories, or motion representations, but these signals capture particular realizations of what may happen rather than the shared semantic objective of the forthcoming behavior. We propose Intention Distillation (INDI), which distills behavior-level intent into the action decoder. During training, a frozen teacher VLM interprets a demonstrated segment from the current observation, instruction, coarse action summary, and corresponding execution video. From its standard inputs, the deployed VLA recovers the resulting multimodal intent representation at an intermediate decoder layer and uses it to organize action prediction together with representations of how the behavior unfolds and what it achieves. On SimplerEnv-Bridge, INDI improves GR00T-N1.7 from 64.3% to 84.7%, and on RoboCasa Kitchen it improves the controlled GR00T-N1.7 baseline from 64.1% to 70.3%, with consistent gains on $\pi_{0.5}$ across both benchmarks. In real-world tasks, INDI improves average success from 62.0% to 68.7%, with gains of up to 12.0 pp on longer-horizon tasks. Further analyses show that the recovered latent is used by the decoder, captures behavior objective and execution progress, and organizes downstream predictions in an objective-dependent manner. These results show that action decoders benefit from explicitly modeling the semantic objective of the behavior they generate.

10. 【2608.23474】What's the Catch? Evaluating Temporal Consistency in Vision-Language Models

链接：https://arxiv.org/abs/2608.23474

作者：Marek Hradil,Danae Sánchez Villegas

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：capture temporal structure, anomaly detection, video and image-sequence, remains unclear, temporal

备注： 17 pages, ACL format

点击查看摘要

11. 【2608.23435】owards Comprehensive Basketball Understanding

链接：https://arxiv.org/abs/2608.23435

作者：Yirong Hu,Jiayuan Rao,Yu Zhang,Shangzhe Di,Weidi Xie

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：structured game knowledge, requires recognizing events, game requires recognizing, basketball game requires, localizing actions

备注： 26 pages, 3 figures

点击查看摘要

Abstract:Understanding a basketball game requires recognizing events, localizing actions, identifying players, and relating these to structured game knowledge. Existing benchmarks primarily evaluate these abilities one at a time, leaving the interactions among these abilities under-explored. We introduce BasketballBench, a multimodal benchmark comprising 7,980 questions across ten tasks in text, image, and video. It is built from the 2025-2026 NBA season and includes official playby-play, rosters and profiles for 530 active players, and 2,501 possession-level broadcast clips. We further propose BasketballSkills, an agent that composes eight basketball-specific perception and retrieval tools under four reusable skills that specify tool order, evidence bindings, and stopping conditions. Experiments show that current MLLMs struggle particularly on questions requiring the integration of multiple capabilities, whereas BasketballSkills outperforms them, highlighting the effectiveness of explicitly composing domain-specific capabilities for comprehensive basketball understanding.

12. 【2608.23432】Image-Conditioned Diffusion Models for Quality Assurance of Organ-at-Risk Segmentations in Radiotherapy

链接：https://arxiv.org/abs/2608.23432

作者：Clea Dronne,Catharine H Clark,Xavier Loizeau,Elizabeth Miles,Peter Hoskin,Jamie R McClelland

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：radiotherapy planning, time-consuming and subjective, essential for radiotherapy, Accurate, comparing a VAE

备注： Submitted to the MICCAI 2026 UNSURE Workshop

点击查看摘要

Abstract:Accurate organ-at-risk segmentation is essential for radiotherapy planning, but reviewing segmentations is time-consuming and subjective. We investigate normative modelling for segmentation error detection in head-and-neck CT, comparing a VAE framework with an image-conditioned segmentation diffusion model. Models were evaluated on RADCURE brainstem and spinal cord segmentations using simulated boundary and width perturbations. Error detection was assessed using the Dice similarity coefficient and the Distance to Agreement (DTA) between the input and reconstructed segmentations. While both models detected some simulated errors, regional DTA showed that the diffusion model localised subtle boundary errors more consistently. These results support image-conditioned diffusion reconstruction as a promising framework for localised, anatomy-aware segmentation QA.

13. 【2608.23410】Photorealistic Novel View Synthesis of Human Faces using Next-Scale Transformers

链接：https://arxiv.org/abs/2608.23410

作者：Federico Stella,Fei Jiang,Zhongshi Jiang,Zohar Barzelay,Emanuel Garbin,Amin Jourabloo,Liuhao Ge

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：fine appearance details, people remains challenging, high spatial resolutions, multiple target cameras, target cameras

备注：

点击查看摘要

Abstract:Photorealistic novel view synthesis of people remains challenging at high spatial resolutions and across multiple target cameras, where preserving identity, fine appearance details, and geometric coherence is critical. We build on the next-scale autoregressive paradigm and adapt it for human-centric view synthesis by enabling higher image resolutions, multi-view outputs and stronger cross-view consistency in a single forward pass. We train on a synthetic dataset of human faces spanning diverse identities and apparel. Contrary to diffusion models, this paradigm does not need 2D pre-training and, thanks to its next-scale architecture, it benefits from lower-resolution, general-purpose pre-trainings, with the full-sized purpose-specific images being used only in the last training stages. This enables our architecture to converge with a smaller amount of purpose-specific training data, allowing us to use a smaller but more realistic training dataset. The resulting model produces sharp and realistic views, with the option to synthesize multiple novel viewpoints simultaneously for improved agreement across views. Empirically, we observe gains in perceptual fidelity and cross-view coherence on human subjects, demonstrating that next-scale autoregression is an effective backbone for scalable, multi-output human view synthesis. We also couple our pipeline with an existing transformer-based model for pixel-aligned 3D gaussian lifting from multi-view facial inputs, resulting in accurate and photorealistic 3D models of human faces.

14. 【2608.23405】MomADv2: Reliable Temporal Memory for End-to-End Autonomous Driving

链接：https://arxiv.org/abs/2608.23405

作者：Ziying Song,Shengkai Zhang,Lin Liu,Peiliang Wu,Lei Yang,Dongyang Xu,Bin Sun,Li Wang,Shaoqing Xu,Caiyan Jia,Yadan Luo

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：safe autonomous driving, complex scenarios, planning, critical for safe, Memory Query Module

备注： 16 pages, 6 figures

点击查看摘要

Abstract:Long-horizon planning is critical for safe autonomous driving in complex scenarios. Existing methods improve planning continuity with temporal memory, but such memory may become invalid and mislead decisions when the driving command changes. Thus, selectively leveraging useful history while suppressing command-inconsistent memory remains a key challenge. To address this issue, we propose MomADv2, a reliable state-space memory framework for long-horizon end-to-end autonomous driving. At its core, MomADv2 introduces a Selective State-Space Planning Memory Query Module, which filters historical planning queries based on temporal continuity and command consistency, selects planning modes relevant to the current command, and models the evolution of planning intentions through a selective state-space mechanism. To further alleviate local trajectory deviations and error accumulation in long-horizon planning, we design a Flow-Matching Trajectory Residual Refiner. It learns a continuous residual correction field from the refined planning output to the expert trajectory, enabling fine-grained trajectory refinement while preserving the stability of anchor-based planning. Extensive experiments on closed-loop NAVSIM and Bench2Drive, as well as open-loop nuScenes, demonstrate that MomADv2 improves long-horizon planning consistency and reduces the average collision rate by 15.6% over MomAD under 6-second planning.

15. 【2608.23383】Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds

链接：https://arxiv.org/abs/2608.23383

作者：Nan Duan,Haoyang Huang,Weiyang Jin,Haoran Li,Yaowei Li,Yuming Li,Yijun Liu,Xin Lu,Xiaoxiao Ma,Yanwen Ma,Yaofeng Su,Yilang Sun,Haoyu Wang,Zeyue Xue,Songchun Zhang,Junhao Zhuang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：follow user controls, Video generation, requiring models, preserve identities, follow user

备注： Project page: [this https URL](https://echo-team-joy-future-academy-jd.github.io/Echo-1.5-Page/)

点击查看摘要

Abstract:Video generation is progressing beyond isolated clips toward long-form narratives and interactive worlds, requiring models to preserve identities, follow user controls, and remain stable over extended rollouts. We present JoyAI-Echo-1.5, a unified audio-visual generation system with two purpose-built variants. The long-video variant introduces composable cross-shot memory that aggregates visual evidence across multiple prior shots and speaker cues derived from speech-filtered full-shot audio, enabling persistent character appearance and voice identity across flexible combinations of text, image, and memory conditioning. The world-model variant converts heterogeneous navigation inputs into calibrated metric 6-DoF camera trajectories and injects them through a geometry-aware conditioning pathway, enabling controller-agnostic interaction across flexible viewpoints. To support efficient long-horizon generation, we transform a bidirectional audio-visual backbone into a causal few-step generator using progressive teacher forcing and short- and long-horizon Self-Gradient Forcing on self-generated rollouts. Experiments demonstrate strong performance in both settings. JoyAI-Echo-1.5 achieves improvements over existing long-video baselines in cross-shot consistency, visual quality, text alignment, and speech fidelity. Its world-model variant ranks first on WBench, with an average score of 81.7, and achieves leading visual quality and long-horizon persistence on SANA-WM-Bench. Together, these results indicate that memory, geometric control, and rollout-aware training provide a practical foundation for generating coherent stories and continuously evolving interactive worlds. Project page: this https URL.

16. 【2608.23363】DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts

链接：https://arxiv.org/abs/2608.23363

作者：Vlad Hondru,Florinel Alin Croitoru,Iuliana Georgescu,A. Sophia Koepke,Radu Tudor Ionescu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：actively studied topic, Audio-visual deepfake detection, studied topic, Audio-visual deepfake, actively studied

备注： Accepted at BMVC 2026

点击查看摘要

Abstract:Audio-visual deepfake detection is an actively studied topic, where one of the main challenges is to develop detectors able to generalize across deepfake generation methods. We conjecture that overfitting can be mitigated by extracting multiple high-level cues from the available audio and visual modalities via pre-trained models. We therefore assemble a wide variety of pre-trained models to extract features that encode mouth movements, face parsing, facial expressions, head pose, gaze tracking, heart rate, audio emotion and speech activity. We further integrate both unimodal and multimodal cues via a Mixture-of-Experts (MoE) backbone to detect deepfakes. We perform in-domain and cross-domain experiments on five benchmarks for deepfake detection (MAVOS-DD, AVLips, PolyGlotFake, BioDeepAV, FakeAVCeleb) to compare our framework (DF-MoE) with state-of-the-art methods. Our results indicate that DF-MoE obtains superior deepfake detection results, surpassing all competing methods. We release our code at this https URL.

17. 【2608.23354】OptiSight: Bridging Semantic Reasoning and Geometric Control for Embodied Navigation

链接：https://arxiv.org/abs/2608.23354

作者：Alperen Avan,Jordi Sanchez-Riera

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Autonomous indoor navigation, Autonomous indoor, understanding and precise, precise geometric control, Autonomous

备注：

点击查看摘要

Abstract:Autonomous indoor navigation requires both semantic understanding and precise geometric control. We propose OptiSight, a hybrid framework that combines Vision-Language Model reasoning with deterministic visual servoing through a finite-state Chain-of-Thought architecture. Grounded-SAM localizes open-vocabulary targets, while camera projection geometry converts visual observations into navigation commands without requiring dense mapping. The VLM is queried only at key decision points, reducing computational overhead while geometric control handles continuous navigation. Experiments in AI Habitat demonstrate reliable zero-shot navigation across diverse indoor scenarios, including obstacle avoidance and semantic ambiguity, while operating within an 8~GB VRAM budget. The source code is available at this https URL.

18. 【2608.23343】Controllable blind deblurring with diffusion models

链接：https://arxiv.org/abs/2608.23343

作者：Imane Si Salah,Emile Cribelier,Thomas Veit,Wolf Hauser,Arthur Leclaire

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：low-level processing steps, Image acquisition, optical system, processing steps, camera involves

备注： 6 pages, 5 figures, 1 table. Accepted to IEEE ICIP 2026

点击查看摘要

Abstract:Image acquisition with a camera involves several degradations due to the optical system, sensor, or low-level processing steps. We address blind deblurring in professional photography: we aim to invert unknown isotropic blur without knowledge of the degradation kernel. For such inverse problems,where some high-frequency information is lost, it is challenging to use generative models to produce details that are both photo-realistic and faithful to the input. We propose SuperSharpen, a diffusion-based blind deblurring method offering explicit control over restoration strength through a blur measure. We compare two conditioning strategies: a ControlNet-style adapter on a frozen backbone, and full finetuning of the diffusion prior. Our experiments show that finetuning achieves better fidelity with fewer hallucinated details. We validate our approach on synthetic and real-world blur, demonstrating improved perceptual quality and controllable restoration strength.

19. 【2608.23336】Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline

链接：https://arxiv.org/abs/2608.23336

作者：Eugenia Moris,José Ignacio Orlando

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：requiring literature review, Developing competitive deep, highly iterative process, iterative process requiring, process requiring literature

备注： MICCAI 2026 Workshop AgenticMed

点击查看摘要

Abstract:Developing competitive deep learning baselines for medical imaging remains a highly iterative process requiring literature review, implementation, experimentation, and expert refinement. Existing automation approaches typically optimize isolated components, such as architecture search or hyperparameter tuning, rather than the complete baseline development process. We present an agentic AI Scientist workflow that combines literature-guided reasoning, automated code generation, and hypothesis-driven experimentation to generate competitive baseline models for medical imaging challenges. The framework is evaluated on four public benchmarks spanning segmentation, classification, and detection. Across all tasks, the Experimentation Pipeline consistently improves validation performance, achieving competitive leaderboard results, including 6th place on both PUMA tracks (15 teams) and 31st place on MILK10k (125 teams). On MIDOG25, the resulting model also demonstrates strong domain generalization across scanners, tumor types, and species. Using the same workflow across all challenges without task-specific redesign, we demonstrate that skill-based, literature-guided agentic workflows can substantially reduce the engineering effort required to develop competitive medical imaging baselines.

20. 【2608.23330】IntentQA: Intent Question Answering in Videos by Cognitive Context Reasoning

链接：https://arxiv.org/abs/2608.23330

作者：Jiapeng Li,Ping Wei,Wenjuan Han,Song-Chun Zhu,Lifeng Fan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：understanding requires intelligent, requires intelligent agents, transcend mere recognition, Video understanding requires, dark matter

备注： 18 pages, 7 figures. Accepted manuscript of an article published in IEEE Transactions on Pattern Analysis and Machine Intelligence

点击查看摘要

Abstract:Video understanding requires intelligent agents to transcend mere recognition of visual facts and comprehend the underlying intents behind human actions (often termed the "dark matter" of social intelligence). To bridge the gap between visual observation and intent reasoning, we introduce a novel task, IntentQA, and contribute a large-scale VideoQA dataset specifically tailored for this purpose. However, recognizing that standard metrics may overestimate capabilities due to dataset biases, we go beyond simple accuracy to rigorously evaluate model robustness. We augment the benchmark by generating five distinct contrast sets via Large Language Models (LLMs) and introducing a "Contrast Performance Decline" metric. We propose the X-CaVIR (eXplainable Context-aware Video Intent Reasoning) framework, which leverages three types of "Cognitive Context" to enhance video analysis: i) Situational Context via a cross-modal Video Query Language (VQL) module, ii) Contrastive Context via a Contrastive Learning module, and iii) Commonsense Context via a Commonsense Reasoning module. Crucially, to overcome the opacity of traditional black-box models, we refine the integration of LLMs within X-CaVIR by employing a transparent pipeline that synergizes video captions with VQA model outputs. This approach not only improves performance by effectively utilizing rich commonsense knowledge but also renders the reasoning process explicitly interpretable. Extensive experiments demonstrate the effectiveness of our components, the superiority of X-CaVIR over state-of-the-art baselines, and its stability against perturbations on the contrast sets.

21. 【2608.23329】hinking Beyond Videos: Unifying Video Reasoning and Deep Research for Open-World Video Agents

链接：https://arxiv.org/abs/2608.23329

作者：Wenqi Liu,Shijie Ma,Yunxiao Wang,Meng Liu,Qile Su,Han Liu,Bohan Hou,Xuanyu Zheng,Changyi Liu,Tianke Zhang,Haonan Fan,Kaiyu Jiang,Yingxin Li,Jiankang Chen,Xu Wang,Bin Wen,Tingting Gao,Han Li,Jianhua Yin,Yinwei Wei,Xuemeng Song

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Open-world video understanding, locate sparse visual, sparse visual evidence, acquire external knowledge, Video Deep Research

备注：

点击查看摘要

Abstract:Open-world video understanding often requires a model to locate sparse visual evidence and acquire external knowledge that is absent from the video and its parametric memory. While Thinking-with-Videos enables active temporal perception and Deep Research supports multi-step information seeking, the two capabilities are typically developed in isolation. We introduce VideoRover, a unified Video Deep Research framework that iteratively coordinates video cropping, multimodal search, and webpage browsing. Given a video-question pair, VideoRover uses each tool result to select the next action, so localized video clips guide external retrieval and retrieved evidence triggers further video inspection and verification. To develop this capability, we construct an automated data curation pipeline, producing 26K verified SFT trajectories and 3K challenging RL instances. We also introduce VideoRover-Bench, a benchmark stratified by video duration and research difficulty. Experiments on VideoDR and VideoRover-Bench show that our VideoRover-8B-RL achieves performance comparable to proprietary models in the direct-answer setting without tool use while outperforming larger open-source models equipped with the same tool suite. Ablation studies and training dynamics further validate the complementary roles of active video grounding, external retrieval, and long-horizon reinforcement learning.

22. 【2608.23302】Grounding Free-Form Instructions for Fashion Complementary Image Generation

链接：https://arxiv.org/abs/2608.23302

作者：Matteo Attimonelli,Claudio Pomo,Alessandro De Bellis,Danilo Danese,Dietmar Jannach,Tommaso Di Noia

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Fashion complementary image, seed item based, multimodal grounding problem, complementary image generation, natural multimodal grounding

备注：

点击查看摘要

Abstract:Fashion complementary image generation (CIG) aims to create garments that stylistically match a seed item based on user intent, making it a natural multimodal grounding problem where models must interpret language in visual context. Existing CIG benchmarks rely on rigid template prompts (e.g., "a photo of a skirt"), failing to reflect natural user queries and obscuring model behavior across levels of linguistic specificity. We introduce fashion complementary image generation with free-form instructions, a multimodal language-grounding setting where a model generates a compatible garment from a seed image and a natural-language instruction. To this end, we enrich three CIG benchmarks with low-, medium-, and high-specificity instructions generated by a vision-language model and validated by human annotators. We instantiate the task with StyleFlow, a Rectified Flow Matching model that jointly conditions on the seed image and instruction within a single multimodal transformer. Across image quality metrics, catalog-alignment analysis, ablations, and human evaluation, StyleFlow consistently produces instruction-aligned and stylistically coherent garments while reducing architectural complexity and inference cost relative to auxiliary-module approaches.

23. 【2608.23299】What Remains Normal? Clean Images Miss Useful Near-Defect Normal Patches for Anomaly Detection

链接：https://arxiv.org/abs/2608.23299

作者：Joongwon Chae,Runming Wang,Peiwu Qin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Memory-based anomaly detectors, score test patches, anomaly detectors store, detectors store nominal, Memory-based anomaly

备注：

点击查看摘要

Abstract:Memory-based anomaly detectors store nominal training patches and score test patches against this memory. A patch selected for coverage therefore becomes a nor- mal reference without a separate check that geometric rarity makes it safe to trust. We probe this coupling with sparse training contamination. Under fixed representa- tions and memory budgets, we compare random, medoid, local, and global coverage selectors. We then use CLEANCON, an out-of-bag cross-image support gate that changes candidate-image eligibility while fixing the representation, absolute mem- ory size, builder, and inference rule. Global coverage strongly over-represents sparse contamination. CLEANCON reduces final-memory contamination to approx- imately zero and increases category-macro P-AP in all 12 matched comparisons. Yet along a retention sweep, the lowest-contamination memory does not attain the highest P-AP; performance continues to improve while contamination rises. Mem- ory contamination therefore does not order the resulting memories by this http URL is publicly available at this https URL.

24. 【2608.23295】What Memory Composition Does Not Tell Us About Anomaly Detection

链接：https://arxiv.org/abs/2608.23295

作者：Joongwon Chae,Runming Wang,Peiwu Qin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Memory-based anomaly detectors, score test patches, anomaly detectors store, detectors store nominal, Memory-based anomaly

备注：

点击查看摘要

25. 【2608.23290】Spotter: Efficient Urban Visual Localization via Geo-Referenced Facade Landmarks in GPS-Degraded Environments

链接：https://arxiv.org/abs/2608.23290

作者：Antoni Valls,Jordi Sanchez-Riera

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：platforms remains challenging, dense urban environments, Accurate visual localization, wearable platforms remains, Accurate visual

备注：

点击查看摘要

Abstract:Accurate visual localization on robotic and wearable platforms remains challenging in dense urban environments. Existing methodologies typically rely on GPS for absolute positioning, yet GPS signals frequently degrade in urban canyons due to multipath propagation. Consequently, standard solutions like visual odometry suffer from unmitigated drift over time, while map-matching techniques struggle to acquire the reliable GPS priors they need, on top of being too computationally heavy for real-time edge execution. To address these limitations, we propose Spotter, a robuts and real-time visual localization framework that uses building facades as a reliable source of global geo-reference, while retaining the capability to integrate GPS signals when available. In an offline stage, Spotter processes Google Street View panoramas by semantically segmenting facades and pairing multi-view stereo depth with cartographic data to build a compact metric database. At runtime, query images are matched via a cascaded retrieval and geometric verification pipeline to recover fine-grained global camera localization. We benchmark Spotter on a newly collected dataset of pedestrian sequences acquired with wearable smart glasses across several districts of Barcelona. Experimental results show that Spotter outperforms odometry-based baselines and achieves localization accuracy comparable to state-of-the-art map-based methods while operating at significantly higher frame rates.

26. 【2608.23279】Spatiotemporally Decoupled Autoregressive Diffusion Model for Human Motion Generation

链接：https://arxiv.org/abs/2608.23279

作者：Chengqun Yang,Liang Xu,Yanping Li,Fulong Liu,Jingnan Gao,Weili Zeng,Yichao Yan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Text-driven human motion, made substantial development, Text-driven human, human motion synthesis, Vector Quantization

备注： Accepted by ICME 2026

点击查看摘要

Abstract:Text-driven human motion synthesis has made substantial development with two core modules of motion representation and generative architecture. For representation, Vector Quantization (VQ)-based methods compress motion data into discrete tokens while latent-based models operate directly in continuous space. However, both of these representations exhibit significant limitations. VQ-based methods suffer from inherent information loss, which compromises the quality, diversity, and generalization of generated motions, while continuous representation on holistic whole-body motion hinders part-level flexibility. For architecture, diffusion and autoregressive diffusion models have demonstrated their superiority, yet the fine-grained controllability over individual body parts is also limited. Thus, we propose a unified spatiotemporally decoupled framework named DeMoDiff, which jointly redesigns representation and architecture. To enhance representation extraction capabilities and offer greater part-level controllability, we present a spatial-temporal VAE that encodes each body joint rather than compressing the whole-body motion into a single latent space. Then, we incorporate spatial-temporal masking and attention mechanisms into an autoregressive diffusion generator, achieving both generative capability and controllable editability. Extensive experiments on the HumanML3D and KIT-ML datasets demonstrate that our model achieves state-of-the-art reconstruction performance and compelling motion generation results. Moreover, our framework demonstrates strong temporal and spatial editing capabilities, further validating its effectiveness. Our project page: this https URL

27. 【2608.23268】Dual-Grained Agent Memory and Shapley Context Attribution for Multimodal Agentic Learner

链接：https://arxiv.org/abs/2608.23268

作者：Jieke Wang,Tiancheng Shen,Yibo Yang,Ming-Hsuan Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Frontier multimodal large, large language models, deliver impressive perception, multimodal large language, Frontier multimodal

备注：

点击查看摘要

Abstract:Frontier multimodal large language models (MLLMs) deliver impressive perception yet still falter on scientific and mathematical reasoning. Parameter-level adaptation is unavailable for closed-weight or on-device backbones, and stateless prompting forfeits any compounding benefit from problems already solved. We propose \textbf{DG-Mem}, a dual-grained agentic memory framework that augments a frozen MLLM with a non-parametric, externally stored memory built once from training-time rollouts and consulted read-only at test time. Motivated by the Complementary Learning Systems (CLS) account of human memory, DG-Mem factors its store into an instance-grounded exemplar memory and a category-level schema memory of IF-THEN rules, with a transient reflection store mediating their construction so that schemas are synthesized only from abstract reflections, never from exemplar text. Two design choices distinguish DG-Mem: an online concept categorizer that grows the category space incrementally during training rather than committing to a predefined taxonomy, and a Shapley context attribution procedure that decomposes correctness across the entire retrieved rule set and yields a per-rule utility that re-weights retrieval at test time. The pipeline introduces no gradient updates and is deployable on closed-weight or on-device backbones. Across MathVista, MMMU, and MMMU-Pro on four open-weight and proprietary backbones (Qwen3.5-27B, Qwen3.5-122B-A10B, GPT-5-Nano, Gemini-3-Flash), DG-Mem improves consistently over no-memory and competitive memory baselines.

28. 【2608.23258】Progressively Learning Heterogeneous Skills in a Unified Latent Space

链接：https://arxiv.org/abs/2608.23258

作者：Yue-Yi Zhang,Ming Gong,Linpu He,Wei-Shi Zheng,Zhilin Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：progressively learn heterogeneous, unified latent space, physics-based character control, learn heterogeneous skills, latent space

备注： 23 pages, 18 figures

点击查看摘要

Abstract:We propose HetSkills, a novel framework designed to progressively learn heterogeneous skills within a unified latent space for physics-based character control. The core idea is to treat this latent space as a shared executable interface, enabling seamless integration of skills learned from diverse data sources, supervision forms, and tasks. HetSkills begins by learning a tracking skill that establishes a strong foundation in motion control and creates a shared motion decoder, which can be reused across tasks without the need for retraining or separate controllers. To prevent the text-to-motion skill from exploiting shortcut pathways instead of learning language semantics, we introduce motion intuition distillation to ground text-to-motion generation in language semantics and a task-guidance module that dynamically adjusts actions based on high-level language instructions. This enables HetSkills to preserve natural motion while continuously expanding its skill repertoire, making it highly adaptable for long-horizon tasks. Experimental results demonstrate the effectiveness in motion tracking, text-to-motion generation, motion completion, and downstream task adaptation, achieving impressive success rates even under challenging conditions.

29. 【2608.23253】E2S-Pruner: Progressive Two-Stage Evidence Fusion for Visual Token Pruning in Vision-Language Models

链接：https://arxiv.org/abs/2608.23253

作者：Taoyu Qian,Qi Wang,Daqian Shi,Yuanhao Jiang,Shang Gao,Hualong Yu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：GPU memory overhead, Vision-language models typically, incurring substantial inference, substantial inference latency, models typically encode

备注：

点击查看摘要

Abstract:Vision-language models typically encode an image into hundreds of visual tokens, incurring substantial inference latency and GPU memory overhead. Existing pruning methods largely rely on attention scores and directly aggregate outputs across attention heads and network layers, making it difficult to characterize evidential uncertainty and conflict. We propose E2S-Pruner, a progressive two-stage evidence-fusion framework for visual token pruning that requires no auxiliary model, trainable parameters, or fine-tuning. In the first stage, E2S-Pruner treats each attention head as an independent evidence source, estimates its reliability from evidence clarity and inter-head consistency, and represents each visual token using three states: important, unimportant, and uncertain. In the second stage, Dempster--Shafer evidence theory is used to quantify inter-layer conflict and fuse complementary evidence from multiple network layers. We further introduce a spatial novelty constraint that promotes coverage of distinct image regions and prevents the retained tokens from concentrating in a few locally salient areas. On LLaVA-1.5-7B, E2S-Pruner retains 98.0%, 96.8%, and 90.6% of the aggregate performance when the average numbers of retained visual tokens are 192, 128, and 64, respectively, while improving throughput by 1.96x and 2.09x under the 128-token and 64-token settings. Experiments on Qwen2-VL-7B further demonstrate cross-model generalization. Code is available at this https URL.

30. 【2608.23249】Semantic Reconstruction and 3-D Detection via Learned Multi-Pair Fusion in RF Imaging

链接：https://arxiv.org/abs/2608.23249

作者：Amir Rezaei,Wen-Xin Pan,Giuseppe Caire

类目：Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

关键词：radio-frequency imaging problem, multistatic radio-frequency imaging, problem with anisotropy, point depends, multistatic radio-frequency

备注：

点击查看摘要

Abstract:We consider a multistatic radio-frequency imaging problem with anisotropy, in which the reflection from a point depends on the positions of the transmit (Tx) and receive (Rx) arrays. The goal is to label the voxels of a field of view by a finite set of semantic classes and to group them into object instances. For the image formation of each Tx--Rx pair we apply a standard inverse-problem solver, and we feed the resulting per-pair reconstructions into a trained three-dimensional (3-D) U-Net that performs the fusion implicitly and the per-voxel classification explicitly. On a controlled, under-determined multistatic setup, we consider the following image formation methods: back-projection (BP) and the least absolute shrinkage and selection operator (LASSO) from a single deterministic snapshot, and incoherent BP and group-LASSO from multiple fading snapshots. For each imaging method we train a separate U-Net that fuses the six Tx--Rx pairs (its input channels) and assigns each voxel a probability vector over the classes. Taking the most probable class gives a labeled volume---the semantic reconstruction. Object instances and their oriented bounding boxes then follow by geometric post-processing (clustering and principal-component analysis). Across a wide range of signal-to-noise ratio, the semantic reconstruction (scored against ground truth by segmentation intersection-over-union) and the resulting 3-D detection degrade far more gracefully than the classical intensity reconstruction: the detection in particular stays reliable well into noise levels at which that reconstruction has dissolved. Because real scenes contain objects of classes the network was not trained on, we add an explicit unknown class trained by outlier exposure, which labels held-out novel objects as unknown instead of mislabeling them as a known class by reconstructed shape.

31. 【2608.23238】Mover360: Controllable Object Manipulation in 360° Panoramic Images

链接：https://arxiv.org/abs/2608.23238

作者：Haoyi Zhong,Fang-Lue Zhang,Andrew Chalmers,Taehyun Rhee

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：controllable object manipulation, object manipulation framework, manipulation framework, Unlike perspective images, controllable object

备注：

点击查看摘要

Abstract:We present Mover360, a controllable object manipulation framework for 360° images. Unlike perspective images, 360° images in equirectangular projection (ERP) exhibit horizontal wrap-around, latitude-dependent distortion, and global scene continuity, which makes object-level edits difficult for existing perspective editors to produce and for users to specify. To address this, Mover360 centers on object Translation (relocating a specified object within an existing panorama) while supporting reference-guided Insert and Remove as auxiliary tasks. Its interface unifies point-, bbox-, and mask-guided control by encoding each task into a fixed prompt and a compact, ERP-aligned instruction map. In the default point mode, a single click relocates an object, allowing the model to infer a plausible size, support, and illumination using panoramic context and an auxiliary depth condition. Structurally, Mover360 is a lightweight adaptation of a pretrained diffusion transformer. To generate paired supervision, we construct a UE5 data-generation pipeline with surface-aware object placement and randomized illumination, yielding large-scale paired data and a dual-domain benchmark of synthetic and real panoramas with ground truth for all three tasks. Across both test domains and two evaluation protocols, Mover360 outperforms strong baselines for perspective editing, insertion, and inpainting in reconstruction fidelity, semantic consistency, and distributional quality. Code and our benchmark dataset are available at this https URL.

32. 【2608.23234】MLLM-Assisted Audio VOS: A 3rd Place Report for the MeViS-Audio Track, 8th LSVOS Challenge

链接：https://arxiv.org/abs/2608.23234

作者：Liangtao Shi,Jinxia Xie,Xiantao Hu,Ting Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal Large Language, Large Language Models, integrates Multimodal Large, Large Language, Multimodal Large

备注： 5 pages

点击查看摘要

Abstract:In this technical report, we present a training-free framework for audio-guided video object segmentation, which integrates Multimodal Large Language Models (MLLMs) with SAM-based segmentation models. We decompose the task into several stages and identify suitable foundation models for each stage. Without introducing additional model training or task-specific fine-tuning, our approach leverages the strong multimodal reasoning capabilities of MLLMs to model text-visual correspondence and employs SAM-based models for accurate object mask generation. The proposed framework demonstrates the effectiveness of leveraging foundation models for audio-guided video segmentation and achieves competitive performance in the MeViS-Audio Track of the 8th LSVOS Challenge.

33. 【2608.23224】hink Only When Needed: Prompt-Authority Control for Selective Slow-Path Intervention in Vision-Language-Action Manipulation

链接：https://arxiv.org/abs/2608.23224

作者：Zhiruo Zhou,Zelin Li,Xiwen Chen,Jiazhuo Li,Chenwei Wang,Huiming Chen,Xiaojun Zhu

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Retrieval can efficiently, efficiently and effectively, effectively augment, control intervention, enters the executed

备注：

点击查看摘要

Abstract:Retrieval can efficiently and effectively augment a frozen vision--language--action (VLA) policy without retraining, yet retrieved text becomes a control intervention once it enters the executed prompt. In a matched audit, raw appended text reduces mean success from 92.47\% to 3.00\%, while meaningful and length-matched meaningless appends both fail on all 500 states. This result identifies \emph{prompt-form collapse}: changing the instruction form, rather than adding useful semantics, can dominate execution. We introduce TOWN-VLA (Think Only When Needed), a prompt-authority interface that separates candidate generation from permission to alter the policy input. A fixed compatibility rule authorizes a canonical compact instruction; otherwise, the interface restores the original Base prompt exactly. Across 900 audited routes, every route follows this contract: 525 routes recover Base with matching hashes, and all 375 authorized prompts preserve the task signature. On a matched $4\times7$ LIBERO-Plus evaluation with 10{,}030 episodes per method, success rises from 69.5\% to 73.1\% ($+362$ episodes; 95\% CI 1.89--5.45 points), improving on six perturbation axes and all four suites. On a physical PiPER arm with a frozen \pizerofive{} checkpoint, success rises from 52.7\% to 78.7\% over 150 trials per method ($p=3.16\times10^{-6}$). Prompt authority is enforceable for a frozen controller; oracle-free admission calibration is the next deployment target.

34. 【2608.23215】BenthicDINO: Physics-Informed Self-Distillation for View-Invariant Side-Scan Sonar Representations

链接：https://arxiv.org/abs/2608.23215

作者：Taqi Hamoda,Hayat Rajani,Nuno Gracias

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：inextricably mix intrinsic, mix intrinsic seabed, intrinsic seabed reflectivity, Automated perception, transient viewing geometries

备注：

点击查看摘要

Abstract:Automated perception in side-scan sonar (SSS) imagery is severely hindered by physical acoustic artifacts, resulting in representations that inextricably mix intrinsic seabed reflectivity with transient viewing geometries. Existing self-supervised learning (SSL) frameworks rely on augmentations designed for natural images, failing to account for acoustic degradation and explicitly enforce view-invariance. To address this gap, we introduce a physics-informed self-distillation framework built upon the DINOv3 architecture utilizing a ConvNeXt-v2-Tiny backbone to maximize data efficiency. The proposed methodology enforces view-invariance through two primary mechanisms: physically motivated augmentations that simulate speckle noise, range-dependent attenuation, and radiometric miscalibration; and a Hilbert-Schmidt Independence Criterion (HSIC) penalty that explicitly decouples learned dense patch features from physical viewing parameters. Furthermore, we propose a dense, hierarchical feature fusion strategy across all four network stages to preserve fine-grained sediment details alongside deep semantic abstractions. Extensive evaluation demonstrates that the framework natively groups complex benthic topographies into stable, noise-free semantic clusters without relying on manual annotations. During supervised downstream tasks on the S3Seg dataset, the fused representations exhibited exceptional data efficiency, achieving 96% of its absolute peak performance using only 10% of the available annotated data, ultimately reaching a mean Intersection over Union (mIoU) of 71.4% and an overall accuracy of 86.5%.

35. 【2608.23213】Bee Detection and Tracking at Hive Entrance using YOLO11 and ByteTrack

链接：https://arxiv.org/abs/2608.23213

作者：Thi Thu Thao Nguyen,Johannes Reschke

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：transfer learning, work presents, ByteTrack tracking algorithm, monitoring system based, progressive backbone unfreezing

备注： 17 pages, 13 figures

点击查看摘要

Abstract:This work presents an automatic bee entrance monitoring system based on YOLO11 transfer learning and the ByteTrack tracking algorithm. The study investigates the influence of data augmentation, backbone freezing, and tracker parameter optimization on the detection and counting of small, fast-moving bees. The detector with progressive backbone unfreezing strategy achieved about 97.0% precision and 98.7% mAP50, while providing more stable convergence than full fine-tuning. Experiments also showed that light augmentation outperformed heavy augmentation. For tracking, ByteTrack parameters were optimized to improve trajectory continuity under low-confidence detections. On an independent 25 FPS side-view video, the optimized YOLO11-ByteTrack system correctly counted 43 of 47 incoming bees (91.5%) and 7 of 30 outgoing bees (23.3%). Error analysis showed that most counting errors were caused by missed detections due to rapid bee motion and motion blur, while tracking failures became less frequent after parameter optimization. Overall, the results indicate that moderate augmentation, progressive backbone unfreezing, and ByteTrack tuning improve the reliability of automatic bee entrance monitoring under realistic recording conditions.

36. 【2608.23206】Learning Spherical Occupancy Profiles for Multi-View 3D Reconstruction and Generation

链接：https://arxiv.org/abs/2608.23206

作者：YiHsuan Tsai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：unified intermediate representation, Google Scanned Objects, study spherical occupancy, spherical occupancy profiles-the, Gaussian reconstructions-as

备注： 12 pages,5 figures,5 tables. Code and data will be released

点击查看摘要

Abstract:We study spherical occupancy profiles-the ray-wise occupancy probability profiles P(r) = T(r) o(r) distilled from multi-view 3D Gaussian reconstructions-as a unified intermediate representation for both discriminative and generative 3D reconstruction from images. On a 999-object subset of Google Scanned Objects with 48 turntable views each, we train (i) a discriminative per-ray decoder that injects global view-averaged and ray-specific image evidence into a FiLM-conditioned profile head, reaching median soft depth error 0.035 (normalized) on an independent 90-object test split, and (ii) a generative pipeline built on a profile VAE and a latent diffusion model, which supports unconditional sampling that matches the reconstruction manifold and image-conditioned multi-solution reconstruction whose per-object solution spread is quantifiable and tunable via classifier-free guidance. We further analyze the morphology of predicted profiles: post-hoc power sharpening and a learned sharpening target both recover ground-truth profile width without degrading depth, exposing a monotonic width-peak frontier in the L1-per-ray loss family and motivating a principled redefinition of morphology gates. Real-photo validation on two DTU scenes confirms the pipeline transfers to non-synthetic input. Our results suggest that ray-wise occupancy profiles offer a compact, learned, and uncertainty-aware interface between multi-view reconstruction and generative priors.

37. 【2608.23190】oward a Foundation Plug-and-Play Prior for Computed Tomography Reconstruction via a Multimodal Diffusion Model

链接：https://arxiv.org/abs/2608.23190

作者：Haley Duba-Sullivan,Patxi Fernandez-Zelaia,Obaidullah Rahman,Amirkoushyar Ziabari

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：detector integration time, Computed tomography, throughput is limited, integration time, number of projections

备注：

点击查看摘要

Abstract:Computed tomography (CT) throughput is limited by scan time, which grows with both the number of projections acquired and the detector integration time for each. Reconstructing high-quality volumes from sparse-view or low-dose measurements therefore depends on an informative prior, typically a neural network trained for one specific scan setting and retrained whenever the modality, geometry, or material changes. We investigate whether a single diffusion model trained across several imaging domains can instead serve as a prior for many CT problems simultaneously. We evaluate the proposed method using the same frozen model on three datasets that differ in modality, beam geometry, material, and degradation type, spanning flaw analysis in additively manufactured metal parts imaged with cone-beam X-ray CT and concrete microstructure imaged with parallel-beam neutron CT. Our proposed method out-performs analytic reconstructions in all three cases, providing a step toward a reusable foundation prior for heterogeneous CT reconstruction problems.

38. 【2608.23189】EchoWM: Open and Enterable Omnimodal World Models

链接：https://arxiv.org/abs/2608.23189

作者：Songchun Zhang,Yaowei Li,Junhao Zhuang,Weiyang Jin,Haoyu Wang,Xin Lu,Yilang Sun,Shiyi Zhang,Haoran Li,Xiaoxiao Ma,Yuming Li,Yijun Liu,Yaofeng Su,Yanwen Ma,Haoyu Wu,Zihan Su,Yue Ma,Lvmin Zhang,Haoyang Huang,Zeyue Xue,Anyi Rao,Nan Duan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：enterable generative media, omnimodal world model, present EchoWM, omnimodal world, enterable generative

备注： 42 pages, 24 figures

点击查看摘要

Abstract:We present EchoWM, an omnimodal world model for enterable generative media that responds to continuous navigation while jointly generating 720p video, environmental sound, music and speech. We organize interaction around camera intent: in first-person scenes, it specifies observer motion, while in third-person scenes, camera--character dynamics are learned from data without view-specific controllers. Discrete commands and continuous poses are mapped to a shared metric-scale relative 6-DoF trajectory, with dataset-level calibration preserving motion magnitude across heterogeneous data. To jointly learn audio-visual generation and trajectory control, we construct a complementary data engine and adopt progressive training followed by autoregressive post-training for long-horizon generation. Extensive evaluations show that \model achieves strong trajectory following and high visual quality on public world-model benchmarks, supporting both first- and third-person interaction across varied subjects, and maintaining synchronized environmental sound and speech over long-horizon generation.

39. 【2608.23182】A Comparative Study of Label-free Representation Quality Metrics in Deep Learning

链接：https://arxiv.org/abs/2608.23182

作者：Daniel Richards Arputharaj,Daniel Jönsson,Gabriel Eilertsen

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：deep neural networks, variety of configurations, present a comparative, comparative study, deep neural

备注： Published in Transactions on Machine Learning Research (TMLR). OpenReview: [this https URL](https://openreview.net/forum?id=yknkAksqr1)

点击查看摘要

Abstract:We present a comparative study of label-free metrics for assessing the quality of representations in deep neural networks to understand their reliability under a wide variety of configurations. We group existing label-free metrics into three families based on their construction and analytically establish connections between metrics within the same family. We then characterise the sensitivity of spectral metrics through controlled synthetic experiments. Finally, all label-free metrics are evaluated against downstream task accuracy across a diverse set of 260 vision models on six datasets spanning generic object classification, fine-grained object classification, scene recognition and geospatial task, stratifying results by architecture class and training objective. We find that intrinsic dimensionality (ID) is the most reliable predictor among the metrics considered. However, the reliability of all metrics, including ID, is moderated by architecture class and training objective. Our results provide a clearer understanding of what label-free representation quality metrics measure, when they are reliable, and how to interpret them in practice.

40. 【2608.23175】Neighbor-Aware View Synthesis for Restoring Missing Views in Light-Field Camera Arrays

链接：https://arxiv.org/abs/2608.23175

作者：Sakshi Goel,Ayush Goyal,K S Venkatesh,Koteswar Rao Jerripothula

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：dense spatial sampling, enables powerful post-capture, powerful post-capture capabilities, array enables powerful, imaging systems

备注：

点击查看摘要

Abstract:In light-field (LF) imaging systems, dense spatial sampling from a camera array enables powerful post-capture capabilities such as refocusing and depth estimation. However, real-world LF capture is often affected by hardware malfunctions, where one or more cameras in the array fail, leading to missing sub-aperture images and degraded reconstruction quality. This paper addresses the problem of defective or missing view restoration in light-field camera arrays. We propose a novel generative framework that synthesizes the absent views by exploiting information from a carefully selected subset of neighboring cameras. These selected images, along with a positional encoding map indicating both their locations and the desired target view, are fed into a conditional Generative Adversarial Network (cGAN) trained to generate the missing viewpoint in a geometrically consistent manner. Extensive experiments on synthetic and real-world LF datasets demonstrate that our method produces visually plausible and photometrically accurate reconstructions, outperforming baselines for view interpolation both quantitatively and qualitatively. The proposed framework thus offers a robust and efficient solution for fault-tolerant light-field image acquisition.

41. 【2608.23173】BenthicFlow: Generating Extensible Underwater Environments via Flow Matching

链接：https://arxiv.org/abs/2608.23173

作者：Joaquín Figueira,Camile Lendering,Manfred Gonzalez-Hernandez,Giacomo D'Amicantonio,Erkut Akdag,Egor Bondarev

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Computer vision applications, remain challenging due, Computer vision, underwater environments remain, environments remain challenging

备注： Accepted to ECCV 2026 in the 2nd Workshop on Marine Vision

点击查看摘要

Abstract:Computer vision applications for 3D scene understanding in underwater environments remain challenging due to the lack of high-quality 3D data and the inability of surface-trained models to generalize to underwater scenes. To address this challenge, an emerging trend is to employ generative models to close the data domain gap. However, existing methods assemble large scenes by stitching independently generated tiles post hoc with separately trained models, while demonstrating heterogeneous landscapes only within individual survey sites. We introduce BenthicFlow, a unified framework based on a single conditional flow-matching model that jointly generates aligned textures and depth maps. A MultiDiffusion-inspired sampling procedure reconciles overlapping windows throughout the generative trajectory, enabling spatially extensible RGBD mosaics without a separate stitching model. The generated mosaics are subsequently lifted into explicit 3D benthic environments using surface-aligned Gaussian surfels. Experiments across geographically distinct survey sites demonstrate that BenthicFlow preserves site-specific appearance while generating coherent, large-scale 3D scenes that closely match the target distributions. Code and trained models are available at this https URL.

42. 【2608.23172】CaRGo-T: Causal Reasoning Graph-of-Thought improves Multimodal Humor Comprehension

链接：https://arxiv.org/abs/2608.23172

作者：Abhilash Nandy,Rahul Seetharaman,Aman Bansal,Rounak Saha,Manav Nitin Kapadnis,Millon Madhur Das,Pawan Goyal,Niloy Ganguly

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Large-scale vision-language models, demonstrated remarkable versatility, Large-scale vision-language, vision-language models, demonstrated remarkable

备注： 18 pages, 5 figures

点击查看摘要

43. 【2608.23143】An end-to-end-trained vision-language model for native-language prostate pathology report generation

链接：https://arxiv.org/abs/2608.23143

作者：Christian Grashei,Fabian Gülhan,Maximilian Legnar,Fabian Stögbauer,Cleo-Aron Weis,Carolin Mogler,Peter Schüffler

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：diagnosed malignancies worldwide, frequently diagnosed malignancies, core burdens pathologists, biopsy core burdens, malignancies worldwide

备注：

点击查看摘要

Abstract:Prostate cancer is among the most frequently diagnosed malignancies worldwide, and structured reporting of each biopsy core burdens pathologists. Existing tools frame this as classification, leaving pathologists to assemble coherent reports, while many slide-level vision-language models rely on English-centric encoders that transfer poorly to other clinical languages. We present a slide-level framework generating prostate biopsy reports that is language-independent by construction: tokenizer and model are trained from scratch, demonstrated here in German. To address paired-data scarcity, an automated pipeline uses a locally deployed large language model to split composite reports into core-specific image-text pairs, yielding 17,344 pairs from 2,402 historical cases without manual annotation. Evaluated for clinical attributes rather than linguistic similarity, the model achieves 96.2% F1 for malignancy detection and 65.2% for Gleason grading, competitive with an FDA-cleared classifier. Grading is further validated on three external cohorts with latent-space augmentation. Institutions can thus train native-language reporting models on their own archives.

44. 【2608.23142】How Merge-Tolerant Are Vision Transformers for Wheat Phenotyping?

链接：https://arxiv.org/abs/2608.23142

作者：Simon Ravé,Pejman Rasti,David Rousseau

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Vision-based wheat phenotyping, wheat phenotyping requires, Vision-based wheat, phenotyping requires repeated, Plain Vision Transformers

备注： Accepted to the CVPPA workshop at ECCV 2026

点击查看摘要

Abstract:Vision-based wheat phenotyping requires repeated measurements under deployment constraints, from growth-stage recognition to wheat-head counting and organ segmentation. Plain Vision Transformers (ViTs) provide a common architecture for these tasks, but quadratic attention limits high-throughput and edge inference. Training-free token merging is attractive because it can be inserted into trained models without retraining. We provide a systematic benchmark of ToMe and Mutual Pair Merging across growth-stage classification, wheat-head detection, and wheat-organ segmentation, measuring task quality, throughput, token count, and peak GPU memory, with additional Raspberry Pi 5 measurements. The benchmark reveals a clear hierarchy: classification is highly merge-tolerant, while detection and segmentation are constrained by repeated instances, thin organs, dense boundaries, reconstruction, and runtime overhead. Optimized attention backends can erase apparent speedups, so deployment value must be profiled on the target runtime rather than inferred from token count.

45. 【2608.23140】MIVIFI: Bridging Perspective and Fisheye Domains for Training Multi-View Fisheye Image Generation Models

链接：https://arxiv.org/abs/2608.23140

作者：Matthias Neuwirth-Trapp,Begüm Altunbas,Jiayi Wang,Yan Xia,Maarten Bieshaar,Xinyu Huang,Daniel Cremers

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：visual perception systems, autonomous vehicles, visual perception, perception systems, systems of autonomous

备注： Accepted at the IEEE International Conference on Intelligent Transportation Systems (ITSC) 2026

点击查看摘要

Abstract:Achieving 360° coverage is critical for the visual perception systems of autonomous vehicles. Fisheye cameras offer a cost-effective solution by enabling full surround coverage with as few as two sensors. However, existing multi-view fisheye datasets are limited, and synthesizing rare corner cases typically requires computationally expensive 3D simulations, hindering the training. While generative models have achieved significant success in standard perspective imagery, their application to wide-angle distortion remains unexplored. In this work, we formally introduce the novel problem of multi-view fisheye image generation conditioned on volumetric semantic representations and present two distinct methods. We first propose SyntheOcc-FE, which adapts the SyntheOcc architecture to fisheye data. While effective, this method is constrained by the scarcity of fisheye datasets, which limits its generalization. To overcome these limitations, we propose our second method, MIVIFI (multi-view fisheye), which leverages cross-domain learning with Equirectangular Projections. By bridging the gap between dataset domains using KITTI-360 fisheye images alongside nuScenes multi-view standard images, our approach enables high-fidelity manipulation of scene content. This framework enables the structural modification of semantic occupancy inputs to introduce or eliminate specific actors and facilitates the rendering of diverse meteorological conditions and illumination scenarios absent in the limited fisheye datasets. Quantitative and qualitative experiments demonstrate that our methods achieve robust photorealistic multi-view fisheye image generation and highlight the specific advantages of our cross-domain strategy for handling data scarcity.

46. 【2608.23138】Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation

链接：https://arxiv.org/abs/2608.23138

作者：Xiwen Chen,Zelin Li,Zhiruo Zhou,Huiming Chen,Chenwei Wang,Xiaojun Zhu

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：creating brittle interfaces, opaque action tokens, autoregressive text coordinates, models often expose, creating brittle

备注：

点击查看摘要

Abstract:Vision-language-action (VLA) models often expose spatial grounding through autoregressive text coordinates or opaque action tokens, creating brittle interfaces between multimodal reasoning and robot execution. We present Pointing-VLA, a typed hidden-state spatial readout built on Embodied-R1. Geometry-specific heads predict normalized points, object-functional grounding (OFG) heatmaps, and visual trajectories without serializing geometry as text. For the evaluated Bridge/WidowX and physical pick-place deployments, an explicit execution contract assigns PICK to source-conditioned OFG and PLACE to Pointing, providing direct stage-aligned spatial targets. Pointing-VLA achieves SOTA performance on Bridge/WidowX, averaging 72.9\% across the evaluated four-task set without Bridge-specific finetuning under collision-enabled CuRobo execution. Pointing and OFG show complementary strengths across native and cross-dataset evaluations. The OFG/contact readout transfers to NORA-1.5, preserving or improving success while reducing recorded controller time by more than 20$\times$; typed heads are also 6.68--6.90$\times$ faster than Embodied-R1 text decoding on a shared external suite. When integrated as spatial guidance for a $\pi_{0.5}$ action policy, Pointing-VLA raises autonomous real-robot success from 52.7\% to 80.7\% across three visual contexts. These results establish typed spatial readouts as an efficient, inspectable interface between embodied reasoning and robot execution.

47. 【2608.23137】A Simulator-Grounded Framework For Constructing Verifiable Muscle-Grounded QA From 3D Tongue Meshes

链接：https://arxiv.org/abs/2608.23137

作者：Seungho Eum,Unsang Park

类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：Existing articulatory corpora, articulatory corpora based, electromagnetic articulography capture, provide traceable labels, capture tongue shape

备注： 15 pages, 4 figures, 15 tables

点击查看摘要

Abstract:Existing articulatory corpora based on real-time MRI and electromagnetic articulography capture tongue shape and motion but do not provide traceable labels for the muscle-driven process that generated an observed configuration. We introduce a simulator-grounded data-construction framework and instantiate it as 3DTongueQA. Controlled 11-dimensional muscle activations are mapped to fixed-topology tongue meshes with the ArtiSynth Badin finite-element model, converted into structured biomechanical records, and rendered as deterministic QA on muscle state, geometry, and target-directed change. We screen 295,157 configurations, retain 295,115 valid meshes, and construct 891,156 QA records per language. Language naturalization changes only surface form and is verified against the source records; English and Korean instantiations demonstrate construction-level portability. A swappable SpiralNet++--Qwen3-8B baseline reaches 62.9 $\pm$ 9.2 Muscle EM, 74.0 $\pm$ 0.2 Value Accuracy, and 65.9 $\pm$ 4.7 Direction EM, while mismatching the paired mesh reduces Muscle EM to 2.2; a dataset-leakage-controlled anchor-held-out model retains 80.4--98.6\% of the full-inventory scores on unseen anchors. Task-specific structured readouts further reach 88.7 $\pm$ 0.7 Muscle EM and 93.3 $\pm$ 1.0 Direction EM. These complementary results show that the constructed supervision supports both efficient structured prediction and heterogeneous natural-language QA rather than being tied to a particular decoder architecture.

48. 【2608.23136】Bridge Damage Detection from Low-Light UAV Imagery via Degradation-Aware Mixture-of-Experts Enhancement

链接：https://arxiv.org/abs/2608.23136

作者：Hu Wang,Hongxu Pu,Zhiqi Hu,Fangzhou Lin,Wang Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Poor illumination obscures, illumination obscures small, obscures small, reducing the reliability, Poor illumination

备注： 31 pages, 9 figures

点击查看摘要

Abstract:Poor illumination obscures small, low-contrast defects in UAV bridge imagery, reducing the reliability and operational flexibility of automated inspection. This paper investigates whether degradation-aware image restoration can improve bridge damage detection under low-light conditions and transfer from synthetic degradations to real inspection scenes. We propose DaL- MoE, a detector-agnostic restoration front end trained with an ISP-aware low-light synthesis pipeline and equipped with degradation-aware guidance estimation and complementary experts for noise suppression, color adjustment, and structural-detail recovery. On paired synthetic data, DaL-MoE achieves 23.12 dB PSNR and 0.8482 SSIM, increasing YOLOv11m box mAP50 from 0.3097 to 0.4923 and mask mAP50 from 0.2281 to 0.3529. On real low-light UAV imagery without paired normal-light references, sim-to-real evaluation shows improved defect visibility and more complete detections than direct inference on raw low-light inputs. Future work will develop low-light-aware bridge damage detectors with stronger cross-scene generalization across bridge sites, imaging conditions, and illumination levels.

49. 【2608.23102】raining-Free Pseudo-Fusion for Composed Image Retrieval with Diffusion Models and Multimodal Large Language Models

链接：https://arxiv.org/abs/2608.23102

作者：Fan Xu,Luis A. Leiva

类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)

关键词：formulate compositional queries, content-based image retrieval, Composed Image Retrieval, enables users, users to formulate

备注：

点击查看摘要

50. 【2608.23090】Loopy: Seamless Video Loop Generation via Anchored Looping Shift of Positional Embedding

链接：https://arxiv.org/abs/2608.23090

作者：Haotian Dong,Wenjing Wang,Chen Li,Jing Lyu,Xin Wang,Di Lin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：game development, web graphics, social media, essential for practical, practical applications

备注： 15 pages, 21 figures, accepted by ACM TOG

点击查看摘要

Abstract:Looping videos are essential for practical applications such as web graphics, game development, and social media. However, existing approaches typically fail to generate high-quality looping videos due to the neglect of how video generation models perceive temporal order and how this relates to the looping behavior. In this work, we are the first to reveal that position embedding at different attention layers within DiT exhibits varying levels of positional control, with the most pronounced layer acting as an anchor. We formulate this anchored layer as the reference point of the looping video, offering strong contextual priors for the remaining layers to facilitate the generation of seamless and coherent video content. Based on this insight, we propose an anchored position embedding shifting strategy that applies layer-specific shift lengths according to each layer's temporal control effect, effectively transforming DiT's temporal perception from a straight line to a circle. Leveraging this strategy, we develop a general framework, Loopy, for high-quality looping video generation, supporting both RGB and RGBA videos, while also enabling advanced AIGC features such as identity control and style transfer. Experiments demonstrate that our approach significantly improves temporal consistency and visual fidelity in generated looping videos. The released model is available on our website: this https URL.

51. 【2608.23074】Grounding Isn't Knowing: Do VLMs Need Object Localization for Spatial Reasoning?

链接：https://arxiv.org/abs/2608.23074

作者：Xiwei Liu,Yulong Li,Xinlin Zhuang,Xuhui Li,Zhixiang Lu,Haolin Yang,Imran Razzak,Yutong Xie

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：remain poorly understood, reasoning remain poorly, mechanisms connecting object, answer spatial questions, Vision-language models

备注：

点击查看摘要

Abstract:Vision-language models (VLMs) can answer spatial questions, yet the mechanisms connecting object grounding to spatial reasoning remain poorly understood. It is underexplored whether spatial reasoning internally requires precise objects localization, or can bypass explicit localization through global layout cues. In this work, we investigate two representative model families, LLaVA-1.5 and Qwen2.5-VL, using a suite of mechanistic interpretability tools, including token ablation, layer-wise probing, attention knockout, and causal mediation analysis. We find that spatial relation prediction follows a staged grounding-to-reasoning process in which object-aligned tokens establish coarse target-reference anchors, while precise bounding-box boundaries are not required. Positional information becomes decodable before relation decisions emerge, and a small set of attention heads mediates the causal effects of both localization and spatial reasoning. The two tasks share early grounding-related processing but ultimately rely on partially distinct specialized pathways. Through rigorous experiments, we provide a token-, layer-, and head-level account of how VLMs transform object grounding into spatial relations, showing that knowing where objects are is not equivalent to knowing how they relate.

52. 【2608.23070】From Generation to Simulation: How Far Are World Models from Being True Simulators?

链接：https://arxiv.org/abs/2608.23070

作者：Tong Wang,Huan Deng,Mucheng Yang,Yang He,Xiaohui Kuang,Gang Zhao

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：including physics engines, large-scale video generation, reinforcement-learning environments, replace traditional simulators, game engines

备注： 42 pages, 23 figures, 2 tables. Project page: [this https URL](https://github.com/AtongWang/world-model-simulators)

点击查看摘要

Abstract:With the rapid progress of diffusion models and large-scale video generation, generative world models are increasingly expected to replace traditional simulators, including physics engines, game engines, and reinforcement-learning environments. Yet the remaining distance from generation to simulation lacks a systematic assessment. We present a capability-based study using an external yardstick: eight capabilities of a traditional simulator, namely asset construction, physics engine, interaction, controllability, stability, state feedback, diversity, and evaluation metrics. We trace three main technical routes--latent dynamics, video generation, and joint-embedding prediction--and map exactly 200 representative works published from 2018 to June 2026 onto these capabilities. Our analysis shows that world models have achieved functional substitution in interaction and controllability for specific scenarios, but remain short of traditional simulators in formal guarantees of physical laws, structured state feedback, and reproducible long-horizon evolution. State feedback is the most neglected cross-route shortcoming: only 6 of 163 implementation papers expose a runtime interface for querying entity states or physical parameters. We identify six research directions: formalized physics, a unified action interface, first-class state feedback, long-horizon stability, downstream-utility evaluation, and cross-route hybridization. Project page: this https URL

53. 【2608.23065】Cultural Moment Benchmark: Evaluating Video Cultural Reasoning and Grounding in Southeast Asia

链接：https://arxiv.org/abs/2608.23065

作者：Burak Satar,Zhixin Ma,Cheng Yu-Tong,Huy Hoang Tran,Phuong Anh Nguyen,Chong-Wah Ngo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Multimedia (cs.MM)

关键词：grasping the symbolic, symbolic and temporal, temporal significance, video, Cultural understanding

备注： Accepted to EMNLP 2026 Main Conference, [this https URL](https://culturalmoment-benchmark.github.io/)

点击查看摘要

54. 【2608.23024】When the Edit Changes the Patient: Measuring Identity Preservation in Counterfactual Retinal Images

链接：https://arxiv.org/abs/2608.23024

作者：Andrea Posada,Wenke Karbole,Bach Ngoc Doan,Alexander Weers,Solmaz Abdolrahimzadeh,Maria Patsiamanidi,Kahkashan Haider,Vaishali Khare,Daniel Rueckert,Andrew Lotery,Sobha Sivaprasad,Martin J. Menten

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：aims to modify, reflect a hypothetical, hypothetical scenario, identity, identity preservation

备注：

点击查看摘要

Abstract:Counterfactual medical image generation aims to modify an existing image to reflect a hypothetical scenario in which certain characteristics of the imaged subject are altered, while keeping their identity fixed. Most existing works repurpose established image editing methods, which do not directly supervise identity preservation. Instead, they assume that identity is implicitly preserved by anchoring generation to the source image. This assumption is rarely tested and may fail in domains where biometric cues are subtle, such as retinal optical coherence tomography (OCT). In this work, we explicitly measure identity preservation for three groups of text-conditioned editing methods - source-anchored, structured-prompt, and paired-training - using referee classifiers, embedding alignment scores, and a blind reader study. We find that all methods produce high-quality OCT images with comparable editing success, yet their identity preservation differs markedly. Source-anchored editing frequently alters the depicted subject, while paired-training preserves it best. We argue that future work on medical counterfactual generation must explicitly measure and report identity preservation alongside image realism and editing success.

55. 【2608.23014】AnaDiffusion: Anatomically CompositionalLatent Diffusion for Controllable 3D Brain MRI Generation

链接：https://arxiv.org/abs/2608.23014

作者：Huiwen Han,Lulin Liu,Bangya Liu,Yuanhao Cai,Nuo Chen,Xiaoqing Wang,Ziqian Xie,Chenyu You,Shuiwang Ji,Degui Zhi,Zhiwen Fan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：made significant advances, brain MRI generation, MRI generation, medical imaging, made significant

备注：

点击查看摘要

Abstract:3D brain MRI generation has made significant advances in medical imaging, simulation, and controllable anatomical analysis. However, existing generative models typically synthesize 3D volumes monolithically, often overlooking regional anatomical structures and limiting local controllability. To address these limitations, we introduce AnaDiffusion, an anatomically compositional latent diffusion framework that factorizes the generation process into distinct, anatomically meaningful regions, followed by part-to-whole assembly and global refinement. Our approach first trains part diffusion models to capture local structural priors. We then inject an assembled anatomical composite of the parts into the whole-brain latent representation and continue denoising. This mechanism enables the model to resolve global context while preserving the injected anatomy. As a result, AnaDiffusion produces both explicit part assets and a globally coherent volume, thereby enabling controllable part editing without requiring subject-specific dense segmentation maps at inference time while maintaining consistent part-to-whole brain structure. On the subject-disjoint ADNI test split, AnaDiffusion achieves the lowest FID across the whole brain, left and right hemispheres, cerebellar-brainstem complex, and seam regions. It also achieves the best cerebellar and second-best ventricular and brainstem absolute Cohen's d values among the evaluated methods. In localized editing experiments, paired MS-SSIM demonstrates high target transfer and off-target preservation, supporting controllable part replacement with minimal unintended anatomical alterations.

56. 【2608.23012】Misanthrope: A Privacy-Preserving Keypoint Detector

链接：https://arxiv.org/abs/2608.23012

作者：Francesco Vultaggio,Predrag Djindjic,Markus Gerke,Sebastian Tschiatschek,Phillipp Fanta-Jende

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Structure from Motion, Visual Localization, Simultaneous Localization, core component, component of applications

备注： Accepted to Privacy preserving Visual Localization (PPVLM) workshop at the European Conference on Computer Vision (ECCV) 2026

点击查看摘要

Abstract:Image matching is a core component of applications such as Simultaneous Localization and Mapping (SLAM), Visual Localization, and Structure from Motion (SfM). However, the local image features central to this task are vulnerable to inversion attacks, which enable adversaries to reconstruct privacy-sensitive scene content from local features. These attacks pose a particular threat in distributed computing scenarios where the pre-computed features leave edge devices to be processed by remote servers. In this work, we introduce Misanthrope, a novel privacy-preserving keypoint detector trained through self-distillation to avoid detecting keypoints on people---a predominant source of privacy-sensitive content in most localization scenarios---thus mitigating inversion attacks at the source rather than through post-hoc obfuscation. We demonstrate how inverted images from traditional feature detection pipelines can be used to detect and re-identify people in the scene, while Misanthrope is able to mitigate these attacks. Furthermore, Misanthrope maintains image matching performance on par with the state of the art and even surpasses it in challenging settings where people act as distractors, such as phototourism and in-the-wild odometry. On the Image Matching Challenge 2021 Phototourism test set, Misanthrope is the top-performing sparse feature extractor in 7 out of 9 scenes. We make our model and its evaluation script available here: this https URL

57. 【2608.23011】Coarse Indexing, Fine Evidence: Decoupling Temporal Granularity in Long-Video RAG

链接：https://arxiv.org/abs/2608.23011

作者：Zhe Jin,Zhimin Lin,Bin Zheng,Junhua Fang,Huihua Yang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Graph-based retrieval-augmented generation, existing systems typically, systems typically inherit, Graph-based retrieval-augmented, scalable paradigm

备注：

点击查看摘要

Abstract:Graph-based retrieval-augmented generation (RAG) provides a scalable paradigm for long-video understanding, but existing systems typically inherit a fixed temporal granularity from video segmentation when constructing their retrieval index. We argue that this design unnecessarily couples indexing granularity with evidence granularity: coarse representations can often suffice for locating relevant temporal regions, while fine-grained evidence remains important for downstream reasoning. We propose \textbf{Density-Aware Graph Construction (DAGC)}, a training-free approach that decouples a query-independent coarse retrieval index from the original fine-grained evidence space. DAGC constructs a compact, density-adaptive graph index by merging visually redundant neighboring chunks, while preserving mappings to the original temporal units. Retrieved coarse regions are subsequently expanded back to the original chunk granularity for fine-grained evidence refinement and answer generation. Experiments on MLVU, VideoMME, and LongVideoBench show that DAGC retains only about 40--50\% of the original graph nodes and achieves $1.3$--$1.7\times$ end-to-end wall-clock acceleration while preserving approximately 99\% of the original QA performance. The gains transfer across different LVLM backbones and video RAG pipelines, suggesting that long-video RAG need not maintain the same temporal granularity for indexing and evidence reasoning.

58. 【2608.22996】ENCORE: Entropy-Guided Cropping and Attention Regularization for Robust Vision--Language Understanding

链接：https://arxiv.org/abs/2608.22996

作者：Yuanhao Sun,Huawei Ji,Jiaxin Ding,Luoyi Fu,Xinbing Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：encoders split images, compromising object integrity, Vision-Language Models, diverse vision-language tasks, transformer-based visual encoders

备注：

点击查看摘要

Abstract:Vision-Language Models (VLMs) perform well on diverse vision-language tasks, but transformer-based visual encoders split images into fixed-resolution sub-images, compromising object integrity in lightweight VLMs. Existing methods only focus on the visual modality and fail to dynamically preserve the integrity of prompt-relevant regions, limiting performance. In this work, we observe that the early-layer image-text entropy of cross-modal attention strongly correlates with answer grounding quality and task accuracy. Building on this finding, we propose \textbf{ENCORE}, an entropy-guided framework with two components: At inference, an \textbf{Entropy-based Cropping Strategy} (ECS) evaluates a small set of candidate crops and selects the one with minimal entropy, preserving contiguous regions relevant to the prompt. At training, \textbf{Entropy Regularization Training} (ERT) augments next-token prediction with an entropy term that sharpens attention on key visual tokens while down-weighting irrelevant ones. Experiments on ten VQA benchmarks show that ENCORE, fine-tuning only 0.14\% of parameters, achieves an average 1.43\% accuracy gain and state-of-the-art performance among recent 2B-parameter VLMs. Our code is released in this https URL.

59. 【2608.22972】Optimize Surgical Triplet Recognition: A Knowledge-Driven Mixture-of-Experts Solution

链接：https://arxiv.org/abs/2608.22972

作者：Yiyi Zhang,Yuchen Yuan,Ying Zheng,Jialun Pei,Jinpeng Li,Zheng Li,Pheng-Ann Heng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：action triplet recognition, context-aware robot-assisted surgery, triplet recognition constitutes, automatic surgical action, Surgical action triplet

备注： Accepted in TMI

点击查看摘要

Abstract:Surgical action triplet recognition constitutes a critical task in context-aware robot-assisted surgery, facilitating automatic surgical action perception by identifying instrument, verb, target, and their association. However, existing works struggle to analyze such complex surgical scenes due to three main issues: (1) component-level optimization conflicts caused by entangled feature spaces, (2) category-level optimization conflicts arising from severe data imbalance, and (3) lack of domain knowledge guidance that limits model interpretability and robustness. To address these challenges, we propose a Mixture-of-Experts-guided Co-Optimization (\textit{MoeCo}) framework powered by knowledge-driven learning. Within the co-optimization pipeline, to first mitigate component-level conflicts, we introduce a component-tailored adapter that disentangles task-specific features across spatial-temporal regimes, facilitating effective component specialization. Next, we develop a coordinated gradient learning strategy to handle category-level conflicts, which adaptively rebalances positive-negative gradients to enhance the perception of rare categories. Notably, inspired by surgical domain expertise, we introduce a knowledge-driven mixture-of-experts mechanism that dynamically integrates multimodal large language model-guided knowledge via activated experts, thereby enriching the co-optimization pipeline with more expressive and robust representations. Extensive experiments on the public CholecT45 and CholecT50 datasets confirm the effectiveness of the proposed co-optimization pipeline and the superiority of dynamic priors integration via the knowledge-driven mixture-of-experts mechanism.

60. 【2608.22971】ParallelWorld: Test-Time Scaling for Embodied Reasoning

链接：https://arxiv.org/abs/2608.22971

作者：Min Chen,Shengjun Zhang,Yuxin Li,Zhang Zhang,Xin Fei,Chong Xia,Yueqi Duan

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Embodied Reasoning constitutes, Embodied Reasoning, embodied intelligence, constitutes a fundamental, fundamental capability

备注： Project Page: [this https URL](https://chen-min-22.github.io/ParallelWorld-page/)

点击查看摘要

Abstract:Embodied Reasoning constitutes a fundamental capability of embodied intelligence, serving as the basis for autonomous perception, reasoning, and interaction within physical environments. Recent studies have shifted the paradigm of embodied reasoning from static perception toward dynamic exploration, where agents acquire task-relevant information through interactions with the environment. However, existing active reasoning approaches generally generate exploration trajectories incrementally without long-horizon planning. Even recently emerged test-time scaling frameworks often resort to myopic, single-step lookaheads, which struggle to resolve the delayed feedback inherent in complex, occluded spatial environments. To address this limitation, we propose ParallelWorld, a multi-horizon test-time scaling framework for embodied reasoning. Instead of greedy, single-step trials, ParallelWorld empowers agents to simulate and evaluate multi-step future trajectories in parallel before committing to an action. Specifically, we introduce a verifier-guided tree-search paradigm. Starting from the current state, ParallelWorld branches into multiple parallel trajectories and rolls them out continuously across a multi-step horizon. At each simulation step, a verifier agent evaluates the intermediate state transitions, dynamically pruning unpromising branches and prioritizing paths with the highest information gain. Once the multi-step prospective simulation is complete, the agent synthesizes the long-horizon outcomes to commit to the optimal action sequence. Finally, an answer agent performs reasoning over the selected trajectory to produce the final reasoning. Extensive experiments on ESI-Bench demonstrate that ParallelWorld consistently improves active perception and reasoning performance.

61. 【2608.22965】Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems

链接：https://arxiv.org/abs/2608.22965

作者：Nico Hessenthaler,Adam T. Müller,Nicolaj C. Stache

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：heterogeneous stereo systems, Accurate extrinsic calibration, frame-based cameras remains, Accurate extrinsic, bottleneck for heterogeneous

备注： Accepted to the 37th British Machine Vision Conference (BMVC) 2026

点击查看摘要

Abstract:Accurate extrinsic calibration between event-based and frame-based cameras remains a practical bottleneck for heterogeneous stereo systems. Existing approaches often require sensor or target motion, precise synchronization, or computationally expensive event-to-image reconstruction. We propose a simple, motion-free cross-modal calibration framework that uses a temporally modulated, blended ChArUco target presented on standard consumer displays. By alternating between the original pattern and a partially blended version, the target reliably triggers events while remaining continuously observable to a frame-based camera, avoiding blank frames and reducing synchronization constraints to a coarse, trigger-based alignment. We discretize events into frames coarsely aligned with the RGB images, apply lightweight denoising, and perform ChArUco-based intrinsic and stereo extrinsic calibration. Extensive experiments assess robustness to blending opacity, display brightness, external illumination, viewing angle, and handheld acquisition. Compared to the strongest motion-based reference (E2Calib + Kalibr) and a non-motion-based reference (Plasberg et al.), our approach reduces the mean reprojection error by $44\%$ and $6\%$, respectively, while substantially simplifying the calibration procedure. Finally, we demonstrate practical utility in a robotic eye-to-hand calibration case study, showing consistent transformations and stable downstream geometric measurements even under partial occlusions. Code is publicly available at this https URL.

62. 【2608.22959】WildHandBench: A Benchmark for Handwritten Text Understanding that Challenges MLLMs and Humans

链接：https://arxiv.org/abs/2608.22959

作者：Jun Zhang,Qiao Zhao,Cheng Cui,Jianying Qu,Zhongkai Sun,Jianwen Yang,Changda Zhou,ZhuoXin Liu,Shubin Han

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：remains largely uncharacterized, handle challenging handwritten, documents remains largely, challenging handwritten documents, handwritten documents remains

备注：

点击查看摘要

Abstract:While the top model on OmniDocBench now reaches 96.34% overall on printed-document parsing, the ability of current models to handle challenging handwritten documents remains largely uncharacterized. Existing benchmarks focus on isolated text or formulas, overlook handwritten tables and real-world degradation, and report aggregate accuracy without explaining why models fail. We present WildHandBench, a benchmark containing 500 handwritten documents across three structures (free text, tables, formulas), four languages, and nine real-world scenarios. We introduce a Prior-Driven Error (PDE) metric that quantifies whether errors originate from language priors rather than visual evidence. Evaluating 18 state-of-the-art models together with calibrated human baselines, we find: (1) the best model achieves only 71.85% overall; (2) humans outperform all models yet the gap is narrow (77.09% vs. 71.85%); and (3) model errors are qualitatively different from human errors -- 63-91% of model errors are prior-driven versus only 49% for humans, exposing systematic reliance on language priors that conventional accuracy metrics cannot capture.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2608.22959 [cs.CV]

(or
arXiv:2608.22959v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.22959

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

63. 【2608.22950】WADE: A Reasoning-Annotated Benchmark for Multi-Instance Floating-Waste Grounding with Compact Vision-Language Models

链接：https://arxiv.org/abs/2608.22950

作者：Md. Asaduzzaman Shuvo,Ahsan Farabi,Md. Abdul Ahad Minhaz,Mahedi Hasan,Israt Khandaker,Ibrahim Khalil Shanto,Muhammad Nomani Kabir

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：inland waterways threatens, waterways threatens aquatic, threatens aquatic ecosystems, requires timely monitoring, multi-object conditions

备注：

点击查看摘要

Abstract:Floating waste in inland waterways threatens aquatic ecosystems and requires timely monitoring under cluttered, multi-object conditions. Existing aquatic-waste datasets provide limited geographic coverage, sparse multi-instance annotations, and little supervision beyond boxes and labels. Compact vision-language models (VLMs) therefore remain insufficiently evaluated for jointly localizing, classifying, counting, and explaining floating waste. We introduce WADE, a reasoning-annotated benchmark containing 2,167 images from rural Bangladesh, 13,608 bounding boxes, and ten waste categories. Each annotation is associated with class-level recognition rules covering visual cues, likely confusions, and discriminative features. We evaluate six VLMs under zero-shot, two-shot, reasoning-guided, and fine-tuned settings using detection, counting, and hallucination metrics. For resource-efficient adaptation, we jointly fine-tune Qwen3-VL-2B on boxes, labels, and reasoning chains using QLoRA. Fine-tuning increases recall from 0.0248 to 0.2339 and F1 from 0.0257 to 0.2163, while reducing image-level hallucination from 0.6836 to 0.0883. However, over three-quarters of instances remain undetected, establishing WADE as a challenging benchmark for dense floating-waste grounding with compact VLMs.

64. 【2608.22937】Quality Inspection of Printed Circuit Board Pin Insertion via Semantic Segmentation and Board-Level Feature Extraction

链接：https://arxiv.org/abs/2608.22937

作者：Nils Rabeneck,André Kiunke,Nicole Hoess,Wolfgang Mauerer

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：reliable electronic products, ensuring reliable electronic, Quality control, printed circuit board, electronic products

备注：

点击查看摘要

Abstract:Quality control during printed circuit board (PCB) assembly is a critical step in ensuring reliable electronic products. Detecting misaligned pins during or after pin insertion remains a particularly challenging inspection task. This paper presents an automated defect detection method for identifying incorrectly inserted pins on PCBs. The proposed pipeline combines semantic segmentation using a U-Net architecture with contour-based feature extraction and logistic regression for board-level pass/fail classification. Segmentation masks are used to derive contour representations of individual pins, from which board-level features -such as average contour size- are extracted and used to train a logistic regression classifier. We evaluate the method on two datasets: an industrial collection of real-world PCB images, and a publicly available PCB pin-inspection dataset with substantially different visual characteristics. To assess the effectiveness of the proposed approach, a comparison against PatchCore, an anomaly detection technique new to be applied to pin inspection, as well as instance segmentation-based pin detection is made. The developed method achieved Area Under the Receiver Operating Characteristic Curve (ROC-AUC) values of 0.990 on a random test set split from the industrial data and 1.000 on the public dataset indicating strong separation between pass and fail boards. The results indicate that the proposed approach is a promising candidate for automated pin inspection in industrial environments and achieves strong performance on datasets with substantially different visual characteristics after dataset-specific training.

65. 【2608.22926】Motion-Based Tokenization for Cross-Dataset Egocentric Gaze Modeling

链接：https://arxiv.org/abs/2608.22926

作者：Virmarie Maquiling,Zhuojiang Cai,Enkelejda Kasneci

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：input signal, signal for vision, vision and multimodal, consensus exists, multimodal models

备注： 8 pages, 1 figure, 1 table

点击查看摘要

Abstract:Gaze is increasingly used as an input signal for vision and multimodal models, yet no consensus exists on how to represent it across datasets. Raw traces preserve detail but are noisy and device-dependent, while coarse event labels are easy to model but can discard local motion structure. We formulate event-aligned, fixed-horizon angular displacement as an interpretable, event-conditioned motion vocabulary and compare it with event-only, spatial, absolute-angle, learned vector-quantized, and continuous representations. To assess transfer alongside target predictability and token collapse, our evaluation combines next-token prediction with target-domain regret, low-order target references, paired bootstrap, order sensitivity, motif overlap, and frozen structural probes. In an event-aligned headset benchmark, angular-motion tokens have lower target-domain regret than frozen-codebook VQ tokens in one transfer direction, while the reverse direction is inconclusive. The probes reveal complementary representation properties, and event-only tokens show that low perplexity can retain little motion information. On a third egocentric dataset, a matched comparison of I-VT, native, and frame-span interfaces shows that event construction materially changes transfer: native events have the lowest regret into EGTEA, while frame-span events have zero motif overlap and fail severely as a source. Motion-based tokenization therefore provides a compact representation for event-aligned egocentric gaze streams, while the evaluation identifies how target predictability and event construction shape cross-dataset conclusions.

66. 【2608.22914】Results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in Conjunction with CVPR 2026

链接：https://arxiv.org/abs/2608.22914

作者：Luca Rossetto,Werner Bailer,Cathal Gurrin,Graham Healy,Omar Shahbaz Khan,Stevan Rudinac,Klaus Schöffmann,Allie Tran

类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：Asynchronous CASTLE Challenge, Joint Egocentric Vision, Egocentric Vision Workshop, Asynchronous CASTLE, CASTLE Challenge

备注：

点击查看摘要

Abstract:This report summarizes the contributions and results of the 1st Asynchronous CASTLE Challenge at the Joint Egocentric Vision Workshop in conjunction with CVPR 2026.

67. 【2608.22906】AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction

链接：https://arxiv.org/abs/2608.22906

作者：Yingxiang Xu,Kerui Ren,Wenqi Guo,Changjian Jiang,Tao Lu,Linning Xu,Mulin Yu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：balancing reconstruction quality, monocular Gaussian Splatting, Gaussian Splatting streaming, achieved impressive performance, Gaussian Splatting

备注： Preprint

点击查看摘要

Abstract:Recent monocular 3D Gaussian Splatting (3DGS) streaming reconstruction methods have achieved impressive performance by balancing reconstruction quality and efficiency. However, extending these frameworks to underwater scenes remains challenging due to severe visual degradation, such as light attenuation and scattering, which degrades camera pose tracking and distorts scene geometry. To address these challenges, we propose AquaFlow, a monocular Gaussian Splatting streaming reconstruction framework for efficient and high-fidelity underwater reconstruction. Specifically, AquaFlow fine-tunes a 3D vision foundation model on large-scale underwater data for robust pose and pointmap estimation, and introduces a medium-guided incremental Gaussian initialization strategy for streaming mapping. Furthermore, we develop a streaming-compatible hybrid scene representation that integrates structured, distance-conditioned neural Gaussians with a physics-inspired optical model to compensate for underwater image formation effects, enabling accurate scene reconstruction. We evaluate AquaFlow on a comprehensive dataset of 62 diverse underwater trajectories, collected from both public benchmarks and in-the-wild web videos across various scales. Extensive experiments demonstrate that AquaFlow achieves state-of-the-art tracking and rendering performance, reducing average localization error by 13.2% and improving PSNR by 4.74 dB compared to WaterSplat-SLAM.

68. 【2608.22888】NemoSplat: Feed-Forward 4D Gaussian Splatting for Media-Aware Underwater Reconstruction

链接：https://arxiv.org/abs/2608.22888

作者：Xiaopeng Guo,Wai Chung Tse,Yipeng Zhu,Hanwen Zhang,Huajian Huang,Sai-Kit Yeung

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：environments remains challenging, remains challenging due, media-induced light scattering, Reconstructing photorealistic scenes, Reconstructing photorealistic

备注： 10 pages

点击查看摘要

Abstract:Reconstructing photorealistic scenes in unconstrained underwater environments remains challenging due to severe media-induced light scattering and unpredictable dynamic objects. Recent feed-forward visual foundation models have demonstrated remarkable capabilities in generalized novel view synthesis and tracking. However, when directly applied to aquatic videos, optical attenuation and motion interference fatally corrupt their feature aggregation, leading to severe tracking and reconstruction failures. To overcome these limitations, we present NemoSplat, the first feed-forward 4D Gaussian Splatting framework tailored for media-aware dynamic reconstruction directly from uncalibrated marine videos. Beyond providing robust estimations of camera poses and dense scene depth, we devise a Promptable Dynamic Disentangler that utilizes a confidence-aware fusion strategy of learned dynamic probabilities and optional semantic text priors, effectively isolating massive transient entities. Furthermore, to counteract visual degradation, a Media-Aware Gaussian Predictor is formulated to jointly estimate intrinsic 3D Gaussian attributes alongside physical media parameters, rendering pristine scene appearance in a single forward pass. Additionally, we introduce a large-scale underwater dataset with massive dynamic elements to facilitate training and evaluation. Extensive experiments on our dataset demonstrate that NemoSplat achieves state-of-the-art tracking accuracy and high-fidelity rendering. Homepage: this https URL

69. 【2608.22885】DRAgent: Discriminative Reasoning Agent for Referring Expression Segmentation

链接：https://arxiv.org/abs/2608.22885

作者：Yujie Qi,Luyan Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Referring Expression Segmentation, Referring Expression, language expression, Expression Segmentation, Expression

备注： 5 pages, 3 figures, 4 tables

点击查看摘要

Abstract:Referring Expression Segmentation (RES) aims to generate a pixel-level mask for the object specified by a language expression. Recent methods based on multimodal large language models (MLLMs) often rely on one-pass coordinate prediction for visual localization, which serializes continuous spatial locations as discrete text tokens and may lead to localization bias and alignment errors. To address these issues, we propose DRAgent, an MLLM-driven discriminative reasoning (DR) framework for RES. Instead of requiring the MLLM to generate localization coordinates, DRAgent first constructs a detector-generated candidate space and then uses the MLLM as a visual-semantic target discriminator. Specifically, the MLLM performs reliable target selection among potential distractors through a two-stage DR mechanism, which first screens high-recall candidates and then performs instance-wise verification. The selected target box is subsequently used as a spatial prompt for a foundation segmentation model to produce the final pixel-level mask. Furthermore, we construct a self-consistency-filtered reasoning-chain data pipeline for LoRA-based fine-tuning, providing more reliable supervision for enhancing the MLLM's discriminative reasoning capability. Experiments demonstrate that DRAgent achieves competitive performance on RefCOCO, RefCOCO+, and RefCOCOg.

70. 【2608.22883】FOVEA: Focused On-Demand Visual Evidence Adaptation for Cache-Friendly Multimodal Speculative Decoding

链接：https://arxiv.org/abs/2608.22883

作者：Hengjie Zhu,Dayan Wu,Zihao Zhang,Xinze Liu,Jingxuan Yu,Peng Fu,Zheng Lin,Weiping Wang,Ding Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：larger target model, accelerates vision-language models, speculative decoding accelerates, target model, lightweight draft model

备注：

点击查看摘要

Abstract:Multimodal speculative decoding accelerates vision-language models by allowing a lightweight draft model to propose candidate tokens for parallel verification by a larger target model. Existing methods typically condition the drafter on a fixed visual interface, such as a predefined visual-token budget or a static compressed representation. However, our controlled visual-budget analysis shows that visual demand varies substantially across tasks and decoding stages, which means more visual input is not always beneficial. Actually, insufficient evidence may weaken visual grounding, while excessive context adds overhead and may disrupt drafting. We propose FOVEA (Focused On-demand Visual Evidence Adaptation), a cache-friendly approach that builds a reusable visual memory and dynamically retrieves a bounded subset for a draft state. A cumulative-mass rule determines both how many and which entries are selected. The selected entries are aggregated into a visual readout and fused with the current draft hidden state through a lightweight gated residual correction. Rather than inserting visual tokens into the autoregressive context, the correction modifies only the representation passed to the language-model head. Experiments across multiple vision-language backbones and multimodal benchmarks show that FOVEA improves draft acceptance and end-to-end decoding speed, achieving up to $2.13\times$ speedup over autoregressive decoding. These results demonstrate that state-conditioned evidence retrieval is an effective alternative to reusing a fixed visual representation throughout multimodal generation.

71. 【2608.22879】Large-Small Model Collaboration for Zero-Shot Surgical Phase Recognition

链接：https://arxiv.org/abs/2608.22879

作者：Yiyi Zhang,Ying Zheng,Wenxin Fan,Yu Zhu,Yuchen Yuan,Litao Zhao,Zheng Li,Pheng-Ann Heng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Task-specific lightweight models, Task-specific lightweight, excel at capturing, generalize poorly, surgical phase recognition

备注： MICCAI 2026 Early Accept

点击查看摘要

Abstract:Task-specific lightweight models for surgical phase recognition excel at capturing temporal dynamics but generalize poorly under domain shift. Conversely, surgical foundation models (FMs) offer superior transferability via large-scale pretraining, yet their lack of explicit temporal modeling often yields temporally inconsistent predictions, leading to degraded performance. To exploit the complementary strengths of both paradigms, we propose \textbf{La}rge-\textbf{S}mall \textbf{T}emporal adaptation (\textbf{LaST}), a novel large-small collaborative framework that enables zero-shot adaptation to unseen clinical domains. In LaST, the FM initiates the pipeline by generating frame-level phase priors that serve as initial weak supervision. To effectively utilize these noisy phase priors, we introduce an iterative temporal refinement scheme that integrates dynamic quality control to filter reliable predictions and dual-model cross-learning to mitigate confirmation bias. Simultaneously, the lightweight model leverages its intrinsic temporal modeling ability to progressively correct inconsistent predictions and enhance overall accuracy across iterations. At the end, a cycle replay strategy is employed to close the loop: the refined, more accurate predictions are utilized as upgraded supervision signals for the subsequent iterations, fostering a self-reinforcing evolution of both label quality and model capability. Extensive experiments demonstrate that LaST achieves robust adaptation to unseen domains for zero-shot surgical phase recognition, outperforming the baseline (PeskaVLP) by 24.85\%-43.17\% in accuracy and even surpassing fully supervised linear probing and several state-of-the-art few-shot approaches. Codes will be released at this https URL.

72. 【2608.22874】Stochastic Separability of Embedding Manifolds

链接：https://arxiv.org/abs/2608.22874

作者：Liqing Zhang

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：Neurobiological studies, embedding manifolds, Toggle, neural spaces exhibit, exhibit low-dimensional object

备注：

点击查看摘要

Abstract:Neurobiological studies and representation learning have observed that representations of objects belonging to the same category in high-dimensional neural spaces exhibit low-dimensional object manifold characteristics, and different object manifolds are linearly separable in these neural spaces. However, these experimentally observed phenomena lack rigorous theoretical validation to date. This paper proposes a new stochastic separability theorem for embedding manifolds of two different object categories. First, we establish a projection measure concentration theorem for embedding manifolds under general conditions. We develop a new two-layer measure concentration analysis technique, which unifies two estimation bounds via the law of total expectation to derive measure concentration inequalities. Based on the measure concentration theorem, we further prove a stochastic separability theorem for embedding manifolds of two different object categories. If two datasets have distinct means and bounded total variances, their samples become linearly separable with high probability, provided that the projection direction satisfies a non-singularity condition. The main contributions of this paper are twofold: 1. We prove the projection concentration properties of embedding manifolds in high-dimensional spaces by using two-lawyer tail-bound inequalities. 2. We identify a non-singularity condition for the stochastic separability between embedding manifolds, and rigorously prove the stochastic projection separability theorem. The theorem not only uncovers geometric and statistical properties of the object embedding manifolds, but also provides a novel mechanism for representation learning in deep networks.

Subjects:

Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.22874 [cs.LG]

(or
arXiv:2608.22874v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2608.22874

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Liqing Zhang [view email] [v1]
Mon, 24 Aug 2026 07:01:00 UTC (56 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled Stochastic Separability of Embedding Manifolds, by Liqing ZhangView PDFHTML (experimental)TeX Source

view license

Current browse context:
cs.LG

|
next

new
|
recent
| 2026-08

Change to browse by:

cs
cs.CV

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

IArxiv recommender toggle

IArxiv Recommender
(What is IArxiv?)

Author
Venue
Institution
Topic

    About arXivLabs

Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)

mathjaxToggle();

    We gratefully acknowledge support from
    our major funders,
    member institutions, ,
    and all contributors.

About

Help

Contact

Privacy

Accessibility

Operational Status (opens in new tab)

Major funding support from

73. 【2608.22869】UniMem: Unifying Multimodal Memory and Control for Vision-Language-Action Models

链接：https://arxiv.org/abs/2608.22869

作者：Lars Osterberg,Maggie Wang,Mac Schwager

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：leveraged internet-scale pretraining, achieve strong performance, models have leveraged, leveraged internet-scale, internet-scale pretraining

备注：

点击查看摘要

Abstract:While Vision-Language-Action (VLA) models have leveraged internet-scale pretraining and task-focused finetuning to achieve strong performance on long-horizon tasks, they often struggle with non-Markovian tasks that require memory. Existing approaches to memory typically involve additional Vision-Language-Models (VLMs) for long-term memory management, introducing a memory bottleneck and a fractured training pipeline. Conditioning on multiple historical frames can provide the VLA with access to more descriptive features of past scenes, but can degrade performance if frames are chosen at arbitrary, fixed intervals. To address these limitations, we present UniMem, a framework that unifies high-level, multimodal memory and low-level control under one backbone. UniMem employs an event classifier for memory updates, a keyframe encoder for dense spatial memory, and a keyframe caching technique to minimize overhead during policy rollouts. We evaluate UniMem across five simulation and four hardware tasks targeting sequential and spatial memory, demonstrating that our unified, single-model system outperforms fixed-interval image sampling baselines (93.4% vs. 68.2%) in simulation and hierarchical baselines (80.0% vs. 43.5%) in hardware, while offering faster inference and a simple training pipeline for easy adoption. Project website: this https URL

74. 【2608.22866】oward Sub-1 kB Identity-Preserving Face Compression: A Benchmark of Codecs, a Custom Learned Codec, and Studies of Resolution, Demographic Fairness, Recompression, and Adversarial Robustness

链接：https://arxiv.org/abs/2608.22866

作者：Petr Hurtik,Jakub Sochor

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Storing face images, Storing face, smart-card biometrics, biometrics and bandwidth-constrained, signal while keeping

备注：

点击查看摘要

Abstract:Storing face images under a hard sub-kilobyte budget, as required for identity documents, smart-card biometrics and bandwidth-constrained verification, forces a codec to discard most of the signal while keeping what a face matcher actually reads: identity. Generic codecs optimize pixel fidelity, not the embedding distances that drive verification, so which codec, resolution and setting best preserve identity at 1024 bytes or less, and how that degrades at 512, is unclear. We benchmark ten general and face-specific codecs across resolutions, byte budgets, two datasets (controlled Color FERET, in-the-wild AI-Solutions-KK) and four anchor face matchers, with a fourteen-model ViT and CNN roster confirming the ranking is backbone-invariant. We then train a custom identity-preserving codec that hits the byte budget exactly via binary search over a frozen gain table, and run four studies: resolution, demographic fairness, recompression, and no-box adversarial robustness. Sub-kilobyte identity preservation is feasible, but which codec to deploy depends entirely on the budget. At 1024 bytes and the 112 px working resolution the problem is close to solved: modern codecs hold Color FERET equal-error rate under 0.35 percent on the ArcFace anchor. At 512 bytes the field re-sorts: AVIF, HEIF, JPEG XL and legacy JPEG collapse to 28 to 98 percent false-non-match rate at FMR 1e-4, while WebP, JPEG-AI and our byte-budgeted learned codecs stay out of that band, with 24.3 percent for WebP against 6.9 percent for our accurate variant in the wild. That re-sort, not the 1024-byte ranking, is the operational result: a codec chosen at 1 kB is not the codec to deploy at half that.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.22866 [cs.CV]

(or
arXiv:2608.22866v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.22866

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

75. 【2608.22861】Following Motion for Sequential Modeling in Video Frame Interpolation

链接：https://arxiv.org/abs/2608.22861

作者：Jaehyun Park,Nam Ik Cho

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Video Frame Interpolation, capture long-range dependencies, Frame Interpolation, Video Frame, linear computational complexity

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:State Space Models (SSMs) have surfaced as a promising architecture in Video Frame Interpolation (VFI), as they can capture long-range dependencies with linear computational complexity. However, their predefined scanning order limits their effectiveness in modeling the dynamic motion trajectories inherent in VFI problems. To tackle this challenge, we propose Motion-Guided Mamba for Video Frame Interpolation (MGMVFI), an adaptation of the selective state space model tailored explicitly for VFI. MGMVFI introduces Motion-Guided Serialization (MGS), which leverages optical flow to define a motion-adaptive 1D input order for the SSM. This aligns the causal state updates with semantically related tokens, enabling motion-consistent feature propagation, particularly for large and dynamic motions. Additionally, to mitigate the unreliable feature representations caused by inaccurate optical flow estimates, we introduce contextual synthesis that utilizes the surrounding spatial context for robust inter-frame feature synthesis. These components are seamlessly integrated within our tailored Mamba architecture, which also employs a lightweight refinement block to enhance local detail reconstruction at a reduced computational cost. Extensive experiments on standard VFI benchmarks demonstrate that MGMVFI achievesstate-of-the-artperformance,particularly on complex and dynamic motions, thereby establishing a new direction for sequence modeling in video interpolation.

76. 【2608.22858】Mapping the Concept Landscape: Structural Perception of Global Distributions for Transparent Data Pruning

链接：https://arxiv.org/abs/2608.22858

作者：Dongyue Wu,Tao Ma

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：Existing data pruning, measure sample importance, high-dimensional feature embeddings, Existing data, methods predominantly rely

备注： ECCV 2026

点击查看摘要

Abstract:Existing data pruning methods predominantly rely on high-dimensional feature embeddings to measure sample importance. However, these compressed vectors often obscure fine-grained semantic interactions, leading to suboptimal coverage of rare semantic concepts in the pruned subsets. In this paper, we propose Mapping the Concept Landscape (MCL), a novel structural perception framework for transparent data pruning. Instead of abstract embeddings, we represent each image-caption pair as an explicit sample-level graph comprising entities, events, and attributes. By integrating these individual graphs into a comprehensive dataset-level graph, we characterize the global distribution of semantic concepts and quantify their rarity across the entire corpus. Based on this structured perception, we develop a greedy concept-coverage maximization algorithm that iteratively selects samples to maximize the marginal gain of high-value, under-represented concepts. Experimental results on various benchmarks demonstrate that our method not only achieves superior pruning efficiency compared to state-of-the-art methods but also provides a transparent and interpretable audit trail for the selection process.

77. 【2608.22828】VeCAS: Vessel-Focused Contrast-Free Angiogram Synthesis for Vascular Interventions

链接：https://arxiv.org/abs/2608.22828

作者：De-Xing Huang,Chen-Yu Wang,Hao Liang,Xiao-Hu Zhou,Mei-Jiang Gui,Tian-Yu Xiang,Qin-Yi Zhang,Chen Wang,Xiao-Liang Xie,Shi-Qi Liu,Ming-Yuan Liu,Zhen-Chang Wang,Zeng-Guang Hou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：X-ray angiography relies, X-ray, non-contrast X-ray images, X-ray angiography, angiography relies

备注： 10 pages, 8 figures, 5 tabels, supplementary material: [this https URL](https://dxhuang-casia.github.io/data/vecas_supplementary_material.pdf)

点击查看摘要

Abstract:X-ray angiography relies on iodinated contrast agents to visualize vascular structures during image-guided interventions. However, contrast administration carries risks of adverse events, motivating the development of contrast-free alternatives. Generating X-ray angiograms directly from non-contrast X-ray images offers a potential solution, but existing approaches remain limited by (i) insufficient control over vascular localization and (ii) inefficient modeling of redundant background content. To address these challenges, we propose VeCAS, a two-stage vessel-focused contrast-free angiogram synthesis framework that separates vascular structure localization from angiographic appearance synthesis. In Stage I, a discriminative model localizes vascular structures in non-contrast X-ray images, while cross-modality latent distillation transfers vessel-sensitive knowledge from X-ray angiograms during training. In Stage II, a vessel-focused inpainting model synthesizes angiographic appearance within the localized vascular regions while preserving the non-vascular background. Experiments on an in-house lower-limb vascular intervention dataset show that VeCAS outperforms the comparison methods in terms of vascular structural fidelity and image quality. Visual Turing tests and physician assessments indicate the perceptual realism of the synthesized angiograms. In addition, robotic guidewire navigation experiments in vascular phantoms show that VeCAS guidance reduces the time to target by 41.4% and the number of operation steps by 40.7% compared with non-contrast guidance. Together, these results suggest the potential of VeCAS to serve as ``meta contrast agent'' for vascular interventions.

78. 【2608.22821】SiZeUp: Fast 3D Proxy from Aerial Images via Depth Ordinal Loss

链接：https://arxiv.org/abs/2608.22821

作者：Wenjun Zhou,Yunshan Li,Qiaoyu Zhu,Weidan Xiong,Hao Zhang,Daniel Cohen-Or,Hui Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：oblique aerial imagery, calibrated oblique aerial, present SiZeUp, aerial imagery, fast and scalable

备注： Accepted to SIGGRAPH Asia 2026 Conference Papers

点击查看摘要

Abstract:We present SiZeUp, a fast and scalable approach for constructing large-scale 3D urban proxy models directly from calibrated oblique aerial imagery. Our method adopts a height-from-footprint representation, reducing 3D building abstraction to a low-dimensional optimization problem in which building footprints are extruded by a single height parameter. To enable efficient and robust height estimation, we introduce an ordinal depth consistency loss that enforces agreement between the relative depth ordering of rendered proxies and depth priors predicted by a monocular depth model. This is realized through a differentiable renderer that maps parametric building proxies into multi-view depth images, allowing gradients to be propagated from depth supervision to building heights. Our ordinal formulation produces stable optimization in practice and avoids explicit feature matching or dense point cloud reconstruction. Rather than relying on metric depth, which can be unreliable under monocular scale ambiguity, our ordinal depth consistency loss operates on relative depths, providing a more reliable signal across views. Combined with an efficient dynamic view selection, our approach achieves a 23-52$\times$ speedup over state-of-the-art proxy reconstruction pipelines while maintaining comparable proxy-level coverage and volume consistency, making it well suited for large-scale urban modeling tasks.

79. 【2608.22819】Direct, Parallel, or Sequential? A Comparative Study of Training-Free Multi-Subject Image-to-Video Generation

链接：https://arxiv.org/abs/2608.22819

作者：Yanliang Qi,Kexi Chen,Muchao Ye,Haomiao Ni

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：subjects remains challenging, multiple subjects remains, advanced rapidly, remains challenging, generation

备注： ACM Multimedia Workshop 2026

点击查看摘要

Abstract:Text-conditioned image-to-video (I2V) generation has advanced rapidly, yet generating videos with multiple subjects remains challenging. A model must simultaneously preserve the appearance of each subject, assign distinct motions, and maintain coherent spatial and temporal interactions. This paper presents a systematic study of three representative paradigms for training-free multi-subject I2V generation: direct, parallel, and sequential generation. Direct generation applies a pretrained I2V model to the complete reference image and prompt, requiring all subjects and motions to be synthesized jointly. Parallel and sequential generation instead decompose the reference image and prompt into subject-specific visual and textual conditions. Parallel generation synthesizes each subject independently and subsequently composes the resulting videos, reducing the complexity of each generation step at the cost of weaker inter-subject context. Sequential generation first synthesizes a background video and then progressively introduces individual subjects. This preserves accumulated scene context but introduces sensitivity to subject ordering and error propagation. We empirically evaluate the three paradigms across diverse multi-subject scenes, comparing appearance preservation, motion fidelity, temporal consistency, and inter-subject coherence, while also characterizing their distinct failure modes. Our findings reveal the strengths and limitations of each paradigm and offer practical insights for designing controllable multi-subject video generation systems.

80. 【2608.22799】Reproducible Vision-Guided 6-DoF Robotic Manipulator with a Mixed Stepper-Driver Architecture and Browser-Native Control

链接：https://arxiv.org/abs/2608.22799

作者：Lasan Perera,Deneth Priyadarshana,Dulana Pitiwaduge,Isitha Dinujaya,Mokshan Colambage

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)

关键词：robotic manipulator built, undergraduate engineering team, debugging experience needed, Web Serial API, robotic manipulator

备注： 13 pages, 16 figures, 7 tables. Design files and firmware: [this https URL](https://github.com/Lasan-Perera/6-dof-arm-neuralnexus)

点击查看摘要

Abstract:We present the NeuralNexus Arm, an open, low-cost 6-DOF robotic manipulator built by an undergraduate engineering team, together with the design decisions and debugging experience needed to reproduce it. The arm is driven by a single STM32H743 microcontroller on a custom printed circuit board (PCB) and combines two stepper-driver strategies on one controller: push-pull 3.3 V step/direction outputs for onboard TMC2209 drivers on the three wrist joints, and open-drain outputs for external CL57T and DM542 drivers on the three high-torque proximal joints. We describe the mechanical design, mixed-driver electronics, interrupt-driven firmware, a MATLAB/Simscape-based inverse-kinematics pipeline, a browser-native control interface using the Web Serial API, and a lightweight vision pipeline for object localisation and autonomous pick-and-place tasks. We also document non-obvious hardware and firmware failure modes encountered during the transition from a development board to the custom PCB as reproducibility guidance. All design files and firmware are released openly. The platform actuates all six axes under coordinated control at a 2 kHz update rate and executes both manual and pre-recorded motions from the browser interface.

81. 【2608.22795】VersaDB: A High-Performance AI Storage Database for Unifying Mutimodal Datasets

链接：https://arxiv.org/abs/2608.22795

作者：Cong Wang,Zelin Liu,Yang Luo Ran Zhang,Zhijian Guo,Hui Zhang,Fan Yu,Yanfei Cao,Naijie Gu,Jun Yu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：rapidly developing, large number, data, data storage formats, storage formats

备注：

点击查看摘要

Abstract:The AI field has been rapidly developing, leading to the emergence of a large number of AI training datasets of various types. These datasets contain different modalities, including text, images, audio, etc., and may come in various data storage formats. With the advancement of AI hardware, AI computation units like GPUs, TPUs, and NPUs can greatly accelerate the training speed of AI models, which in turn increases the demand for faster data processing. When using existing AI processing frameworks to handle datasets with different modalities and storage formats, processing speeds may be suboptimal due to issues such as data layout and the way users handle the data. Therefore, using a unified database to store multiple data formats can better manage and optimize data access. In this paper, we introduce VersaDB, a database designed specifically for AI datasets with various modalities. We implemented a page-based storage system, separating structured and unstructured data. Additionally, we generated B+ tree-based index files to accelerate data access. VersaDB supports automatic sharding and maintains a hierarchical metadata management system, with corresponding metadata maintained at the page, shard, and global levels, forming the foundation for the efficient operation of the database. We also focused on ease of use by providing APIs for directly converting datasets into VersaDB, as well as APIs for converting popular AI data storage formats (e.g., CSV, TFRecord, .bin) into this http URL experiments show that using VersaDB can achieve up to 5.35x acceleration and maintain consistent performance across different parallelism levels.

82. 【2608.22789】GuidedFlow: An Attention-Guided Framework for Anomaly Detection in Additive Manufacturing

链接：https://arxiv.org/abs/2608.22789

作者：Sosmita Paul,Krishna Roy

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Additive Manufacturing, ongoing industrial revolution, plays a vital, vital role, Additive

备注：

点击查看摘要

Abstract:Additive Manufacturing (AM) plays a vital role in the ongoing industrial revolution. However, quality control remains crucial and challenging due to printing defects or potential cyber-physical intrusions. Image or video-based anomaly detection is a key effort towards addressing these challenges. Various approaches have been explored in this domain, including reconstruction-based, embedding-based, and flow-based methods. Though normalizing flow-based methods address some of the core challenges of unforeseen defects and generalization while maintaining detection performance, existing approaches struggle with tiny/stringing defects common in 3D printing. In a small-data setting, this poses a limitation in generalization. To address these limitations, we propose \textbf{GuidedFlow}, a novel attention-guided normalizing flow model for anomaly detection and localization. GuidedFlow employs a pre-trained ResNet model, fine-tuned on the domain dataset. An attention-guided spatial and temporal flow framework models the dynamics across multiple scales and frames. A Spatio-Temporal Attention Network (SAN) enables the flow model to prioritize relevant contextual cues from input frames. We evaluate GuidedFlow on our AM3D-AD dataset, consisting of benign and anomalous real 3D printed object images and videos. We also conduct a comparative study using the MVTec-AD industrial image anomaly detection dataset. Experimental results demonstrate that GuidedFlow outperforms most of the state-of-the-art models with enhanced detection accuracy and AUROC.

83. 【2608.22785】OmicSync: Reliability-Aware Spatial Multi-Omics Clustering with Evidence-Constrained LLM Reasoning

链接：https://arxiv.org/abs/2608.22785

作者：Rabeya Tus Sadia,Qiang Ye,Qiang Cheng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：profile gene expression, technologies jointly profile, jointly profile gene, indicating assignment reliability, multi-omics technologies jointly

备注：

点击查看摘要

Abstract:Spatial multi-omics technologies jointly profile gene expression, surface proteins, and histology at each tissue spot, yet most spatial domain discovery methods provide only cluster assignments, without indicating assignment reliability, modality contributions, or why a domain decision should be trusted. We present OmicSync, a reliability-aware spatial multi-omics framework that couples unsupervised domain clustering with evidence-constrained LLM reasoning using model-derived per-spot signals, including assignment confidence, epistemic routing uncertainty, and modality-routing weights. These signals are converted into structured evidence dictionaries and used to generate standard, stepwise, counterfactual, contrastive, and uncertainty-focused explanations. OmicSync integrates a KAN-GCN backbone with spatial encoding, cross-modal fusion, uncertainty-aware routing, cell-type supervision, and missing-modality imputation. We further introduce OmicSync-R, which closes the reasoning-clustering loop by using automatically computed reasoning-quality scores as REINFORCE rewards, allowing reasoning coherence to shape the latent structure without backpropagating through the language model. Across four 10x CytAssist FFPE spatial proteomics benchmarks, OmicSync achieves the best average rank on Human Tonsil (1.44), Glioblastoma (1.78), and Tonsil Add-on (1.22), and second-best on Human Breast Cancer (2.33). OmicSync-R further improves ARI on Human Breast Cancer from 45.73 to 46.72 and outperforms existing methods on six of nine clustering metrics. Together, OmicSync and OmicSync-R enable reliability-aware, spot-level auditable spatial domain discovery guided by evidence-constrained reasoning.

84. 【2608.22782】Neural Operator based Multi-Field Reconstruction of Inner Solar Boundary State

链接：https://arxiv.org/abs/2608.22782

作者：Vignesh Kumar Pandian Sathia,Reza Mansouri,Dustin J. Kempton,Pete Riley,Rafal A. Angryk

类目：Machine Learning (cs.LG); Instrumentation and Methods for Astrophysics (astro-ph.IM); Solar and Stellar Astrophysics (astro-ph.SR); Computer Vision and Pattern Recognition (cs.CV)

关键词：charged particles emanating, interacting magnetohydrodynamic processes, governed by complex, continuous flow, flow of charged

备注： 8 pages, 4 figures, preprint, accepted at International Conference on Machind Learning and Applications

点击查看摘要

Abstract:The Solar wind is a continuous flow of charged particles emanating from the solar surface and governed by complex, interacting magnetohydrodynamic processes. Accurate specification of inner-boundary conditions is essential for heliospheric modeling and solar-wind prediction. In many practical applications, only a subset of interacting multi-field variables is directly available, but for a comprehensive view of solar wind prediction and downstream magnetohydrodynamic simulations, a more complete boundary state is required. In this work, we study the problem of learning the multi-field multi-scale solar magnetohydrodynamic state at 30 solar radii ($R_\odot$) using operator learning. Specifically, given the radial velocity and radial magnetic field, we aim to reconstruct the non-radial velocity and magnetic field components, radial and non-radial current density, thermodynamic density, and pressure components. This mapping is highly nonlinear, spatially coupled, and multi-scale, making it a challenging task for data-driven scientific machine learning. To address this problem, we employ a Local Neural Operator (LocalNO) that learns mappings between input and output function spaces while retaining locality and resolution-awareness. Unlike conventional regression models and autoencoder models, neural operators are better suited for learning structured field-to-field transformations arising from physical systems. The resulting predictions along with inputs are intended to serve as boundary condition variables for future inner-heliospheric modeling pipelines.

Comments:
8 pages, 4 figures, preprint, accepted at International Conference on Machind Learning and Applications

Subjects:

Machine Learning (cs.LG); Instrumentation and Methods for Astrophysics (astro-ph.IM); Solar and Stellar Astrophysics (astro-ph.SR); Computer Vision and Pattern Recognition (cs.CV)

ACMclasses:
J.2; I.5.4

Cite as:
arXiv:2608.22782 [cs.LG]

(or
arXiv:2608.22782v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2608.22782

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

85. 【2608.22780】Can We Perform Online RL for Image Editing without Editing Rewards?

链接：https://arxiv.org/abs/2608.22780

作者：Qichao Ma,Jikang Cheng,Ling Liang,Zhaofei Yu,Tiejun Huang,Renye Yan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：complex task-dependent calibration, costly triplet supervision, Reinforcement learning, enables direct preference, image editing

备注：

点击查看摘要

Abstract:Reinforcement learning (RL) enables direct preference optimization for image editing through editing-specific rewards, which remain less developed due to costly triplet supervision and complex task-dependent calibration. In contrast, text-to-image (T2I) generation benefits from a mature and diverse reward ecosystem spanning semantic alignment, aesthetics, realism, glyph shape, and other visual preferences. Extending this ecosystem to image editing would substantially broaden the range of visual preferences accessible to RL-based optimization, prompting the central question: \emph{Can We Perform Image Editing RL without Editing Rewards?} In this paper, we argue that the standard image editing dimensions have potential to be mapped to the T2I reward space: image quality can transfer directly, prompt following can be aligned through a description of the desired visual state, and reference consistency admits a coarse semantic conversion by encoding the source content to preserve. However, editing instructions specify relative changes, whereas T2I rewards require self-contained target descriptions; moreover, semantically valid captions from generic vision-language models may be incompatible with the frozen reward. Hence, we further introduce Lever-Edit, a two-stage framework that learns a reward-aligned captioner for counterfactual target descriptions, freezes it, and optimizes the editing policy solely with the transferred T2I reward. Experiments show competitive editing alignment and source preservation against editing-reward-based fine-tuning, while outperforming intuitive transfer baselines.

86. 【2608.22773】LagrangeGS: Non-Conservative Lagrangian System on Dynamic 3D Gaussian Splatting

链接：https://arxiv.org/abs/2608.22773

作者：Shogo Sato,Takuhiro Kaneko,Shoichiro Takeda,Tomoyasu Shimada,Riku Inoue,Kazuhiko Murasaki,Ryuichi Tanida

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieves photorealistic reconstruction, recent physics-aware extensions, physics-aware extensions improve, predicting velocity fields, Gaussian Splatting

备注： Accepted by BMVC2026

点击查看摘要

Abstract:Dynamic 3D Gaussian Splatting (3DGS) achieves photorealistic reconstruction of time-varying scenes, and recent physics-aware extensions improve extrapolation by explicitly predicting velocity fields. However, these extensions merely fit vector fields to visual deformations without satisfying Lagrangian mechanics, leading to three major issues: (i) physically inconsistent trajectories, (ii) lack of time-reversibility, and (iii) geometric collapse during long-term extrapolation. In this paper, we propose LagrangeGS, which formulates dynamic 3DGS as a non-conservative Lagrangian system. While this Lagrangian formulation fundamentally solves (i), a direct application of general LNNs to dynamic 3DGS requires a large velocity-Hessian inversion for millions of Gaussian particles. To overcome this computational bottleneck, we approximate the velocity-Hessian as an identity matrix, decoupling particle dynamics for computational tractability. For (ii), we restrict the non-conservative forces to be explicitly time independent, enabling consistent backward integration. Finally, to address (iii), we introduce local rigid alignment that regularizes particle trajectories. Extensive evaluations on dynamic scene benchmarks demonstrate that LagrangeGS enables stable long-term extrapolation, consistent time reversal, and counterfactual physics-based editing without retraining.

87. 【2608.22760】ByteAction: Byte-space Action Recognition Foundation Model

链接：https://arxiv.org/abs/2608.22760

作者：Fangcheng Li,Zhen Yu,Kejun Wu,Qiong Liu,You Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Byte-space Action Recognition, recognize human actions, human actions directly, Byte-space Action, Bitstream Pattern Augmentation

备注：

点击查看摘要

Abstract:Byte-space Action Recognition (BAR) aims to recognize human actions directly from compressed image bitstreams without any pixel decoding. By operating entirely in byte space, BAR is inherently independent of file integrity and pixel-level reconstruction, making it naturally applicable to privacy-sensitive scenarios and robust against bitstream corruption. In this paper, we propose ByteAction, a BAR foundation model that achieves accurate action recognition on corrupted image bitstreams. ByteAction follows a dual-view byte-level recognition framework. It constructs weakly and strongly corrupted bitstream views, which are augmented by Bitstream Pattern Augmentation (BPA) and encoded with a shared ByteFormer backbone. The model is optimized with both classification and corruption consistency objectives. Specifically, we propose Bitstream Pattern Augmentation (BPA), which reshapes one-dimensional byte sequences into two-dimensional byte matrix and applies region-level erasure to encourage the model to learn robust cross-region byte dependencies. We further propose a Corruption Consistency Training strategy that constrains the model to maintain stable predictions across different corruption severities through bidirectional KL divergence. Experiments on the image bitstream from Stanford40, PPMI, and PASCAL VOC 2012 Action demonstrate that ByteAction achieves state-of-the-art corruption robustness across all scenarios while maintaining competitive intact bitstream performance.

88. 【2608.22757】Object-Uni: A Unified Model for Object-Centric Spatial Understanding and Controllable Generation

链接：https://arxiv.org/abs/2608.22757

作者：Mining Tan,Yinuo Wang,Ziqi Zhou,Weize Quan,Sifei Li,Jingdong Chen,DanDan Zheng,Libin Wang,Weiming Dong

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：made rapid progress, rapid progress, made rapid, lack the ability, ability to understand

备注：

点击查看摘要

Abstract:Unified models for visual understanding and generation have made rapid progress, yet they still lack the ability to understand and manipulate the spatial states of object instances. Existing models can describe objects in natural language, but they struggle to precisely represent continuous object poses and generate geometrically consistent images under target viewpoints. To mitigate this, we propose \emph{Object-Uni}, a unified model for object-centric spatial understanding and controllable generation. Specifically, we formulate object-centric spatial intelligence as a unified problem connecting pose perception, spatial reasoning, pose-conditioned generation, and object-centric novel view synthesis. We treat object pose as an explicit geometric variable shared by understanding and generation, rather than merely a prediction label or control signal. To make pose usable by multimodal large language models, we propose a viewpoint-based orientation abstraction that maps orientation into structured viewpoint descriptions while preserving continuous geometric supervision. We further construct an object-centric spatial benchmark (UniSpatial-80K) and train a unified model with an object-token-grounded pose anchor to associate each instance with its pose state. Experiments show that our model improves object-level pose understanding and pose-controllable generation, moving unified models from describing objects toward manipulating spatial states.

89. 【2608.22740】Seeing the Unseen: Semantic-in-Gaussian for Sparse-View 3D Generalization

链接：https://arxiv.org/abs/2608.22740

作者：Zeyang Bai,Yunpeng Wang,Yunbiao Wang,Jun Xiao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：synthesis undersparse-view settings, view synthesis undersparse-view, Gaussian Splatting, undersparse-view settings, promising approach

备注： Accepted at the ECCV 2026 Workshop on 3DWM

点击查看摘要

Abstract:Generalizable 3D Gaussian Splatting (G-3DGS) has emerged as a promising approach for novel view synthesis undersparse-view settings. However, existing frameworks remain restricted by pixel-aligned Gaussian estimation, whichstruggles in partially observed or occluded regions and often leads to incomplete surfaces or structural collapse. Toaddress these challenges, we propose SeeU (Seeing the Unseen), a novel G-3DGS framework. We frame its core design asSemantic-in-Gaussian: semantic-conditioned refinement in Gaussian space. Specifically, we introduce a Cross-viewEntropy-Aware (CEA) module that aggregates multi-view semantic and geometric cues into compact embeddings. Theseembeddings guide the Conditional Gaussian Transformer, which applies residual updates to coarse Gaussians, helpingrecover under-constrained regions of partially observed structures while preserving surface consistency. Comprehensiveexperiments on multiple benchmarks demonstrate that SeeU consistently improves rendering quality and structuralcompleteness while retaining efficient feed-forward inference. Especially under challenging extrapolation settings,SeeU achieves an average improvement of 2.44 dB in PSNR compared to recent SOTA G-3DGS methods.

90. 【2608.22723】LoViF 2026 The First Challenge on Unified Removal of Raindrops and Reflections: Methods and Results

链接：https://arxiv.org/abs/2608.22723

作者：Zewei He,Xi Tong,Yu Chen,Xingyu Liu,Xin Li,Zepeng Wang,Jiagao Hu,Fuhao Li,Yuxuan Chen,Fei Wang,Daiguo Zhou,Minmin Yi,Chuanrui Zhang,Liwen Zhang,Yeongjin Jeong,Hyunjin Cho,Jiwon Lee,Minsang Kim,Jae Woong Soh,Jin-Hui Jiang,Rong-Lin Jian,Chih-Chung Hsu,Youngjin Oh,Junhyeong Kwon,Junyoung Park,Jae Hyun Park,Sung Ju Lee,Nam Ik Cho,Vishwajeet Shukla,Himanshu Baurai,Zhiqi Zhang,Kui Jiang,Zhaocheng Yu,Runzhe Li,Dawei Fan,Hao Li,Zhanshuo Zhang,Fan Ji,Jiangmeng Li,Xiongxin Tang,Fanjiang Xu,Shangquan Sun,Anh-Kiet Duong,Petra Gomez-Krämer,Jean-Michel Carozza,Ruibo Zhang,Dexiang Hong,Xinyan Liu,Shengeng Tang,Weidong Chen,Tzu-Hsuan Weng,Min-Te Sun

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：workshop paper comprehensively, paper comprehensively reviews, Unified Removal, Raindrops and Reflections, workshop paper

备注： ECCV 2026 Workshops

点击查看摘要

Abstract:This workshop paper comprehensively reviews the First Challenge on Unified Removal of Raindrops and Reflections. The challenge aims to address a frequently encountered practical problem in the field of autonomous driving, i.e., raindrop-reflection composite degradation on rainy days. This competition attracted 149 registered participants and received 12 valid final submissions with corresponding fact sheets, significantly contributing to the progress of unified removal of raindrops and reflections. All the methods are developed and evaluated on our real-shot RainDrop and ReFlection (RDRF) dataset. A detailed analysis of the submitted methods and corresponding results is provided in this report, which highlights effective approaches and provides interesting insights for future research.

91. 【2608.22692】Hybrid Generative-Discriminative Object Placement

链接：https://arxiv.org/abs/2608.22692

作者：Siyuan Zhou,Li Niu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：object placement aims, image composition, inserted foreground object, important operation, operation of image

备注：

点击查看摘要

Abstract:As an important operation of image composition, object placement aims to predict the plausible placement (location, scale) for the inserted foreground object. Previous object placement methods can be divided into generative methods and discriminative methods, both of which cannot balance efficiency and effectiveness well. In this work, we propose a semi-generative method in the middle ground between them. In particular, we assign uniformly distributed anchors on the background. Then, we fuse foreground and background features to predict the rationality score for each anchor and predict plausible placement sets for positive anchors. Extensive experiments on the OPA dataset show that our method can strike a good balance between efficiency and effectiveness.

92. 【2608.22690】MorphoCLIP: Text-Supervised Contrastive Learning for Perturbation Matching in Cell Painting Images

链接：https://arxiv.org/abs/2608.22690

作者：Sukhrobbek Ilyosbekov(1),Shubham Gajjar(1),Rongfei Jin(1) ((1) Northeastern University)

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Painting microscopy captures, Cell Painting microscopy, Cell Painting, microscopy captures, Cell Painting data

备注： 9 pages, 4 figures, 6 tables. Code: [this https URL](https://github.com/suxrobGM/morphoclip)

点击查看摘要

Abstract:Cell Painting microscopy captures how cells change after a chemical or genetic perturbation. Connecting these images to the perturbations that produced them could make large imaging screens easier to search and interpret, but the task remains difficult because biological effects are subtle and technical variation is substantial. We introduce MorphoCLIP, a contrastive model that links Cell Painting profiles with text descriptions of compounds, CRISPR knockouts, and ORF overexpressions. The model keeps its vision and language backbones frozen and trains only a compact cross-channel module and projection layers, so it can be trained on a single consumer GPU. On held-out CPJUMP1 data, MorphoCLIP searches in both directions: from a cell image to its perturbation description and from a description to matching cell images. In both cases, a correct match appears among the top ten results much more often than expected by chance. Adding a replicate-alignment loss makes profiles from repeated experiments more consistent, although this improvement does not yet translate into reliable gene-compound matching. Gene-aware labels and plate correction also show no consistent retrieval benefit. These findings suggest that text supervision can help organize chemical and genetic Cell Painting data. Matching compounds with genetic perturbations, however, remains an open problem.

93. 【2608.22679】Contextrast++: Robust Multi-Scale Contextual Contrastive Learning for Semantic Segmentation

链接：https://arxiv.org/abs/2608.22679

作者：Changki Sung,Hyungtae Lim,Wanhee Kim,Youngwoo Seo,Hyun Myung

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：effectively capturing local, challenges remain, Semantic segmentation, rapidly advanced, advanced with deep

备注： Accepted to IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2026

点击查看摘要

Abstract:Semantic segmentation has rapidly advanced with deep learning; however, challenges remain in effectively capturing local and global contexts as well as addressing the long-tailed distribution problem. To tackle these issues, we present Contextrast++, a robust contrastive learning method for semantic segmentation that improves multi-scale feature integration and mitigates class imbalance issues. Our method consists of two key components: 1) contextual contrastive learning (CCL) and 2) boundary-aware negative (BANE) sampling. CCL includes three subcomponents: adaptive fusion module, pixel-to-anchor (PA) loss, and anchor-to-anchor (AA) loss. The adaptive fusion module dynamically balances local and global feature integration, resulting in a more context-aware representation. While the PA loss leverages the fused multi-scale features to improve feature representation learning, the AA loss focuses on addressing the long-tailed distribution problem by utilizing a memory bank that stores a fixed number of class-balanced representative anchors. Meanwhile, BANE sampling enhances segmentation precision by selecting hard negatives from misclassified boundary regions, which refines fine-grained details during contrastive learning. As verified in extensive experiments using public datasets, we demonstrate that Contextrast++ substantially improves semantic segmentation performance over existing contrastive learning-based state-of-the-art approaches, while introducing no additional computational overhead during inference.

94. 【2608.22678】RACO: Reliability-Aware Coarse-Goal Optimization for Inspection-Oriented UAV Vision-Language Navigation

链接：https://arxiv.org/abs/2608.22678

作者：Sen Wang,Yiming Sun,Jiaxuan He,Pengfei Zhu

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：UAV vision-language navigation, avoid falsely confirming, falsely confirming visually, semantically similar distractors, UAV vision-language

备注：

点击查看摘要

Abstract:UAV vision-language navigation (UAV-VLN) is commonly evaluated as goal reaching, but inspection-oriented deployment requires the agent to stop within a valid inspection region and avoid falsely confirming visually or semantically similar distractors. This requirement exposes a key weakness in existing coarse-to-fine UAV-VLN policies: the coarse goal predicted before local refinement is often treated as reliable, although it may drift toward plausible but incorrect object regions and limit the ability of the local stage to recover. To systematically evaluate this problem, we introduce LG-UVI, an object-centric inspection evaluation setting derived from CityNav/CityRefer. LG-UVI extends standard UAV-VLN episodes with target objects, hard distractors, type-aware inspection regions, and diagnostics for inspection-region arrival and object-level confirmation. To address this inspection-oriented setting, we further propose RACO, a reliability-aware adaptive coarse-to-fine navigation framework. Instead of treating the predicted coarse goal as a fixed waypoint, RACO views it as a runtime hypothesis and uses object-level candidate anchors to check and correct coarse localization before Stage 1 and at the Stage 1-to-Stage 2 boundary. RACO also applies scale-adaptive terminal refinement to handle terminal near-miss cases using runtime-observable geometric and anchor-based evidence. Under a unified online evaluation protocol, RACO improves SR over the reproduced HETT baseline by 9.53 and 7.98 percentage points on validation-unseen and test-unseen, respectively. It also improves inspection-region arrival and reduces false verification risk, showing that coarse-goal reliability optimization is an effective complement to existing coarse-to-fine UAV-VLN policies.

95. 【2608.22665】Hyperbolic Hierarchical Clustering for Visual Representation Learning

链接：https://arxiv.org/abs/2608.22665

作者：Jianan Wei,Guikun Chen,Zhiyuan Weng,Chunchao Guo,Yujia Wang,Wenguan Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：machine learning, token mixer, classic approaches, approaches in machine, vision Transformers

备注：

点击查看摘要

Abstract:We investigate the token mixer in vision backbones by revisiting clustering, one of the most classic approaches in machine learning. An effective token mixer is a fundamental component of modern vision backbones like vision Transformers, facilitating information exchange between image patches. Mainstream token mixers, which rely on convolution, attention, MLP, or their hybrids, primarily focus on navigating the trade-off between accuracy and computational cost. However, a significant drawback of these methods is their black-box nature; their encoding process is opaque and lacks interpretability. Diverging from these opaque designs, we introduce ClusterMixer, a transparent token mixer that is grounded in a clustering paradigm and interpretable by design. ClusterMixer explicitly formulates the token mixing process through a hierarchical clustering mechanism. To model the natural, tree-like relationships inherent in visual data, the clustering is performed in hyperbolic space, which is well-suited for embedding hierarchies with low distortion. Building on this innovation, we present HCFormer, a new backbone architecture that integrates ClusterMixer with a series of meticulously designed clustering strategies to ensure robust performance across tasks. Extensive experiments demonstrate that HCFormer consistently outperforms its counterparts across diverse tasks, including image classification, object detection, instance segmentation, and semantic segmentation. Considering its transparency and efficacy, we hope HCFormer can facilitate a paradigm shift toward interpretable backbones.

96. 【2608.22655】Multiple View Neural Regression of a Facial Shape Model

链接：https://arxiv.org/abs/2608.22655

作者：Xiang Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：high-quality facial animation, Creating re-topologized, labor-intensive and time-consuming, essential for high-quality, remains labor-intensive

备注：

点击查看摘要

Abstract:Creating re-topologized 3D facial meshes is essential for high-quality facial animation but remains labor-intensive and time-consuming. This dissertation explores more efficient approaches for capturing production-ready facial meshes through: (1) the development of VarIS, a custom light sphere for capturing high-resolution stereo geometry and reflectance maps; (2) analysis of camera parameters affecting automatic 2D and 3D landmarking; (3) synthetic-data methods for training neural face regression; and (4) techniques for improving neural multi-view face-shape regression. While VarIS enables photorealistic face capture, its operational and processing costs motivate a more scalable approach. A deep learning framework is therefore proposed to directly predict re-topologized facial meshes from synthetic multiview images generated with Visage Craft, an in-house physically based rendering system using an Appearance 3D Morphable Model (A3DMM). The system produces standardized meshes ready for rigging and animation with minimal human supervision. Results show that incorporating accurate camera intrinsics and extrinsics improves landmark accuracy and geometric consistency, while 3D landmark regularization further improves reconstruction quality.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.22655 [cs.CV]

(or
arXiv:2608.22655v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.22655

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

97. 【2608.22637】OmniCAD: A Large-Scale Benchmark for 3D Spatial Reasoning in Robotics Assemblies

链接：https://arxiv.org/abs/2608.22637

作者：Mingjia Wang,Taiting Lu,Ziwei Dong,Sisong Bei,Jingying Zeng,Runze Liu,Kaiyuan Lin,Hongxing Pan,Kai Zhang,Yizheng Hou,Yangshoudu Zheng,Chenchen Guo,Weiyuan Meng,Shubin Lyu,Zhijun Zheng,Dexu Wang,Xinyu Bai,Shurui Qian,Zhangzixin,Mengyu Pan,Guoliang Shi,Ling Ma,Yifan Yang,Qi He,Yi-Chao Chen,Yincheng Jin,Sung-Liang Chen,Mahanth Gowda

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent vision-language models, assemblies remains underexplored, Recent vision-language, complex mechanical assemblies, mechanical assemblies remains

备注：

点击查看摘要

Abstract:Recent vision-language models (VLMs) show strong capabilities in robotic perception and spatial reasoning, yet their ability to reason about complex mechanical assemblies remains underexplored. We introduce OmniCAD, a large-scale benchmark for assembly-aware 3D spatial reasoning across diverse industrial systems, including robotic mechanisms, automotive components, aerospace structures, and agricultural machinery. OmniCAD contains 25k mechanical assemblies, with an average of 12 parts per assembly and 21 types of mate relationships. Each assembly includes a human-verified ground-truth 3D model and renderings from 20 viewpoints. The benchmark evaluates three capabilities: (1) component-level 3D spatial reasoning, requiring prediction of part positions and orientations; (2) part-to-part relational reasoning, requiring identification of mating relationships and assembly constraints; and (3) tool-augmented agentic reasoning, where models iteratively select viewpoints, inspect visual evidence, and refine predictions. Experiments show that current VLMs struggle with industrial assembly reasoning, often producing inaccurate poses, invalid mating relationships, part interpenetration, and degraded performance as assembly complexity increases. We will open-source the benchmark, evaluation code, and tool interfaces to support research on accurate, physically valid, and scalable 3D assembly reasoning.

98. 【2608.22617】AI-based worker guidance in assembly and disassembly operations using multimodal ego/exo-centric data capture and structured task knowledge

链接：https://arxiv.org/abs/2608.22617

作者：Vivek Chavan,Jörg Krüger

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词：disassembly processes rely, difficult to document, processes rely, structured task knowledge, Assembly and disassembly

备注： 5 pages. Published in CIRP Annals - Manufacturing Technology

点击查看摘要

Abstract:Assembly and disassembly processes rely on expert knowledge that is difficult to document, reuse, and transfer. This paper presents a data-centric approach for extracting structured task knowledge from expert demonstrations using egocentric and exocentric recordings. Temporal and multimodal information from video and narration is jointly encoded to derive structured task representations that enable procedural documentation and context-aware worker guidance. The approach is evaluated on a real-world disassembly case study, demonstrating that video-based representations capture procedural structure and execution context beyond static image-based methods. The results highlight the potential of egocentric video understanding for repair, training, and circular manufacturing applications. Project website: this https URL

99. 【2608.22586】Vision-Language Models for Occupational Physical Exposure Assessment: Estimating External Hand Forces in Manual Material Handling Tasks from RGB Video

链接：https://arxiv.org/abs/2608.22586

作者：Mohammad Sadra Rajabi,Aanuoluwapo Ojelade,Sunwook Kim,Maury A. Nussbaum

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：manual material handling, typically requires instrumented, External hand forces, requires instrumented objects, bilateral external hand

备注：

点击查看摘要

100. 【2608.22532】SymmAdapt: Symmetrical Flow Matching for Source-Free Domain Adaptation in Medical Image Segmentation

链接：https://arxiv.org/abs/2608.22532

作者：Tal Grossman,Noa Cahan,Hayit Greenspan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：acquisition sites remains, Symmetrical Flow Matching, imaging modalities, modalities and acquisition, acquisition sites

备注： Accepted at SASHIMI 2026, held in conjunction with MICCAI 2026. To appear in the Springer LNCS proceedings of the MICCAI 2026 Satellite Events

点击查看摘要

Abstract:Domain shift across imaging modalities and acquisition sites remains a significant barrier to the clinical deployment of segmentation models. Source-free unsupervised domain adaptation (SFUDA) addresses this by adapting a pretrained model to an unlabeled target domain without requiring access to sensitive source data. We introduce a novel SFUDA framework built on Symmetrical Flow Matching, a unified generative model that segments an input image and synthesizes a source-like image from a mask within the same learned flow. By initializing inference from a domain-agnostic Gaussian origin, the model preserves structural consistency across domains and grounds predictions in learned anatomy rather than shifted texture statistics. Our pipeline leverages this symmetry to generate reliable pseudo-labels and corresponding source-like synthetic images from unlabeled target data, creating a generative replay buffer that anchors source knowledge during a generative self-training stage that fine-tunes on a joint set of real target and synthetic source-like images. We evaluate on abdominal multi-organ and cardiac segmentation, covering cross-modality MRI-CT shifts, and multi-site prostate segmentation. Our approach outperforms SFUDA baselines and is competitive with conventional UDA methods.

101. 【2608.22526】RS$^3$-Prune: Read-Sparse, Store-Sparse Token Pruning for Video Object Segmentation

链接：https://arxiv.org/abs/2608.22526

作者：Avilasha Mandal,Sarvesh Shashikumar

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：training-free token-pruning recipe, inference time hooks, time hooks atop, hooks atop existing, atop existing video

备注： Accepted to BMVC 2026

点击查看摘要

Abstract:We introduce RS$^3$-Prune, a training-free token-pruning recipe that instantiates as a small set of inference time hooks atop existing video object segmentation (VOS) networks. Modern VOS models have converged on a common, expensive design: an image encoder produces a dense token grid for every frame, and a memory bank accumulates these tokens across all previously processed frames to condition future predictions. As a video grows longer, the resulting token budget governs both per-frame latency and peak GPU memory. Hence these models break on use cases such as --- long-form video or real-time deployment on memory-bounded accelerators. In this work we argue that the right axis along which to compress memory-bank VOS is the token budget itself. RS$^3$-Prune operates in two precise locations within an arbitrary memory-bank VOS pipeline: at the boundary between the image encoder and the memory-attention readout, where we restrict the queries that participate in the cross-frame attention to only a small, geometrically informed subset; and at the boundary between the memory encoder and the memory bank, where we restrict which tokens are ever permitted to enter the bank to those that lie within the object's spatial extent. Over various established benchmarks, RS$^3$-Prune delivers up to $38.8\%$ FPS speedup and reduces $13.1\%$ peak memory usage, while preserving a competitive $\mathcal{J}$$\mathcal{F}$ compared to the unmodified VOS networks.

102. 【2608.22521】VISTA: Test-Time Compositional Alignment for Visual Autoregressive Generation

链接：https://arxiv.org/abs/2608.22521

作者：Hossein Shahabadi,Niki Sepasian,Mahdieh Soleymani Baghshah

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：persistent compositional failures, exhibit persistent compositional, next-scale VAR generation, textbf, high-quality alternative

备注：

点击查看摘要

Abstract:Visual autoregressive (VAR) models have emerged as a fast, high-quality alternative to diffusion for text-to-image generation, but like diffusion models they exhibit persistent compositional failures, producing images that violate the attribute bindings and spatial relations specified in the prompt. While a rich line of test-time alignment methods has developed for diffusion, no comparable approach exists for next-scale VAR generation, whose stateful, discrete, multi-resolution sampling process makes existing techniques inapplicable. We close this gap with \textbf{VISTA} (\textbf{Vi}sual Autoregressive \textbf{S}emantic \textbf{T}est-time \textbf{A}lignment), the first gradient-based test-time alignment framework for next-scale autoregressive image generation. Built on Infinity, VISTA intervenes directly in the generation process, optimizing intermediate representations through the frozen transformer to steer visual predictions toward compositional constraints, without modifying model parameters or requiring additional training. VISTA introduces the mechanisms needed to make such optimization stable across scales, together with an extensible objective space that any differentiable constraint on cross-attention can plug into. Across two benchmarks and two model scales, VISTA improves every targeted compositional category, raising the mean targeted score by nearly 20\% on a 2B backbone and almost 6\% on an 8B backbone, with the largest gains on spatial relations. Image quality is preserved: an independent preference model VISTA never optimizes scores its outputs nearly 20\% higher. Notably, the 2B model with VISTA surpasses a backbone four times its size, indicating that a substantial part of the compositional gap between model scales is recoverable at test time.

103. 【2608.22516】RACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understanding

链接：https://arxiv.org/abs/2608.22516

作者：Pengyiang Liu,Junbo Niu,Xiaoyang Hu,Zhongyue Shi,Zitian Wang,Linjiang Huang,Si Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Event Counting items, frames, evidence intervals, Event Counting, Temporal Ordering

备注： Accepted to EMNLP 2026 Main Conference. 19 pages, 5 figures, 6 tables. Project page: [this https URL](https://buaa-colalab.github.io/TRACE/)

点击查看摘要

104. 【2608.22500】Learning Sample-wise Rank-aware Interpolation Weights for Composed Visual Data Retrieval

链接：https://arxiv.org/abs/2608.22500

作者：Boseung Jeong,Taegyu Park,Donghyeon Kwon,Hyunsouk Cho,Suha Kwak

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：reference visual input, composed visual data, visual data retrieval, visual data, reference visual

备注： ECCV 2026

点击查看摘要

Abstract:At the heart of composed visual data retrieval is the fusion of a reference visual input and a textual modification into a single query. While current state-of-the-art methods utilize multimodal large language models for this fusion, their complexity introduces prohibitive querytime latency, limiting their scalability. We instead revisit the efficacy of simple linear interpolation within an embedding space, and introduce SRAIN, the first framework that dynamically predicts query-specific interpolation weights. The key challenge lies in the fact that the quality of an interpolation weight should be measured by the interpolated embedding's discriminability from negatives as well as its proximity to true targets; this makes collecting and predicting optimal weights intractable. We overcome this bottleneck through two key innovations: batch-wise rank-aware weight estimation during training, and a compact memory bank that synthesizes hard negatives during inference. SRAIN achieves the best in composed video retrieval and matches the current state of the art in composed image retrieval, all while substantially reducing querytime latency compared to MLLM-based alternatives.

105. 【2608.22485】HeatTok: Enhancing Remote Sensing Image Understanding via Thermodiffusion-based Tokenization

链接：https://arxiv.org/abs/2608.22485

作者：Yingying Yan,Jiaqi Tang,Wei Wei,Qianzhou Wang,Jinjian Wu,Botong Geng,Jianmin Chen,Yuyang Xia,Lei Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal Large Language, Large Language Models, Current visual tokenizers, Large Language, remote sensing imagery

备注： 19 pages (10 pages main text + appendix), 10 figures. Accepted at the 34th ACM International Conference on Multimedia (ACM MM 2026), Rio de Janeiro, Brazil, November 10--14, 2026

点击查看摘要

Abstract:Current visual tokenizers in Multimodal Large Language Models (MLLMs) predominantly rely on patch-based partitioning, which causes severe semantic mixture and object fragmentation in remote sensing imagery due to the irregular contours of geo-objects. Moreover, existing adaptive methods struggle to extract precise object-level tokens and lack dedicated geometric positional encodings for irregular regions. In this paper, we propose HeatTok, a semantic-aware tokenizer driven by thermodiffusion aggregation. Inspired by the physical principles of heat conduction, HeatTok adaptively merges adjacent homogeneous regions to generate semantically independent, object-aligned irregular tokens. To enable MLLMs to perceive these irregular shapes, we design the Gaussian Multimodal Rotary Positional Embedding (G-MRoPE), which models token spatial distributions via 2D Gaussians and explicitly injects center, scale, and orientation cues. Extensive evaluations on the VRSBench and EarthVQA datasets demonstrate that HeatTok effectively preserves object-level semantic integrity and achieves state-of-the-art performance under a reasonable token budget. The code is available: this https URL.

106. 【2608.22465】M$^3$ISR: A Multi-Modal Multi-View Benchmark for 3D/4D Gaussian Splatting and Feedforward Compression

链接：https://arxiv.org/abs/2608.22465

作者：Xinhui Liu,Lei Liu,Zhenghao Chen,Lebin Zhou,Wei Wang,Wei Jiang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：High-fidelity free-viewpoint video, interactive rendering increasingly, rendering increasingly rely, practical deployment remains, deployment remains constrained

备注：

点击查看摘要

Abstract:High-fidelity free-viewpoint video (FVV) and interactive rendering increasingly rely on explicit Gaussian representations, yet practical deployment remains constrained by representation size, dynamic updates, and computational cost. Existing multi-view video benchmarks provide valuable real-captured content, but they make it difficult to isolate the effects of controlled camera geometry, representation efficiency, and temporal redundancy. We introduce M$^3$ISR, a controlled synthetic benchmark for 3D and 4D Gaussian Splatting (3DGS/4DGS). The benchmark contains 25 scenes from five indoor and outdoor scene groups, two camera/motion configurations, six synchronized 1080p views, and dense ground-truth annotations including RGB, camera parameters, depth, semantic and instance segmentation, and static--dynamic masks. The shared-center camera design intentionally isolates angular view variation and enables controlled evaluation of novel-view synthesis and representation efficiency. We organize M$^3$ISR into five complementary tracks covering 3DGS synthesis, 4DGS synthesis, 4DGS streaming, 3DGS compression, and 4DGS compression. Representative baseline results show small differences in static reconstruction quality but substantial differences in representation storage, while the evaluated streaming methods exhibit substantially higher reported training or reconstruction cost than the corresponding offline dynamic reconstruction baselines. We further define feedforward compression tasks for 3DGS and 4DGS and provide reference rate--distortion formulations and preliminary baseline evaluations. The benchmark is intended as a controlled and complementary testbed for systematic study of Gaussian-based FVV reconstruction, compression, and streaming.

107. 【2608.22419】Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Masking

链接：https://arxiv.org/abs/2608.22419

作者：Dongzhou Cheng,Ziang Li,Yixiao Zhou,Haojuan Li,Jinghao Zhang,Lei Lei,Minjing Dong,Jie Gui,Jiaqi Wang

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：models offer low-latency, offer low-latency inference, exhibit discontinuous actions, complex dual-arm tasks, models offer

备注： 35 pages, 22 figures, 9 tables

点击查看摘要

Abstract:Query-based Vision-Language-Action (VLA) models offer low-latency inference that is attractive for bimanual robotic manipulation, but we observe that they can still exhibit discontinuous actions and execution failures in complex dual-arm tasks. We hypothesize that unstable multi-view and language fusion is one contributing factor in these failures, often coinciding with attention spreading to distracting regions. To improve robustness, we introduce the Modality Masking Mechanism (M3), an embarrassingly simple, training-only strategy that requires no architectural changes or large-scale robot pretraining. M3 stochastically masks subsets of modality channels during training, exposing the policy to controlled partial observations and encouraging it to rely less on distracting cues and more on evidence that remains reliable. We evaluate M3 on ten bimanual tasks from RoboTwin 2.0 and on three long-horizon real-world tasks. Compared with the Adapter baseline, M3 improves average success by 21.7% in the Clean setting and 11.4% in Clean2Rand, where policies are trained on clean demonstrations and evaluated on randomized scenes, while also improving averaged real-world full-task success by over 30%. These results suggest that structured training-time masking is a practical way to improve the robustness of query-based VLA policies for bimanual manipulation.

108. 【2608.22398】MotionDLO: Hybrid Event- and Frame-Based Tracking of Deformable Linear Objects

链接：https://arxiv.org/abs/2608.22398

作者：Annalena Hartmann,Priyamvada Ajithkumar,Patrick Bründl,Jörg Franke

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：simultaneously ensuring robustness, moving deformable linear, state estimation remains, deformable linear objects, tracking moving deformable

备注：

点击查看摘要

Abstract:Reliably tracking moving deformable linear objects (DLOs) while simultaneously ensuring robustness, accuracy, and temporally consistent state estimation remains a fundamental challenge in robot perception. We introduce MotionDLO, a real-time tracking framework specifically designed to overcome these limitations in temporal continuity and latency. The method exploits the high temporal resolution and sparsity of event-based cameras and combines segmentation with the Coherent Point Drift (CPD) algorithm under the principles of Motion Coherence Theory. This integration enables temporally consistent shape estimation while maintaining a low computational overhead. Existing event-based tracking methods are typically computationally efficient but exhibit reduced accuracy compared to frame-based approaches, or alternatively compromise event sparsity to achieve competitive performance. To resolve this trade-off, we propose a hybrid event- and frame-based tracking architecture that preserves the complementary strengths of both sensing modalities. The event stream ensures high-frequency motion updates, while frame-based information stabilizes spatial accuracy and object identity. We demonstrate that the proposed framework reliably associates DLO instances across video sequences, enabling robust perception for robotic manipulation tasks. Experimental results validate real-time performance at 12 ms update rates and accurate shape tracking with an point-to-curve error as measurement of accuracy of up to 0.43 mm, supporting dynamic path adaptation during manipulation. The source code and demonstration datasets are publicly available.

109. 【2608.22370】LiST: Local-Simplex Test-Time LoRA Fusion

链接：https://arxiv.org/abs/2608.22370

作者：Yihua Shao,Jia Li,Siyu Chen,Xinyu Luo,Yang Liu,Kecheng Chen,Xinwei Long,Lingyu Zhu,Fanhu Zeng,Maolin Wang,Ziyang Yan,Jingcai Guo,Hao Tang,Nicu Sebe,Zhenyi Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：specialize large language, vision-language models, offer a modular, specialize large, LoRA adapters offer

备注： Accepted by EMNLP 2026 Finding

点击查看摘要

Abstract:Task-specific LoRA adapters offer a modular way to specialize large language and vision-language models. However, existing adapter composition methods are mostly static and cannot adapt to individual test inputs. To address these issues, we propose \textbf{LiST}, a label-free test-time LoRA fusion framework that converts an existing LoRA bank into a target-conditioned local simplex and searches sample-specific fusion weights at inference time. LiST builds joint task representations from LoRA parameter anchors and prompt-level behavior vectors, retrieves neighboring adapters as a local search space, and performs branch-preserving fusion without updating the backbone or adapters. Candidate weights are selected by a prompt-level energy with prior, geometric, and stochastic-consistency constraints, and are deployed only when they pass a safe acceptance rule. Otherwise, LiST falls back to a target-conditioned prior. Experiments on multimodal and language benchmarks show that LiST outperforms static LoRA merging and conventional test-time adaptation baselines, while preserving task-specific adapter utility and improving robustness on unseen tasks.

110. 【2608.22368】DiD It in 87 Minutes: A Label-Free Softmax-to-Linear Adaptation of Vision Transformers for Object Detection

链接：https://arxiv.org/abs/2608.22368

作者：Huaiyuan Qin,Gabriel James Goenawan,Zihang Lin,Muli Yang,Hongyuan Zhu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：global token mixing, trivial drop-in replacement, Softmax-attention ViT backbone, high-resolution object detection, object detection due

备注：

点击查看摘要

Abstract:While linear attention is a compelling mechanism for high-resolution object detection due to its reduced cost for global token mixing, converting the Softmax-attention ViT backbone of a trained detector into a linear-attention one is not a trivial drop-in replacement. Directly swapping the attention operator leads to severe performance degradation, and generic label-free distillation, though effective for classification, often fails on detection tasks. We argue that the central challenge is \textit{detector-interface preservation}: the converted backbone must reproduce the exact feature tensors expected by the fixed downstream detector, rather than merely imitating internal Softmax hidden states. To address this, we introduce Detector-Interface Distillation (DiD), a label-free conversion method that exclusively trains the linear-attention backbone by aligning detector-facing interface tensors with those of a frozen Softmax teacher. On DOTA-v1.5, DiD substantially outperforms established baselines and matches supervised, fully trained linear models. Adaptation completes in roughly 87 minutes on 4 GPUs, and the linearized backbone cuts inference latency by ~62% and peak memory by ~49%. We hope our findings offer the community a simple, label-free route to reusing trained Softmax detectors as efficient linear ones, and encourage interface-aware objectives in future architecture-conversion work.

111. 【2608.22366】When Do VLMs Help Arabic Manuscript OCR? A Cross-Dataset Study

链接：https://arxiv.org/abs/2608.22366

作者：Moshiur Farazi,Firoj Alam,Abderrahmane Maaradji,Zakaria Maamar,Hamdy Mubarak,Wajdi Zaghouani

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Vision-language models, Islamic manuscript recognition, Islamic manuscript, document understanding, recognition remains underexplored

备注：

点击查看摘要

Abstract:Vision-language models (VLMs) are increasingly being used for document understanding, yet their role in Arabic and Islamic manuscript recognition remains underexplored. To address such a gap in this paper, we evaluate traditional OCR, general-purpose VLMs, Arabic-specialized VLMs, and OCR-conditioned VLM correction across eight Arabic text datasets spanning historical manuscripts, aged printed books, clean print, multi-domain documents, and handwriting. The results show that no single approach dominates across setups. On line-level historical manuscripts, VLMs are close to Tesseract; on page-level manuscript images, they perform better; and in several settings, an OCR-conditioned corrector improves over both standalone OCR and standalone VLMs. The central finding is an OCR-prior recoverability principle: OCR conditioning helps when the OCR output remains visually and textually recoverable, providing anchors that the VLM can refine against the image. It improves recognition on aged print, clean print, mixed-domain Arabic, and some Naskh manuscripts, but degrades performance when the prior is script-mismatched or systematically misleading, as in Maghribi manuscripts and realistic student handwriting. Additional diagnostics show that Arabic VLM-OCR is sensitive to diacritics, preprocessing, generation budget, and repetition loops. These findings support an adaptive OCR-VLM workflow that routes pages according to script, OCR-prior recoverability, length diagnostics, and failure-mode indicators.

112. 【2608.22359】Pre-Decoding Acoustic Triage for Budgeted Vision-Language Captioning of Untrimmed Egocentric Video

链接：https://arxiv.org/abs/2608.22359

作者：Masoud Jalayer,Changyi Li,Yu Xiao

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Sound (cs.SD)

关键词：Automatically analyzing hours-long, analyzing hours-long egocentric, Automatically analyzing, hours-long egocentric video, quality control

备注： 18 pages, 5 figures, 9 tables. Under review at IEEE BigData 2026, Industrial and Government Track. Code: [this https URL](https://github.com/masjalayer/PreDecoding-AcousticTriage)

点击查看摘要

Abstract:Automatically analyzing hours-long egocentric video is increasingly essential for progress monitoring, quality control, and safety in logistics, construction, and manufacturing. Yet current pipelines that process short, fixed-size windows with a vision-language model (VLM) are prohibitively expensive because cost scales with the number of model calls. To reduce this cost, prior work proposes triage policies to select which windows merit a VLM invocation. However, these policies either sample uniformly or rank windows using visual features, which ironically requires the video decoding that the budget constraints are meant to avoid. We propose audio-first triage: select windows using the lightest modality, scored before any video frame is decoded, so the approach composes naturally with token compression or quantization. The novelty lies in the objective, not the representation: rather than a per-frame sound-event detector, we train the selector to trigger once per action. This objective shift improves action coverage by 4.0-10.8 percentage points across all evaluated call rates, using frozen AudioSet-pretrained features without domain-specific sound-event labels. Using fewer than half of the available calls, the triage cuts 9-20% of VLM calls at matched coverage on EPIC-KITCHENS-100 (EK-100), surpasses uniform sampling through the mid-range on Ego4D over 247 clips, and outperforms two recent visual keyframe selectors. Code, the reference implementation and every results file this manuscript reads are at this https URL.

113. 【2608.22346】Multimodal examination answer data with expert-designed Outcome-Based Education rubrics for criterion-level assessment

链接：https://arxiv.org/abs/2608.22346

作者：Jahangir Alam SM,Md Khalid Syfullah,Saad Ahmed,Munira Akter Mou,A K Z Rasel Rahman,A.K.M. Masudur Rahman,Mohammed Sowket Ali

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：expert-designed Outcome-Based Education, Outcome-Based Education, examination answers paired, data article describes, grading metadata

备注：

点击查看摘要

Abstract:This data article describes a multimodal collection of scanned examination answers paired with expert-designed Outcome-Based Education (OBE) grading metadata. The collection contains 485 answer submissions from 415 consenting students at four academic institutions. Eight faculty contributors supplied examination materials covering nine subjects and 12 distinct question templates. Each answer-level item links a scanned PDF to a randomized identifier, subject label, question, model answer, criterion definitions, performance-level descriptions, criterion marks, and a total mark. The 12 rubrics contain 47 criteria in total. The scans retain realistic academic content, including handwriting, printed text, equations, tables, code, figures, sketches, and diagrams. CamScanner, Adobe Scan, and conventional scanners contributed variation in illumination, contrast, orientation, compression, and resolution. Diverse handwriting, crossed-out work, revised calculations, and inserted corrections add further visual variability for robustness and generalization studies. Preparation involved heterogeneous-source consolidation, label and text standardization, score validation, identifier randomization, filename randomization, and JSON-to-PDF integrity checks. An answer-level audit confirmed 485 unique identifiers, 485 unique PDF filenames, agreement between each total mark and its criterion-mark sum, and scores within the applicable rubric maximum. The data can support rubric-aware automated evaluation, multimodal document understanding, criterion-level feedback, score prediction, and privacy-aware OBE assessment research. Access is restricted to research use and is available from the corresponding author upon reasonable request.

114. 【2608.22344】Fast and Compact 3D Gaussian Splatting with Polarized Opacity Prior

链接：https://arxiv.org/abs/2608.22344

作者：Zi-Ming Wang,Kai-Wen Duan,Kowei Huang,Akihiro Sugimoto,Shang-Hong Lai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：inflate memory usage, Gaussian Splatting, number of redundant, real-time speeds, speeds but suffers

备注：

点击查看摘要

Abstract:3D Gaussian Splatting (3DGS) achieves state-of-the-art rendering quality at real-time speeds but suffers from "model bloat" - a large number of redundant, low-opacity Gaussians that inflate memory usage and training costs. This inefficiency stems from the standard "densify-then-prune" paradigm, which expands the model aggressively before relying on pruning to achieve compactness. To mitigate this problem, we present an efficient training framework that builds an intrinsically compact representation, replacing the conventional densify-then-prune cycle. Our method leverages a synergistic design: an L2 reconstruction loss to provide error-proportional gradients that stabilize optimization, and a novel Polarized Opacity Prior (POP) to actively manage the Gaussian population. POP steers informative primitives toward full opacity and uninformative ones toward transparency, enabling natural pruning and accelerating rendering through Early Ray Termination. Experiments on three public datasets demonstrate that our approach consistently achieves accelerated 3DGS training with significantly fewer Gaussians while maintaining comparable visual reconstruction quality. These results show that the proposed framework provides a simple and effective path toward fast and inherently compact 3DGS training.

115. 【2608.22341】ransHands: Repurposing Human Pose Encoders as Hand Pose Encoders

链接：https://arxiv.org/abs/2608.22341

作者：Milo Piccioli,Gianluca Amprimo,Claudia Ferraris,Gabriella Olmo

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：monocular representations remains, remains challenging due, availability of large-scale, limited availability, Lifting

备注：

点击查看摘要

Abstract:Lifting 3D hand poses from 2D monocular representations remains challenging due to the limited availability of large-scale, diverse 3D-annotated hand datasets, in contrast to the abundance of human body motion data. We address this limitation by transferring motion representations learned from large body pose corpora to the hand domain. We introduce TransHands, a backbone-agnostic transfer learning framework that enables pre-trained human motion encoders to be effectively adapted for 3D hand pose estimation from 2D pose inputs. Rather than training hand-specific biomechanical models from scratch, TransHands combines a two-stage training and fine-tuning strategy with a lightweight hand-specific input adaptation module that aligns hand kinematics with the representation space learned for full-body motion. We evaluate TransHands across four state-of-the-art motion modeling architectures, including transformer-based, graph-based, and frequency- domain models. Results demonstrate that motion priors learned from body pose data transfer consistently across architectures, yielding consistent accuracy gains, strong cross-domain generalization, particularly in challenging egocentric settings, and applicability for downstream tasks in real-world contexts.

116. 【2608.22338】AcroMELD: Recovering Interactive PDF Forms with Structure-Aware Graph Set Transformers

链接：https://arxiv.org/abs/2608.22338

作者：Samuel Abramov(Accessful GmbH)

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Interactive PDF form, visually resemble forms, leaving users unable, PDF form fields, external editing tools

备注： 13 pages, 2 figures, 7 tables. Source compiles to a tagged PDF 2.0 document with MathML embedded as associated files

点击查看摘要

Abstract:Interactive PDF form fields are often absent from documents that visually resemble forms, leaving users unable to enter data without printing or external editing tools. Detecting the missing widgets is difficult because a field may be indicated by several overlapping cues, born-digital PDFs expose useful but incomplete drawing structure, and dense pages can contain hundreds of fields. We introduce AcroMELD (AcroForm Multi-source Evidence Linking Decoder), a 39.4M-parameter detector that combines a high-resolution visual transformer with label-free PDF primitives. Its 896-query set comprises 384 visual proposals, 384 structure-seeded proposals, and 128 learned recovery queries. Four graph-set layers exchange information over geometry-biased sparse neighborhoods and cross-attend to PDF structure. A learned same-field relation links co-referent candidates, while a localization-quality head is trained on the containment-aware overlap used by the downstream recovery decision. We define a hash-bound evaluation protocol with disjoint development, calibration, internal-test, and quarantined external-holdout roles. The sealed, single-seed candidate reaches native containment micro-$F_1$ 0.9344 on the internal test and 0.8477 on the one-shot external holdout (95% PDF-cluster bootstrap interval [0.8339, 0.8605]). This passes the registered historical FFGBT-v8 reference by 0.0186 absolute $F_1$. Under the stricter external adapter, however, performance is 0.7786 IoU-$0.5$ $F_1$ and 0.2900 COCO mAP, below a locally evaluated CommonForms-L reference; the signature class receives no prediction at the selected threshold. Thus the result supports the registered operational gate while exposing substantial domain and rare-class limitations.

117. 【2608.22337】Motion-Aware Reasoning from Speech to Mask Tracks: Runner-up Solution for the MeViS-Audio Track of the 8th LSVOS Challenge 2026

链接：https://arxiv.org/abs/2608.22337

作者：Jinxing Zhou,Suiyi Zhao,Yanghao Zhou,Ruohao Guo

类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

关键词：Speech-guided referring video, referring video object, video object segmentation, object segmentation aims, Speech-guided referring

备注：

点击查看摘要

Abstract:Speech-guided referring video object segmentation aims to recover the mask tracks of objects specified by a spoken motion description. Here, speech carries a linguistic instruction rather than acoustic evidence from a sounding object, so a solution must connect speech recognition, motion-centric temporal grounding, mask tracking, and explicit no-target handling. We introduce Speech2MaskTrack, our approach for the MeViS-Audio track of the 8th LSVOS Challenge. Speech2MaskTrack transcribes the spoken query and compiles it into structured constraints over category, count, direction, interaction role, and temporal phase. SAM3.1 enumerates multiple instance tracks, which TRACE ranks using complete-trajectory motion and relation evidence. A frozen lexical presence gate may suppress the ranked SAM3.1 base prediction. When the gate predicts that a target is present, an available full-expression-conditioned SaSaSa2VA track replaces the SAM3.1 mask. Only outputs that remain empty enter GPT-assisted recovery, which invokes SaSaSa2VA again under query- and mask-level verification. Speech2MaskTrack achieved second place in the official challenge ranking.

118. 【2608.22329】ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation

链接：https://arxiv.org/abs/2608.22329

作者：Qianqian Tang,Jiayi Gao,Ting Lei,Yang Liu

类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV)

关键词：satisfy semantic content, target emotion simultaneously, Emotion-aware artistic image, image generation requires, Emotion-aware artistic

备注： Accepted by ACM Multimedia 2026 (Grand Challenge Track 1), 7 pages, 3 figures

点击查看摘要

Abstract:Emotion-aware artistic image generation requires a model to satisfy semantic content, artistic style, and target emotion simultaneously. The key challenge is that artistic captions conflate these axes into underspecified free-form text, making fine-grained visual attributes such as brushwork, composition, and tonal atmosphere difficult to ground concretely. We present ReART, a reference-guided retrieval and refinement framework. Our method decomposes test captions and each image annotation in the EmoArt database into structured visual fields, and performs field-wise retrieval over subject, layout, brush-line, and tone-mood dimensions to retrieve role-specific visual references that supply the perceptual detail text alone cannot convey; these references are used alongside a structured prompt for initial synthesis. For samples where any Attribute Alignment Score (AAS) axis falls below threshold, an AAS-driven refinement loop diagnoses failures, constructs constrained repair plans specifying elements to keep, errors to fix, and operations to avoid, routes references by correction purpose, and performs controlled editing under structural preservation constraints. Our system ranks 2nd in Track 1 of the AffectiveArt 2026 Grand Challenge, achieving a perfect AAS of 1.00 and an overall score of 0.78. Code is available at this https URL.

119. 【2608.22323】MedReaMM: Evaluating Large Multimodal Models on Expert-Level Clinical Diagnostic Synthesis

链接：https://arxiv.org/abs/2608.22323

作者：Lai Wei,Yuchao Chen,Zhenbiao Cao,Xiaojin Zhang,Zhongyu Wei,Bangting Wang,Wei Chen,Xiang Bai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large Language Models, garnered growing interest, Language Models, Large Language, growing interest

备注：

点击查看摘要

Abstract:The application of Large Language Models (LLMs) to diagnostic decision-making has garnered growing interest. However, existing benchmarks largely focus on textual reasoning or isolated visual question-answering (VQA) tasks, lacking holistic integration of clinical narratives and medical imaging, and thus failing to assess the multimodal diagnostic synthesis capability central to expert clinical judgment. To bridge this gap, we introduce MedReaMM, a benchmark specifically designed to evaluate models' ability to synthesize heterogeneous clinical evidence consisting of detailed patient histories alongside multiple medical images into accurate differential diagnoses under a complete-information paradigm. Constructed from case reports sourced from top-tier medical journals and curated clinical case databases, MedReaMM comprises 625 expert-validated cases with an average of 2.79 medical images per case and a total of 1,042 standardized diagnoses annotated with ICD-11 codes. These cases predominantly represent rare, atypical, or multi-system presentations that demand expert-level evidence integration beyond routine pattern recognition. We evaluate 23 Large Multimodal Models (LMMs) and find that most achieve diagnostic accuracy scores below 50%, underscoring a substantial gap in multimodal diagnostic synthesis capability. Further analysis reveals that medical knowledge proficiency, medical image understanding, and evidence integration are all highly correlated with diagnostic performance.

120. 【2608.22316】Does a Modern-Handwriting Warm-Up Help Historical Arabic OCR? A Reproducible, Compute-Matched Evaluation on Muharaf and KHATT

链接：https://arxiv.org/abs/2608.22316

作者：Sumaih Almarshad,Maram Alamri,Dona Aloraini,Fares Altuwaim,AlJawharh AlOtaibi,Reem Alyabis,Rayah Aldawsari

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：historical Arabic HTR, hurts historical Arabic, Arabic HTR, modern Arabic handwriting, modern Arabic

备注： 14 pages, Dal Research Team

点击查看摘要

Abstract:Whether an intermediate stage of modern Arabic handwriting helps or hurts historical Arabic HTR is usually decided from one implementation and one comparison, too thin a basis for a claim either way. We test stability by running the same nominal ablation four times, letting the base checkpoint, encoder-freezing strategy, epoch budget, precision, and learning-rate schedule vary as they naturally did during development, while holding the normalization, scorer, and interval estimation fixed. Each run compares intermediate training on modern handwriting (KHATT) then fine-tuning on historical manuscripts (Muharaf) against fine-tuning on Muharaf directly. Across the four runs the estimated effect swings from -17.64 to +14.52 CER points and reverses sign. The two extremes are exactly the two runs with an identifiable confound (a fivefold lower learning rate in one; a checkpoint of undisclosed provenance in the other); the two clean runs land at -0.25 and +0.94, i.e. no effect. A tight interval from one implementation says nothing about the next. We then run a compute-matched experiment with identical budgets over three seeds: KHATT warm-up is +2.42 CER points worse than a matched same-domain control (95% interval [+0.60, +4.25]); the part of that gap specific to the handwriting domain is only about 0.6 points a small negative effect under this configuration, not a universal result. We release a SaudiHeritage-OCR package with the normalizer, interval scorer, a verified KHATT decoder, experimental manifests, VLM baselines, and an edition-alignment protocol, so the result can be checked independently. The Al-Mahd inscription line is held strictly out and is not offered as a benchmark.

121. 【2608.22314】On the Choice of Tensor Estimation for Corner Detection, Optical Flow and Denoising

链接：https://arxiv.org/abs/2608.22314

作者：Freddie Åström,Michael Felsberg

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：iterative enhancement make, gradient energy tensor, gradient energy, corner detection, optical flow

备注：

点击查看摘要

Abstract:Many image processing methods such as corner detection, optical flow and iterative enhancement make use of image tensors. Generally, these tensors are estimated using the structure tensor. In this work we show that the gradient energy tensor can be used as an alternative to the structure tensor in several cases. We apply the gradient energy tensor to common image problem applications such as corner detection, optical flow and image enhancement. Our experimental results suggest that the gradient energy tensor enables real-time tensor-based image enhancement using the graphical processing unit (GPU) and we obtain 40% increase of frame rate without loss of image quality.

122. 【2608.22313】Adapting Dense Vision-Language Relationships for Multi-label Classification with Partial Label

链接：https://arxiv.org/abs/2608.22313

作者：Cheng Chen,Yifan Zhao,Jia Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large-scale datasets, challenging task, widely studied, superior trade-off, trade-off between high

备注：

点击查看摘要

Abstract:Learning multi-label image classification with incomplete annotations is a challenging task that has been widely studied for its superior trade-off between high efficiency and less labor consumption on large-scale datasets. Predominant methods rely on strong prior assumptions to recover the missing semantics from partial annotations. However, these statistic priors suffer from unstable semantic mistakes and thus lead to catastrophic overfitting. Toward this end, we propose a Language-driven Dense Semantic Adaptor (LDSA) that excavates prior-adaptive relationships from multimodal pretrained CLIP models. In our approach, the densely contrastive adaptor is first proposed to construct dense visual contrastive constraints, transferring the task-specific knowledge to visual domains. We then propose a language-driven interactive decoder with the help of class-specific prompt tuning, which adapts language proxies with visual domains. With the collaborative learning of proposed modules, experimental results demonstrate our proposed LDSA achieves a new state of the art on public multi-label classification benchmarks, and interpretable analyses reveal that our LDSA discovers implicit semantic relationships with the prior-adaptive learning scheme.

123. 【2608.22302】On Tensor-Based PDEs and their Corresponding Variational Formulations with Application to Color Image Denoising

链接：https://arxiv.org/abs/2608.22302

作者：Freddie Åström,George Baravdish,Michael Felsberg

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：partial differential equation, data term, smoothness term, partial differential, differential equation

备注：

点击查看摘要

Abstract:The case when a partial differential equation (PDE) can be considered as an Euler-Lagrange (E-L) equation of an energy functional, consisting of a data term and a smoothness term is investigated. We show the necessary conditions for a PDE to be the E-L equation for a corresponding functional. This energy functional is applied to a color image denoising problem and it is shown that the method compares favorably to current state-of-the-art color image denoising techniques.

124. 【2608.22300】Self-Calibrating Dense Displacement Fields for Reliable Co-Registration of Large Optical Satellite Imagery

链接：https://arxiv.org/abs/2608.22300

作者：Shoukun Sun,Zhe Wang,Sanaz Salati,Jiyin Zhang,Hui Wang,Xiaogang Ma

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：data fusion degrade, Co-registration underlies, carry documented offsets, optical satellite imagery, time series

备注：

点击查看摘要

Abstract:Co-registration underlies nearly every multi-temporal and multi-sensor use of optical satellite imagery, and operational products still carry documented offsets well above the fraction-of-a-pixel scale at which change detection, time series, and data fusion degrade. Real image pairs differ along several axes at once (sensor response, scene content, viewing geometry, resolution, mosaic seams), and the last of these is not a single global motion. Existing tools embed a motion model and constants tuned to their development data; a pair that fits is registered precisely, while one that does not either fails to match or returns a result wrong by tens of pixels with no failure reported. Learned matchers add a GPU requirement and carry no accuracy guarantee outside their training distribution. We present SCDF (self-calibrating displacement fields), a training-free, GPU-free estimator whose motion model is the dense per-pixel displacement field itself, so no scene motion falls outside the model. A single predict--measure--filter loop runs over a resolution pyramid: the accumulated field predicts where each patch of the moving image falls in the reference, RootSIFT matching and a correlation pass measure the displacement there to sub-pixel precision, and filters whose thresholds are all calibrated on the image pair itself decide what survives. One configuration, with no per-dataset tuning, processes full $8192^2$ scenes on a single CPU core. On 584 constructed-ground-truth pairs built from real Sentinel-2, Landsat-8/9, and NAIP imagery, against seven classical baselines and two zero-shot pretrained matchers, SCDF registers every pair with zero failures, reduces the best baseline's real-pair median end-point error from 6.83 to 4.17m, and cuts its 90th percentile from 17.8 to 7.77m.

125. 【2608.22299】argeted Iterative Filtering

链接：https://arxiv.org/abs/2608.22299

作者：Freddie Åström,Michael Felsberg,George Baravdish,Claes Lundström

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：applied denoising method, denoising results depends, medical images require, image denoising results, respective application area

备注：

点击查看摘要

Abstract:The assessment of image denoising results depends on the respective application area, i.e. image compression, still-image acquisition, and medical images require entirely different behavior of the applied denoising method. In this paper we propose a novel, nonlinear diffusion scheme that is derived from a linear diffusion process in a value space determined by the application. We show that application-driven linear diffusion in the transformed space compares favorably with existing nonlinear diffusion techniques.

126. 【2608.22296】ONAV: Task-Oriented Navigation and Action-Velocity Chunk Learning for Articulated Object Quadrupedal Mobile Manipulation

链接：https://arxiv.org/abs/2608.22296

作者：Haoran Lin,Mingyu Yang,Pengfei Qi,Kehan Chen,Qiang Diao,Liangji Zeng,Wenrui Chen,Yaonan Wang,Kailun Yang

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：tightly coupled capabilities, Quadruped mobile manipulation, maintaining stable contact, coupled capabilities, Quadruped mobile

备注： The project page is at [this https URL](https://haochen611.github.io/TONAV)

点击查看摘要

Abstract:Quadruped mobile manipulation requires two tightly coupled capabilities: reaching manipulation-ready configurations and maintaining stable contact throughout articulated-object interaction. However, existing methods often terminate navigation near the target, leaving a gap between reachability and manipulation readiness, while tracking lag, motion jitter, and contact instability limit continuous interaction. To address these challenges, we present TONAV, a unified framework integrating task-oriented navigation with action-velocity chunk learning. First, we introduce a position-velocity-coupled teleoperation framework that explicitly captures motion dynamics to improve master-follower consistency and collect smooth, temporally consistent demonstrations. Next, task-oriented navigation leverages vision-language reasoning to decompose high-level instructions into executable subgoals and adaptively refine the robot base toward a manipulation-ready configuration. Finally, action-velocity chunk learning jointly models joint positions and their temporal transitions under velocity supervision, enabling smooth and stable sustained-contact manipulation. Real-world experiments across diverse articulated-object tasks demonstrate that TONAV achieves higher success rates in both task-oriented navigation and complete mobile manipulation, mitigating the navigation-manipulation gap and improving continuous-contact interaction. The project page is at this https URL.

127. 【2608.22289】DECO: Depth-Guided Co-Visibility Reasoning for Low-Altitude UAV Visual Localization

链接：https://arxiv.org/abs/2608.22289

作者：Yibin Ye,Xichao Teng,Shuo Chen,Xiaokai Song,Dongdong Guan,Qifeng Yu,Zhang Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Unmanned aerial vehicles, increasingly require robust, Unmanned aerial, require robust visual, UAV images

备注：

点击查看摘要

Abstract:Unmanned aerial vehicles (UAVs) increasingly require robust visual localization in GNSS-denied environments. A common solution estimates UAV poses by matching keypoints between UAV images and geo-tagged orthographic reference maps derived from satellite or aerial imagery, followed by Perspective-$n$-Point (PnP) pose solving. However, such reference maps mainly record top-down surfaces such as roofs and ground planes, while vertical structures such as facades and walls are often compressed or missing. Consequently, many visually distinctive keypoints in low-altitude UAV images have no valid counterparts in the reference map, leading to redundant matches and inaccurate pose estimation. To address this issue, we propose DECO, a DEpth-guided CO-visibility reasoning framework for low-altitude UAV visual localization. DECO uses monocular depth priors to infer local surface geometry and estimate co-visible regions between UAV images and the reference map. Based on this prior, a Geometry-Saliency Coupled Co-visibility Score is introduced to jointly consider geometric co-visibility and detector saliency for keypoint ranking. In this way, DECO retains keypoints that are both visually distinctive and geometrically co-visible, improving feature matching and PnP-based pose estimation. Extensive experiments demonstrate that DECO achieves superior localization performance and can be integrated with different depth models, feature detectors, and matchers. The source code will be available at this https URL.

128. 【2608.22279】OVIBench: Benchmarking Online Video Question Answering under Interruption

链接：https://arxiv.org/abs/2608.22279

作者：Naiming Liu,Zhiheng Wu,Shuning Wang,Tie Zhang,Bowen Liu,Tong Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Recent vision language, achieved strong progress, Recent vision, vision language models, Online Video Question

备注： EMNLP 2026

点击查看摘要

Abstract:Recent vision language models (VLMs) have achieved strong progress in video understanding. However, most existing video QA research and benchmarks still follow an offline, single-round paradigm, overlooking realistic interactions where users may interrupt the model during answer generation. To address this gap, we formulate the task of Online Video Question Answering under Interruption and introduce OVIBench, the first standardized benchmark for evaluating VLMs in this setting. OVIBench categorizes interruptions into three types: Cancellation, False Trigger, Correction and supports both open-ended and multiple-choice evaluations. To enable large-scale and reproducible testing, we develop an offline simulation protocol that reproduces interruption during generation under a unified temporal setup, together with a multi-dimensional metric suite for assessing interruption understanding and response generation. Experiments demonstrate that OVIBench effectively distinguishes models' interruption-handling abilities, especially in following correction requests. Finally, we construct a train set OVI-Train for interruption-aware fine-tuning. Models fine-tuned on this dataset achieve significant gains on OVIBench, validating the effectiveness of our benchmark and data design. OVIBench, OVI-Train, and the evaluation code will be released.

129. 【2608.22272】GAN-Diff : Coupling Pretrained WGAN-GP Features with Conditional Diffusion U-Nets

链接：https://arxiv.org/abs/2608.22272

作者：Saif Ahmed,Ashadulla Hil Galib,S.M. Riaz Rahman Antu,Ahmed Faizul Haque Dhrubo,Souvik Pramanik,Mohammad Abdul Qayum,Mohsin Sajjad,Mohammad Ashrafuzzaman Khan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Generative adversarial networks, efficient image generation, require iterative sampling, provide efficient image, offer high-quality image

备注： 7 pages, 10 figures, 4 tables

点击查看摘要

Abstract:Generative adversarial networks (GANs) can provide efficient image generation, while diffusion models offer high-quality image restoration but require iterative sampling. This paper presents a hybrid GAN-guided diffusion framework that uses a pretrained Wasserstein GAN with gradient penalty (WGAN-GP) as a feature prior for conditional diffusion-based image restoration. Intermediate features from the frozen WGAN-GP generator are incorporated into a diffusion U-Net through cross-attention and remain fixed during the DDIM sampling process. The framework is evaluated on two restoration tasks, Gaussian denoising and 2Xsuper-resolution, using CelebA face images. During development, several sources of instability were identified and addressed, including adversarial learning-rate imbalance, inappropriate diffusion initialization, excessive corruption, and insufficient parameter averaging. The resulting framework consistently improves the quality of both degraded and low-resolution images. In particular, it improves denoising performance by 4.40 dB in PSNR and super-resolution performance by 3.70 dB over their respective input baselines. These results demonstrate the potential of a frozen GAN feature prior to guide diffusion models toward stable and effective image restoration.

130. 【2608.22263】raining-Free VLM Personalization via Calibrated Residual Decoding

链接：https://arxiv.org/abs/2608.22263

作者：Jiaao Yu,Yujian Ma,Xianming Hu,Pengran Wang,Ang Li

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：updating model parameters, directly providing user, Vision-language models, providing user profiles, inference time

备注：

点击查看摘要

Abstract:Vision-language models can be personalized in a training-free manner by directly providing user profiles, preferences, or visual references at inference time, without updating model parameters. However, direct personalized prompting does not guarantee that the model will reliably exploit such evidence. The predictive distribution under the positive user profile often mixes two sources: personalized signals genuinely supported by the current profile, and the model's generic visual or linguistic priors. As a result, from the positive-profile response alone, it is difficult to determine whether a high-confidence answer is supported by the user profile or merely reflects the model's default preference. To address this problem, we propose a training-free calibrated residual decoding framework. Given the same image and question, we construct three evidence conditions: a positive profile , a counterfactual profile , and an empty profile . Our method keeps the prediction under as the anchored base, and explicitly estimates the marginal contribution of personalization from score differences across the three conditions. We further introduce normalized-entropy-based uncertainty calibration, allowing the strength of personalized enhancement to adapt to the reliability of the residual signal. Experiments on MMPB, YoLLaVA, and MyVLM show that the proposed method improves personalized multimodal understanding without fine-tuning, with consistent gains on identity-sensitive visual personalization tasks. Additional analysis shows that entropy calibration stabilizes residual decoding when the contrastive personalization signal is uncertain.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2608.22263 [cs.CV]

(or
arXiv:2608.22263v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.22263

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

131. 【2608.22238】Hyper^2: Unleashing Hyperbolic Geometry's Full Potential via Dual-Space Consistency

链接：https://arxiv.org/abs/2608.22238

作者：Guantian Zheng,Haiyang Xu,Tianyu Gao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：pioneered hyperbolic geometry, Euclidean Chamfer distance, HyperbolicCD pioneered hyperbolic, gains are modest, reduction across SeedFormer

备注： 18 pages, 5 figures, 5 tables. Accepted to BMVC 2026

点击查看摘要

Abstract:HyperbolicCD pioneered hyperbolic geometry for point cloud completion by replacing the Euclidean Chamfer distance with arcosh(1+alpha||x-y||^2), but the reported gains are modest (3-7% Chamfer reduction across SeedFormer, PointAttN and PMP-Net backbones on PCN and ShapeNet-55). We argue the bottleneck lies elsewhere: the loss is hyperbolic but the encoder it back-propagates through is Euclidean, so the position-dependent supervision of the loss is averaged away by the chain rule before it reaches the parameters. We call this a cross-geometry mismatch, and make it testable through two model-agnostic indicators, feature-loss correlation r_FL and effective gradient utilisation u_G. On an SVDFormer backbone trained with HyperbolicCD's loss alone we measure (r_FL, u_G) = (0.68, 39%). We propose Hyper^2, a dual-space consistency framework that extends HyperbolicCD by reusing the identical arcosh(1+alpha d^2) functional form as a positional bias on the refinement attention (a hyperbolic distance encoding), paired with HyperbolicCD's hyperbolic Chamfer loss under a single shared curvature alpha. Both operators are O(N log N) scalar non-linearities on Euclidean distances and together add only ~1.6% FLOPs over SVDFormer. Hyper^2 delivers -22.9% Chamfer on ShapeNet-55 over SVDFormer (well above the 13.2% linear sum of the -12.0% loss-only and -1.2% encoding-only single-space ablations) and -37.5% on the 21 unseen ShapeNet-34 categories. The two indicators remain essentially flat for any single-space configuration but jump together to (0.95, 87%) only when both encoder and loss are hyperbolic, supporting the claim that geometric consistency across encoder and loss, rather than either operator alone, is what enables hyperbolic supervision in point cloud completion. Code is available at this https URL.

132. 【2608.22233】When Test-Time Adaptation Helps, Harms, or Becomes Inactive: A Condition-Level Study on CIFAR-10-C

链接：https://arxiv.org/abs/2608.22233

作者：Sreeja Guha Majumdar,Aratrika Saha

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：unlabeled test data, source model, Test-time adaptation, robustness under distribution, distribution shift

备注：

点击查看摘要

Abstract:Test-time adaptation (TTA) aims to improve model robustness under distribution shift by adapting a source model using unlabeled test data. Although methods such as TENT and EATA have demonstrated gains on corrupted data, aggregate accuracy can obscure the conditions under which adaptation fails or provides little benefit. We present a controlled comparison of three TTA strategies---BatchNorm-statistics adaptation (BN-Adapt), entropy-minimization adaptation (TENT), and reliability-filtered adaptation (a scoped re-implementation of EATA)---against an unadapted source model on the full CIFAR-10-C benchmark, covering 15 corruption types and 5 severity levels. All three methods improve mean accuracy over the source model by 12.2--13.3 percentage points (Wilcoxon signed-rank $p 10^{-12}$). However, each method underperforms the source model on 8.0--9.3\% of conditions, with failures concentrated in low-severity corruptions where the source model already performs near ceiling, particularly brightness, fog, contrast, and defocus blur. We further find that EATA closely tracks the gradient-free BN-Adapt baseline, with a mean absolute difference of 0.09 percentage points, compared with 1.08 percentage points relative to TENT. This suggests that reliability filtering can substantially restrict effective adaptation, causing EATA to behave more like a BatchNorm-statistics baseline than an entropy-minimization method. These results show that aggregate accuracy alone can mask systematic TTA failure modes and motivate condition-level evaluation of when adaptation helps, harms, or becomes effectively inactive.

133. 【2608.22232】Beyond What Meets the Eye: Unveiling Situational Illusions for Multimodal Large Language Models

链接：https://arxiv.org/abs/2608.22232

作者：Zhiming Yang,Zhuoxi Xiong,Donglin Zhou,Wenjun Wei,Shiyao Cui,Jinqiao Shi

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：underlying physical states, Real-world situation appearances, multimodal large language, large language models, physical states

备注： 9 pages, 5 figures

点击查看摘要

134. 【2608.22217】UR$^{2}$-MLLM: Uncertainty-aware Revisit Reasoning in Multimodal Large Language Models for Radiology Report Generation

链接：https://arxiv.org/abs/2608.22217

作者：Yucheng Chen,Yang Yu,Jiazhou Zhou,Yufei Shi,Yongying Lan,Yichi Zhang,Liyi Li,Si Yong Yeo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Radiologists generate diagnostic, generate diagnostic reports, generate diagnostic, iterative and selective, selective revisiting

备注： EMNLP 2026 Findings

点击查看摘要

Abstract:Radiologists generate diagnostic reports through iterative and selective revisiting of suspicious regions to refine their interpretations. Recent multimodal large language models (MLLMs) for radiology report generation (RRG) have shifted from text-only reasoning toward a ``Thinking-with-Images'' paradigm, incorporating visual evidence into the reasoning process. However, existing methods provide static visual evidence without a dynamic revisit mechanism during reasoning, neglecting how radiologists re-examine uncertain observations. To this end, we propose an Uncertainty-aware Revisit Reasoning MLLM (UR$^{2}$-MLLM) framework that dynamically revisits uncertain regions during reasoning for RRG. UR$^{2}$-MLLM is first equipped with uncertainty perception by training on an uncertainty-aware dataset. We then construct a multimodal reasoning trajectory dataset together with a detect-and-copy mechanism, which guides when and where to revisit. Finally, a visual grounding reward refines this behavior through reinforcement learning, aligning the revisited regions with corresponding anatomical structures. Experiments on MIMIC-CXR and IU-Xray show that UR$^{2}$-MLLM achieves state-of-the-art performance, highlighting the value of uncertainty-aware visual revisit reasoning for reliable and clinically aligned report generation.

135. 【2608.22193】SAM3Dual: A 3rd Place Solution to the MOSEv2 Track, 8th LSVOS Challenge

链接：https://arxiv.org/abs/2608.22193

作者：JeongRae Kim,Chaehyun Kim,Changwon Lim

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large-scale Video Object, Video Object Segmentation, Challenge at ECCV, Large-scale Video, Object Segmentation

备注： 3rd place solution to the MOSEv2 Track of the 8th LSVOS Challenge at ECCV 2026

点击查看摘要

Abstract:We present SAM3Dual, our third-place solution to the MOSEv2 track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge at ECCV 2026. SAM3Dual is a training-free inference extension of pretrained SAM 3 that explicitly separates temporal memory into a short-term branch for recent observations and a long-term branch for interval-sampled historical representations. The two memory responses are combined using a deterministic sequence-relative fusion schedule and conservatively modulated by the previous-frame object confidence. All pretrained SAM 3 parameters remain frozen, requiring no task-specific training, fine-tuning, test-time training, or online parameter optimization. The complete system achieved an official JF score of 64.37 and ranked third in the MOSEv2 track. This result highlights the potential of reorganizing temporal memory entirely at inference time to obtain competitive long-term VOS performance while preserving the pretrained model.

136. 【2608.22187】BehaviorWorldGen: Closing the Loop between Action Models and World Simulators via Controllable Behavior-Aware Structured World Generation

链接：https://arxiv.org/abs/2608.22187

作者：Jiaqi Wang,Zhuo Zhang,Haining Guan,Tingguang Zhou,Haowen Cui,Zhongyang Zhu,Yulong Zheng,ChuanYe Wang,Xuefeng Chen,Zhen Yang,Tianchen Deng,Feiyang Tan,Hangning Zhou,Bo Dai,Lixia Shen,Xiwu Chen,Xiyang Wang,Jiajun Zhu

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Modern driving action, Modern driving, simulator imagines future, imagines future observations, driving action models

备注：

点击查看摘要

Abstract:Modern driving action models are increasingly improved in a self-improvement loop, where a learned world simulator imagines future observations and the resulting data is fed back to refine the action model. However, the bottleneck of this loop lies in the simulators' inability to generate behaviorally plausible responses by surrounding agents, making generated data both unrealistic in interaction and imbalanced in distribution. We introduce BehaviorWorldGen, a framework that closes the loop between action models and world simulators through controllable behavior-aware structured world generation. Its core component is BehaviorFlow, a meta-action-conditioned traffic-flow model that injects interpretable behavior controls and jointly generates multi-agent rollouts. BehaviorFlow realizes the specified agent behaviors while allowing surrounding vehicles to respond to the ego and to one another. The resulting rollouts are rendered by a world simulator into realistic multi-view observations, which are paired with corrected interaction-aware trajectories for action-model refinement. Since BehaviorWorldGen uses structured trajectories as the interface between its modules, it is compatible with diverse action models and world simulators. Experiments on world generation, scene extrapolation, and policy refinement demonstrate consistent improvements, with the largest benefits concentrated on difficult interactive scenarios.

137. 【2608.22183】VERDICT: Agreement Beats Pixel-Space Verification in Real-Document OCSR

链接：https://arxiv.org/abs/2608.22183

作者：Yani Guan,Dengpan Dong,Shuang Luo,Zi Wei,Joah Han,Dan Hannah,Yumin Zhang,Qichao Hu,Kang Xu

类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：chemical training datasets, Chemical Structure Recognition, Optical Chemical Structure, large-scale chemical training, constructing large-scale chemical

备注：

点击查看摘要

138. 【2608.22174】When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?

链接：https://arxiv.org/abs/2608.22174

作者：Yubo Zhu,Zhehan Kan,Jingyi Yang,Miaolin Chen,Jinbo Xing,Kai Zhu,Zijian Wang,Sheng Zhong,Wei Tong

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Unified multimodal models, multimodal models, raising a central, central question, generation improve understanding

备注：

点击查看摘要

Abstract:Unified multimodal models (UMMs) can perform both understanding and generation, raising a central question: can visual generation improve understanding? Existing evaluations provide mixed evidence, but confound task difficulty, reasoning paradigms, and the closed-loop interaction between generation and understanding. We introduce VGAU-Diag, a fine-grained evaluation framework for vision generation-assisted understanding. It stratifies samples by difficulty, enables unified evaluation of multiple reasoning paradigms, and uses Oracle-Assisted Reference Protocols. Our analysis shows that generated visual aids help on easier instances but become unreliable as reasoning complexity increases. Oracle-assisted diagnosis further reveals that the main bottleneck often lies on the visual-understanding side rather than the visual-generation side, as current UMMs struggle to leverage even faithful visual aids. We also show that effective visual generation should target visual-understanding bottlenecks rather than add more reasoning steps, and identify a three-stage transition from task-irrelevant noise, to misleading plausible guidance, and finally to useful assistance. These findings would be useful to guide the development of better UMMs.

139. 【2608.22131】RACE: Artifact-Robust Statistical Shape Modeling from Imperfect Surface Scans - A Case Study in Craniosynostosis 3D Photography

链接：https://arxiv.org/abs/2608.22131

作者：Sanjay Bhandari,Nawazish Khan,Alzbeta Novotna,Tiffany Jeong,Loretta Bowman,Michael Hernandez,Tobi Somorin,Viraj Govani,Jesse Goldstein,Shireen Elhabian

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：quantify cranial morphology, heavily curated three-dimensional, existing workflows depend, statistical shape models, severity analysis increasingly

备注： Accepted at ShapeMI workshop at MICCAI 2026

点击查看摘要

Abstract:Craniosynostosis severity analysis increasingly relies on statistical shape models (SSMs) to quantify cranial morphology, but most existing workflows depend on computed tomography or heavily curated three-dimensional (3D) photographs. Raw clinical 3D photographs provide a radiation-free and repeatable alternative, yet often contain shoulders, hands, hair, clothing, scanner noise, and incomplete boundaries that corrupt correspondences. We introduce the Template-constrained Robust Artifact-aware Correspondence Estimation (TRACE) framework, an unsupervised method for constructing SSMs directly from artifact-contaminated clinical 3D head photographs. TRACE predicts sparse anatomically corresponding head-surface control points from the raw point cloud, refines them through a coarse-to-fine Surface-Aware Deformation cascade, and uses thin-plate spline warping to deform a clean template mesh into a subject-specific head reconstruction. This template-constrained formulation keeps dense correspondences on clinically relevant head anatomy while suppressing non-head artifacts. The correspondence module is decoupled from the point-cloud encoder, enabling the same deformation pipeline to be paired with different backbones, including PointNet, DGCNN, and Point Transformer V3. Across all backbones, TRACE substantially improves surface sampling, topology preservation, and shape-model quality over prior SSM methods, providing a scalable foundation for photograph-based craniosynostosis shape analysis and a framework that may extend to other artifact-contaminated surface scans when an appropriate clean template is available.

140. 【2608.22116】Vehicle speed dataset for the major European road network derived from Sentinel-2 imagery, 2022-2026

链接：https://arxiv.org/abs/2608.22116

作者：Maciej Adamiak,Sascha Fendrich,Julian Psotta,Alexander Zipf

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：European E-roads, observations on European, primary and secondary, years 2022-2026, individual vehicle speed

备注：

点击查看摘要

Abstract:The dataset provides individual vehicle speed observations on European E-roads: motorways, trunk roads, primary and secondary roads, as tagged in OpenStreetMap as e-road, for the years 2022-2026. Speeds are derived from Copernicus Sentinel-2 Level-2A satellite optical imagery using a processing pipeline that exploits the short, well-characterized acquisition delays between the blue (B02_10m), green (B03_10m), and red bands (B04_10m) of the Sentinel-2 push-broom instrument. A moving vehicle appears at slightly displaced positions in the three bands, forming a moving echo. The detected displaced intensity peaks are linked into per-vehicle trajectories through a prediction-and-matching procedure. The resulting displacements are converted into ground speeds using publicly accessible inter-band time delays. Each record contains the trajectory geometry, per-channel displacements and headings, internal quality indicators, the estimated speed, the acquisition timestamp, and the source Sentinel-2 product identifier. The dataset is distributed as GeoPackage files, with one record per detected vehicle, and can support studies of traffic patterns, speed behavior, transport modeling, and the calibration of road network attributes at a continental scale.

141. 【2608.22102】Learning Implicit Constitutive Laws for Dynamic 3D Gaussian Splatting from Monocular Videos

链接：https://arxiv.org/abs/2608.22102

作者：Xiaoyang Liu,Kai Han

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Gaussian Constitutive Alignment, deformable objects represented, Gaussian Constitutive, learning implicit constitutive, implicit constitutive laws

备注：

点击查看摘要

Abstract:We present GCA (Gaussian Constitutive Alignment), a framework for learning implicit constitutive laws from monocular dynamic video of deformable objects represented by 3D Gaussians. Given a static multi-view scan for geometric initialization, our method learns intrinsic physical dynamics solely from a single fixed-viewpoint video of the moving object. Existing implicit methods often suffer from local minima under noisy supervision and lack physical interpretability, while explicit approaches rely on predefined constitutive equations, limiting generalizability and becoming unstable in monocular settings. To address these challenges, our framework unifies LoRA-based adaptation with two key alignment modules. First, we propose Rank-based Depth-Geometric Anchors (RDGA) to establish robust geometric constraints from monocular dynamic observations via scale-invariant rank-based depth alignment, reducing the reliance on unreliable pixel-level color supervision. Second, a Constitutive Prior Regularizer (CPR) integrates classical constitutive models as soft differentiable priors, regularizing the optimization while preserving the flexibility of implicit modeling---even when the actual material is absent from the hypotheses. Extensive experiments on synthetic, real-to-sim, and real-world datasets demonstrate that GCA outperforms existing methods, achieving 48% lower Chamfer Distance than the strongest baseline on synthetic benchmarks while remaining robust under monocular supervision.

142. 【2608.22096】hree-Phase Scribble-Adaptive Curriculum Learning for autoPETV Grand Challenge

链接：https://arxiv.org/abs/2608.22096

作者：Libo Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Libo Zhang algorithmic, describes Libo Zhang, autoPETV Grand Challenge, report describes Libo, Zhang algorithmic solution

备注：

点击查看摘要

Abstract:This report describes Libo Zhang's algorithmic solution to autoPETV Grand Challenge on interactive lesion segmentation in whole-body PET/CT. Interaction is encoded as two additional input channels that rasterize the accumulated foreground and background scribbles, and a residual-encoder U-Net of about 140 million parameters is trained with a three-phase curriculum over 4000 epochs: the network first learns fully automatic segmentation with silent interaction channels, then observes ground-truth-derived scribbles under randomly sampled visibility modes, and finally adapts to its own mistakes through online simulation of up to five error-driven correction steps. Training draws on 1811 autoPET and DeepPSMA studies, and the submission ensembles the best and final checkpoints of five folds by logit averaging. In interactive five-fold cross-validation with six interaction steps, the final checkpoints reach a mean AUC-Dice of 3.836 and a mean AUC-DMM of 3.869, improving monotonically in every fold, with roughly half of the total gain delivered by the first corrective scribble. Our code and trained model checkpoints are available on this https URL.

143. 【2608.22082】When More References Hurt: Contamination-Aware DINOv2 Memory Banks for Few-Shot Steel Defect Detection

链接：https://arxiv.org/abs/2608.22082

作者：Hannaneh Kalantari,Javad Khoramdel

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：anomaly detectors assume, Patch-memory anomaly detectors, anomaly detectors, detectors assume, difficult to guarantee

备注：

点击查看摘要

Abstract:Patch-memory anomaly detectors assume that their reference bank is normal, an assumption that is difficult to guarantee when additional industrial images are unverified. We study whether a few trusted normal images can safely recover useful normal patches from such references without defect masks. Starting from the DINOv2 patch-memory formulation used by AnomalyDINO, we score candidate patches by distance to a clean seed bank, discard the most suspicious 20%, merge the retained patches with the seed, and enforce a fixed budget by greedy coreset selection. On Severstal, naive additional references contain 9.46% anomalous patches; the proposed trim rejects 78.1\% of them and reduces residual contamination to 2.59%. At an equal 51,200-patch development budget, the proposed bank reaches 0.1084 AUPRC versus 0.0950 for naive expansion, 0.0952 for random removal, and 0.1030 for eight clean images. Injecting only 0.5\% anomalous patches into a clean bank reduces AUPRC from 0.1030 to 0.0759. On all five completed held-out pairs, the proposed bank improves over naive expansion, with a mean gain of 0.0142 AUPRC. Reference purity is therefore a first-order design variable, and unverified images are useful only when their contribution is filtered explicitly.

144. 【2608.22072】Spiking Neural Networks for Energy-Efficient Object Detection in Forward-Looking Sonar Imagery

链接：https://arxiv.org/abs/2608.22072

作者：Gwenevere Frank,Gert Cauwenberghs

类目：Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)

关键词：Autonomous underwater vehicles, increasingly important tools, Autonomous underwater, underwater vehicles, ranging from research

备注：

点击查看摘要

Abstract:Autonomous underwater vehicles (AUVs) are increasingly important tools in industries ranging from research, to energy, to defense. AUVs are power-constrained platforms operating in remote environments with fixed battery capacities, where propulsion competes with compute and sensors for power over lengthy mission durations. AUVs frequently operate in dark or turbid waters where optical sensing is of limited value, and rely on sonar as their primary sensing modality. Convolutional neural networks (CNNs) are the state-of-the-art solution for object detection in forward-looking sonar imagery, but are energy expensive (e.g. YOLOv8m: 322 mJ/inference). Spiking neural networks (SNNs) rely on binary spike activations and thus sparse accumulate-only operations, allowing them to be remarkably energy efficient, particularly when paired with dedicated neuromorphic hardware. The sparse, high-contrast structure of forward-looking sonar (FLS) returns is structurally matched to spike coding in a way that optical imagery is not. No prior work has assessed the suitability of SNNs for object detection in FLS imagery. SpikeYOLO, a fully spiking network trained with surrogate gradients, was benchmarked against state-of-the-art CNN baselines on three FLS object detection datasets. Key results: SpikeYOLO T=2 achieves 3.3$\times$ lower theoretical compute energy on UATD (97 vs 322 mJ) at competitive accuracy (0.529 mAP@0.5:0.95 vs. YOLOv8m's 0.575); SpikeYOLO matches YOLOv8m on mAP@0.5 and outperforms YOLO-SONAR and Fast R-CNN baselines on the sparse Marine-Debris-FLS dataset at 4.4$\times$ lower energy; SpikeYOLO demonstrates superior robustness to multiplicative speckle noise (3.0% degradation at $\sigma{=}0.4$ vs. 8.9% for YOLOv8m), outperforming YOLOv8m outright at $\sigma{=}0.6$, directly relevant to real-world FLS deployment.

145. 【2608.22067】Inferring Action from Future Latent State for Robotic Manipulation

链接：https://arxiv.org/abs/2608.22067

作者：Fenghao Lei,Zhixiong Huang,Long Yang,Jiabao Chen,Jie Cheng,Peilin Huang,Han Fu,Zhuo Li,Xiaoxue Ren

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：build robot control, video-generation backbones, control on video-generation, robot actions, jointly predict dense

备注：

点击查看摘要

Abstract:World-Action Models (WAMs) build robot control on video-generation backbones, which jointly predict dense future visual trajectories and robot actions. We argue that video generation is an unnecessary intermediate objective for world-action modeling. For robotic manipulation, the goal of a world model is not to reproduce how the world looks at every intermediate moment, but to predict the state that the world will reach after an action is executed. The intermediate frames only describe the visual transition between physical states, which consumes substantial model capacity and computation, but do not directly specify the physical outcome that the robot action is intended to produce. In this paper, we propose DELE-w0.5, which infers robot actions from predicted future states without relying on video generation. Concretely, DELE-w0.5 infers the action sequence from its corresponding compact future latent state. The future latent state captures the action-relevant physical outcome of robot interaction and serves as an explicit bridge between world modeling and action generation. The core design principle of DELE-w0.5 is to model how the physical world changes under robot actions, rather than how its visual appearance evolves frame by frame. This formulation removes the high-dimensional visual redundancy introduced by dense video representations, and it therefore enables cheaper training and low-latency inference. Across 480 real-robot trials on four long-horizon manipulation tasks, our DELE-w0.5 achieves the best performance among all compared policies, attaining 62.5 overall full-task success and 81.3 macro ordered-stage progress, outperforming the strongest baseline by 47.5 and 30.7 percentage points, respectively.

146. 【2608.22066】ADMIL: Attention-Distilled Multiple Instance Learning for Selective Foundation Model Inference in Pathology

链接：https://arxiv.org/abs/2608.22066

作者：Duncan Stothers,Ren-Chin Wu,William Lotter

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Attention-based multiple instance, multiple instance learning, large image encoder, instance learning, Attention-based multiple

备注：

点击查看摘要

Abstract:Attention-based multiple instance learning (ABMIL) using pathology foundation model embeddings is effective for slide-level tasks, but exhaustive inference requires applying a large image encoder to every foreground tile despite the subsequent attention distribution often concentrating over a small subset of informative regions. We introduce ADMIL (Attention-Distilled Multiple Instance Learning), a selective-compute framework that distills an ABMIL teacher's attention into a lightweight tile-selection model, PriorNet. Using an EfficientNet architecture, PriorNet learns the teacher attention distribution from raw tile pixels with KL divergence; at inference, it scores the foreground pool, selects the top-K tiles, and invokes the expensive foundation model only on that subset before a selected-bag ABMIL student predicts the slide label. Across BRACS, PANDA, and CAMELYON16, ADMIL matches full-teacher headline performance at K=4, 8, and 128 tiles, respectively, avoiding 98% of foundation model (Virchow2) tile embeddings and model inference FLOPs. Random and teacher-attention oracle controls show that this result depends on task-relevant selection rather than tile-count reduction alone. Quantitative and qualitative analyses suggest that PriorNet recovers the teacher's tile ordering with high fidelity while focusing on task-relevant morphological regions. ADMIL shows that nearly all expensive tile encodings can be removed without sacrificing slide-level performance, providing a potential path for more efficient deployment in clinical settings where latency and compute costs are key considerations.

147. 【2608.22064】Competitive Memory Readout for Robust Video Object Segmentation: 2nd Place Technical Report for the MOSEv2 Track of the 8th LSVOS Challenge

链接：https://arxiv.org/abs/2608.22064

作者：Mingqi Gao,Sijie Li,Jungong Han

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large-scale Video Object, Video Object Segmentation, Large-scale Video, Object Segmentation, Video Object

备注：

点击查看摘要

Abstract:We present our solution for the MOSEv2 track of the 8th Large-scale Video Object Segmentation (LSVOS) Challenge at ECCV 2026. The challenge evaluates robust video object segmentation under complex temporal dynamics, including long-term occlusion, disappearance and reappearance, large appearance changes, and strong interference from visually similar objects. Our method builds on SAM~3 and focuses on its memory readout. Standard target-only memory retrieval can confuse the annotated target with same-class non-target objects because such distractors are represented only implicitly as background. Our method introduces Competitive Memory Readout, which explicitly incorporates same-class competitor evidence when retrieving target information from memory. To prevent excessive suppression of weak or reappearing targets, we further apply a lightweight adaptive restoration rule after competition. The resulting system retains the original SAM~3 tracking pipeline while improving target identity preservation in challenging videos. Our submission achieves 66.20 on the primary challenge score and ranks 2nd in the MOSEv2 track.

148. 【2608.22054】Robust Global Structure-from-Motion via View Graph Pruning

链接：https://arxiv.org/abs/2608.22054

作者：Jiamin Xu,Lixing Yao,Weichen Dai,Renshu Gu,Zunjie Zhu,Weiwei Xu,Gang Xu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：estimate camera poses, aims to estimate, global SfM, camera poses, SfM

备注：

点击查看摘要

Abstract:Structure-from-Motion (SfM) aims to estimate camera poses and reconstruct 3D structures from a collection of unordered images. Compared with incremental SfM, global SfM achieves better scalability by jointly estimating camera poses based on a view graph constructed from pairwise correspondences. However, its performance is highly sensitive to erroneous edges caused by visually ambiguous matches, which may lead to incorrect camera registration and reconstruction artifacts. In this work, we propose a subgraph-guided view graph pruning framework for robust global SfM. Our key idea is to exploit the internal consistency of reliable subgraphs to identify and remove unreliable connections. Specifically, we first partition the view graph into locally consistent subgraphs and perform global SfM within each subgraph to obtain reliable camera poses. We then apply RANSAC-based edge pruning across subgraphs to remove inconsistent edges, and finally perform global SfM on the refined view graph. Extensive experiments on ambiguous, sequential, and unordered image datasets demonstrate that our method improves the robustness of global SfM under challenging conditions. Further evaluation with neural rendering shows that the improved camera estimation leads to higher-quality novel view synthesis results.

149. 【2608.22039】ORBIT++: Benchmarking SfM in the Wild with 360° Video

链接：https://arxiv.org/abs/2608.22039

作者：Sara Sabour,Linyi Jin,Richard Tucker,Amir Hertz,Marcus Brubaker,Saurabh Saxena,Junhwa Hur,Andrea Tagliasacchi,Deqing Sun,David J. Fleet,Richard Szeliski,Noah Snavely

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：complex videos involving, fail when applied, applied to complex, involving challenging camera, dynamic scenes

备注： A revision was Accepted at CVPR 2026

点击查看摘要

Abstract:Structure-from-Motion (SfM) is a cornerstone of 3D perception, yet current methods often fail when applied to complex videos involving challenging camera motions or dynamic scenes. Compounding the problem, the field lacks reliable ground-truth benchmarks for such difficult scenarios, making it hard to gauge real-world progress or to pinpoint where improvements are most needed. To address this gap, we introduce a new benchmark for evaluating camera pose estimation. Our key insight is to leverage online panoramic 360° video as a source of data from which to construct challenging clips, while still enabling robust ground-truth trajectory recovery. The panoramic nature of these videos provides richer visual context for tracking camera motion, even when parts of the view are affected by blur, motion, or dynamic objects. After tracking camera motion across full 360° videos, we crop and reproject selected portions to generate perspective-view clips that serve as our benchmark, called ORBIT. Experiments show that COLMAP, as well as recent optimization-based and feed-forward SfM methods struggle to accurately estimate camera poses on our benchmark. Hence, ORBIT provides a valuable testbed where researchers can meaningfully measure progress on truly challenging, real-world SfM problems.

150. 【2608.22003】Close Shortcut Wins Long: Seeking Diverse and Stable Generators for Data-Free Knowledge Distillation

链接：https://arxiv.org/abs/2608.22003

作者：Kailin Lyu,Zherui Zhang,Junhao Dong,Kexue Fu,Weiguang Pang,Rongtao Xu,Qizheng Wang,Di Wu,Chee-Keong Kwoh,Longxiang Gao,Shibiao Xu,Changwei Wang,Ce Hao,Yu Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Data-Free Knowledge Distillation, real data access, Knowledge Distillation, Data-Free Knowledge, transferring knowledge

备注： 12 pages, 8 figures

点击查看摘要

Abstract:Data-Free Knowledge Distillation (DFKD) preserves privacy by transferring knowledge without real data access. However, existing generator-based DFKD methods suffer from over-reliance on teacher preferences and pattern collapse, exhibiting "generative shortcut learning" in the frequency domain: dependent on specific frequency components and frequency positions, resulting in inconsistent synthetic image quality and class diversity. In this paper, we propose a CSWL framework aimed at introducing insights from the frequency domain perspective to improve generator diversity and training stability to Close the phenomenon of Shortcut learning to Win in the Longer term. To address the issue of generative shortcut learning, we introduce frequency-domain augmentation at the feature level, encouraging the generator to attend to the full frequency spectrum and thereby suppress shortcut learning behavior. To tackle training instability, we propose a Cross-Stage Frequency Reconstruction (CSFR) auxiliary task, which implicitly constructs an Exponential Moving Average (EMA) mechanism to promote long-term optimization and stability. Extensive experiments, including downstream tasks and various image recognition datasets at multiple resolutions, validate the effectiveness of CSWL in improving both diversity and stability from the frequency view.

151. 【2608.21972】Improved denoising diffusion probabilistic models with efficient non-diagonal covariance modeling

链接：https://arxiv.org/abs/2608.21972

作者：Rui Xia,Ayan Das,Artem Artemev,Andi Zhang,Guillaume Hennequin,Alberto Bernacchia

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

关键词：Diffusion Probabilistic Models, Denoising Diffusion Probabilistic, Diffusion Probabilistic, leveraging second-order information, larger sampling steps

备注： 29 pages, 11 figures

点击查看摘要

Abstract:The sampling process of Denoising Diffusion Probabilistic Models (DDPMs) can be accelerated by leveraging second-order information in the form of approximations to the denoising posterior covariance -- allowing samples of acceptable quality to be produced in fewer but larger sampling steps. Previous attempts at using such information have used drastic (e.g.\ diagonal) simplifications of the covariance. These do not do justice to the peculiar statistical structure of natural images, which exhibit strong non-diagonal correlations between pixels and color channels, and a slow-decaying power-law frequency spectrum. Here, we develop a novel covariance model that captures these features. Our Kronecker-DCT (K-DCT) model uses a Kronecker-factored decomposition of inter-color covariances and spatial covariances modeled in the frequency domain using the Discrete Cosine Transform (DCT). The use of the DCT reduces the computational complexity from quadratic to log-linear, resulting in negligible computational and memory overhead in each denoising step. By learning K-DCT-structured amortizations of the denoising posterior covariance using pre-trained score models on CIFAR-10, Celeb-A, ImageNet and LSUN datasets, we show improved performance compared to previous SOTA denoising samplers, both in terms of FID and likelihoods, especially in the regime of few denoising steps.

152. 【2608.21970】Retrieval-Augmented Visual Prompting: Guiding Foundation Models in Two-Photon Imaging

链接：https://arxiv.org/abs/2608.21970

作者：Salvatore Calcagno,Marco Finocchiaro,Giovanni Bellitto,Daniela Giordano,Concetto Spampinato,Federica Proietto Salanitri

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：image appearance varies, appearance varies substantially, Two-photon calcium imaging, Two-photon calcium, calcium imaging presents

备注： 14 pages, 4 figures, 6 tables. Supplementary material included

点击查看摘要

Abstract:Two-photon calcium imaging presents a challenging setting for foundation models: image appearance varies substantially across recordings and experimental conditions, annotations are scarce, and rapid adaptation is often needed. Rather than adapting model weights through fine-tuning, we ask whether a foundation model can be guided at inference time by injecting external visual memory directly into its input. We implement this idea with SAM 3 and introduce Retrieval-Augmented Visual Prompting (RAVP), a framework in which each target tile is augmented with a retrieved annotated exemplar whose bounding box is used as a concept prompt. RAVP turns retrieval into a form of visual prompting and enables adaptation through input design alone. We study multiple exemplar selection strategies, including fluorescence-guided heuristics and a lightweight recall predictor trained to estimate which exemplar is most informative for a target tile. Experiments on the Allen Brain Observatory show that exemplar-augmented inference consistently strengthens zero-shot neuron detection and instance segmentation. Ablation studies further show that a single carefully selected exemplar is more effective than prompting with multiple retrieved examples. These results position inference-time visual memory injection as a simple and effective alternative to parameter adaptation for foundation models in specialized biomedical imaging.

Comments:
14 pages, 4 figures, 6 tables. Supplementary material included

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.21970 [cs.CV]

(or
arXiv:2608.21970v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.21970

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

153. 【2608.21967】rustworthy Visual Quality Inspection under Data Scarcity in Manufacturing

链接：https://arxiv.org/abs/2608.21967

作者：Panagiotis Sapoutzoglou,Jessy Ribaira,Martin Kanounnikoff,Bas Tijsma,Christian Geiß,Maria Pateraki

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Automated visual inspection, Automated visual, inconsistent manual checks, reserving human expertise, automate routine inspection

备注： Accepted at International Conference on the Economics of Grids, Clouds, Systems, and Services (GECON) 2026

点击查看摘要

Abstract:Automated visual inspection in manufacturing aims to replace slow and inconsistent manual checks, but its economic value depends on whether its decisions can be trusted enough to automate routine inspection while reserving human expertise for ambiguous cases. In production-line settings, defective samples are scarce, since the process is optimized to produce good parts, which limits any learning-based inspector trained on real data alone. Compounding this, defect decisions emitted as hard labels with no confidence estimate carry an asymmetric cost: a false reject wastes a good product, while a false accept may increase the risk of undetected defects progressing through the production process. We address both problems by mitigating data scarcity through the generation of synthetic defective samples with a diffusion model, and meeting the need for confidence-aware decisions with a Bayesian classifier that defers ambiguous units to human review rather than misclassifying them. These components are embedded in a staged pipeline of successive, complementary checks. We evaluate how synthetic augmentation affects classification and localization on a test set of real defects, and examine the system's trustworthiness at three points: the decision, the synthetic data, and the pipeline structure. This work-in-progress reports preliminary results suggesting that diffusion-generated defects, combined with uncertainty-aware classification, can lower the cost of reaching a trustworthy, deployable inspection model under data scarcity.

154. 【2608.21948】Sparse Multi-Stage Expert-Agent Routing for Complex Clinical Reasoning

链接：https://arxiv.org/abs/2608.21948

作者：Sike Xiang,Shuang Chen,Qian sun,Jia Cheng,Yusi Wei,Amir Atapour-Abarghouei

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：limited consultation resources, Complex clinical reasoning, Complex clinical, clinical reasoning, update diagnostic hypotheses

备注：

点击查看摘要

Abstract:Complex clinical reasoning requires models to update diagnostic hypotheses as new evidence emerges and to coordinate different medical specialities under limited consultation resources. Existing LLM-based clinical reasoning systems typically perform single-pass prediction or rely on fixed multi-agent workflows, making expert participation either static or unnecessarily exhaustive. We propose Sparse Multi-Stage Expert-Agent Routing, a language-based clinical reasoning framework that models diagnosis as a stage-wise routing process. Given progressively available clinical evidence derived from multiple modalities, the framework maintains an evolving case state and adaptively activates a sparse set of medical expert agents, supported by expert-specific memory across stages. To evaluate free-text diagnostic conclusions beyond surface similarity, we further introduce ClinFEScore, a fact-aware semantic evaluation protocol for clinical reasoning outputs. On reconstructed multi-stage cases from MAC and AgentClinic-NEJM, our framework reduces the average number of activated experts from 17.0 to 3.0 whilst maintaining strong fact-level diagnostic quality. On 200 real-world hospital MDT cases, ClinFEScore correlates strongly with clinician judgements (Spearman's $\rho=0.81$; Pearson's $r=0.87$), whilst our method achieves 91.5\% clinician-verified diagnostic accuracy with approximately five expert-agent/LLM calls per case. These results support sparse stage-wise coordination as an efficient and clinically relevant approach to LLM-based clinical reasoning.

155. 【2608.21937】C$^2$Path: Class-Conditional Pathway Decoupling for Vision-Language Incremental Object Detection

链接：https://arxiv.org/abs/2608.21937

作者：Lecheng Xu,Feifei Shao,Ouyangzi Ye,Zhen Wang,Lin Li,Kexin Li,Zhao Wang,Changqin Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：preserving previously acquired, Incremental Object Detection, previously acquired knowledge, Object Detection, continuously learn

备注：

点击查看摘要

Abstract:Incremental Object Detection (IOD) aims to enable detectors to continuously learn novel categories while preserving previously acquired knowledge. However, existing methods suffer from two forms of \textbf{class knowledge coupling}: class boundary erosion induced by shared parameter updates and class representation entanglement arising from mixed feature encoding. We argue that effective incremental learning requires class-specific computational pathways that enable isolated parameter updates and separated class-wise injection. To this end, we propose \textbf{C$^2$Path}, a class-conditional pathway decoupling framework for vision-language incremental object detection that leverages token-level class cues to establish dedicated and updatable computational pathways for different categories. Specifically, C$^2$Path introduces a category expert library and a class-conditional decoupling module. The expert library consists of learnable low-rank computational nodes that capture category-specific knowledge, while the decoupling module generates class-aware routing signals to dynamically compose \textit{ClassLoRA} adapters from these experts, thereby forming class-specific computational pathways for isolated updates and separated injection across categories. Extensive experiments on COCO 2017 under multiple incremental learning settings demonstrate that C$^2$Path consistently outperforms state-of-the-art methods, providing an effective and scalable solution for continual category expansion in vision-language detectors.

156. 【2608.21926】AirAlign: Geometry-Aware Relative Pose Alignment for UAV Last-Meter Navigation

链接：https://arxiv.org/abs/2608.21926

作者：Jinyi Zhou,Shuo Feng,Yufei Wu,Piji Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Unmanned aerial vehicle, navigation increasingly important, modern low-altitude environments, low-altitude environments requires, final approach stage

备注：

点击查看摘要

Abstract:Unmanned aerial vehicle (UAV) navigation in modern low-altitude environments requires more accurate pose alignment in the final approach stage for target information acquisition or manipulation, making "last-meter" navigation increasingly important. However, severe viewpoint and appearance variations make this task challenging. To tackle this problem, we propose AirAlign, a framework for RGB-only image-pair relative pose alignment for UAVs. AirAlign uses a pretrained visual geometry reconstruction model as the backbone to extract geometry-aware features from source-target image pairs. In addition, to better utilize the limited training data, we split the training set into multiple scene-disjoint folds for unseen cross-validation and model selection. During inference, the predictions of the selected models are averaged to form the ensemble output of the overall framework. Experiments on the PairUAV challenge at the ACMMM 2026 Workshop on UAVs in Multimedia demonstrate the effectiveness and robustness of our method, while comprehensive ablation studies validate the contribution of each component.

157. 【2608.21913】Entity-Constrained CBCT Retrieval for Low-Resource Dental Record Completion

链接：https://arxiv.org/abs/2608.21913

作者：Nhi Ngoc-Yen Nguyen,Thai Nguyen,Kiet Huynh Cao Tuan,Huy-Hieu Pham

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Completing dental records, cone-beam computed tomography, individual clinical fields, Completing dental, computed tomography

备注： Accepted at the ODIN 2026 Workshop, MICCAI 2026

点击查看摘要

Abstract:Completing dental records from cone-beam computed tomography (CBCT) is difficult when annotation is scarce and individual clinical fields are supported by different types of evidence. MMDental Task 3 requires seven-field record completion from only 50 labeled CBCT cases and scores the correctness of structured FDI positions and ICD codes; consequently, a visually plausible retrieved record can still be harmful when it introduces an unsupported entity. We propose Entity-Constrained CBCT-Guided Retrieval (ECCR), a parameter-free framework that separates evidence availability from evidence authority. A corpus-derived prior first supplies the complete record. A frozen 3D encoder retrieves image-conditioned Diagnosis evidence, which is appended only if it does not expand the prior FDI or ICD entity set, so the asserted entity set is invariant by construction. On public validation, ECCR reaches a weighted score of 0.3134, improving on both full-record multimodal retrieval (0.2237) and a static text-only prior (0.2915); the guard blocks 63.3% of retrieved candidates, each of which would otherwise have injected an FDI position or ICD code absent from the prior. On the final test evaluation, ECCR obtains 11.37 of a 97.4-point attainable maximum, securing second place overall. The result indicates that, in an extreme low-resource setting, controlling what multimodal evidence is allowed to modify can be more reliable than transferring an entire retrieved record.

158. 【2608.21893】A Scalable Vector Graphics Latent Space

链接：https://arxiv.org/abs/2608.21893

作者：Leonardo Zini,Elia Frigieri,Lorenzo Baraldi

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：deep learning community, learning community lacks, foundational building block, Scalable Vector Graphics, resolution-independent visual content

备注： Accepted at The 19th European Conference on Computer Vision -- ECCV 2026

点击查看摘要

Abstract:Scalable Vector Graphics are a fundamental medium for resolution-independent visual content, yet the deep learning community lacks a continuous, dense, and invertible latent space for vector representations, the kind of foundational building block that Variational Autoencoders and their descendants have long provided for raster images. We introduce SLS (SVG Latent Space), a Transformer-based autoencoder that learns compact dense representations of individual SVG paths, the atomic visual elements from which any SVG image can be composed. By modeling SVG commands, coordinate data, and visual properties within a unified BPE-based token vocabulary, SLS learns fixed-size latent representations that jointly capture structure and appearance, and can be decoded back into valid, style-consistent SVG paths with high fidelity. The resulting embedding space is robust, invertible, and structured: embeddings lie on a unit hypersphere, enabling efficient similarity search, composition, and downstream conditioning through simple vector-space operations. Finally, we demonstrate that SLS generalizes across diverse tasks reducing their FLOPs by over 150 times compared to token-based approaches, and establishing a general-purpose latent foundation for vector graphics research.

159. 【2608.21885】Pixel-Space Diffusion via Observation Operators

链接：https://arxiv.org/abs/2608.21885

作者：Shaojie Guo,Lichen Ma,Haoyang Tong,Yu He,Zipeng Guo,Xiaoan Liu,Feng Yan,Yu Guo,Fei Wang,Junshi Huang,Yan Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Pixel-space diffusion models, Pixel-space diffusion, diffusion models directly, difficult to optimize, models directly model

备注：

点击查看摘要

Abstract:Pixel-space diffusion models directly model image distributions but remain difficult to optimize. Recent methods alleviate this challenge through target reparameterization, while still relying on a fixed clean-image target throughout denoising. Through empirical analysis, we identify a scale-time mismatch: image structures become predictable from coarse to fine as noise decreases, whereas existing models are forced to predict the full image even under high noise, resulting in low-SNR gradients that hinder optimization. To resolve this mismatch, we propose Observation Operator Diffusion, a unified framework that aligns both the supervision trajectory and feature refinement with the intrinsic recovery order of image structures. Specifically, we replace fixed full-image supervision along the standard flow path with a time-indexed observation trajectory that evolves from coarse structures to the full image during denoising. This trajectory is instantiated with a family of Gaussian-Lanczos operators at varying observation scales, yielding a path-consistent training objective. We further introduce GL-CoDA, a decoder that injects scale-specific Gaussian-Lanczos observations across decoding stages for coarse-to-fine feature refinement. Extensive experiments show that the proposed approach converges substantially faster while consistently improving generation quality, achieving an FID of 1.52 on ImageNet-256.

160. 【2608.21883】VIG: Visual Information Gain as a Reward Signal for Multimodal Chain-of-Thought Compression

链接：https://arxiv.org/abs/2608.21883

作者：Wen Luo,Xiaohan Yi,Xiaotao Huang,Liqun Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：inflate inference cost, repeated visual descriptions, rely on long, visually-disengaged filler, inflate inference

备注： Accepted by EMNLP 2026 Findings

点击查看摘要

Abstract:Multimodal large reasoning models often rely on long Chain-of-Thought (CoT) traces in which a substantial fraction of tokens, such as repeated visual descriptions, self-reflection, and other visually-disengaged filler, inflate inference cost without contributing to the answer. Existing CoT compression methods optimize output length but never measure whether a reasoning token is actually grounded in the image. We propose \textbf{VIG} (Visual Information Gain), an information-theoretic GRPO reward that scores each reasoning token by how much the image reduces its predictive uncertainty. VIG is computed online from two forward passes of the same policy, one with and one without the image, so no reference chains, external annotations, or auxiliary reward models are needed. Across six main multimodal reasoning benchmarks and three Qwen3-VL-Thinking model sizes (2B/4B/8B), plus an additional R1-Onevision-Bench evaluation on 8B, VIG consistently improves the accuracy--efficiency trade-off, supporting our central claim: \emph{efficient multimodal reasoning emerges from raising visual information density, where every reasoning token earns its place by anchoring to the image, rather than from imposing a length budget.} Our source code is available at this https URL.

161. 【2608.21881】Region-Weighted Losses and Model Fusion for Cross-Modal PET Attenuation Correction

链接：https://arxiv.org/abs/2608.21881

作者：Khoa Tuan Nguyen,Joris Vankerschaver,Wesley De Neve

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Cross-Modal Attenuation Correction, Big Cross-Modal Attenuation, Attenuation Correction, Hounsfield Units, Attenuation-Corrected PET

备注： ntkhoa team submission for BIC-MAC MICCAI26 challenge ( [this https URL](https://www.codabench.org/competitions/12555/#/results-tab) )

点击查看摘要

Abstract:We describe our approach to the Big Cross-Modal Attenuation Correction (BIC-MAC) challenge, which asks for a pseudo-CT in Hounsfield Units to be synthesized from Non-Attenuation-Corrected PET (NAC-PET), DIXON MRI and a topogram, and scores both the pseudo-CT and the Attenuation-Corrected PET (AC-PET) reconstructed from it. Three ideas carried our improvements over the organizers' 3D U-Net baseline. The loss matters more than the architecture: we compute the $L_1$ error in the Carney attenuation-coefficient ($\mu$) space that the CT metric itself uses, weighted by anatomical region. Only once that loss was in place did the unregistered DIXON MRI work as extra input channels. A fixed convex combination of two independently trained models then beat both of its members on three of the four metrics and ranks first overall on the public validation leaderboard.

162. 【2608.21878】ViSMoE: Visual-Aware Sparse Mixture-of-Experts for Embodied Referring Expression Grounding

链接：https://arxiv.org/abs/2608.21878

作者：Shuo Feng,Piji Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Referring Expression Grounding, Embodied Referring Expression, Referring Expression, Expression Grounding, natural language instructions

备注： Accepted by ICANN 2025

点击查看摘要

Abstract:Embodied Referring Expression Grounding is the task of enabling an agent to navigate in real environments and to localize a remote object based on natural language instructions. In this scenario, the agent needs to select one view for navigation at each step and identify a specific object among all candidate objects at the destination. However, most of the previous approaches fail to distinguish between views and objects, instead processing them using the vanilla vision encoder, which results in ambiguous representations of both views and objects. To address the above issues, we propose ViSMoE, which equips sparse Mixture-of-Experts with a visual-aware routing policy for the embodied agent. This framework processes different types of visual information specifically, resulting in discriminative visual representations for both views and objects. Experimental results on REVERIE and SOON datasets demonstrate that ViSMoE outperforms the previous state-of-the-art methods, showing the superiority of our proposed method.

163. 【2608.21869】GuardPaint:SpeculativeSafetyDecodingforText-to-ImageGeneration

链接：https://arxiv.org/abs/2608.21869

作者：Shreyash Dhoot,Paras Dhiman,Arsh Abbas Naqvi,Aranbi Dutta,Aman Chadha,Vinija Jain,Amitava Das

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：critical safety challenge, offer powerful visual, models offer powerful, powerful visual generation, diffusion models offer

备注：

点击查看摘要

Abstract:Text-to-image (T2I) diffusion models offer powerful visual generation, but their controllability creates a critical safety challenge: adversarial prompts can steer the denoising trajectory toward policy-violating content such as explicit nudity or graphic violence. Existing safeguards mostly act before generation through prompt filtering or after generation through image classification, leaving the diffusion process itself unguarded and often yielding only refusal rather than safe visual repair. We introduce GuardPaint, a speculative decoding framework for safe T2I generation that intervenes inside the diffusion trajectory without modifying the base model. A lightweight auditor monitors intermediate images, localizes unsafe regions, and triggers surgical inpainting repair only where needed. Candidate repairs are generated by a policy-aligned inpainter and selected through a guarded tournament that accepts edits only when they improve policy compliance while preserving prompt fidelity and perceptual quality. Across five jailbreak families SneakPrompt, MMA, PGJ, DACA, and RABell and UNet/flow-matching models including SD~1.5, SDXL, SD~3.5, and FLUX.1-dev. GuardPaint reduces attack success and harmful generations with minimal degradation to image quality, prompt fidelity, and benign behavior. Content warning: This paper contains examples involving nudity and violence that some readers may find disturbing, distressing, or offensive.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2608.21869 [cs.CV]

(or
arXiv:2608.21869v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.21869

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Shreyash Santosh Dhoot [view email] [v1]
Sat, 22 Aug 2026 09:28:30 UTC (8,206 KB)

164. 【2608.21864】BioMed-Agent-RL: A Meta Learning, All You Need for Biomedical Applications

链接：https://arxiv.org/abs/2608.21864

作者：Md Asaduzzaman Jabin,Zihao Wu,Tianming Liu

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Large Language Models, Vision Large Language, Large Language, improved digital diagnostics, substantially improved digital

备注：

点击查看摘要

Abstract:The current progress of Clinical Vision Large Language Models (C-VLLMs) has substantially improved digital diagnostics, still these frameworks often endure lesion noises, modality misalignment, hallucination, and missed contextual grounding in complex clinical cases. Moreover, prevailing agent systems usually depend on static and non-adaptable pipelines and lack the versatility necessary for complex medical reasoning. To resolve these difficulties, we present BioMed-Agent-RL, a unified medical agent that incorporates adaptive orchestration, policy, and reward-based reinforcement learning (RL) models for biomedical applications. To ensure reliability, it invokes clinical context-aware preference optimization (CPO), direct preference optimization (DPO), and group relative policy optimization (GRPO) with dynamic entropy regulation. This pipeline utilizes a multimodal meta-learning approach that operates as a field-specific expert and human judgment synthesizer. The agent adaptively utilizes a set of model-level expertise, such as clinical grounding and reasoner, lesion segmenter, and field-specific synthesizer, across various clinical modalities (e.g., X-ray) by utilizing an iterative and adaptive RL approach. The agent learns to seriously synthesize misleading, conflicting vision cues and trust in inherent reasoning, while specialist advice is faulty. An intensive ablation study is conducted across multiple benchmarks, and the agent significantly outperforms existing state of the art models, such as GPT-5, attaining up to ~73% accuracy (gain of ~5%) over contemporary baselines. As a result, the framework suggests a new standard for building factual, reliable, robust, and expert-like intelligent agent systems for independent clinical reasoning.

165. 【2608.21854】Frame-Level Evaluation in Weakly Supervised Video Anomaly Detection Mostly Measures Video-Level Ranking

链接：https://arxiv.org/abs/2608.21854

作者：Inpyo Song,Jangwon Lee

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Weakly supervised video, Weakly supervised, commonly evaluated, Weakly, video

备注： Preprint

点击查看摘要

Abstract:Weakly supervised video anomaly detectors are trained with video-level labels but are commonly evaluated as temporal localizers using Micro-AUROC or AP over pooled test frames. Because these metrics compare frames from different videos, a detector can score well by separating videos without accurately ordering moments within them. We exactly decompose Micro-AUROC by video identity into Within-AUROC for temporal ordering within videos and Cross-AUROC for comparisons across videos. Across ShanghaiTech, XD-Violence, and UCF-Crime, only 0.071-0.388% of comparisons between anomalous and normal frames occur within the same video. When both classes remain distributed across V videos, this share decreases as O(1/V), a benchmark property we call temporal dilution. We train anomaly video binary classifiers under the same video-level supervision and repeat each video score across all frames. These video-constant outputs reach 81.40-97.18 Micro-AUROC despite having no within-video variation. Across 72 controlled runs, replacing every frame score with its video mean preserves a median 98.6% of the Micro-AUROC margin above chance. The same empirical pattern holds for author-released outputs and for XD-Violence under its official AP evaluation. A detector can therefore achieve a high pooled score even when it assigns the same score to every moment within each video.

166. 【2608.21849】GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors

链接：https://arxiv.org/abs/2608.21849

作者：Xinhui Liu,Can Wang,Wei Jiang,Wei Wang,Dong Xu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Gaussian Splatting, exhibit noticeable artifacts, achieved remarkable success, view synthesis, noticeable artifacts

备注：

点击查看摘要

Abstract:3D Gaussian Splatting (3DGS) has achieved remarkable success in novel view synthesis; however, reconstructions under sparse views often exhibit noticeable artifacts. While recent video diffusion models provide strong spatio-temporal priors for 3DGS restoration, directly fine-tuning them for restoration is suboptimal, as they lack awareness of the underlying multi-camera geometry, resulting in multi-view inconsistencies. In this work, we propose a novel 3D-aware video restoration framework designed to enhance the quality of sparse 3DGS reconstruction. Specifically, we construct a large-scale 3DGS video dataset to enable specialized fine-tuning. To bridge the gap between 2D video generation and 3D multi-view constraints, we introduce a camera-conditioned geometric prior. By using the first and last frames as boundary anchors and encoding the corresponding camera relationships, we explicitly inject spatial structure into the video generation pipeline. This boundary-anchored, camera-aware prior guides the network toward geometrically grounded restoration that remains coherent across viewpoints. Extensive experiments show that, among video-prior restoration methods, our approach attains the best pixel- and structure-level fidelity (PSNR/SSIM) and improves multi-view consistency, while remaining competitive in perceptual quality (LPIPS).

167. 【2608.21847】BC-IHV: Conditioning the Color Space for Stable Rectified-Flow Low-Light Enhancement

链接：https://arxiv.org/abs/2608.21847

作者：Yi Ai,Zheng Chen,Yuanhao Cai,Yulun Zhang,Xiaokang Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Low-light image enhancement, correct ambiguous exposure, Low-light image, correct ambiguous, overwriting structure

备注： 7 pages, 5 figures

点击查看摘要

Abstract:Low-light image enhancement (LLIE) must correct ambiguous exposure without overwriting structure already supported by the input. Generative transport can model exposure ambiguity; however, its flexibility may also alter observable geometry and chromatic content. Moreover, fixed invertible color coordinates are usually treated only as representations, although their inverse mappings reshape the RGB-domain gradients received by the enhancement network. To address these issues, we propose Structure-Anchored Rectified Flow (SA-RF), which maintains correspondence through separate chromaticity/intensity stems, a scale-matched condition pyramid, and HybridAda. HybridAda assigns location-specific retrieval to spatial cross-attention and global exposure modulation to pooled AdaLN. We further introduce BC-IHV, a learnable Box--Cox polar color space whose analytically invertible intensity mapping controls the inverse-gradient dynamic range through a single exponent. This allows the representation to balance dark-range expansion and gradient conditioning instead of adopting a fixed linear or logarithmic law. Experiments on three LOL benchmarks, blind image-quality evaluation, and cross-dataset tests demonstrate consistent reconstruction and perceptual advantages over the sota. Controlled studies further support the effectiveness of both the proposed framework and color representation.

168. 【2608.21839】FIRM-Video: Check Before You Score for Reliable Text-to-Video Reward Modeling

链接：https://arxiv.org/abs/2608.21839

作者：Peiyuan Zhang,Xiangyu Zhao,Hongbo Liu,Xiaoxing Hu,Mingxin Liu,Shuran Ma,Yunhang Shen,Jian Hu,Haihan Gao,Haoyu Cao,Xue Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Reliable reward models, models are essential, Reliable reward, Reliable, reward models

备注：

点击查看摘要

Abstract:Reliable reward models are essential for text-to-video evaluation and alignment. However, the trade-off between evaluation accuracy and inference efficiency places high demands on the quality of training supervision. Existing approaches often rely on holistic judges with fixed rubrics or open-ended reasoning, leading to incomplete inspection, unfaithful justification, and entangled attribution. We introduce FIRM-Video, a unified checklist-driven data construction framework based on a check-before-score principle: construct dimension-specific checklists, verify each criterion against temporal visual evidence, and aggregate only verified decisions. For Instruction Following, FIRM-Video decomposes prompts into weighted atomic requirements; for World Coherence, it constructs prompt-calibrated, target-specific checks grounded in visible entities and actions; and for Perceptual Quality, it applies a generic taxonomy of visual defects. The verified criteria and scores are further transformed into natural-language analyses for end-to-end reward modeling. Subsequently, we construct FIRM-Video-90K with 88,044 dimension-specific instances from 29,348 videos, and introduce FIRM-Video-Bench with 750 point-wise human annotations across 250 videos. The Qwen3-VL-based FIRM-Video-8B achieves the best overall MAE on FIRM-Video-Bench while consistently delivering the highest VBench Total, Quality, and Semantic Scores in Best-of-8 sampling across three video generators.

169. 【2608.21837】owards Bitstream-corrupted Harsh Visual Understanding: Through Bitstream Language Modeling as Robust Semantic Priors

链接：https://arxiv.org/abs/2608.21837

作者：Chaoran Huang,Fangcheng Li,Tianyi Liu,Wenyang Liu,Kejun Wu

类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：Bitstream-corrupted Harsh Visual, Harsh Visual Understanding, Visual Understanding, real-world multimedia communication, understand harshly degraded

备注： 9 pages, 5 figures, 4 tables

点击查看摘要

Abstract:Bitstream-corrupted Harsh Visual Understanding (BcHVU) aims to understand harshly degraded videos originally decoded from a severely corrupted bitstream in real-world multimedia communication. The ill-posed nature of BcHVU poses a major challenge for existing vision models, as even subtle bitstream corruption can lead to irreversible pixel distortion and significant semantic loss. To address these challenges in BcHVU, we propose Bitstream Language Modeling as Robust Semantic Priors (BLMSP), a framework for learning and injecting bitstream-native semantic cues. Our proposed BLMSP framework learns to extract bitstream-native semantic cues by bitstream language modeling, and leverages them as priors by injecting into off-the-shelf vision models of BcHVU tasks. Specifically, we present a Video Bitstream Byte Model (VBBM) that integrates byte-level modeling and cross-codec semantic distillation, enabling it to interpret robust semantics from byte sequences in multiple corrupted bitstream formats. The learned bitstream semantics are leveraged as robust priors and fused into BcHVU model backbones for improving the quality of video restoration, captioning, and human pose estimation. To train BLMSP, we construct a large-scale multi-source Corrupted-bitstream Harsh-video Paired (CHP) dataset containing 607k corrupted bitstream segments and 287k paired harsh video clips. Extensive experimental results show that the learned bitstream priors improve video restoration, captioning, and human pose estimation by 2.51 dB in PSNR, 0.20 in CIDEr, and 0.18 in PCK@0.2 on average, respectively. These results demonstrate that corrupted bitstream can serve as robust semantic priors in solving pixel distortion and semantic loss in BcHVU.

170. 【2608.21828】owards Alias-Free 4D Gaussian Representations with Motion-Aware Filtering

链接：https://arxiv.org/abs/2608.21828

作者：Ankit Dhiman,Kunal A Kathare,Pranav Vignesh,Lokesh R Boregowda,Venkatesh Babu Radhakrishnan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Neural Radiance Fields, Novel-view synthesis, remains a challenging, challenging problem, Gaussian Splatting

备注： Accepted to ECCV 2026. Project Page: [this https URL](https://maaf-4dgs.github.io/)

点击查看摘要

Abstract:Novel-view synthesis of dynamic scenes, crucial for AR/VR applications, remains a challenging problem. Recent methods adapt representations like 3D Gaussian Splatting (3DGS) and Neural Radiance Fields (NeRF) for dynamic scenes by incorporating time as the fourth dimension (4D representations). These 4D representations still suffer from aliasing artifacts, especially when generating novel views from divergent viewpoints (zoom-in/zoom-out operations). While using 3D smoothing filters like those proposed in Mip-Splatting might seem like a possible solution, they fail to account for local motion and also exhibit aliasing. To address this, we propose a motion-aware 3D smoothing filter specifically designed for 4D representations. Our approach adapts the filter strength based on local motion information, effectively mitigating aliasing without compromising rendering quality. This is achieved by estimating the joint density function of time and focal-to-depth ratio using a non-parametric estimation method. During inference, we sample from this joint distribution to determine the appropriate smoothing filter. This flexible strategy can be integrated with various 4D representations. Our evaluations on standard datasets demonstrate superior performance compared to state-of-the-art methods.

171. 【2608.21825】VisAdj: Learning Adjacency Matrices from Node-Link Images

链接：https://arxiv.org/abs/2608.21825

作者：Jiahao Xie,Guangmo Tong

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Learning adjacency matrices, recovering structured graph, structured graph information, Learning adjacency, visual observations

备注： Accepted by CIKM 2026

点击查看摘要

Abstract:Learning adjacency matrices from node-link images is a fundamental problem for recovering structured graph information from visual observations. Existing methods typically rely on fixed KNN-based heuristics for candidate edge selection and fail to capture dependencies among edges. To overcome these limitations, we propose VisAdj, a new framework for topology-aware adjacency prediction. VisAdj introduces an attention-sparse neighbor sampler to adaptively select a high-recall set of candidate node pairs and performs joint edge inference using a line-graph transformer that treats candidate edges as tokens and explicitly models dependencies among incident edges. Extensive experiments on synthetic graphs, road networks, and vessel images demonstrate that VisAdj consistently outperforms existing baselines by clear margins.

172. 【2608.21819】PatchGate: Narrowing the Verbalization Gap with Intrinsic Object Inventories in Frozen Vision-Language Models

链接：https://arxiv.org/abs/2608.21819

作者：Jihyung Ko,Eunji Jung,Hyeongsub Kim,Ziseok Lee,Jae Won Cho,Sanghyun Jo,Kyungsu Kim

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Reliable image captioning, Reliable image, avoiding unsupported object, covering visible objects, requires captions

备注： 31 pages, 9 figures. Code will be available

点击查看摘要

173. 【2608.21813】hrough the Schrödinger Bridge: Benchmarking Antemortem Image Restoration from Postmortem Autolysis to Enhance Forensic Diagnostics

链接：https://arxiv.org/abs/2608.21813

作者：Shuang Hao,Jiacheng Yue,Yaxuan Zhao,Fan Wang,Jianhua Ma,Erwen Huang,Chunfeng Lian

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：introduces diagnostic subjectivity, distorts tissue morphology, essential for determining, disease diagnosis, pre-autolysis state

备注：

点击查看摘要

Abstract:Forensic histopathology, essential for determining cause of death and disease diagnosis, is severely impeded by postmortem autolysis, i.e., an irreversible, stochastic degradation process that distorts tissue morphology and introduces diagnostic subjectivity, thereby underscoring the value of restoring autolyzed images to a diagnostically plausible, pre-autolysis state for improving objectivity in forensic practice. This restoration task is fundamentally challenging due to the large, non-deterministic morphological changes caused by autolysis and the infeasibility of pixel-wise paired data, which invalidates assumptions underlying supervised and cycle/structure-consistent unpaired translation methods. To address this, we formalize forensic histopathology autolysis restoration as a new task: under unpaired supervision, transform postmortem images with severe autolysis into diagnostically meaningful ``antemortem'' representations. We contribute AutoPath, the first homologous yet unpaired dataset for this problem, constructed by splitting specimens into adjacent tissue blocks---one processed immediately, the other exposed to induce autolysis---yielding nearly ten thousand $10\times$ patches from 69 cases with varying liver conditions. We further frame the problem as a Schrödinger Bridge between the autolyzed and non-autolyzed distributions, offering a principled approach to modeling stochastic, severe morphological degradation. Critically, we demonstrate the misalignment of generic image-level generative metrics (e.g., FID) with diagnostic utility and propose a forensically grounded, slide-level diagnostic distribution consistency evaluation. Overall, this work establishes a reproducible benchmark (encompassing task definition, a real-world dataset, and an evaluation methodology) toward rigorous and practically meaningful progress in autolysis restoration for forensic pathology.

174. 【2608.21810】MSM-Mem: A Universal Medical Structured Multimodal Memory Framework for Medical AI Agents

链接：https://arxiv.org/abs/2608.21810

作者：Md Asaduzzaman Jabin,Khoa Le,Lin Zhao,Tianming Liu

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：synthesizing patient history, inherently experience-driven, physicians progressively refine, multimodal observations, Medical Structured Multimodal

备注： 8 pages

点击查看摘要

Abstract:Clinical decision-making is inherently experience-driven: physicians progressively refine their reasoning by synthesizing patient history, multimodal observations, and prior diagnostic experiences across interactions. In contrast, current multimodal large language model (MLLM)-based medical AI agents largely operate as stateless inference systems, generating decisions independently for each interaction without retaining or internalizing experiential knowledge. This discrepancy limits their ability to progressively improve reasoning reliability through usage and adapt to longitudinal patient contexts in real-world clinical workflows. In this study, we propose Medical Structured Multimodal Memory (MSM-Mem), an agentic memory framework that enables medical AI agents to evolve through accumulated clinical experiences. MSM-Mem organizes heterogeneous clinical experiences into semantic, episodic, and visual memory and incrementally updates them during inference, allowing the agent to retrieve prior experiences to inform current reasoning and progressively refine decision-making over time. Evaluations on MoE-LLaVA backbones demonstrate consistent performance improve- ments with further gains observed through continued usage. In general, MSM-Mem offers a viable pathway toward medical AI agents capable of evolving their reasoning competence in a manner analogous to the way clinicians learn from practice over time.

175. 【2608.21804】FlashReg: GPU-Accelerated 3-Clique Point Cloud Registration for Real-Time Correspondence-to-Pose Estimation

链接：https://arxiv.org/abs/2608.21804

作者：Ziyang Yu,Xiang Li,Qiong Chang,Jun Miyazaki

类目：Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)

关键词：Graph-based point cloud, consistent correspondence sets, achieves high robustness, identifying geometrically consistent, geometrically consistent correspondence

备注： 12 pages

点击查看摘要

Abstract:Graph-based point cloud registration achieves high robustness by identifying geometrically consistent correspondence sets, but constructing second-order compatibility graphs and enumerating candidate cliques remain compute- and memory-intensive. This work presents FlashReg, a GPU-oriented correspondence-to-pose estimator that avoids materializing the dense scored second-order graph. Its Fast First- and Second-Order Graph (FFSOG) construction builds a capacity-bounded sparse second-order graph directly from the binary first-order graph. A dataflow-optimized three-node clique (3-clique) search then selects pivots from compact per-row candidate pools and enumerates triples through sorted sparse-neighborhood intersections. Across indoor and outdoor benchmarks, FlashReg reduces correspondence-to-pose latency by 2--3x relative to TurboReg at comparable registration recall, while using about 50% of its peak allocated tensor memory on an embedded GPU. These results make FlashReg suitable as a high-throughput registration backend within onboard perception pipelines.

176. 【2608.21796】SAFE-G: Structure-aware Faithful Evidence-guided Generation for Knowledge-based Visual Question Answering

链接：https://arxiv.org/abs/2608.21796

作者：Long Shu,Shuochen Liu,Wei Chen,Junda Lin,Zhi Zheng,Huijun Hou,Tong Xu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Knowledge-based Visual Question, Visual Question Answering, Question Answering, Multimodal Large Language, Large Language Models

备注： 12 pages, 5 figures

点击查看摘要

Abstract:Knowledge-based Visual Question Answering (KB-VQA) aims to answer queries that necessitate reasoning over external knowledge sources beyond the visual content. Typically, current methods fuse multimodal features to retrieve external information, subsequently leveraging Multimodal Large Language Models (MLLMs) to derive answers from the retrieved evidence. However, these methods often struggle to capture structural associations within complex contexts to effectively filter noise. Furthermore, they frequently fail to ensure that the reasoning process remains strictly faithful to the retrieved evidence. To address these challenges, we propose SAFE-G, a Structure-Aware Faithful Evidence-guided Generation framework, which enables precise evidence localization and trustworthy reasoning. Specifically, we first employ a coarse-grained hybrid search fusing visual and textual modalities to recall candidate documents, and subsequently implement a structure-aware fine-grained graph retrieval that captures structural dependencies to filter noise and pinpoint precise evidence. Moreover, we introduce a reinforcement learning (RL) strategy with an evidence-grounded reward that assigns credit to correct answers only when the selected evidence is correct. This strict alignment constraint compels the model to anchor its response in the retrieved context, effectively enhancing its capability to locate evidence via multimodal features and perform faithful reasoning. Extensive experiments on the Encyclopedic-VQA and InfoSeek benchmarks demonstrate that SAFE-G outperforms prior methods by a margin of 8.9% and 3.5%, substantially enhancing the overall reasoning accuracy. Our source code is publicly available at: this https URL.

177. 【2608.21792】HIRA: A Human-in-the-Loop Retrieval-Augmented Cascade for Document Classification in Regulated Industries

链接：https://arxiv.org/abs/2608.21792

作者：Shangxuan Tian,Yanhui Chen,Carlos Queiroz

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：costly model-governance procedures, scarce review capacity, limited cold-start labels, classification in regulated, Document classification

备注： CIKM 2026

点击查看摘要

Comments:
CIKM 2026

Subjects:

Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

Cite as:
arXiv:2608.21792 [cs.AI]

(or
arXiv:2608.21792v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2608.21792

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

178. 【2608.21786】HP-UniIF: Hierarchical Prompt Learning for Unified Image Fusion

链接：https://arxiv.org/abs/2608.21786

作者：Xingxin Xu,Siqi Zhao,Xin Li,Xinjie Yao,Yiming Sun,Pengfei Zhu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：General image fusion, integrate complementary information, General image, task-oriented perception simultaneously, image fusion seeks

备注：

点击查看摘要

Abstract:General image fusion seeks to integrate complementary information from multiple source images, yet real-world applications often require a single system to support heterogeneous fusion, degradation restoration, and task-oriented perception simultaneously. Existing unified frameworks struggle with these orthogonal objectives, resulting in entangled representations and degraded performance across subtasks. We propose HP-UniIF, a unified vision framework that leverages diffusion priors to bridge heterogeneous fusion, visual restoration, and downstream perception. To address the limited adaptability of diffusion models to domain-, degradation-, and task-level objectives within one pipeline, HP-UniIF introduces a depth-wise hierarchical conditional modulation strategy that decouples these objectives across network stages. Task prompt modulation at bottleneck layers adapts the backbone to different fusion paradigms, the degradation prompt router at shallow layers injects degradation-aware constraints for local restoration, and the application prompt bank at decoding stages aligns generation with downstream tasks. This hierarchical design enables HP-UniIF to produce visually faithful results while preserving task-relevant semantics. Extensive experiments across multiple fusion tasks, diverse degradations, and various downstream applications demonstrate the superior performance of HP-UniIF.

179. 【2608.21784】DefaultShift: Auditing Semantic Default Shift in Accelerated Text-to-Image Models

链接：https://arxiv.org/abs/2608.21784

作者：Xuanhua Yin,Chuanzhi Xu,Shunqi Mao,Wei Guo,Weidong Cai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：replace slower generators, increasingly replace slower, individual outputs remain, outputs remain plausible, models increasingly replace

备注： 21 pages, 12 figures, 25 tables

点击查看摘要

Abstract:Few-step text-to-image models increasingly replace slower generators, yet acceleration can silently change distributions over unspecified attributes even when individual outputs remain plausible and aligned. We call these distributions semantic defaults and their change under replacement semantic default shift. Existing quality, preference, and diversity evaluations do not test whether a replacement preserves its reference model's semantic defaults. We introduce DefaultShift, a paired audit that labels repeated samples with closed semantic vocabularies, measures probability-mass movement, and separates interpretable ranking from confirmatory cross-fit inference. Across 14 reference and replacement pairs, adjusted color discrepancies range from 0.054 to 0.303 with recipe-specific directions. A 1,000-image human audit reproduces the ordering. We further introduce DefaultShift-Select, an offline calibration method that reduces human-measured shift by 10.3 percent to 35.1 percent across Turbo, DMD2, and FLUX without material quality loss. Under balanced evaluation, selected data recover 4.3 accuracy points and 7.5 worst-group points over uncalibrated replacement data. DefaultShift makes semantic preservation under acceleration measurable and actionable.

180. 【2608.21776】SpatialDiff: 3D-Aware Object Movement via Implicit Spatial Modeling

链接：https://arxiv.org/abs/2608.21776

作者：Zheng Liu,Zijian He,Huiguo He,Weizhi Zhong,Yejun Tang,Huan Yang,Kun Gai,Guanbin Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent advances, complex scenes, movement in complex, handle spatial movement, partially occluded

备注： Accepted by CVPR2026

点击查看摘要

Abstract:Recent advances in image editing allow impressive manipulation of objects, existing methods still struggle to handle spatial movement in complex scenes, such as objects span different depth layers or are partially occluded. Most image editing methods focus solely on prior information from 2D datasets, emphasizing planar features while lacking support for spatial structures. Even approaches that incorporate explicit positional information fail to capture true 3D spatial relationships, thus limiting accurate object movement in complex scenes. In this paper, we present SpatialDiff, a method that effectively captures 3D spatial structures, enabling precise and consistent object movements in complex scenes. Our core innovations are twofold: (1) Implicit 3D Spatial Modeling, which introduces 3D prior knowledge and enables the model to internally build a comprehensive understanding of the three-dimensional spatial structure; and (2) Global Spatial Supervision, which constrains the latent spatial features to enable the model to perceive changes in object spatial positions caused by editing operations. Experimental results demonstrate that our method significantly improves the accuracy and fidelity of spatial movement in complex scenes.

181. 【2608.21764】LiteEvent-AE: Lightweight Autoencoder for Event-Based Vision on Low-Latency Energy-Constrained Edge Devices

链接：https://arxiv.org/abs/2608.21764

作者：Riadul Islam,Joey Mule,Dhandeep Challagundla,Shahmir Rizvi,Sean Carson,Rachit Saini

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)

关键词：energy-aware artificial intelligence, low-latency visual signals, support sustainable edge, reduce redundant data, redundant data processing

备注：

点击查看摘要

Abstract:Event-based vision has emerged as a promising paradigm for energy-aware artificial intelligence (AI), offering sparse, low-latency visual signals that reduce redundant data processing and support sustainable edge computing. However, the asynchronous and noise-prone nature of event streams creates challenges for conventional deep learning models, which are often too computationally intensive for low-power embedded platforms. This work presents a compact and configurable event-driven autoencoder that efficiently compresses neuromorphic data while preserving essential spatiotemporal structure for downstream inference. The architecture integrates lightweight convolutional encoding with robust performance under adaptive event thresholding and a minimal classifier head, enabling substantial reductions in computational cost without degrading recognition fidelity. Extensive evaluations on the Smart Event Face Dataset (SEFD) and Event-Based Crossing Dataset (EBCD) show that the proposed framework achieves competitive or superior accuracy compared to YOLOv9 while requiring up to 35.6$\times$ fewer parameters. To assess real-world sustainability, the model is deployed on resource-constrained hardware: a Raspberry Pi 4B and a NVIDIA Jetson Nano. On NVIDIA Jetson Nano, it delivers real-time throughput of 44.8 FPS. On a Raspberry Pi 4B CPU, the 50\% autoencoder classifier consumes 16.19 J for the evaluated inference workload, corresponding to approximately 726.3$\times$ lower energy consumption than YOLOv9 under the same evaluation protocol. These results demonstrate the potential of compact event-driven models to advance environmentally conscious, low-power AI systems for high-speed perception in autonomous, mobile, and embedded computing environments.

182. 【2608.21762】Learning to Look Again: Loss-Gap Supervision for Free-form Crop Routing in Vision-Language Models

链接：https://arxiv.org/abs/2608.21762

作者：Jinchang Zhu,Rong Fu,Yi Ding,Chenghao Wu,Ying Liu,Menglin Yang

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Vision-language models, low-resolution global view, fail many detail-centric, image is compressed, low-resolution global

备注：

点击查看摘要

183. 【2608.21761】What Does CLIP Learn for Regional Geolocalization? Probing Visual Cues and Scene Configuration After Adaptation

链接：https://arxiv.org/abs/2608.21761

作者：Changyu Lee,Yeonsoo Park,Abdullah Alfarrarjeh,Seon Ho Kim

类目：Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE); Computer Vision and Pattern Recognition (cs.CV)

关键词：imagery provide rich, Large collections, provide rich visual, extracting fine-grained geographic, street-view imagery provide

备注： 10 pages, 4 figures, 9 tables. Manuscript under review

点击查看摘要

Abstract:Large collections of street-view imagery provide rich visual information about urban environments, but extracting fine-grained geographic information from such data remains challenging. In particular, fine-grained regional geolocalization is challenging because nearby areas often share coarse geographic cues. We study regional geolocalization within a metropolitan area and ask whether pretrained CLIP features are sufficient for regional discrimination, and what visual information supports performance after adaptation. Using 9,085 street-view images from eight Greater Los Angeles regions, we compare zero-shot CLIP, frozen-encoder readouts, partial encoder updating, Low-Rank Adaptation (LoRA), and full fine-tuning. Frozen readouts remain near the 39.03% zero-shot accuracy, whereas encoder adaptation achieves 75.94-82.10%. Full fine-tuning also reduces the mean distance to the predicted region center from 12.30 km to 3.86 km. We probe these gains through semantic cue removal, appearance reduction using edge maps and blur, and scene-configuration disruption using patch scrambling. Adapted models achieve higher edge and blur accuracy and switch 42.92-45.56% of predictions after scrambling, compared with 10.79-14.60% for frozen methods. However, adaptation does not improve the fraction of performance retained after appearance reduction, while vegetation and sky remain influential. A Caltech101 control further shows that scrambling sensitivity is not unique to geolocalization. Overall, encoder adaptation substantially improves nearby-region discrimination and is associated with greater sensitivity to intact scene configuration, without evidence that coarse structure alone becomes sufficient for prediction. These conclusions concern viewpoint variation near known locations rather than geographically disjoint generalization.

184. 【2608.21756】How Architecture and Training Affect TPC Representations Across Experiments

链接：https://arxiv.org/abs/2608.21756

作者：Tyler Wheeler,Michelle P. Kuchera,Raghuram Ramanujan,William Sieland,Ryan Krupp,Daniel Bazin,Connor L. Cross,Hoi Yan Ian Heung,Andrew J. Jones,Ruchi Mahajan,Saiprasad Ravishankar,Pranjal Singh,Benjamin Votaw,Chris Wrede

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Nuclear Experiment (nucl-ex); Instrumentation and Detectors (physics.ins-det)

关键词：Deep-learning efforts, foundation model approaches, efforts have increasingly, increasingly shifted, shifted toward foundation

备注：

点击查看摘要

Abstract:Deep-learning efforts have increasingly shifted toward foundation model approaches. In experimental physics, this allows models and learned representations to be reused beyond the experiments in which they were developed. This work evaluates the reusability of representations across experiments and detector systems using probes on frozen encoders. These probes reveal task-relevant structure before downstream adaptation, complementing fine-tuning. Together with random-weight controls, they distinguish contributions from architecture and encoder training that downstream performance alone cannot resolve. Time projection chamber (TPC) data provide a useful testbed because events from TPC systems can be represented as variable-length sparse tensors, while detector geometries, event topologies, and scientific tasks can differ substantially. We investigate whether fixed-dimensional TPC event representations can be reused across classification tasks, experiments, and detector systems. Sparse ResNet and PointNet-style encoders produce 512-dimensional embeddings for four datasets from the GADGET II TPC and AT-TPC. Randomly initialized encoders isolate the contribution from architecture before supervised training. We then train each encoder on a classification task, freeze its parameters, and train a linear or nonlinear probe for each downstream task. We find that this architecture-induced structure remains useful across experiments and detector systems. The randomly initialized PointNet-style representation is highly informative on several tasks. The two architectures organize their embedding spaces differently, but neither exhibits a large, systematic loss of utility cross-detector. These results show that architecture is a major source of task-relevant structure in TPC embeddings and should be treated explicitly when assessing representation learning and developing reusable detector models.

Subjects:

Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Nuclear Experiment (nucl-ex); Instrumentation and Detectors (physics.ins-det)

Cite as:
arXiv:2608.21756 [cs.LG]

(or
arXiv:2608.21756v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2608.21756

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

185. 【2608.21754】Fidelity-Diversity-Consistency (FDC): Data Pruning for Remote Sensing Change Detection

链接：https://arxiv.org/abs/2608.21754

作者：Dongyao Zhu,Ranga Raju Vatsavai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：improving downstream model, downstream model performance, detection remains unexplored, training data sizes, reducing training data

备注：

点击查看摘要

Abstract:Despite the success of data pruning (DP) in reducing training data sizes and improving downstream model performance in classification and segmentation tasks, its potential in remote sensing change detection remains unexplored. For the first time, we benchmark six representative DP methods across building- and forest-change datasets, CNN- and transformer-based models, and three pruning budgets, and show that existing baselines yield no reliable advantage over random selection. Notably, even the strongest evaluated baseline, Feature Diversity, is matched or exceeded by $\sim$33\% of randomly sampled subsets. To understand the underlying mechanism, we conduct a systematic regression study over 540 randomly sampled data subsets, characterizing each with four descriptors covering label statistics, image diversity, and feature-space geometry. Random Forest models show that \emph{change distribution fidelity} is the most prominent factor in determining the quality of change detection data subsets, a property absent from the existing pruning literature. Our analyses further show that pixel-wise image diversity and label-feature consistency are secondary factors. We translate these findings into Fidelity-Diversity-Consistency (FDC), a simple two-stage pruning method that shows consistent improvements over existing baselines across change detection benchmarks and backbones, especially at lower pruning ratios. Code is available at \href{this https URL}{this https URL}.

186. 【2608.21748】Calibrate What You SHIP: Post-Selection Risk Control for Verifier-Guided Text-to-Image Generation

链接：https://arxiv.org/abs/2608.21748

作者：Xuanhua Yin,Shunqi Mao,Wei Guo,Chuanzhi Xu,Weidong Cai

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：systems increasingly, increasingly use test-time, stop among multiple, calibrated on individual, Verifier-guided

备注： 17 pages, 9 figures, 23 tables

点击查看摘要

Abstract:Verifier-guided text-to-image systems increasingly use test-time search to select, refine, or stop among multiple candidates, yet release thresholds are often calibrated on individual images. This creates a candidate-to-policy calibration mismatch: search changes both which prompts receive an output and which candidate is released, so candidate-level risk control need not imply control of released-output risk. We formalize this estimand shift through prompt reweighting and within-prompt selection, and introduce SHIP, Selection-aware Held-out calibration of Inference Policies. SHIP runs or replays the complete deployed policy on held-out prompts, evaluates the image it actually releases using an independent target judge, and selects the most permissive threshold whose risk upper bound satisfies a prescribed budget. For replayable policies with a prespecified threshold grid, simultaneous confidence control provides finite-sample validity. Experiments across fixed, sequential, and adaptive T2I inference procedures show that policy-level calibration recovers lower-risk operating points while exposing policy-dependent tradeoffs among risk, coverage, and compute. On GenEval2 with FLUX at N=16, a pooled-candidate threshold yields released risk 0.310, whereas SHIP reduces it to 0.162. Across 200 cached-stream splits, the fixed-grid certificate has no target crossing. Reliable inference-time scaling therefore requires calibrating the output distribution induced by the complete deployed policy.

187. 【2608.21713】he Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generation

链接：https://arxiv.org/abs/2608.21713

作者：Ashritha Gonuguntla

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：explicit textual plan, generating image tokens, emit an explicit, explicit textual, plan

备注： 15 pages, 7 figures. Accepted at ECCV 2026 (oral)

点击查看摘要

188. 【2608.21710】StereoDiffuer: Diffusion-based Progressive Geometry Modeling with Saliency Attention Perception for Stereo Matching

链接：https://arxiv.org/abs/2608.21710

作者：Bohan Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：deep neural networks, disparity maps obtained, stereo matching, stereo matching methods, neural networks

备注： 17 pages, 9 figures, and 11 tables. Accepted by Signal Processing: Image Communication

点击查看摘要

Abstract:With the advance of deep neural networks, the quality of disparity maps obtained through stereo matching has steadily improved. However, existing stereo matching methods still struggle to preserve fine-grained geometric details, resulting in blurred edges and over-smoothed predictions in challenging regions. To address these limitations, we propose StereoDiffuer, an iterative diffusion-based stereo matching framework that explicitly models geometric details and progressively refines disparity estimates. The framework incorporates a Saliency Attention Perception (SAP) module to extract salient geometric cues, including object boundaries, thin structures, and sharp edges. Confidence-guided SAP features are combined with the initial disparity estimate to condition an iterative denoising diffusion process, which corrects residual disparity errors and restores geometric details suppressed during cost-volume regularization and upsampling. Experimental results on the Scene Flow and KITTI benchmarks demonstrate the effectiveness of the proposed framework and its competitive performance relative to the compared stereo matching methods.

189. 【2608.21697】Emotion Intensity Matters: Generating Realistic Expressions in Virtual Humans with CVAEs

链接：https://arxiv.org/abs/2608.21697

作者：Vitor Miguel Xavier Peres,Lara Volpato,Gabriel Ferri Scnheider,Soraia Raupp Musse

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：Conditional Variational Autoencoders, Generating expressive facial, Generating expressive, remains a central, Variational Autoencoders

备注：

点击查看摘要

Abstract:Generating expressive facial behavior in virtual humans (VHs) remains a central challenge in affective computing and character animation. This paper presents a novel approach based on Conditional Variational Autoencoders (CVAEs), trained on real human facial expression data, to synthesize controllable emotional expressions at varying intensities. Using a dataset comprising six basic emotions represented at two intensity levels (low and high), we train a CVAE model to generate synthetic facial expression data while preserving semantic consistency with real human expressions. Despite the limited amount of training data (only 7,680 facial expression samples), the proposed approach learns meaningful latent representations and generates coherent emotional variations. Our method enables control over emotional intensity, making it suitable for animating virtual characters without requiring actor performances or manual artistic intervention. Our research aimed to evaluate whether the method (CVAE) preserves the characteristics associated with the different intensity levels present in the dataset. Results show that the proposed model preserves key expressive characteristics across intensity levels while supporting generalization across emotional intensity levels, contributing to the creation of emotionally expressive virtual characters from relatively small datasets.

190. 【2608.21659】SketchFlow: Zero-Shot Vector Sketch Generation via GMM Prior Flow in CLIP Latent Space

链接：https://arxiv.org/abs/2608.21659

作者：Jin Zhou,Hongliang Yang,Pengfei Xu,Hui Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Vector sketches remain, abstract human expression, generating high-quality vector, Vector sketches, Optimal Transport Conditional

备注： Accepted to SIGGRAPH Asia 2026 Conference Papers. 16 pages

点击查看摘要

Abstract:Vector sketches remain one of the most concise and immediate mediums for abstract human expression. However, generating high-quality vector strokes that exhibit human-like drawing styles remains an open challenge due to the severe scarcity of fine-grained, high-quality text-to-sketch paired data. Existing text-conditioned generation methods often rely on unstable, time-consuming optimization or struggle to generalize to unseen categories in a zero-shot manner. To address these limitations, we present SketchFlow, a novel generative framework rooted in Optimal Transport (OT) theory and flow matching. By leveraging pre-trained CLIP models to bypass labor-intensive image-level text annotations, we formulate cross-modal alignment as a continuous mapping problem directly within the CLIP latent space. To bridge the inevitable modality gap between discrete text concepts and continuous sketch features, we first inject noise into discrete category embeddings to construct a continuous Gaussian Mixture Model (GMM) prior. We then utilize an Optimal Transport Conditional Flow Matching (OT-CFM) model to learn a deterministic vector field mapping from this continuous GMM prior to the target sketch feature distribution. Finally, a Hybrid Diffusion Decoder, fusing 1D U-Net and Transformer architectures, is designed to decode these features into fast and high-fidelity stroke trajectories. Extensive experiments demonstrate that SketchFlow substantially outperforms existing baselines in visual quality and adherence to natural human drawing styles. Furthermore, our geometry-preserving framework demonstrates promising local zero-shot synthesis for prompts beyond the QuickDraw training vocabulary, including unseen concept labels and semantic modifiers, while enabling smooth, continuous semantic interpolation between distinct concepts. Source code is available at: this https URL.

191. 【2608.21653】Bounded Precision-Geometry Scaling for Robust Multi-Task Learning under Loss Scale Mismatch

链接：https://arxiv.org/abs/2608.21653

作者：Krishna Subedi

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：causing homoscedastic uncertainty, Bounded Precision-Geometry Scaling, orders of magnitude, degrade severely, learning often combines

备注：

点击查看摘要

Abstract:Multi-task learning often combines losses that span several orders of magnitude, causing homoscedastic uncertainty weighting to degrade severely. We propose Bounded Precision-Geometry Scaling (BPGS), a method that maps each task's log-variance through a bounded sigmoid parameterisation anchored to detached batch loss statistics, and decouples network optimisation from uncertainty optimisation. Its normalised task weights are provably invariant to uniform rescaling under non-degenerate loss scales. We evaluate BPGS on synthetic stress tests and three real-world benchmarks: NYUv2 dense prediction, Yeast multi-label classification, and RF1 multi-target regression. Under pure loss rescaling from $\times 1$ to $\times 1000$, its macro score changes from 0.777 to 0.778, whereas Kendall weighting drops from 0.780 to 0.637; $\ell_1$-normalising Kendall's weights does not close the gap. On NYUv2, BPGS records the lowest depth absolute relative error (0.223), depth RMSE (0.790), and total loss (1.891) among all compared methods, including Nash-MTL. Sensitivity studies on batch size and calibration show small variation across the tested ranges, and runtime overhead relative to Kendall is under 1%. BPGS posts the highest Yeast micro-F1 (0.616) and is competitive on RF1, though PCGrad leads RMSE and MAE there. These findings establish BPGS as a scale-robust alternative to homoscedastic uncertainty weighting, notably effective when loss-scale disparities dominate multi-task optimisation.

192. 【2608.21636】Semantic Slots for Video Object-Centric Learning

链接：https://arxiv.org/abs/2608.21636

作者：Khalil Sabri,Guillaume-Alexandre Bilodeau,Nicolas Saunier,Wassim Bouachir

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Video Object-Centric Learning, Object-Centric Learning, ensure temporal consistency, traditionally focused, focused on refining

备注： Accepted at BMVC 2026

点击查看摘要

Abstract:Video Object-Centric Learning (OCL) has traditionally focused on refining the encoder architecture to ensure temporal consistency. In this paper, we argue that the primary bottleneck lies in the decoder. We show that traditional decoders force slots to be spatially anchored, hindering their ability to adapt to motion. We propose SemanticSlots, which uses a Transformer-based decoder that leverages image context, relieving slots from encoding boundary precision and spatial location. This allows slots to function as semantic queries that are inherently object position invariant, retrieving matching features rather than memorizing coordinates. More importantly, this property allows slots computed from a single frame to decompose subsequent video frames, eliminating the need for complex temporal predictors or auxiliary temporal losses. Results on YouTube-VIS show that SemanticSlots improves upon VideoSAUR by 31 points in mBO and outperforms current state-of-the-art methods by 21 points, achieving 86.6% ARI and 62.8% mBO.

193. 【2608.21595】Perturb the Thought, Not the Pixels: Latent-Space Rollout Diversification for Reinforcement Learning of Vision-Language Models

链接：https://arxiv.org/abs/2608.21595

作者：Michael Jerge,Joseph Pelczar,Justin Downes

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：optimization group amplifies, Reinforcement learning, amplifies its gains, learning with verifiable, ability of vision-language

备注：

点击查看摘要

Abstract:Reinforcement learning with verifiable rewards (RLVR) improves the reasoning ability of vision-language models (VLMs), and diversifying the rollouts within each optimization group amplifies its gains. Existing approaches diversify through decoding temperature or pixel-space image distortion; we ask whether the perturbation belongs in the model's latent space instead. We introduce Noise-Contrastive GRPO (NC-GRPO), which injects scale-calibrated Gaussian noise into the last hidden layer of the prompt-encoding pass for half of each rollout group, branching those rollouts from a displaced departure state. Branches that reach the answer despite the displacement are reinforced over those derailed by it, converting sensitivity at the branch point into policy-gradient signal; the objective, reward, and inference protocol are untouched. On Qwen2.5-VL-7B trained on Geometry3K, NC-GRPO significantly improves out-of-domain mathematical reasoning over vanilla GRPO across five held-out benchmarks (pooled McNemar $p \le 0.001$) while also improving in-domain accuracy and hallucination robustness -- the latter an axis on which image-space noise regresses even while posting a larger OOD average on perception-heavy benchmarks. Mechanism ablations indicate that independent stochastic diversity, not noise budget or direction, is the active ingredient, and a noise-scale study exposes a dial between reasoning specialization and general capability. NC-GRPO is designed to be modality-agnostic and integrates into a standard RLVR pipeline as a ~50-line change to the inference engine.

194. 【2608.21571】Extending the Horizon of Early Diagnosis: Lung Cancer Prediction with Vision Transformers

链接：https://arxiv.org/abs/2608.21571

作者：Olivera Kotevska,Ian Goethert,Michael McGee,Maria Mahbub,Sean R. Wilkinson,Rowena Yip,Myvizhi Esai Selvan,Zeynep H. Gumus,Claudia Henschke,Robert J. Klein,Providencia Morales,Samuel M Aguayo,Ioana Danciu,Mayanka Chandrashekar

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：cancer-related mortality worldwide, mortality worldwide, improving survival, chest X-rays, cancer-related mortality

备注：

点击查看摘要

Abstract:Lung cancer remains a leading cause of cancer-related mortality worldwide, and early diagnosis is critical for improving survival. However, early-stage malignancies can be subtle on chest X-rays, creating challenges for radiologists. This study evaluates Vision Transformers (ViTs) for predicting lung cancer one to two years before clinical diagnosis. We analyzed 259,361 chest X-rays from 91,020 imaging studies at the Jamaica Plains VA Hospital in Boston, MA. The dataset showed extreme class imbalance, approximately 1:150 cancer to non-cancer, which was addressed using hybrid under- and over-sampling and class-weighted loss optimization. Three ViT configurations were evaluated: a model trained from scratch, an ImageNet-pretrained model, and a Corona-pretrained model fine-tuned on the lung cancer dataset. Transfer learning improved performance, with pretrained models exceeding the scratch baseline by 6-10 percentage points in AUC and about 10-12 percent in balanced accuracy. ImageNet-pretrained models showed the most stable overall performance, while Corona-pretrained models achieved higher sensitivity in some settings but greater variability. Moderate resampling ratios, including 1:1 undersampling and 1.5:2 oversampling, provided favorable trade-offs between sensitivity, precision, and computational efficiency, reducing runtime by up to 70 percent without major performance loss. These findings demonstrate the potential of ViTs for early lung cancer risk prediction from routine chest X-rays. Although performance remains below clinical deployment thresholds, the results support further development of ViT-based triage systems to flag high-risk patients for earlier evaluation.

195. 【2608.21543】presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Search

链接：https://arxiv.org/abs/2608.21543

作者：Weixuan Ding,Shang Liu,Hanyu Pei,Zeyan Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：semantically coherent positioning, Large Language Model, image composition, requiring spatially, Multimodal Large Language

备注： Accepted to ICONIP 2026

点击查看摘要

Abstract:Object placement is critical in image composition, requiring spatially and semantically coherent positioning of objects within diverse scenes. Existing approaches typically rely on hand-crafted rules or supervised learning on limited datasets, which restricts their generalization and interpretability, especially in open-world scenarios involving novel objects and scenes. In this work, we reformulate open-world object placement as a heuristic search task guided by reasoning from a Multimodal Large Language Model (MLLM). We introduce \textsf{presto}, a zero-shot, training-free framework that operates within an imaginary action space to iteratively refine object position and scale. Our coarse-to-fine search strategy ensures fast convergence, and we evaluate two decision-making variants: Metric-guided Selection and MLLM-as-a-judge. Experiments across multiple benchmarks show that \textsf{presto}~achieves state-of-the-art performance, particularly in previously unseen, open-world settings. Human studies further reveal that the MLLM-as-a-judge variant produces more perceptually coherent placements than metric-driven approaches, highlighting a gap between standard evaluation metrics and human visual judgment.

196. 【2608.21529】DamageScope: Vision-Language Retrieval at Scale for Disaster Damage Assessment from Satellite Imagery

链接：https://arxiv.org/abs/2608.21529

作者：Ravi K. Rajendran,Biplob Debnath,Murugan Sankaradas,Srimat T. Chakradhar

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Timely and accurate, Large Language Models, vision-language models, Timely, damage assessment

备注：

点击查看摘要

197. 【2608.21487】ASSO: TAsk-Specific Subspace Optimization for Continual Learning of Vision-Language Models

链接：https://arxiv.org/abs/2608.21487

作者：Chang Sun,Francesco Barbato,Matteo Caligiuri,Pietro Zanuttigh

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：attractive solution, exhibit strong zero-shot, latent space geometry, Vision-Language Models, exhibit strong

备注：

点击查看摘要

Abstract:Vision-Language Models (VLMs) exhibit strong zero-shot capabilities, making them an attractive solution for continual learning across diverse tasks. However, during continual adaptation, both catastrophic forgetting and zero-shot degradation occur, severely degrading performance. In this paper, we introduce TASSO, a new paradigm that efficiently preserves the latent space geometry while ensuring network plasticity. We achieve this with two complementary techniques: subspace learning and geometry-aware knowledge distillation. Specifically, we first learn a sequence of task-specific low-rank projectors, which we use to project the latent representations before optimizing cross-entropy. Secondly, we employ a geodesic-distance-based loss that distills knowledge from the previous-task model while effectively preserving the latent space geometry. These design choices not only avoid unnecessary parameter updates along the full embedding dimensions but also improve learning by focusing on task-specific manifolds. Moreover, the geometry-aware distillation provides strong regularization and significantly reduces both catastrophic forgetting and zero-shot degradation throughout the continual learning sequence. Experimental results with the CLIP vision language model in the multi-domain task incremental and class incremental learning benchmarks demonstrate clear improvements over state-of-the-art methods in mitigating forgetting and preserving zero-shot capabilities.

198. 【2608.21486】EXPL-FR: Explaining Face Recognition Models via Vision-Language Alignment

链接：https://arxiv.org/abs/2608.21486

作者：Guray Ozgur,Mustafa Efe Tamyapar,Naser Damer,Fadi Boutros

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Deep face recognition, reach near-saturated accuracy, similarity score relied, models reach near-saturated, Deep face

备注： Accepted at the ECCV 2026 Workshops

点击查看摘要

Abstract:Deep face recognition (FR) models reach near-saturated accuracy but remain opaque: a practitioner cannot ask which semantic attributes a similarity score relied upon. EXPL-FR answers this inside the FR model's own embedding space. A lightweight adapter aligns a vision-language model's (VLM) image encoder with the frozen FR space, trained on face images alone and never on text. Because the VLM's encoders share one space, the same adapter applies to the text encoder, turning 978 attribute prompts in 22 categories, also extendable, into FR-space anchors at no extra cost. We do not assume this transfer works: a face-verification protocol measures it, and an ablation changing only the adapter isolates its contribution. Not every concept survives, because an FR model earns its invariances by discarding the factors it must verify identities across. A label-free detectability measure compares each concept's separability in FR space against the VLM space, and the 100 most detectable form the model's readable semantic signature, which separates identities better than the full vocabulary. We cover four FR backbones and two VLM encoders, EXPL-FR needs no architecture access, and supports identity-level, per-image, and differential explanations. We benchmark attribute-level auditing under three supervision settings, human labels (current practice), VLM pseudo-labels, and our fully prompt-driven audit, against real verification behavior. With no labels, the prompt-driven audit ranks four FR models by their measured per-ethnicity RFW errors and ranks controlled attribute changes by their true verification cost.

199. 【2608.21476】From Subjective Judgments to Auditable Standards:Protocol-Guided AI Auditing of Website Redundancy

链接：https://arxiv.org/abs/2608.21476

作者：Ge Kong,Yongtong Cao

类目：oftware Engineering (cs.SE); Computer Vision and Pattern Recognition (cs.CV)

关键词：single fixed meaning, Website redundancy, Observable Redundancy Audit, Website, Observable Redundancy

备注：

点击查看摘要

Abstract:Website redundancy does not have a single fixed meaning. The same repeated element may distract during one task and provide backup during another. We introduce CORA (Counterfactual, Observable Redundancy Audit), which measures repetition load, normal-use tax, and failure-domain recovery reserve separately. Each run retains screenshots, stable element identities, and task traces. A versioned vision-language model proposes the annotations. Typed validation and release checks then determine whether a calibrated dimension can be reported; failed or malformed outputs stay in the fixed denominator. On a transparent mechanistic testbed, the factorized CORA representation separated reserve from normal-use tax and predicted perturbed success more accurately than scalar-load baselines. The model studies then showed why repeatability is not enough: two small local vision-language models produced recurring outputs, but neither instrument met all release requirements. CORA therefore withheld automated scores from both instruments while retaining the raw responses and failure records. Separate checker fixtures confirmed that the typed validator and hardened release gates implement their specifications; these tests do not establish semantic grounding or accuracy on production sites. Taken together, the results position CORA as an auditable candidate procedure for the controlled benchmark studied here rather than a general standard. Human agreement, AI-versus-human accuracy, and validation on independent production sites remain open empirical questions.

200. 【2608.21468】3D Point Cloud from Close-Range Photogrammetry for Defect Characterisation of Rubberised Concrete

链接：https://arxiv.org/abs/2608.21468

作者：Jiacheng Liu,Mohammed Alnahhal,Ailar Hajimohammadi,Sara Gonizzi Barsanti,Jinling Wang,Mohsen Kalantari

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Terrestrial Laser Scanning, Laser Scanning, Terrestrial Laser, mainstream LiDAR systems, point clouds

备注： 8 pages, 10 figures. Published in the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, XXV ISPRS Congress 2026, Toronto, Canada

点击查看摘要

Abstract:While three-dimensional (3D) point clouds are widely used in civil engineering, mainstream LiDAR systems such as Terrestrial Laser Scanning (TLS) are physically constrained to laboratory environments. Since their laser spot size typically exceeds the width of microcracks, the beam physically bridges over voids, rendering TLS unsuitable for fine-scale defect analysis. Alternatively, close-range photogrammetry utilising Structure-from-Motion (SfM) and Multi-View Stereo (MVS) algorithms offers a solution for testing highly tortuous materials, and its utility at fine-scale remains underexplored. This study adapts photogrammetric workflows specifically for rubberised concrete (RuC), a sustainable composite exhibiting high ductility and complex fracture morphologies. High-resolution image sets were captured using a Canon DSLR and an iPhone 16 to generate dense 3D models. Comparisons revealed that the DSLR-based reconstruction achieved sub-millimetre resolution, demonstrating superior performance for fine-scale surface monitoring. An RGB-guided crack extraction method was developed to enhance the identification of surface defects and isolate potential crack areas from the background. The extracted crack regions were visually distinguishable and provided a well-structured geometrical representation of defect morphology. Furthermore, a Pre and Post-Test deformation analysis was conducted to quantify surface displacement across testing stages. The results confirm that this close-range photogrammetry workflow is a flexible, high-resolution alternative to LiDAR for surface inspection and deformation monitoring of specimens in laboratory settings. Ultimately, this approach establishes a robust geometric baseline for future automated 3D feature characterisation and material performance evaluation.

201. 【2608.21464】Complexity Induction: Compositional Generalization via Structured Label Distortion

链接：https://arxiv.org/abs/2608.21464

作者：Aleksandr Abramov

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：term complexity induction, standard CNN classifier, complexity induction, architectural modification, term complexity

备注：

点击查看摘要

Abstract:We demonstrate that structured distortion of training data - which we term complexity induction - can induce compositional generalization in a standard CNN classifier without architectural modification. Using synthetic images of colored geometric shapes, we encode classes as flat string labels (e.g., "red-circle") with no explicit attribute decomposition, and exclude certain color-shape combinations from training entirely. We apply two distortion methods derived from Jaccard string similarity between class names: mixed labels (soft target distributions encoding inter-class overlap) and expanded dataset (false training samples with structurally motivated incorrect labels). Both methods induce the ability to predict unseen class combinations, and act at different levels: mixed labels activate the classifier for unseen combinations by exploiting the CNN's natural embedding structure, while expanded training improves the embedding factorization itself. A control with random (unstructured) false labels confirms that the effect depends on the structure of the distortion, not on noise per se. These results suggest that structured complication of training signals can influence both the internal organization of learned representations and their compositional interpretation - a principle that may underlie the role of natural language in cognitive development.

202. 【2608.21460】FigmaTrace: Capturing Creative Nuances in Human Figma Design Workflows

链接：https://arxiv.org/abs/2608.21460

作者：Darshan Deshpande,Yoshinari Fujinuma,Martyna Markiewicz,Devanshu Bansal,Shivani Jain,Nicholas Saban,Chirag Maheshwari,Anand Kannappan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Vision Language Models, Vision Language, recently shown improvements, creative design tasks, Language Models

备注： Dataset: [this https URL](https://huggingface.co/datasets/PatronusAI/figmatrace) Model: [this https URL](https://huggingface.co/PatronusAI/Qwen3.8-27B-Figmatrace-SFT)

点击查看摘要

Abstract:Vision Language Models have recently shown improvements in several objective and verifiable domains such as object detection but continue to underperform on subjective and creative design tasks. A major contributor to this performance gap is the lack of high quality human workflow data that captures a diverse set of preferences and decisions that make human experts good at design tasks. In this work, we first define a unique, expert curated taxonomy of design skills and best practices which we further expand into a set of 126 open ended, subjective, long horizon tasks. Built on top of this and expert solutions, our dataset FigmaTrace contains over 200 hours of human captured video data converted into 3469 design trajectories using a novel design phase-based method. We use our dataset to train four models and show that training on FigmaTrace leads to a performance improvement comparable to frontier closed models such as \textsc{Claude-Opus-5} and \textsc{GPT-5.6-Sol} on four out of distribution agentic GUI environments. We further perform a useful ablation to attribute these performance improvements to a design phase-based video to trajectory conversion which outperforms prior length-based conversion approaches. Finally, we perform a qualitative analysis on the best performing \textsc{Qwen3.8-27B} outputs to better correlate performance improvements to FigmaTrace's trends. We open source our dataset and the best model for the community.

203. 【2608.21457】CLSC DETR: Reliable Candidate Ranking via Cross Layer Geometric Support for UAV Small Object Detection

链接：https://arxiv.org/abs/2608.21457

作者：Junyan Lin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Unmanned aerial vehicle, complex aerial scenes, aerial scenes remains, scenes remains challenging, Unmanned aerial

备注：

点击查看摘要

Abstract:Unmanned aerial vehicle (UAV) object detection is critical for applications such as target search, where accurate detection of small objects in complex aerial scenes remains challenging. The limited spatial extent, dense distribution, and frequent occlusion of small objects make reliable candidate ranking particularly difficult. Existing Detection Transformer (DETR) based methods improve ranking by estimating localization quality from individual queries and incorporating it into classification scores. However, a single query often lacks sufficient geometric evidence for small objects with weak boundary cues, resulting in unreliable quality estimation and unstable ranking. To address this limitation, we propose Cross Layer Local Support and Consistency Calibration for DETR, termed CLSC DETR. Specifically, the Cross Layer Local Support module establishes correspondences between final layer queries and intermediate layer candidates to aggregate complementary geometric evidence for more reliable localization quality estimation, while the Classification and Localization Consistency Calibration module adaptively adjusts classification scores according to localization quality and classification reliability to improve candidate ranking. Experiments show that CLSC DETR improves AP and AP$_{75}$ over the baseline by 1.5\% and 2.0\% on VisDrone, respectively, while achieving consistent improvements on UAVDT.

204. 【2608.21455】omatoes, Potatoes, and Onions: Questioning the Need for Faces in Face Presentation Attack Detection

链接：https://arxiv.org/abs/2608.21455

作者：Guray Ozgur,Fadi Boutros,Naser Damer

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：PAD, face PAD, face PAD datasets, conventional face PAD, visual artifacts introduced

备注： Accepted at ACMM2026 Workshops

点击查看摘要

Abstract:Face presentation attack detection (PAD) is traditionally formulated as a face-specific problem, although many of the visual artifacts introduced by print, replay, and recapture processes are not inherently tied to facial appearance. In this work, we investigate whether transferable PAD representations can be learned without using faces during downstream PAD training. To this end, we introduce TPO, a controlled face-free presentation attack dataset consisting of bona fide, print, and replay recordings of, almost randomly chosen, tomatoes, potatoes, and onions acquired under protocols that closely mirror conventional face PAD datasets. Using a foundation-model-based PAD architecture, we demonstrate that a detector trained on TPO achieves an average AUC of 92.70% across four standard cross-dataset face PAD benchmarks, outperforming training on synthetic faces and remaining competitive with models trained on real face datasets. Conversely, models trained on face PAD datasets transfer consistently above chance to TPO, suggesting that the learned representations capture characteristics of the presentation process rather than object semantics. Furthermore, incorporating TPO into conventional face PAD training consistently improves cross-dataset performance under fixed optimization budgets, indicating that face-free data provides complementary information rather than simply additional training samples. Finally, representation and frequency analyses provide further evidence that transferable PAD representations cannot be explained by a single spectral artifact but instead encode richer presentation cues shared across object categories. Together, these results provide empirical evidence that transferable presentation attack representations can be learned independently of facial content, opening new opportunities for privacy-preserving and identity-independent PAD development.

205. 【2608.21454】Multi-Scale Fruit Capsules: Dilated Convolutions and Dynamic Routing for In-the-Wild Explainable Fruit Recognition

链接：https://arxiv.org/abs/2608.21454

作者：Subhankar Chattoraj,Sawon Pratiher,Samiran Das,Hubert Konik

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：absorb wide intra, narrow inter-class variability, automated fruit classification, bagged in plastic, colour and texture

备注： Accepted in IECON 2026

点击查看摘要

Abstract:The same fruit appears in a bunch, unpicked, peeled, bagged in plastic, or sliced on a dish, so automated fruit classification in the wild (AFCW) must absorb wide intra- class and narrow inter-class variability in shape, size, colour and texture. Convolutional networks route information through pooling, which discards the pose and location of the region of interest and therefore generalises poorly across these presentations. We propose FruitCapsNet, a capsule network whose Fruit Capsules replace the standard convolutional front end with dilated convolutions: the receptive field grows exponentially at constant parameter cost, so each capsule encodes multi-scale context before dynamic routing resolves part whole spatial agreement. Hyper-parameters, including the dilation factor, are selected by Bayesian optimisation rather than grid search. On three public datasets (SMP, FruitsGB, Fruits-360) and a new 19-class, 10,639-image in-the-wild dataset (PD-19), FruitCapsNet exceeds ten fine-tuned transfer-learning backbones at one-third the depth, with the largest margin (+2.7% over the nearest competitor) on the hardest set. Grad-CAM saliency propagated from the DigitCaps layer shows that the improvement comes from attributing decisions to whole-fruit regions rather than to object edges, giving post-hoc evidence that the gain is not a dataset artefact.

206. 【2608.21450】Beyond Visual Similarity: Entity-Aligned Retrieval for Knowledge-Based Visual Question Answering

链接：https://arxiv.org/abs/2608.21450

作者：Hangrui Xu,Zhengxian Wu,Yunyao Yu,Zhuohong Chen,Rui Cong,Xiangwen Deng,Zhifang Liu,Peng Jiao,Haoqian Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Visual Question Answering, Question Answering, Knowledge-Based Visual Question, retrieving external information, answer queries involving

备注： Accepted by ACM MM 2026

点击查看摘要

Abstract:Knowledge-Based Visual Question Answering (KB-VQA) relies on retrieving external information to answer queries involving long-tail entities. However, existing retrieval pipelines predominantly employ CLIP-style dual encoders, which prioritize surface-level visual similarity over entity-level semantic alignment. This paradigm often fails when semantically identical concepts exhibit large visual variations or when distinct entities appear visually similar. To address this, we propose KBMR, the first MLLM-based embedding retriever tailored for KB-VQA. Leveraging the robust autoregressive capabilities of MLLMs, KBMR maps images into a semantic space that better preserves concept identity. To tackle the challenge of noisy supervision in Wikipedia-scale retrieval, we introduce an MLLM-based semantic discriminator that generates continuous entity-consistency weights. These weights guide a novel continuous semantic distillation objective, enabling effective hard negative sampling and soft supervision beyond rigid binary labels. Extensive experiments demonstrate that KBMR significantly outperforms CLIP baselines, yielding up to a 14.7% improvement in retrieval Recall@1 and a 9.4% gain in end-to-end VQA accuracy. Code is available at this https URL.

207. 【2608.21447】BIMScript: Material-Aware Structured Scene Programs for BIM Ingestion

链接：https://arxiv.org/abs/2608.21447

作者：Prakash Kondibhau Naikade,Thomas B. Moeslund,Andreas Møgelmose

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：semantically explicit representation, Structured-language models, explicit representation, SceneScript reconstruct, inherently editable

备注： Project Page: see [this https URL](https://bimscriptworld.github.io/BIMScript/) ; to be published in ECCV 2026 TwinWorld Workshop

点击查看摘要

Abstract:Structured-language models such as SceneScript reconstruct a scene as a short program of parametric commands, an inherently editable and semantically explicit representation. We ask three questions that stand between such models and their most compelling application, automated ingestion of existing buildings into BIM tools, studied here on synthetic scans: \emph{what} is the scene made of, \emph{how fast} can it be produced, and \emph{exactly where} is each element. BIMScript answers all three within one grammar. First, we extend the layout language with per-element \emph{material} and \emph{condition} attributes, supervised by a vision-language-model material-passport corpus we build over 100k synthetic scenes (1.9M pseudo-labeled elements), and route image appearance to the material tokens through a lifted-feature point encoder. Second, we show that autoregressive decoding of these programs is dominated not by compute but by kernel-launch and host-synchronization overhead, and remove it with an output-exact CUDA-graph decoder (1.9 vs 6.4\,ms/step, $3.4\times$) plus a grammar-parallel, tolerance-verified draft-and-verify scheme that exploits the deterministic entity schema. Third, we address the model's 5cm token-grid granularity with training-free geometric snapping and a hybrid discrete--continuous decoder head that regresses a sub-bin offset, and measure how much of the residual error each recovers. Because each command maps one-to-one onto a native Revit object, we validate direct ingestion into a BIM authoring tool end to end with a working add-in and its IFC4 export, and the same program's language form is designed to support LLM-driven, sustainability-aware reasoning over the built asset.

208. 【2608.21445】ViTexSZ: Heterogeneous Vision-Text Knowledge Distillation for EEG Seizure Detection

链接：https://arxiv.org/abs/2608.21445

作者：Chenxi Liu,Mingzhao Li,Yicong Liu,Hao Miao,Hongyuan Zhang,Ziyi Chen,Gaofeng Meng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：continuous neurological monitoring, Automated seizure detection, EEG, Automated seizure, neurological monitoring

备注：

点击查看摘要

Abstract:Automated seizure detection from electroencephalography (EEG) is essential for continuous neurological monitoring, particularly for subclinical epileptic seizures that may exhibit only subtle electrographic changes. Existing time-series methods are often designed for fixed EEG channel configurations, thereby limiting their applicability to heterogeneous EEG recordings with irregular channel layouts. Although visual and language modeling offer promising alternatives, aligning heterogeneous EEG representations with clinical semantics remains challenging. We introduce ViTexSZ, a heterogeneous Vision-Text knowledge distillation framework for EEG seizure detection. ViTexSZ converts EEG recordings into structured waveform images and introduces a query-based multi-channel alignment module that maps source-dependent visual features into a unified token space. A heterogeneous teacher further integrates the aligned EEG representations with clinical prompts through a multimodal large language model, associating high-level clinical semantics with seizure-related evidence. Vision-text knowledge distillation then transfers the teacher representations to a lightweight student during detection. Experiments on four EEG seizure datasets demonstrate the generalizability of ViTexSZ across both subclinical and general seizure detection scenarios, achieving the highest accuracy on all datasets and relative improvements of up to 12.9% over the second-best baselines, showing its effectiveness.

209. 【2608.21443】xt-Guided Visual Dependency Graph Learning with Cross-Modal Attention Priors

链接：https://arxiv.org/abs/2608.21443

作者：Fei Wang,Yutong Zhang,Yang Ye,Jinxian Chen,Wang Wenshuai,Xiong Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：remains largely unexplored, Estimating interpretable conditional-dependence, Gaussian Graphical Models, visual-linguistic features remains, features remains largely

备注：

点击查看摘要

Abstract:Estimating interpretable conditional-dependence structures from multimodal visual-linguistic features remains largely unexplored. We propose CM-GLasso (Cross-Modal Graphical Lasso), a framework that bridges vision-language representation learning and sparse Gaussian Graphical Models. CM-GLasso introduces three key components: (i) a text visualization strategy that renders class-attribute descriptions as images and processes them through the same SigLIP-2 vision encoder as natural images, yielding prototype-indexed patch-level attention footprints in a shared feature coordinate system; (ii) a cross-attention distillation mechanism that condenses high-dimensional patches into a small set of semantic graph nodes, whose attention-footprint similarities yield cross-modal structural priors for non-uniform L1 penalization; (iii) a joint ADMM formulation that estimates shared and class-specific precision components within a single convex objective, avoiding the need to first estimate and then decompose separate class-wise graphs. The learned sparse graph topologies directly support a parameter-free, precision-based classification rule and a lightweight topology-aware segmentation head. Extensive experiments on eight benchmarks demonstrate that CM-GLasso achieves competitive or superior performance compared with strong feature-based and task-specific baselines. Under the matched controlled protocol, it attains the highest average classification accuracy (91.97%) and the highest segmentation mIoU among the controlled baselines on VOC (74.75%) and ADE20K (64.01%), while also yielding explicit sparse conditional-dependence graphs with common-specific decomposition.

210. 【2608.21439】WorldMind: Decoupled Game World Model for State-Aware NPC Behavior

链接：https://arxiv.org/abs/2608.21439

作者：Zhiyang Deng,Boran Zhang,Danze Chen,Yeying Jin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：recently demonstrated promising, demonstrated promising capabilities, NPC behavior, state-aware NPC behavior, NPC

备注： Project page: [this https URL](https://teawhite.cn/worldmind_projectpage/)

点击查看摘要

Abstract:Game world models have recently demonstrated promising capabilities in generating visually coherent and action-controllable gameplay videos. However, non-player character (NPC) behavior in existing models is either implicitly entangled with video generation or explicitly prescribed through external control signals. Consequently, a game world model has to jointly understand the state, plan the NPC's response and render its visual outcome, limiting its ability to produce responsive and state-aware NPC behavior. The challenge lies in the lack of an explicit interface for state-grounded decision-making. To this end, we introduce WorldMind, to our knowledge the first decoupled framework for state-aware NPC behavior in game world models. WorldMind separates interactive world modeling into four layers: an Understanding Layer that constructs a compact state from generated frames; a Decision Layer that reasons over the compact state to plan the NPC's next action; a Control Layer that translates the actions into temporally aligned conditions; and a Generation Layer that synthesizes their visual outcomes. By reconnecting layers in a closed interaction loop, WorldMind grounds NPC behavior in the evolving game state. We further introduce BOSS-140K, a dataset of gameplay videos paired with rich internal game states, together with an agent that automates the collection at scale. Experiments on BOSS-140K demonstrate reliable compact state reconstruction and mechanics-grounded planning, with WorldMind preferred over the baselines in approximately 70% of pairwise comparisons for its more tactically appropriate and coherent NPC behavior. Project page: this https URL

211. 【2608.21438】DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning

链接：https://arxiv.org/abs/2608.21438

作者：Xiujin Liu,Tianyu Yang,Yilun Zhao,Xiangliang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)

关键词：modifying reconstructed environments, Text guided, natural language design, language design requests, reconstructed environments

备注：

点击查看摘要

Abstract:Text guided 3D scene editing provides an intuitive interface for modifying reconstructed environments, but remains difficult because natural language design requests are often semantically underspecified and must be grounded in cluttered 3D scenes. Existing methods typically formulate the task as one-shot conditional generation from a single prompt, failing to resolve ambiguous user intents or achieve precise spatial grounding. Consequently, they suffer from severe object localization drift, tracking failure under occlusions, and the notorious multi-view "sticker effect." To overcome these limitations, we present DesignAgent3D, an interactive multimodal agentic framework that reformulates 3D scene editing as a designer-like Plan-Perceive-Act paradigm. The agent first plans by interacting with the user to clarify underspecified design goals, then perceives by grounding the intended edit to specific objects or regions in the 3D scene, and finally acts by applying controlled visual modifications while preserving scene consistency. The edits are further integrated into the underlying 3D representation, supporting persistent and multi-view consistent novel-view rendering. Extensive experiments across both NeRF and 3D Gaussian Splatting backbones demonstrate that DesignAgent3D significantly outperforms state-of-the-art baselines, delivering superior semantic intent alignment, impeccable spatial localization accuracy, and high-fidelity multi-view consistency.

212. 【2608.21431】Boosting Knowledge-based Visual Question Answering with Structured Context Reasoning

链接：https://arxiv.org/abs/2608.21431

作者：Qiyou Liu,Yong Zhang,Jianjie Luo,Zhenguo Yang,Yi Yu

类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)

关键词：Question Answering aims, Knowledge-based Visual Question, Visual Question Answering, Question Answering, Large Language Models

备注： Accepted by ICME 2026. Source code is available at [this https URL](https://github.com/WISLab-GDUT/SCoRe)

点击查看摘要

Abstract:Knowledge-based Visual Question Answering aims to answer questions about an image by integrating external knowledge with visual and textual information. Recent approaches often rely on in-context learning to prompt Large Language Models (LLMs) with multimodal context in a zero-shot or few-shot manner. However, we observe that directly concatenating heterogeneous visual descriptions and retrieved knowledge into long, unstructured prompts often degrades reasoning performance, due to both excessive irrelevant context and the lack of explicit relational structure. In this paper, we propose an LLM-based Structured Context Reasoning (SCoRe) framework that infers both explicit and implicit relationships for prediction. SCoRe consists of three stages: Context Acquisition, which generates diverse visual notes and retrieves explicit knowledge via an efficient two-stage multimodal retrieval strategy; Context Selection, which filters relevant visual, explicit, and implicit knowledge using LLM-guided selection; and Context Compression, which performs Relational Logic Distillation (RLD) to transform raw text into explicit entity-relation triplets. These relational triplets serve as a concise and structured prompt for final answer prediction. Extensive experiments on the OK-VQA and A-OKVQA benchmarks demonstrate that SCoRe consistently outperforms state-of-the-art methods.

213. 【2608.21430】Evaluating Multimodal Narrative Understanding of Popular Hollywood Films

链接：https://arxiv.org/abs/2608.21430

作者：David Bamman,Kent K. Chang,Allison Cooper,Juishan Hsu,Reina Kushihashi,Madison Mar,Arnav Podichetty,Rachael Samberg,Ipek Nil Sancak,Yuhan Shao

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY)

关键词：increasingly show promise, large-scale computational analysis, language models increasingly, models increasingly show, Multimodal language models

备注：

点击查看摘要

214. 【2608.21429】Measuring Gender Representation in Animated Films

链接：https://arxiv.org/abs/2608.21429

作者：David Bamman,Allison Cooper,Ruby Alvarez Rubio,Reina Kushihashi,Madison Mar

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：children in mind, vector for enculturation, fine-grained instrument, Animated films, audience of children

备注：

点击查看摘要

Abstract:Animated films--often developed with an audience of children in mind--are an important vector for enculturation, and empirical work that has examined the representation of gender at scale in these films has largely focused on counting the gender composition of the cast rather than deploying a more fine-grained instrument (such as assessing the visibility of those characters in overall screentime). In this work, we develop a computational pipeline for recognizing animated characters in these films, and use it to test several hypotheses about gender representation in a corpus of 224 popular animated movies. We find that while the overall representation of female characters in animated films largely tracks with those of live-action films (over the period 1980-2025), we see stark differences between the representation of human characters (much greater representation among women and girls) and non-humans (largely male). Contrary to past work on Disney, we do not see female characters declining in antagonist roles in animated films, and characters who are women and girls are much more likely to share scenes together than their live action contemporaneous counterparts.

215. 【2608.21427】Few-Shot Cross-Dataset Adaptation for Tuberculosis Detection Using DenseNet

链接：https://arxiv.org/abs/2608.21427

作者：Bidhan Biswas,Shahadat Hossain Sohag,Nabil Ashab,Soumit Kumar Kundu,Saif Mahmud Parvez

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：dangerous bacterial ailments, bacterial ailments, common and dangerous, dangerous bacterial, domain

备注：

点击查看摘要

Abstract:Tuberculosis (TB) is one of the most common and dangerous bacterial ailments. Every year, it causes a large number of deaths worldwide. Although many deep learning models can detect tuberculosis from chest X-rays quite accurately, severe domain shift across datasets makes the task challenging. Different imaging protocols, patient demographics, and equipment across domains make the task of generalization difficult. In real-world settings, a model may perform well on one dataset but show a noticeable drop in performance when tested on another. In this work, we address this domain adaptation challenge through a few-shot scaling study. A controlled cross-dataset evaluation is presented in this paper using TBX11K as the source domain and the Mendeley TB dataset as the target domain. It is investigated how varying the number of target samples affects model performance under three training regimes: frozen backbone adaptation, full fine-tuning of a source-pretrained DenseNet121 model, and training from scratch. The results indicate that the model can perform well even with limited data and can achieve 98.36\% accuracy with just 75 labeled samples per class. The adaptation curves demonstrate how fine-tuning effectively mitigates domain shift. These findings establish full fine-tuning of pretrained models as a highly effective and practical strategy for mitigating domain shift in low-resource clinical deployment scenarios.

216. 【2608.21426】AI Visual Inspection for Garment Production

链接：https://arxiv.org/abs/2608.21426

作者：Ray Wai Man Kong,Ding Ning,Theodore Ho Tin Kong

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：garment manufacturing industry, accelerate digital transformation, improve product quality, manufacturing industry, reduce costs

备注： 18 pages, 8 figures

点击查看摘要

Abstract:The garment manufacturing industry is under increasing pressure to improve product quality, reduce costs, and accelerate digital transformation toward Industry 4.0. One of the most challenging quality-control activities is sewing-line inspection, where defects such as broken stitches and skipped stitches are difficult to detect consistently through manual inspection. Human-based inspection is often affected by fatigue, subjective judgement, and inconsistent performance, resulting in defect leakage, rework, and reduced production efficiency. This study presents the development and validation of an Artificial Intelligence (AI)-based visual inspection system for garment sewing-line quality control. The system utilizes Convolutional Neural Networks (CNNs) to detect sewing defects and was initially trained using black fabric and black sewing thread samples. Experimental testing was conducted on black, red, dark green, light blue, silver, and fluorescent yellow fabrics. The results demonstrated successful detection of jump sewing-line defects on black, red, and dark green materials, while performance limitations were observed for broken sewing-line defects and fabrics with significantly different visual characteristics, including light blue, silver, and fluorescent yellow colours. These findings indicate that model accuracy is strongly influenced by the diversity of training data and the ability to generalize across different fabric and thread colours.

Comments:
18 pages, 8 figures

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

Cite as:
arXiv:2608.21426 [cs.CV]

(or
arXiv:2608.21426v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.21426

Focus to learn more

              arXiv-issued DOI via DataCite

Journalreference:
International Journal of Computer Science and Information Technology Research V14 issue 3 pp47-64 July-September 2026

Related DOI:

https://doi.org/10.5281/zenodo.21946142

Focus to learn more

            DOI(s) linking to related resources</p>

217. 【2608.21425】Aligning Human Sense: Calibrated Distributional Reward Learning for Video Generation

链接：https://arxiv.org/abs/2608.21425

作者：Nai-Xin Zhai,Weihua Cheng,Dexu Yu,Yikai Gu,Hanwen Du,Junchen Fu,Chenxi Huang,Yingwei Song,Liyuan Lillian Ma,Yang Ran,Youhua Li,Yongxin Ni

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：AI-powered content creation, human preferences, content creation, human, central to AI-powered

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Video generation is central to AI-powered content creation. Aligning generated videos with human preferences is a key criterion for evaluating generation quality. Despite significant progress in visual quality, three key challenges remain. First, the reliability of reward signals is constrained by the quality of human preference data, which is often affected by subjective noise and bias. Second, standard scalar reward models collapse multi-aspect human preferences into a single value, leading to the loss of dynamic trade-offs across multiple preference dimensions. Third, in policy optimization, the widely adopted KL divergence imposes primarily local constraints and may fail to capture the global structure of human preferences. To address these challenges, we propose a unified preference-aware learning framework for video generation. First, we introduce elite-guided filtering to calibrate preference data and construct reliable supervision for reward model training. We then model video quality as a multidimensional reward distribution to capture the uncertainty inherent in human preferences, and use the Wasserstein distance to align the learned reward distribution with the empirical human preference distribution. Finally, we introduce Wasserstein-based distributional alignment into GRPO, guiding policy optimization to better match the global structure of human preferences over videos. Experiments on reward modeling and video generation demonstrate that our approach improves the reliability of reward signals and the perceptual consistency of generated videos. Our code is available at this https URL.

218. 【2608.21424】EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing

链接：https://arxiv.org/abs/2608.21424

作者：Yuqian Zhou,Zhenghong Zhou,Zongze Wu,Cameron Smith,Richard Zhang,Jiebo Luo,Eli Shechtman,Zhe Lin

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

关键词：Interactive video generation, Reference-guided Video Editing, video generation, Camera Pose Change, editing

备注： 25 pages, 12 figures, Project page: [this https URL](https://real-time-video-research.github.io/editstream/)

点击查看摘要

Abstract:Interactive video generation and editing are becoming increasingly important for creative design. In this report, we introduce EditStream: a unified framework for interactive video generation and editing. EditStream unifies multiple video creation and manipulation tasks within a single DiT-based model through flexible task-specific conditioning, and further transforms it into a fast, few-step autoregressive model for efficient streaming. It supports Text-to-Video, Image-to-Video, Video-to-Video, Editing Propagation, Reference-guided Video Editing, and Camera Pose Change, enabling flexible control over video generation, transformation, and editing within one system. To make the unified model practical for interactive use, we develop a two-stage distillation approach that combines Velocity Moment Matching (VMM) with autoregressive unrolling. VMM matches conditional velocity moments at student-reached intermediate states to preserve generation quality and motion, while unrolling exposes the student to its own autoregressive predictions to improve temporal stability. Together, they alleviate common challenges in few-step autoregressive video generation, including over-saturation, degraded motion, temporal instability, and complex training. EditStream provides a practical and scalable solution that bridges high-quality diffusion-based video models with interactive creative workflows.

219. 【2608.21422】opology of a Smile: Persistent Homology in Dental Imaging

链接：https://arxiv.org/abs/2608.21422

作者：Leon Dahlmeier,Sara Kališnik,Albert Mehl,Bastian Rieck

类目：Computer Vision and Pattern Recognition (cs.CV); Algebraic Topology (math.AT)

关键词：Cone Beam Computed, Beam Computed Tomography, detailed three-dimensional images, provide detailed three-dimensional, Cone Beam

备注：

点击查看摘要

Abstract:CBCT (Cone Beam Computed Tomography) scans provide detailed three-dimensional images, widely used in dentistry for diagnostic and treatment planning tasks. While invaluable, analyzing and documenting these scans is labor-intensive, prompting efforts to automate key steps like the classification and segmentation of anatomical structures to identify tooth types and associated pathologies. In this article, we propose an approach to automation that leverages persistent homology, a framework from topological data analysis that studies the shape of data by identifying features like connected components, holes, and voids across multiple scales. Persistent homology, together with a support vector machine, allows us to classify teeth in a CBCT scan and to perform diagnostics. Our method advances the state of the art, reaching average accuracy scores of 97.67% for tooth-labeling and 96.77% for diagnostic tasks, outperforming a CNN trained on the same data with accuracy of 70.27% and 86.67%, respectively.

220. 【2608.21402】Selective Cross-View Consistency for World Action Models: Held-Out Viewpoint Robustness Without Test-Time Camera Information

链接：https://arxiv.org/abs/2608.21402

作者：Bingqi Huang,Bingchuan Wei,Yingkai Cai,Zhaokui Wang

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：World action models, future video frames, denoise future video, jointly denoise future, World action

备注：

点击查看摘要

Abstract:World action models (WAMs) jointly denoise future video frames and robot actions, and the video prior is expected to generalize their control. Camera viewpoint change remains one of their hardest perturbation axes. We study a question specific to this model class: when training with same-state cross-view image pairs, on which output coordinates should a consistency loss be imposed? The WAM denoising target mixes view-covariant coordinates, namely the predicted future scene, with view-invariant coordinates, namely the action chunk, future proprioception, and value. We show that consistency applied to the covariant block is provably harmful, shrinking legitimate view-specific content to a fraction $1/(1+4\lambda)$ of its true value, and we verify this shrinkage law in controlled experiments. Selective cross-view consistency (SCVC) therefore constrains only the invariant block, requires no camera labels, extrinsics, depth, or view synthesis at training or test time, and leaves the deployment interface unchanged. We introduce a carve-and-hold-out evaluation protocol on the LIBERO-Plus camera track that separates a distribution-matched ceiling from genuine interpolation and extrapolation to held-out viewpoints, with a matched pair-trained control isolating the effect of the consistency term from pair exposure. On held-out orbital viewpoints beyond the training envelope, SCVC improves closed-loop success over the matched control by 12.2 points (95% CI [7.4, 17.0]; +15.5, CI [11.7, 19.4], under an independent second seed) -- an effect two further camera axes replicate -- while interpolation within the envelope shows no gain in either seed (-1.2 and -4.3 points) and in-distribution competence is preserved (-0.6, -0.2). We also report a cross-backbone audit showing that published camera-robustness numbers are confounded by wrist-camera pose stability.

221. 【2608.21380】RoboShape: Information-Theoretic Point Cloud Representations for Privacy-Aware Robot Perception

链接：https://arxiv.org/abs/2608.21380

作者：Oguzhan Baser,Mirac Sozen,Kaan Kale,Sandeep Chinchali,Sriram Vishwanath

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

关键词：collected point clouds, point clouds reveal, sensitive spatial context, robotic agents operating, cloud-based planning

备注： under review

点击查看摘要

Abstract:With the increased adoption of robotic agents operating in human environments by scanning and sharing 3D representations (e.g., for fleet learning, cloud-based planning, or collaborative mapping), collected point clouds reveal not just the objects in a scene but also sensitive spatial context, such as room function or information that occupants never consented to disclose. Traditional point cloud encoders offer no principled control over this: either all is preserved, or none. Hence, we introduce RoboShape, an information theory guided compression head following the frozen {\tt Sonata} encoder. We project voxel-level embeddings using the Donsker-Varadhan formulation of mutual information (MI). Specifically, we maximize the MI between embeddings and object-level understanding while minimizing it for private attributes. RoboShape leads to 87.5\% smaller embeddings that retain 98.7\% of object classification utility while collapsing sensitive attribute predictions by 39.3\% across the three real-world indoor LiDAR datasets. Its privacy-preserving embeddings are cheaper to transmit over the network or to train a model for any downstream tasks. We release the RoboShape codebase to give the robotics community a practical, encoder-agnostic tool for building perception pipelines that are compact, privacy-aware, and deployment-ready.

222. 【2608.15934】Differentiable Voxelization of Surface Representations

链接：https://arxiv.org/abs/2608.15934

作者：Tobias Djuren,Ugo Finnendahl,Markus Worchel,Hendrik Meyer,Marc Alexa

类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词：facilitate different computations, shape representations facilitate, representations facilitate, Abstract, Surface

备注：

点击查看摘要

Abstract:Different shape representations facilitate different computations. Surface representations, in particular meshes, are often used for modeling, whereas volume representations are useful for spatial queries such as intersection or containment. Optimizing a surface representation based on a volumetric properties by gradient descent requires the derivatives of the volume relative to its bounding surface. We derive this gradient for winding numbers and show that it can be efficiently computed for volumetric values sampled on a regular grid (voxel representation) and surface parameters based on vertex sets (triangle meshes). This enables an efficient solution for a variety of optimization problems. We demonstrate the practical use of this approach at the examples of deforming meshes to resolve intersections, being manufacturable by cutting with a bandsaw from three directions, and creating shapes that are close to tiling 3D space.

223. 【2608.15933】As-Rigid-As-Possible Regularization for Implicit Surfaces

链接：https://arxiv.org/abs/2608.15933

作者：Tobias Djuren,Markus Worchel,Ugo Finnendahl,Marc Alexa

类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词：machine learning, regained popularity, Implicit surface representations, Implicit surface, surface

备注：

点击查看摘要

Abstract:Implicit surface representations have regained popularity because of their use in machine learning. A common component in optimization is regularization, penalizing the deviation of the surface from its original shape. The popular as-rigid-aspossible (ARAP) energy strikes a good compromise between realistic deformation behavior and efficient computation, at least for piecewise linear meshes. We develop an approach for computing the ARAP energy of a deformation function based on point sampling of the surface. The implicit representation is exploited to provide differentials in each sample. The evaluation is efficient and exact in each sample (up to numerical precision). We demonstrate the general applicability of the method to neural shape processing in several applications and contrast its properties with alternatives from the literature.

224. 【2608.22619】GET: Generative Embedding Translation for Medical Image Segmentation

链接：https://arxiv.org/abs/2608.22619

作者：Md Maklachur Rahman,Md Hasan Al Banna,Saraf Anjum,Mahmudul Hasan,Tracy Hammond

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：remaining computationally efficient, direct pixel-wise prediction, preserve target structure, learned latent representations, Stable Diffusion VAE

备注： Accepted at ECCV 2026 - BioImage Computing Workshop

点击查看摘要

Abstract:Generative segmentation provides an alternative to direct pixel-wise prediction by operating on learned latent representations, but effective image-to-mask translation must preserve target structure while remaining computationally efficient. We propose Generative Embedding Translation (GET), a structured embedding-translation framework that progressively transforms image embeddings into mask embeddings within the frozen latent space of a Stable Diffusion VAE. GET uses a U-Net-style Embedding Translation Network with 1.07M trainable parameters, combining Mobile Bottleneck Convolutions, Subsampled Self-Attention, and Multi-scale Feature Enrichment for local modeling, global context, and multi-scale refinement. Across five medical segmentation datasets, GET outperforms generative, CNN, and Transformer baselines. Compared with the strongest generative baseline, GMS, GET improves average Dice and IoU by 0.93% and 1.26%, reduces HD95 by 0.81 pixels, and uses 31.41% fewer trainable parameters. Under bidirectional BUS-BUSI domain shift, GET further improves Dice and IoU by 3.51% and 3.39%, while reducing HD95 by 27.37 pixels. Our code is available at: this https URL.

225. 【2608.22281】CiUNet: A Hybrid Swin-CNN UNet for Medical Image Segmentation

链接：https://arxiv.org/abs/2608.22281

作者：Bin Dong,Jinghong Chen

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：requires high accuracy, demands privacy preservation, Medical image segmentation, Medical image, image segmentation requires

备注： 14 pages, 3 figures. The demo predictor and trained weights are available at: [this https URL](https://github.com/ciphoBD/CiUNet)

点击查看摘要

Abstract:Medical image segmentation requires high accuracy and robustness, yet practical commercial deployment also demands privacy preservation and computational efficiency. In this context, the U-Net architecture, which can be inherently decoupled into independent encoder and decoder components, serves as a natural commercial choice. However, pure Transformer-based variants like Swin-UNet often suffer from insufficient local detail capture and limited interpretability. In this paper, we propose a lightweight hybrid architecture built upon the Swin-UNet framework. Our model integrates a parallel CNN encoder to complement the shallow layer reasoning of Swin Transformers with local texture features. To bridge the semantic gap and enhance fine-grained spatial detail recovery, we design an asymmetric feature fusion strategy and introduce cross-layer skip (XSkip) connections that explicitly propagate shallow CNN features into the decoder. We further incorporate novel loss functions and an auxiliary supervision head (Aux-Head) to strengthen training stability, boundary delineation, and intermediate feature interpretability. Extensive experiments on the Synapse multi-organ segmentation dataset demonstrate that our approach achieves state-of-the-art competitive Dice scores and Hausdorff distances, offering an accurate, efficient, and interpretable solution for clinical deployment.

226. 【2608.22097】Pretreatment DCE-MRI Resolves Response Quality Within Pathologic Endpoints in Neoadjuvant Breast Cancer

链接：https://arxiv.org/abs/2608.22097

作者：Dattatreya Kantha,Murray H. Loew

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)

关键词：Pathologic complete response, Pathologic complete, strong neoadjuvant endpoint, recur and clinical, genomic variables

备注：

点击查看摘要

Abstract:Pathologic complete response (pCR) is a strong neoadjuvant endpoint, yet 5-15% of complete responders recur and clinical/genomic variables do not reliably identify them. We tested whether pretreatment dynamic contrast-enhanced MRI entropy - intratumoral enhancement heterogeneity - resolves response quality hidden within pCR and residual cancer burden (RCB). Across four cohorts (1,200 patients), a prespecified entropy threshold defined favorable and adverse structural states. Crossing structure with pathology yielded a four-tier framework spanning 4.1-fold recurrence in I-SPY1 and 7.7-fold at response extremes. In I-SPY2, 55 of 219 complete responders (25.1%) were structurally adverse, pretreatment. In an external HER2-positive responder synthesis (I-SPY1 pathology-confirmed pCR plus UCSF best-response proxy; n = 33, 10 events), adverse structure was associated with higher recurrence risk (HR = 2.87, 95% CI 1.38-5.96) capturing 7 of 10 recurrences, enriching rather than determining risk. In a HER2-positive RCB-0 subset, recurrence was 12.5% with favorable and 80.0% with adverse structure; Firth Cox regression preserved the association (HR = 8.13, 95% CI 1.71-49.21; n = 21, 6 events). In Duke (n = 908; 76 events), favorable structure remained independently associated with lower distant-recurrence risk (adjusted HR = 0.61, 95% CI 0.41-0.91). RNA linked favorable structure to a directionally reproduced immune-architecture program among non-overlapping patients within ISPY2; EMT-pathway enrichment was favorable-side, while the adverse tier contained a broadly immune-depleted substate. Yet full-cohort RNA models weakly discriminated structural state and did not recover continuous entropy. Pretreatment MRI therefore does not replace pCR or RCB; it reveals response-quality differences that these endpoints compress and identifies a recurrence-enriched group for prospective validation.

227. 【2608.22086】SweepLSD: A One-Pass, O(width)-Memory Line Segment Detector with an Integer-Only Streaming Core and a Real-Time FPGA Realization

链接：https://arxiv.org/abs/2608.22086

作者：Yoshiyasu Shimizu

类目：Image and Video Processing (eess.IV); Hardware Architecture (cs.AR); Computer Vision and Pattern Recognition (cs.CV)

关键词：line segment detector, passing the scan, scan line, reads the image, final line test

备注： 40 pages, 12 figures, 18 tables. Code, benchmarks, and evaluation harnesses (MIT): [this https URL](https://github.com/yosh-shimizu/sweeplsd)

点击查看摘要

Abstract:We present SweepLSD, a line segment detector that reads the image exactly once and emits each segment within a few rows of its last pixel passing the scan line. Every stage, including connected-component labeling and the final line test, processes the image as a row stream: intermediate memory is O(width) rather than O(pixels), and the per-pixel core is integer-only. We give the first complete description of the algorithm, designed in the author's 2014 master's thesis but never published, together with an open-source C++17 implementation and an FPGA realization -- held bit-exact against the software in its hardware configuration -- detecting segments in live 1080p30 video on 2009-era silicon without frame buffer or external memory. On structure-rich public 4K photographs downscaled to Full-HD, one CPU thread detects segments in ~11 ms -- 4.6x/5.2x/25x faster than the original authors' implementations of ELSED, EDLines, and LSD -- with the tightest frame-time distribution and the best per-segment direction accuracy of the four detectors, and curve rejection by design, while trailing ELSED in F-score on synthetic ground truth. A Manhattan-frame vanishing-point study on York Urban and NYU-VP scores every detector under a selection/evaluation-separated best-estimator-per-detector protocol, under which SweepLSD leads on NYU-VP by ~0.3 degrees and trails by 0.1 degrees on York Urban, with the fastest end-to-end pipeline of the four detectors on both. A single-frame camera-attitude application, evaluated on synthetic scenes with exact ground truth and on EuRoC and TUM-VI, matches the baselines' accuracy at a fraction of their memory, and drives a 4K horizon lock to 0.06 degrees median attitude error at 32 ms median per frame.

228. 【2608.22059】CRS-Bench: A Reference-Relative Reliability Benchmark for Medical Image Encoders

链接：https://arxiv.org/abs/2608.22059

作者：Xingtao Lin,Hangqi Ren,Caiwan Sun,You Chen

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：expert annotation, annotation is costly, costly and task-specific, task-specific cohorts, medical image classification

备注： 10 pages, 7 figures. Submitted to WACV 2027

点击查看摘要

Abstract:Pretrained image encoders are central to medical image classification, where expert annotation is costly and task-specific cohorts are often limited. As the model space expands from general-purpose to broad-medical and specialty-specific encoders, selecting the representation becomes a substantive modeling decision. Clean-test discrimination alone is insufficient for this purpose: encoders with similar AUROC can differ in calibration, label efficiency, and stability under acquisition perturbations or distribution shift. We introduce CRS-Bench, a controlled benchmark for multi-objective medical encoder selection. CRS-Bench evaluates 15 pretrained encoder families across dermatology, ophthalmology, and radiology using ISIC 2019, APTOS 2019, and CheXpert, with CheXpert-to-MIMIC-CXR as an observed institutional shift, yielding 17,575 controlled run records and 3,515 seed-aggregated metric rows. Each encoder is characterized along four operational reliability dimensions: discrimination, calibration, label efficiency, and robustness. We summarize these dimensions using the Clinical Reliability Score (CRS), a Pareto-aware, reference-relative score combining dominance, profile balance, and worst-axis performance. AUROC and CRS are positively associated but not decision-equivalent: 21 of 105 pairwise orderings reverse, with a mean absolute rank displacement of 1.87. Paired-seed bootstrap analysis identifies PanDerm, MedSigLIP, and MedGemma as a stable leading reliability tier rather than a statistically resolved single leader. CRS-Bench provides a controlled framework for selecting medical image encoders from multi-axis reliability profiles rather than clean-test AUROC alone.

Comments:
10 pages, 7 figures. Submitted to WACV 2027

Subjects:

Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.22059 [eess.IV]

(or
arXiv:2608.22059v1 [eess.IV] for this version)

https://doi.org/10.48550/arXiv.2608.22059

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

229. 【2608.21497】CHIMERA Challenge: Biochemical Recurrence Prediction in Prostate Cancer Patients using multimodal datasets

链接：https://arxiv.org/abs/2608.21497

作者：Robert N. Spaans,Catherine Chia,Tongjie Wang,Adam Kowalewski,Parandzem Khachatryan,Domingos Oliveira,Khrystyna Faryna,Jean-Paul A. van Basten,Geert Litjens,Nadieh Khalili

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：detectable prostate-specific antigen, prostate-specific antigen level, Biochemical recurrence, confirmatory elevation, detectable prostate-specific

备注： 38 pages, 3 figures, 3 supplementary figures. Preprint submitted to Medical Image Analysis. Challenge results presented at the CHIMERA workshop, MICCAI 2025. Challenge website: [this https URL](https://chimera.grand-challenge.org/chimera/)

点击查看摘要

Abstract:Biochemical recurrence (BCR), defined as any detectable prostate-specific antigen level after prostatectomy with confirmatory elevation, is widely used as a surrogate endpoint and typically assessed using clinical and pathological variables. Currently, no standardized benchmark exists for multimodal prognostic modeling in urological cancers, partly because curating heterogeneous multimodal data remains challenging. We developed the CHIMERA Challenge, a multimodal benchmark integrating preoperative mpMRI, post-prostatectomy histopathology, patient characteristics, and clinician-derived variables from 267 patients across two institutions. The dataset comprises 801 MRI sequences, 13 clinical variables per case, and 942 WSIs. Training (n=95), validation (n=23), and test (n=149) splits were established and hosted on the Grand Challenge platform. Baseline clinical and pathological characteristics did not differ significantly across splits. Models were evaluated on predicting time to BCR using the C-index. Post-challenge analyses tested how each model type performed when clinician-derived variables were withheld or randomized. Unimodal clinical models achieved the highest test C-index of 0.7402 but proved sensitive to the integrity of these variables, with performance collapsing toward chance (C approximately 0.50) when they were randomized. Multimodal models retained near-baseline performance when these variables were withheld (delta C at most 0.04), indicating their ability to recover prognostic signal directly from imaging data. CHIMERA is the first public, standardized multimodal benchmark for prostate cancer prognosis. Although models using only patient characteristics and clinician-derived variables yielded the highest leaderboard performance, multimodal models demonstrated greater robustness in clinically realistic scenarios where complete expert annotation is not guaranteed.

230. 【2608.21495】MDFI: A Multi-Domain Features Integration for Compressed Video Quality Enhancement

链接：https://arxiv.org/abs/2608.21495

作者：Sang NguyenQuang,Hieu Bui Minh,Dang BuiDinh,Xiem HoangVan

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)

关键词：demonstrated significant improvements, compression efficiency compared, video coding standard, demonstrated significant, significant improvements

备注：

点击查看摘要

Abstract:The latest video coding standard, H.266/VVC, has demonstrated significant improvements in compression efficiency compared to H.265/HEVC. Despite its advanced coding techniques, H.266/VVC still faces challenges in meeting the increasing demand for higher perceptual quality and enhanced compression performance. To address these limitations, we propose MDFI (Multi-Domain Features Integration), a compressed video quality enhancement approach that features a novel Frame-Prediction Feature Transform (FPFT) module to process prediction information. Moreover, MDFI integrates a multi-domain feature fusion strategy that effectively combines spatiotemporal characteristics, cross-frequency representations, and compressed-domain prediction information to enhance decoded video quality. Additionally, we introduce a comprehensive dataset that encompasses uncompressed video sequences, corresponding reconstructed versions at multiple QP levels, and predicted frames generated from H.266/VVC compressed bitstreams, providing essential resources for developing and benchmarking video enhancement approaches. Extensive experiments demonstrate that our MDFI approach achieves superior performance to state-of-the-art methods in both objective metrics and visual quality, effectively mitigating video compression artifacts. The code is available at: this https URL.

231. 【2608.21482】Reliability- and Anatomy-Consistency-Aware Multimodal Learning for Robust Fracture Classification from Bangladeshi Radiographs

链接：https://arxiv.org/abs/2608.21482

作者：Musa Tur Farazi,K G Subarno Bithi

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal fracture classifiers, Multimodal fracture, classifiers may benefit, benefit from patient, brittle when contextual

备注：

点击查看摘要

Abstract:Background: Multimodal fracture classifiers may benefit from patient and anatomical metadata, but they can also become brittle when contextual information is missing or mismatched. Methods: We studied 1493 radiographs from the Bangladeshi OrthoFrac-XR dataset using leakage-safe age, sex, bone type, and laterality. A ConvNeXt image encoder was combined with a clinical multilayer perceptron through concatenation, late fusion, reliability-gated residual fusion, and a hierarchical state-location formulation. We additionally introduced an anatomy-consistency gate that attenuates metadata corrections when an image-side anatomical prediction disagrees with the reported bone type. Results: Across five folds and three seeds, hierarchical residual fusion achieved a macro-F1 of 0.6046 +/- 0.0279, compared with 0.5727 +/- 0.0270 for image-only learning, while improving the Brier score from 0.5239 to 0.4948. In a five-fold robustness experiment, anatomy-consistency fusion reduced the macro-F1 loss under shuffled metadata from 0.0567 to 0.0203 relative to ordinary residual fusion, although its clean-data macro-F1 was lower. Without bone type at inference, auxiliary anatomy supervision improved macro-F1 from 0.5620 +/- 0.0330 to 0.5899 +/- 0.0289. Conclusions: Structured context improves fracture classification, and consistency-aware gating limits harm from mismatched metadata. The observed clean-performance-robustness trade-off and the absence of patient-level identifiers motivate external and prospective validation.

232. 【2608.21481】Multimodal pseudo-CT synthesis for PET attenuation correction using separate modality encoding and topogram conditioning

链接：https://arxiv.org/abs/2608.21481

作者：Rory Bell,Artemis Bouzaki,Jiaming Cao,Jasmine Morrison,Chelsea Sargeant

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)

关键词：BIC-MAC Challenge, generation from NAC-PET, patch-based U-Net, U-Net for pseudo-CT, pseudo-CT generation

备注： Technical report for the BIC-MAC 2026 Challenge

点击查看摘要

Abstract:We participated in the BIC-MAC Challenge with a multimodal 3D patch-based U-Net for pseudo-CT generation from NAC-PET, MRI, and 2D topograms. By using separate PET and MR encoders, multi-scale feature fusion, and FiLM-based topogram conditioning at the bottleneck, we obtain a model that integrates complementary cross-modal information while reducing reliance on precise voxel-wise correspondence between modalities. Our final submission can be found: this https URL

233. 【2608.21446】HiFiC-G: Adapting HiFiC for Hi-C Contact Matrices

链接：https://arxiv.org/abs/2608.21446

作者：Andre Antonio Straton

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Genomics (q-bio.GN)

关键词：High-Fidelity Generative Image, Generative Image Compression, GAN-based neural codec, neural codec originally, codec originally built

备注： 13 pages, 3 figures, 2 tables. Bachelor's thesis project, Transilvania University of Brasov (UNITBV). Language editing and translation assistance provided using Claude (Anthropic)

点击查看摘要

Abstract:We study whether the loss design of High-Fidelity Generative Image Compression (HiFiC), a GAN-based neural codec originally built for natural photographs, can be adapted to preserve biologically meaningful structure in Hi-C chromatin contact maps under lossy compression. Standard image compression, including HiFiC in its original form, optimizes for human visual perception; but a Hi-C contact map is normally distributed together with its numeric matrix file (.cool/.mcool), which downstream genomic analysis tools consume directly. Aggressive compression that looks acceptable to the eye can nonetheless blur or delete loops and topologically associating domain (TAD) boundaries that these tools depend on. We modify HiFiC's distortion term with a spatially-weighted MSE that up-weights biologically salient regions (loops, TAD boundaries, stripes, compartment structure) and add an insulation-score loss term that directly penalizes loss of TAD boundary sharpness. We describe a three-phase fine-tuning strategy that adapts a pretrained HiFiC checkpoint to the Hi-C domain without catastrophic forgetting. We evaluate the resulting system, HiFiC-G, using both conventional image-quality metrics (PSNR, SSIM) and genomics-domain preservation metrics (loop/TAD/compartment/stripe preservation percentage) across two cell lines. HiFiC-G preserves local structure, meaning stripes and TAD boundaries, substantially better than the metrics alone would suggest, while long-range A/B compartment structure remains poorly preserved; we show this gap tracks genomic scale and is consistent with a specific architectural cause, the fixed-size tiling that both HiFiC-G and the original HiFiC rely on for memory efficiency.

234. 【2608.21371】Gate Voltage Effect on Pulse Detection Efficiency of Perimeter-Gated SPADs

链接：https://arxiv.org/abs/2608.21371

作者：Hunter Guthrie,Md Sakibur Sajal,Zexi Liu,Marc Dandin

类目：Instrumentation and Detectors (physics.ins-det); Computer Vision and Pattern Recognition (cs.CV)

关键词：Perimeter-gated single-photon avalanche, single-photon avalanche diodes, noise modulation capabilities, Perimeter-gated single-photon, dark noise modulation

备注： 4 pages, 7 figures, accepted in MWSCAS 2026 Conference

点击查看摘要

Abstract:Perimeter-gated single-photon avalanche diodes (pg-SPADs) are known for their dynamic dark noise modulation capabilities. They are reported to trade noise for photon sensitivity under continuous illumination. However, the implications of this trade-off have not heretofore been studied with pulsed optical systems. This work bridges this gap. We demonstrate that pg-SPADs fabricated in a 0.35 $\mu$m standard CMOS process trade-off pulse detection efficiency for a reduction in the the spread of spurious events within a burst window. Consequently, herein, we propose guidelines for the optimal use of pg-SPADs in pulsed LIDAR applications in view of the observed trade-off.

235. 【2608.21360】OmniAssistBench: Assistant-style Interaction Benchmark for Omni-LLMs

链接：https://arxiv.org/abs/2608.21360

作者：Xianyun Sun,Chaoyou Fu,Zhengye Zhang,Feiyang Duan,Qingyuan Cao,Yonghui Niu,Sihang Yuan,Ge Zhang,Caifeng Shan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent omni-modal large, omni-modal large language, continuously perceive environments, Recent omni-modal, large language models

备注： Project page: [this https URL](https://xianyunsun.github.io/OmniAssistBench/)

点击查看摘要

Abstract:Recent omni-modal large language models (Omni-LLMs) show great potential as real-time video assistants, which continuously perceive environments and guide users to achieve specific goals. Unlike traditional passive video understanding, interactive assistants should actively combine visual states, user goals, and prior knowledge to provide effective help. Evaluating this is rather challenging, as the model's unpredictable response dynamically changes the user's subsequent actions, which static offline datasets cannot accommodate. To address this bottleneck, we introduce OmniAssistBench. To solve the issue of diverging interaction paths where the same user goal can be achieved through various methods, we provide models with predefined priors derived from the source video, requiring them to guide users along the exact same routes. Since real interaction videos are rare, we construct the dataset by reverse-engineering existing Internet videos. We deduce logical user goals and segment the videos into multi-turn clips to simulate continuous interactions. This rigorous pipeline required over 1000 expert person-hours to build the dataset. Results show that the proprietary Gemini-3-Pro reaches 66.4 out of the max point of 100, while the open-source Qwen3-Omni-Instruct achieves 51.2. Although current models generally understand user inputs, they frequently provide incorrect or incomplete answers. Specifically, they struggle with visual prompts (e.g., hand gestures), fail to maintain historical context during multi-turn interactions, and fail to delay response until the target event. Results indicate substantial room for improvement before models can become reliable assistants.