Arxiv每日速递(2026-08-07)

本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新659篇论文，其中：

• 自然语言处理94篇
• 信息检索15篇
• 计算机视觉133篇

自然语言处理

1. 【2608.06377】Learning When to Trust via Selective Context Preference Optimization

链接：https://arxiv.org/abs/2608.06377

作者：Xian Sun,Wei Chow,Yingshuo Wang,Junhao Liu,Wei Gao,Qing Wu,Lingdong Kong

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Language models increasingly, Language models, models increasingly condition, correct answer wrong, external signals

备注： Project Page at [this https URL](https://worldbench.github.io/scope) GitHub Repo at [this https URL](https://github.com/worldbench/SCOPE) HF Dataset at [this https URL](https://huggingface.co/datasets/worldbench/MIST-Bench)

点击查看摘要

Abstract:Language models increasingly condition their answers on external signals, and a single misleading one can turn a correct answer wrong. The obvious remedy, training models to resist such signals, hides a failure mode: a model that ignores all context looks robust yet is useless when the context is worth trusting. We recast the problem as selective trust and introduce MIST, a human-annotated benchmark that renders each reasoning item under four matched conditions (clean, misleading, correct-context, and irrelevant-context), together with SC2W, a paired metric counting how often a misleading signal flips a clean-correct answer to wrong. Across a comprehensive benchmark study, we observe that such a susceptibility is universal. We then propose SCOPE, which mines clean-correct/misleading-wrong failures and optimizes a standard Direct Preference Optimization (DPO) objective over matched preference pairs balanced equally across all four conditions, rather than over misleading items alone. Our approach substantially reduces SC2W on popular open-sourced models while preserving accuracy when the added context is clean, correct, or irrelevant. With this work, we argue that models should be judged on selective trust, not on resistance alone.

2. 【2608.06370】he Bitter Lesson of Tool Calling

链接：https://arxiv.org/abs/2608.06370

作者：Ishan Patel,Sahil Sen,Elias Lumer,Vamse Kumar Subbiah

类目：Computation and Language (cs.CL)

关键词：JSON tool calling, programmatic tool calling, tool calling, replacing rigid JSON, rigid JSON calls

备注：

点击查看摘要

Abstract:Tool use transforms LLMs into agents that act beyond their training data, and for code-capable models, programmatic tool calling extends this further by replacing rigid JSON calls with scripts that chain and parallelize naturally. However, a systematic evaluation of tools as code on an established benchmark across current and prior model generations under real-world task conditions has not been conducted. In this work, we empirically compare programmatic tool calling (PTC) to native JSON tool calling across 14 language models on BFCL v4. In the programmatic tool calling paradigm, tools are exposed as typed Python stubs that the model invokes through code, with execution and results handled in a single agent turn. Programmatic tool calling matches or exceeds native JSON tool calling in 11 of 14 models on BFCL v4, with the GPT-5.6 family achieving a 10.6% improvement over the JSON tool calling baseline. Further, it matches or outperforms baseline in 13 of 14 models under parallel fan-out, and holds stable under context rot conditions where baseline degrades 2.3% on average. Our results demonstrate that programmatic tool calling is a viable and robust alternative to JSON tool calling, with performance tracking model capability across release generations.

3. 【2608.06362】AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games

链接：https://arxiv.org/abs/2608.06362

作者：Boning Li,Yu Chen,Longbo Huang

类目：Computer Science and Game Theory (cs.GT); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

关键词：skill outweighs luck, game costs money, outweighs luck, costs money, stronger means playing

备注： 34 pages, 5 figures

点击查看摘要

Abstract:Deciding which of two agents is stronger means playing games until skill outweighs luck, and every game costs money, model inference, or expert time. Since the number of games needed is unknown, fixed-budget evaluations either keep paying after the result is settled or stop before the agents can be told apart, while naive optional stopping with an ordinary confidence interval invalidates the stated level. We make such an evaluation stop as soon as its evidence suffices, with the guarantee intact. The Action-Informed Value Assessment Tool (AIVAT) reduces variance in imperfect-information games through conditional mean-zero corrections, by a median $54\times$ across 15 LLM agent configurations spanning 71,439 paired Heads-Up No-Limit Hold'em (HUNL) hands, but does not say when to stop. We combine AIVAT with continuously monitored Confidence Sequences (CSs) into anytime-valid AIVAT (AV-AIVAT), whose online value model learns only from past games so that no game scores its own correction. At the nominal 95\% level and a target precision of $\pm1$ Big Blind, raw outcomes need a median $74\times$ as many hands as AIVAT-corrected outcomes to stop under the Asymptotic CS (AsympCS). Exact finite-sample certification uses the Empirical-Bernstein CS (EB-CS), which needs an independently justified bound on corrected payoffs. We establish such a bound structurally for Leduc hold'em and characterize a width floor set by the CS's bet cap and that bound, which governs how much of a variance gain becomes earlier stopping; the descriptive HUNL EB-CS runs show a median $1.37\times$ stopping-time ratio. AV-AIVAT turns variance reduction into efficient, auditable early stopping while separating asymptotic screening from exact certification, so an evaluation can stop the moment its evidence suffices and hand a third party everything needed to recheck the verdict at that very stopping time.

4. 【2608.06352】CalibForge: Adversarial Solver Calibration for Scaling Learnable Terminal Tasks

链接：https://arxiv.org/abs/2608.06352

作者：Fanzhe Meng,Guoxin Chen,Jiale Zhao,Shuang Sun,Zhiyu Lin,Wayne Xin Zhao,Ruihua Song,Ji-Rong Wen,Kai Jia

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：challenging for learning, appropriately challenging, agents requires executable, requires executable, solver

备注： Dataset: [this https URL](https://huggingface.co/datasets/AweAI-Team/CalibForge) . Repository: [this https URL](https://github.com/AweAI-Team/CalibForge)

点击查看摘要

Abstract:Training terminal agents requires executable and verifiable tasks that are not merely solvable, but appropriately challenging for learning. Executable validation establishes feasibility, yet does not reveal how a task behaves relative to a given solver setting. In this paper, we present CalibForge, an autonomous terminal-task synthesis system that uses verified solver behavior to revise candidate tasks through adversarial solver calibration. Multi-solver calibration targets disagreement within a heterogeneous solver pool, whereas contrastive solver calibration targets a designated strong-pass/weak-fail relation; both operationalize a solver-relative learnable zone anchored in demonstrated solvability. Using CalibForge, we construct 5,431 calibrated terminal tasks. Our ablations show that both strategies yield more effective supervision than authoring and validation alone or ordinary single-solver feedback. Models trained on the full collection achieve 32.58% and 47.57% on Terminal-Bench 2.0. The largest improvements over the corresponding base model reach 24.71 percentage points on Terminal-Bench 2.0, 27.68 points on SWE-bench Pro, and 30.04 points on Doc2Repo. Together, these results support solver-relative learnability as a practical target for constructing effective and transferable agent training data.

5. 【2608.06347】RP-OPSD: Reasoning-Pivot-Guided On-Policy Self-Distillation for Multilingual Reasoning Transfer

链接：https://arxiv.org/abs/2608.06347

作者：Xinye Wang,Junxiao Liu,Shujian Huang

类目：Computation and Language (cs.CL)

关键词：large language models, extending reasoning capabilities, crucial for extending, capabilities of large, reasoning

备注： 16 pages. Under review

点击查看摘要

Abstract:Multilingual reasoning transfer is crucial for extending reasoning capabilities of large language models (LLMs) beyond high-resource languages. On-policy self-distillation (OPSD) and its variants have emerged as a promising paradigm, providing dense token-level supervision on student-generated rollouts, yet their objectives do not explicitly prioritize reasoning signals most critical to cross-lingual transfer. We characterize that target-language reasoning comprises the generation of both surface text and reasoning pivots, which are decisions that advance or redirect the reasoning process and shape subsequent inference. This motivates concentrating privileged distillation around such pivots. We therefore propose RP-OPSD, Reasoning-Pivot-guided On-Policy Self-Distillation, using the distributional shift between matched teacher views with and without an English reference solution as an operational proxy to guide privileged distillation and reference anchoring. Experiments on mathematical reasoning benchmarks covering 17 languages and multiple difficulty levels show that our method outperforms strong multilingual reasoning baselines and OPSD variants. Further analysis reveals that RP-OPSD concentrates privileged distillation on reasoning-control and problem-condistioned state-update tokens, while downweighting it for tokens that mainly support surface realization. Our code is available at this https URL.

6. 【2608.06329】Benchmarking the Benchmarks: Evaluating Benchmarks for Conversational Agents

链接：https://arxiv.org/abs/2608.06329

作者：Noam Koren,Roy Bar-Haim,Abigail Goldsteen

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Task-oriented conversational agents, Task-oriented conversational, rarely assessed, conversational agents, agents are evaluated

备注： 15 pages

点击查看摘要

Abstract:Task-oriented conversational agents are evaluated using curated or automatically generated benchmarks, yet benchmark quality is rarely assessed. Poor benchmarks may contain inconsistent tasks, simplistic scenarios, or limited policy coverage, leading to unreliable evaluations. We introduce a reference-free framework that uses LLM judges to assess benchmark consistency, complexity, and policy coverage, while providing actionable diagnostics of weaknesses. We validate the framework by demonstrating agreement with independent human annotations and by evaluating benchmarks generated by LLMs of varying capabilities, as well as benchmarks subjected to controlled quality-degrading perturbations. Across domains and judge models, the proposed metrics consistently distinguish between benchmark quality levels. We further demonstrate the framework's applicability to manually curated benchmarks. Our framework offers a practical approach for evaluating synthetic and manually curated conversational-agent benchmarks.

7. 【2608.06312】Benchmarking and Enhancing LLMs for Rule-Intensive Review of National Standard Documents

链接：https://arxiv.org/abs/2608.06312

作者：Tao Wang,Qihao Yang,Rongjiao Liang,Lianghong Lin,Haitao Wang,Xinyu Cao,Tianyong Hao

类目：Computation and Language (cs.CL)

关键词：increasingly support complex, remain insufficiently evaluated, Large language models, Large language, complex professional tasks

备注：

点击查看摘要

Abstract:Large language models (LLMs) increasingly support complex professional tasks, yet their capabilities in rule-intensive document review remain insufficiently evaluated. National standard documents, such as China GB/T standards, offer a representative testbed: they are lengthy, highly structured, and governed by explicit rules for scope, terminology, normative wording, and cross-section consistency. Existing benchmarks focus on domain knowledge and question answering, largely overlooking intrinsic quality review for professional documents. Such reviews rely heavily on human experts, making them costly and difficult to scale. To bridge this gap, we introduce GB/T-Bench, the first benchmark for the structured review of national standard documents. Its GB/T Review Taxonomy is a hierarchical schema covering document structure, scope alignment, normative modality, terminology consistency, and normative references, with 25 diagnosable error types. A controllable counterexample generation mechanism combines deterministic rules and constrained LLM rewriting to process 488 documents into 7,306 traceable review error instances for evaluation. We also develop a diagnosis-oriented evaluation protocol requiring exact matches on error location, review dimension, and error type, plus document-level coverage metrics. We further propose GB/T-Reviewer, a multi-agent framework that converts review knowledge into specialized skills and coordinates global inspection, targeted diagnosis, rule scanning, and result verification. Experiments with 14 mainstream LLMs reveal a substantial human-LLM gap: the strongest model achieves only 0.3280 CMCS versus 0.6640 for experts. GB/T-Reviewer raises the best CMCS to 0.5094, showing the value of structured skill coordination for rule-intensive document review. This work paves the way for trustworthy AI in standardization and other high-stakes document domains.

8. 【2608.06310】RRC: Unlocking Generative Reward Models in LLM Reinforcement Learning via Ranking-Based Reward Construction

链接：https://arxiv.org/abs/2608.06310

作者：Chenglong Wang,Ziming Zhu,Yifu Huo,Bei Li,Qiaozhi He,Yan Ding,Xiaoyang Hao,Yuxin Gao,Tianhua Zhou,Xiaojia Chang,Tongran Liu,Jingbo Zhu

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：generative reward models, Recent advances, reward models, generative reward, discriminative reward models

备注：

点击查看摘要

Abstract:Recent advances in reward modeling show a paradigm shift from discriminative reward models to generative reward models. However, despite their strong capabilities in response ranking, generative reward models have not realized their potential in reinforcement learning (RL). Our analysis reveals that this limitation arises from a mismatch between the comparative nature of generative reward modeling and the scalar scoring paradigm adopted by existing RL algorithms. To bridge this gap, we propose a Ranking-based Reward Construction (RRC) approach, which enables generative reward models to provide more effective RL learning signals by deriving rewards from relative preference rankings. RRC introduces two complementary strategies: self-competitive ranking, which exploits comparisons among sampled responses, and anchor-guided ranking, which enables scalable ranking-based reward construction with a small set of reference responses. Experiments across open-ended chat and reasoning benchmarks demonstrate that RRC substantially improves RL training with generative reward models, achieving consistent gains over existing reward construction approaches. Our code can be found at this https URL.

9. 【2608.06305】Beyond Top-K: Replacing Black-Box Retrieval with Interpretable Agentic Operations

链接：https://arxiv.org/abs/2608.06305

作者：Sagar Tamang,Ayush Vyas,Tabarakul Hazarika

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Retrieval-augmented generation, top-k nearest neighbours, generation over long, nearest neighbours, Model Context Protocol

备注：

点击查看摘要

Abstract:Retrieval-augmented generation over long documents is dominated by one design: chunk the text, embed the chunks, and surface the top-k nearest neighbours of the query. We argue that for an important class of documents -- financial statements, audit reports, regulatory returns -- this design is structurally unsound, and we make the argument measurable. On a 780-page government financial report, 86.8% of content lines are table rows, thousands of near-identical figures compete in one embedding space, and a figure inherits its unit from a header a median of 13 lines above it -- so a chunk boundary routinely separates a number from whether it is in lakh or crore, an error of two orders of magnitude. A table-aware chunker built as a steelman fixes the unit problem but leaves 27-30% of numeric chunks with no fiscal-year header at every chunk size we tried. We propose READ (Reliable Embedding-free Agentic Document-search), in which an agent reads the raw document through three deterministic operations -- normalized lexical search, structural navigation, and bounded span reads -- exposed over the Model Context Protocol, so a trajectory is a replayable audit trail, not an opaque similarity score. On 51 verified questions READ answers 58.8% against dense retrieval's 15.7% (p_Holm = 2 x 10^-5) -- or 35.3% tuned, which READ still leads by 23.5 points (p_Holm = 0.017). An agent given the same loop but a top-k tool reaches only 27.5%, locating the gain in the interface rather than in iteration. We also report what the evidence does not support: BM25 is statistically indistinguishable from READ, so our result separates embedding-based from embedding-free retrieval, not agentic from lexical search.

10. 【2608.06301】HarnessOpt-Bench: Evaluating LLMs at Harness Optimization

链接：https://arxiv.org/abs/2608.06301

作者：Varun Ursekar,Apaar Shanker,Yash Maurya,Shehab Yasser,Vijay S. Kalmath,Veronica Chatrath,Yuan Xue

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：orchestration code surrounding, control flow, harness, increasingly deployed, deployed within agentic

备注：

点击查看摘要

Abstract:As LLMs are increasingly deployed within agentic systems, their capabilities depend not only on the model weights but also on the harness: the prompts, tools, control flow, memory, and orchestration code surrounding them. This makes automated harness optimization -- the iterative and evaluation-guided improvement of a harness by an AI system -- both an important route to improving AI systems and a demanding capability for AI systems themselves. Yet the community lacks a common protocol for measuring how well frontier LLMs perform at this task. We introduce HarnessOpt-Bench, a benchmark for end-to-end harness optimization under expensive and stochastic evaluation. An optimizer, an LLM paired with a coding harness, receives a target agent's seed harness, graded evaluation feedback, and a fixed target-evaluation budget. It edits the harness and nominates a final candidate, which is scored by its normalized gain over the seed on a held-out test partition that remains inaccessible throughout search. A trusted execution environment enforces the evaluation boundary, meters target-agent resource use, and preserves candidate versions for audit. We evaluate 5 frontier LLMs as optimizers both under a shared coding harness and under their native harnesses across 4 downstream tasks, over 111 scored runs. Experiment results show that optimizer models separate more than the coding harnesses they act through, native harnesses are not consistently superior, and gains vary substantially across tasks and seed regimes. These results establish harness optimization as a measurable and discriminative capability with large space for improvement.

11. 【2608.06292】NeSy-RAG: Neuro-Symbolic RAG for Explainable Question Answering

链接：https://arxiv.org/abs/2608.06292

作者：Jonas Gann,Michael Gertz

类目：Computation and Language (cs.CL); Symbolic Computation (cs.SC)

关键词：improves question answering, Retrieval-augmented generation, large language models, grounding large language, improves question

备注：

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) improves question answering by grounding large language models (LLMs) in external knowledge such as text corpora. However, its reasoning process remains largely opaque: intermediate reasoning steps are difficult to verify and cannot be reliably attributed to specific evidence. Moreover, missing user-specific context is rarely detected systematically, often leading to incomplete or incorrect output. We propose NeSy-RAG, a modular neuro-symbolic RAG framework that synthesizes attributable Prolog modules from retrieved text chunks. For each chunk, the system generates semantically meaningful predicates that encode Boolean claims, which may depend on user facts. Using joint natural language-code embeddings, predicates are retrieved and composed into Prolog queries. To address incomplete user context, we introduce a symbolic knowledge-gap detection mechanism that identifies missing user facts whose truth values affect the query outcome and automatically triggers follow-up interactions. Executing the resulting Prolog queries yields deterministic answers together with transparent execution traces that link each reasoning step to its originating source. On the ShARC benchmark, without domain-specific training, NeSy-RAG achieves 61.1% accuracy, outperforming a same-model RAG baseline that achieves 42.8% accuracy.

Subjects:

Computation and Language (cs.CL); Symbolic Computation (cs.SC)

Cite as:
arXiv:2608.06292 [cs.CL]

(or
arXiv:2608.06292v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.06292

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

12. 【2608.06171】Routing Is Least Learnable Where It Is Most Valuable: Bounds on Representation Routing for Web Agents

链接：https://arxiv.org/abs/2608.06171

作者：Jiaming Wei,Zekun Wu,Adriano Koshiyama,Maria Perez-Ortiz

类目：Computation and Language (cs.CL)

关键词：Web agents observe, Web agents, observe a browser, mode, Web

备注： Preprint. Under review at the Second Workshop for Research on Agent Language Models (REALM), EMNLP 2026 (non-archival track)

点击查看摘要

Abstract:Web agents observe a browser through text, pixels, or both, and the choice is usually fixed once for all tasks. We measure six observation modes across eight site-model combinations (cells) on VisualWebArena and WebArena and ask what choosing per task would buy. The modes are complementary: each solves tasks the others miss, they fail in structurally different ways, and the best choice reverses between task sets. The obvious prize, an oracle that picks a winning mode for every task, looks large but is inflated by run-to-run noise: rerunning the same mode on the same tasks changes 12-14% of outcomes, so a second run of a mode already in hand gains about as much as adding a new one. What survives is a cost bound: sending only the tasks no mode solves to the cheapest mode cuts cost by 9.5-30.6% in 8 of 8 cells at unchanged success. We then test five routing policies (picking the mode, deciding when to spend on the strong mode, a zero-cost rule read off the task text, a confidence cascade, and pooled cost tiers), and none robustly beats simply fixing one well-chosen mode; the one exception is a fragile result in our sparsest cell. The central obstruction is that routing supervision is produced at the agent's success rate: the weaker the agent, the fewer labels a router gets, exactly where routing would be most valuable. This limit belongs to today's agents rather than to routing itself. Label supply and routing opportunity rise together (correlation 0.95 across cells), so a stronger agent can overturn the result, and we report the rerun noise bands and the full measurement protocol.

13. 【2608.06167】Schema-Guided Hierarchical Information Extraction and Semantic Evaluation Using Generative AI

链接：https://arxiv.org/abs/2608.06167

作者：Modhurita Mitra,Jan-Willem Versteeg,Maarten D. Schermer,Shiva Nadi Najafabadi,Marie L. De Bruin,Lourens T. Bloem

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：unstructured text documents, automated semantic evaluation, extracting complex, present a schema-based, unstructured text

备注： 10 pages, 7 figures, 3 tables. To be published in Proceedings of the 2026 IEEE 22nd International Conference on e-Science (e-Science), Naples, Italy

点击查看摘要

Abstract:We present a schema-based framework for extracting complex, structured information from unstructured text documents using generative AI, followed by automated semantic evaluation of the extracted information against a gold standard. The schema, serving as an information model encoding domain knowledge, provides a unified, systematic, and consistent framework for extraction of hierarchical, nested information, with attributes of variable cardinality, and subsequent evaluation of the results. Information extraction from a document is performed in a single call to the model, in zero-shot mode. In the evaluation step, we introduce a path-based semantic matching algorithm to align the nested, variable-cardinality attributes in the extracted results with those in the gold standard. We use generative AI for semantic comparison of the extracted and gold standard values of an attribute, and introduce a rubric to classify the result of the comparison, according to domain-specific considerations, as an exact, semantic, useful, or non-match. We were able to extract 12 out of 14 attributes with an F1 score of $$90\% from documents published by the health technology assessment organisation NICE, using the generative AI model Claude Opus 3. The time needed to extract the attributes from a document was $\sim$30 times lower than the time taken by a human domain expert. We further demonstrate generalisability of this framework across different generative AI models and transferability across different HTA organisations and languages.

Comments:
10 pages, 7 figures, 3 tables. To be published in Proceedings of the 2026 IEEE 22nd International Conference on e-Science (e-Science), Naples, Italy

Subjects:

Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

MSC classes:
68T50

ACMclasses:
I.2.7

Cite as:
arXiv:2608.06167 [cs.AI]

(or
arXiv:2608.06167v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2608.06167

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

14. 【2608.06141】Decolonizing Linguistic Policies in Automated Speech Recognition: A Framework for Cross-Culturally Competent Speech AI

链接：https://arxiv.org/abs/2608.06141

作者：Jay L. Cunningham,Mark Atta Mensah,Richard Martinez,Joao Vieira da Silva Neto,Efi Dawodu

类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)

关键词：automatic speech recognition, ASR-mediated voice interfaces, speech recognition, public services, paper focuses

备注： 10 Pages, 2 Figures, 2 Tables, Interspeech 2026 - Sydney, Australia

点击查看摘要

Abstract:This paper focuses on automatic speech recognition (ASR) and ASR-mediated voice interfaces that shape access to public services, healthcare, and education. We argue that persistent failures for low-resource, Indigenous, and non-standard language varieties are not only technical errors, but also implicit linguistic policies that reproduce colonial language hierarchies. Drawing on linguistic capital, raciolinguistic ideology, language policy research, and decolonial computing, we show how data, metrics, and model priors determine whose voices become machine-legible. We introduce the Three Harms (3M) taxonomy---Misrecognition, Misalignment, and Mistrust---and a seven-layer situatedness model for linguistic diversity in ASR and ASR-mediated voice interfaces. We then propose a participatory framework and minimum audit protocol for culturally competent ASR, positioning affected communities as co-designers, evaluators, and governance partners.

15. 【2608.06123】Poli-Bias: Understanding and Measuring Large Language Model Biases in International Political Conflicts

链接：https://arxiv.org/abs/2608.06123

作者：Massi-Nissa Abboud,Aladin Djuhera,Elena Cabrio,Holger Boche

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：large language models, remains challenging, differences in framing, large language, subtle differences

备注：

点击查看摘要

Abstract:Measuring political bias in large language models (LLMs) remains challenging as it can manifest through subtle differences in framing, argumentation, and legal reasoning that are difficult to capture with a single metric. In this work, we introduce Poli-Bias, a counterfactual framework for measuring whether LLMs treat legally equivalent conflict scenarios differently depending on the countries involved. Poli-Bias compares responses to paired prompts in which country identities are systematically swapped across diverse geopolitical relationships, legal violations, and reasoning tasks. Rather than reducing bias to a single judgment, our framework decomposes response disparities into five interpretable dimensions, revealing how and where unequal treatment manifests. Across 13 contemporary LLMs spanning diverse model families and sizes, we find that country identities and user affiliations can systematically affect how equivalent actions are described, evaluated, and defended under international law. Our results thus establish Poli-Bias as a fine-grained framework for auditing political even-handedness and sycophancy in LLMs.

16. 【2608.06112】From Siloed Algorithms to Compliance-First Agentic Platforms: A Multi-Layered Architecture for Hospital AI Systems

链接：https://arxiv.org/abs/2608.06112

作者：Manideep Dhar,Ritwik Singh,Sharat Chandra Kumar Manikonda

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)

关键词：inside departmental silos, rapidly adopting artificial, adopting artificial intelligence, remain isolated point, isolated point solutions

备注： Peer-reviewed published article

点击查看摘要

Abstract:Hospitals are rapidly adopting artificial intelligence for triage, imaging, scheduling etc., yet most deployments remain isolated point solutions locked inside departmental silos, resulting in duplicated effort, hidden risks, and unrealized enterprise value. Despite explosive growth of AI in healthcare market and accelerating investment, an estimated 70-80% of healthcare AI pilots fail to scale, largely due to governance gaps, fragmented data, and missing integration blueprints. This research proposes a hospital-specific, compliance-first, Agentic AI architecture with multiple interoperable layers, extending existing hospital AI platform models with: (i) an Agent Orchestration Layer for multi-agent workflows across clinical, operational, and financial domains, (ii) a Compliance and Policy Layer that centralizes policy-as-code for HIPAA, GDPR, the EU AI Act, DISHA Act, India's DPDP Act, and ISO/IEC security and safety standards, and (iii) a Privacy-Preserving Data Fabric that plugs federated learning, differential privacy, and secure enclaves into real-world Hospital Information Management System (HIMS) flows. Using a synthetic but structurally realistic hospital dataset and an open, ready-to-deploy prototype implementation, this study demonstrates the end-to-end orchestration of triage risk prediction, workflow optimization, and compliance logging, achieving substantial simulated reductions in task turnaround times and manual documentation effort while maintaining policy-guarded data access. The resulting architecture offers hospital leaders a pragmatic blueprint to move from ad hoc tools to a governed, globally compliant, ROI-focused AI platform that can be tailored to on-premise, hybrid and cloud-native deployments.

17. 【2608.06111】Beyond Sequence Order: Syntax-Informed Positional Embeddings for Transformers

链接：https://arxiv.org/abs/2608.06111

作者：Haris Riaz,Hyungji Kim,Mihai Surdeanu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Transformers encode token, encode token distance, Transformers encode, textbf, encode token

备注： 21 pages, 9 figures

点击查看摘要

Abstract:Positional embeddings (PE) in Transformers encode token distance and order but are largely agnostic to \textit{syntactic structure}. We introduce \textbf{S}yntax-\textbf{i}nformed \textbf{P}ositional \textbf{E}mbeddings (\textbf{SiPE}), which learns a lightweight syntactic prior from dependency parses during pretraining and injects it across all three dominant PE families (absolute, relative, rotary), for both encoders and decoders, leaving self-attention and the rest of the architecture untouched. We isolate \emph{where} and \emph{how} the prior should enter the model, and find it depends on the architecture: for autoregressive decoders that use relative PE, the prior is strongest when coupled multiplicatively with the relative-position term of the attention score, outperforming injection into the input embeddings, into self-attention, or into the positional and attention terms jointly---while for encoders it is best added directly to the input embeddings, composing with each encoder's native positional mechanism. We find that models pre-trained with SiPE improve on the SyntaxGym benchmark by up to $10.3\%$ while simultaneously reducing perplexity by $9.0\%$ over a base model with no syntactic supervision---a metric nearly every existing syntax-injection method instead degrades. Crucially, these gains extend beyond syntactic generalization: SiPE also improves real-world language understanding, raising scores on the GLUE benchmark by up to $8.2\%$ over a model trained without it. Unlike existing syntactic language models that marginalize over many parses at inference or discard syntax at runtime, SiPE conditions on a single parse, establishing a new Pareto frontier between syntactic supervision and inference cost.

18. 【2608.06110】ECHO: A Locally-Deployable Agentic Health Assistant with Temporal Memory, Safety Guardrails, and Speech Assessment

链接：https://arxiv.org/abs/2608.06110

作者：Abdulkadir Külçe,Alihan Esen,Cağla Fikir,Berke Kurt,Kuzey Arar,Gökhan Ercan,Faik Boray Tek

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：chronic care management, long-term chronic care, paper presents ECHO, Enhanced Care, conversational health assistant

备注： 5 pages

点击查看摘要

Abstract:This paper presents ECHO (Enhanced Care \ Health Observer), a locally-deployable conversational health assistant for long-term chronic care management. ECHO integrates three complementary software modules developed under shared supervision as a unified system. The core module is an agentic chatbot built on a ReAct loop orchestrated via LangGraph, equipped with 17 clinical tools and a temporal knowledge graph for persistent cross-session memory; it achieves a 94.9\% tool-execution pass rate across a 59-scenario benchmark with GPT-5 Mini. A two-stage hybrid safety layer intercepts all incoming queries: a rule-based layer handles explicit crisis signals and jailbreak attempts in under 1ms, while a signed graph neural network (GNN) with APPNP-style propagation classifies boundary cases by clinical intent, achieving 88.8\% accuracy and 90.6\% unsafe recall on a 2,537-query annotated Turkish health dataset while outperforming zero-shot LLM baselines including Llama 3.3 70B. A multimodal speech assessment module combining Whisper acoustic encoding and BERT text encoding with cross-attention fusion estimates emotion, depression, and pain, reaching a mean macro F1 of 0.652. The full system is implemented as a web application that can run entirely on consumer hardware, with no patient data transmitted to external services, supporting compliance with GDPR and KVKK.

19. 【2608.06069】raining-Free Token-Level Steering for LLM Personalized Co-Writing

链接：https://arxiv.org/abs/2608.06069

作者：Wenhao Mao,Chengbin Hou,Weixiao Wang,Jialiang Zhu,Min Liu,Yibin Hao,Hairong Lv

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, show great promise, show great, promise for personalization

备注：

点击查看摘要

Abstract:While Large Language Models (LLMs) show great promise for personalization, they often lack specialized domain knowledge. Conventional solutions like fine-tuning struggle with high computational costs and rapid data updates, while Retrieval-Augmented Generation fails to provide fine-grained, token-level steering. Furthermore, chat-based interfaces remain dominant, whereas productive co-writing paradigms have not yet been well exploited beyond the coding domain. To this end, we introduce SteerWrite, a training-free framework designed for personalized co-writing. Our method effectively adapts the base model to specialized domains without gradient updates, with specific designs tailored to small datasets. Experiments demonstrate that SteerWrite achieves state-of-the-art performance across diverse datasets, metrics, and models, significantly reducing human editing effort.

20. 【2608.06041】LangChoiceBench: Measuring and Explaining Programming-Language Choice in LLMs

链接：https://arxiv.org/abs/2608.06041

作者：Lukas Twist,Twm Stone,Helen Yannakoudakis,Jie M. Zhang

类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)

关键词：exhibit strong Python, strong Python preferences, Large language models, Large language, Python

备注： 19 pages, 9 tables, 2 figures

点击查看摘要

Abstract:Large language models (LLMs) have been shown to exhibit strong Python preferences when generating project-level code, but there is currently no systematic way to measure this behaviour across new models. To bridge this gap, we introduce LangChoiceBench, a project-level code-generation benchmark for measuring Python preference, recommendation-implementation consistency, and language diversity. LangChoiceBench covers 28 projects across seven software areas where Python is often a poor default. We evaluate 25 diverse LLMs and find that Python remains heavily over-selected, recommendation-implementation consistency is low, and smaller open-weight models generally show stronger Python preference and lower language diversity. We further analyse 9,826 reasoning traces and find that most Python choices are automatic or driven primarily by ease, rather than explicit consideration of project requirements. In a smaller but important set of cases, models fabricate contextual support for choosing Python - a failure mode we call phantom evidence - or produce code that contradicts the language selected in their own reasoning.

21. 【2608.06027】FormBharo: Designing and Evaluating a Voice Agent for Conversational Form Filling in Rural India

链接：https://arxiv.org/abs/2608.06027

作者：Aman Dalmia,Sanskriti Midha,Jigar Doshi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词：social benefit starts, social benefit, benefit starts, read or write, unable to read

备注：

点击查看摘要

Abstract:In India, almost every social benefit starts with a form, yet the people who need these benefits most are often unable to read or write. Reaching them requires a spoken conversation. Today that work falls to frontline health workers who enroll beneficiaries one at a time, a poor use of stretched capacity. We built FormBharo ("fill the form" in Hindi), a voice agent that fills a structured form over a phone call under tight latency and cost budgets by pairing Large Language Models (LLMs) with deterministic, rule-based validation and flow control. It is being piloted with ARMMAN, an NGO running large-scale maternal and child mobile-health programs in India, to enroll low-income, Hindi-speaking mothers in antenatal and postnatal care. To our knowledge, it is the first voice agent piloted to fill an enrollment form for this population. We openly release FormVoiceAgentBench, a benchmark pairing human-recorded Hindi audio with 3,760 multi-turn conversation tests across 960 simulated calls, to evaluate our agent's components (transcription, extraction, reply generation) and end-to-end form completion under real acoustic variations. Form completion drops by up to ~41 points when LLMs receive error-prone real-speech transcripts instead of reference ones. The rule-based controls recover many turn-level extraction errors, helping smaller, cheaper models match or surpass frontier models on form completion. Component performance does not predict end-to-end performance: GPT-5.5 leads turn-level extraction accuracy on reference transcripts (99.8%) but ranks lower on form completion. Since errors both propagate and cancel across the pipeline, the optimal model choice of models emerges only through end-to-end evaluation. Finally, no single model is best across accuracy, cost, and latency at once, so we use a Pareto-based weighted-sum scalarization to select a deployable configuration balancing the three.

22. 【2608.06022】EpiBench: Can LLMs Understand Epitopes for Antibody Drug Discovery?

链接：https://arxiv.org/abs/2608.06022

作者：Zirui Wang,Jiaqi Wang,Qinghan Wang,Yuzhi Xu,Gang Du,Tingjun Hou,Odin Zhang

类目：Computation and Language (cs.CL); Genomics (q-bio.GN)

关键词：shape downstream therapeutic, downstream therapeutic properties, making epitope understanding, epitope understanding central, antibodies bind antigens

备注：

点击查看摘要

Abstract:Epitopes determine where antibodies bind antigens and shape downstream therapeutic properties such as functional blockade and escape resistance, making epitope understanding central to antibody drug discovery. Although large language models (LLMs) have shown strong biomedical reasoning ability, it remains unclear whether they can infer epitope information directly from antigen and antibody sequences. Existing epitope resources typically focus on isolated prediction tasks or rely on specialized structural settings, while general protein benchmarks do not evaluate epitope-centered decisions across the antibody development workflow. To address this gap, we introduce EpiBench, a closed-book, sequence-based, and automatically scorable benchmark for evaluating epitope reasoning in LLMs. EpiBench contains 1,609 curated samples grounded in structural antibody--antigen contacts, curated functional B-cell assays, and deep mutational scanning escape measurements. It covers five connected tasks: targetable region discovery, antibody-conditioned epitope identification, epitope binning, functional epitope assessment, and antibody escape assessment, with controlled sampling to reduce shortcut-based evaluation artifacts. We evaluate nine general-purpose LLMs and analyze their behavior through task-specific baselines, antigen length stratification, explicit-reasoning comparison, and failure-mode inspection. The results show that current LLMs capture partial epitope-related signals but remain limited in antibody-specific sequence grounding, long-context residue localization, and biologically grounded reasoning. Therefore, EpiBench provides a diagnostic testbed for measuring and improving sequence-aware biomedical LLMs toward reliable LLM-assisted antibody discovery.

23. 【2608.05993】Clinical Communication Processing with Models Trained on LLM-Generated Synthetic Data: A Structured Survey and Novel Application Case Studies

链接：https://arxiv.org/abs/2608.05993

作者：Alexander Apartsin,Yehudit Aperstein

类目：Computation and Language (cs.CL)

关键词：patients describe symptoms, clinicians reason, give instructions, ambulances hand, emergency departments

备注： 20 pages, 7 figures

点击查看摘要

Abstract:Much clinical value is conveyed not through structured records but through communication: exchanges in which patients describe symptoms, clinicians reason and give instructions, ambulances hand over to emergency departments, and nurses pass on a shift. Such language differs from tabular data because meaning depends on speaker role, intent, causality, uncertainty, omission, and channel noise. Healthcare natural language processing must therefore interpret information as conveyed rather than coded. This requires well-annotated corpora, which are scarce because authentic exchanges are private, fragmented, and costly to annotate. Large language models offer a way forward by transforming clinical sources, such as records, diagnostic labels, symptom lists, or care plans, into written and transcribed communication for downstream models. We present a structured narrative survey organized by source representation, communication form and participants, generation method, and downstream task, complemented by thirteen novel case studies. These build clinical NLP systems for communication channels and languages without labeled real-world data, including EMS pre-arrival reports, field-radio casualty documentation, nurse handoffs, patient-portal triage, and low-resource discharge communication. They show that synthetic communication can bootstrap such systems. Findings include the competitiveness of fine-tuned encoder models over evaluated zero-shot baselines and the value of deliberately degraded communication for robustness. The main limitation is that most studies evaluate on held-out synthetic communication, while train-on-synthetic, test-on-authentic evidence remains limited. We conclude that syn-thetic clinical communication is becoming a practical research resource; establishing it as reusable clinical infrastructure will require authentic-data transfer, safety and external validation.

24. 【2608.05906】Causal Episodic Memory for Feedback-Driven Agent Repair

链接：https://arxiv.org/abs/2608.05906

作者：Khang Nhat Hoang Vo,Tam Minh Chu,Anh Trac Duc Dinh,Thuyen Vinh Ha Bui,Tho Quan

类目：Computation and Language (cs.CL)

关键词：rediscover similar solutions, discard successful corrections, LLM agents, similar solutions, discard successful

备注：

点击查看摘要

Abstract:LLM agents that repair failures often discard successful corrections, forcing later episodes to rediscover similar solutions. We study whether finalized repair outcomes can improve subsequent Text-to-SQL episodes without parameter updates. We introduce MERIT, a training-free agent that maintains an online dual-polarity memory of oracle-verified corrections and observed unsuccessful directions. Under oracle-assisted benchmark feedback, only memories from earlier finalized episodes are eligible for retrieval. A deterministic classifier assigns a coarse failure type, which conditions a hybrid lexical-dense retriever before the frozen model generates each revision. Using Qwen2.5-7B-Instruct with identical initial predictions and repair budgets, MERIT improves execution accuracy over stateless iterative repair from \(66.34\%\) to \(69.79\%\) on Spider and from \(47.35\%\) to \(48.44\%\) on BIRD. Paired analyses provide clear evidence for the Spider gain but weaker evidence on BIRD. MERIT is not reliably separated from untyped dynamic retrieval on either benchmark, while Reflexion-style memory reaches \(51.24\%\) on BIRD at substantially higher inference cost. Ablations show that negative memory contributes modestly, the value of type conditioning and lexical--dense ranking is dataset dependent, and schema-local experience provides the most consistent benefit. These results clarify when causal cross-query memory improves repair and when broader memory representations remain preferable.

25. 【2608.05891】AppDeltaWorld: Transition-Grounded Delta Code World Model for Mobile GUI Agents

链接：https://arxiv.org/abs/2608.05891

作者：Weikai Xu,Yunren Feng,Haoxiang Lei,Kun Huang,Yuxuan Liu,Kang Zhao,Xiaolin Hu,Shuo Shang,Bo An

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：improving long-horizon mobile, Mobile GUI agents, mobile interaction policies, long-horizon mobile interaction, long-horizon mobile

备注：

点击查看摘要

Abstract:Mobile GUI agents can operate apps through pixel perception and touch actions, making them a promising interface for collecting and improving long-horizon mobile interaction policies. However, real trajectories are difficult to obtain for sensitive apps and privacy-critical operations. At the same time, existing simulated environments are costly to scale up, and GUI world models still suffer from unstable generation, limited modality coverage, and inconsistent action-transition logic. To address these limitations, we propose AppDeltaWorld, a transition-grounded delta code world model that predicts the next GUI as a reachable code update rather than as an unconstrained image or text description. AppDeltaWorld retrieves app-specific Level-1 HTML references under an action-transition constraint, generates Level-2 executable HTML conditioned on the current screen, action, predicted next-screen text, and retrieved structure, and inserts generated visual assets into image slots before browser rendering. As a world model, AppDeltaWorld achieves the highest fidelity on CMGUIBench-500 under Code2World evaluation, with clear gains in structural layout and UI element reconstruction over image-only and code-only baselines. As a training environment, AppDeltaWorld supports filtered closed-loop SFT data construction that, when combined with public supervision, enables AppDeltaAgent to achieve state-of-the-art performance on AndroidLens and consistent gains on MobileGym and MobileWorld. Moreover, world-model-based test-time reinforcement learning enables policy adaptation and shows further improvements without additional interaction with real apps.

26. 【2608.05889】he em-dash em-beds in Congress: A population-level rise in em-dash frequency in U.S. congressional press releases at the dawn of the large-language-model era, 2021-2025

链接：https://arxiv.org/abs/2608.05889

作者：Przemysław Czuma(Polish Association for Artificial Intelligence in Medicine)

类目：Digital Libraries (cs.DL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：Large language models, leave small stylistic, small stylistic traces, Large language, leave small

备注： Preregistered study (OSF: [https://doi.org/10.17605/OSF.IO/U5NEY%29%3B](https://doi.org/10.17605/OSF.IO/U5NEY%29%3B) deviations from the registered plan, including a formal validation-gate breach, are disclosed in Section 4.6. Companion study: [arXiv:2606.29540](https://arxiv.org/abs/2606.29540) . 3 figures, 4 tables

点击查看摘要

Abstract:Large language models (LLMs) can leave small stylistic traces in text written with their help. The most discussed is the em-dash (U+2014), especially the unspaced form word---word, which is normal in typeset English prose but unusual in U.S. press writing, where AP style calls for spaced dashes. This study asks whether that trace is measurable in congressional press releases. In a preregistered design (OSF: https://doi.org/10.17605/OSF.IO/U5NEY), 146,239 scraper-sourced releases from 480 House and Senate offices (2021-2025, the open congress-press dataset) were analyzed: density of unspaced prose-form em-dashes per 1,000 characters of cleaned text, Poisson/negative-binomial models with a length offset, clustering by office. Density stayed within 0.10-0.12 per 1,000 characters through 2021-2024, then rose to 0.217 in 2025, more than twice the four-year baseline; the share of releases with such an em-dash rose from ~13% to 24.8%. The primary frequency ratio (2023-2025 vs 2021-2022) was 1.55 (95% CI 1.28-1.93; exact registered cut-off: 1.528), just above the prespecified 1.5x threshold. The rise was net-new (hyphen density stable), held within authors (75.6% of 262 continuous offices increased; p ~ 1e-16) and in a closed panel of 224 offices, and survived falsification tests: three placebo cut-offs were null, the pipeline showed no step at the 2024/2025 boundary, and continuing offices carried the rise. A segmented regression finds no step at the ChatGPT cut-off but a clear post-period acceleration; the 2025 rise is symmetric across parties and chambers. Because the registered validation gate was formally breached, the full preregistered decision rule was not met; the interpretation (broad diffusion of LLM-assisted writing as the models matured) is offered as exploratory. The em-dash remains a population-level marker, not a per-release authorship detector, and the design supports no causal claim.

27. 【2608.05884】he Vulnerability With No CVE: Managing Persistent Gaps Between Mandate and Authority in AI Coding Agents

链接：https://arxiv.org/abs/2608.05884

作者：Shayell Aharon Salomon Amir Shaked Matan Noga

类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)

关键词：Existing guidance identifies, guidance identifies excessive, weak task-bound authorization, inadequate agent controls, identifies excessive agency

备注：

点击查看摘要

Abstract:Existing guidance identifies excessive agency, excessive permission, weak task-bound authorization, and inadequate agent controls as important risks. Control frameworks also describe capabilities for constraining, authorizing, observing, validating, and responding to agent activity. Yet security programs still need a way to manage persistent deployed instances that span components and outlive any one event. We propose the agentic posture vulnerability (APV) as a task-conditioned vulnerability-management abstraction: a durable record for a composed agent-control exposure. One posture may produce different runtime manifestations across tasks; APV links those manifestations to the invariant posture and remains open until authority is narrowed, a missing control is added, risk is accepted, or closure is verified. APV is not proposed as a new root-cause class of risk; it operationalizes existing excessive-agency, authorization, and control-composition weaknesses. We distinguish APVs from CVE-addressable product defects, OWASP Excessive Agency, Agent Baseline control outcomes, and the runtime authorization-execution gap. We then provide a field vignette, a thresholded definition, six recurring APV patterns, a vulnerability lifecycle, a minimum record, a control-and-closure matrix, tooling implications, and a testable research agenda.

Subjects:

Cryptography and Security (cs.CR); Computation and Language (cs.CL)

Cite as:
arXiv:2608.05884 [cs.CR]

(or
arXiv:2608.05884v1 [cs.CR] for this version)

https://doi.org/10.48550/arXiv.2608.05884

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

28. 【2608.05876】Personalized Deep Research Query Refinement with Graph-Scaffolded Evidence Grounding

链接：https://arxiv.org/abs/2608.05876

作者：Soojin Yoon,Dongha Lee

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：deep research, deep research agents, deep research agent, research, User requests serve

备注： 13 pages, 4 figures

点击查看摘要

Abstract:User requests serve as research specifications for deep research agents, shaping what evidence to seek and how to synthesize it. In personalized deep research, these specifications must additionally reflect user goals, constraints, preferences, and evaluation criteria. User context can be incorporated either within the deep research pipeline or into the research specification provided as its input. We focus on the latter, refining the user request into a personalized research specification before passing it to an unchanged deep research agent. This requires resolving three coupled decisions: which framing factors are relevant, whether the available user context sufficiently supports them, and whether to retrieve user memory, ask the user, or stop and refine the query. For training, G-STEER organizes framing factors as elicitation targets in an Intent Elicitation Graph that captures their dependencies. It learns a clarification policy from graph-scaffolded trajectories spanning diverse factor dependencies and evidence conditions. The policy produces a refined query while balancing target coverage against the costs of evidence acquisition. Experiments show that G-STEER achieves the strongest overall weighted target coverage and the highest downstream report personalization across both evaluated DRAs, while asking roughly one third as many user questions as a strong clarification baseline.

29. 【2608.05872】MACRO: Markov Chain Routing of Transformer Layers

链接：https://arxiv.org/abs/2608.05872

作者：Paweł Batorski,Abtin Pourhadi,Akylgali Aitaza,Przemysław Spurek,Paul Swoboda

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Standard Large Language, Large Language Models, Standard Large, Large Language, execute layers sequentially

备注：

点击查看摘要

Abstract:Standard Large Language Models (LLMs) execute layers sequentially. Dynamic layer routing, i.e. search for a different execution path through layers involving layer repetitions, skips and other moves, can improve performance. Existing routing approaches often require updating model weights, running expensive search loops per test instance, or demand ground-truth labels during inference. In this work, we propose Markov Chain Routing of Transformer Layers (MACRO), a framework that learns task-specific routes over LLM architectures without modifying underlying parameters. MACRO models layer routing as a context-dependent Markov policy conditioned on layer indices, computation budget phases, directional displacements, and operator context, supporting skip, repeat, and residual hidden-state addition operations. The Markov route distribution is updated via feedback on training data and decoded using a top-k Viterbi algorithm to isolate high-probability candidate programs. We evaluate MACRO across diverse reasoning and knowledge benchmarks on multiple open-weight LLMs. MACRO achieves a +5.0% average accuracy improvement over the unrouted baselines, with largest gains on small models. We outperform the best dynamic routing approach Dr. LLM by +7.2%, while reducing route-search time 9.4x (from 14.8 to 1.6 hours). Our code is publicly available at this https URL.

30. 【2608.05857】Mapping Similarity Spaces across Embedding Models with Synthetic Query Probing

链接：https://arxiv.org/abs/2608.05857

作者：Marcin Rozmus,Peter van der Putten

类目：Computation and Language (cs.CL)

关键词：Retrieval-Augmented Generation systems, Generation systems rely, retrieve relevant content, differing geometric properties, Retrieval-Augmented Generation

备注： Accepted for 29th International Conference on Discovery Science, October 5-9, 2026, Mainz, Germany

点击查看摘要

Abstract:Retrieval-Augmented Generation systems rely on similarity scores to retrieve relevant content, yet scores are not directly comparable across embedding models due to differing geometric properties, complicating model migration and limiting threshold reuse. We study how similarity scores can be related by learning mappings between score distributions rather than embeddings. We introduce Synthetic Query Probing, generating queries from documents to create controlled query-chunk pairs, enabling large-scale, reference-free analysis of cross-model similarity behavior. We evaluate the approach on multiple embedding configurations and learn score conversion functions using linear, isotonic, and quantile mappings. Experiments on SciFact and a proprietary corpus show that while models largely agree on rankings, their absolute scores exhibit systematic distortions. Learned mappings partially align these spaces and improve threshold portability, with isotonic regression performing best. Our results highlight the need for cross-model calibration and position Synthetic Query Probing as a scalable framework for analyzing embedding comparability.

31. 【2608.05850】MameLoshnLM: Yiddish Language Model and Evaluation Benchmark

链接：https://arxiv.org/abs/2608.05850

作者：Uri Katz,Omer Goldman,Tomasz Limisiewicz,Reut Tsarfaty,Noah A. Smith

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：model built specifically, built specifically, Yiddish, Yiddish language modeling, language model built

备注： Accepted at the Conference on Language Modeling (COLM) 2026

点击查看摘要

Abstract:We present MameLoshnLM, the first open-source 8B-parameter language model built specifically for Yiddish. Despite Yiddish's rich textual tradition, its limited digital presence and the scarcity of reliable evaluation resources have constrained progress in Yiddish language modeling. Existing multilingual corpora and benchmarks are often poor proxies for the language, containing substantial amounts of noisy, machine-translated, and misclassified text. We address these gaps by introducing Oytser, a high-quality Yiddish pretraining corpus that combines contemporary web-native sources with literary materials, and Kashes, a multi-task benchmark spanning translation, linguistic analysis, information extraction, and language understanding. Using these resources, we continue pretraining Llama 3.1 8B to obtain MameLoshnLM. Across the tasks in the benchmark, MameLoshnLM outperforms open baselines of similar scale. Our analyses show that these gains are not only quantitative: relative to general-purpose multilingual models, MameLoshnLM better captures language-defining lexical and morphological patterns, pointing to a broader failure mode of noisy web-scale multilingual data for low-resource languages. Our results provide both a foundation for Yiddish NLP and a practical template for language model development in historically rich but digitally underrepresented languages.

32. 【2608.05832】Enhancing Social Intelligence in LLMs with Hierarchical Reasoning and Utterance-Level Goal Rewarding

链接：https://arxiv.org/abs/2608.05832

作者：Xiaofeng Wang,Kakam Chong,Shuai Xiao,DeXin Kong,Qingyuan Tian,Chen Ju,Xu Yan,Shuai Zhao,Fei Huang,Rui Wang,Shuguang Han,jufeng chen

类目：Computation and Language (cs.CL)

关键词：Large language models, Large language, dynamic social interactions, success requires long-term, requires long-term goal

备注：

点击查看摘要

Abstract:Large language models (LLMs) excel in structured tasks but struggle with dynamic social interactions, where success requires long-term goal coordination and rapid adaptation. Current methods often apply uniform goal-based rewards to every utterance, overlooking the specificity of objectives at each dialogue turn and failing to account for the rationale of potential strategies. Inspired by the Theory of Planned Behavior, we propose the Think-Strategy-Response (TSR) framework, which decomposes social dialogue into two hierarchical stages: high-level strategic planning and low-level linguistic execution. To optimize TSR, we introduce Linearized Hierarchical Reinforcement Learning with Variance-Gated Rewards (LHRL-VGR), a novel algorithm that dynamically routes rewards - balancing goal completion and strategy adherence - based on the variance of goal achievement scores. Experiments on the SOTOPIA benchmark show that our approach fine-tunes a Qwen2.5-7B agent to surpass the GPT-4o baseline by 7.32% in goal completion success, demonstrating state-of-the-art performance in multi-agent social negotiation tasks.

33. 【2608.05825】MoCA: Implicit Social Context Analysis

链接：https://arxiv.org/abs/2608.05825

作者：Wenhao Xu,Kaiwen Zhang,Hao Li,Maowei You,Yongzheng Ji,Siyuan Zuo,Jingxuan Yu,Sina A,Xinyao Tan,Bobo Li,Hao Fei,Mong-Li Lee,Wynne Hsu

类目：Computation and Language (cs.CL)

关键词：culturally grounded signals, implicit social, Human social communication, Social Context Analysis, expressed through indirect

备注：

点击查看摘要

Abstract:Human social communication, such as affection and intent, is often conveyed in highly implicit ways, where underlying meanings are expressed through indirect, socially and culturally grounded signals rather than explicit statements. Such implicit social contexts are pervasive in real-world interactions, yet there remains a lack of a formal and systematic framework for studying them. In this paper, we introduce Implicit Social Context Analysis (MoCA), a novel task that systematically models implicit social scenarios along three key dimensions: affection, intent, and stance. We construct a high-quality benchmark containing 3,108 multimodal instances collected from real-world sources, with fine-grained cognitive annotations revealing who expresses what toward whom, as well as how and why it is conveyed. Using the MoCA dataset, we show that state-of-the-art multimodal large language models struggle significantly with this task because of their reliance on explicit cues and limited ability to reason over latent social contexts. To address this challenge, we propose Conflict-Driven Abductive Reasoning (CoDAR), a novel framework that models the discrepancy between observed expressions and expected truthful behavior as cognitive conflict, thereby enabling the inference of hidden mental states. Extensive experiments demonstrate that CoDAR substantially improves model performance. Nevertheless, a large gap from human reasoning remains, highlighting the fundamental difficulty of implicit social understanding.

34. 【2608.05823】Decomposed Entailment for Factuality Checking and Hallucination Detection

链接：https://arxiv.org/abs/2608.05823

作者：Achir Oukelmoun,Nasredine Semmar,Gaël De Chalendar

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, reliability of Large, Language Models, factual inconsistencies

备注：

点击查看摘要

Abstract:The reliability of Large Language Models (LLMs) is often compromised by factual inconsistencies, including hallucinations---cases where generated content is not supported by the underlying source. We present HallDetect, a lightweight, reference-free, and black-box framework for hallucination detection that we evaluate not only on summarization but across a broader range of source-grounded generation settings. HallDetect builds on decomposition-based factuality evaluation: generated content is decomposed into atomic claims, each verified by a compact encoder-based entailment model through a contrastive formulation over a multi-scale library of source chunks, and aggregated with an asymmetric score in which a single confidently contradicted claim flags the response. Under a controlled protocol in which all methods share the same 4-bit quantized backbones and consumer-grade hardware budget, HallDetect outperforms comparably resourced generative and embedding-based baselines on three of four benchmarks while remaining stable across backbone families, and yields a claim-to-span audit trail that localizes each error.

35. 【2608.05817】M$^3$R-Bench: A Unified Benchmark for Evidence-Grounded Multimodal Metaphor Understanding

链接：https://arxiv.org/abs/2608.05817

作者：Hong Jiang,Junnan Zhu,Jingwang Huang,Xiao Sun,Yuming Yang,Jiang Zhong,Ruirui Chen,Jingman Shi,Hao Wu,Nayu Liu,Xinyi Jiang,Kaiwen Wei

类目：Computation and Language (cs.CL)

关键词：conveying affective attitudes, Source mappings, abstract concepts, affective attitudes, concepts through cross-domain

备注： 6 figures and 5 tables. Hong Jiang, Junnan Zhu, and Jingwang Huang contributed equally. Jiang Zhong and Kaiwen Wei are corresponding authors. Code and data are available at [this https URL](https://github.com/hongshi4/M3R-Bench)

点击查看摘要

Abstract:Metaphor enables the understanding of abstract concepts through cross-domain mappings while conveying affective attitudes. In multimodal scenarios, visual and textual information jointly construct Target--Source mappings, requiring both conceptual understanding and cross-modal reasoning. However, existing benchmarks mainly evaluate metaphor understanding through isolated subtasks and lack evidence-grounded explanations, making it difficult to assess whether models establish mappings grounded in visual and textual this http URL address these limitations, we introduce M$^3$R-Bench, a unified and evidence-grounded benchmark containing 1,000 image--text instances with human-verified annotations. Guided by Conceptual Metaphor Theory and theories of nonliteral language understanding, M$^3$R-Bench provides joint annotations for metaphor occurrence, Target--Source mapping, sentiment, and stage-wise explanations following ``evidence identification--mapping establishment--sentiment inference.''Evaluations on M$^3$R-Bench reveal that existing models often overlook visual evidence, rely on superficial textual cues, and produce inaccurate Target--Source mappings, exposing a cross-modal evidence--mapping mismatch. To address this mismatch, we propose M$^3$R-Reasoner, which combines curriculum-based reasoning supervision with task-aware reinforcement learning to align model reasoning with metaphor interpretation. Experiments show that, with only an 8B-parameter backbone, M$^3$R-Reasoner outperforms larger proprietary MLLMs across four unified-task metrics and improves Visual Evidence and Sentiment Justification scores over GPT-5.5 by 28.45 and 30.11 points, respectively, while surpassing Claude-Sonnet-4.6 by 8.00 points in mean rubric score. The dataset and code are available at this https URL.

36. 【2608.05810】When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents

链接：https://arxiv.org/abs/2608.05810

作者：Linfang Shang,Ming Xu,Yiding Sun,Tianle Xia,Lingxiang Hu,Lan Xu,Ning Zheng

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Self-evolving agents accumulate, agents accumulate capability, Self-evolving agents, newly added skills, critical pool size

备注：

点击查看摘要

Abstract:Self-evolving agents accumulate capability by distilling reusable skills from their execution trajectories, but we find this process is not monotonic: past a critical pool size, newly added skills degrade performance instead of improving it. We formalize this capability-contamination phase transition and trace it to a structural cause: once a defective skill enters the decision context, it becomes reference material for distilling later skills, forming cross-round contamination chains. We further show the contamination is structurally irreversible: removing a source skill after the fact cannot erase the flawed reasoning its descendants have already inherited, so post-hoc rollback recovers only a small fraction of the lost performance. This makes skill admission a pre-commit necessity rather than a post-hoc fix, and motivates Verifier-as-Gatekeeper (VaG): a progressive trust hierarchy whose three heterogeneous critics - structural validity, behavioral harmlessness, and semantic consistency - filter each skill individually, coupled with a marginal-gain subset selection that removes combinatorial contamination at the top tier before skills reach the runtime context. On Terminal-Bench 2, unconditional accumulation rises to a peak and then degrades, giving back most of its gains as the pool keeps growing, and post-hoc removal of the culprit skills recovers only a small part of the drop - the empirical signature of irreversibility. In contrast, VaG improves every round, reaching 72% pass@1 with a pool roughly 5x smaller, and its frozen skill pool transfers positively to four other backbones and a second benchmark without re-evolution. Ablations confirm the three critics are complementary and mutually non-substitutable, each intercepting a largely disjoint class of harmful skills.

37. 【2608.05806】Hierarchical Latent Prediction for Language Models

链接：https://arxiv.org/abs/2608.05806

作者：Chang Shi,Tim Pearce,Manan Tomar,Siddhartha Sen,John Langford

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：language model pre, teacher-forced training paradigm, standard Next-Token Prediction, lays the foundation, model pre

备注：

点击查看摘要

Abstract:While standard Next-Token Prediction (NTP) lays the foundation of language model pre- training, its teacher-forced training paradigm may not be optimal for long-horizon reasoning and planning. Recent works such as Multi-Token Prediction (MTP) and Next-Latent prediction (NextLat) try to mitigate the problem through predicting multiple future tokens and self-supervised prediction in the latent space. However, those auxiliary objectives either have a limited horizon or suffer from compounding error from multi-step rollout. We introduce Hierarchical Latent Prediction (HiLP), which introduces an auxiliary higher-level abstract latent to help reduce the error accumulation effect in latent-space rollouts. Experiments show that HiLP can lead to longer-horizon coherent belief state representation and demonstrate the effectiveness of our method across coding and multi-step reasoning benchmarks, and offers more speculative decoding efficiency.

38. 【2608.05802】On-Policy Delta Distillation for Multilingual Math Reasoning

链接：https://arxiv.org/abs/2608.05802

作者：Byeongho Heo,Jaehui Hwang,Sangdoo Yun,Dongyoon Han

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：On-Policy Delta Distillation, settings remains underexplored, LLM post-training, multilingual settings remains, Delta Distillation

备注： 9 pages, 3 figures, 10 tables

点击查看摘要

Abstract:On-Policy Distillation (OPD) is emerging as a promising alternative to reinforcement learning for LLM post-training, yet its effectiveness in multilingual settings remains underexplored. We study OPD and its advanced variant, On-Policy Delta Distillation (OPD$^2$), for mathematical reasoning in English, Korean, and Japanese. OPD$^2$ improves OPD by using the probability gap between a post-trained teacher and its base model as the learning signal. Experiments with Qwen3 show that OPD$^2$ consistently outperforms the original OPD, with particularly strong improvements in Korean and Japanese, and generally narrows the English-Korean performance gap. We further find that English-only OPD can also increase performance for Korean and Japanese, but often shifts the responses toward English, highlighting the importance of multilingual data to preserving target-language responses.

39. 【2608.05797】Predicting Task Difficulty Without Rollouts

链接：https://arxiv.org/abs/2608.05797

作者：Stefan Krsteski,Charlotte Meyer

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：executing costly simulations, likelihood of success, rollouts means forecasting, forecasting this directly, description before executing

备注：

点击查看摘要

Abstract:Task difficulty dictates an agent's likelihood of success, and estimating it without rollouts means forecasting this directly from a task description before executing costly simulations in stateful environments. Reliable estimates would therefore allow environment designers to calibrate evaluation benchmarks and construct progressive training curricula. This becomes increasingly important as agents move into long-horizon domains, where empirical trial-and-error is a severe computational bottleneck. Prior work on early prediction is limited to static tasks or isolated coding environments, often relying on narrow features and inaccurate evaluation metrics. We study \textit{ex ante} difficulty prediction across 17 agentic benchmarks spanning coding, mathematics, machine learning, web navigation, function calling, and other domains. We show that AUC can mask poor difficulty estimates, identify token-level entropy as a useful predictive signal, and show how residuals between expected and observed difficulty can expose hidden environment flaws such as contamination and infeasibility.

40. 【2608.05785】ask-Conditional Flow Matching for Balanced Multilingual Text Embedding Adaptation

链接：https://arxiv.org/abs/2608.05785

作者：Tirth Bhatt,Naren Kumar S,Mayank Singh

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：single training objective, Flow Matching, Task-Conditional Flow Matching, applies Flow Matching, tasks requiring fundamentally

备注：

点击查看摘要

Abstract:Multilingual text embedding models are commonly adapted using a single training objective across diverse tasks, despite different tasks requiring fundamentally different optimization strategies. We introduce Task-Conditional Flow Matching (TCFM), a multilingual embedding adaptation framework that selectively applies Flow Matching to translation tasks while optimizing retrieval, classification, and pair-classification tasks with objectives better aligned to their learning dynamics. TCFM further combines teacher-guided representation preservation with a three-stage curriculum to enable stable adaptation. Evaluated on the Indic Massive Text Embedding Benchmark, TCFM establishes a new state-of-the-art, consistently improving embedding quality across a diverse set of multilingual tasks and generalizing across embedding model families. We will publicly release the codebase and datasets upon acceptance of the paper.

41. 【2608.05783】GROM: Gradient-Free Rapid One-Shot Machine Unlearning

链接：https://arxiv.org/abs/2608.05783

作者：Paweł Batorski,Przemysław Spurek,Paul Swoboda

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：safely removing specific, large language models, Machine unlearning, removing specific, critical capability

备注：

点击查看摘要

Abstract:Machine unlearning has become a critical capability for safely removing specific, sensitive knowledge from large language models (LLMs). Current state-of-the-art approaches primarily rely on iterative, training-time unlearning via fine-tuning. However, even when utilizing parameter-efficient dimensionality reduction techniques like LoRA, gradient-based optimization remains computationally expensive and lacks explicit analytical formulations. It can also leave the targeted knowledge merely hidden rather than removed, to the point that simply quantizing the unlearned model restores much of what it was supposed to have erased. To resolve this, we propose a novel one-shot unlearning approach, abandoning iterative optimization in favor of a direct, exact analytical solution. We frame the unlearning process as a ridge-regularized least-squares optimization problem, deriving a closed-form additive update for targeted weight matrices. This update forces the selected layer to suppress unwanted content while strictly preserving its behavior on retained data. Computed from gradient-free forward passes alone, with no backpropagation and no iteration to convergence, GROM applies the weight edit in mere seconds, which makes it orders of magnitude faster than traditional fine-tuning. Extensive evaluations demonstrate that GROM achieves state-of-the-art forgetting-utility trade-offs on TOFU-5%, TOFU-10%, MUSE-Books, MUSE-News and WMDP, significantly reducing computational overhead without sacrificing overall model performance. Because the update removes the targeted content from the weights instead of masking it, GROM also withstands the low-bit quantization attack that recovers much of the content a gradient-based baseline had appeared to forget. Our code is publicly available at this https URL.

42. 【2608.05759】How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMs

链接：https://arxiv.org/abs/2608.05759

作者：Christian Huber,Alexander Waibel

类目：Computation and Language (cs.CL)

关键词：domain specific special, automatic speech recognition, specific special words, context biasing methods, named entities

备注：

点击查看摘要

Abstract:Recognizing new and rare words - named entities, acronyms, domain specific special words, and other items scarce in training data - remains a key challenge for automatic speech recognition (ASR). We compare two strategies for this: context biasing methods, where an ASR model is extended such that during inference a word list can be supplied, and speech large language models (LLMs) prompted with context directly. We evaluate two context biasing methods based on Whisper against three speech LLMs across read and non-read speech, reporting biased, unbiased, and overall word error rate (WER). The context biasing methods cut biased WER by up to 88% relative while leaving other words largely unaffected. Speech LLMs excel on read speech but generalize less well to non-read speech, and prove sensitive to distractor count and prompt word order. We characterize the resulting trade-offs to guide method selection.

43. 【2608.05741】Once a Response, Always a Response: Detecting LLM-generated Text via Latent Prompt Restoration

链接：https://arxiv.org/abs/2608.05741

作者：Hongrui Bao,Yubing Ren,Yanan Cao,Jinhan You,Fang Fang,Shi Wang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Large language models, creating growing risks, Large language, educational misuse, creating growing

备注： 17 pages, 7 figures

点击查看摘要

Abstract:Large language models (LLMs) can generate fluent and convincing text at scale, creating growing risks for misinformation dissemination, educational misuse, and platform governance. These concerns make robust detection of machine-generated text increasingly necessary. Recent zero-shot detectors mainly exploit probability-based statistical discrepancies, but they do not explicitly account for the training process of LLMs, which leaves a distinct generation mechanism insufficiently modeled and limits detection robustness. To address this issue, we propose EchoPrompt, a training-free detector based on latent prompt restoration. Our key intuition is that machine-generated text is typically produced conditioned on an upstream prompt, and this hidden dependency can be partially reactivated by prepending a unified generic prefix. Specifically, EchoPrompt restores a generic assistant-response context, measures the induced likelihood gain with an instruction-tuned model, calibrates it against the corresponding base model, and aggregates the resulting differences into a score that quantifies latent prompt dependency. Extensive experiments show that EchoPrompt achieves state-of-the-art performance among zero-shot detectors while maintaining strong robustness across challenging evaluation settings.

44. 【2608.05729】Unified Agent: Managing Interactions across Devices

链接：https://arxiv.org/abs/2608.05729

作者：Xinshuang Liu,Runfa Blark Li,Shaoxiu Wei,Xin Lin,Truong Nguyen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：capabilities rapidly increase, rapidly increase, capabilities rapidly, move from running, running inside

备注：

点击查看摘要

Abstract:As capabilities rapidly increase, AI agents can move from running inside one app to acting across a user's devices over time. Yet existing agent systems still fall short in this scenario. This is because observations are scattered across devices and moments, but mainstream systems are not designed around this fact: a single agent that treats devices as tools lacks effective state management for all devices across time, and multi-agent systems coordinate across agents but do not maintain the compact carried state a cross-device, cross-time request needs. We argue that the agent should maintain an effectively designed state that organizes engagement evidence, stated facts, and the standing request in a compact, action-ready form for deciding its action given the current observation. To compare state designs, we construct a benchmark of user-agent interaction across devices and time. We instantiate this principle in Unified Agent, a stateful agent that carries interaction evidence across devices and moments and uses it with the current observation to act. In the default setting, it significantly outperforms our adaptations of four published designs. Across changes in multimodal large language model (MLLM) family, capability, and reasoning effort, it remains ahead of all compared systems, demonstrating that the state-design advantage is robust across MLLM settings. Our code and data will be publicly available on GitHub.

45. 【2608.05726】Mitigating Scoring Bias in LLM-as-a-Judge via Random Number Generation

链接：https://arxiv.org/abs/2608.05726

作者：Yuma Asato,Kiyoaki Shirai,Natthawut Kertkeidkachorn

类目：Computation and Language (cs.CL)

关键词：Large Language Models, Large Language, Language Models, LLM, automatic evaluation metrics

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) are often used as evaluators of text quality, known as LLM-as-a-Judge, which can outperform conventional automatic evaluation metrics that rely on reference texts. However, LLM evaluators tend to generate particular scores regardless of the context of the evaluated text, which is known as scoring bias. This study proposes a novel method to mitigate this scoring bias. An LLM is instructed to randomly generate number tokens, and the latent numerical bias of the LLM is identified by measuring the deviation of the observed distribution of numbers from the uniform distribution. A definition of a downstream task, for which an LLM evaluator is used, is added to the prompts for random number generation to measure task-specific latent number bias. In the evaluation by an LLM, the token generation probabilities for a given input are rectified considering the LLM's latent number bias. Results of the experiment on four different tasks, evaluation of LLM alignment, evaluation of summarization, Semantic Textual Similarity, and Semantic Textual Relatedness, demonstrate that our proposed method outperforms the baselines, including an LLM without debiasing and previous calibration methods. In addition, it is confirmed that scoring bias varies across LLMs, tasks, and score ranges, indicating the importance of measuring latent number bias as the case may be.

46. 【2608.05724】Sparse Mutual Information Graph Averaging for Improving Random Indexing Embeddings

链接：https://arxiv.org/abs/2608.05724

作者：Sriram Loganathan,Gokul Anand,Aung Bo Bo,Yourui Shao,William B. Andreopoulos

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：co-occurrence matrix materialization, avoid dense co-occurrence, dense co-occurrence matrix, Pointwise Mutual Information, Positive Pointwise Mutual

备注：

点击查看摘要

Abstract:Sparse word embedding pipelines can avoid dense co-occurrence matrix materialization, dense factorization, and gradient training while still relying on sparse global corpus statistics. This paper studies Random Indexing (RI) vectors refined by weighted averaging on a sparse Positive Pointwise Mutual Information (PPMI) graph. On a fairytales corpus, the covered semantic analogy set consists of 272 Google family- category questions. On this family subset, PPMI top-K graph averaging repairs a weak RI initialization, improving accuracy from 19.4+-0.7% to 30.7+-2.9% across five seeds. Under the single tested runs, the same neighborhood averaging reduces family- subset analogy accuracy for PPMI+SVD (singular value decom- position), Binary+SVD, CBOW, and Skip-gram. Thus the method is not competitive with neural baselines on text8 and gives near- zero strict similarity correlation on SimLex-999. While Bloom filter sketches underperform RI in the tested configuration, we find that PPMI graph averaging with top-K pruning is a useful non-gradient repair for weak RI embeddings. On the fairytales dataset, PPMI top-K=50 graph averaging improves RI with accuracy going from 19.4+-0.7% to 30.7+-2.9%, and performing best with a seed42 of 34.6%.

47. 【2608.05695】DreamGuard: Efficient Runtime Guardrail for LLM Agents via Risk-Aware World Model

链接：https://arxiv.org/abs/2608.05695

作者：Wenhao Lin,Chenyu Yu,Xingwei Lin,Sicong Cao,Xiang Chen,Lei Xue,Le Yu,Letian Sha,Chunming Wu

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词：increasingly invoke external, invoke external tools, large language model, agents increasingly invoke, user data

备注：

点击查看摘要

Abstract:As large language model (LLM) agents increasingly invoke external tools and interact with real-world systems, unsafe actions may cause irreversible consequences on external states, user data, and downstream services. Recent runtime guardrails mitigate such risks by checking proposed actions before execution, but many remain reactive: they primarily assess the apparent safety of the current action, lacking an explicit model of how risk evolves across the trajectory. This limitation creates a critical blind spot for long-horizon risks, where individually benign-looking actions can gradually drift the agent toward hazardous states. In response, we propose DreamGuard, a proactive guardrail for LLM agents built around a risk-aware world model. The world model maintains a compact recurrent latent state over the trajectory and predicts future latent states from which DreamGuard derives immediate-hazard and prefix-risk evidence. It then fuses these multi-horizon signals into intervention decisions before execution. Experiments across four benchmarks and an online guardrail evaluation show that DreamGuard outperforms generic, reactive, and proactive guardrail baselines, achieves the best safety-utility trade-off among evaluated guardrails, and maintains an average end-to-end latency of 25 ms per call.

48. 【2608.05687】Answer First, Reason Later: Commitment Order in Diffusion LLMs

链接：https://arxiv.org/abs/2608.05687

作者：Jewon Yeom,Jaewon Sok,Seonghyeon Park,Jeongjae Park,Hwiyeong Lee,Taesup Kim

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Masked diffusion language, diffusion language models, diffusion language, core advantage, advantage over autoregressive

备注：

点击查看摘要

Abstract:Masked diffusion language models (dLLMs) can commit tokens in any order -- a freedom marketed as their core advantage over autoregressive decoding. We show that on reasoning tasks this freedom is instead the axis of failure. Logging every commitment during decoding of LLaDA-8B on GSM8K, we find that unconstrained (pure) decoding commits the final answer at 15-24% of the trajectory while half the reasoning region is still masked, and collapses to answer-only outputs on up to 90% of problems as the canvas grows. The cause is not the model's termination beliefs -- EOS "pressure" is nearly identical across decoders -- but reachability: whether the sampler may act on those beliefs at distant positions. A 2x2 prompt-decoder design shows that chain-of-thought helps only under ordered commitment (interaction +34.8 percentage points, 95% CI [26.8, 42.8]; without reasoning text the decoders are indistinguishable), an interaction we decompose into a collapse channel and an order channel and replicate on Dream-7B and MATH-500. A single-knob intervention -- frontier-gated commitment -- causally recovers the full gap (0.528 to 0.852) while preserving up to 4x parallel decoding, along a measured frontier whose optimal window flips from w=1 at full refinement to unconstrained at 8 tokens/step. Our results reframe existing window-style samplers, previously motivated by efficiency, as the minimal fix for a reasoning pathology they were never designed to address.

49. 【2608.05660】Reasoning Errors Have a Region and a Direction in the Residual-Stream Trajectory of LLMs

链接：https://arxiv.org/abs/2608.05660

作者：Hamed Damirchi,Ignacio Meza De la Jara,Damith Ranasinghe,Yuhang Liu,Javen Shi

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：reliably distinguishing sound, important practical problem, require verifiable reasoning, distinguishing sound reasoning, reliably distinguishing

备注：

点击查看摘要

Abstract:As language models are increasingly used for tasks that require verifiable reasoning, reliably distinguishing sound reasoning from flawed reasoning has become an important practical problem. Recent trajectory-based methods seek this signal in layerwise residual-stream displacements, which capture how representations change while attenuating some stable, token-specific information. However, displacement omits the state from which an update originates, whereas restoring the full state risks reintroducing shortcut-prone information. We identify this trade-off and propose a three-stream detector that combines motion with two restricted views of location. A coarse region reader based on vector quantization and a fine direction reader over normalized multi-layer states. This design restores enough state context to interpret the motion without returning to full-state probing. On reasoning benchmarks unseen during training, our method improves selection accuracy by up to 12% over the displacement-only state of the art and 21% over single-layer probing baselines. Although trained only on reasoning benchmarks, it also reads factual completion and fact verification, ahead of every detector we compare against, which places the signal on correctness rather than on a kind of reasoning. Ablations further show that motion, region, and direction provide complementary signals. These results suggest that reasoning validity is better read from state-conditioned motion than from either static states or decontextualized trajectories alone.

50. 【2608.05651】Relay, Don't Route: Adaptive Population Handoff for Cost-Efficient LLM-Driven Evolution

链接：https://arxiv.org/abs/2608.05651

作者：Sichun Luo,Yi Huang,Guanzhi Deng,Haibo Wang,Haochen Luo,Lei Li,Zefa Hu,Junlan Feng,Qi Liu

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

关键词：Large language model, long evolutionary runs, Large language, driven evolution, algorithm discovery

备注：

点击查看摘要

Abstract:Large language model (LLM)-driven evolution has shown promise for program search and algorithm discovery, but relying on strong models throughout long evolutionary runs is costly. A natural alternative is to combine cheap and strong models under a fixed inference budget. However, existing approaches typically allocate models at the level of individual queries or mutation steps, overlooking that evolutionary search is \textit{stateful}: each generated candidate changes the population from which subsequent mutations are produced. We empirically analyze LLM-driven evolutionary trajectories and find that search progress is strongly front-loaded, early trajectory performance is informative but noisy, and cheap models recover much of the early progress achieved by strong models at lower cost. Motivated by these findings, we propose \textbf{\model}, a training-free framework that shifts budget allocation from individual calls to evolving populations through adaptive \textit{population handoff}. A cheap model explores multiple trajectories in short blocks allocated by a bandit scheduler. Relay Gain, defined as the marginal improvement of a compact, quality-diverse candidate bank constructed for handoff, serves as the scheduler reward and determines when to hand off. The curated candidates initialize a shared strong model population for refinement. Across four benchmarks and three budgets, \model achieves the highest mean score in 11 of 12 settings, outperforming competitive baselines. Our results suggest that in stateful search, budget allocation should be organized around the population, not the individual call.

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Neural and Evolutionary Computing (cs.NE)

Cite as:
arXiv:2608.05651 [cs.CL]

(or
arXiv:2608.05651v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.05651

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

51. 【2608.05643】Refining Over Resampling: Test-Time Self-Correction for LLM Reasoning

链接：https://arxiv.org/abs/2608.05643

作者：Ahsan Bilal,Muhammad Ahmed Mohsin,Muhammad Umer,Lena Trigg,Ali Subhan,Muhammad Ali,Dean F. Hougen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：scaling improves LLM, additional inference compute, existing answer patterns, repeat existing answer, improves LLM reasoning

备注： Submitted to EMNLP 2026

点击查看摘要

Abstract:Test-time scaling improves LLM reasoning by using additional inference compute, but wider sampling alone can suffer from diminishing returns: new rollouts often repeat existing answer patterns instead of adding useful reasoning diversity. Verifier-based selection offers an alternative, but its performance depends on the calibration of an external reward model. We propose a verifier-free breadth--depth refinement framework that uses test-time compute to both explore and improve candidate solutions. The method samples multiple independent reasoning rollouts, refines each rollout through iterative self-critique and self-correction, and aggregates the refined answers by majority voting. Breadth preserves diverse initial attempts, while depth repairs local reasoning errors before aggregation. Across AIME24, AIME25, AMC, OlympiadBench, and MATH500, our method consistently improves over greedy decoding, majority voting, verifier-based best-of-$N$, beam search, and lookahead decoding across multiple open-weight models. For instance, with Qwen2.5-1.5B, accuracy increases from the strongest verifier-based baseline to $58.0\%$ on MATH500, and from $25.0\%$ to $32.5\%$ on AMC. These results show that test-time compute can be more effective when used to refine sampled trajectories rather than only to sample more candidates or rely on verifier-guided selection.

52. 【2608.05630】Human-Like Anaphor Resolution in Large Language Models

链接：https://arxiv.org/abs/2608.05630

作者：Keane Zhang,Varshini Chinta,Raj Sanjay Shah,Sashank Varma

类目：Computation and Language (cs.CL)

关键词：anaphor resolution, Large Language Models, anaphor, resolution, expressions

备注： 7 pages, 6 figures, 1 table. Presented at CogSci 2026 and the 2026 Annual Meeting of the Society for Text Discourse. Code: [this https URL](https://github.com/wristy/anaphor)

点击查看摘要

Abstract:Anaphors are expressions that refer to other expressions, called antecedents. The process of connecting the two is called resolution. Cognitive science has identified multiple factors that affect the speed and success of anaphor resolution, including discourse structure, situation-model properties, and semantic factors. Here, we investigate whether these factors also affect anaphor resolution in five Large Language Models (LLMs) with open weights: GPT-2-XL, Llama-3.1-8B, Pythia-12B, Mistral-7B, and Mistral-24B. To model processing difficulty, we adopt the standard linking hypothesis that relates human reading times to model surprisal at the anaphor. As a second behavioral measure, we compare model accuracy to human accuracy on comprehension questions probing the antecedents of anaphors. The results show selective cognitive alignment: some LLMs exhibit human-like sensitivity to discourse prominence and distance-based factors in anaphor resolution, while showing weaker or absent sensitivity to semantic interference effects. These findings delimit the conditions under which LLMs approximate human anaphor resolution.

53. 【2608.05624】Measuring and Detecting Harmful AI Sycophancy

链接：https://arxiv.org/abs/2608.05624

作者：Bohan Jiang,Dawei Li,Yasin Silva,Huan Liu

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：large language models, Contrastive Anchor Probing, PSRS, pervasive in large, large language

备注： under-review

点击查看摘要

Abstract:Sycophantic responses are becoming pervasive in large language models (LLMs), and prior work has pointed out that some of them could be harmful. This paper focuses on one harmful sycophancy: preference-induced stance reversal sycophancy (PSRS), where a model reverses an initial stance merely to align with a user's stated preference. While existing research mainly measures how sycophantic a model is, we go further and ask whether PSRS can also be detected automatically from a single response. To investigate this at scale, we introduce CAP (Contrastive Anchor Probing), a framework for collecting labeled PSRS data. Applying CAP to 17 open- and closed-source LLMs, we collect 290,460 labeled responses across 12 everyday-advice domains. We organize our study around three research questions. (1) How often does PSRS occur? (2) How well can it be detected? (3) How does detection generalize to unseen models? We first reveal that PSRS rates range from 5% to 56% across LLMs, with more capable models being less sycophantic. Next, we show that detecting PSRS is feasible from the response text alone, and detectors need to learn subtle PSRS patterns from the training data. Because new LLMs appear rapidly, detectors inevitably encounter unseen models, making cross-model generalization an important framework goal. We demonstrate that detection performance drops on unseen models and propose an initial approach to address this challenge. We will release our dataset and code to support future research.

54. 【2608.05611】FOCUS: Decoupling Expert Personas in LLMs to Enhance Domain Expert Capabilities

链接：https://arxiv.org/abs/2608.05611

作者：Guanyu Wang,Zidi Zhang,Xu Chu

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Large Language Models, Large Language, exhibit diverse personas, Language Models, textbf

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) can exhibit diverse personas, and activating expert personas has been shown to improve domain expertise and task accuracy. However, existing persona control methods often suffer from cross-domain coupling, which may lead to overly aggressive behavior in high-caution domains such as healthcare, or excessive conservatism in risk-sensitive domains such as financial trading. To address this issue, we propose FOCUS (\textbf{\underline{F}}ine-tuning with \textbf{\underline{O}}rthogonal \textbf{\underline{C}}ontrol for \textbf{\underline{U}}ncoupled persona\textbf{\underline{S}}). FOCUS first automatically extracts expert persona vectors from LLMs, then applies orthogonal decomposition to decouple domain-specific expert personas, and finally introduces an expert gating module to adaptively control persona activation according to task contexts. With a two-stage training strategy and a gated selection regularizer, the model learns to activate appropriate personas for both single-domain and cross-domain tasks. Experiments on financial, legal, medical, and cross-domain benchmarks show that FOCUS improves task accuracy and outperforms existing persona control methods. Our code is available at \href{this https URL}{this url}.

55. 【2608.05604】SkillZip: Contract-Preserving Graph Compression for Scalable Agent Skill Libraries

链接：https://arxiv.org/abs/2608.05604

作者：Xingyu Tan,Xiaoyang Wang,Qing Liu,Xiwei Xu,Xin Yuan,Liming Zhu,Wenjie Zhang

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Large Language Models, Large Language, Language Models, increasingly act, knowledge is stored

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) increasingly act as agents whose procedural knowledge is stored in reusable skill packages and loaded at inference time. As skill libraries grow, a central challenge is to expose the smallest sufficient executable context under a limited context budget. Existing systems struggle to reuse routines below the whole-skill level, preserve procedural contracts during compression, keep compressed routines executable and expandable, and update the compressed library as skills evolve. These challenges reveal a unit mismatch: skills are retrieved as packages, compressed as text, and converted into execution graphs only after retrieval, whereas reliable reuse requires a contract-bearing procedural unit. We propose SkillZip, an execution-aware procedural abstraction framework that performs contract-preserving compression over section-level graphs. SkillZip rewrites recurring contract-valid motifs into reversible ported macros while preserving boundary signatures, dependency closure, verifier reachability, and source-level expansion. At inference time, it hydrates a compact, dependency-closed context and expands macros only when required. ReZip further integrates new skills and revises risky macros using execution evidence. Comprehensive experiments1 on technical and embodied agent benchmarks show SkillZip consistently outperforms the strongest baseline by up to 12.2 points, while achieving a 3.46x compression ratio with 99.2% dependency preservation and 98.7% verifier reachability. Scaling analyses further confirm robust retrieval across skill libraries ranging from 200 to 100K skills.

56. 【2608.05576】Where Models Converge and Humans Diverge: A Coverage Framework for Distributional Pluralism in Open-Ended Generation

链接：https://arxiv.org/abs/2608.05576

作者：Zini Yang,Emily Wenger,Richard So

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：writes Harry Potter, Harry Potter fanfiction, Harry Potter fanfictions, Human-written Harry Potter, Harry Potter

备注： 18 pages, 4 figures

点击查看摘要

Abstract:When a large language model (LLM) writes Harry Potter fanfiction, it reliably produces fundamental elements of the Hogwarts universe, such as recognizable places and characters. Human-written Harry Potter fanfictions, however, typically include these fundamentals and much more, incorporating stylistically irregular content and relationship-diverse plotlines. This gap between LLM and human writing has been noted across a variety of domains. LLMs tend to produce "average" writing, while human writing contains more diverse content that covers a broader distribution. Existing work has shown the existence of this distributional "gap", but no work has proposed a systematic way to measure it. Our paper proposes a human-grounded framework that uses the empirical distribution of human writing on a topic to measure the distributional breadth of LLM-generated content on that same topic. We propose two metrics, LLM Coverage (LLM-Cov) and In-Boundary Rate (IBR), that separate the plausibility of LLM content from its distributional breadth. Across ideation and narrative tasks, we find that current LLMs produce plausible but narrow content that concentrates near the center of the human response space. Our framework can enable researchers to better assess the distributional breadth of LLM-authored content, which we term its "cultural reach".

57. 【2608.05560】From Sports to Safety: Benchmarking Proactive Risk Inference in MLLMs

链接：https://arxiv.org/abs/2608.05560

作者：Jiawei Qiu,Yichen Xu,Jianzhe Ma,Mingyang Yu,Wenbin Zhu,Yang Han,Pinzheng Lv,Wenxuan Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Timely anticipation, hazard prediction underexplored, existing MLLM evaluations, MLLM evaluations focus, prediction underexplored

备注： Preprints

点击查看摘要

Abstract:Timely anticipation of physical hazards is essential for real-world safety, yet existing MLLM evaluations focus on harmful content or general risks, leaving proactive physical hazard prediction underexplored. Sports provide a well-suited testbed: accident causes span diverse injury dimensions and pre-accident spatiotemporal cues draw on reasoning capabilities shared with broader safety domains such as autonomous driving and fall detection. We introduce SPRINT (Sports Proactive Risk INference Testbed), a benchmark of 2,888 real-world sports videos (2,440 accident, 448 safe controls) spanning 14 sports and 3 environmental settings. Accident videos feature fine-grained annotations of early hazard cues, accident timing, and hierarchical causes; safe videos are manually verified as accident-free and serve to diagnose prompt-induced false alarms. Evaluating state-of-the-art MLLMs under diverse prompts and temporal windows reveals a sharp gap between hazard sensitivity and understanding: the best model exceeds 95% in signaling hazards yet falls below 50% in identifying their causes. Diagnostic experiments further show that explicit danger queries trigger severe false alarms even on hazard-free videos. These findings indicate that current MLLMs exhibit only superficial proactive safety, lacking stable, cause-grounded early warning, and underscore the need for reliable proactive safety in dynamic physical environments. Data and code will be open-sourced upon acceptance.

58. 【2608.05519】EcoAgent-Bench: Evaluating Economic Decision-Making in Budget-Constrained LLM Agents

链接：https://arxiv.org/abs/2608.05519

作者：Jie Wu,Ming Gong,Feixiang Cheng,Qinqin Zhao

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：auxiliary statistic, benchmarks usually measure, treat resource, measure task completion, Agent benchmarks

备注： 8 pages, 3 figures, 4 tables. Benchmark, dataset (304 budget-conditioned agent tasks), and evaluation harness; artifacts to be released

点击查看摘要

Abstract:Agent benchmarks usually measure task completion and treat resource use as an auxiliary statistic. In deployment, however, the choice among a local lookup, broad search, composite research tool, stronger model, or human escalation is part of the task itself. We introduce EcoAgent-Bench, in which every task specifies priced actions and an explicit budget. Its 304 real-derived tasks span five families adapted from GAIA, HotpotQA, and MuSiQue, and test four decisions: avoiding unnecessary escalation, escalating when local evidence is insufficient, selecting a model tier, and stopping on unsupported premises. We evaluate seven LLM agents in tool-API and workspace-CLI settings, together with four oracle scripted controls. Micro-averaged accuracy rewards one-sided policies: always-escalate controls achieve high micro success while failing save-oriented tasks. We therefore also report an economic-consistency score (the worse of accuracy on upgrade-oriented and save-oriented family groups) which exposes this failure. Tool-API agents attain only 3.9-24.0% micro strict success (at most 7.3% economic consistency), often either stopping before warranted escalation or overspending on cheap tasks. A threshold-crossing budget sweep changes GPT-5.4's escalation rate from 0% to only 3%. These results show that completion under a budget and economical action selection are distinct properties. We release the task bundle, transformation pipeline, frozen evaluation environments, and integrity-bound result artifacts needed to study both.

59. 【2608.05510】Different Perturbations, Different Mechanisms: Understanding Continued Pre-training for Zero-Shot Dialect Robustness

链接：https://arxiv.org/abs/2608.05510

作者：Aarohi Srivastava,David Chiang

类目：Computation and Language (cs.CL)

关键词：remains a major, major challenge, CPT, Dialectal variation remains, perturbation-based CPT

备注：

点击查看摘要

Abstract:Dialectal variation remains a major challenge for multilingual language models. Perturbation-based continued pre-training (CPT) has emerged as a promising approach to improving robustness, yet existing work largely evaluates individual perturbation strategies in isolation and provides limited insight into why they work. We present a systematic study of perturbation-based CPT for multilingual dialect robustness in LLMs, comparing six training conditions across nine German, Italian, and Arabic dialect tasks. Perturbation-based CPT, especially character-noised CPT, consistently improves zero-shot dialect robustness while largely preserving standard variety performance. More importantly, we show that methods with similar downstream performance induce distinct mechanisms of robustness, exhibiting different patterns of language model adaptation, representational alignment, and prediction repair. Our results provide a more complete understanding of how synthetic surface variation improves robustness and offer practical guidance for selecting CPT strategies in multilingual and dialectal settings.

60. 【2608.05493】Learning Context-Free Grammars for Grammar-Constrained Decoding via Declarative Agentic Programming with Guarantees

链接：https://arxiv.org/abs/2608.05493

作者：Kevin Cheang,Geoff Hulette,Rahul Kumar,Felipe R. Monteiro,Federico Mora,Robin Salkeld,Lin Tan,Serdar Tasiran

类目：Programming Languages (cs.PL); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)

关键词：interact with external, external services, written in domain-specific, programs written, domain-specific languages

备注： 9 pages, 3 figures, 2 tables

点击查看摘要

Abstract:Language models (LMs) are increasingly used to interact with external services via programs written in domain-specific languages (DSLs). Unfortunately, since DSLs are often low-resource and esoteric, LMs frequently produce syntactically invalid programs in these languages. Grammar-constrained decoding can eliminate such failures, but requires syntactic constraints. These are usually in the form of a context-free grammar for the target language, an artifact that is hard to come by for third-party DSLs. In this work, we define an agent, called Autogrammar, that automatically learns context-free grammars from documentation and execution data. Autogrammar is formalized as a Kripke structure whose nondeterministic choices are resolved by a language model, enabling declarative control of agent behavior via linear temporal logic constraints. We evaluate four versions of Autogrammar on three DSLs (i.e., Amazon CloudWatch Logs Insights, Dynatrace Query Language, and Datadog Search Syntax) and find that it generates grammars that achieve near perfect precision on unseen data; that temporal restrictions reduce execution time by 3.8x without incurring statistically-significant loss in precision; that execution data is crucial while documentation is dispensable; and that grammar-constrained decoding using Autogrammar-generated grammars significantly improves end-to-end LM performance on eight out of ten real tasks, matching or exceeding the performance of a professionally-maintained grammar. In comparison, the context-free grammars generated by existing LM baselines and a state-of-the-art formal technique perform significantly worse over the same evaluation.

61. 【2608.05478】GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers

链接：https://arxiv.org/abs/2608.05478

作者：Takuro Kawada,Shunsuke Kitada,Hitoshi Iyatomi

类目：Graphics (cs.GR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

关键词：Graphical Abstracts, visually summarize, playing a crucial, summarize the key, key findings

备注： 20 pages, 11 figures, 4 tables

点击查看摘要

Abstract:Graphical Abstracts (GAs) visually summarize the key findings of academic papers, playing a crucial role in facilitating the understanding of research content. Recently, advancements in vision-language models and image generation models have enabled the automatic generation of scientific figures based on paper content. However, most conventional methods output the generated results as raster graphics, making post-editing (e.g., text modification and layout changes) highly difficult. This poses a significant challenge, as they are unsuitable for the iterative figure revision process inherent in paper writing and peer review. To tackle these challenges, we define the novel task of generating editable GAs from paper content and propose GenGA, a new GA generation framework that directly produces figures in vector format. By generating figures as a collection of vector elements with a hierarchical structure, GenGA produces outputs that can be seamlessly imported into existing drawing tools for intuitive, element-level editing. Furthermore, we introduce the Structural Independence Coefficient (SIC), a metric that quantifies the editing simplicity of a figure based on the degree to which local modifications propagate to other elements. Experimental results show that GenGA achieves superior editing simplicity compared to conventional methods, and even surpasses human-authored GAs in conciseness and semantic alignment. We also validate SIC as an effective metric correlated with manual editing costs. This study fundamentally redefines GA generation as an editable vector graphic generation problem grounded in the practical workflows of researchers, significantly promoting effective scientific communication.

62. 【2608.05448】DBLAST: Dependent Block Drafting for Stochastic Speculative Decoding

链接：https://arxiv.org/abs/2608.05448

作者：Amirmohammad Karimi,Chao Gao,Negar Hassanpour

类目：Computation and Language (cs.CL)

关键词：accelerates large language, large language models', language models' inference, decoding accelerates large, Speculative decoding accelerates

备注：

点击查看摘要

Abstract:Speculative decoding accelerates large language models' inference by using a lightweight drafter to propose multiple future tokens and a target model to verify them. While recent block and diffusion-style drafters can predict several positions in a single pass, their training and sampling procedures are typically optimized for greedy decoding or assume that positions in the draft block are conditionally independent. This assumption becomes brittle in non-greedy speculative decoding, where the target distribution is deliberately stochastic and multiple continuations become plausible. We study this mismatch for block diffusion drafters and show that the accepted draft length degrades as the entropy of the target sampling distribution increases. We propose a dependent block drafter based on a low-rank latent mixture over token positions, complemented by an acceptance-oriented training objective that directly targets the expected verified length. Experiments with Qwen3-4B and Qwen3-8B on GSM8K, MT-Bench, HumanEval, and creative-writing benchmarks show that our approach, namely DBLast, consistently improves accepted length over independent block sampling, especially in higher-entropy decoding regimes.

63. 【2608.05447】Example-Guided Prompting for Document-Level Text Simplification

链接：https://arxiv.org/abs/2608.05447

作者：Marina Litvak,Ariel Perstin,Ilan Shtilman,Michael Färber

类目：Computation and Language (cs.CL)

关键词：requires large language, large language models, text simplification requires, simplification requires large, preserving meaning

备注：

点击查看摘要

Abstract:Document-level text simplification requires large language models (LLMs) to rewrite complex documents while preserving meaning, readability, and discourse coherence. Although prompt-based LLMs have shown promising performance, they often produce inconsistent simplifications because textual instructions alone provide limited guidance for complex document-level transformations. We investigate whether retrieved document-simplification examples can improve document-level generation by augmenting prompts with examples selected from a parallel simplification corpus. This example-guided prompting approach enables LLMs to exploit relevant simplification patterns without task-specific fine-tuning. Experiments on the OneStopEnglish corpus using multiple state-of-the-art LLMs show that incorporating retrieved examples consistently improves simplification quality over prompt-only generation and achieves competitive or superior performance compared with representative supervised (T5) and planning-based (PlanSimp) document simplification systems. Furthermore, we find that the benefits of example-guided prompting vary across LLMs, suggesting that effective use of retrieved examples depends on a model's ability to integrate contextual information during generation.

64. 【2608.05446】EvoHarness-RL: Learning Self-Evolving Runtime Harness for Long-Horizon LLM Agents

链接：https://arxiv.org/abs/2608.05446

作者：Xuying Ning,Dongqi Fu,Tianxin Wei,Hanqing Zeng,Yuanchen Bei,Bingxuan Li,Zihao Li,Qifan Wang,Xiang Shen,Yifan Wu,Jiayi Liu,Hong Li,Yinglong Xia,Xiangjun Fan,Hanghang Tong,Jingrui He

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：agents increasingly rely, LLM agents increasingly, verify outcomes, harness, increasingly rely

备注： Accepted to LLA@COLM 2026

点击查看摘要

Abstract:Long-horizon LLM agents increasingly rely on external execution support to maintain state, track progress, invoke tools, verify outcomes, and reuse experience across interactions. However, effective harness use raises two coupled challenges: state formation from noisy interaction traces and runtime control over external-state access. Existing agents usually handle both through prompts, heuristics, or domain-specific conventions, leaving the external workspace and its usage policy manually engineered. To address this, we study the problem of harness policy learning, where agents learn harness policies offline and deploy them to construct and update external harness state online during runtime task execution. We introduce EvoHarness-RL, which exposes Belief, Progress, and Experience (BPE) as policy-facing harness state. Supervised harness fine-tuning teaches the base agent the harness action space and how to construct useful external state, while cost-aware GRPO explores coordination policies to selectively read, update, and consolidate that state during long-horizon interaction. Instantiated on ALFWorld with a Qwen3-8B LLM, EvoHarness-RL reaches 96.9% success and reveals two key dynamics: harness annealing, where training internalizes recurring harness-use patterns into the model policy and shifts the agent from frequent harness calls toward selective external-state access, and harness evolution, where progress updates and experience consolidation refine the harness into a compact, task-adaptive state substrate. These results suggest that long-horizon agents benefit from trainable policies for constructing and coordinating with external harness workspaces, beyond simply adding stronger tools or larger memories.

65. 【2608.05409】Mood Matters: How Syntactic Sensitivity Undermines Safety Alignment

链接：https://arxiv.org/abs/2608.05409

作者：Alina Klerings,Jannik Brinkmann,Heiner Stuckenschmidt,Simone Paolo Ponzetto

类目：Computation and Language (cs.CL)

关键词：sidestep established safeguards, Large language models, Large language, language models typically, models typically undergo

备注：

点击查看摘要

Abstract:Large language models typically undergo post-training to align them with safety policies but there exist many sophisticated jailbreaks that sidestep established safeguards. For instance, prior work by Andriushchenko et al. (2025) has found that changing the grammatical tense from present to past can be enough to elicit harmful responses. In this work, we uncover a more general failure of non-imperative syntactic forms. We demonstrate that this syntactic vulnerability exists in 16 models up to 70B parameters, using behavioral evaluation. To investigate the root cause, we apply causal mediation analysis, finding that refusal is partially conditioned on upstream syntactic features. By steering these purely syntactic features we are able to trigger and suppress refusal. Finally, we trace this ill-conditioning to linguistically biased post-training data of open-source models and show that increasing syntactic diversity can mitigate the issue. Our findings suggest that current alignment approaches introduce confounders that prevent a pure semantic grounding of the refusal decision.

66. 【2608.05364】he interface of intonation and lexical tone: Boundary phenomena in Mandarin varieties

链接：https://arxiv.org/abs/2608.05364

作者：Cong Zhang,Yiya Chen

类目：Computation and Language (cs.CL); Sound (cs.SD)

关键词：Mandarin Chinese varieties, primary acoustic cue, Mandarin Chinese, Chinese varieties, intonation and tone

备注： to be published in book 'Shaping Phonological and Morphological Representations: Diachrony, Acquisition, and Processing'

点击查看摘要

Abstract:This chapter explores the intricate interplay between intonation and tone in Mandarin Chinese varieties, focusing on f0, the primary acoustic cue for both intonation and tone. The main empirical base is intonation boundary phenomena, where intonation and tone intersect and influence each other in conveying a range of sentence-level linguistic functions -- such as question vs. statement -- and a rich array of speakers' attitudinal information. Theoretical models and emerging techniques are also discussed to account for the observed interactions of tonal aspects and boundary phenomena to convey multiple levels of communicative meanings.

67. 【2608.05353】Evidence Lock Before Commitment: A Frozen Interface Degrades LLM-as-Judge Evaluation

链接：https://arxiv.org/abs/2608.05353

作者：Divyansh Singh

类目：Computation and Language (cs.CL)

关键词：LLM judges, asked to extract, extract criteria, choosing between candidate, LLM

备注：

点击查看摘要

Abstract:LLM judges are often asked to extract criteria and evidence before choosing between candidate answers. This workflow assumes that the intermediate record preserves the information needed for a later verdict. For reasoning-capable models, visible field order does not reveal internal decision order, so we test an observable alternative: persist the evidence in one call and make it the exclusive input to the next. Across 24,000 judgments over HelpSteer3, FeedbackQA, and CoVal, we compare standard pairwise judging, structured one-call judging, two-call evidence locking, and three-call pointwise locking with Claude Sonnet 4.5 and GPT-5. Evidence locking reduces agreement with released human preferences by 4 to 6 percentage points and increases answer-order inconsistency by 8 to 10 points relative to structured one-call judging. Pointwise locking is also harmful, while structured evidence elicitation remains close to standard judging. The result holds for both judges and all three datasets. Persisted evidence can support auditability, but it should not replace the source answers at decision time.

68. 【2608.05326】QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding

链接：https://arxiv.org/abs/2608.05326

作者：Ayushman Garg,Akshita Gupta,Shaswata Bhattacharya,Abhishek Gupta,Sandeep Kumar,Manoj Kumar

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Autoregressive large language, Autoregressive large, large language model, language model inference, large language

备注： 24 pages, 6 figures. The first four authors contributed equally

点击查看摘要

Abstract:Autoregressive large language model inference is increasingly constrained by the memory footprint of the Key-Value (KV) cache. A dominant line of work reduces this footprint by evicting tokens that appear unimportant under attention-derived scores. However, such policies make an implicit irreversible decision: once a token is evicted, it cannot become useful again. We show that this assumption is brittle during decoding. Token and window importance drift as generated queries evolve, causing standard eviction policies to permanently discard states that later receive substantial attention under the full-cache model. To characterize this behaviour, we introduce Future Missed Mass and Global LIR, two diagnostics that measure future attention assigned to discarded states and the reactivation of historically inactive regions. We propose QEvict, a three-tier KV-cache management scheme that replaces binary retain-or-delete eviction with recoverable eviction. QEvict maintains high-confidence windows in full precision, stores intermediate windows in a quantized recoverable tier, and deletes only the lowest-confidence windows. During decoding, cumulative attention scores update window importance and when a quantized window becomes important again, it is dequantized and promoted to the full-precision. Under a fixed memory budget, this design preserves broader historical context while retaining exact full precision for the most important regions. Across long-context understanding, retrieval, and reasoning benchmarks, QEvict consistently improves over representative eviction and quantization baselines, reducing missed attention and improving information retention

69. 【2608.05303】EdgeXpert: An Edge Device for Memory-Efficient LLM Inference with Mixture-of-Experts and Speculative Decoding

链接：https://arxiv.org/abs/2608.05303

作者：Sangwoo Ha,Hyunwoo Seo,Yurim Jo,Youngjin Moon,Hoi-Jun Yoo

类目：Hardware Architecture (cs.AR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Large Language Models, Language Models, Large Language, personalized edge applications, On-device deployment

备注： Accepted at the 59th IEEE/ACM International Symposium on Microarchitecture (MICRO 2026)

点击查看摘要

Abstract:On-device deployment of Large Language Models (LLMs) has become essential for personalized edge applications. A primary bottleneck is external memory access (EMA) in feed-forward network (FFN) layers. Speculative decoding and mixture-of-experts (MoE) are promising solutions. Speculative decoding reduces the number of decoding stages by generating multiple tokens per stage, and MoE minimizes per-stage cost through sparse expert activation. However, there is an incompatibility when combining these two techniques. We propose EdgeXpert, a software-hardware co-designed LLM accelerator that resolves this incompatibility. In the prefill stage, the prompt-wise expert reuse reformulates routing as prompt-level expert reuse rather than independent per-token expert selection. It identifies important tokens using a lightweight encoder, constructs a shared expert set from them, and routes less important tokens with a reduced expert budget to lower expert EMA. In the decode stage, depth-aware expert coalescing exploits the contextual similarity and mutual exclusivity of same-depth candidate tokens. Rather than loading the union of all required channels, EdgeXpert loads only salient channels and applies computational calibration to recover accuracy without additional memory access. Synthesized in Samsung 28nm technology at 800 MHz, EdgeXpert achieves up to 56.3% latency reduction and 44.1% energy reduction compared to prior works, while maintaining near-baseline accuracy.

70. 【2608.05254】Constraint-First Reasoning: A Training-Free Protocol for Exploiting Answer-Space Constraints in Mathematical Problem Solving

链接：https://arxiv.org/abs/2608.05254

作者：Hongbo Ma,Bangji Yang,Yunqian Selina Cheng,Jiajun Fan,Hanwen Zhang,Ge Liu

类目：Computation and Language (cs.CL); Symbolic Computation (cs.SC)

关键词：Large language models, violate explicit requirements, encoded answer form, wrong encoded answer, Large language

备注： 53 pages, 5 figures, 36 tables

点击查看摘要

Abstract:Large language models can derive a plausible mathematical object yet still violate explicit requirements--for example, by omitting a modular reduction, returning a non-integer, or using the wrong encoded answer form. We introduce Constraint-First Reasoning (CFR), a training-free two-stage prompting protocol: Stage 1 extracts and summarizes constraints entailed by the problem, and Stage 2 solves while checking intermediate and final results against that summary. Routed-CFR activates the two-stage protocol only when a text-only regex router detects restrictive cues; otherwise it uses direct chain-of-thought (CoT). Across AIME, CMIMC, BRUMO, and AIMO_AMC, the method improves direct CoT on multiple backbones. We further report convention-controlled routing experiments, matched prompting baselines, problem-level paired tests, decoding robustness, constraint-quality audits, total-token accounting, and an OlympiadBench evaluation. These analyses position CFR as a targeted test-time intervention whose benefit depends on recoverable constraints and reliable Stage 1 extraction, rather than as a general-purpose replacement for mathematical reasoning.

71. 【2608.05232】Analysis of Numerical Localisation in LLM Translations

链接：https://arxiv.org/abs/2608.05232

作者：Patrizia Kaye

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：work of Tang, large language models, Tang, Abstract, translation

备注： 13 pages, 7 tables, 2 figures

点击查看摘要

Abstract:The work of Tang et. al. (2025) on numerical translation is extended by analysing the capability of five large language models (LLMs) for the localisation of times, numbers, and dates instead of translation. Models were selected that could be loaded onto and run on commodity hardware and a baseline quality for each mode is computed, then three different strategies to improve on that accuracy were tested. In contrast to Tang et. al., it was discovered that on the tested LLMs, embedding the localisation principles into the prompt context provided a statistically significant improvement in accuracy compared to direct translation or the alternative strategies.

72. 【2608.05228】riQua: Reconciling Granularity and Context in Factuality Evaluation

链接：https://arxiv.org/abs/2608.05228

作者：Jin Liu,Steffen Thoma,Achim Rettinger

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：broader statements lack, paradigm for LLM, omit essential context, fundamental trade-off, precise assessment

备注：

点击查看摘要

Abstract:The "decompose-then-verify" paradigm for LLM factuality evaluation faces a fundamental trade-off: atomic facts, i.e., one sentence conveying one unit of information, often omit essential context, while broader statements lack the granularity needed for precise assessment. To address this, we introduce TriQua, a framework that flexibly models facts based on their complexity. Simple claims are extracted as standard triples, while complex claims are represented as hyperrelational facts by attaching auxiliary contextual qualifiers. This adaptive structure preserves the necessary context for accurate retrieval and verification without sacrificing atomicity. Furthermore, TriQua's verification process directly annotates concrete errors within specific triples and qualifiers, providing fine-grained explainability for error detection. Alongside the framework, we propose TriQuaScore to quantify the factuality of these structured fact units. Empirical evaluations show that TriQuaScore strongly aligns with human annotated factuality scores, TriQua achieves robust decomposition quality, and outperforms existing decomposition-based frameworks in evidence-based fact verification.

73. 【2608.05188】Position: It's Time to Optimize LLMs for Self-Consistency

链接：https://arxiv.org/abs/2608.05188

作者：Itamar Pres,Belinda Z. Li,Laura Ruis,Zifan Carl Guo,Keya Hu,Mehul Damani,Isha Puri,Ekdeep Singh Lubana,Jacob Andreas

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：exhibit incomplete logical, incomplete logical generalization, important failures persist, user framing, exhibit incomplete

备注： Accepted at the 43rd International Conference on Machine Learning (ICML 2026), Position Paper Track

点击查看摘要

Abstract:Despite ever-increasing sophistication in language model (LM) pre- and post-training pipelines, many important failures persist: models overcondition on user framing ("sycophancy"), exhibit incomplete logical generalization, and produce confident but incorrect responses. We argue that these failures arise from a modeling assumption permeating all aspects of the pipeline: that behavior can be specified and evaluated independently on single-output pairs. Many model failures are difficult, if not impossible, to detect without reasoning about relationships between a model's responses across inputs. In this position paper, we propose self-consistency as a framework for understanding these failures. We first observe that a wide variety of techniques designed to improve specific aspects of LM behavior-targeting properties as diverse as adversarial robustness and factual coherence-can be understood as special cases of a common "consistency optimization" procedure and addressed with a standard set of optimization tools. We next outline a set of new model properties that could be achieved by optimizing for consistency, and conclude with a discussion of what it would mean to develop generally consistent LMs, including the capabilities they would enable and the objections they raise.

74. 【2608.05170】DREAM: LLM-based Dynamic Role-playing via Event-Aware Memory Graph

链接：https://arxiv.org/abs/2608.05170

作者：Zhihao Xiao,Mengting Li,Xintao Wang,Linfeng Li,Limin Shui,Mengqi Ji,Borui Cai

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：large language models, high-fidelity character simulation, enabling immersive, key application, application of large

备注： Accepted at KDD 2026. Camera-ready version to appear. 16 pages, 5 figures

点击查看摘要

Abstract:Role-playing agents (RPAs) have emerged as a key application of large language models, enabling immersive and high-fidelity character simulation. Accurate role-playing of established characters requires not only stylistic imitation but also temporally consistent and causally grounded behavioral reasoning. However, existing RPAs primarily rely on static character descriptions and unstructured memory, limiting their ability to maintain long-term narrative and personality coherence. We introduce DREAM, a structured memory framework for role-playing agents inspired by the Activating Event-Belief-Consequence (ABC) cognitive model. DREAM transforms unstructured literary text into an Event-aware Memory Graph (EMG) that organizes character experiences into temporally ordered and causally linked event graph. This representation enables the construction of dynamic, dual-granularity character profiles that capture both stable personality traits and event-driven behavioral evolution. We further propose the Temporal Causal Memory (TCM) benchmark to evaluate temporal consistency and long-range causal narrative coherence. DREAM achieves state-of-the-art performance across CoSER, LIFECHOICE, and TCM, outperforming multiple strong baselines. Our approach demonstrates the effectiveness of structured memory in enhancing the interpretability and consistency of role-playing agents.

75. 【2608.05169】ConWriter: Transition-Constrained Stateful Long-Form Story Generation with Lightweight Neuro-Symbolic Consistency Control

链接：https://arxiv.org/abs/2608.05169

作者：Jindong Li,Yang Yang,Zihao Liu,Yutao Yue,Menglin Yang

类目：Computation and Language (cs.CL)

关键词：existing prompting-based methods, generation requires models, extended contexts, accumulate temporal, requires models

备注：

点击查看摘要

Abstract:Long-form story generation requires models to preserve narrative consistency across extended contexts, yet existing prompting-based methods often accumulate temporal, factual, character, commonsense, and stylistic errors as the story grows. We propose ConWriter, a training-free framework for consistency-aware long story generation. ConWriter writes stories incrementally at the scene level, guided by static story requirements, dynamic narrative memory, symbolic state reasoning, and uncertainty-aware risk signals. Rather than treating long-story generation as a single free-form decoding process, ConWriter maintains evolving story states, checks whether new scenes satisfy required narrative transitions, and uses uncertainty-aware risk signals to prioritize validation and localized repair. This enables consistency control during generation, before local errors propagate into later scenes. We evaluate ConWriter on ConStory-Bench, covering four long-story tasks: continuation, generation, expansion, and completion. Due to the high cost of long-form generation and evaluation, we use the first five cases from each task and test 3k, 6k, and 12k target lengths across Qwen3.5-Plus, DeepSeek-V4-Flash, and GPT-5 series. Experiments follow the official ConStory-Bench evaluation protocol.

76. 【2608.05168】Woodpecker Distillation: Weak Models Diagnose Reasoning Bugs in Strong Models

链接：https://arxiv.org/abs/2608.05168

作者：Dayu Wang,Jiaye Yang,Weikang Li,Jiahui Liang,Yang Li,Deguo Xia,Jizhou Huang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large language models, Large language, tasks despite possessing, possessing the capability, capability to solve

备注：

点击查看摘要

Abstract:Large language models often fail on reasoning tasks despite possessing the capability to solve them. We argue that many such failures arise from localized reasoning bugs in intermediate steps rather than from global incompetence. We show that these bugs are frequently repairable: inserting a short patch generated by a weak probe model after the same strong-model reasoning prefix can redirect the trajectory toward a correct solution. However, this corrective effect is not reliably internalized by directly fine-tuning on weak patches or repaired trajectories, suggesting that the useful signal lies not in the intervention text itself, but in how it reshapes the model's future reasoning distribution. We therefore propose Woodpecker Distillation, a weak-to-strong training framework that learns from contrastive local interventions. Our method contrasts successful and unsuccessful weak-model patches at the same prefix, constructs a corrective teacher distribution from their induced future token predictions, and distills this signal into the strong model. Experiments on mathematical reasoning benchmarks show that Woodpecker Distillation consistently improves strong-model performance and outperforms direct imitation baselines.

Subjects:

Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

Cite as:
arXiv:2608.05168 [cs.AI]

(or
arXiv:2608.05168v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2608.05168

Focus to learn more

              arXiv-issued DOI via DataCite</p>

77. 【2608.05167】CNM-BERT: A Drop-In Structural Embedding for Chinese Characters via Ideographic Description Sequences

链接：https://arxiv.org/abs/2608.05167

作者：Thomas Sing-wing Wu,Liqian Yan

类目：Computation and Language (cs.CL)

关键词：BERT treat Chinese, treat Chinese characters, treat Chinese, Token-based encoders, Chinese characters

备注：

点击查看摘要

Abstract:Token-based encoders like BERT treat Chinese characters as atomic identifiers, ignoring their recursive orthographic structure. Consequently, models rely on contextual co-occurrence, degrading performance on rare and out-of-vocabulary (OOV) characters. We propose the Compositional Network Model (CNM), a lightweight augmentation that injects discrete compositional structure into Transformer encoders. CNM parses Ideographic Description Sequences (IDS) into trees, encodes them via a recursive Tree-MLP, and fuses the structural embeddings into BERT without modifying the backbone. Evaluated on the Wu et al. (2025) structural-probing benchmark, CNM-BERT outperforms the strongest baseline (ChineseBERT) on long-tail and OOV characters by +9.8 Structure accuracy and +7.7 Radical F1. Furthermore, CNM-BERT achieves consistent gains across CLUE, MRC, and NER tasks at both base and large scales, demonstrating that explicit structural injection delivers both robust OOV understanding and tangible downstream value.

78. 【2608.05166】Conditional Cognitive Biases in LLMs: How Biased User Turns Modulate In-Context Reasoning

链接：https://arxiv.org/abs/2608.05166

作者：Sachini Weerasekara,Sagar Kamarthi,Jacqueline Isaacs

类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)

关键词：multi-turn interaction settings, realistic multi-turn interaction, present an evaluation, realistic multi-turn, interaction settings

备注：

点击查看摘要

Abstract:We present an evaluation of cognitive bias expression in state-of-the-art instruction-tuned LLMs under realistic multi-turn interaction settings. Our work introduces a novel three-condition experimental framework that disentangles the effect of exposure to a biased user turn from the effect of the turn's semantic content, alongside a benchmark of 24,300 jury-validated user prompts spanning all 81 cells of a 9x9 target-human bias interaction matrix. Across eight frontier LLMs, we find that biased conversational context systematically increases bias expression relative to zero-shot baselines in 6 of 8 models. We identify two competing behavioral dynamics underlying this effect: conversational exposure to biased reasoning generally amplifies downstream bias tendencies, while explicitly stated bias cues often trigger alignment-related suppression behaviors that reduce overt bias expression. We release our framework, codebase, and dataset to support future research on context-conditioned cognitive biases and behavioral adaptation in LLMs.

79. 【2608.05165】A Study of ASR Adaptation and Representation Dimensionality Reduction in Persian Speech Emotion Recognition Using Whisper

链接：https://arxiv.org/abs/2608.05165

作者：Ali Shendabadi,Parnia Izadirad,Mostafa Salehi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)

关键词：challenging problem due, limited labeled data, labeled data, remains a challenging, challenging problem

备注： 6 pages

点击查看摘要

Abstract:Speech Emotion Recognition (SER) in low-resource languages remains a challenging problem due to limited labeled data. In this work, we study the use of Whisper for Persian SER with a particular focus on representation dimensionality reduction and language-specific model adaptation. We propose a SER framework in which frame-level embeddings extracted from the Whisper encoder are reduced in dimensionality using PCA, eliminating the need for learned projection layers and substantially reducing the number of trainable parameters. The reduced representations are aggregated using an attention-based pooling mechanism and classified with a lightweight prediction head. In addition, we investigate whether fine-tuning Whisper on a Persian automatic speech recognition (ASR) task improves downstream SER performance. Experiments conducted on the ShEMO dataset under a speaker-independent evaluation protocol show that PCA-based dimensionality reduction consistently improves emotion recognition performance while reducing training latency and memory usage. ASR fine-tuning yields only modest gains for SER, suggesting limited transfer from language adaptation to emotion-related representations under the evaluated conditions. These findings provide practical insights into the efficient use of large pretrained speech models for emotion recognition in low-resource languages.

80. 【2608.05164】Cross-Architecture Steering Transfer in Language Models: A Systematic Empirical Study

链接：https://arxiv.org/abs/2608.05164

作者：Ayushi Agarwal

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：trained large language, develop shared internal, Independently trained large, Independently trained, control remains untested

备注：

点击查看摘要

Abstract:Independently trained large language models may develop shared internal representations of semantic concepts despite architectural differences -- but whether this geometric similarity has functional consequences for cross-model behavioural control remains untested. We present the first systematic evaluation of cross-model steering transfer and show that shared LLM geometry is functionally exploitable, conditionally: concept directions from one model can steer a different independently trained model when sufficient representational capacity exists. We study five open-weight models spanning three parameter scales (0.8B--8B) and two architectural lineages, training one Sparse Autoencoder per model across 15 semantic domains and testing alignment across all 20 directed model pairs. We observe a suggestive discontinuity near 1.7B parameters: at = 1.7B scale, 47--49% of cross-model feature pairs validate (Pearson r = 0.60, Procrustes cosines 0.895--0.956), while alignment degrades sharply below 0.8B. Cross-model steering vectors (B3-TI) achieve a 71.0% win rate across 15 supervised concepts versus 68.0% for same-model native vectors; a single universal vector achieves 67.3% in 4 of 5 models without any per-model supervision. Transfer degrades for models below 1.7B and for one model with generation instability, confirming that functional exploitability requires sufficient representational capacity. Our findings underscore the importance of scale thresholds in mechanistic interpretability: tools validated at 7B scale may not transfer to smaller models without revalidation. We provide the first functional complement to the Platonic Representation Hypothesis -- geometric convergence across independently trained LLMs supports cross-model behavioural control without fine-tuning, under the identified scale conditions.

81. 【2608.05163】Where Privacy Risk Lives in English-Source Multilingual RAG: A Stage-Decomposed Audit Across Five Query Languages

链接：https://arxiv.org/abs/2608.05163

作者：Yanhang Li,Zhichao Fan,Zexin Zhuang

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：multilingual RAG system, RAG system easier, common assumption holds, non-English language makes, multilingual RAG

备注：

点击查看摘要

Abstract:A common assumption holds that switching to a non-English language makes a multilingual RAG system easier to attack for personal information. We test this on an English-source synthetic-PII corpus with five query languages and a two-stage defence (LLM input judge + regex output filter), in a pipeline whose translator, judge, back-translator, and generator are all Qwen2.5-7B -- so every finding below is pipeline-conditional, not a causal ranking of language-inherent risk. Under output-only filtering, English has the highest observed unstructured-PII leak rate; only English-vs-Swahili separates cleanly under document-level bootstrap intervals. Once the input judge is added, residual leaks remain on Arabic and Swahili, and back-translating the query does not close the gap (an ablation we report but cannot use as a causal diagnostic, since the back-translator is also Qwen). On a separate n=17 multilingual-prompted-judge residual corner, attaching the gold corpus document to the input judge blocks 15/17 residual cells. We frame this last result as a mechanism diagnostic, not a deployable defence: it uses oracle retrieval, BLOCK/ALLOW rates are measured on adversarial queries only, and we measure no benign-query false-positive rate and no answer-utility cost. The supplementary material contains code, corpora, queries, and per-trial JSONLs; the priority follow-up is an independent-MT plus non-Qwen-judge replication with a native-speaker query set, scoped in the Limitations section.

82. 【2608.05162】PoolBench: A Benchmark for Pooling Strategies in Concept Representation Evaluation for Decoder-Only LLMs

链接：https://arxiv.org/abs/2608.05162

作者：Ayushi Agarwal

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：collapse token-level hidden, token-level hidden states, shared protocol exists, concept representation work, under-examined design choice

备注：

点击查看摘要

Abstract:Pooling is a consequential but under-examined design choice in decoder-only concept representation work: practitioners must collapse token-level hidden states into a passage-level vector, yet no shared protocol exists for comparing this choice across concepts, models, and tasks. Reported gains are confounded by simultaneous changes in dataset, layer, construction method, and pooling rule, making principled decisions impossible. We introduce PoolBench, a benchmark that isolates pooling as the experimental variable under a fixed evaluation protocol. PoolBench covers 17 concepts, 19 pooling strategies, and 3 open-weight decoder-only models (Llama-3.1-8B, Gemma-2-9B, Mistral-7B), evaluated on a single audited corpus of 37,693 real-text passages. The primary axis is linear separability (D1/AUROC); steered concept prevalence (D2/SCP) and output-level disentanglement (D3) serve as diagnostic axes. The primary finding is decisive: W4_hierarchical reaches a cross-model mean AUROC of 0.7799, while the widely adopted P1_last_token baseline reaches only 0.7640 and is statistically significantly worse (Friedman+Nemenyi, p = 2.0e-36; 77 significant pairs among 18 effective strategies). Rankings are stable across layers (rho = 0.961--0.990). A key negative result: strong detection does not imply strong steering -- D2 and D3 are substantially weaker than D1 for most concepts, indicating a fundamental representational limit rather than a pooling failure. On mid-difficulty concepts, W4_hierarchical outperforms P1_last_token by 0.042--0.113 AUROC; construction method choice (DiffMean vs. REPE) has a larger effect (delta AUROC 0.15) than pooling (delta AUROC 0.016), establishing the correct practical hierarchy. We release the corpus, pre-extracted activations, scorer models, steering vectors, and evaluation code as a reusable protocol for pooling research.

83. 【2608.05161】SemiAdapt-Instruct: Extensible Instruction Tuning via Latent Domain-Specialised Adapters

链接：https://arxiv.org/abs/2608.05161

作者：Josh McGiff,Salma Mekaoui,Robert Shanahan,Nikola S. Nikolov

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：unsolved practical challenge, Instruction-tuned LLMs, fine-tuned model capabilities, practical challenge, LLMs are deployed

备注：

点击查看摘要

Abstract:Instruction-tuned LLMs are deployed into environments where domains evolve, yet extending a fine-tuned model's capabilities without full retraining remains an unsolved practical challenge. We present SemiAdapt-Instruct, a modular framework that discovers latent instruction domains, trains per-domain LoRA adapters in parallel, and performs parameter-free routing, incorporating new domains via single-adapter training without modifying existing components. SemiAdapt-Instruct outperforms full model fine-tuning across all configurations on both ROUGE-L and LLM-as-a-judge evaluation, while matching single LoRA fine-tuning and delivering extensibility that monolithic approaches cannot provide. We empirically demonstrate this extensibility by showing that updating a single adapter with new domain data outperforms all monolithic baselines. Our study also finds that independent discovery methods converge on the same specialisation-friendly domains. These findings demonstrate that decomposing heterogeneous instruction data into latent domains enables extensible NLP systems where evolving domains require only targeted single-adapter updates, eliminating the need for full model retraining.

84. 【2608.05160】he Ignition Index: Measuring Global Workspace Dynamics in Language Models

链接：https://arxiv.org/abs/2608.05160

作者：Saman Rahbar

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Global Workspace Theory, Workspace Theory, operationalizes Global Workspace, Global Workspace, validated scalar metric

备注： 26 pages, 10 figures. Code: [this https URL](https://github.com/saman-rahbar/ignition-index)

点击查看摘要

Abstract:We introduce the Ignition Index (I), a validated scalar metric that operationalizes Global Workspace Theory's (GWT) all-or-none ignition prediction in transformer language models. The metric fits a four-parameter sigmoid to per-layer linear probe accuracy as a function of input signal strength, extracting steepness parameter beta-hat: high values indicate abrupt, ignition-like transitions; low values indicate graded build-up. Across 11 models spanning five architecture families, shuffled-label controls demonstrate 9.6-fold selectivity for genuine linguistic structure over spurious probe capacity (p 0.001, Mann-Whitney U-test). We find: (1) Feedforward transformers exceed SSMs by 89% in aggregate beta-hat (p 1e-13, Cohen's d = 0.52), with Mamba exhibiting near-linear profiles consistent with absent global broadcast. (2) Huginn-3.5B exhibits 2.12-fold higher ignition along its iteration axis than its depth axis, demonstrating that recurrent architectures manifest workspace-like transitions along the recurrence dimension. (3) Pythia-410M shows a PELT-detected phase transition at training step 256 (+67%), preceding induction-head formation. (4) Hypotheses linking ignition to model scale and signal strength were not confirmed, suggesting transformer architectures may saturate available ignition mechanisms. The Ignition Index provides the first validated quantitative bridge between GWT's dynamical predictions and mechanistic interpretability, with 9.6-fold measurement selectivity and architecture-level discriminability not previously characterized in the scaling literature. Code: this https URL

85. 【2608.05159】Agentic Nesting: A New Methodology for Existing Enterprise Application Integration and Services

链接：https://arxiv.org/abs/2608.05159

作者：Xi Wang,Kun Li,Xianyao Ling,Gang Yin,Liang Zhang,Jiang Wu,Wenbo Lei,Jun Xu,Annie Wang,Fu Zhang,Weizhe Wang

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：operations extensively rely, severe data silos, Enterprise operations extensively, Enterprise Service Bus, Robotic Process Automation

备注：

点击查看摘要

Abstract:Enterprise operations extensively rely on multiple heterogeneous business systems and information applications, which also result in severe data silos and process fragmentation. Enterprises have invested considerable financial and material resources in building these applications, however, effectively leveraging and orchestrating them remains a formidable challenge. Conventional approaches to enterprise application integration, encompassing middleware architectures such as Enterprise Service Bus (ESB), API gateway infrastructures, and Robotic Process Automation (RPA), suffer from inherent limitations like high architectural coupling, escalating operation and maintenance costs, and limited intelligence capabilities. This paper proposes Agentic Nesting, a multi-agent collaboration framework in which existing enterprise applications are encapsulated as autonomous AI agents within a hierarchically nested structure. Rather than flat interconnection, agents are organized into layered stewardship topologies that mirror the compositional complexity of enterprise ecosystems. The framework extracts a digital agent proxy from each legacy application to enable natural-language interaction and autonomous manipulation, coordinates multiple agents through a central orchestrator for task decomposition and dynamic dispatching, and exposes a unified conversational interface for cross-application querying and process orchestration. The main contributions of this paper are the proposition of the "Application-as-Agent" integration paradigm and the "Conversation-as-Integration" interaction philosophy, together with an exploration of the generalization potential of this methodology in scenarios encompassing heterogeneous system coordination, and large-scale data applications.

86. 【2608.05158】Safe Evolution with Circuit Anchors

链接：https://arxiv.org/abs/2608.05158

作者：Yan Liu,Jie Fu,Tsung-Yi Ho

类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)

关键词：evolve enhanced capabilities, losing essential functions, unconstrained mutation, catastrophic outcomes, functions for survival

备注：

点击查看摘要

Abstract:In biological evolution, unconstrained mutation can lead to catastrophic outcomes: organisms may evolve enhanced capabilities while losing essential functions for survival. Nature's solution is \textit{developmental constraints}, where core regulatory genes remain anchored while peripheral genes adapt freely. We observe that current self-evolution algorithms for large language models lack analogous constraints. They optimize purely for capability, implicitly assuming safety will be preserved. Our experiments reveal this assumption to be dangerously wrong: models can \textit{misevolve} into powerful yet dangerous entities. Inspired by how Hox genes anchor body structure across $500$ million years of evolution, we propose \textbf{Circuit-Anchored Evolution (CAE)}. Using mechanistic interpretability, we identify a tiny \textit{safety circuit}, comprising less than $2$\% of model features, that causally mediates safety behaviors. We anchor this circuit during evolution, constraining it within a small displacement bound while allowing the remaining features to evolve freely. This mirrors the biological principle of \textit{evolvability with constraint}: preserving what is essential while adapting what is peripheral. Experiments across $3$ model families and two evolution algorithms demonstrate that CAE achieves superior safety preservation with minimal capability loss, substantially outperforming explicit reward-based constraints in both effectiveness and efficiency. Just as developmental constraints prevent biological evolution from producing nonviable organisms, circuit anchoring prevents model evolution from producing capable but dangerous systems.

87. 【2608.05157】Large Language Models Threaten Double-blind Review

链接：https://arxiv.org/abs/2608.05157

作者：Bulambo Mwendelwa Gloire,Prasenjit Mitra

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：community primary defense, scientific community primary, peer review serves, affiliation bias, community primary

备注：

点击查看摘要

Abstract:Double blind peer review serves as the scientific community primary defense against status and affiliation bias. Its effectiveness rests on the assumption that anonymized manuscripts convey scientific merit without revealing their authors. While authorship can often be recovered using citation networks or stylistic markers, we show that this assumption is increasingly fragile in the presence of large language models (LLMs). Using only titles and abstracts from papers published after model training, we find that LLMs collapse anonymity more efficiently than humans, with belief concentrating onto a small subset of plausible authors drawn from pools of five domain expert candidates. This vulnerability persists even when stylistic and bibliographic cues are excluded, indicating that stable patterns in problem framing and research focus function as latent conceptual signatures of authorship. Together, these findings indicate that double blind review is vulnerable to automated semantic inference, necessitating a revaluation of how anonymity and fairness are maintained in an AI augmented research ecosystem.

88. 【2608.05156】Scaffold-Mediated Post-Training: Co-Evolving Model Parameters and Procedural Scaffold Graphs

链接：https://arxiv.org/abs/2608.05156

作者：Fei Ding,Yongkang Zhang,Runhao Liu,Yuhao Liao,Zijian Zeng,Huiming Yang

类目：Computation and Language (cs.CL)

关键词：typically designed independently, language models optimizes, large language models, large language, typically designed

备注：

点击查看摘要

Abstract:Post-training of large language models optimizes only parameters, while inference-time procedural scaffolds are typically designed independently of parameter training. This disconnect makes it difficult to automatically acquire and internalize complex strategies. We propose scaffold-mediated post-training: procedural scaffolds are organized into an evolvable graph structure that co-evolves with model parameters through discovery, distillation, and dynamic recompilation. We instantiate this paradigm as Skill Training. On FeatureBench, automatically discovered skills improve the passed rate by 8.1pp, and after progressive distillation the model still achieves a 27.7% passed rate without any external scaffold (distillation retention rate 85.2%, defined as post-distillation / with-skill passed rate), significantly outperforming standard SFT on the same data.

89. 【2608.05155】Beyond Sentiment: Comparing Traditional NLP and LLM-Based Multi-Dimensional Analysis for Political News Evaluation

链接：https://arxiv.org/abs/2608.05155

作者：Maryam Fooladi,Federico Bottino

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：provide limited insight, polarity classification, provide limited, sciences and humanities, effective for polarity

备注： Accepted at PoliticalNLP 2026, the 3rd Workshop on Natural Language Processing for Political Sciences, co-located with LREC 2026. 10 pages, 3 figures

点击查看摘要

Abstract:Traditional sentiment analysis (SA) models, while effective for polarity classification, provide limited insight into the rhetorical, ideological, and framing dimensions of political discourse -- dimensions that are central to research in the social sciences and humanities (SSH). In this paper, we present a comparative study of RoBERTa-based sentiment analysis and an LLM-based multi-dimensional framing analysis platform applied to a corpus of 50 political news articles from 17 international media outlets. The results reveal a critical limitation we term neutral collapse: RoBERTa classifies 70% of articles as neutral, effectively flattening substantively rich political content into an analytically uninformative category. We find that 23% of neutral-classified articles exhibit negative probability scores above 0.30. By contrast, the LLM-based approach captures political bias direction and intensity, sensationalism, emotional appeal, and political framing -- yielding multi-dimensional analytical outputs aligned with SSH epistemologies. We argue that for political media analysis, traditional SA alone is insufficient, and that LLM-based multi-dimensional frameworks offer a more epistemologically adequate computational lens for SSH research needs.

90. 【2608.05154】RIG-RoPE: Relation- and Instance-Gated Rotary Positional Encoding with Duration-Aware Temporal Coordinates

链接：https://arxiv.org/abs/2608.05154

作者：Donggen Li

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Rotary positional encoding, split positional channels, Rotary positional, modern language models, positional encoding

备注： Preliminary technical report. 15 pages, 1 table

点击查看摘要

Abstract:Rotary positional encoding (RoPE) is a core component of modern language models and has been extended to multimodal LLMs through multidimensional variants such as multimodal RoPE (M-RoPE), which split positional channels into temporal, height, and width subspaces. This report identifies two limitations of static multidimensional position assignment in interleaved multimodal contexts. First, height/width rotations may be applied to token pairs whose spatial displacement is not a well-defined geometric object, producing cross-modal and inter-instance spatial interference. Second, temporal coordinates are often treated as equal-step counters, so a text token, an image block, and a video segment can advance the temporal phase by comparable amounts despite different information density. We propose RIG-RoPE, a relation- and instance-gated RoPE mechanism with duration-aware temporal coordinates. RIG-RoPE augments each token with a modality indicator, a visual instance identifier, and a scalar information-duration coordinate. It enables H/W rotations only for query-key pairs from the same visual instance; otherwise the unknown spatial displacement is marginalized rather than set to zero. Temporal rotations use interpolated cumulative block durations: text tokens consume unit duration, images use a dimension-aware logarithmic spatial scale, and videos further apply a logarithmic temporal extension over effective frames. We provide a gauge-invariance argument for avoiding ordinary cross-instance spatial rotation, an impossibility result for static IDs under shared H/W subspaces, and a duration-consistency argument against equal-step multimodal time. RIG-RoPE adds no learned parameters and can be implemented inside tiled attention kernels with constant additional metadata per token. This preliminary report establishes the formulation and validation path without claiming empirical superiority.

Comments:
Preliminary technical report. 15 pages, 1 table

Subjects:

Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.05154 [cs.CL]

(or
arXiv:2608.05154v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.05154

Focus to learn more

              arXiv-issued DOI via DataCite</p>

91. 【2608.05153】Universal Pathologies, Conditional Consequences: A Triple-Robustness Analysis of RAG for Multi-Hop Traceability

链接：https://arxiv.org/abs/2608.05153

作者：Meftun Akarsu,Burak Ozdemir

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：underperforms vector RAG, GraphRAG underperforms vector, remained corpus-bound, underperforms vector, citation precision

备注： 5 pages, 3 figures, 4 tables

点击查看摘要

Abstract:GraphRAG underperforms vector RAG on citation precision in many reports, but where and why have remained corpus-bound. We present a triple-robustness analysis that holds the retrieval architecture fixed and varies three orthogonal axes embedder (local e5-small - Azure text-embedding-3-small), corpus (DO-178C typed-edge requirements - Wikipedia paragraph chains via MuSiQue), and judge (paired GPT-5.4 x GPT-4.1) across 4,440 main-matrix runs, 600 cross-corpus runs, and 1,200 paired faithfulness judgments. (C2a) Over-citation is architecturally universal: GraphRAG emits 11-15 IDs per answer at citation precision 0.12-0.23 and retrieval recall 0.68-0.87 across all three settings. (C2b) Its faithfulness consequence is corpus-conditional: in typed-edge DO-178C, GraphRAG faithfulness collapses 74%-40% across hops; on Wikipedia chains the same pipeline rises 42%-58% because over-cited paragraphs remain topically supporting. (C1) Stratum-conditional winners are corpus-conditional but embedder-robust: vanilla wins 2-hop on DO-178C, GraphRAG wins 2-hop on MuSiQue, identical under either embedder. (C3) Single-judge LLM faithfulness is fragile to retrieval state: same-judge self-kappa across embedders is 0.137 for GPT-5.4 (verdict change on 41% of items). A learned router on dense embeddings alone reaches macro-F1 0.86 on hop classification (C4). We argue triple-robustness is the minimum bar for trustworthy RAG architecture claims.

92. 【2608.05152】Mean-Field Dynamics of Chain-of-Thought Reasoning in Large Language Models

链接：https://arxiv.org/abs/2608.05152

作者：Hao Ai

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Large language models, guide model optimization, Large language, recent years, widely applied

备注：

点击查看摘要

Abstract:Large language models (LLMs) with chain-of-thought reasoning have been widely applied in recent years, and theoretical explanations of their behavior may help deepen our understanding and guide model optimization. In this study, we introduce a framework that seeks statistical regularities and theoretical interpretations in LLM reasoning without simplifying the model architecture or making analogies to existing physical systems. We formulate LLM reasoning as a guided discovery process on a clue graph, and derive a one-dimensional ordinary differential equation for the fraction of discovered clues using the mean-field approximation. Experimentally, clue tokens are identified using the normalized surprisal of a student LLM on the outputs of a teacher LLM, and statistical regularities are obtained by averaging over many reasoning chains of thought. Our experiments show that the resulting statistical regularities are reproducible within the same dataset and can be fitted by the solving the proposed theoretical equation.

93. 【2608.05151】Simulator-Grounded Large Language Models for Industrial Causal Reasoning: Tool-Use, Structured Injection, and Plant-Portable Retrieval for Wastewater Treatment Decision Support

链接：https://arxiv.org/abs/2608.05151

作者：Gary Simethy,Daniel Ortiz Arroyo,Petar Durdevic

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：fast effects propagate, generic pretraining text, plant variables interact, effects propagate, pretraining text

备注： 20 pages, 2 figures, 8 tables. Preprint submitted to Elsevier

点击查看摘要

Abstract:Wastewater operators need answers grounded in how their plant's variables interact and how fast effects propagate, not in generic pretraining text, when asking causal questions such as "why is N2O rising?" or "what happens if I cut aeration by 20%?". We compare three concrete ways to ground a frozen Qwen2.5-32B-Instruct model in an architecturally interpretable wastewater simulator (CCSS-IX): a live simulator oracle (Method 1), structured parameter injection (Method 2), and a Decoupled Recall-Reasoning (DRR) retriever (Method 3). On a 198-question causal benchmark the three reach 99.5%, 79%, and 75.8%, forming a deployment ladder above the strongest retrieval-augmented baseline at 48%. The DRR retriever has 110M parameters and trains per plant in ~17 seconds; after cross-plant transfer to a biologically distinct plant it still reaches 88%, while Method 2's static table cannot transfer. On a 60-question counterfactual benchmark only Method 3 handles queries about what happens after an intervention: +16.3 pp over Method 2, paired 95% CI [+7.1, +26.4] pp, with 100% on the timescale and operating-regime categories. On the AI2 Reasoning Challenge (ARC) with an OpenBookQA fact corpus, the same selective-retrieval mechanism reaches 79% versus unconstrained Llama-3.1-8B 76% and full-injection 74%, a +3 pp out-of-domain replication that argues against a result specific to wastewater treatment. We provide the first single-simulator comparison of live tool-use, static parameter injection, and learned numerical-parameter retrieval for industrial causal question answering.

94. 【2503.17181】A Study of LLMs' Preferences for Libraries and Programming Languages

链接：https://arxiv.org/abs/2503.17181

作者：Lukas Twist,Mark Harman,Don Syme,Joost Noppen,Helen Yannakoudakis,Detlef Nauck,Jie M. Zhang

类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：make critical design, existing evaluations focus, large language models, LLMs make critical, critical design choices

备注： 21 pages, 10 tables, 3 figures. Accepted to Findings of ACL 2026

点击查看摘要

Abstract:Despite the rapid progress of large language models (LLMs) in code generation, existing evaluations focus on functional correctness or syntactic validity, overlooking how LLMs make critical design choices such as which library or programming language to use. To fill this gap, we perform the first empirical study of LLMs' preferences for libraries and programming languages when generating code, covering eight diverse LLMs. We observe a strong tendency to overuse widely adopted libraries such as NumPy; in up to 45% of cases, this usage is not required and deviates from the ground-truth solutions. The LLMs we study also show a significant preference toward Python as their default language. For high-performance project initialisation tasks where Python is not the optimal language, it remains the dominant choice in 58% of cases, and Rust is not used once. These results highlight how LLMs prioritise familiarity and popularity over suitability and task-specific optimality; underscoring the need for targeted fine-tuning, data diversification, and evaluation benchmarks that explicitly measure language and library selection fidelity.

信息检索

1. 【2608.06305】Beyond Top-K: Replacing Black-Box Retrieval with Interpretable Agentic Operations

链接：https://arxiv.org/abs/2608.06305

作者：Sagar Tamang,Ayush Vyas,Tabarakul Hazarika

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)

关键词：Retrieval-augmented generation, top-k nearest neighbours, generation over long, nearest neighbours, Model Context Protocol

备注：

点击查看摘要

Abstract:Retrieval-augmented generation over long documents is dominated by one design: chunk the text, embed the chunks, and surface the top-k nearest neighbours of the query. We argue that for an important class of documents -- financial statements, audit reports, regulatory returns -- this design is structurally unsound, and we make the argument measurable. On a 780-page government financial report, 86.8% of content lines are table rows, thousands of near-identical figures compete in one embedding space, and a figure inherits its unit from a header a median of 13 lines above it -- so a chunk boundary routinely separates a number from whether it is in lakh or crore, an error of two orders of magnitude. A table-aware chunker built as a steelman fixes the unit problem but leaves 27-30% of numeric chunks with no fiscal-year header at every chunk size we tried. We propose READ (Reliable Embedding-free Agentic Document-search), in which an agent reads the raw document through three deterministic operations -- normalized lexical search, structural navigation, and bounded span reads -- exposed over the Model Context Protocol, so a trajectory is a replayable audit trail, not an opaque similarity score. On 51 verified questions READ answers 58.8% against dense retrieval's 15.7% (p_Holm = 2 x 10^-5) -- or 35.3% tuned, which READ still leads by 23.5 points (p_Holm = 0.017). An agent given the same loop but a top-k tool reaches only 27.5%, locating the gain in the interface rather than in iteration. We also report what the evidence does not support: BM25 is statistically indistinguishable from READ, so our result separates embedding-based from embedding-free retrieval, not agentic from lexical search.

2. 【2608.06213】Gryphon-v2: One Model in Place of a Cascade - Generate-and-Rank Recommender with Rollout Distillation

链接：https://arxiv.org/abs/2608.06213

作者：Anna Lipkina,Daria Tikhonovich,Viktor Yanush,Mariia Ulianova,Oleg Sorokin,Vladislav Dodonov,Ilya Murzin,Denis Burshtein,Nikolay Savushkin

类目：Information Retrieval (cs.IR)

关键词：Industrial recommender systems, Industrial recommender, Ranking Module, ranking, commonly deployed

备注：

点击查看摘要

Abstract:Industrial recommender systems are commonly deployed as multi-stage cascades with separate candidate generators, pre-rankers, and final rankers. Although effective, these cascades require repeated user-history processing, complex feature pipelines, and multiple serving stages. Semantic-ID-based generative retrieval offers a path toward simpler end-to-end systems, but next-item prediction alone does not capture the fine-grained preferences encoded by production ranking objectives. We present Gryphon-v2, a unified generate-and-rank architecture for end-to-end recommendation. The model encodes a user history once, generates Semantic-ID candidates with an autoregressive decoder, resolves them to catalogue items, and ranks them with an item-level Ranking Module that reuses the shared encoder states. To transfer fine-grained production ranking preferences without adding an expensive second model to the serving path, we distill a high-capacity, training-only Teacher Ranker into the Ranking Module. Gryphon-v2 is trained with Rollout Distillation: teacher scores are the only ranking supervision, and they are collected over two complementary candidate distributions. Rollouts from the current decoder expose the Ranking Module to candidates produced by the same generation mechanism used at serving time, while logged impressions cover items users were actually shown. In an online A/B experiment on a large-scale recommendation surface at Yandex Music, a single Gryphon-v2 model replaces a production cascade comprising more than 15 candidate generators, pre-ranking, and final ranking. The deployment increases the number of active users by 1.41% at serving latency comparable to the production cascade. These results support the practical viability of a generative retriever with a Ranking Module distilled from the Teacher Ranker as an end-to-end alternative to a production cascade.

3. 【2608.06091】"I don't know anything about laptops!" - User Perception of Digital Product Advisors Adapting to Their Knowledge Levels

链接：https://arxiv.org/abs/2608.06091

作者：Kevin Schott,Andrea Papenmeier,Daniel Hienert,Dagmar Kern

类目：Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

关键词：Conversational commerce, decision-making in e-commerce, commerce uses digital, process and decision-making, digital assistants

备注：

点击查看摘要

Abstract:Conversational commerce uses digital assistants to support the search process and decision-making in e-commerce. Effective communication in these interactions can be facilitated by assistants adapting their communication style to users and supporting shared understanding. An open challenge in this context is adapting the presentation of complex product information to users with varying levels of domain knowledge. To investigate strategies for such knowledge-level adaptation, we set up a chatbot-assisted laptop search scenario. In a between-subjects experiment (n = 251), we examined novice and expert perceptions of product attribute recommendations presented as technical information only (T), or augmented with performance categories (TC), attribute explanations (TE), or both (TCE). For novices, approaches with explanations (TE, TCE) were perceived as more helpful and led to higher perceived learning than those without. Novices also rated the combined approach (TCE) more appropriate than the baseline (T) and TC in terms of information quantity, indicating that explanations are crucial to understand and benefit from performance categories. Critically, experts showed no significant differences across conditions, suggesting that providing supplementary information beneficial to novices did not detract from their experience. We distill these findings into four concrete design guidelines for inclusive text-based product advisors in technical domains: use TCE by default; keep a single inclusive interface; avoid standalone categories; and support user agency and personalize to the stated use case.

4. 【2608.06068】Cleo: A Transparent and Controllable Chatbot for Conversational Commerce

链接：https://arxiv.org/abs/2608.06068

作者：Kevin Schott,Jan Lattenkamp,Daniel Hienert,Dagmar Kern

类目：Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)

关键词：demonstrate Cleo, challenges of opacity, advisor that addresses, addresses the challenges, Cleo

备注：

点击查看摘要

Abstract:We demonstrate Cleo, a transparent and controllable conversational product advisor that addresses the challenges of opacity, unpredictability of LLMs, and the complexity of comparisons in conversational commerce. With our chatbot system, we make four contributions: First, we introduce transparency by prompting the LLM to reflect on interpreted user needs, while an auditable ranking mechanism reveals loss values per attribute, explaining ranking decisions. Second, we propose controllability through a hybrid architecture separating deterministic ranking from language generation. A ranker applies categorical filters and numeric loss functions over 3,638 product specifications. Meanwhile, a constrained LLM generates grounded descriptions constrained to catalog evidence, thus mitigating the risk of hallucinated or persuasive content. Third, we provide decision support in the form of natural-language comparisons and a highlights feature. These aim to reduce mental workload by contextualizing specifications relative to user needs. Fourth, we contribute an extensible experimental system for IR and HCI researchers, as well as practitioners of conversational search and recommendation. Unlike traditional faceted search or opaque LLM-only recommenders, our approach allows for fluid conversation while maintaining algorithmic transparency. In a live demonstration, attendees will experience information needs elicitation and reflection, conversational refinement with real-time re-ranking, inspection of per-attribute loss explanations, and AI-generated multi-item comparisons. The system aims to advance the design of transparent and controllable conversational systems that provide support for decision-making during online product search.

5. 【2608.05655】Is Personalized Modality Weighting Actually Personalized? A Controlled Audit of Per-User Weighting Claims in Multimodal Recommenders

链接：https://arxiv.org/abs/2608.05655

作者：Jingyuan Zheng,Xin Zhang,Yang Gu,Dongjing Wang,Yuxiang Wang,Xudong Shen,Haiping Zhang,Youhuizi Li,Dongjin Yu

类目：Information Retrieval (cs.IR)

关键词：user modality-strength vectors, low-rank guided weights, user-specific modality preference, Per-user modality weighting, global modality weight

备注：

点击查看摘要

Abstract:Per-user modality weighting is deployed at billion-user scale in multimodal recommenders, through user modality-strength vectors, attention gates, meta-weight hypernetworks, and low-rank guided weights, each claiming a ranking gain from user-specific modality preference. Yet, to our knowledge, prior evaluations do not isolate a genuinely user-specific signal from a global modality weight plus model capacity. We audit this family with a two-contrast audit principle, reducing six implementations onto one shared collaborative backbone and measuring a utility gap (real-GM) against a single global modality weight and an identifiability gap (real-shuf) against an eval-time permutation of the user-weight binding. Across three independent short-video corpora, a single global weight already delivers nearly all of the content gain (+1.9/+3.6/+3.5pp over a no-modality baseline, p .001). Making the weight per-user adds no consistent utility: no implementation wins on all corpora and metrics, and the few positive gaps are small (=0.9pp) and flip. The shuffle control is necessary but not sufficient, since real-shuf reaches +128% of the content gain for heads that simultaneously lose to the global weight. We trace this dissociation to gates reading the shared collaborative embedding: decoupling the gate input collapses the inflated real-shuf to near zero while the utility conclusion stands. A monotone signal-implant dose-response (capture AUROC rising from 0.57 to 0.89 and from 0.64 to 1.00) verifies the harness would detect user-specific structure if present, and every finding replicates on a fourth, cross-domain e-commerce corpus. We propose reporting real-GM alongside real-shuf as a minimum evidentiary standard for personalization claims.

6. 【2608.05571】Align-RAG: Alignment Is All You Need for TSFM In-Context Learning

链接：https://arxiv.org/abs/2608.05571

作者：Mohammad Asadi,Soheil Hor,Bardiya Akhbari,Jack W. O'Sullivan,Tahoura Nedaee,Layne C. Price,Raviteja Anantha,Euan Ashley,Ehsan Adeli

类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)

关键词：Series Foundation Models, Time Series Foundation, frozen Time Series, Foundation Models, Time Series

备注：

点击查看摘要

Abstract:Retrieval-augmented forecasting promises to adapt frozen Time Series Foundation Models (TSFMs) to new domains without fine-tuning, but recent methods typically rely on learned fusion modules, i.e., trained adapters that merge retrieved examples into the backbone's forecast, based on the assumption that frozen backbones cannot dynamically incorporate retrieved context on their own. We show this assumption is unnecessary. We introduce Align-RAG, a training-free method that applies a closed-form per-pair amplitude rescaling and integer-lag phase shift to retrieved past-future windows before they enter a frozen backbone's context. With no learned parameters, Align-RAG outperforms the state-of-the-art trained retrieval adapter on a frozen Chronos-Bolt on all seven datasets of the standard benchmark (avg -3.75% MSE), showing that the gains previously attributed to learned fusion are recoverable without any training. Align-RAG further improves zero-shot MSE on four additional frozen TSFMs with various architectures by 2.5% to 13.7% per backbone with no per-backbone tuning. To probe why alignment helps, we compare the frozen backbone's prediction shift under aligned demonstrations to the closed-form ridge prediction shift on the same pairs. We find that aligned demonstrations induce prediction shifts that track a closed-form ridge predictor on the same pairs, with a future-shuffle control ruling out a futures-averaging account. Together, these results indicate that frozen TSFMs already support dynamic in-context use of retrievals, and that closed-form alignment should be the default baseline for retrieval-augmented forecasting before any fusion module is trained. Code available at: this https URL

7. 【2608.05543】omni-macos: On-Device Omni-Modal Search on Apple Silicon

链接：https://arxiv.org/abs/2608.05543

作者：Han Xiao

类目：Information Retrieval (cs.IR)

关键词：embeds text, audio and video, assumes a server, representation space, component built

备注： 16 pages, 5 figures, 8 tables

点击查看摘要

Abstract:A search engine that embeds text, code, documents, images, audio and video into the same representation space has to run its encoder and keep its index somewhere, and almost every component built for the purpose assumes a server. We present omni-macos, which runs that whole engine, encoder, index and store, on the Mac the files are already on, so no file, query or vector ever leaves the machine. It keeps a background indexer and an interactive search box inside one memory budget the user sets: it re-encodes only the chunks an edit changes, hands the GPU smaller units while the user is typing, answers queries from a quantized replica with exact rescoring, and propagates that budget to the allocators that draw on unified memory. We measure every mechanism on five Macs spanning an eightfold range of accelerator width and a thirty-twofold range of memory, each one indexing its own local files.

8. 【2608.05497】EXCISE: Query-Side Exclusion for Late-Interaction Retrieval

链接：https://arxiv.org/abs/2608.05497

作者：Mohammed Ali,Abdelrahman Abdallah,Adam Jatowt

类目：Information Retrieval (cs.IR)

关键词：Late-interaction retrievers handle, Late-interaction retrievers, retrievers handle exclusion, retrievers handle, exclusion queries poorly

备注：

点击查看摘要

Abstract:Late-interaction retrievers handle exclusion queries poorly. When a user asks for X but not Z, the additive MaxSim score promotes documents covering Z, a problem we call exclusion inversion. We show that no readout of the frozen vectors recovers the constraint, because the difficulty lies in identifying the excluded topic, which depends on the query alone. EXCISE operates at query time and corrects the inversion while leaving the index frozen. Two query-side modules totalling 1.5M parameters identify the topic and re-embed a 100-document shortlist, and a parameter-free rule demotes candidates matching that topic. Across six collections and three backbones, EXCISE is the strongest system in all eighteen backbone-collection cells against that backbone's own frozen and fine-tuned baselines. It raises exclusion success@10 on ExcluIR from 0.058 to 0.691 and raises Boolean NOT accuracy from 0.25-0.29 to 0.90-0.92. Pooled over 1,860 queries, it outperforms every fine-tuned cross-encoder, each of which loses no-harm nDCG@10, whereas EXCISE matches its frozen baseline on its strongest backbone. We release X-BENCH, a tiered benchmark of explicit, implicit, and compound exclusions with no-harm and Boolean controls.

9. 【2608.05489】An Ontology-Based Framework for Student Profiling and Content Personalization in Higher Education

链接：https://arxiv.org/abs/2608.05489

作者：José Luiz M. Morais,Arlindo F. da Conceição,Cacilda Encarnação Augusto Alvarenga,Daniela Musa

类目：Information Retrieval (cs.IR)

关键词：Communication Technologies, virtual learning environments, learning environments brought, Digital Information, environments brought

备注：

点击查看摘要

Abstract:The expansion of access to Digital Information and Communication Technologies and the offer of distance or semi-distance education courses that make use of virtual learning environments brought changes in the teaching and learning processes, requiring that the student be even more protagonist in this process. The present study aimed to identify important aspects to be considered in the implementation and improvement of self-paced learning and e-learning in higher education courses, with the purpose of rethinking pedagogical models of courses offered at a distance so that they reach even more of your learning objectives. The research is characterized as qualitative, of bibliographic nature, and discusses techniques to monitor and record, electronically and automatically, the results of the process and learning. The importance of processes that store and manage the student's profile is highlighted, both in terms of content and forms of access. The article proposes the use of ontologies to store information about the educational process and presents a computational architecture for this purpose.

10. 【2608.05467】A Mechanistic Analysis of Gender Sensitivity in Dense Retrieval Models

链接：https://arxiv.org/abs/2608.05467

作者：Catherine Chen,Maarten de Rijke,Carsten Eickhoff

类目：Information Retrieval (cs.IR)

关键词：prior work showing, male-gendered documents higher, internal mechanisms producing, score male-gendered documents, dense retrieval models

备注：

点击查看摘要

Abstract:While gender bias in dense retrieval models is well documented, with prior work showing that models often score male-gendered documents higher than female or neutral variants, the internal mechanisms producing these disparities are poorly understood. In this paper, we mechanistically analyze bi-encoder models to localize gender sensitivity, finding that the signal originates in input embeddings and propagates through a small set of late-layer attention heads that carry both gender and term-matching signals. Guided by these findings, we test steering interventions at both identified points and find distinct effects: embedding-level steering non-specifically neutralizes score differences, while attention-level steering produces directional shifts. Our findings provide a mechanistic basis for targeted debiasing and highlight the challenge of disentangling gender from relevance signals in shared model components.

11. 【2608.05441】Filtered Vector Search in a Disaggregated Lakehouse: Composing Table-Format Pruning with Per-File ANN

链接：https://arxiv.org/abs/2608.05441

作者：Rakesh Jain,Thomas Griffin,Syed Zawad(IBM Research)

类目：Databases (cs.DB); Distributed, Parallel, and Cluster Computing (cs.DC); Emerging Technologies (cs.ET); Information Retrieval (cs.IR)

关键词：alongside structured data, Approximate nearest-neighbor, increasingly runs alongside, runs alongside structured, separate filter step

备注：

点击查看摘要

Abstract:Approximate nearest-neighbor (ANN) search increasingly runs alongside structured data - "find the 10 nearest documents where tenant='acme' AND lang='en'" - yet similarity and filtering are usually bolted together: a specialized vector index for one, a separate filter step for the other. We ask what happens when both live inside an open lakehouse table (Apache Iceberg over Parquet on object storage), where the engine already owns a mature file-pruning stack (partition pruning, zone-maps, a bitmap index). We embed an IVF index in place in each Parquet file's footer and make filtered vector queries fast not with a new filtering algorithm but by composing the table's existing file pruning with per-file ANN: the planner prunes data files by the predicate first, then runs IVF only over the survivors. The index is built distributed and non-destructively - a metadata-only Iceberg replace that every other engine still reads - and a rendezvous-hashed per-file cache keeps object-store read latency from swamping the algorithmic win. The payoff comes entirely from file pruning. On an 11.5M x 768 table, warm IVF search is ~32x faster than brute force at recall@10 = 0.90, a selective predicate having pruned 355 of 444 data files before ANN runs; on 5M real IBM Granite embeddings, a filter arriving across a join prunes four of five region partitions and runs nearly two orders of magnitude (~94x: 14.7 s - 157 ms) faster than the query-time join at identical top-k, once the reduction is materialized into a region-partitioned layout. We characterize when the composition pays off - it requires file-level locality on the filter column, and the residual predicate is only safe to push into the search over a provably pure (partitioned) column, not a merely sorted one - and report the failure modes we hit bolting ANN onto a lakehouse engine.

12. 【2608.05402】Robustness and User-Perceived Value of Popularity Calibration in Music Recommendation: A User Study

链接：https://arxiv.org/abs/2608.05402

作者：Oleg Lesota,Gustavo Escobedo,Bruce Ferwerda,Simone Kopeinik,Dominik Kowald,Elisabeth Lex,Markus Schedl

类目：Information Retrieval (cs.IR)

关键词：Popularity, Popularity calibration, calibration, form of user-centered, user-centered personalization

备注： Submitted to ACM TORS

点击查看摘要

Abstract:Popularity calibration in recommender systems has been studied both as a form of user-centered personalization and as an indicator of popularity bias. Most existing work evaluates calibration through offline metrics, often assuming that users prefer recommendation lists whose popularity distribution matches their historical consumption profile. However, user studies on calibration remain limited, and existing findings suggest that calibrated recommendations do not necessarily have a strong effect on user experience. Moreover, although prior work has shown that calibration metrics can correlate with users' perceptions of recommendation lists, the robustness of this relation remains unclear under different levels of item familiarity and incomplete user-history information. In this work, we study the perceived value and measurement reliability of popularity calibration in music recommendation. We construct personalized track lists from users' recent listening histories and use a controlled naive recommender to create lists with different popularity compositions: highpop-heavy, lowpop-heavy, and calibrated. We investigate whether users perceive differences between these lists, whether calibrated lists are preferred, how robust JSD-based popularity calibration is under different familiarity and history-availability conditions, and how computational popularity labels align with users' own popularity judgments. Our results show that users perceive differences in popularity composition, but do not clearly prefer calibrated lists. We further find that the relation between JSD and perceived popularity depends on item familiarity, list composition, and available user history, while computational and user-judged popularity labels only weakly align. These findings contribute to a more critical understanding of popularity calibration as both an offline metric and a user-facing construct.

13. 【2608.05302】Cross-platform epistemic verification for improving factual reliability in AI-generated news summarization

链接：https://arxiv.org/abs/2608.05302

作者：Zhuo Xie,Haoze Ni

类目：Information Retrieval (cs.IR)

关键词：Multi-source Evidence Consen, post-hoc hallucination cor, Evidence Consen, proposes Multi-source Evidence, MECV aggregates evidence

备注：

点击查看摘要

Abstract:This study proposes Multi-source Evidence Consen- sus Verification (MECV), a post-hoc hallucination cor- rection framework for AI-generated news summariza- tion. Instead of depending on a single retrieval channel, MECV aggregates evidence from multiple heterogeneous sources, including the source document, Wikipedia, and open-web retrieval. The framework further incorporates a multi-LLM jury mechanism that estimates factual reliabil- ity through contradiction-aware consensus scoring across verifier models. Claims identified as potentially unsup- ported are revised through iterative minimal-edit refine- ment. The proposed framework is evaluated on the SummEd- its benchmark using GPT-4o-mini and DeepSeek-Chat as the verifier jury, with Qwen-Plus as the orchestra- tor. Experimental results show that MECV improves fac- tual consistency while preserving the semantic structure of the original summaries. The findings further suggest that agreement across heterogeneous evidence sources can serve as a useful signal for identifying factual uncertainty in AI-generated summaries, including in information- sensitive domains such as financial news aggregation. This study contributes to research on trustworthy AI and automated journalism by introducing a multi-source verification framework for hallucination correction and demonstrating the value of consensus-based verification for improving factual reliability in AI-generated news summarization.

14. 【2608.05235】From Trajectories to Evidence: Auditable Experimental Records for Industrial Research Agents

链接：https://arxiv.org/abs/2608.05235

作者：Zijie Zhuang,Changxin Lao,Pengbo Xu,Hanwen Xu,Ruochen Yang,Yingzhi He,Peng Zhang,Jiangxia Cao,Yusheng Huang,Guohong Mu,Jian Liang,Ruiming Tang,Shuang Yang,Zhaojie Liu,Wenwu Ou,Kun Gai

类目：Information Retrieval (cs.IR)

关键词：agents increasingly conduct, increasingly conduct multi-round, conduct multi-round machine-learning, multi-round machine-learning experiments, industrial recommendation settings

备注：

点击查看摘要

Abstract:Research agents increasingly conduct multi-round machine-learning experiments in industrial recommendation settings and retain the resulting trajectories to guide later decisions. Yet a completed trajectory is not automatically evidence: generated artifacts may be unsupported or incomplete, executed rounds may be invalid or confounded, and later modifications may obscure earlier findings. We study \textbf{trajectory-to-evidence conversion}, asking what a completed research process has actually established. We introduce an evidence-grounded framework that couples bounded verification of consequential artifacts with post-execution claim qualification. A context-isolated generate--verify--repair process checks artifacts for evidence violations and missing downstream requirements before release. After execution, validity and attribution checks consolidate evidence across rounds, qualify intervention-level claims as actionable repairs, diagnostic guards, or withheld findings, and preserve admitted claims as auditable records with explicit provenance and applicability boundaries. A hybrid LLM-assisted controller subsequently applies, defers, or rejects records based on available target evidence. Record audits characterize which claims survive qualification, while downstream diagnostics identify affirmative applicability judgment as a bottleneck for the tested controller. Across paper-to-target adaptations, later rounds often improve on the first, while final rounds frequently underperform an earlier best, exposing non-monotonic trajectory evolution. Candidates produced through the complete workflow also yielded positive online lifts relative to deployed baselines.

15. 【2608.05227】BioMedJImpact: A Comprehensive Dataset and LLM Pipeline for AI Engagement and Scientific Impact Analysis of Biomedical Journals

链接：https://arxiv.org/abs/2608.05227

作者：Ruiyu Wang,Yuzhang Xie,Xiao Hu,Carl Yang,Jiaying Lu

类目：Information Retrieval (cs.IR)

关键词：existing resources rarely, resources rarely capture, shape venue prestige, Assessing journal impact, research jointly shape

备注：

点击查看摘要

Abstract:Assessing journal impact is central to scholarly communication, yet existing resources rarely capture how collaboration and artificial intelligence (AI) research jointly shape venue prestige in biomedicine. We present BioMedJImpact, a large-scale, biomedical-oriented dataset built from 1.74 million PubMed Central articles across 2,744 journals. BioMedJImpact integrates bibliometric indicators, collaboration features, and an LLM-derived AI engagement rate, defined as the proportion of AI-related articles within each journal-year. Specifically, AI engagement rate is extracted through a reproducible three-stage LLM pipeline. We analyze how collaboration intensity and AI engagement rate jointly influence scientific impact across two temporal subsets (2016-2019, 2020-2023). Two main patterns emerge: journals with larger author teams tend to have higher citation impact, while AI engagement rate is positively associated with Impact Factor only in the 2019 subset. To validate the LLM pipeline for deriving the AI engagement rate, we conduct human evaluation, confirming substantial agreement in AI relevance detection and consistent subfield classification. Together, BioMedJImpact provides both a comprehensive dataset at the interface of biomedicine and AI and a validated framework for scalable, content-aware scientometric analysis. Code and dataset are available at this https URL.

计算机视觉

1. 【2608.06311】Does FLAIR super-resolution erase or hallucinate small white-matter lesions?

链接：https://arxiv.org/abs/2608.06311

作者：Zahra Khodakarami,Yue Li,Pulkit Khandelwal,John Detre,Sandhitsu Das,Christopher Brown,David Wolk,Paul Yushkevich

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Fluid-attenuated Inversion Recovery, White matter hyperintensities, Inversion Recovery, Fluid-attenuated Inversion, White matter

备注： 10 pages, 2 figures, 3 tables. Accepted at the 11th International Workshop on Simulation and Synthesis in Medical Imaging (SASHIMI 2026), held in conjunction with MICCAI 2026. This is the version submitted for review; the final authenticated version will appear in the Springer LNCS proceedings

点击查看摘要

Abstract:White matter hyperintensities (WMH), bright regions on Fluid-attenuated Inversion Recovery (FLAIR) scans are associated with cerebrovascular pathology and neurodegeneration. FLAIR is usually acquired with thick slices in clinical settings, giving it poor through-plane resolution. Super-resolution (SR) is a widely used method for recovering an isotropic volume from an anisotropic scan. Yet whether applying it prior to WMH segmentation preserves lesion content remains unknown: a model may erase small real lesions or hallucinate absent ones. We used 1-mm isotropic high-resolution (HR) FLAIR scans from 29 individuals in the ADNI cohort, each manually segmented for WMH by an expert. Then, we degraded each to simulated 3 and 5 mm through-plane acquisitions. Multi-contrast implicit neural representation (INR), a single-contrast self-supervised model (ECLARE), and cubic interpolation were used to upsample them onto the HR grid. WMH segmentation from a simulated thick slice and the original HR FLAIR set the floor and ceiling, respectively, for the per-lesion analysis. Of four WMH segmentation methods (WMH-SynthSeg, segcsvd, MARS-WMH, TrUE-Net), we ran the analysis under the most sensitive one to small lesions on HR (MARS-WMH) with the evaluation metrics of detection sensitivity, erasure rate (HR-detected lesions lost after reconstruction), and hallucination rate (predicted components absent from both the manual and HR segmentation). The dominant effect of SR was erasure of small real lesions, not hallucination, and it increased with slice thickness, though every reconstruction still improved lesion detection over the raw thick slice. ECLARE recovered small lesion signal best at both thicknesses, while the INR was no better than cubic interpolation.

2. 【2608.06307】UQ-Loc: Uncertainty-Aware LiDAR Scene Coordinate Regression

链接：https://arxiv.org/abs/2608.06307

作者：Jacek Komorowski

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Scene Coordinate Regression, LiDAR-based Scene Coordinate, explicit map retrieval, maps point clouds, point clouds directly

备注：

点击查看摘要

Abstract:LiDAR-based Scene Coordinate Regression (SCR) maps point clouds directly to 3D scene coordinates, enabling precise 6-DoF localisation without explicit map retrieval. However, existing methods produce deterministic predictions, discarding aleatoric uncertainty that could improve robustness and downstream decision-making. We present UQ-Loc, which extends the LightLoc architecture with an anisotropic Gaussian covariance head that predicts a full 3x3 positive-definite covariance matrix per voxel. Training uses a Negative Log-Likelihood (NLL) loss augmented with a kNN-based spatial smoothness regulariser, while inference employs a modified SC2-PCR solver with uncertainty-weighted seed scoring and a Mahalanobis-distance inlier test. We adopt Expected Calibration Error (ECE) as a principled metric for evaluating the quality of the predicted uncertainty. Experiments demonstrate that UQ-Loc achieves consistent improvement in 6-DoF localization accuracy while producing well-calibrated covariances.

3. 【2608.06275】LNM: Externally Validated Tooth Detection, Numbering and Segmentation from Smartphone Photographs Using Mask R-CNN

链接：https://arxiv.org/abs/2608.06275

作者：Arash Nedaei,Henna Tiensuu,Elina Väyrynen,Saujanya Karki,Jaakko Suutala

类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词：preventive oral healthcare, hinder preventive oral, affect billions globally, issues affect billions, professional dental care

备注： 16 pages, 7 figures, 6 tables

点击查看摘要

Abstract:Oral health issues affect billions globally, but the cost and limited access to professional dental care hinder preventive oral healthcare. Research relies on clinical-grade radiographs or intraoral camera images, unavailable for public self-screening. This study introduces a tooth localisation and numbering model for smartphone photographs. We developed a customised Mask Region-based Convolutional Neural Network (Mask R-CNN) pipeline trained on 1,272 annotated smartphone images. To address variability in patient-generated health data, the pipeline incorporates two domain-informed mechanisms: a masked gray-world white-balancing algorithm to mitigate artificial colour casts and an anatomically constrained detection layer to enforce structural validity and suppress false positives. Evaluation comprised four stages: internal held-out testing, independent external testing, a descriptive ablation study, and fold-based training stability analysis using the same internal test set. On the internal test set, the model achieved an instance-mask AP@50 of 0.818, class-aware PQ of 0.780, and operational F1 of 0.884. Training stability showed limited between-model variation: across ten runs, instance-mask AP@50 had a standard deviation of 0.009. On the external dataset, the model achieved an instance-mask AP@50 of 0.901, class-aware PQ of 0.832, and operational F1 of 0.928 despite differences in population, sensors, and acquisition protocols. The inference pipeline is available as an open-source, containerised API. These results demonstrate that consumer-grade smartphone imagery can support automated tooth-level anatomical mapping, offering a scalable, potentially low-cost foundation for remote screening and tele-dentistry in resource-constrained environments.

4. 【2608.06264】OTLesMix: Wasserstein Barycenter and Optimal Transport Map for Synthetic Lesion Generation with Diverse Shapes and Locations

链接：https://arxiv.org/abs/2608.06264

作者：Robin Trombetta,Carole Lartizien

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

关键词：revolutionized medical imaging, medical imaging segmentation, allowing the extraction, characterize pathologies, development of deep

备注：

点击查看摘要

Abstract:The development of deep learning over the past decade has revolutionized medical imaging segmentation, allowing the extraction of precise descriptors from large volumes to characterize pathologies. Data augmentation is a technique widely regarded as a way to improve model training. It includes simple transformations like spatial operations or intensity modifications, but also more advanced synthesis techniques. Their goal is to generate new realistic samples from an existing dataset to diversify the images used during training. Among them, several propose different mixing strategies to combine real samples. However, one of their major shortcomings is to yield limited variability in terms of generated lesion shapes and locations. In this work, we introduce a novel image synthesis method, called OTLesMix, that leverages Wasserstein barycenter and optimal transport plan to generate realistic and diverse samples. We evaluated our method on three brain lesion segmentation tasks, on which it improves the Dice score compared to a model trained without synthetic data by 2.9 to 6.6 points, and outperforms state-of-the-art mix-based methods.

5. 【2608.06257】MASS: Multiplayer World Models with Authoritative Shared State

链接：https://arxiv.org/abs/2608.06257

作者：Ziqi Cai,Siqi Yang,Yimu Wang,Zixian Gao,Yunheng Liu,Shuchen Weng,Erwin Wu,Kaipeng Zhang,Boxin Shi

类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：Current video world, view-dependent visual latents, Current video, visual latents, leading to redundant

备注：

点击查看摘要

Abstract:Current video world models struggle in multiplayer environments because they entangle world state with view-dependent visual latents, leading to redundant compute, view inconsistencies, and poor scalability. We propose MAS (Multiplayer world models with Authoritative Shared State) to resolve this limitation. Inspired by multiplayer game architectures, MAS disentangles world dynamics and view rendering. A learned Logic Engine advances a global, authoritative typed state from joint actions without any hand-written transition function, acting as the sole recurrent memory and synchronization reference. From this shared state, a learned Rendering Engine generates independent and consistent views for any requested camera on demand. This explicit disentangling allows MAS to achieve superior state accuracy and lower cross-view inconsistency compared to state-of-the-art multi-view baselines on a matched multiplayer Snake benchmark. It advances predicted worlds with 1,024 concurrent players for 10,000 recurrent steps. Our results show that explicit, authoritative state modeling provides a practical foundation for scalable and consistent multi-agent world simulation.

6. 【2608.06252】oward Deployable Bangla Sign Language Recognition with Expert-Validated Data and a Lightweight Attention-Based Model

链接：https://arxiv.org/abs/2608.06252

作者：Saad Ahmed,Md Khalid Syfullaha

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Bangla Sign Language, Sign Language, Bangladesh communicate, Bangla Sign, Deaf

备注：

点击查看摘要

Abstract:Deaf and hard-of-hearing people in Bangladesh communicate mainly through Bangla Sign Language (BdSL). Automatic BdSL recognition on personal devices could widen access to education and services. Existing systems use controlled-setting datasets without expert verification and heavyweight pretrained backbones unsuited to on-device use. We introduce RSBdSL38, 10,874 expert-validated images spanning all 38 BdSL hand signs, representing the 51 letters of the Bangla alphabet, recorded from real signers at three special-needs schools across Bangladesh. We propose a lightweight attention based convolutional network of 298,470 parameters, built from grouped bottleneck residual blocks, channel and spatial attention, a multi-scale depthwise hand-feature block, dual pooling, and Swish activations. Trained from scratch, it attains 96.37% accuracy (95.72% +- 0.54% over five seeds), within 1.08 percentage points of the best of nine ImageNet-pretrained efficient architectures under an identical protocol, using 8.5 to 68x fewer parameters and 1.3 to 21.7x fewer MACs. Retrained, it reaches 92.95 to 98.33% on six public BdSL benchmarks, 97.04% on a merged corpus, and 76.25% zero-shot on BdSL-38. Removing any architectural stage costs 7.61 to 89.30 points, against at most 3.17 for the training recipe. Grad-CAM with deletion-insertion and weight-randomization checks confirms that predictions follow the signing hand. A signer-independent split holding out 6 of 36 signers yields 85.18%. Quantized to 0.48 MB, it runs at 3.98 ms per image within a 15.5 MB footprint on a commodity smartphone. Together, RSBdSL38 and our from-scratch model turn benchmark accuracy into deployable accessibility at a fraction of pretrained-backbone cost; dataset, code, and models are released.

7. 【2608.06240】PRISM: Distribution-Gated Flow Matching for Controllable Unpaired Image Translation

链接：https://arxiv.org/abs/2608.06240

作者：Elad Yoshai,Natan T. Shaked

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：unpaired translators control, paired supervision, preserve without paired, diffusion-based unpaired translators, Ordinary Differential Equation

备注：

点击查看摘要

Abstract:Unpaired image-to-image translation must decide, per image, what to change and what to preserve without paired supervision. Many diffusion-based unpaired translators control preservation through a single global noise or guidance value applied across the image, which cannot separate content to keep from appearance to change. We present PRISM, a GAN-free flow-matching framework that replaces this global control with a learned per-feature gate. The gate's spatial prior is derived from each source feature's standardized distance to the target feature distribution, so features far from the target are freed while target-consistent features are preserved. The same gate controls both the initialization, which mixes the real source latent with a task-matched corruption, and the transport timing during Ordinary Differential Equation (ODE) integration. The corruption is matched to the task, content-anchored (AdaIN) for structure-preserving translation and partially anchored for structure-changing translation, and the gate can be overridden locally at inference from text or a detector without retraining, preserving important structures of the original image while still generating realistic results. We evaluate PRISM on five natural and biomedical benchmarks (AFHQ cat-dog, CelebA-HQ appearance translation, day-night relighting, virtual staining, and breast frozen-permanent histopathology). Among the evaluated methods under a shared same-split protocol, PRISM attains the best Inception FID and KID on four benchmarks and a competitive result on the fifth, and on histopathology yields the nuclei-count ratio closest to the ideal, supporting a favorable balance between target realism and structural preservation.

8. 【2608.06236】Depth-Guided Video Object Counting in Crowded Scenes

链接：https://arxiv.org/abs/2608.06236

作者：Yuanjing Xu,Xinyan Liu,Weidong Chen,Zixuan Zou,Linhao Zhang,Zhuangzhe Meng,Antoni B. Chan,Weigang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：target category based, advance video object, aiming to robustly, visual prompts, video object counting

备注： Accepted at ACM Multimedia 2026

点击查看摘要

Abstract:Our primary objective is to advance video object counting in crowded scenes, aiming to robustly count all instances of a target category based on given text or visual prompts. Existing methods rely on RGB information, limiting their discriminative ability in crowded and occluded conditions. To address this, we propose a Depth-Guided Detector (DG-Det) along with a general post-processing pipeline. By integrating depth cues with multi-scale RGB-D cross-attention and explicit occlusion prediction, our method enhances spatial understanding and achieves robust detection in crowded and occluded scenes. Furthermore, we introduce a unified de-duplication framework to eliminate cross-frame redundant counting. To facilitate future research, we also release a new RGB-D Video Object Counting dataset featuring depth information and multiple object categories persequence. Extensive experiments demonstrate that our method achieves a 62.01\% reduction in MAE compared to existing baselines, and also produces consistent improvements in RMSE. We provide the source code at this https URL and the dataset at this https URL.

9. 【2608.06231】EmoWorld: A Decoupled Affective Field for Controllable Emotional Video Generation

链接：https://arxiv.org/abs/2608.06231

作者：Bingyuan Wang,Baistan Zhyldyzbekov,Kunyu Feng,Zeyu Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：single text condition, entangle global atmosphere, generators entangle global, Temporal Affective Steering, Semantic Affective Steering

备注：

点击查看摘要

Abstract:Emotion shapes how viewers interpret a scene, yet existing video generators entangle global atmosphere, affect-bearing semantic cues, and temporal progression within a single text condition. We present EmoWorld, a framework that decouples these factors within a frozen flow-matching video diffusion transformer (Video DiT). A one-time preparation stage extracts layer-specific affect directions and a reusable cue library from geometry-preserving neutral and emotion-edited panoramas. At inference, Visual Atmosphere Steering (VAS) injects atmosphere directions into hidden states, Semantic Affective Steering (SAS) isolates a separately scalable prompt residual for semantic cues, and Temporal Affective Steering (TAS) interpolates endpoint residual fields across denoising and video time. On Wan2.2, VAS improves target-emotion alignment by 19% while reducing a temporal-fluctuation proxy by 48%; SAS improves target-emotion alignment by 37% and increases detected affect-bearing cues by 36%; and TAS improves transition monotonicity by 15% over the strongest baseline. EmoWorld is evaluated across 27 emotion categories in text-to-video and image-to-video settings, demonstrates portability across multiple Video-DiT backbones, and supports camera-conditioned composition without updating generator parameters.

10. 【2608.06211】Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era

链接：https://arxiv.org/abs/2608.06211

作者：Binze Wang,Jinyu Tian,Xingrun Wang,Xiaochen Yuan,Jianqing Li

类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

关键词：Significant advancements, underscoring the critical, copyright protection, utilization of large, critical importance

备注：

点击查看摘要

Abstract:Significant advancements in deep learning have been made possible by the utilization of large datasets, underscoring the critical importance of copyright protection. Adding meticulously designed perturbations to examples, making them unlearnable has become a crucial approach for safeguarding data copyright. Existing methods for creating unlearnable examples overlook the risk of data leakage, which can threaten data ownership. Thus, copyright protection in deep learning faces two main threats: illegal model training and malicious data leakage. We investigate that these two threats cannot be solved by straightforwardly combining existing availability attacks and watermarking techniques as their negative interaction effects. Therefore, in this paper, we propose a novel copyright protection mechanism for the aforementioned security concerns. Considering that the prevention of unauthorized model training requires powerful generalizability of unlearnable perturbations, we generate perturbations to induce the model to learn uncorrelated features of input images. It works by minimizing the mutual information of the input and output of the model. On the other hand, to eliminate the side impact of unlearnable perturbations on the watermark extraction, we design a dual extraction strategy by using two distinct watermark extractors. Extensive experiments on the image datasets {ImageNet, CIFAR10, and Pets} show that our proposed method could provide comprehensive copyright protection to images. The code is available at {this https URL}.

11. 【2608.06205】CFGPNet: Cross-Attention-Based Fused Gradient Programmed Network Framework for Multispectral Object Detection

链接：https://arxiv.org/abs/2608.06205

作者：Nima Hatami,Karim Faez,Saeed Sharifian,Hamidreza Amindavar

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：supporting robust perception, complex multi-scale environments, object detection exploits, infrared imagery, supporting robust

备注：

点击查看摘要

Abstract:RGB--T object detection exploits the complementary strengths of visible and infrared imagery, supporting robust perception in low-light, adverse-weather, and complex multi-scale environments. However, existing methods still suffer from insufficient cross-modal interaction, unstable fusion from modality distribution gaps, and the high computational cost of heavy attention-based architectures. To address these issues, CFGPNet is proposed, a Cross-Attention-Based Fused Gradient Programmed Network framework for multispectral object detection. CFGPNet uses an improved GELAN backbone with RepViT-style re-parameterized blocks to strengthen feature representation while preserving computational efficiency. A Cross Computation Efficient Attention (CrossCEA) module is introduced to enhance cross-modal feature interaction and reduce redundant information transfer between visible and thermal branches. To generate compact and discriminative fused representations, an Attention Selection and Aggregation Fusion (ASAF) network combines dense feature aggregation with selective attention-based emphasis. Moreover, a programmable-gradient auxiliary branch is integrated into each CFGPNet variant to improve gradient delivery and optimization quality. Experiments on five public multispectral benchmarks, FLIR, M3FD, LLVIP, VEDAI, and MFAD, demonstrate that CFGPNet achieves strong and consistent performance across diverse scenes, object scales, and modality balances. In particular, the framework attains 80.7% mAP50 / 45.0% mAP50:95 on FLIR, 89.9% / 63.4% on M3FD, and 97.8% / 68.9% on LLVIP. It also reaches 83.3% / 56.9% on VEDAI and 83.4% / 61.8% on MFAD. These results show that CFGPNet is an effective, practical solution offering useful accuracy--efficiency trade-offs across three model scales. The code, data, and fine-tuned models are available at this https URL.

12. 【2608.06192】HOPE: Hand-Object Pressure Estimation from Monocular Videos

链接：https://arxiv.org/abs/2608.06192

作者：Subin Jeon,Byungjun Kim,Hanbyul Joo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Estimating physical pressure, Estimating physical, understanding contact-rich hand-object, contact-rich hand-object interaction, vision is essential

备注： project page is at: [this https URL](https://subin6.github.io/page-hope)

点击查看摘要

Abstract:Estimating physical pressure from vision is essential for understanding contact-rich hand-object interaction. However, prior vision-based pressure estimation methods are largely limited to planar surfaces and single image input, making them difficult to apply to dynamic hand-object interaction with diverse objects. We instead formulate pressure estimation as a hand-centric video prediction problem with monocular video as input. This formulation predicts temporally evolving per-vertex normal pressure and contact directly on the hand mesh, yielding a unified output space independent of object shape and sensor layout. Building on this formulation, we propose \textbf{HOPE}, a framework with two key components. First, we lift tactile-glove pressure, planar-sensor pressure, and distance-based hand-object contact annotations into a shared hand vertex space, allowing bare-hand contact data to regularize pressure learning where metric labels are unavailable. Second, we introduce a vertex-anchored video transformer that treats each vertex as a persistent token, aggregates visual features and hand pose over time, and uses a contact-gated pressure head to enforce that pressure vanishes without contact. Experiments on OpenTouch, PressureVisionDB, and hand-object contact benchmarks validate HOPE across object-pressure, surface-pressure, and contact-supervised HOI settings. Despite using metric pressure supervision primarily from gloved-hand videos, HOPE generalizes to bare-hand egocentric and in-the-wild videos, producing joint contact and pressure predictions beyond the scope of contact-only or planar-pressure baselines.

13. 【2608.06184】EvReflection: Event-Driven Micro-Dynamics for Reflection Removal

链接：https://arxiv.org/abs/2608.06184

作者：Jiaxiao Wang,Dachun Kai,Huyue Zhu,Quanquan Hu,Zhenyang Xu,Xiaoyan Sun

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：primarily exploit static, current methods primarily, residual artifacts due, exploit static image, severe residual artifacts

备注： ICML 2026

点击查看摘要

Abstract:Despite remarkable progress in reflection removal, current methods primarily exploit static image priors from a single frame and still suffer from severe residual artifacts due to the inherent ambiguity between the reflection and transmission layers. In this paper, we propose leveraging event signals to break this ambiguity. By employing event cameras to capture micro-dynamics, we reveal the differential motion between these two layers. We thereby present a novel event-driven reflection removal network, EvReflection, that utilizes these dynamic cues for layer separation. Specifically, we design a Micro-Dynamics Decoupler to disentangle layer-specific motions from event streams as priors, which then guide a Parallax-Attention Rectifier to cleanly remove artifacts from the RGB image. Furthermore, to address data scarcity, we develop a parallax-aware simulation pipeline and construct the EVR$^2$ benchmark dataset, the first real-world dataset for this task. Extensive experiments demonstrate that EvReflection achieves state-of-the-art performance on both synthetic and real-world benchmarks, surpassing the best competing method by more than 1.6 dB and 1.2 dB in PSNR, respectively. The code, dataset, and pre-trained models are available at this https URL.

14. 【2608.06174】Support Operation Factorization: Compositional Readout of Frozen Vision Encoders under Controlled Interventions

链接：https://arxiv.org/abs/2608.06174

作者：Zhongyao Wang,Wanli Ouyang,Taoyong Cui,Pheng Ann Heng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Compositional analysis, frozen vision encoders, vision encoders, encoders should determine, Compositional

备注：

点击查看摘要

Abstract:Compositional analysis of frozen vision encoders should determine both what changed and where it changed. Standard factor probes score these axes separately, however, and can reward multiple operations that reuse the same predicted slot. We call this failure operation laundering. We introduce an injectively aligned leave-one-cell-out protocol over support x operation grids and SO-OPF, a readout that factors cell energy into support salience and a competitive operation posterior. This formulation separates two questions that aggregate scores conflate: whether the carrier composes held-out bindings when the grid is known, and whether that grid can be recovered from flat cell labels. With frozen DINOv3 features, known factorial assignment reaches 0.874 injective accuracy on Shapes3D-Extended and 0.799 on globally image-disjoint COCO; learning the assignment from flat labels reaches 0.769 and 0.762, respectively. Under matched-axis-aware supervision on Shapes3D, the factored carrier improves learned-assignment accuracy from 0.653 to 0.841 over a dense carrier and eliminates its laundering gap. SigLIP2 replicates the COCO separation. A rebuilt MuJoCo substrate exposes a boundary: learned-assignment accuracy is 0.569 with DINOv3 and 0.484 with SigLIP2, with substantial slot collapse. Thus factored readout and injective evaluation recover held-out bindings on two substrates while exposing, rather than hiding, a renderer-specific failure boundary; they do not establish universal recovery from flat labels.

15. 【2608.06170】Prior-SG: Task and Prior Driven Region Segmentation for Scene Graphs in Arbitrarily-Structured Environments

链接：https://arxiv.org/abs/2608.06170

作者：Giorgio Tonetti,Laurent Kneip,Abel Gawel,Marco Hutter

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：autonomous mobile platforms, mobile platforms, promising representation, reasoning in autonomous, autonomous mobile

备注：

点击查看摘要

Abstract:Hierarchical 3D scene graphs are a promising representation for high-level spatial reasoning in autonomous mobile platforms. However, existing extraction frameworks typically rely on purely local visual clustering or strict geometric heuristics, such as wall-separated rooms, which fail in open-plan or arbitrarily-structured environments. We propose Prior-SG, a task- and prior-driven framework that casts scene graph generation fundamentally as a probabilistic alignment problem. As the robot explores, it continuously aggregates an incoming RGB-D sensor stream into a physically grounded Instance Graph utilizing a multi-scale, open-vocabulary feature fusion strategy. The system then infers the high-level functional semantics of this map through a Maximum A Posteriori (MAP) estimate, guided by a Prior Graph-a logical expectation of the environment's structure and task-relevant vocabulary synthesized dynamically by a Large Language Model. By optimizing a Markov Random Field that fuses heterogeneous experts (visual, geometric, and discrete objects) with these topological priors, the system resolves local perceptual ambiguities. We validate this approach across diverse simulated residential datasets and large, open-plan real-world environments. Prior-SG achieves state-of-the-art semantic region segmentation accuracy compared to recent baselines, robustly delineates distant functional boundaries in the absence of physical walls, and uniquely provides zero-shot ontological flexibility, enabling the robot to entirely restructure its spatial partitioning based on a given high-level task.

16. 【2608.06164】BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Models

链接：https://arxiv.org/abs/2608.06164

作者：Yixiong Jing,Qi Wang,Lin Chen,Junwei Jiang,Guangming Wang,Haibing Wu,Olaf Wysocki,Wanli Ma,Brian Sheil

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：benefiting robotics planning, observations enables physically, enables physically consistent, physically consistent dynamic, consistent dynamic prediction

备注：

点击查看摘要

Abstract:Reconstructing objects with mechanical properties from video observations enables physically consistent dynamic prediction, benefiting robotics planning and interaction. Existing spring--mass based physical driven reconstruction approaches offer efficient and differentiable physical reconstruction, but they typically rely on axial springs alone. Such formulations oversimplify the underlying structural mechanics and can become mechanically under-constrained when the physical graph is coarsened, limiting their ability to preserve stable local deformation. We present BendTwin, a bending-aware differentiable spring--mass framework for video-based reconstruction and future prediction of deformable objects. BendTwin introduces bending stiffness and damping over local surface triplets, penalizing deviations from rest angles and regularizing higher-order deformation. These bending constraints improve mechanical stability while preserving the simplicity of spring--mass system. Experiments show that BendTwin consistently outperforms the axial-only PhysTwin baseline. Ablation studies further demonstrate that the bending constraints maintain system stability across different downsampling ratios and consistently improve upon the original PhysTwin formulation. Overall, BendTwin provides an effective approach for constructing mechanically faithful digital twins from sparse-view RGB-D videos.

17. 【2608.06154】Visual Grounding in Zero-Shot Vision-Language Control

链接：https://arxiv.org/abs/2608.06154

作者：J. de Curtò,Dayani Plasencia,Diego Sánchez,I. de Zarzà

类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：produce favourable scores, conservative action priors, Vision-language models, successful trajectories, necessarily show

备注：

点击查看摘要

Abstract:Vision-language models (VLMs) are increasingly used as zero-shot controllers, but successful trajectories do not necessarily show that decisions are grounded in visual input: simulator dynamics and conservative action priors can produce favourable scores without meaningful perception. We investigate this with an input-ablation battery: blind-image controls, repeated identical inputs, lane-axis reflection, non-visual baselines, and pipeline-integrity checks. Across nine direct-action models, six structured local VLMs, and an exploratory VLM-MPC hierarchy, we analyse 32,874 scored calls over two embodiments and three simulators. The direct-control results are largely negative: a constant-SLOW policy outperforms a scripted geometric controller, several models are image-invariant or nearly constant, and models that recognize longitudinal hazards still fail to transform LEFT and RIGHT under reflection. No local VLM meets the joint longitudinal and lateral grounding criteria. However, an image-only deterministic positive control estimates the lead gap with 0.090 m MAE and exact mirror equivariance, confirming the stimuli carry sufficient visual information; the failures are modular, not universal. A post-hoc, leakage-controlled symmetry-consensus guardian selects two models from 16 calibration frames and freezes a 2-of-4 hazard vote across original and reflected views. On 272 held-out frames it reaches 0.954 balanced accuracy (episode-cluster bootstrap 95% CI [0.895,0.990]); nested leave-one-episode-out recovers the same pair and threshold in all 12 folds. Abstaining on ties raises committed balanced accuracy to 0.973 at 0.824 coverage. With deterministic perception retaining lateral authority, offline modular replay achieves 0.934 action agreement and exact mirror equivariance. These results support current VLMs as bounded, selective hazard assistants, not monolithic zero-shot controllers.

18. 【2608.06150】CogVis: Must Open-Vocabulary Change Detection Perceive the Scene Anew for Every Query?

链接：https://arxiv.org/abs/2608.06150

作者：Zijie Wang,Chen Zhong,Wei He

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Earth-surface monitoring requires, detection models capable, Earth-surface monitoring, monitoring requires change, arbitrary semantic categories

备注： 19 pages, 11 figures, including 3 supplementary figures. Code: [this https URL](https://github.com/KotlinWang/CogVis)

点击查看摘要

Abstract:Earth-surface monitoring requires change detection models capable of recognizing arbitrary semantic categories. Open-Vocabulary Change Detection (OVCD) addresses this need. However, existing methods often entangle temporal perception, semantic discrimination, and region verification, causing unstable results and redundant computation. Inspired by human visual change perception, we propose CogVis, a cognitive memory-guided framework that reformulates OVCD as a perception-memory-verification paradigm. CogVis first employs a Scene Change Perceptron (SCP) to extract a reusable, category-agnostic change prior from frozen bi-temporal features, thereby decoupling temporal evidence from semantic category decisions. A Semantic Memory Calibrator (SMC) then compensates for category-dependent score shifts by dynamically estimating an image-query-specific decision threshold. Finally, an Adaptive Region Filter (ARF) filters connected candidates using learned semantic, temporal, and structural reliability. Experiments on seven benchmarks spanning semantic change detection, binary change localization, and building-damage assessment show that CogVis achieves state-of-the-art performance across all evaluated datasets. By sharing scene-level change perception, CogVis further avoids repeating category-agnostic temporal perception across queries and improves inference throughput by 28.50%.

19. 【2608.06142】Learning visual representations for compositional analysis of artworks and photographs

链接：https://arxiv.org/abs/2608.06142

作者：Fatemeh Behrad,Tinne Tuytelaars,Johan Wagemans

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：conveyed in artwork, deliberate arrangement, aesthetic quality, quality are conveyed, formalized dimensions

备注： ECCV workshops 2026

点击查看摘要

Abstract:Composition, the deliberate arrangement of visual elements, is central to how meaning, emotion, and aesthetic quality are conveyed in artwork, yet it remains among the least formalized dimensions of visual understanding. Prior work highlights a persistent gap in learning meaningful compositional representations, attributing it to semantic bias and suggesting that human-inspired approaches may be key. We compare two parallel paradigms for composition analysis: a human-inspired method grounded in perceptual grouping, and fine-tuned foundation models enabled by recent large-scale compositional datasets. The human-inspired approach uses object-centric models for region-level decomposition and a graph attention network to capture spatial relationships between elements. Both paradigms are evaluated on composition score/category prediction, compositional image retrieval, and visual saliency detection. With frozen encoders, the human-inspired method achieves competitive performance while remaining interpretable. When sufficient data enables fine-tuning, large self-supervised models outperform significantly, but at the cost of interpretability and cross-domain generalization.

20. 【2608.06126】Patient Pose Assessment Using a CT-Based Framework for Synthetic Data Generation

链接：https://arxiv.org/abs/2608.06126

作者：Manuel Laufer,Dominik Mairhöfer,Malte Sieren,Hauke Gerdes,Fabio Leal dos Reis,Arpad Bischof,Thomas Käster,Erhardt Barth,Jörg Barkhausen,Thomas Martinetz

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：adequate diagnostic quality, treatment planning, diagnostic quality, essential for reliable, reliable diagnoses

备注： Accepted for publication at the Journal of Machine Learning for Biomedical Imaging (MELBA) [this https URL](https://melba-journal.org/2026:027)

点击查看摘要

Abstract:An adequate diagnostic quality of radiographs is essential for reliable diagnoses and treatment planning. The patient's pose during radiography is one of the most important factors determining the diagnostic quality. Since patient positioning is difficult and not standardized, an automated AI-based approach using depth images to automatically assess the patient's pose before the radiograph has been taken would be helpful. Due to regulatory hurdles, however, it is difficult in practice to acquire the required depth images and corresponding radiographs. In this paper, we present a framework that can generate such training data synthetically from Computed Tomography scans. We further show that by pretraining on our generated synthetic dataset consisting of 3077 image pairs of upper ankle joints, the pose assessment of real upper ankle joints can be improved by up to 11 percentage points.

21. 【2608.06125】Sample-Adaptive Latent Rewards for Uncertainty-Guided Diffusion Post-Training

链接：https://arxiv.org/abs/2608.06125

作者：Rui Li,Yuanzhi Liang,Ke Hao,Ziqiao Weng,Haibin Huang,Chi Zhang,XueLong Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：supervise visual diffusion, textsc, decoding intermediate states, supervise visual, intermediate states

备注：

点击查看摘要

Abstract:Latent reward models can supervise visual diffusion models without decoding intermediate states into pixel space. This makes alignment with human preferences more efficient. However, existing latent reward models output only scalar scores. They do not estimate the uncertainty of each prediction. The generator therefore cannot determine which feedback is reliable. This can drive optimization in the wrong direction and lead to reward hacking. We propose \textsc{SURE}, a unified latent-space framework for image and video diffusion models. It learns reward distributions and directly uses their reliability to guide dense post-training. First, we propose sample-adaptive latent reward model (\textsc{SURE-LRM}). It predicts a Gaussian utility for each noisy latent. Its mean predicts the reward score. Its variance reflect the uncertainty of prediction without human annotation. The learned distribution then guides post-training through uncertainty-guided reward feedback learning (\textsc{SURE-REFL}). This method provides uncertainty-guided dense feedback along the denoising trajectory. At selected transitions, \textsc{SURE-REFL} queries the frozen \textsc{SURE-LRM}. It converts detached variance into reliability weights for samples at the same transition. Each weighted reward is backpropagated only through its local transition. The entire process remains in latent space and requires neither pixel-space decoding nor the full denoising graph. Experiments show that \textsc{SURE-LRM} improves preference prediction over strong baselines. \textsc{SURE-REFL} achieves the sota performance among various metrics and further improves optimization stability. It also achieves the highest VBench quality, semantic, and total scores among the evaluated methods.

22. 【2608.06117】Confidence matters: Leveraging Multi-view Geometric Priors for GS-based Reconstruction

链接：https://arxiv.org/abs/2608.06117

作者：Hongyu Zhou,Zorah Lähner

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：offering real-time rendering, Gaussian splatting, view synthesis, offering real-time, sparse representation

备注：

点击查看摘要

Abstract:3D Gaussian splatting (3DGS) has emerged as a widely-used tool for novel view synthesis, offering real-time rendering in a sparse representation. However, the method's reliance on structure-from-motion initialization and photometric optimization can lead to suboptimal geometric reconstruction, particularly for objects with high specularity. In this work, we investigate the integration of geometric priors, in the form of predicted normal and depth maps, into the 3DGS framework to improve the reconstruction quality. We analyze the effect of incorporating these priors into GS-based methods and our evaluation reveals that multi-view predictions, as they are done by the recent visual geometry grounded transformer (VGGT), outperform single-view alternatives. A major factor is the existence of a confidence map for the estimations, which comes as a by-product of multi-view models and which can significantly improve the effectiveness of priors by weighting each prediction appropriately. Extensive experiments on standard benchmarks show consistent improvement in reconstruction quality and significant gains in complex scenes including specular objects.

23. 【2608.06082】Dense-Cast: A lightweight ensemble of deep learning architectures for precipitation nowcasting

链接：https://arxiv.org/abs/2608.06082

作者：Gourav Jyoti Kalita,Hidam Kumarjit Singh

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Proper short-term forecasting, Proper short-term, short-term forecasting, short-term forecasting challenging, make short-term forecasting

备注：

点击查看摘要

Abstract:Proper short-term forecasting of precipitation is crucial in disaster management and preparedness. Nonetheless, the variability and nonlinearity of precipitation make short-term forecasting challenging for meteorologists. Moreover, capturing temporal dependencies in spatiotemporal data is a challenge in precipitation nowcasting. In this article, we introduce a lightweight deep learning model for half-hourly precipitation nowcasting. This model has been designed by incorporating the DenseNet architecture, residual connections, and transformer encoders for effective precipitation nowcasting with reduced model parameters. The North-Eastern region of India has been selected as the area of interest for our study. The region receives the highest precipitation during the months of June-September due to the monsoon season. The proposed model takes the previous five time-steps of half-hourly precipitation as inputs and predicts the precipitation in the next two half-hours. The GPM IMERG precipitation dataset with a 30-minute cadence has been used in this study for training and testing the model. The proposed architecture achieves best MAE of 0.235 millimetres, RMSE of 0.735 millimetres, and KGE score of 0.816 at an interval of 30 minutes.

24. 【2608.06075】Domain-Grounded Candidate Selection for Agentic Image Editing: A Shadow Removal Case

链接：https://arxiv.org/abs/2608.06075

作者：Shilin Hu,Jingyi Xu,Dimitris Samaras,Hieu Le

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：rival task-specific systems, reshaping computer vision, visual priors broad, task-specific systems, reshaping computer

备注：

点击查看摘要

Abstract:Commercial vision-language models are reshaping computer vision, with visual priors broad enough to rival task-specific systems. This raises a natural question: do they reduce the need for classic, physics-informed low-level vision? We study this through shadow removal, a problem shaped by scene geometry, illumination, materials, and occluders, where paired shadow and shadow-free data are hard to collect at scale. We find that a commercial generative editor, used directly, can produce clean shadow-free edits that preserve surface texture and local appearance. However, this comes with a new failure mode: the same editor can regenerate scene content, hallucinate objects, or misread a shadow as material or geometry, producing plausible but physically wrong edits. We address this with an agentic candidate-selection pipeline: the editor generates a guided probe, an evaluator screens for major failures, retries when needed, samples multiple candidates, filters them, and selects a final result balancing shadow removal against scene preservation. Grounding this process in shadow-formation physics makes it more reliable: prompting the generator and evaluator to treat shadows as illumination effects caused by light occlusion, not material or object structure, measurably improves quality and consistency. On the ShadowRemovalRefine benchmark, our physics-oriented pipeline achieves a CDD of 0.0075, reducing CDD by at least 47% over the strongest prior method. These results suggest that commercial vision-language models do not replace classic low-level vision priors; instead, such priors remain useful for constraining and steering physically underconstrained generation.

25. 【2608.06065】he Next Screenshot Knows: Gated Hindsight Distillation for Mobile GUI Agents

链接：https://arxiv.org/abs/2608.06065

作者：Weiwei Li,Junzhuo Liu,Tong Chu,Hengfu Yu,Wen Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：commonly trained offline, successful interaction trajectories, GUI agents, commonly trained, trained offline

备注：

点击查看摘要

Abstract:GUI agents are commonly trained offline from successful interaction trajectories. Standard training decomposes each trajectory into prefix-action pairs: the agent predicts an action from the current screen and interaction history, while the subsequent observation is discarded. This removes the rationale of why an action is correct: the evidence often appears only on the subsequent screen. For example, to enable Soft Wrap, the agent should click Edit or View, but nothing reveals this until the menu opens. Without such evidence, standard imitation gives the model little chance of ever sampling and thus learning the correct reasoning. To address this issue, we propose Gated Hindsight Distillation (GHD), which uses the next screenshot as privileged information during training. A student predicts from the observable trajectory prefix, while a parameter-sharing teacher additionally observes the next screenshot and re-scores the student's on-policy responses. We apply distillation only when the student fails and the hindsight-conditioned teacher recovers the demonstrated action. GHD improves task success over GRPO on AndroidWorld and AndroidLab across two vision-language models. The code and checkpoints will be made available.

26. 【2608.06062】Bar-JEPA: Extracting Values from Bar Chart with Joint-Embedding Predictive Architecture

链接：https://arxiv.org/abs/2608.06062

作者：Poonam Poonam,Alexander Epple,Timo Ropinski

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：underlying data computationally, understood by humans, easily understood, non-trivial to extract, extract the underlying

备注： Accepted at ICDAR 2026

点击查看摘要

Abstract:Bar charts are commonly used in data visualization, and while they are easily understood by humans, it is non-trivial to extract the underlying data computationally. For a machine-learning-based approach, training chart de-rendering models usually requires labeled, real-world data. Labeling data is a time consuming task, which is why annotated data is scarce. Models can learn more efficiently when provided with features of high semantic quality, which a joint-embedding predictive architecture (JEPA) is designed to learn in a self-supervised manner. We present a per-bar, numerical value recovery pipeline for bar charts, where a JEPA encoder is used to produce semantically rich latent features. The decoder model consuming these features is simple and quick to train and outputs the coordinates of ticks and bars, which can be used to recover bar values. The effectiveness of self-supervised finetuning and quality of the extracted features is evident when comparing our model to end-to-end supervised baselines. Code, datasets and checkpoints are available on \href{this https URL}{GitHub}.

27. 【2608.06060】Learning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval

链接：https://arxiv.org/abs/2608.06060

作者：Zelong Sun,Jun Wang,Kaicheng Yang,Tiancheng Gu,Ziyong Feng,Zhiwu Lu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：satisfy complex user, complex user intent, user intent expressed, Unified multimodal retrieval, Unified multimodal

备注： 26 pages,10 figures,14 Tables

点击查看摘要

Abstract:Unified multimodal retrieval aims to identify candidates that satisfy complex user intent expressed through heterogeneous inputs. Although Large Vision-Language Model (LVLM)-based retrievers are efficient and scalable, directly encoding raw multimodal inputs often misses fine-grained discriminative cues, leading to confusion among semantically similar candidates. Recent methods mitigate this limitation by generating Chain-of-Thought (CoT) rationales to enrich the query representation. However, such reasoning is typically derived from the query alone: it explains what the query describes, but not what the retriever misunderstands. We argue that effective retrieval reasoning should instead be conditioned on retrieval feedback. Based on this insight, we introduce UniME-R1, an embedder-adviser framework that learns to reason over initially retrieved candidates and generate Retrieval-Centric Chain-of-Thought (RC-CoT). The adviser analyzes candidates individually to identify the discriminative cues confused by the embedder. If the target appears in the initial top-k set, UniME-R1 directly reranks the candidates; otherwise, it generates RC-CoT to refine the retrieval direction and performs full-corpus re-retrieval with a dual-mode embedder. To train the framework, we mine hard negatives to simulate realistic retrieval failures, jointly optimize direct retrieval and RC-CoT-augmented retrieval, and align the adviser with retrieval outcomes through supervised learning and retrieval-oriented reinforcement learning. Extensive experiments on MMEB-V2 and a diverse set of general multimodal retrieval benchmarks demonstrate that UniME-R1 consistently improves retrieval performance over strong baselines.

28. 【2608.06059】DARAD: Dual Adapters and Ranking-Aware Distillation for Continual Remote Sensing Image-Text Retrieval

链接：https://arxiv.org/abs/2608.06059

作者：Xi Chen,Xu Chen,Xiangyang Jia,Wei Wang,Xu Zhang,Zhenyuan Sun

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Earth observation technologies, remote sensing image-text, making remote sensing, remote sensing archives, remote sensing

备注：

点击查看摘要

Abstract:With the rapid growth of Earth observation technologies, remote sensing archives are rapidly expanding, making remote sensing image-text retrieval (RS-ITR) increasingly important. However, continual RS-ITR remains challenging because scale variation and distribution shifts in RS aggravate cross-modal alignment space distortion, making it difficult for existing continual learning (CL) methods to support reliable continual retrieval. To address this challenge, we propose DARAD, a dual-adapter and ranking-aware distillation framework that preserves the historical cross-modal ranking structure while learning new visual and textual concepts from evolving archives. Specifically, the visual branch introduces a spatial fusion adapter, which integrates coarse regional cues and fine-grained patch cues to accommodate RS scale variation while anchoring visual updates to the pretrained alignment space. The textual branch employs multi-expert semantic routing, which separates shared textual semantics from semantically specialized residuals to absorb newly emerging descriptions while constraining global text embedding drift. Furthermore, bidirectional ranking distillation uses a frozen teacher model and historical anchors to preserve the historical cross-modal ranking structure, thereby mitigating alignment space distortion across continual stages. Experiments under a multi-stage continual retrieval protocol show that DARAD achieves superior performance over existing CL methods, improving adaptation to newly arrived data while maintaining effectiveness on historical data.

29. 【2608.06037】Integrating Implicit and Explicit Relational Biases through Graph-Based Multiple Instance Learning: A Case Study in Skin Lesion Diagnosis

链接：https://arxiv.org/abs/2608.06037

作者：Rafał Buler(1),Jakub Buler(1),Maciej Bobowicz(2),Michał Grochowski(1) ((1) Gdańsk University of Technology, (2) Medical University of Gdańsk)

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

关键词：capturing structural dependencies, dependencies among data, Relational inductive biases, essential for capturing, capturing structural

备注： Accepted as a short paper for presentation at the 21st International Conference on Computational Intelligence Methods for Bioinformatics and Biostatistics (CIBB 2026)

点击查看摘要

Abstract:Relational inductive biases are essential for capturing structural dependencies among data. This study investigates a dual-level relational framework for image classification, bridging the gap between implicit representation learning and explicit structural modelling. We begin by establishing a baseline using an EfficientNetB3 architecture. To move beyond standard convolutional biases, we adopt a patch-based strategy, employing a convolutional masked autoencoder to learn implicit inter-patch relationships through self-supervised reconstruction. We then extend this approach by incorporating explicit relational modelling, organizing the learned embeddings into various graph topologies, including grid-based, random, and k-nearest neighbour structures. Experimental results on the ISIC-2018 and ISIC-2019 skin lesion diagnosis benchmarks show that combining implicit inter-patch modelling with explicit graph-based message passing yields the best performance. On the ISIC-2018 test set, the baseline model achieves a balanced accuracy of 76.17%, which improves to 77.12% with implicit patch-based relational modelling. The fully integrated grid-structured Graph Attention Network further increases performance to 79.27%. Similarly, on ISIC-2019, the implicit approach reaches 59.84% balanced accuracy, while the combination of implicit and explicit modelling yields 60.67%.

30. 【2608.06030】PaCoNet: Deep Data Extraction for Parallel Coordinates

链接：https://arxiv.org/abs/2608.06030

作者：Poonam Poonam,Hannah Kniesel,Pere-Pau Vázquez,Timo Ropinski

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：current research focused, Extracting data, parallel coordinate, long challenged computer, focused on bar

备注： Accepted at ICPR 2026

点击查看摘要

Abstract:Extracting data from visualizations has long challenged computer vision, with current research focused on bar, line, and pie charts, among other low-dimensional visualizations. However, parallel coordinates as a widely used high-dimensional data visualization approach, remain largely unexplored in this context. As parallel coordinate plots can quickly become cluttered and difficult to interpret when poorly designed or densely populated, automated data extraction from such visualizations is of particular interest. In this paper, we propose PaCoNet, the first approach for parallel coordinate data extraction. PaCoNet not only extracts line coordinates, but also enables the extraction of individual data samples for further analysis. Towards this end, we make the following contributions. We present the first deep learning approach tailored for parallel coordinate analysis, and demonstrate that it outperforms unadapted baselines by a significant margin. We further introduce a large-scale parallel coordinate dataset for training and testing. Together, these key contributions enable for the first time the automated analysis and redesign of parallel coordinate plots. PaCoNet thus lays the groundwork for complex visualization analysis, and further advances the intersection of computer vision and data visualization. All code, trained models, and data generation scripts will be made publicly available upon acceptance of the paper.

31. 【2608.06014】Iterate or Widen? When Test-Time Refinement Helps LiDAR Scene Completion: A Controlled Study of Evidence Geometry, Training Coverage, and Compute

链接：https://arxiv.org/abs/2608.06014

作者：Shijie Hao,Weining Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：model spend extra, spend extra test-time, extra test-time compute, similar parameter budget, completion model spend

备注： 24 pages, 11 figures, 3 tables

点击查看摘要

Abstract:Should a completion model spend extra test-time compute by iterating, or spend a similar parameter budget on a wider one-shot predictor? The answer is easily confounded by denoising curricula, corruption augmentation, capacity, and unpaired evaluation. We study this question in LiDAR semantic scene completion by comparing a one-shot predictor, a parameter-matched wider predictor, and a weight-tied multigrid refiner initialized from the same frozen predictor. The protocol separates coherent region removal, independent thinning, range-dependent attenuation, and additive clutter while preserving exact scene-condition pairing. Across five training seeds and 815 SemanticKITTI sequence-08 frames, the full iterative system improves mIoU over the wide control by 0.911 points under contiguous angular removal, with a 95% moving-block bootstrap interval of [0.804, 1.040] that clears a predeclared 0.5-point practical margin. Under independent 75% thinning, iteration adds only 0.300 points [0.166, 0.436], whereas observation-family augmentation adds 5.975 points [5.662, 6.140]. Neither intervention repairs additive clutter. The iterative system also costs 10.74 ms and 0.75 GiB per frame, versus 6.25 ms and 0.23 GiB for the wide control. These results establish a geometry-conditioned empirical boundary rather than a universal advantage: coherent gaps can justify fixed-depth refinement, broadly thinned evidence is addressed more effectively by training coverage, and spurious evidence requires a different robustness mechanism.

32. 【2608.06009】Wan-Animate-2: Pushing the Application Boundaries of Character Animation

链接：https://arxiv.org/abs/2608.06009

作者：Guangyuan Wang,Li Hu,Dechao Meng,Zhongyi Zhang,Peng Zhang,Mingyang Huang,Ruoshi Zhang,Ke Sun,Zhe Zhang,Xingjun Wang,Gang Cheng,Bang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：image animation remains, computer vision, remains a foundational, foundational yet challenging, challenging task

备注： Project page: [this https URL](https://humanaigc.github.io/wan-animate-2/)

点击查看摘要

Abstract:Character image animation remains a foundational yet challenging task in computer vision. Existing approaches can be broadly categorized into three paradigms: methods based on explicit motion representations suffer from extraction errors and identity drift; methods based on implicit motion features lose fine-grained dynamics through compression; and in-context learning approaches avoid intermediate representations but incur prohibitive computational costs. Furthermore, all current systems are designed for offline synthesis, unable to meet the real-time requirements of interactive applications such as digital avatars and live-streaming hosts. To address these limitations, we present Wan-Animate-2, an end-to-end character animation framework that directly consumes the driving video within a redesigned Diffusion Transformer. Our architecture achieves superior motion fidelity and identity preservation by eliminating intermediate motion extractors entirely. We further introduce text driven viewpoint control that decouples the output camera perspective from the driving video--a capability rarely supported by prior character animation methods that rely on explicit motion representations. Beyond generation quality, we present Wan-Animate-2-Lite, an efficient variant that reduces inference latency to real-time thresholds through a three-stage training paradigm: teacher forcing pretraining with error buffer mechanism, and Self-Forcing distillation with chunk-wise backpropagation. This enables streaming character animation for interactive applications, opening new deployment scenarios that were previously infeasible. Qualitative evaluations and user studies demonstrate that Wan-Animate-2 achieves high-fidelity animation results across diverse characters and motion patterns. To foster further research and community development, we will release the Wan-Animate-2-Base model weights to the public.

33. 【2608.05983】Universal Concept Disruption for SAM3 Image Segmentation

链接：https://arxiv.org/abs/2608.05983

作者：Hao Wang,Yuxuan Zhang,Wei Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：grounding model decides, extends promptable segmentation, text-conditioned grounding model, extends promptable, matching instances

备注：

点击查看摘要

Abstract:SAM3 extends promptable segmentation from geometry-driven mask prediction to open-vocabulary concept segmentation, where a text-conditioned grounding model decides whether a concept is present and segments all matching instances. While this presence-gated design improves concept-level prediction, its adversarial robustness remains unexplored. In this paper, we introduce Universal Concept Disruption (UCD), the first universal cross-concept adversarial attack tailored to SAM3 image segmentation. UCD learns a single bounded image perturbation from (image, noun-phrase) pairs and attacks SAM3 as an integrated concept-grounding system. It jointly disrupts the text-conditioned input path, maximizes divergence in prompt-shared visual features, suppresses the final presence-gated concept scores, and corrupts the spatial validity of retained masks through area collapse and clean-mask Dice disruption. Across SACo-Gold, LVIS, RefCOCO, PhraseCut, and OpenImages datasets, UCD consistently outperforms all baselines under a matched evaluation protocol, reducing average mask AP from 59.43 to 18.73 and average cgF1 from 50.32 to 20.49. The learned perturbation also transfers to SAM3.1 and to SAM3 video inference without re-optimization, while prompt ensembling, lightweight head fine-tuning, and temporal filtering provide limited recovery.

34. 【2608.05979】Multi-Year Geospatial Reasoning using Interannually-Consistent Historical Predictions as a Free Input Modality

链接：https://arxiv.org/abs/2608.05979

作者：Syed Roshaan Ali Shah,Kasper Bonte,David Bekaert,Kristof Van Tricht,Dieter Wens

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：higher-level Earth observation, derive higher-level Earth, Machine learning, Earth observation, higher-level Earth

备注： 17 pages, 7 figures

点击查看摘要

Abstract:Machine learning, and deep networks in particular, are increasingly used to derive higher-level Earth observation (EO) products such as annual land-cover and crop-type maps. Many are generated operationally: each year a new acquisition is processed, typically with the same model, extending a multi-year archive. In the process these systems accumulate two kinds of useful signal that are almost never fed back into the model: the system's own archive of past predictions, and ancillary layers produced by other partners in a processing consortium. Both are normally used outside the network, as rule-based post-processing or a fixed input mask. Using the Copernicus Land Monitoring Service High Resolution Layer (HRL) Croplands crop-type product as a testbed, we show that bringing both signals inside the model turns a single-year, single-task pixel classifier into one that reasons across years. We introduce a Crop Type (CTY) embedding encoder that represents each past prediction as a confidence-scaled, time-ordered categorical token and attends over the year axis, and we study how the externally provided Base Vegetation Layer (BVL) mask should be represented in the model's inputs and outputs. To compare designs fairly when they relabel non-crop pixels, we evaluate on the 18 crop classes only and report precision and recall separately. On a pan-European dataset of about 5.4M labelled pixels, adding the prediction history raises crop-only F1 by 1.6 percentage points (pp) and, more importantly, corrects a recall-skewed error profile, with the largest gains on perennial and tree crops (olives +4.6, fruits +3.7, nuts +3.2 pp). Representing the BVL mask consistently in both the history and the target year adds about 2.5 pp on the crop classes. The approach is a low-cost recipe for any recurring geospatial or foundation model that emits class maps.

35. 【2608.05976】Diff-VF: Training-free High-quality Long Video Generation via Diffusion Model

链接：https://arxiv.org/abs/2608.05976

作者：Haoning Yang,Xinyuan Chen,Yaohui Wang,Guo Lu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：made great progress, video diffusion models, Weighted Window Sampling, diffusion models, Hybrid Noise Initialization

备注： Accepted for publication in ACM Transactions on Multimedia Computing, Communications, and Applications (TOMM)

点击查看摘要

Abstract:Recently, diffusion models have made great progress in video generation. However, most existing video diffusion models are trained with short videos, and degrade when extrapolated to long videos, struggling to maintain long-range temporal coherence while retaining diverse motions. To generate consistent, high-quality and dynamic long videos, we propose Diff-VF, a training-free, plug-and-play and model-agnostic framework that converts existing short-video diffusion backbones into long-video generators without modifying or fine-tuning the base model. Diff-VF couples three complementary strategies: Hybrid Noise Initialization (HNI) to constrain global semantics, Weighted Window Sampling (WWS) to remove inter-window discontinuities, and Temporal Extended Sampling (TES) to establish long-range dependencies with a timestep-varying fusion. We further extend Diff-VF to long-video enhancement via Skip Residual Guidance that balances fidelity and realism through timestep-dependent guidance. VBench-Long evaluation results show that Diff-VF achieves a more favorable balance between temporal coherence and motion diversity than base models and recent training-free long video generation baselines, including FreeNoise, FreeLong, and RIFLEx, while maintaining competitive frame-wise quality. Experiments on two base models demonstrate the applicability to video diffusion models with different spatial-temporal modeling strategies. Extensive ablations validate the contribution of each component and hyperparameters.

36. 【2608.05964】opology-Aware Neighborhood Learning for Source-Free Cross-Scene Hyperspectral Image Classification

链接：https://arxiv.org/abs/2608.05964

作者：Qingmei Li,Juepeng Zheng,Jiarui Zhang,Jianxi Huang,Haohuan Fu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：significantly improving discriminative, advanced cross-scene hyperspectral, cross-scene hyperspectral image, improving discriminative capability, hyperspectral image classification

备注：

点击查看摘要

Abstract:Domain adaptation has advanced cross-scene hyperspectral image classification, significantly improving discriminative capability in complex scenarios. However, privacy rules or storage limits often block access to data from the source domain. Conventional domain adaptation methods become impractical, severely restricting their utility in realistic remote sensing scenarios. To tackle this challenge, we propose a topology-aware source-free learning framework. We first introduce the entropy momentum pseudo-labeling (EMP) to refine k-means assignments by leveraging entropy-aware confidence and temporal prediction momentum. Under the guidance of the refined pseudo-labels, we further utilize the contextual neighborhood topology (CNT) to exploit the intrinsic geometric structure of the target feature space. Combining the global structural information extracted by collaborative representation with the local similarity information modeled by nearest neighbor search, the CNT accomplishes the comprehensive encoding of manifold-level geometric properties in the target domain feature space. The overall objective integrates cross-entropy on refined pseudo-labels, log inner product-based topology consistency, and an information-maximization term for balanced classification, ensuring stable adaptation in the source-free setting. Extensive experiments on three typical cross-scenarios demonstrate that the proposed method exceeds state-of-the-art performance, and ablation studies further validate the contribution of each module. The results highlight the critical role of topology-aware modeling in achieving robust and accurate classification without source data.

37. 【2608.05960】Big, Bright, or Invisible: A Frozen-Feature Benchmark of 3D CT Foundation Models

链接：https://arxiv.org/abs/2608.05960

作者：Maulik Chevli,Johannes Brandt,Rickmer Braren,Daniel Rueckert,Philip Müller

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Routine CT interpretation, entire scan volume, capturing incidental findings, inherently comprehensive, capturing incidental

备注：

点击查看摘要

Abstract:Routine CT interpretation is inherently comprehensive, capturing incidental findings across the entire scan volume. 3D CT foundation models could assist this process by providing generalizable representations of anatomy and pathology. To evaluate their diagnostic breadth, we benchmark ten frozen CT encoders across three cohorts of thoracic CT scans, including an unseen internal clinical dataset, using $k$-nearest neighbors, zero-shot prompting, and linear probing. We find no universal state-of-the-art, with rankings fluctuating significantly depending on the evaluation context. While models combining fine-grained image tokenization with vision-language alignment generally perform best, a lightweight supervised encoder remains highly competitive, demonstrating that explicit labels can effectively substitute for scale. Crucially, rather than model architecture, we observe that the primary determinant of performance is a physical bottleneck: a finding's detectability scales with its contrast against surrounding tissue and its spatial extent. Through controlled within-organ comparisons, we empirically demonstrate that widespread or high-contrast abnormalities, such as devices and effusions, are reliably recovered. Conversely, small, low-contrast focal lesions remain a persistent challenge across all evaluated encoders. We attribute this to the inherent limitations of globally pooled embeddings, suggesting that accurately representing small, low-contrast structures will require region- or lesion-level pretraining.

38. 【2608.05954】raining a Conditioned Video Game Agent on a VLM Annotated Dataset

链接：https://arxiv.org/abs/2608.05954

作者：Katrin Schmid,Iuri Frosio

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Reinforcement Learning, policy learning, Learning, Vision Language Models, Reinforcement

备注：

点击查看摘要

Abstract:Reinforcement Learning (RL) is a powerful but far from easy-to-use technique for policy learning. In the specific case of video games, access to the game engine is required to get rewards for training (e.g. to collect rewards from the environment). Furthermore, the proper identification and weighting of the rewards generally requires a difficult trial-and-error approach. Lastly, rewards are often sparse and understanding how they eventually affect the learned policy is a non-trivial exercise. To ease these issues we propose annotating a video game dataset with Vision Language Models (VLMs) instructed to extract human defined rewards. We show that offline RL can then be used to train a conditioned agent that responds accordingly to the desired returns and we discuss the difficulties and limitations that emerged in our early experiments.

39. 【2608.05949】VLMs for Videogame Data Annotation

链接：https://arxiv.org/abs/2608.05949

作者：Katrin Schmid,Iuri Frosio

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Vision Language Models, Vision Language, Language Models, Artificial Intelligence, engineers approach complex

备注：

点击查看摘要

Abstract:Vision Language Models (VLMs) and Artificial Intelligence (AI) agents have revolutionized how engineers approach complex problems in real-world applications. Their adoption in video games is on the other hand limited by the extreme variability of the synthetic scenarios and their poor compliance with real-world physics. Here we investigate the use of VLMs for annotating video game frame sequences with reward signals, a task with several potential applications including, among others, conditioned training and offline reinforcement learning. We show that VLMs often struggle to answer basic questions on racing video games (although we observed a similar behavior on other game genres) and discuss countermeasures such as VLM output mixing and prompt optimization. We also show how input sequence length, resolution, and question batching affect the annotation quality and its token consumption.

40. 【2608.05948】GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models

链接：https://arxiv.org/abs/2608.05948

作者：Shuai Wang,Yaxin Feng,Xuekun Jiang,Shihan Tian,Ningyu Yan,Xing Shen,Chaoyang Lyu,Hui Wang,Yunsong Zhou,Hanqing Wang,Jiangmiao Pang,Yang Xiang,Xing Gao,Chunhua Shen,Weinan Zhang

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：facilitate large-scale training, video world models, engines facilitate large-scale, generative video world, Physics engines facilitate

备注：

点击查看摘要

Abstract:Physics engines facilitate large-scale training and evaluation for embodied intelligence, while generative video world models are emerging as implicit simulators of future states and interactions. However, existing evaluations of physical fidelity are often conducted in isolation and rely heavily on perceptual similarity or human judgments, providing limited insight into which physical principles or parameters are violated. We introduce GAUGE, a real-world-grounded diagnostic benchmark for jointly evaluating how numerical simulators and generative video world models reproduce or deviate from real-world physics. It comprises 22 controlled task families covering rigid bodies, flexible cables, textiles, and volumetric deformable objects. Grounded in real-world trajectories and paired with calibrated physical metadata, uncertainty annotations, and task-specific observables, these tasks cover fundamental physical processes including collision, friction, momentum transfer, oscillation, self-contact, and deformation across diverse materials and conditions. We benchmark Isaac Sim, Genesis, and Newton on 14 task families using generalized trajectory errors, and evaluate 6 image-to-video models on 5 rigid-body tasks by testing physical-law consistency and the temporal stability of inferred parameters. Our results reveal no uniformly faithful physics engine, with the largest discrepancies arising in impulsive contact, rapid textile motion, and volumetric deformation. We further find that video world models can produce trajectories with the expected equation form while recovering incorrect accelerations, momentum transfer, and oscillation timing. GAUGE lays the groundwork for developing more physically faithful simulators and world models for embodied intelligence.

41. 【2608.05945】Respect Your Zero-Shot Uncertainty: Conservative Calibration for Test-Time-Adapted Vision-Language Models

链接：https://arxiv.org/abs/2608.05945

作者：Jingyan Jiang,Yaru Sun,Xiao Chen,Jiazhen Huang,Caiting Li,Zhijian He,Yin Chen,Pingting Hao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Test-time adaptation, downstream decision-making, making predictive confidence, improve the recognition, vision-language models

备注：

点击查看摘要

Abstract:Test-time adaptation (TTA) can improve the recognition accuracy of vision-language models under distribution shift, but often degrades calibration, making predictive confidence unreliable for downstream decision-making. Many existing label-free calibration approaches are either coupled to prompt optimization or rely on logit-range statistics that provide only a coarse characterization of the predictive distribution. We show that TTA can increase confidence and reduce entropy even when the top-1 prediction and its correctness remain unchanged, a failure mode we term prediction-preserving sharpening. Across diverse TTA methods and benchmarks, larger entropy reductions relative to paired zero-shot predictions are associated with greater increases in Expected Calibration Error (ECE). On entropy-reduced samples, confidence gains also tend to exceed accuracy gains. Based on these findings, we propose Zero-Shot-Anchored Entropy Calibration (ZAEC), a label-free post-hoc method that uses zero-shot entropy as a sample-specific uncertainty reference. ZAEC selectively restores the zero-shot entropy of sharpened predictions through minimal temperature scaling while leaving all other predictions unchanged. It requires no labeled calibration data or learned parameters and preserves class rankings and classification accuracy. Across five TTA methods and 15 datasets, ZAEC achieves the lowest post-hoc macro-average ECE on ViT-B/16, with consistent gains on RN50.

42. 【2608.05938】MirrorNet: Can Medical Image Anonymization Really Protect Patient Identity?

链接：https://arxiv.org/abs/2608.05938

作者：Attila Simkó

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：renders them anonymous, public benchmarks, metadata removed, cross-sectional medical image, routinely de-identified

备注：

点击查看摘要

Abstract:Medical images are routinely de-identified---names, dates, and other metadata removed---and then shared for research, teaching, and public benchmarks under the assumption that this renders them anonymous. Such de-identification protects the metadata but not the pixels, and---apart from scans that directly contain facial structures---whether the image content itself identifies the patient has received little scrutiny. We investigate this question by learning a cycle-consistent correspondence between a cross-sectional medical image and a non-medical, patient-identifying image, using a pair of coupled, cycle-consistent variational autoencoders. From a held-out scan, the model recovers a recognisable likeness of the patient (identity-region MAE = 0.163); conversely, it synthesises a scan from such an image. These results indicate that a de-identified medical scan remains identifying---it is, in effect, a photograph of the patient---and that imaging data should be governed as biometric data rather than as anonymisable records. To support reproducibility, the code and trained models are shared at this https URL.

43. 【2608.05920】Floating Radiance Networks

链接：https://arxiv.org/abs/2608.05920

作者：Krzysztof Byrski,Rafał Tobiasz,Grzegorz Wilczyński,Mikołaj Zieliński,Dawid Baran,Dominik Belter,Jacek Tabor,Przemysław Spurek

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：photorealistic novel-view synthesis, conventional graphics workflows, methods remain tightly, remain tightly coupled, Recent advances

备注：

点击查看摘要

Abstract:Recent advances in neural scene representations enable photorealistic novel-view synthesis, yet most methods remain tightly coupled to a single rendering paradigm, limiting their versatility and integration with conventional graphics workflows. We introduce Floating Radiance Networks (FlaRe), a neural scene representation combining explicit ray-traceable geometry with continuous neural radiance functions. A scene is represented by floating planar generalized Gaussian primitives, each carrying a compact latent descriptor of a local radiance field. A lightweight decoder shared across the scene maps this descriptor, local surface coordinates, and viewing direction to color and opacity. This formulation preserves the expressiveness of neural fields while providing an explicitly addressable structure that can be efficiently queried and manipulated. Hardware-accelerated primitive intersections enable interactive rendering and recursive ray-tracing, including reflections, refractions, transparency, and shadows. The same representation further supports primitive-level deformation, mesh extraction, and appearance stylization directly in its learned descriptor space. Experiments across standard reconstruction benchmarks demonstrate competitive rendering quality while using a compact set of primitives. Together, these results establish FlaRe as a versatile representation that brings high-fidelity neural rendering, ray-tracing, geometric manipulation, and appearance editing into a unified scene model. Source code is available online. Source code can be found at: this https URL

44. 【2608.05911】Mapping Armenian Paris: Extracting and Geocoding Commercial Advertisements from the 20th-Century Diaspora Press

链接：https://arxiv.org/abs/2608.05911

作者：Chahan Vidal-Gorène(CJM, LIPN),Seda Kirakosyan(UFAR),Edita Matevosyan(UFAR)

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Parisian Armenian commercial, Armenian commercial community, Parisian Armenian, digitised Armenian press, Western Armenian press

备注：

点击查看摘要

Abstract:This paper presents an end-to-end, IIIF-based pipeline that turns the digitised Armenian press of France into an interactive map of the 20th-century Parisian Armenian commercial community. On each page, commercial advertisements are located, read, and parsed into structured records, which are then geocoded and placed on the map. Western Armenian is under-resourced and unsupported by off-the-shelf layout and OCR models, so the pipeline uses vision-language models (VLMs) as a data-bootstrapping strategy: they produce usable structured records at a scale hand annotation could not reach, and stay reliable on the strongly curved scans where conventional line-level CRNN OCR breaks down. The contribution includes a 500-page Western Armenian press corpus with 3,270 advertisement-level annotations, a Label Studio template that captures detection and semantic fields in a single annotation pass, and a reproducible workflow transposable to other under-resourced historical corpora. More broadly, the work shows that VLM-driven data bootstrapping is an effective lever for under-resourced historical languages such as (Western) Armenian.

45. 【2608.05903】Robust-WAM: Bridging Generative Pretraining and Semantic Foresight in World-Action Models

链接：https://arxiv.org/abs/2608.05903

作者：Haodong Yan,Junfeng Li,Junjie He,Zhide Zhong,MingMing Yu,Wenxuan Song,Jiaguan Zhu,Yangyang Zheng,Yuqiao Du,Jiadi You,Yingjie Cai,Xu Yan,Guanyi Zhao,Bingbing Liu,Haoang Li

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Mainstream World-Action Models, adapt pretrained video, pretrained video generation, Mainstream World-Action, video generation models

备注：

点击查看摘要

Abstract:Mainstream World-Action Models (WAMs) adapt pretrained video generation models (VGMs) for robot control, transferring their learned dynamics prior for action prediction. These VGMs are typically trained in a variational autoencoder (VAE) latent space. However, the VAE latent space is optimized for pixel reconstruction, which rewards fine appearance detail and leaves the action prediction fragile under visual shifts. Recent works build WAMs in semantic latent space, which are more robust to appearance shifts. However, these models cannot leverage the large-scale VGM pretraining that exists only in VAE space. To overcome this dilemma, we propose Robust-WAM, a general post-training method for video-generation-based WAMs that preserves the VAE-based generative path and adds a lightweight semantic foresight alignment objective on the action stream. This retains the large-scale VGM pretraining while grounding actions in appearance-invariant dynamics that stay reliable under illumination shifts and other visual out-of-distribution conditions. Specifically, we employ learnable query tokens to bring future-scene semantics into the action stream by aligning their output hidden states with the semantic foresight of future ground-truth frames. To establish the temporal correspondence between each query and the future step it describes, we give it the positional encoding of the matching action tokens. Experiments on out-of-distribution generalization simulation benchmarks and a real-robot setup show that our Robust-WAM consistently improves the success rates of multiple WAM baselines without sacrificing in-distribution performance.

46. 【2608.05879】o See a World in a Living Context: Unified Indoor-Outdoor Urban World Generation

链接：https://arxiv.org/abs/2608.05879

作者：Xiaobin Huang,Zilong Huang,Yang Luo,Hongchao Fan,Yiping Chen,Ting Han

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：detailed indoor scenes, large-scale outdoor environments, creating large-scale outdoor, synthesized independently, advanced rapidly

备注： 9 pages, 4 figures

点击查看摘要

Abstract:Text-driven 3D generation has advanced rapidly in creating large-scale outdoor environments and detailed indoor scenes, but these domains are usually synthesized independently, lacking the correspondence required for a coherent urban world. We present HoloWorld, a unified indoor-outdoor urban world generation framework built on a continuously updated cross-scale world context. Initializing from a user description, HoloWorld progressively represents and updates the diverse world information, from city-scale planning to individual buildings, allowing generated interiors to maintain explicit correspondence with their associated exterior buildings. Conditioned on the evolving context and previously generated neighboring blocks, HoloWorld autoregressively generates urban exteriors with consistent spatial organization and visual identity across blocks. The generated exterior representations are further grounded in 3D building instances and footprints, enabling building-specific indoor generation with geometry-constrained layouts and inherited appearance characteristics. To our knowledge, HoloWorld is the first framework to unify indoor and outdoor generation within a coherent 3D urban world. Extensive experiments demonstrate that HoloWorld achieves superior urban exterior generation performance, improving the average AQS score over the SOTA by 7.68\% and obtaining the highest average RDR score, while maintaining strong building-level indoor-outdoor correspondence and cross-block continuity within a unified 3D urban world.

47. 【2608.05878】MAVISEG: Manifold Propagation and Visual Prototypes for Zero-Shot Open-Vocabulary Segmentation in Diffusion Transformers

链接：https://arxiv.org/abs/2608.05878

作者：Rajatsubhra Chakraborty,Xujun Che,Ritabrata Chakraborty,Xi Niu,Depeng Xu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：open-vocabulary semantic segmentation, zero-shot open-vocabulary semantic, training-free zero-shot open-vocabulary, making them strong, semantic segmentation

备注： 20 pages, 14 figures, 9 tables. Preprint under review

点击查看摘要

Abstract:Text-to-image diffusion transformers learn about objects and scenes by learning to generate them, making them strong candidates for training-free zero-shot open-vocabulary semantic segmentation. State-of-the-art attribution methods score each pixel independently, comparing its features against a fixed text-derived class representation, whether as an output-space similarity or as a cross-attention weight. This discards structured signals the model itself exposes: the temporal structure of the generative trajectory, the visual appearance statistics of each concept, and the image's own pairwise feature geometry. We present MAVISEG, a training-free refinement layer that recovers these signals. Because its operators consume only a pixel-by-concept score field and a pixel feature space, MAVISEG is capture-agnostic rather than tied to one attribution method. Across six benchmarks it achieves the strongest overall results among training-free methods, including the best mIoU on every benchmark. Interestingly, gains are largest where the initial capture is weakest, and individual operators contribute depending on the noise in the field they refine. Our results indicate that diffusion transformers carry more concept-level information than current attribution methods recover, and that much of it is lost on the way to the mask rather than absent from the model.

48. 【2608.05877】D-CLOT: Double Closed Loop Optimal Transport for Unsupervised Action Segmentation

链接：https://arxiv.org/abs/2608.05877

作者：Elena Bueno-Benito,Mariella Dimiccoli

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Optimal transport, unsupervised action segmentation, effective framework, action segmentation, action prototypes

备注：

点击查看摘要

Abstract:Optimal transport (OT) has emerged as an effective framework for unsupervised action segmentation. Yet, in existing OT-based methods, the latent action prototypes that define the OT costs are not re-estimated from the refined frame geometry. Instead, they evolve solely through gradients from the pseudo-label loss. We identify this \emph{representation--prototype inconsistency} as a central bottleneck, particularly around ambiguous transitions and for short or infrequent actions. To address this issue, we build on the recently introduced CLOT, which refines frame embeddings based on estimated segment embeddings, and further re-estimates the action prototypes from the refined frame embeddings. Specifically, we introduce a graph-constrained module that regularizes the OT-refined frame and segment representations by preserving the local neighborhood geometry of the encoder output. An action-embedding refinement step then periodically re-anchors the prototypes to this stabilized representation geometry. We study two instantiations that share the same backbone, graph module, and objective: D-CLOT updates the prototypes using $k$-means, whereas D-CLOT$_{B}$ updates them as OT barycenters weighted by the refined transport plan, yielding an assignment-aware prototype update consistent with the current transport geometry. Across five established benchmarks, both variants improve segment-level quality over CLOT, with per-video gains of up to $+12.7$ F1 and $+10.2$ mIoU (YTI) and activity-level gains of up to $+8.9$ F1 (FS-Eval). We further establish the first unsupervised action-segmentation baseline on Assembly101, a procedural and substantially more fine-grained benchmark than those commonly used in prior work. Extensive ablations and sensitivity analyses demonstrate that the two refinement mechanisms are complementary and robust.

49. 【2608.05858】Shape-Aware Oriented Bounding Box (OBB) to Horizontal Bounding Box (HBB) Conversion

链接：https://arxiv.org/abs/2608.05858

作者：Badha Rathna Sabhapathy,Gotam Dahiya,Vishesh Vatsal

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Accurate object detection, Horizontal Bounding Boxes, Accurate object, Bounding Boxes, Oriented Bounding Boxes

备注： 8 pages

点击查看摘要

Abstract:Accurate object detection in aerial and satellite imagery is dependent upon the bounding box representation. This is especially true for spatially oriented objects such as ships or aircrafts. Oriented Bounding Boxes (OBB) have a tighter fit and more robust non-max suppression compared to Horizontal Bounding Boxes (HBB), any current post-processing conversion from OBB to HBB either introduces excess empty and background space or removes data from the detection. This paper introduces a novel approach for a shape-aware OBB-to-HBB conversion for ship detection in remote sensing imagery. It leverages hull shape, hull fullness, and the bounding box orientation to produce a tighter axis-aligned HBB representation. The proposed method is benchmarked against three baselines methods for OBBto-HBB conversion, Outer HBB which uses minimum and maximum, Area Equivalent HBB and GBB Marginalized HBB.

50. 【2608.05848】DTRNet: Dual Text-Radical Decoding for Handwritten Chinese Text Recognition with Faked Character Detection

链接：https://arxiv.org/abs/2608.05848

作者：Runrui Li,Lin Zhu,Hua Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：handwritten Chinese text, transcribe student writing, handwritten Chinese, educational scenarios, Chinese text recognition

备注： Accepted by ACM MM 2026 (Oral)

点击查看摘要

Abstract:In K-12 educational scenarios, handwritten Chinese text recognition should not only transcribe student writing, but also detect faked characters. However, existing recognition models are usually confined to a predefined set of normal characters and therefore cannot explicitly identify faked characters. Existing detection methods exhibit complementary limitations: character-level methods provide interpretable structural evidence but suffer from low efficiency, whereas line-level methods are efficient but rely heavily on confidence scores, making them prone to missed detections and lacking explicit structural evidence. Thus, the key challenge is to preserve character-structural evidence independent of contextual inference while maintaining line-level efficiency. To this end, we propose DTRNet, a dual Text-Radical decoding framework for line-level faked character detection. DTRNet decouples context-aware text recognition from character-wise structural verification, where the text branch performs line-level transcription and the radical branch predicts legal Ideographic Description Sequences (IDS) for lexicon-based faked character judgment. We further introduce IDS-Guided Confidence Adjustment (IGCA) to refine text predictions using structural evidence during inference. Experimental results demonstrate that DTRNet effectively detects faked characters while maintaining strong recognition performance and providing interpretable radical-level evidence. Code, checkpoints, and the processed dataset are publicly available at this https URL.

51. 【2608.05844】Curia-MAE: Multi-Modal Multi-Anatomy MAE Pre-Training for 3D Medical Image Segmentation

链接：https://arxiv.org/abs/2608.05844

作者：Théo Danielou,Antoine Saporta,Léo Alberge,Corentin Dancette

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Radiology foundation models, learn transferable representations, Radiology foundation, foundation models learn, models learn transferable

备注： Accepted at ECCV 2026 Workshop AI4M3D

点击查看摘要

Abstract:Radiology foundation models learn transferable representations that can be adapted to new tasks by training only small layers on top of a frozen encoder. Dense prediction tasks such as 3D segmentation are, however, underrepresented in their evaluation, and, with the encoder kept frozen, pre-trained models still fall short of nnU-Net, the state-of-the-art reference trained from scratch. To close this gap we extend convolutional MAE pre-training with a robust reconstruction objective, a feature regularizer, and a local-global similarity objective. Using this method, we propose Curia-MAE, a multi-modal, multi-anatomy MAE model pre-trained on 300,000 CT and MRI images covering a large number of anatomical sites. On eight anatomy- and lesion-focused segmentation benchmarks, Curia-MAE improves frozen-encoder performance over a strong MAE baseline, while remaining competitive under full finetuning and superior on lesion tasks, where labeled data is scarce. These results indicate that a single frozen encoder can be reused across diverse segmentation tasks, reducing the cost of adapting and deploying such models in clinical workflows. We will make our pre-trained model weights publicly available.

52. 【2608.05843】Overcoming Attention Drift: Homogeneity-Heterogeneity Guided Feature Aggregation for Low-Light Remote Sensing Image Enhancement

链接：https://arxiv.org/abs/2608.05843

作者：Yaozi Zhong,Xingxing Yang,Shaohui Mei,Mingyang Ma

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Restoring high-fidelity remote, extreme low-light degradation, Restoring high-fidelity, downstream machine vision, machine vision

备注： 10 pages, 7 figures, 7 tables. Yaozi Zhong and Xingxing Yang contributed equally. Code: [this https URL](https://github.com/AlexYangxx/HALO)

点击查看摘要

Abstract:Restoring high-fidelity remote sensing imagery from extreme low-light degradation is indispensable for reliable Earth observation and downstream machine vision. However, under severe noise and illumination corruption, existing methods suffer from attention drift, erroneously aggregating features across distinct physical boundaries and causing severe structural blurring and color distortion. To address this, we propose HALO, a dual-prior-driven enhancement framework that formulates enhancement as a guided feature aggregation problem driven by foundation model priors. Specifically, an illumination-invariant semantic prior provides regional homogeneity as a positive bias for content-consistent aggregation, while a pseudo-3D topological prior provides boundary heterogeneity as a negative penalty to strictly prevent cross-boundary confusion. To cooperatively incorporate these two priors, we propose a Homogeneity-Heterogeneity Cooperative Attention Module (H2CAM) to resolve feature conflicts during cross-modal prior fusion. Extensive experiments demonstrate that HALO achieves state-of-the-art performance across 8 challenging synthetic and real-world remote sensing benchmarks, significantly improving physical boundary sharpness and color fidelity while maximizing the preservation of discriminative features for downstream Earth observation tasks.

53. 【2608.05840】Accurate Localization of Road Traffic Objects on the Road Plane Using Surveillance Camera Imagery

链接：https://arxiv.org/abs/2608.05840

作者：Jan Gawroński,Witold Czajewski

类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词：traffic conflict analysis, intelligent transportation systems, Accurate vehicle localization, monocular roadside surveillance, traffic monitoring

备注： 8 pages, 7 figures. Accepted for publication in the proceedings of the 2026 Progress in Applied Electrical Engineering (PAEE) conference

点击查看摘要

Abstract:Accurate vehicle localization from monocular roadside surveillance cameras is important for intelligent transportation systems, traffic monitoring, and traffic conflict analysis. Standard approaches often estimate vehicle position from the center of the detector bounding box, which can produce large errors due to perspective distortion and parallax, especially for elevated cameras and large vehicles. This paper proposes a two-stage geometry-aware localization pipeline that estimates the projection of the vehicle footprint onto the road plane. First, vehicles are detected using a YOLO26-based detector. Second, a dedicated ResNet34 regression network predicts four corner points corresponding to the projected vehicle base. The final position is computed as the geometric center of the predicted quadrilateral. The method was trained on synthetic data generated in CARLA and fine-tuned on real-world roadside imagery from DAIR-V2X. Experiments on synthetic and real data showed clear improvements over naive bounding-box-center localization. On DAIR-V2X, the mean image-space localization error decreased from 31.77 px to 15.30 px, a 51.8% improvement, while the median error decreased to 4.29 px. Median ground-plane error for medium-range vehicles decreased from 5.52 m to 0.90 m, and for far-range vehicles from 8.67 m to 1.84 m. The results also show that contextual information surrounding the detector bounding box is important for geometric localization. The largest gains were observed for distant vehicles and geometrically challenging cases affected by strong perspective distortion and parallax.

Comments:
8 pages, 7 figures. Accepted for publication in the proceedings of the 2026 Progress in Applied Electrical Engineering (PAEE) conference

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

Cite as:
arXiv:2608.05840 [cs.CV]

(or
arXiv:2608.05840v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.05840

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Witold Czajewski [view email] [v1]
Thu, 6 Aug 2026 10:07:53 UTC (14,995 KB)

54. 【2608.05834】Controllable Clothing: Precise Labels and Generation for Virtual Try-On with Latent Diffusion Models

链接：https://arxiv.org/abs/2608.05834

作者：Max Rehman Linder

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：guiding image generation, context of Virtual, technical report, proposed method leverages, VITON

备注：

点击查看摘要

Abstract:In this technical report, I present a new method for guiding image generation in the context of Virtual- Try-On (VITON). The proposed method leverages new open source Ai models to augment the image data with labels, such as lengths and styles. By training adapters with these labels paired with images of the garments, the model can produce a more diverse set of images that the user can control. For the end user, such as a retailer, this means that they can assure that the produced image is as true to the true fit as possible, not misleading consumers

55. 【2608.05815】Bayesian adaptively-weighted ensembles for few-shot abdominal segmentation

链接：https://arxiv.org/abs/2608.05815

作者：Abbas Al-Sabbagh,Shalom F. Mushtaq,Tomás M. da Silva,Kushagra Soni,Binawei Gbamila,Sri Atluri,Qianye Yang,Yipeng Hu,Claire C. Villette,Shaheer U. Saeed

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：data are scarce, promising approach, Few-shot learning, few-shot learning algorithms, Few-shot

备注： Accepted at DEMI at MICCAI 2026 - The 4th MICCAI Workshop in Data Engineering in Medical Imaging

点击查看摘要

Abstract:Few-shot learning has emerged as a promising approach for anatomical segmentation when labelled data are scarce. However, different few-shot learning algorithms exhibit complementary strengths and weaknesses, with performance varying across anatomical targets and institutions. Existing few-shot segmentation ensembles, that combine predictions from multiple algorithms, typically employ fixed weighting schemes and therefore cannot adjust model contributions according to the target domain. In this work, we propose a Bayesian adaptively-weighted ensemble framework for segmentation under label scarcity and domain shift. Multiple few-shot segmentation algorithms are first adapted using a small labelled support set. Bayesian optimisation is then used to automatically identify ensemble weights that maximise segmentation performance on a target-domain validation set. The learned weights are subsequently fixed and applied to combine predictions on previously unseen query images from the target domain. The proposed framework is evaluated on the Cross-institution Male Pelvic Structures dataset using held-out anatomical structures and institutions to simulate simultaneous label scarcity and institutional domain shift. Results demonstrate statistically significant improvements over individual few-shot learners, fixed-weight ensembles, training-from-scratch baselines and recent state-of-the-art ensembling approaches. By adapting model contributions to the target anatomy and institutional domain, the proposed framework provides a practical mechanism for deploying segmentation systems to new clinical sites under severe annotation constraints.

56. 【2608.05811】Energy-Guided Flow Matching

链接：https://arxiv.org/abs/2608.05811

作者：Haoyang Tong(1 and 2),Yu He(2),Fang Li(2),Lichen Ma(2 and 3),Jingling Fu(2),Dong Chen(2),Zhen Chen(2),Junshi Huang(2),Jie Cao(1) ((1) MAIS amp; NLPR, CASIA, (2) a href="http://JD.com" rel="external noopener nofollow" class="link-external link-http"this http URL/a, (3) Xi'an Jiaotong University)

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：lossy latent compression, bypass lossy latent, necessitate joint learning, Pixel-space generative models, models bypass lossy

备注： 19 pages, Code: [this https URL](https://github.com/ysng123/EG-FM)

点击查看摘要

Abstract:Pixel-space generative models bypass lossy latent compression, yet necessitate joint learning of global structure and fine-grained details in a high-dimensional space. Standard flow matching interpolates noise toward a fixed clean-image endpoint, leaving the spectral evolution to be learned implicitly. In this paper, we introduce Energy-Guided Flow Matching(EG-FM) that explicitly models a coarse-to-fine generative trajectory by moving endpoint. Specifically, EG-FM replaces the fixed endpoint with a heat-kernel-filtered endpoint that evolves smoothly from low-frequency image to clean this http URL fraction of high-frequency signal in moving endpoint is released by an image-specific energy-guided scheduling, leading to the re-targeting of velocity in flow this http URL framework requires no adaptation of the backbone and training data, bringing negligible cost on the training and inference stages. In our experiment, EG-FM consistently achieves lower FID on the ImageNet class-conditional image generation task at $256 \times 256$ with fewer epochs, reaching an FID of 1.55 at 200 epochs and 1.45 at 600 epochs. We continue training the generation task on the setting of $512 \times 512$ resolution, yielding a FID of 1.58 after only 40 high-resolution adaptation this http URL, we transfer EG-FM on text-to-image generation and achieve 0.85 on GenEval score and 83.9 on DPG-Bench. Code is available at this https URL.

57. 【2608.05808】STAIL: Semantic Text-Anchored Incremental Learning for Medical Imaging via Large Language Models

链接：https://arxiv.org/abs/2608.05808

作者：Songpan Gao,Yajie Zhang,Guanxing Chen,Jiayu Qian,Zhenzhen Liu,Shijun Li,Xiaowei Zhu,Yao Hu,Kay Chen Tan,Yu-An Huang,Shiqi Wang,Zhi-An Huang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Deep learning models, image analysis suffer, Deep learning, severe catastrophic forgetting, dynamic environments

备注：

点击查看摘要

Abstract:Deep learning models applied to medical image analysis suffer from severe catastrophic forgetting when continually adapting to new clinical tasks in dynamic environments. Mainstream incremental learning methods typically mitigate this by rehearsing raw historical images. However, this pixel-level rehearsal incurs significant storage overhead, raises privacy concerns, and fails to adequately capture the true data distribution with sparse exemplars. Inspired by human cognitive mechanisms, we propose a novel framework termed Semantic Text-Anchored Incremental Learning (STAIL) for sequential clinical tasks. To overcome the rehearsal bottleneck, STAIL introduces an asymmetric semantic consolidation buffer (SCB). By incorporating a minimal set of image anchors and extensive textual descriptions, the SCB enables dense semantic reconstruction of old tasks at a minimal storage cost. Furthermore, we design an LLM-derived Semantic Anchoring Mechanism (LSAM) that leverages the stable semantic space of frozen large language models as developmental priors. This mechanism explicitly anchors evolving visual features to textual representations, guiding and constraining plasticity and stability at both macroscopic and microscopic levels. Extensive experiments across three heterogeneous medical datasets, covering fundus, ultrasound, and X-ray imaging, demonstrate that STAIL acts as a highly effective plug-and-play module. It comprehensively enhances the performance of various existing baselines, achieving average gains of 2.24\% in AAA-AUC for sustained performance and 3.55\% in BWT-AUC for reduced forgetting. Code is available.

58. 【2608.05804】Ordered Diffusion for 3D Human Registration

链接：https://arxiv.org/abs/2608.05804

作者：Mattia Masiero,Ilya A. Petrov,Daniel Cremers,Gerard Pons-Moll,Riccardo Marin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：unique ground-truth alignment, ground-truth alignment exists, regression task, assuming a unique, historically been treated

备注： Accepted at GCPR 2026

点击查看摘要

Abstract:3D human registration has historically been treated as a regression task, assuming a unique ground-truth alignment exists between the template and an input point cloud. In reality, acquisition noise, occlusions, and unknown soft tissue dynamics introduce inherent ambiguity into human scans. Regression-based methods consequently converge to an average prediction, often failing to represent a plausible geometry. In our work, we embrace such uncertainty by modeling the registration as a distribution of alignments. We propose ODin, which formulates registration as a 3D diffusion process that generates a point cloud aligned with the target geometry while preserving template semantics through consistent point ordering. To achieve this, ODin relies on global, local, and positional conditioning, guiding each point to its correct location. Our experiments demonstrate that such a generative formulation not only outperforms its regression-based baseline, but also establishes a new state of the art, surpassing highly engineered methods while reducing the registration time by two-thirds. Pre-trained models and code are available at this https URL.

59. 【2608.05803】Vorch-Omni: Multi-Task Orchestration of Sight and Sound

链接：https://arxiv.org/abs/2608.05803

作者：Vorch Team,Xiaoyu Chen,Yang Ding,Cong Han,Menglin Han,Yuxin Hong,Jiebo Hou,Zequn Jie,Xiang Li,Jing Liu,Qi Liu,Yulei Lu,Siyuan Luo,Lin Ma,Xin Ma,Yinlong Qian,Peng Shi,Fang Wan,Siqi Wang,Yaohui Wang,Yaole Wang,Yidi Wu,Siqian Yang,Mingyu Yin,Haoran Yu,Gang Yue,Lisai Zhang,Yuting Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent advances, generative video modeling, advances in generative, modeling have enabled, existing approaches

备注： Project Page: [this https URL](https://vorch-project.github.io/Vorch-Omni-project/)

点击查看摘要

Abstract:Recent advances in generative video modeling have enabled diverse generation, reference-based synthesis, extension, and editing, but existing approaches often rely on fragmented task-specific models. A general model must distinguish heterogeneous target, source, and reference signals to determine what to generate, preserve, or use as guidance, while reducing interference among tasks. Joint audio-visual generation further increases this challenge by introducing diverse conditioning and output configurations across modalities. We present Vorch-Omni, a unified multi-task framework for audio-visual synthesis based on an arbitrary-condition-to-arbitrary-output formulation. It flexibly treats video and audio signals as either conditioning inputs or generation targets. Token-level conditioning masks and task identifiers distinguish targets, source content, and references, while position types separate temporal context from independent conditions. To capture semantic and structural information, Vorch-Omni employs complementary visual conditioning pathways: a vision-language model interprets sampled frames with text instructions, and a video VAE encodes conditions into latent tokens for direct guidance. We further build a distributed data pipeline to curate diverse temporally aligned audio-visual clips, generate structured captions and metadata, and balance heterogeneous task distributions. Built on a single flow-matching diffusion transformer without task-specific architectural changes, Vorch-Omni supports over 10 tasks, including text-to-video, text-to-audio-video, image- and reference-conditioned generation, temporal extension, audio-driven generation, video transformation, and audio-visual editing. This unified framework provides a scalable foundation for general-purpose audio-visual generation and manipulation.

60. 【2608.05799】XEWorld: Can Action-Conditioned World Models Generalize to Unseen Robot Embodiments?

链接：https://arxiv.org/abs/2608.05799

作者：Yixiang Chen,Jiabing Yang,Yuan Xu,Qisen Ma,Keji He,Peiyan Li,Kai Wang,Ziheng He,Xiangnan Wu,Jing Liu,Nianfeng Liu,Yan Huang,Liang Wang

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：Action-conditioned world models, Action-conditioned world, promising learned simulators, training robots fails, robotic manipulation

备注：

点击查看摘要

Abstract:Action-conditioned world models are promising learned simulators for robotic manipulation, yet evaluating them exclusively on training robots fails to reveal whether they capture physical dynamics or merely memorize visual patterns. To answer whether a model can faithfully render a robot it has never seen, we introduce XEWorld, a controlled cross-embodiment testbed for world models that isolates embodiments by evaluating held-out robots within physically identical scenes. Our systematic analysis uncovers a shared architectural bottleneck: current models act primarily as 2D visual pattern matchers whose generalization is governed by visual similarity rather than physical kinematic similarity. Driven by this limitation, they struggle to translate abstract numeric joint actions into coherent visual trajectories, and fail to predict dynamic visual changes from static initial observations. Consequently, successfully rendering an unseen embodiment zero-shot strictly requires heavily grounded cues, specifically pixel-space actions and explicit spatial-temporal alignment. Even when bypassing this zero-shot barrier via few-shot adaptation, the forced appearance recovery triggers catastrophic forgetting of seen embodiments. Together, these failures expose a critical inability to apply learned physical dynamics to novel visual appearances, highlighting that achieving true cross-embodiment generalization requires architectural innovations that decouple visual appearance from underlying physical dynamics.

61. 【2608.05798】KVAE: Family of Tokenizers for Multimodal Generative Models

链接：https://arxiv.org/abs/2608.05798

作者：Andrey Shutkin,Denis Parkhomenko,Ivan Kirillov,Kirill Chernyshev,Kirill Malakhov,Ilia Vasiliev,Ilia Trushkin,Valeriya Kobenko,David Chikovani,Alexander Ivanov,Azat Saginbaev,Egor Silvestrov,Ivan Mikheev,Konstantin Zakharov

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Sound (cs.SD)

关键词：Latent diffusion modeling, map input signal, diffusion modeling, prominent paradigm, compressed representation

备注：

点击查看摘要

Abstract:Latent diffusion modeling (LDM), a prominent paradigm, utilizes tokenizers to map input signal to compressed representation. This dependency positions tokenizer as an integral part of generation process itself, since it affects learning speed, quality of synthesized samples and lay foundation for later applications. This report presents series of KVAE tokenizers for audio, image and video, all designed for subsequent text-conditioned generation: KVAE-Audio, a continuous full-band 48 kHz tokenizer with a 50 Hz latent of 64 channels; KVAE-3D -- two causal video tokenizers for 4x16x16 and 4x8x8 compression; KVAE-2D, an image model, compressing input by factor of 8 with 32 channels. We demonstrate that reconstruction (PSNR, LPIPS, PESQ, etc.) and generation results on objective (Frechet Distance, CLIP score, CLAP score, etc.) and subjective (side-by-side evaluation) metrics matches or surpasses frontier opensource tokenizers, such as VAEs from Wan-2.2, HunyuanVideo-1.5, FLUX.2, MovieGen, StableAudio and MMAudio. Considering difficulty of development, we share with community training details, model selection method and ablation on design choices. The code is publicly available at this https URL and this https URL.

62. 【2608.05782】VSMP-IMU: Video-Grounded Semantic Motion Programs for Sensor-Aware Synthetic IMU Generation

链接：https://arxiv.org/abs/2608.05782

作者：Lala Shakti Swarup Ray,Vitor Fortes Rey,Mengxi Liu,Paul Lukowicz,Bo Zhou

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：human activity recognition, Wearable human activity, activity recognition, Synthetic IMU generation, human activity

备注： Under review

点击查看摘要

Abstract:Wearable human activity recognition (HAR) is often limited by the scarcity of labeled sensor data, especially in low-resource, class-imbalanced, and subject-generalization settings. Synthetic IMU generation can reduce this dependency and enhance HAR machine learning model's performance, but existing approaches face a trade-off without addressing all factors: video-driven methods are visually grounded but sensitive to pose-estimation errors, while text-driven methods are controllable but often weakly grounded in how activities are actually performed. We present VSMP-IMU, a video-grounded framework for controllable synthetic IMU generation based on a structured Semantic Motion Program (SMP), which separates activity-defining semantics from label-preserving variation. Given an input video, VSMP-IMU extracts and augments an SMP, uses it to synthesize motion, converts the motion into virtual IMU signals, and grounds the resulting signals to the target wearable domain. We evaluate VSMP-IMU against state-of-the-art synthetic data generation methods on five public IMU-HAR datasets under leave-one-person-out evaluation. VSMP-IMU achieves an average Macro-F1 of 78.33%, improving over real-only training by 9.77% and over the strongest prior synthetic baseline by 4.04%. In low-resource settings with reduced training data-samples, it improves over real-only training by 18.54% and over the strongest prior synthetic baselines by more than 6% on average. Under long-tail evaluation in imbalanced datasets, it improves tail-class Macro-F1 by 19.86% over Real-only training and by 4.76% over SOTA. These results show that structured video-grounded semantics provide a practical foundation for controllable, wearable-relevant synthetic sensor data generation.

63. 【2608.05780】Evidence-Driven Dynamic Visual Selector for Efficient Long Video Understanding

链接：https://arxiv.org/abs/2608.05780

作者：Bo Zhang,Wenxin Wang,Feng Chen,Zhihao Zhang,Zixuan Wang,Changsheng Li,Yinjie Lei

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：mitigated inference-time computational, limited context lengths, Recent advancements, selecting query-relevant frames, target MLLM

备注： Project Page: [this https URL](https://zhangbo135.github.io/EviSelect/)

点击查看摘要

Abstract:Recent advancements in MLLM-based long-form video understanding have mitigated inference-time computational cost and limited context lengths by selecting query-relevant frames. However, existing approaches predominantly rely on external proxy scorers and rigid heuristic rules, inevitably suffering from misalignment with the target MLLM's intrinsic evidence and failing to accommodate the non-uniform spatiotemporal information density. In this paper, we propose a fine-grained dynamic visual selection framework named EviSelect, grounded in the target MLLM internal attention evidence. Our method efficiently probes visual evidence via sparse prefilling as a structured prior to guide distribution-aware dynamic sampling. Specifically, we efficiently approximate attention maps of the target MLLM using highly compressed visual inputs and sparse attention, well-aligned to the full counterpart. Conditioned on three complementary attention components derived from this prior, we design a lightweight selector that not only precisely locates query-relevant timestamps but also adaptively adjusts the local sampling rate and spatial resolution. To enable evidence-conditioned spatiotemporal sampling, we formulate the selector as a stochastic policy and optimize it via GRPO under a joint accuracy--efficiency reward. By rewarding correct predictions under lower visual cost through group-relative comparisons, our method encourages the policy to allocate computation dynamically according to the information density of each video. Across three long video understanding benchmarks, EviSelect achieves superior performance compared to existing methods while reducing selected visual tokens by about 50\% and achieving a 3.9x end-to-end speedup.

64. 【2608.05776】Vorch-Director: Interactive World Story Model via Noise-Aware Error Rectification

链接：https://arxiv.org/abs/2608.05776

作者：Lisai Zhang,Yidi Wu,Qi Liu,Xin Ma,Yang Ding,Gang Yue,Siqian Yang,Jingyuan Chen,Lin Ma,Yaohui Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：short-window generator conditioned, previously generated video, natural path, path toward minute-scale, repeatedly extending

备注： Project page: [this https URL](https://vorch-project.github.io/Vorch-Director-project)

点击查看摘要

Abstract:Autoregressive continuation provides a natural path toward minute-scale audio-visual generation by repeatedly extending a short-window generator conditioned on previously generated video and audio. However, models are trained on clean ground-truth histories, while inference relies on their own generated histories, where accumulated errors cause identity drift, over-smoothing, and audio-visual desynchronization. Recent methods reduce this mismatch by reusing prediction residuals as synthetic corruption, but we observe that the effectiveness of residual correction critically depends on the flow-matching noise level at which residuals are produced. We propose Vorch-Director, a noise-level-aware residual correction strategy that associates each residual with its originating noise level and injects residuals from matched noise regimes during training. By aligning injected errors with the denoising process, Vorch-Director produces more realistic autoregressive histories while retaining efficient teacher-forcing training. Built on the audio-visual LTX-2 diffusion transformer, Vorch-Director further introduces task embeddings to distinguish historical video, reference images, and target video, enabling unified conditioning for long-horizon generation. Together with a clean conditioning sink and mixed-task training, Vorch-Director supports multi-shot, multi-subject, reference-guided audio-visual long-video generation. We evaluate Vorch-Director on ST-Bench and introduce a new long-horizon audio-visual benchmark with metrics for quality drift and long-range consistency. Extensive experiments demonstrate improved stability and audio-visual fidelity over strong baselines.

65. 【2608.05774】SR-JEPA: Learning Predictive Latent State in 3D Scenes

链接：https://arxiv.org/abs/2608.05774

作者：Zihan Zhou,Qifu Wen,Xi Zeng

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Joint-embedding predictive architectures, predictive architectures learn, predicting latent representations, Joint-embedding predictive, missing observations

备注： 17 pages, 5 figures, 9 tables

点击查看摘要

Abstract:Joint-embedding predictive architectures learn by predicting latent representations of missing observations, yet many masked JEPAs are evaluated primarily through the encoders they produce. We ask what a trained predictive pathway itself infers when an entire entity is absent from a native 3D scene. We introduce SR-JEPA, a point-native JEPA for scene-scale point clouds whose original frozen predictive pathway can be queried at a supplied location. At evaluation, every point of one object is removed before encoding and replaced by the same shape-free 32-point query at its centroid. Training uses only self-contained 3D EMA targets: no reconstruction, semantic labels, language, or lifted 2D features. On 5,953 held-out ARKitScenes objects, the imputed latent reaches 43.13% semantic-identity macro accuracy, 22.18 points above the strongest floor. Randomizing the prediction path removes 9.78 points, while substituting matched donor context removes 21.98 points. On 8,570 Sr3D support pairs, the full latent reaches 41.15 AP; identity decoded from the missing-object latent, combined with anchor identity and geometry, reaches 39.37 AP, leaving an unresolved 1.78-point residual. These results reveal a queryable, compositional 3D predictive state: the model completes context-dependent entity content, which downstream computation combines with metric geometry.

66. 【2608.05771】HyTBE: Hyperbolic Target-Background Expert Model for Cross-Domain Infrared Small Target Detection

链接：https://arxiv.org/abs/2608.05771

作者：Aohua Li,Jin Kuang,Yubing Lu,Pingping Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：achieved substantial progress, Infrared small target, Infrared small, unseen infrared domains, relation

备注： 15 pages, 9 figures, 9 tables. Code: [this https URL](https://github.com/PepperCS/HyTBE)

点击查看摘要

Abstract:Infrared small target detection (IRSTD) has achieved substantial progress under domain-consistent evaluation, yet detector performance often degrades markedly when generalizing to unseen infrared domains. Existing methods primarily improve detection by enhancing target responses and suppressing background interference. However, when trained on only a limited set of source domains, their learned decision rules are inevitably established from a restricted range of source-domain target-background relation patterns. We formulate this cross-domain failure as target-background relation shift: unseen domains may exhibit relation patterns that are not observed during training, thereby weakening the discriminative capability learned from the source domains. To address this problem, we propose HyTBE, a Hyperbolic Target-Background Expert model that expands source-domain relation patterns and adaptively adjusts visual representations using explicit relation cues. The Target-Background Relation Intervention selectively perturbs either targets or backgrounds, broadening the observable relation patterns during training while maintaining valid supervision. Subsequently, the Hyperbolic Relation Modeling maps multi-scale visual cues into a Poincaré ball and characterizes the target-background relation of each feature token according to its relative distances to the target and background anchors. The Hyperbolic-guided MoE Adapter further uses these hyperbolic relation representations to calibrate multi-scale visual features and aggregate expert-specific feature corrections for different relation patterns. Leave-one-domain-out experiments on NUAA-SIRST, NUDT-SIRST, and IRSTD-1K demonstrate that HyTBE achieves stronger cross-domain generalization than competitive baselines.

67. 【2608.05769】Flow-Map Distillation on Relation Manifolds for Image Restoration

链接：https://arxiv.org/abs/2608.05769

作者：Zihao He,Songhua Liu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：typically aligns intermediate, aligns intermediate features, knowledge transfer process, restoration typically aligns, knowledge transfer

备注： 9 pages, 7 figures. Accepted to ACM Multimedia 2026

点击查看摘要

Abstract:Knowledge distillation for image restoration typically aligns intermediate features or relation matrices between teacher and student networks as static targets, ignoring the dynamic structure of the knowledge transfer process. In this paper, we propose Flow-Map Distillation on Relation Manifolds (FoRM), which reformulates relation-based knowledge transfer as a continuous flow mapping problem on the relation manifold. Rather than regressing a constant velocity field between student and teacher relation states, FoRM learns a flow map operator $\mathcal{F}_\theta(\mathbf{z}, t, s)$ that directly predicts the relation state at any target time $s$ given the current state at time $t$, enabling richer trajectory-level supervision. To ensure global self-consistency of the learned flow map, we introduce a safe semigroup consistency constraint that enforces compositional agreement using ground-truth bridge states, eliminating phantom-state error accumulation. An endpoint anchoring loss further prevents the operator from drifting away from the teacher target. Extensive experiments on five image restoration tasks, including super-resolution, deraining, denoising, deblurring, and low-light enhancement, demonstrate consistent gains over state-of-the-art distillation baselines across multiple backbone architectures, reducing training variance by approximately 50\% compared to naive flow matching distillation while achieving superior restoration quality.

68. 【2608.05757】Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning

链接：https://arxiv.org/abs/2608.05757

作者：Bryan Wong,Xun Xu,Huazhu Fu,Nancy F. Chen,Mun Yong Yi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Whole-slide image, Whole-slide, evidence, BEACON, WSI

备注：

点击查看摘要

Abstract:Whole-slide image (WSI) reasoning requires an agent to sequentially acquire visual evidence before answering a diagnostic question. Existing training-free agentic frameworks formulate this process as iterative patch retrieval based on semantic relevance to the question. However, semantic relevance does not necessarily imply diagnostic informativeness in computational pathology, where competing diagnoses often exhibit similar and overlapping morphological patterns, making many patches semantically relevant yet diagnostically non-discriminative. Consequently, relevance-based retrieval may acquire redundant observations and leave diagnostic uncertainty unresolved. We propose BEACON, a plug-and-play agentic framework that reformulates WSI reasoning as a Bayesian evidence acquisition problem. BEACON maintains a probabilistic belief over competing diagnostic hypotheses and sequentially acquires patches by maximizing expected information gain (EIG) to reduce diagnostic uncertainty. An evidence controller then determines whether to answer, acquire additional evidence, or perform higher-resolution inspection. Built entirely from off-the-shelf foundation models, BEACON requires no additional training or fine-tuning. Extensive zero-shot experiments across five WSI-VQA benchmarks demonstrate that BEACON achieves the strongest overall performance among training-free agentic frameworks while substantially improving evidence acquisition efficiency, establishing Bayesian evidence acquisition as a principled paradigm for uncertainty-aware agentic WSI reasoning. The code is available at this https URL

69. 【2608.05747】GST-Bench: Can VLMs Develop Global Spatial Awareness from Video?

链接：https://arxiv.org/abs/2608.05747

作者：Qifeng Zhang,Kaixiang Huang,Heng Dong,Huang Fang,Junting Chen,Junjie Zhu,Yonghang Chen,Zhiyu Zhang,Wei Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：existing benchmarks focus, long-horizon visual streams, overlooking global spatial, global spatial awareness, embodied agents

备注：

点击查看摘要

Abstract:Spatial intelligence is fundamental to embodied agents, yet existing benchmarks focus on local spatial perception from single or few viewpoints, overlooking global spatial awareness over continuous, long-horizon visual streams. To address this limitation, we introduce the Global-Spatial-Temporal Benchmark (GST-Bench), a VQA benchmark for global spatial intelligence in video understanding, comprising human-verified questions derived from 6,790 minutes of synthetically generated video. It requires models to perform accurate spatial inference from novel viewpoints unseen in the input video and to map egocentric observations onto global top-down images. A comprehensive evaluation of 22 state-of-the-art VLMs exposes a striking gap between models and humans: the strongest zero-shot model attains only 42.68, far below the human score of 79.08. To probe the cause of this gap, we construct GST-Bench-Local and find that models, despite strong local spatial understanding under the same task formulation, still fail to consolidate long-horizon observations into a globally consistent scene representation. We further provide GST-Train, a dataset for global spatial reasoning, as a complementary resource to facilitate future research on this challenge.

70. 【2608.05745】UniVVT: A Unified End-to-End Framework for High-Fidelity Video Virtual Try-on

链接：https://arxiv.org/abs/2608.05745

作者：Yushe Cao,Shikun Feng,Fei Shen,Haikuo Peng,Jianqiang Xia,Yiheng Zhu,Dianxi Shi,Chun Yu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：preserving identity, scene dynamics, person wearing, approaches cast VVT, VVT

备注： 17 pages,21 figures

点击查看摘要

Abstract:Video Virtual Try-On (VVT) synthesizes a video of a person wearing a target garment while preserving identity, motion, and scene dynamics. Dominant approaches cast VVT as mask-conditioned video inpainting and rely on separate modules for human parsing, pose estimation, and garment warping. This multi-stage design complicates deployment and, more critically, allows errors in explicit geometric priors to propagate irreversibly into the generated video. We present UniVVT, a unified end-to-end framework that reframes VVT as semantically conditioned video generation, eliminating mask, pose, and warping modules at inference. At its core, a scene-task perceiver built on a Multimodal Large Language Model jointly encodes the source video, target garment, and task instruction into compact, task-aware latent tokens, implicitly capturing what to transfer and where and how to transfer it. A lightweight semantic bridge then aligns these tokens with the conditioning space of a diffusion-based video generator, enabling coherent garment transfer. To robustly couple the heterogeneous components, we devise a three-stage progressive training strategy comprising semantic alignment, joint task adaptation, and flexible-resolution refinement. Extensive experiments demonstrate that UniVVT achieves state-of-the-art performance across multiple benchmarks, validating implicit semantic guidance as a simple and effective alternative to fragile geometric preprocessing for end-to-end virtual try-on.

71. 【2608.05743】ConceptADapt: Concept-guided Adaptive Feature Reconstruction with Dynamic Attention for Few-Shot Industrial Anomaly Detection

链接：https://arxiv.org/abs/2608.05743

作者：Yufei Li,Yicheng Ruan,Long Tian,Dongsheng Wang,Liang Bao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Few-shot industrial anomaly, Few-shot industrial, localizing visual defects, focuses on detecting, cold-start phase

备注： 11 pages, 7 figures

点击查看摘要

Abstract:Few-shot industrial anomaly detection (FS-IAD) focuses on detecting and localizing visual defects in industrial inspection during the cold-start phase, where only a limited number of normal training samples are available per category. Recent advances in this field predominantly leverage visual features from foundation-model and have achieved promising performance. Despite the strong representational power of foundation-model features, the model generalization remains fragile due to the extreme scarcity of normal training this http URL address this pivotal issue, we propose ConceptADapt, a concept-guided adaptive feature reconstruction model with dynamic attention. Specifically, our model pre-learns a set of fixed normal concepts from the limited support features and leverages them to mine relationships with query features, thereby recalibrating their statistics for improved anomaly detection at test time. To mitigate the prevalent feature shortcut problem, which is particularly severe under low-data regimes, we further develop a dynamic attention mechanism integrated with sparse autoencoders to learn robust normal concepts during training. Moreover, to enable fast adaptation during inference, our model remains lightweight by incorporating LoRA into the attention module, which introduces only minimal updating this http URL experiments on three widely adopted FS-IAD benchmarks, including MVTec-AD, VisA, and MPDD, demonstrate that our model consistently outperforms state-of-the-art (SOTA) approaches across both detection and localization tasks, achieving significant improvements under various shot settings.

72. 【2608.05739】LiteKD-Net: Lightweight Knowledge-Distilled Network for Mobile Image Denoising

链接：https://arxiv.org/abs/2608.05739

作者：Zhou Zhiyi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Mobile image denoising, Mobile image, image denoising requires, LQ-GT clean pairs, collect large-scale LQ-GT

备注：

点击查看摘要

Abstract:Mobile image denoising requires both good restoration quality and low computational cost. In addition, it's annoying to collect large-scale LQ-GT clean pairs. As a result, we propose LiteKD-Net, a lightweight knowledge-distilled network for mobile image denoising. First, a physics-guided noise simulation pipeline generates paired training data by adding pixel crosstalk compared with pipelines applied to cameras. Next, we adapt the Real-ESRGAN to identity-resolution denoising and construct a lightweight Student using Lite-RRDB blocks based on depthwise separable convolutions. Third, feature-level knowledge distillation is applied to transfer the Teacher's restoration capability to the Student without introducing additional inference cost. Experiments on real-world datasets show that our model reaches great reduction in runtime and increase in the inference rate with good restoration quality. Our model also reaches the best in all metrics compared with SwinIR. These results indicate that LiteKD-Net provides a great trade-off between restoration quality and computational efficiency.

73. 【2608.05729】Unified Agent: Managing Interactions across Devices

链接：https://arxiv.org/abs/2608.05729

作者：Xinshuang Liu,Runfa Blark Li,Shaoxiu Wei,Xin Lin,Truong Nguyen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：capabilities rapidly increase, rapidly increase, capabilities rapidly, move from running, running inside

备注：

点击查看摘要

Abstract:As capabilities rapidly increase, AI agents can move from running inside one app to acting across a user's devices over time. Yet existing agent systems still fall short in this scenario. This is because observations are scattered across devices and moments, but mainstream systems are not designed around this fact: a single agent that treats devices as tools lacks effective state management for all devices across time, and multi-agent systems coordinate across agents but do not maintain the compact carried state a cross-device, cross-time request needs. We argue that the agent should maintain an effectively designed state that organizes engagement evidence, stated facts, and the standing request in a compact, action-ready form for deciding its action given the current observation. To compare state designs, we construct a benchmark of user-agent interaction across devices and time. We instantiate this principle in Unified Agent, a stateful agent that carries interaction evidence across devices and moments and uses it with the current observation to act. In the default setting, it significantly outperforms our adaptations of four published designs. Across changes in multimodal large language model (MLLM) family, capability, and reasoning effort, it remains ahead of all compared systems, demonstrating that the state-design advantage is robust across MLLM settings. Our code and data will be publicly available on GitHub.

74. 【2608.05728】Engram-E2VID: Reference-Based Event-to-Video Reconstruction via Generative Activation of Appearance Engrams

链接：https://arxiv.org/abs/2608.05728

作者：Feiyu Ji,Xiang Li,Hao Ma,Tianxiang Huang,Qingxin Lu,Mengqi Ji,Lei Han,Xiaokang Yang,Xiaoyun Yuan

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Optics (physics.optics)

关键词：recover target RGB, target RGB frames, event stream captured, RGB frames, target RGB

备注： 9 pages, 5 figures

点击查看摘要

Abstract:Reference-based event-to-video reconstruction aims to recover target RGB frames from a reference frame and the event stream captured over the reference-to-target interval. Although events provide fine-grained temporal cues, they encode sparse and asynchronous log-intensity changes rather than absolute appearance, making faithful reconstruction intrinsically challenging. The central challenge lies in associating event-derived target-time structures with relevant appearance information from the reference frame, especially under complex motion and long temporal intervals. In this work, we propose Engram-E2VID, a structure-guided framework that reconstructs target frames through the generative activation of appearance engrams. Specifically, the reference frame is encoded into token-space appearance engrams, while the event stream and reference context are transformed into a target-time motion-structure scaffold that captures motion boundaries and event-induced structural changes. Within a one-step diffusion backbone, scaffold-derived structural tokens progressively interact with and activate relevant appearance engrams across layers. This token-space association allows target structures to access reference appearance without relying on direct pixel-wise correspondence, while the diffusion prior complements uncertain or newly revealed regions. Across three benchmarks, Engram-E2VID improves PSNR by up to 3.29 dB and reduces LPIPS by up to 0.08 over the strongest same-input baseline, while degrading more slowly as the reconstruction interval increases.

75. 【2608.05720】PhyLatent: Learning Dynamics-Relevant Representations for JEPA World Models

链接：https://arxiv.org/abs/2608.05720

作者：Xi Zeng,Haojie Ren,Ziying Song

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：dynamics-relevant training objective, JointEmbedding Predictive Architecture, JEPA world models, objective for JointEmbedding, physical

备注： 16 pages, 5 figures

点击查看摘要

Abstract:We propose PhyLatent, a dynamics-relevant training objective for JointEmbedding Predictive Architecture (JEPA) world models. Our key observation is that preventing global latent collapse does not ensure that a representation preserves physical states and action consequences. We identify three failure modes in JEPA world models: physical invariance collapse, physical identifiability collapse, and counterfactual dynamics collapse. PhyLatent addresses them through three training pathways: physical invariance, physical identifiability, and counterfactual dynamics, implemented with physical state grounding, future representation alignment, static visual invariance, counterfactual branch separation, and latent denoising. On OGBench-Cube, PhyLatent reduces the three failure rates from 15.60%, 6.71%, and 8.41% to 7.53%, 0.95%, and 4.62%, respectively, and improves model predictive control (MPC) success from 70.0% to 78.1%. With the same architecture and planner, it further improves success from 81.0% to 98.0% on TwoRooms and remains competitive on Reacher and PushT. These results show that global non-collapse alone is insufficient for learning a reliable JEPA worldmodel state space.

76. 【2608.05718】Iterative Hybrid Discrete-Continuous Viewpoint Planning for UAV Photogrammetry

链接：https://arxiv.org/abs/2608.05718

作者：Alan Grech,Daniel Pisani,Andre Grima,Carl James Debono,Saviour Formosa,Dylan Seychell

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Unmanned aerial vehicle, requires camera networks, Unmanned aerial, sufficient surface coverage, photogrammetry requires camera

备注： 6 pages, 3 figures, 2 tables. Accepted for publication at the 14th IEEE European Conference on Visual Information Processing (EUVIP 2026)

点击查看摘要

Abstract:Unmanned aerial vehicle (UAV) photogrammetry requires camera networks that provide sufficient surface coverage, image overlap, parallax, and resolution, yet conventional flight patterns are often poorly adapted to scene geometry resulting in local reconstruction errors. This paper proposes an iterative hybrid discrete-continuous viewpoint planning method for targeted UAV photogrammetry from a proxy reconstruction. The method scores sampled surface points using photogrammetric heuristics based on frontality, imaging distance, parallax, and multi-view observation count, while also evaluating the full viewpoint set in terms of visibility, pairwise overlap, and graph connectivity. Candidate viewpoints are generated around weakly observed regions, refined using clustered Covariance matrix adaptation evolution strategy (CMA-ES) optimisation, and removed when redundant. The final flight path combines close-range detail viewpoints with wider model-coverage viewpoints, balancing local reconstruction quality with global image-network robustness. Evaluation on three synthetic scenes shows that the proposed method improves both reconstruction accuracy and completeness compared with prior UAV path-planning methods.

77. 【2608.05707】One Ranking, Any Budget: Matryoshka Evidence-to-Context Frame Selection for Long-Video Understanding

链接：https://arxiv.org/abs/2608.05707

作者：Wang Chen,Yu Chen,Xiang Wang,Shuai Li,Jinfa Huang,Xiawu Zheng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large Multimodal Models, applying Large Multimodal, Multimodal Models, Large Multimodal, applying Large

备注： 21 pages, 7 figures, 7 tables

点击查看摘要

Abstract:Frame selection is essential for applying Large Multimodal Models (LMMs) to long videos due to severe frame redundancy and limited context windows. Since the appropriate frame budget varies with the downstream LMM, reasoning demands, and latency constraints, a practical selector should serve multiple budgets. However, existing methods typically optimize an isolated frame subset for each predefined budget: when the budget changes, previously selected evidence may be replaced rather than progressively augmented. Ranking frames by a fixed score would allow prefix reuse across budgets, but it ignores the distinct roles of different ranking positions. In this paper, we formulate long-video frame selection as a Matryoshka ranking problem: constructing a single priority sequence whose small prefixes concentrate query-conditioned evidence, while progressively larger prefixes preserve this evidence and add broader temporal context. Efficiently constructing such a ranking is itself challenging, as densely sampling long videos and evaluating frame-query relevance incurs substantial overhead. We therefore introduce Matryoshka Evidence-to-Context (MEC) Frame Selection, a training-free framework that builds a reusable sparse video index, discovers candidates through sparse probing and local zooming, and greedily constructs a position-adaptive ranking: early positions emphasize evidence; later positions progressively favor temporal coverage while preserving visual diversity. A single ranking can thus be truncated to any target budget without rerunning the selector. Across four benchmarks and six frame budgets, MEC improves average accuracy over uniform sampling by 3.77 percentage points, matches strong state-of-the-art selectors, and reduces end-to-end selection latency by 47.37-51.19%.

78. 【2608.05706】LAWM-3D: Learning 3D-Aware Latent Actions from Human Videos for Generalizable Robot World Models

链接：https://arxiv.org/abs/2608.05706

作者：Jiarui Yang,Jiale Zhange,Jiawei Li,Hang Guo,Wen Huang,Jinpeng Wang,Peidong Liu,Shu-Tao Xia

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：perform forward rollout, models enable agents, real-world interaction, enable agents, agents to perform

备注：

点击查看摘要

Abstract:World models enable agents to perform forward rollout and planning without real-world interaction. However, their application in open-world embodied intelligence remains limited by the high cost of action annotations and the heterogeneity of action spaces across platforms. Recently, latent action models (LAMs) have alleviated this bottleneck by learning action representations directly from unlabeled human videos in a self-supervised manner. Nevertheless, most existing LAMs rely on single-view inputs and operate primarily in 2D pixel space, raising a fundamental question: can simply incorporating multi-view videos into LAM training endow the learned latent actions with 3D-aware perception? Our study shows that the answer is negative. The primary reasons lie in future-frame appearance leakage as well as inter-camera appearance discrepancies and viewpoint variations. To address these issues, we propose LAWM-3D, which introduces three tightly coupled key designs: (1) a multi-view invariant unified action tokenization scheme for learning 3D-aware latent actions; (2) a geometric alignment constraint that anchors intermediate encoder features to a pretrained 3D foundation model, thereby explicitly providing cross-view geometric correspondences; and (3) a non-injective RGB-D joint reconstruction objective that prevents shortcut learning from future-frame appearance information, forcing the LAM to focus supervision on motion cues with geometric significance. Importantly, these components are not simply stacked but are tightly coupled through a unified motivation. Built upon a two-stage paradigm of large-scale human video pretraining followed by robot fine-tuning, extensive experiments demonstrate that the proposed 3D-aware latent actions significantly improve world model performance, achieving SOTA results in generation quality, physical consistency, and generalization ability.

79. 【2608.05704】G$^2$ARD-GS: Geometry-Guided Anchor-Regularized Gaussian Splatting Distillation

链接：https://arxiv.org/abs/2608.05704

作者：Puyuan Zhang,Jianming Huang,Wenkai Ye,Wei Dong

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：colored LiDAR maps, LiDAR maps provide, maps provide accurate, provide accurate city-scale, Dense colored LiDAR

备注：

点击查看摘要

Abstract:Dense colored LiDAR maps provide accurate city-scale geometry, but lifting them into 3D Gaussian Splatting (3DGS) retains millions of primitives, making the resulting models costly to store, transmit, render, and adapt. Aggressive primitive reduction alleviates this burden, but can remove the local surface support needed for stable novel-view synthesis and downstream geometric use. We introduce G$^2$ARD-GS, a geometry-guided distillation method that converts a dense Gaussian prior instantiated either as a training-free point-cloud lift or a trained GS model into a compact, reusable representation. G$^2$ARD-GS progressively consolidates the prior into surface-aware representatives, then recovers appearance on the resulting fixed topology under construction-time anchor constraints, with no primitives added or removed during recovery. Under limited supervision, geometry-aware view selection allocates the available view budget. On MatrixCity, G$^2$ARD-GS achieves the best PSNR, SSIM, and LPIPS across matched $5\times$--$30\times$ compression budgets, outperforming PUP by $3.2$--$6.8$,dB in PSNR. When reused as frozen geometry, the compact model improves off-trajectory appearance adaptation by $3.7$--$4.9$,dB over PUP 3D-GS and preserves image-to-model registration accuracy on Cambridge KingsCollege at $30\times$ compression. Project page: this https URL.

80. 【2608.05703】StreamArena: Toward Continuous, Interactive, and Long-Horizon Agentic Streaming Video Understanding

链接：https://arxiv.org/abs/2608.05703

作者：Xichen Zhang,Guankai Li,Yinghao Zhu,Shijian Wang,Sitong Wu,Shaozuo Yu,Meng Chu,Yuan Lu,Jiaya Jia

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：real-world environments requires, ingest unbounded audio-visual, unbounded audio-visual streams, Deploying autonomous multimodal, Deploying autonomous

备注：

点击查看摘要

Abstract:Deploying autonomous multimodal agents in continuous, real-world environments requires them to ingest unbounded audio-visual streams and maintain hour-scale memory. However, current evaluations predominantly rely on brief clips and multiple-choice formats. This design allows minimal baselines that process only the last four frames to match or surpass complex streaming models, while answer options also expose language shortcuts. We introduce StreamArena, a benchmark for hour-scale, interactive streaming video understanding. StreamArena contains 243 full-length videos averaging 88.8 minutes and 3,646 rigorously annotated, open-ended question-answer pairs that evaluate real-time perception, historical retrospection, proactive interaction, and multimodal tool utilization. Evaluation across diverse systems exposes a tension between continuous interaction and long-horizon multimodal comprehension. Methods that retain only recent frames cannot recover distant events, methods that convert past observations into text lose visual evidence, and methods that repeatedly compress visual memory struggle to preserve fine-grained details over time. We address this tension with StreamMind, a two-tier architecture that assigns latency-critical interaction and proactive monitoring to independently scheduled frontend workers, while backend workers asynchronously construct persistent multimodal memory and perform historical recall and external search. StreamMind outperforms existing streaming baselines across all four capabilities and reduces query-to-answer latency by reusing persistent state.

81. 【2608.05699】AU-Bench: From Anomaly Instance Tracking to Fine-Grained Video Anomaly Understanding

链接：https://arxiv.org/abs/2608.05699

作者：Kepeng Yang,Dongxuan Liu,Rongxin Gao,Zixin Su,Rui Wu,Shuzhao Xie,Chenxin Li,Panwang Pan,Yuzhi Huang,Yue Huang,Jingyan Jiang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：coherent perceptual process, understand anomalous events, Humans understand anomalous, follow its behavior, coherent perceptual

备注：

点击查看摘要

Abstract:Humans understand anomalous events through a coherent perceptual process in which they identify the focal instance, follow its behavior as the event unfolds, and interpret why it violates the expectations of the surrounding scene. Video anomaly understanding (VAU) seeks to endow models with a similar capability, moving beyond deciding whether a video is anomalous toward explaining how the event develops and why it matters. Although recent vision--language models (VLMs) can generate detailed and plausible anomaly descriptions, their semantic fluency does not ensure that these interpretations remain grounded in the correct anomaly instance over time. Existing benchmarks typically evaluate tracking and semantic understanding through separate protocols, leaving such instance--semantic inconsistency largely unmeasured. We therefore introduce TAU-Bench, a track-centric benchmark for jointly evaluating anomaly instance tracking and fine-grained anomaly understanding. TAU-Bench contains 1,118 videos, 1,454 tracks, and 202,438 pixel-level masks spanning 49 event and 45 scene categories, together with track-centric annotations that connect instance-level identification, event-level understanding, and scene-level reasoning. To build TAU-Bench at scale, we developed an automated data engine integrating anomaly suitability filtering, anomaly instance track construction, hierarchical caption annotation, and human quality control. Evaluations across representative VLM families show that models producing plausible anomaly interpretations may still fail to localize and track the correct instance reliably, revealing a persistent gap between semantic reasoning and visual grounding. These findings therefore highlight instance-grounded evaluation as an important step toward more faithful and reliable VAU systems.

82. 【2608.05691】SciQNet: Two-Stage Multimodal Adaptation for Scientific Image Quality Assessment

链接：https://arxiv.org/abs/2608.05691

作者：Yin-Loon Khor,Yi-Jie Wong,Jing Jie Tan,Ming Jie Lee

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：communicating experimental observations, scientific image quality, image quality assessment, experimental observations, quantitative evidence

备注：

点击查看摘要

Abstract:Scientific images are essential for communicating experimental observations, quantitative evidence and conceptual knowledge. Unlike natural images, their quality depends on both visual clarity and scientific informativeness, making assessment challenging. In this work, we present SciQNet, a two-stage multimodal adaptation framework for scientific image quality assessment. The first stage performs domain-adaptive pretraining on scientific document images and the second stage conducts task-specific fine-tuning with joint scoring and understanding supervision. For scoring-oriented supervision, we combine instruction tuning with a Huber loss derived from rating-word logits, while understanding-oriented supervision is formulated as multiple-choice visual question answering. Experiments show that using a 40% stratified subset of the domain-adaptive data gives the best performance among the evaluated pretraining fractions, suggesting that pretraining-data relevance may be as important as pretraining-data scale. The final model achieves an SIQA-S score of 92.21, an SIQA-U score of 47.38 and a combined score of 69.80. This work presents our solution to the ICME 2026 Scientific Image Quality Assessment Challenge, which ranked 2nd in the scoring track.

83. 【2608.05683】DistMedVL: Distributional Vision-Language Alignment for Uncertainty-Aware Medical Image Segmentation

链接：https://arxiv.org/abs/2608.05683

作者：Jiaxuan Li,Qing Xu,Xiangjian He,Yue Li,Daokun Zhang,Fiseha B. Tesema,Rong Qu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)

关键词：real-world clinical conditions, medical image understanding, multimodal medical image, image understanding, clinical conditions

备注： 10 pages, 5 figures

点击查看摘要

Abstract:Cross-modal alignment of visual and textual representations is fundamental to multimodal medical image understanding, yet remains hindered by uncertainty in both modalities under real-world clinical conditions. Existing vision-language segmentation methods rely on deterministic cross-modal matching, which overlooks aleatoric uncertainty from ambiguous boundaries and epistemic uncertainty from limited training data, leading to fragile performance under domain shift. To address this issue, we propose DistMedVL, a probabilistic vision-language framework that introduces a lightweight Probabilistic Cross-Modal Adapter (PCM-Adapter) upon frozen encoders to explicitly model representational uncertainty. Specifically, the PCM-Adapter comprises two sequential modules for progressive probabilistic alignment. We first devise a Mahalanobis Alignment Module (MAM) that models textual tokens as Gaussian distributions and computes patch-text compatibility via Mahalanobis distance, yielding variance-conditioned matching that downweights unreliable feature dimensions. Moreover, we devise a Distribution Flow Module (DFM) that estimates modality-wise confidence parameters and performs vision-guided refinement of textual distributions, accommodating distributional variation across imaging modalities. Extensive experiments across eight medical segmentation benchmarks demonstrate that DistMedVL outperforms state-of-the-art methods with only 6.3M trainable parameters, exhibiting superior data efficiency, perturbation robustness and cross-dataset generalization.

84. 【2608.05673】A Unified Framework for Trajectory Prediction with Explicit Planning and Reaction Decomposition

链接：https://arxiv.org/abs/2608.05673

作者：Jiaheng Chen,Jiaxing Li,Tinghe Zhang,Chaopeng Guo

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：shifted toward structured, structured formulations, formulations with explicit, social, explicit social modeling

备注： Accepted by ACM MM 2026

点击查看摘要

Abstract:Trajectory prediction has shifted toward structured formulations with explicit social modeling. However, existing methods inadequately distinguish the functional roles of social influence in trajectory planning. Observing that agents typically form motion plans by anticipating others' future behaviors before making local reactive adjustments, we identify social interactions as playing staged roles, namely planning precedes reaction. We propose INTraJ, a unified framework that decomposes social influence into two stages: a planning stage constructs reference trajectories using future social information, and a reaction stage recovers local adjustments from the residual between full-context prediction and the reference. INTraJ supports both multi-target and single-target paradigms. Extensive experiments on four standard benchmarks, including Argoverse 2, Argoverse 2-ped, ETH/UCY, and SDD, demonstrate consistent improvements, particularly in FDE and long-horizon consistency, with state-of-the-art performance achieved in several settings. INTraJ reframes trajectory prediction as a planning-driven two-stage process, validating that staged social modeling is critical for stable predictions. The code is publicly available at this https URL.

85. 【2608.05671】URNet: A Unified Reparameterized Network for Efficient RGB-D Semantic Segmentation

链接：https://arxiv.org/abs/2608.05671

作者：Guoan Xu,Zhengxue Wang,Yang Xiao,Ligeng Chen,Guangwei Gao,Dongchen Zhu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Previous RGB-D semantic, methods commonly employ, commonly employ dual, separately process RGB, Previous RGB-D

备注： ACM MM 2026

点击查看摘要

Abstract:Previous RGB-D semantic segmentation methods commonly employ dual encoders to separately process RGB and depth inputs, followed by dedicated modules for cross-modal feature fusion. However, such designs often inadequately capture depth representations and consequently limit effective cross-modal interaction, while the additional encoder branch introduces redundant computation that hinders lightweight execution. To tackle these challenges, we propose URNet, a Unified Reparameterized RGB-D Network that performs simultaneous multi-modal feature extraction and cross-modal fusion within a single encoder. Specifically, we adopt a reparameterization strategy to compact the network architecture and facilitate fast inference. Within each Reparameterized Block (RepBlock), a Linear Gated Attention (LGA) module is introduced to fully exploit complementary RGB and depth cues across different feature scales. Furthermore, considering that decoder design has been relatively underexplored in existing RGB-D segmentation models, we develop a concise yet effective universal decoder, termed the Pyramid Merging Decoder (PMD). Extensive experiments on multiple RGB-D segmentation benchmarks demonstrate that URNet achieves state-of-the-art performance while maintaining high efficiency. Code will be available at this https URL.

86. 【2608.05664】Dual-Attention and Adversarial Transfer Networks for Sim-to-Real Cross-Orientation Wireless Sensing

链接：https://arxiv.org/abs/2608.05664

作者：Linfeng Du,Kehan Wu,Tong Zhang,Rui Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Millimeter-wave human activity, suffers significant performance, significant performance degradation, Millimeter-wave human, collecting labeled multi-orientation

备注：

点击查看摘要

Abstract:Millimeter-wave human activity recognition suffers significant performance degradation when the user's orientation changes relative to the sensing system, yet collecting labeled multi-orientation data is labor-intensive and costly. To eliminate the need for exhaustive multi-orientation measured data, we develop a physics-guided simulator that synthesizes orientation-diverse wireless training data from single-orientation motion. Specifically, to suppress orientation-induced feature variations, we propose a dual-attention network that extracts activity-discriminative and orientation-robust representations from dual-link Doppler spectrograms. To bridge the simulation-to-reality gap, we introduce an adversarial unsupervised transfer learning mechanism that aligns feature distributions using only a small number of unlabeled target-domain samples. The S2M-Sense platform shows high fidelity in reproducing real-world signatures, validated against 60.48 GHz mmWave measured data with an average structural similarity index measure (SSIM) of 0.84 between simulated and measured Doppler spectrograms across all 4 activities and 4 orientations. Experimental results show that S2M-Sense achieves 88.33% recognition accuracy using only the dual-link multi-orientation simulated dataset, which improves to 95% after simulation-to-reality transfer learning with as few as 16 unlabeled measured samples. Both cases with and without transfer learning outperform state-of-the-art cross-domain sensing methods.

87. 【2608.05663】Vorch-Streamer: Extending Human Audio-Visual Generation to Real-Time Long-Form Streaming

链接：https://arxiv.org/abs/2608.05663

作者：Menglin Han,Yang Ding,Yulei Lu,Haoran Yu,Xin Ma,Junyi Chen,Zhangkai Ni,Lin Ma,Yaohui Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

关键词：visual consistency, generation requires causal, maintaining audiovisual synchronization, video generation requires, causal

备注： Project page: [this https URL](https://vorch-project.github.io/Vorch-Streamer-project/)

点击查看摘要

Abstract:Real-time long-form avatar audio--video generation requires causal, continuous synthesis while maintaining audiovisual synchronization and visual consistency. Adapting a pretrained bidirectional model to this setting presents two key dilemmas. First, autoregressively reusing generated blocks as context creates exposure bias, causing errors and visual drift to accumulate over long rollouts. Second, a global speech utterance does not indicates a causal generator which portion should be spoken next when only limited local audio--video context is available. We present \textbf{Vorch-Streamer}, a post-training framework that addresses these challenges and enables real-time long-form Text-to-Audio-Video (T2AV) streaming. We construct a synthetic corpus of 80K avatar clips spanning 12--21 seconds and first train a causal generator with mixed Teacher Forcing and Diffusion Forcing. We then apply long-horizon Self Forcing with DMD distillation, exposing the model to its own rollout distribution while preserving the quality of the pretrained bidirectional teacher. To explicitly control speech progression, an external language model predicts discrete 25-Hz speech-planning tokens, whose continuous features condition the audio diffusion branch and align each causal block with the content it should speak. With bounded causal context and four-step denoising, Vorch-Streamer jointly generates audio and video from text at 27.12 FPS, exceeding the 24-FPS real-time playback rate while maintaining competitive audio--lip synchronization and strong identity preservation over long-form generation.

88. 【2608.05648】Vorch-IR: Long-Form Unified Multimodal Identity Replacement Video Generation

链接：https://arxiv.org/abs/2608.05648

作者：Yaole Wang,Xiaoyu Chen,Xin Ma,Yang Ding,Gang Yue,Jingjing Chen,Lin Ma,Yaohui Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：seeks to transfer, transfer the identities, identity replacement seeks, driving video, replacement seeks

备注： Project page: [this https URL](https://vorch-project.github.io/Vorch-IR-project/)

点击查看摘要

Abstract:Video identity replacement seeks to transfer the identities of one or more subjects while preserving the motion, expressions, and temporal structure of a driving video. Existing methods largely target single-person settings and often require task-specific structural controls, such as masks or pose representations, limiting their flexibility in general multimodal editing systems. Progress on multi-person replacement is further constrained by the scarcity of paired training data. We present Vorch-IR, a unified framework that supports single- and dual-person identity replacement, with optional background replacement, in a single model. Built on LTX2, Vorch-IR jointly conditions on a driving video, indexed reference images, and a textual editing instruction. The reference images need not match the pose, layout, or spatial configuration of the driving video: their roles as subject or background references are specified through the instruction. Dense visual conditions are fused through self-attention, while a vision-language context establishes semantic correspondence through cross-attention. We further develop an automatic data construction pipeline that synthesizes paired supervision for all four editing settings. Experiments using automatic metrics and pairwise human evaluation demonstrate strong identity preservation, motion fidelity, and temporal coherence across diverse scenarios. A temporal overlapping inference strategy additionally extends the short-clip model to minute-long generation without autoregressive continuation.

89. 【2608.05631】ChronoVision: Temporal Reasoning via Latent State Reconstruction

链接：https://arxiv.org/abs/2608.05631

作者：Yifan Shen,Jian Xu,Boyi Li,Yuner Zhang,Tianjiao Yu,Bingxuan Li,Houze Yang,Rushi Wang,Xu Cao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal large language, complex visual cognitive, large language models, language models excel, cognitive tasks requiring

备注：

点击查看摘要

Abstract:Multimodal large language models excel at passive perception but struggle with complex visual cognitive tasks requiring multi-step temporal reasoning. This degradation largely stems from the inherent ambiguity of language-based reasoning, which often fails to accurately articulate continuous visual transformations. To address this, we propose ChronoVision, a multimodal framework designed to align visual logic with latent imagery. During supervised fine-tuning, a Reconstructive Visual Head predicts the latent representation of the final transformed state, while an ROI Attention Locating module focuses the model on key visual evidence via semantic span queries. In post-training, we apply reinforcement learning with an implicit process grounding mechanism, guided by a composite reward function that evaluates outcome correctness, latent process alignment, and unsupervised visual focus. Furthermore, we introduce Vbvr-VQA, a novel dataset that evaluates temporal tracking by reformulating video reasoning into a strict image-ordering task. Experiments demonstrate that ChronoVision achieves state-of-the-art performance on Vbvr-VQA with 74.8% in-domain and 71.6% out-of-domain accuracy, alongside a strong 55.0% accuracy on IntPhys2, a highly challenging cross-domain benchmark.

90. 【2608.05627】SCI-CLIP: Segment-Centric Inference with Reference Memory for Training-Free Open-Vocabulary Segmentation

链接：https://arxiv.org/abs/2608.05627

作者：Mohamad Zamini,Diksha Shukla

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Training-free open-vocabulary segmentation, segmentation remains limited, Training-free open-vocabulary, remains limited, missing inference abstraction

备注：

点击查看摘要

Abstract:Training-free open-vocabulary segmentation remains limited by a missing inference abstraction. Frozen vision-language features are produced at patch level, yet dense prediction requires a unit that simultaneously governs feature interaction, spatial support, contextual recovery, and retrieval-based correction. We present SCI-CLIP, a segment-centric inference framework built around the principle that the same region abstraction should organize all stages of dense open-vocabulary prediction. SCI-CLIP first induces a region-consistent interaction graph over frozen visual tokens, then reconstructs dense features by propagating values over this graph, augmenting them with selective cross-window support only where local evidence is insufficient. The same segment abstraction is subsequently used to construct and query an offline reference memory, aligning exemplar retrieval with the units on which prediction is made. SCI-CLIP turns frozen CLIP-style features into spatially coherent, context-aware, and retrieval-compatible dense predictions without any training. SCI-CLIP consistently improves the structural quality of dense predictions, the robustness of contextual reasoning, and the alignment of exemplar-based correction, yielding stronger open-vocabulary segmentation across eight benchmarks. Project code is available at: this https URL.

91. 【2608.05626】Dual-Output Multi-Exposure HDR Reconstruction via SDR Fusion and Gain Map Inverse Tone Mapping

链接：https://arxiv.org/abs/2608.05626

作者：Jinho Kim,Jinwoo Kim,Seon Joo Kim

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：inverse tone mapping, perceptually balanced SDR, dual-output multi-exposure HDR, map inverse tone, balanced SDR image

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:We propose DOME-HDR, a dual-output multi-exposure HDR reconstruction framework that jointly produces a perceptually balanced SDR image and a consistent HDR image via gain map inverse tone mapping. Given three bracketed LDR inputs, DOME-HDR first synthesizes a base SDR using a LoRA-adapted latent diffusion model. A dual cross-attention fusion module injects complementary structural and color cues from the under- and over-exposed images while anchoring on the mid exposure for stability. The synthesized SDR then guides HPGM, our HDR Prior-guided Gain Map network, to predict a spatially varying gain map for reliable dynamic-range expansion. We evaluate on Kalantari, Tel, and Challenge123 using both full-reference and no-reference metrics, where DOME-HDR achieves state-of-the-art HDR reconstruction quality; ablations further confirm the effectiveness of dual cross-attention and SDR-guided gain map estimation.

92. 【2608.05616】ruthLens: Object Hallucination Detection via Self-Evaluating Truthfulness Scores in LVLMs

链接：https://arxiv.org/abs/2608.05616

作者：Yanqi Wu,Runhe Lai,Xinhua Lu,Qichao Chen,Zhiping Zhou,Jia-Xin Zhuang,Weijiang Yu,Ruixuan Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：large vision language, vision language models, object hallucination remains, trustworthy deployment, remarkable progress

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:Despite the remarkable progress of large vision language models (LVLMs), object hallucination remains a fundamental challenge that hinders their trustworthy deployment. A key finding motivates our work: real and hallucinated object tokens are clearly separable in hidden representations, yet this separability is largely lost at the language-modeling (LM) head. We propose TruthLens, a self-evaluation framework that teaches the LM head to expose a per-object truthfulness signal without any auxiliary model or additional inference cost. Concretely, a rarely-used special token is repurposed as a reference token. For each object-token position, we extract the log-probability assigned to this special token by the LM head, and define its difference from a predefined constant as the truthfulness score. The model is then fine-tuned with an MSE objective that drives scores toward 1 for real objects and 0 for hallucinated ones, while a divergence constraint preserves the original generation capability. Despite being trained on only a limited set of object categories, TruthLens generalizes effectively to benchmarks with substantially larger label spaces. Extensive experiments across multiple LVLMs demonstrate state-of-the-art performance; notably, on Qwen2.5-VL-7B, TruthLens outperforms the previous best method on MS-COCO by over 17\% in AUROC. Our code is available at this https URL.

93. 【2608.05615】ALTER: Modeling Longitudinal Changes via Regional Differencing for 3D CT Report Generation

链接：https://arxiv.org/abs/2608.05615

作者：Dongchen Li,Jitao Liang,Wei Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：automatically generating accurate, Computed tomography, complete radiology reports, clinical diagnosis, automatically generating

备注：

点击查看摘要

Abstract:Computed tomography (CT) is widely used for clinical diagnosis and longitudinal follow-up, yet automatically generating accurate and complete radiology reports from three-dimensional (3D) CT remains challenging. Existing methods improve fine-grained correspondence between images and text by modeling anatomical regions, but remain centered on the current examination. Consequently, patient-specific longitudinal changes within individual regions remain insufficiently modeled. Meanwhile, interval changes are often distributed across multiple anatomical regions, complicating a coherent assessment of the overall longitudinal state. We propose Anatomically Localized Temporal Evidence Representation (ALTER) to address these limitations. Global Prior Integration (GPI) incorporates the prior CT and report to establish historical context for the current examination. Regional Proxy Differencing (RPD) enables each current anatomical region to retrieve a historical proxy from a single shared encoding of the prior volume and to derive localized interval evidence. Interval Change Fusion (ICF) further combines current abnormality states with region-distributed differences, converting their joint representation into change-aware soft prompts that guide report generation. ALTER achieves state-of-the-art results on most evaluation metrics across the RadGenome-ChestCT validation and CTRG-Chest-548K test sets. Code and data preprocessing details are available at this https URL.

94. 【2608.05600】LC-GRPO: Bridging Train-Inference Gap for Flow-Based GRPO with Langevin Correction

链接：https://arxiv.org/abs/2608.05600

作者：Yingqing Guo,Hui Yuan,Zijian He,Mengdi Wang,Zheng Ding

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：ordinary differential equation, ODE Euler step, Flow-based generative models, stochastic differential equation, differential equation

备注：

点击查看摘要

Abstract:Flow-based generative models are typically sampled by solving a deterministic ordinary differential equation (ODE), whereas online reinforcement learning requires stochastic rollouts for policy exploration and optimization. Existing GRPO methods for flow models therefore replace the inference-time ODE with a stochastic differential equation (SDE) during training. Although the ODE and SDE share the same marginal distributions in continuous time, their finite-step discretizations can differ substantially. In particular, SDE rollouts often become blurry as the exploration noise increases, creating a mismatch between the samples used for reinforcement learning and those generated by the test-time ODE sampler. We introduce LC-GRPO, a flow-based GRPO framework with Langevin correction. Each rollout transition first takes an inference-aligned ODE Euler step and then applies a stochastic Langevin correction targeting the marginal distribution at the resulting timestep. The required score is recovered directly from the flow velocity, requiring no additional score model, while the resulting transition remains an isotropic Gaussian with a tractable likelihood for policy optimization. We theoretically show that, under suitable conditions, one Langevin correction step reduces the Wasserstein error of an imperfect ODE Euler step. At a matched randomness level, we further show that the proposed transition can be more accurate than the standard Euler--Maruyama discretization of the reverse SDE. Experiments on SD3.5-Medium, FLUX.1-Dev, and HunyuanVideo demonstrate that LC-GRPO consistently improves reward optimization across text-to-image and text-to-video tasks, preserves generation quality, and substantially narrows the gap between stochastic training rollouts and deterministic test-time ODE inference.

95. 【2608.05597】Uncertainty-Aware World Model for Aerial Image-Goal Navigation

链接：https://arxiv.org/abs/2608.05597

作者：Deyi Zhu,Haoyu Fan,Yinan Zhu,Weichen Zhang,Shilin Ma,Xinlei Chen,Yansong Tang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：unmanned aerial vehicle, Aerial image-goal navigation, image-goal navigation requires, requires an unmanned, reach a target

备注：

点击查看摘要

Abstract:Aerial image-goal navigation requires an unmanned aerial vehicle (UAV) to reach a target location specified by a goal image. Existing world-model-based methods rank candidate trajectories using predicted futures, but typically rely on only one or a few point predictions, which is inadequate for large-scale outdoor environments with substantial future-state uncertainty. To address this limitation, we propose the Uncertainty-Aware Navigation World Model (UA-NWM), an efficient latent world model for aerial image-goal navigation, which formulates trajectory scoring as conditional out-of-distribution detection. UA-NWM represents plausible futures with an uncertainty subspace and decomposes the prediction--goal discrepancy into uncertainty-explainable and unexplainable components. Only the unexplainable residual is used for scoring, enabling robust selection without multiple future samples. Extensive experiments demonstrate that UA-NWM consistently outperforms existing navigation world models while maintaining low inference latency. Real-world UAV experiments further validate its practical applicability. Project page: this https URL

96. 【2608.05592】Beyond Frame Selection: Rethinking Long-Video Understanding with MLLMs

链接：https://arxiv.org/abs/2608.05592

作者：Ziling Huang,Shin'ichi Satoh

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large Language Models, Multimodal Large Language, Multimodal Large, Language Models, Large Language

备注：

点击查看摘要

Abstract:Multimodal Large Language Models (MLLMs) have achieved strong progress in video understanding, yet it remains challenging because the token limitation makes MLLMs difficult to capture temporally sparse evidence. Existing methods typically rely on uniform sampling, or frame selection, but these strategies usually optimize either broad temporal coverage or local relevance, making it difficult to preserve both global storyline context and fine-grained evidence. We propose VideoRouter(VR) that rethinks long-video understanding as coordinating complementary evidence views rather than selecting a single subset of frames. It first organizes each video into a question-agnostic temporal hierarchy, which partition the video into coarse-to-fine temporally coherent segments. In this hierarchy, upper-level nodes capture broad storyline context and event progression, while lower-level nodes preserve fine-grained local details and evidence-bearing moments. This naturally gives rise to two complementary views: a global view for coverage-oriented reasoning and a local view for detail-oriented evidence recovery. We further introduce a verification-guided router to determine which view is better supported by the selected evidence and select the final answer. We validate the effectiveness of the proposed design through extensive experiments, showing that the verification-guided router effectively coordinates global and local reasoning, and that, on VideoMME, our method outperforms state-of-the-art frame selection methods by 2.9 points, respectively, under the LLaVA-Video-7B backbone. We will release the code.

97. 【2608.05570】A Multi-Layer System for Ultra-High-Resolution Static 360-Degree Telepresence

链接：https://arxiv.org/abs/2608.05570

作者：Jiapeng Chi,Gerd Bruder,Carsten Neumann,Carolina Cruz-Neira,Dirk Reiners

类目：Human-Computer Interaction (cs.HC); Computer Vision and Pattern Recognition (cs.CV)

关键词：telepresence offers strong, offers strong immersive, strong immersive potential, display hardware, video telepresence offers

备注： 11 pages, 11 figures. Accepted to IEEE ISMAR 2026, to appear in IEEE Transactions on Visualization and Computer Graphics (TVCG)

点击查看摘要

Abstract:360-degree video telepresence offers strong immersive potential but remains constrained by the limited resolution of current capture and display hardware. Many telepresence installations feature fixed viewpoints and largely static scenes, yet optimization strategies tailored to such setups have received limited attention. We present a multi-layer, ultra-high-resolution system for static 360-degree telepresence that combines an 8K panoramic camera with a rotatable 4K pan-tilt-zoom (PTZ) camera. Our approach builds a three-layer representation: (1) a tile-based ultra-high-resolution panoramic background, generated by offline stitching high-detail 4K PTZ scans onto the base 8K panorama to achieve effective resolution beyond native capture, and represented as a set of spatial tiles; (2) a dynamic update layer that composites foreground motions from the 8K stream via real-time high-resolution background matting; and (3) a region-of-interest 4K layer that streams a real-time PTZ view of the selected region and additionally updates the corresponding background tiles over time. We evaluate the proposed system through comparisons with representative video super-resolution approaches and a user study assessing perceived detail and immersive experience. Our results indicate that tile-based background refinement, together with user-guided updates, provides a practical way to balance panoramic fidelity and interactivity in static 360-degree telepresence.

98. 【2608.05569】CoordRefer: Coordinate-Aware 3D Visual Grounding from Multiview Images

链接：https://arxiv.org/abs/2608.05569

作者：Haijie Li,Jiaxin Zhang,Dave Zhenyu Chen,Youyu Chen,Yanmin Wu,Jian Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multiview image-based, coordinate frame selection, visual grounding predicts, coordinate frame, coordinate

备注：

点击查看摘要

Abstract:Multiview image-based 3D visual grounding predicts a coordinate frame to define a coordinate system and then regresses a 3D bounding box for localization. However, existing methods jointly optimize coordinate frame selection and box regression, leading to coordinate-relative box ambiguity and degraded grounding performance. This ambiguity arises because the same box admits different numerical representations across coordinate frames, creating multiple optimization targets and yielding invalid compromise predictions. To tackle this challenge, we propose CoordRefer, a coordinate-aware framework that decouples coordinate frame selection from coordinate-conditioned grounding. CoordRefer first selects a reference frame to define the coordinate system and then conditions 3D box prediction on the coordinate system. We perform coordinate-aware supervised fine-tuning to establish coordinate frame selection and coordinate-conditioned box regression, followed by Group Relative Policy Optimization with 3D IoU-based rewards to align both stages with downstream grounding quality. On ScanRefer with Qwen3-VL-2B, CoordRefer achieves gains of 11% in Acc@0.25 and 7% in Acc@0.5 over the coordinate-agnostic baseline, while its geometrically refined variant surpasses methods using explicit 3D inputs.

99. 【2608.05565】EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal

链接：https://arxiv.org/abs/2608.05565

作者：Feier Wu,Wanke Xia,Xu He,Zilang Zhou,Si Chen,Dongxia Liu,Liyang Chen,Qimeng Wu,Zhengbo Zhang,Wenming Yang,Zhiyong Wu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：spatiotemporally coherent restoration, coherent restoration, maintaining high-fidelity, high-fidelity and spatiotemporally, spatiotemporally coherent

备注： Project: [this https URL](https://morleyolsen.github.io/EffectLearner/)

点击查看摘要

Abstract:Video object removal must eliminate not only the target object but also its induced effects while maintaining high-fidelity and spatiotemporally coherent restoration. Existing methods mainly learn object-effect correspondences implicitly from predefined effect categories and fixed data distributions, limiting their generalization to complex real-world scenes involving compositional effects, spatially detached or weakly correlated effects, long-tail physical phenomena, and dynamically evolving interactions. We propose EffectLearner, a semantic-reasoning-enhanced framework that combines a VLM-based Object-Effect Reasoner with a DiT-based Video Eraser. Guided by a structured effect-analysis prompt, the Reasoner performs cross-modal reasoning over a target-highlighted video and extracts compact effect-aware context, which guides the Video Eraser toward comprehensive object-effect removal. Motion-aware mask guidance and motion-consistency supervision further improve removal coverage and spatiotemporal stability under object motion and evolving scene dynamics. To fully exploit the framework in challenging real-world scenarios, we further construct EffectWorld, a paired video dataset specifically designed for complex object-induced effects, and introduce a progressive training curriculum that combines common supervision with complex-effect data. On the standard ROSE-Bench, EffectLearner outperforms existing baselines on most metrics and achieves clear advantages on both EffectWorld-Eval and the challenging EffectWorld-Wild, demonstrating its ability to deliver high-quality video object removal in complex real-world scenes.

100. 【2608.05560】From Sports to Safety: Benchmarking Proactive Risk Inference in MLLMs

链接：https://arxiv.org/abs/2608.05560

作者：Jiawei Qiu,Yichen Xu,Jianzhe Ma,Mingyang Yu,Wenbin Zhu,Yang Han,Pinzheng Lv,Wenxuan Wang

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Timely anticipation, hazard prediction underexplored, existing MLLM evaluations, MLLM evaluations focus, prediction underexplored

备注： Preprints

点击查看摘要

Abstract:Timely anticipation of physical hazards is essential for real-world safety, yet existing MLLM evaluations focus on harmful content or general risks, leaving proactive physical hazard prediction underexplored. Sports provide a well-suited testbed: accident causes span diverse injury dimensions and pre-accident spatiotemporal cues draw on reasoning capabilities shared with broader safety domains such as autonomous driving and fall detection. We introduce SPRINT (Sports Proactive Risk INference Testbed), a benchmark of 2,888 real-world sports videos (2,440 accident, 448 safe controls) spanning 14 sports and 3 environmental settings. Accident videos feature fine-grained annotations of early hazard cues, accident timing, and hierarchical causes; safe videos are manually verified as accident-free and serve to diagnose prompt-induced false alarms. Evaluating state-of-the-art MLLMs under diverse prompts and temporal windows reveals a sharp gap between hazard sensitivity and understanding: the best model exceeds 95% in signaling hazards yet falls below 50% in identifying their causes. Diagnostic experiments further show that explicit danger queries trigger severe false alarms even on hazard-free videos. These findings indicate that current MLLMs exhibit only superficial proactive safety, lacking stable, cause-grounded early warning, and underscore the need for reliable proactive safety in dynamic physical environments. Data and code will be open-sourced upon acceptance.

101. 【2608.05557】Hierarchical Flow Matching for 3D Point Cloud Generation

链接：https://arxiv.org/abs/2608.05557

作者：Linhao Wang,Qichang Zhang,Ye Su,Hao Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：local geometric details, Generating high-quality, Flow Matching, geometric details, clouds requires capturing

备注：

点击查看摘要

Abstract:Generating high-quality 3D point clouds requires capturing both global shape topology and local geometric details. Existing flow-based methods rely on continuous normalizing flows (CNFs) that demand expensive ODE solving and trace estimation during training, while diffusion models require hundreds of iterative denoising steps. Moreover, most approaches adopt single-level generation directly in point space, disregarding the hierarchical structure natural to 3D shapes. We propose Hierarchical Flow Matching (HFM) that extends flow matching to bilevel structure for unconditional 3D point cloud generation. HFM decomposes the task into two levels via optimal-transport flow matching: a \textit{Latent Flow Matching} models the global shape manifold in a compact latent space, and a \textit{Conditional Point Flow Matching} reconstructs detailed point clouds conditioned on the latent code. Both flows are trained with simple MSE regression losses. The resulting straight OT paths enable efficient sampling with as few as 15 Euler steps per flow, while the structured latent space supports downstream tasks including classification. Extensive experiments on ShapeNet and ModelNet benchmarks demonstrate that HFM achieves competitive or even best performance compared with prior state-of-the-art methods.

102. 【2608.05539】OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction

链接：https://arxiv.org/abs/2608.05539

作者：Taiting Lu,Runze Liu,Ziwei Dong,Sisong Bei,Jingying Zeng,Mingjia Wang,Zhenghao Li,Kaiyuan Lin,Yi-Shan Wu,Yangshoudu Zheng,Hongxing Pan,Kai Zhang,Guoliang Shi,Ling Ma,Yifan Yang,Jiaying Lu,Qi He,Sung-Liang Chen,Yi-Chao Chen,Yincheng Jin,Mahanth Gowda

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent vision-language models, industrial mechanical design, generate executable CAD, Recent vision-language, millimeter-level tolerances required

备注：

点击查看摘要

Abstract:Recent vision-language models (VLMs) can generate executable CAD programs from images, but existing methods mainly target coarse, general-purpose 3D objects and rarely address the fine-grained geometry and millimeter-level tolerances required in industrial mechanical design. We introduce OmniMech, the first million-scale benchmark for evaluating VLMs on executable CAD generation from industrial manufacturing data. OmniMech contains more than 251,000 fully dimensioned and toleranced 2D orthographic drawings, paired with native CAD models, multi-view renderings, mesh, STEP and B-rep representations, and rich semantic annotations. The benchmark includes four tasks: (1) parametric CAD program synthesis from engineering drawings; (2) diagram-to-3D reasoning for geometrically and structurally consistent reconstruction; (3) annotation-grounded reasoning over dimensions, symbols, feature callouts, and manufacturing constraints; and (4) tool-augmented agentic reasoning using visualization, measurement, CAD execution, and verification tools. Experiments show that current VLMs and CAD-specialized models still struggle with executable program synthesis, fine-grained 3D reconstruction, and reliable enforcement of dimensions and tolerances. We will release the benchmark data, evaluation code, and tool interfaces to support future research.

103. 【2608.05523】HERA: Historical Evidence Routing Adapter for Physical Prediction in Latent World Models

链接：https://arxiv.org/abs/2608.05523

作者：Yuanruyi,Yue Cao,Haojia Gao,Guanqiu Guo,Ziyuezhang,Shangqin,Junbo Tan,Bokui Chen,Zhuo Zou,Xueqian Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Predictive video models, Predictive video, learning latent visual, latent visual dynamics, historical evidence

备注：

点击查看摘要

Abstract:Predictive video models have emerged as promising world models by learning latent visual dynamics from large-scale video. Yet these models remain challenged by physical events under occlusion, where later predictions may depend on object evidence that is no longer available in the current view. Addressing this challenge requires historical evidence not only to be preserved but also to remain accessible when it becomes relevant to a subsequent prediction. Existing approaches mainly enlarge the temporal context, cache generic video features, or impose explicit object-centric states, thereby improving the capacity or structure of retained history. However, they do not directly address how relevant historical evidence can be selectively retrieved and integrated into a pretrained predictor without interfering with its native latent workspace. Accordingly, we introduce HERA (Historical Evidence Routing Adapter), a framework for routing retained historical evidence into a frozen latent predictor, and instantiate it with Register-Routed Patch Memory (RRPM), a lightweight adapter comprising a Structured Memory Bank, Memory Registers, and Workspace Registers. On the IntPhys2 Main split, HERA with RRPM improves the pairwise AvgSurprise accuracy of V-JEPA 2-G from 52.57% to 54.35%. Subgroup analysis shows particularly strong improvements on fixed-camera continuity, from 46.15% to 57.69%, and fixed-camera immutability, from 46.15% to 63.46%. These results support historical evidence routing as a practical adaptation strategy for physical prediction in latent world models.

104. 【2608.05505】DynaPix: Can Vision-Language Models Identify the Exact Future?

链接：https://arxiv.org/abs/2608.05505

作者：Thong Nguyen,Vinh-Hien Do,Quynh Vo,Cong-Duy Nguyen,See-Kiong Ng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：physical scene requires, scene requires knowing, requires knowing, knowing its real, Acting

备注： Work in progress

点击查看摘要

Abstract:Acting in a physical scene requires knowing its real later state, not a plausible one. Current evaluations often accept words or a realistic-looking image, so the predicted state is never checked against the true one. We introduce DynaPix (Dynamic Pixels), a benchmark that makes prediction checkable. Given a video clip that stops before a key event and a question about a later moment, a model must pick the true future image from close candidates or a large gallery. The scenes come from a physics simulator, so the correct image and its time are known exactly and the wrong options are deliberately similar. Models often succeed when a visible event marks the target moment, but are near chance when only elapsed time marks it. Gallery search is harder still, as the true image rarely ranks first. People handle the elapsed-time items well, so the difficulty lies with the models, not the questions. Training on scene accounts drawn from the simulator's true record, not a teacher's guess, repairs much of this but not the longer elapsed time case. DynaPix thus exposes a temporal-anchoring gap: models attach a prediction to an event far better than to time itself.

105. 【2608.05499】APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning

链接：https://arxiv.org/abs/2608.05499

作者：Sadegh Jafari,Mohiuddin Bilwal,Fan Zhou,Brian Gelder,Ali Jannesari

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Modern deep neural, achieve strong performance, resource-constrained edge devices, deep neural networks, neural networks achieve

备注： 22 pages, 7 figures

点击查看摘要

Abstract:Modern deep neural networks achieve strong performance, but their scale makes them costly and slow, especially on resource-constrained edge devices. Pruning and quantization address this, but rely on manual, expert choices and on algorithms that are hard to apply across architectures. Uniform settings also ignore how differently individual layers respond to compression, which costs accuracy. We introduce APQF, an agentic profiling-guided framework that combines structured pruning, mixed-precision quantization-aware training, and accuracy recovery in one automated pipeline. A profiling agent measures how cost is distributed across the model and how sensitive each part is to pruning, and this evidence drives per-layer pruning ratios, per-layer bit-widths, and the recovery strategy, all proposed by LLM planners and validated before execution. To our knowledge, APQF is the first framework to combine LLM-guided, profiling-grounded decisions with a fully training-aware pruning and quantization pipeline for both CNNs and vision transformers. We evaluate APQF on ResNet, VGG7, ViT, DeiT, and Swin using ImageNet-1k and CIFAR-10. On ImageNet it cuts compute to 5.6-7.7 percent of the original bit-operations, a 13-18x reduction, while keeping accuracy close to the baseline, and under a 200K-image budget it stays roughly 17 points higher in Top-1 than existing joint pruning and quantization methods. On CIFAR-10 it compresses further than that method on four of five architectures. On VGG7 it reaches 93.15 percent using only 0.41 percent of baseline bit-operations, the only method at that compression level to improve on its full-precision baseline. Ablations show that uniform compression loses the most accuracy at matched compute, and that withholding profiling data from the planner hurts every model. Six LLM planners, including free open-weight ones, all reach 97.4-97.9 percent on Swin-Tiny.

106. 【2608.05485】VideoArgus: Agentic Rubric-Grounded Unified Evaluation for Video Generation and Editing

链接：https://arxiv.org/abs/2608.05485

作者：Ziyun Zeng,Zixuan Wang,Yongsheng Yu,Hang Hua,Jiebo Luo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Evaluating generated videos, fixed evaluation content, Evaluating generated, provide limited evidence, existing benchmarks rely

备注： Preprint

点击查看摘要

Abstract:Evaluating generated videos remains challenging because existing benchmarks rely on fixed evaluation content, cover only a subset of generation and editing settings, and provide limited evidence for their scores. We introduce VideoArgus, a unified rubric-grounded framework covering five video generation and editing settings. For each input instance, VideoArgus generates an output-blind, sample-specific rubric once and reuses it to evaluate all corresponding candidate videos. The rubric defines concrete criteria, scoring rules, failure modes, and evidence plans, which guide criterion-specific VLM QA and visual tools to produce evidence-grounded criterion scores, rationales, and a diagnostic report. We further construct VideoArgus-Bench, containing 1,026 curated input instances built from 653 high-quality images and 416 high-quality videos, with all benchmark rubrics pre-generated, frozen, and released. On a separate 1,260-video human-alignment set, VideoArgus achieves higher within-input Spearman and Kendall correlations with human judgments than the corresponding benchmark-specific evaluators across all five tasks. Model rankings also remain largely consistent across different rubric-generation and evaluation-VLM backbones. All code and data are released. Visit our project page: this https URL

107. 【2608.05482】CDSeg: A Renderable Gaussian Carrier for Image-to-3D Label Transfer

链接：https://arxiv.org/abs/2608.05482

作者：Wentao Sun,Yiping Chen,Zhengsen Xu,Jonathan Li,John S. Zelek

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Modern image models, models provide strong, provide strong cues, Modern image, emph

备注： 15 pages, 8 figures

点击查看摘要

Abstract:Modern image models provide strong cues about \emph{what} should be segmented in each view, but their masks do not by themselves determine \emph{where} those labels should persist in 3D. We present Cross-Domain Segmentation via Gaussian Splatting (CDSeg), a label-transfer interface that requires no task-specific 3D segmentation training and uses Gaussian primitives as a renderable label carrier. An external mask source supplies the labels, while renderer-derived visibility determines which 3D primitives receive them. The carrier is instantiated either by completing each input point into one Gaussian, preserving its index, or by reusing the native primitives of an optimized Gaussian scene. CDSeg records pixel--primitive associations during rendering and fuses multi-view masks through voting and a local filter. The resulting labels can be returned to the original points, retained on the native Gaussian scene, or rendered into other views. CDSeg covers promptable, automatic instance, semantic, and LiDAR settings and processes scenes with millions of primitives in seconds. It obtains 92.35\% mIoU on DesktopObjects-360, 95.89\% on NeRDS-360, and 65.77\% on the full ScanNet-v2 validation split using the provided 2D semantic annotations. CDSeg thereby provides one interface for reusing 2D masks across point clouds, Gaussian scenes, and image views without a task-specific 3D segmentation network.

108. 【2608.05478】GenGA: Editable and Data-Grounded Graphical Abstract Generation for Academic Papers

链接：https://arxiv.org/abs/2608.05478

作者：Takuro Kawada,Shunsuke Kitada,Hitoshi Iyatomi

类目：Graphics (cs.GR); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG); Multimedia (cs.MM)

关键词：Graphical Abstracts, visually summarize, playing a crucial, summarize the key, key findings

备注： 20 pages, 11 figures, 4 tables

点击查看摘要

Abstract:Graphical Abstracts (GAs) visually summarize the key findings of academic papers, playing a crucial role in facilitating the understanding of research content. Recently, advancements in vision-language models and image generation models have enabled the automatic generation of scientific figures based on paper content. However, most conventional methods output the generated results as raster graphics, making post-editing (e.g., text modification and layout changes) highly difficult. This poses a significant challenge, as they are unsuitable for the iterative figure revision process inherent in paper writing and peer review. To tackle these challenges, we define the novel task of generating editable GAs from paper content and propose GenGA, a new GA generation framework that directly produces figures in vector format. By generating figures as a collection of vector elements with a hierarchical structure, GenGA produces outputs that can be seamlessly imported into existing drawing tools for intuitive, element-level editing. Furthermore, we introduce the Structural Independence Coefficient (SIC), a metric that quantifies the editing simplicity of a figure based on the degree to which local modifications propagate to other elements. Experimental results show that GenGA achieves superior editing simplicity compared to conventional methods, and even surpasses human-authored GAs in conciseness and semantic alignment. We also validate SIC as an effective metric correlated with manual editing costs. This study fundamentally redefines GA generation as an editable vector graphic generation problem grounded in the practical workflows of researchers, significantly promoting effective scientific communication.

109. 【2608.05450】MOSAIK: Multi-Patch Content-Aware Spatial Allocation of Image Tokens for Efficient Generation

链接：https://arxiv.org/abs/2608.05450

作者：Mohammadreza Hami,Mohammadreza Samadi,Chao Gao,Negar Hassanpour

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Pixel-space diffusion models, diffusion models avoid, latent diffusion models, Pixel-space diffusion, diffusion models

备注：

点击查看摘要

Abstract:Pixel-space diffusion models avoid the reconstruction ceiling of latent diffusion models by generating directly in image space. However, their substantially higher token count makes generation expensive due to the quadratic complexity of self-attention. Several existing efficiency methods reduce this cost by using larger patches at selected denoising steps, thereby representing the image with fewer tokens. Yet, each step still uses a single patch size uniformly across the entire image, overlooking that different regions suffer different fidelity losses when coarsened. We introduce MOSAIK, a damage-guided framework that varies patch size across regions and denoising steps. MOSAIK adapts the PixelDiT backbone to generate arbitrary heterogeneous patch layouts, and a lightweight predictor uses intermediate denoising features to estimate the fidelity loss caused by coarsening each region. Given a token budget, our damage-guided layout predictor assigns fine patches to sensitive regions and coarse patches elsewhere. Remarkably, while reducing FLOPs by 70% and token count by 83%, MOSAIK matches the full-compute PixelDiT on GenEval and its DPG-Bench score drops by only 1.0 point. Compared to diverse efficiency paradigms, including temporal patch scheduling and feature caching, our approach delivers highly competitive performance at moderate budgets and consistently outperforms these baselines in highly constrained compute regimes.

110. 【2608.05424】Invisible Shortcuts: Why Vision Encoders Know Your Camera

链接：https://arxiv.org/abs/2608.05424

作者：Vladan Stojnić,Ryan Ramos,Giorgos Kordopatis-Zilos,Noa Garcia,Giorgos Tolias

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Deep vision models, Deep vision, vision models exploit, relying on cues, cues that correlate

备注： ECCV 2026

点击查看摘要

Abstract:Deep vision models exploit shortcuts, relying on cues that correlate with supervision signals. Prior work has focused on visible biases, such as object-background or texture correlations. We identify a different source of shortcut learning: invisible metadata traces embedded at the pixel level, for metadata such as image processing and photo acquisition. We hypothesize that large-scale semantic supervision, whether through categorical labels (ImageNet) or billion-scale captions (LAION), naturally induces metadata-semantics correlations during pretraining, leading models to convert low-level signals into predictive features. By introducing controlled metadata-semantics correlations, we show that stronger ones produce systematically higher sensitivity to metadata traces and larger performance degradation under metadata distribution shifts. We further explore mitigation strategies applied during and after pretraining that reduce sensitivity not only to targeted metadata but also to unseen ones, without sacrificing performance on downstream tasks. Metadata sensitivity also has a positive side: it partly explains the strong generated-image detection ability of some encoders, while its mitigation can improve out-of-distribution generalization. Code: this https URL

111. 【2608.05393】Adapting Vision Foundation Models with Cascaded Semantics

链接：https://arxiv.org/abs/2608.05393

作者：Xi Xiao,Xingjian Li,Cheng Han,Tianyang Wang,Lin Zhao,Yunbei Zhang,Guosheng Hu,Runmin Jiang,Xi Li,Xiao Wang,Min Xu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：paradigm in NLP, leading parameter-efficient adaptation, parameter-efficient adaptation paradigm, leading parameter-efficient, recently been extended

备注： Accepted by Transactions on Machine Learning Research (TMLR), 2026. Project page: [this https URL](https://xixiaouab.github.io/Cascaded-Semantics/)

点击查看摘要

Abstract:Prompt tuning, a leading parameter-efficient adaptation paradigm in NLP, has recently been extended to computer vision. Visual prompt tuning (VPT) adapts pre-trained vision transformers (ViTs) by updating a small set of additional prompt parameters. However, existing visual prompts are randomly initialized and do not exploit prior knowledge, such as instructions in NLP. We address this gap by injecting two complementary semantic priors into VPT. Fundamental image priors, including color, texture, and shape, are extracted with classical hand-crafted operators and injected into the input space, while self-attention maps provide instance-aware semantics in the feature space. We further propose a cascaded scheme that integrates both priors throughout ViT adaptation. Experiments on 34 challenging image classification datasets demonstrate superior downstream adaptation while tuning only 0.74% of ViT parameters. Project page: this https URL.

112. 【2608.05389】xt-Guided Refinement of Multi-sequence Glioma Subregion Segmentation with a Vision-Language Foundation Model

链接：https://arxiv.org/abs/2608.05389

作者：Zach Eidex,Yu-nong Lin,Mojtaba Safari,Sean Pitroda,Ralph Weichselbaum,Zhen Tian,Xiaofeng Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Accurate glioma subregion, Toggle, Accurate glioma, Toggle Hugging Face, Explorer Toggle Bibliographic

备注：

点击查看摘要

Abstract:Background: Accurate glioma subregion delineation is important for radiotherapy planning and longitudinal monitoring, but manual contour correction is time-consuming. Models such as nnU-Net may generalize imperfectly and lack clinician-directed text correction. Purpose: We investigated adapting a three-dimensional (3D) vision-language foundation model for text-guided brain tumor segmentation refinement. Methods: We developed a lightweight VoxTell-based framework. Pretrained VoxTell generated initial masks. Oracle prompts derived from segmentation errors encoded target, action, location, imaging evidence, edit size, and preservation constraints. Frozen Qwen/VoxTell prompt embeddings were injected through trainable projections into its multiscale decoder conditioning; other weights remained frozen. Training, validation, and testing used 901, 100, and 250 BraTS-GLI cases. Cross-dataset transfer was evaluated on 100 meningioma, metastasis, pediatric tumor, and UPENN-GBM cases. Results: On the internal test set using post-contrast T1-weighted input, correct instructions improved subregion Dice similarity coefficient (DSC; enhancing tumor, edema, and necrotic/non-enhancing core) from $0.774\pm0.158$ to $0.796\pm0.137$. They outperformed blank prompts ($0.762\pm0.155$; Holm-adjusted $p0.001$, $d_z=0.71$) and contradictory prompts ($0.770\pm0.163$; $p0.001$, $d_z=0.48$). In cross-dataset testing, correct instructions improved DSC from $0.527\pm0.287$ to $0.550\pm0.278$ and outperformed contradictory instructions ($0.504\pm0.275$; $p0.001$, $d_z=0.43$). Conclusion: A 3D vision-language foundation model can perform instruction-guided refinement of glioma subregion segmentations. Sensitivity to correct, blank, and contradictory prompts suggests text-dependent contour editing rather than nonspecific post-processing, supporting further evaluation as a clinician-in-the-loop tool.

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.05389 [cs.CV]

(or
arXiv:2608.05389v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2608.05389

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Zach Eidex [view email] [v1]
Wed, 5 Aug 2026 20:17:02 UTC (1,853 KB)

Full-text links:
Access Paper:

View a PDF of the paper titled Text-Guided Refinement of Multi-sequence Glioma Subregion Segmentation with a Vision-Language Foundation Model, by Zach Eidex and 5 other authorsView PDFHTML (experimental)TeX Source

view license

Current browse context:
cs.CV

prev

|
next

new
|
recent
| 2026-08

Change to browse by:

cs

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author
Venue
Institution
Topic

    About arXivLabs

arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.

Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)

mathjaxToggle();

    We gratefully acknowledge support from
    our major funders,
    member institutions, ,
    and all contributors.

About

Help

Contact

Subscribe

Copyright

Privacy

Accessibility

Operational Status (opens in new tab)

Major funding support from

113. 【2608.05369】World-to-Wrist: Task-Conditioned Future Wrist Modeling for Fine-Grained Robot Manipulation

链接：https://arxiv.org/abs/2608.05369

作者：Yuhao Pan,Haosong Peng,Zhengshen Zhang,Zhengyang Yan,Yalun Dai,Fushuo Huo,Chujie Wang,Tianyu Qi,Xiucheng Wang,Nan Cheng,Wenchao Xu

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：parallel visual inputs, visual inputs, overlooking their distinct, treat main-view, main-view and wrist-view

备注：

点击查看摘要

Abstract:Vision-language-action (VLA) models often treat main-view and wrist-view observations as parallel visual inputs, overlooking their distinct roles in robot manipulation. Fine-grained manipulation, however, benefits from anticipating how wrist-local interactions may evolve under the global task context. To address this limitation, we present World-to-Wrist VLA (W2-VLA), a VLA model for fine-grained robot manipulation with task-conditioned future wrist modeling. Given current multi-view observations and a task instruction, W2-VLA contextualizes a set of latent modeling tokens as a compact interface between the vision-language model and the wrist predictor. Conditioned on this interface and the observed wrist history, the predictor forecasts future wrist latents, which are transformed into future-aware context for action prediction. In addition, we introduce W2-CoT, a synthesis pipeline that produces structured annotations describing manipulation progress, physical transition cues, and wrist-local evidence. These annotations provide auxiliary supervision that shapes the task-conditioned latent interface. Experiments on LIBERO, RoboTwin 2.0, and real-world manipulation tasks demonstrate improved fine-grained and contact-sensitive manipulation across both single-arm and bimanual settings, while maintaining action-generation rates above 80 Hz.

114. 【2608.05356】LoDA: A Level of Detection Aware Method and a Multimodal Sensing Benchmark for Object Level Change Detection

链接：https://arxiv.org/abs/2608.05356

作者：Haitian Wang,Xinyu Wang,Sheldon Fung,Xian Zhang,Zichen Geng

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：require reliable detection, digital maps aligned, smart-city services, physical world, multi-temporal urban LiDAR

备注： 10 pages, 5 figures, 5 tables. Accepted at the 34th ACM International Conference on Multimedia (ACM MM 2026) Main Track

点击查看摘要

Abstract:High-definition 3D LiDAR maps are important for autonomous driving and smart-city services, which require reliable detection of object-level changes in multi-temporal urban LiDAR to keep digital maps aligned with the physical world. Existing approaches from raster height differencing to depth image and point-cloud networks often remain tile-based and threshold-driven, yielding per-point scores without explicit detection limits or consistent object-level labels. We propose an object-level 3D change-detection pipeline that integrates detection-limit-aware registration, geometry-driven object proxies with rule-based semantic and instance segmentation, and displacement cues in height, volume, and surface-normal direction to assign five change labels with confidence. By decoupling registration, geometry, and semantics, the pipeline propagates pose uncertainty into spatially varying detection limits, stabilizes cross-epoch correspondences, and suppresses false changes caused by residual misalignment and density variation. We also present LoDA, a level-of-detection (LoD) aware benchmark for the Subiaco district with fused multi-temporal vehicle-LiDAR maps constructed with LiDAR, GNSS, and IMU support, semantic instances, and object-level annotations. On this benchmark, our method achieves 95.0% accuracy, 90.8% macro F1, and 83.0% macro IoU, exceeding the best baseline by 8.7 IoU points and 4.4 F1 points. On the public Urb3DCD-V2 benchmark evaluated under the official point-wise protocol, it reaches 96.81% mean accuracy and 89.52% mean change IoU, improving over the strongest reported baselines by 1.36 points in mAcc and 3.18 points in mIoUch.

115. 【2608.05341】Positive-Unlabeled Preference Optimization For Chest X-ray Report Generation

链接：https://arxiv.org/abs/2608.05341

作者：Yuta Kobayashi,Pradyun Ramesh,Muhammad Ahmed Chaudhry,Vincent Jeanselme,Judy Wawira Gichoya,Sanmi Koyejo,Kathleen Capaccione,Shalmali Joshi

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：left unreported due, radiology report generation, retrospective clinical reports, clinically present findings, clinically present

备注：

点击查看摘要

Abstract:Vision-Language Models (VLMs) for radiology report generation are typically trained on retrospective clinical reports, which suffer from omission noise: clinically present findings are left unreported due to the omission of subtle findings. For example, prior studies show that cardiomegaly may be omitted from ICU chest X-ray reports when the imaging request is focused on monitoring support device placement. As a result, models trained with standard approaches inherit these omissions, learning to under-report findings themselves. We propose PU-DPO, a preference optimization framework to prevent omission noise from corrupting the preference signal. We reformulate the objective under a positive-unlabeled (PU) learning framework, treating absent mentions as unlabeled rather than truly negative. Our framework provides preference supervision using constructed contrastive pairs, generated using edits to model responses, producing variants that explicitly mention or omit a specific finding. Generated responses that mention the finding are naturally preferred in the context of visual evidence. Across semi-synthetic experiments and analyses on real-world chest radiograph benchmarks where adjudicated labels are available, PU-DPO yields consistent gains in detection rates and recovery of hidden positives across multiple pathologies, and is more robust to omission noise than prior approaches.

116. 【2608.05333】Context Matters: Support Set Selection and Failure Detection for In-Context Medical Image Segmentation

链接：https://arxiv.org/abs/2608.05333

作者：Youssef Gehad,Emmanuel Zerefa,Krish Kabra,Guha Balakrishnan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：adapts medical image, adapts medical, unseen structures, retraining by conditioning, support set

备注： 10 pages

点击查看摘要

Abstract:In-context learning (ICL) adapts medical image segmentation models to unseen structures and modalities without retraining by conditioning on a task-specific support set of image-mask exemplars. Because this support set is the model's only task-specific signal, its composition directly influences segmentation performance. In this work, we investigate the support set as a controllable determinant of ICL reliability. First, we compare random sampling against similarity-based selection, where exemplars are retrieved based on their visual similarity to the query image. Second, we train a transformer-based classifier to predict, from the query and support images alone, whether a segmentation will fall below a specified Intersection-over-Union (IoU) threshold. Using MultiverSeg with DINOv3 embeddings across four benchmarks and three imaging modalities, we show that similarity-based selection consistently matches or outperforms random sampling, with the largest gains at the smallest support set sizes. Furthermore, our classifier predicts segmentation failure above chance on all four benchmarks. Ultimately, these results demonstrate that the reliability of in-context segmentation can be both improved via informed support selection and anticipated before use, providing practical mechanisms for safer clinical deployment.

117. 【2608.05265】Evaluating Machine Learning Models for Post-Wildfire Debris-Flow Prediction

链接：https://arxiv.org/abs/2608.05265

作者：Quinn Ledingham,Zhengsen Xu,Yimin Zhu,Zack Dewis,Mabel Heffring,Saeid Taleghanidoozdoozan,Motasem Alkayid,Megan Greenwood,Lincoln Linlin Xu

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：recently burned areas, post-wildfire debris flows, hazards to communities, burned areas, debris flows

备注：

点击查看摘要

Abstract:Prediction of post-wildfire debris flows is critical for mitigating hazards to communities, infrastructure, and resources during intense rainfall in recently burned areas. However, identifying reliable machine learning models is complicated by overlapping debris-flow and non-debris-flow events in feature space, the need for model interpretability, and limited training data. This paper addresses these challenges through a systematic evaluation of machine learning models in terms of predictive performance, feature importance, and synthetic data augmentation. Using basin-scale observations of post-wildfire debris-flow events across the western United States, we compare 15 models, including the Tabular Prior-Data Fitted Network (TabPFN). Repeated stratified cross-validation shows that TabPFN achieves the highest unaugmented performance with a threat score of 0.637, closely followed by the best tree-based models. SHapley Additive exPlanations (SHAP) are used to identify the features driving predictions, revealing that short-duration rainfall intensity and storm accumulation consistently rank highest, while burn severity and terrain features contribute less. We further evaluate synthetic data augmentation using TabPFN-generated samples to address the scarcity of debris-flow observations. Synthetic augmentation improves the performance of all models except CNN, with the largest mean threat score increase of +0.041 among the deep learning models. By combining rigorous model benchmarking, interpretable feature analysis, and synthetic data augmentation, this work provides a comprehensive framework for improving post-wildfire debris-flow prediction.

118. 【2608.05260】A Paragraph is Worth a Thousand Captions: Rethinking Text Supervision for Vision-Language Retrieval

链接：https://arxiv.org/abs/2608.05260

作者：Mahyar Ghazanfari,Amin Tabrizian,Arsyi Aziz,Binshuai Wang,Peng Wei

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：detailed textual descriptions, limiting their ability, Contrastive vision-language models, typically trained, trained on short

备注： Accepted at the MUCG workshop, ECCV 2026

点击查看摘要

Abstract:Contrastive vision-language models such as CLIP and BLIP are typically trained on short image captions, limiting their ability to retrieve images from detailed textual descriptions. While methods such as Long-CLIP extend the token limit through positional embedding interpolation, we ask a simpler question: does training text granularity alone determine long-text retrieval performance? We present a systematic study of supervision ranging from single captions to multi-sentence paragraphs for contrastive image-text retrieval. Using a synthetic pipeline based on Qwen2-VL and Llama 3.2 Vision, we generate diverse captions, hard negatives, and quality-scored paragraphs for 500K CC3M images. To isolate the effect of text granularity, we fine-tune only the BLIP text encoder while keeping the vision encoder frozen across 10 training configurations. Our paragraph-supervised models match Long-CLIP-L on ShareGPT4V and outperform it by more than 14 points on DOCCI for image-to-text retrieval, without architectural changes. We further show that paragraph supervision enables effective use of long token sequences, whereas caption-only training degrades beyond 60 tokens. Increasing caption diversity improves short-caption retrieval with diminishing returns, while paragraph supervision consistently benefits long-description benchmarks and hard negatives prove detrimental in text-only fine-tuning. Evaluations on Flickr30k, COCO, ShareGPT4V, and DOCCI provide a comprehensive analysis of the trade-offs between text granularity, retrieval direction, and description length.

119. 【2608.05258】Grad-CAM for Vision Transformers: A Systematic Taxonomy and Audit of Methodological Ambiguity in Explainable AI

链接：https://arxiv.org/abs/2608.05258

作者：Casey Wall,Longwei Wang,Rodrigue Rizk,KC Santosh

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Gradient-weighted Class Activation, Class Activation Mapping, Gradient-weighted Class, Activation Mapping, Class Activation

备注：

点击查看摘要

Abstract:Gradient-weighted Class Activation Mapping (Grad-CAM) is widely used to visualize model decisions, but it was originally formulated for convolutional neural networks, where spatial feature maps and channel dimensions have clear architectural meanings. Vision Transformers (ViTs) do not provide the same structure, instead representing images through tokens, attention, residual streams, and multimodal interactions. This paper presents a systematic taxonomy and literature audit of how Grad-CAM and related methods are adapted, justified, and reported for ViT-based architectures. From an initial search of more than 550 papers, we identify 175 papers that apply Grad-CAM or Grad-CAM-adjacent methods to ViTs. We find that most papers do not provide a full mathematical or implementation-level account of how Grad-CAM is adapted to transformer representations. To characterize this gap, we introduce a descriptive taxonomy of ViT Grad-CAM adaptations that makes explicit the feature locations, gradient targets, spatial reconstruction steps, and aggregation choices that are often left implicit. This taxonomy is not intended to prescribe a single correct adaptation, but to clarify the range of methodological choices being made. The study shows that Grad-CAM on ViTs is often treated as a trivial extension of CNN-based Grad-CAM, despite requiring nontrivial choices that affect rigor, reproducibility, and interpretation.

120. 【2608.05248】WorldClaw: Agentic 3D Open-World Generation at Scale

链接：https://arxiv.org/abs/2608.05248

作者：Chunchao Guo,Jinpeng Li,Yang Li,Zilong Huang

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：open-ended text remains, text remains challenging, explicit assets suitable, jointly maintain global, freely explorable

备注： Authors are listed in alphabetical order by given name

点击查看摘要

Abstract:Generating large-scale, freely explorable 3D worlds from open-ended text remains challenging because a system must jointly maintain global spatial coherence, rich local content, and explicit assets suitable for downstream editing and reuse. We present WorldClaw, a fully agentic, coarse-to-fine framework for open-world 3D scene generation. Planning agents translate a text prompt into a structured specification of regions, terrain, assets, materials, and spatial relations. WorldClaw then builds a globally coherent terrain foundation from semantic layouts, reusable assets, generative or procedural materials, and a region-aware height field. For detail-demanding regions, it generates terrain-conditioned compositions, reconstructs editable textured meshes, and recovers their placement on the terrain; render-based agents further refine terrain, objects, appearance, and contacts. Across diverse open-world prompts, WorldClaw produces large-scale scenes with coherent spatial organization, visually compelling local content, and editable instance-level assets while preserving a consistent global terrain structure.

121. 【2608.05242】Disentangling 3D Modeling from Spatial Reasoning

链接：https://arxiv.org/abs/2608.05242

作者：Haoze Sun,Jiequan Cui,Qingshan Xu,Richang Hong

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：jointly acquiring implicit, explicitly disentangling, acquiring implicit, Disentangled Spatial Reasoner, jointly acquiring

备注：

点击查看摘要

Abstract:In this work, we explore an alternative paradigm for spatial reasoning by explicitly disentangling 3D perception from reasoning, rather than jointly acquiring implicit 3D perception and reasoning through large-scale training. Our key observation is that modern perception models excel at estimating continuous 3D geometry, whereas large language models (LLMs) are particularly effective at compositional and symbolic reasoning. Motivated by these complementary strengths, we propose the Disentangled Spatial Reasoner (DiSR), a simple yet effective framework that reconstructs the physical world into structured 3D evidence using off-the-shelf expert perception models and fine-tunes an LLM with LoRA to perform reasoning solely over this explicit geometric evidence. Without large-scale 3D VQA training or complex tool-use policies, DiSR achieves competitive performance on popular spatial reasoning benchmarks. Beyond its strong performance, DiSR offers improved interpretability, modularity, and computational efficiency, demonstrating that explicit separation of perception and reasoning is a scalable and effective alternative paradigm to end-to-end modeling for spatial intelligence.

122. 【2608.05237】In-Context Forcing: Uncovering Context Effects in Autoregressive Video Diffusion

链接：https://arxiv.org/abs/2608.05237

作者：Lingxiao Yang,Liu Liu,Moran Li,Han Feng,Wenjian Cao,Jiangning Zhang,Ye Shi

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：fully denoised clean, Current few-step autoregressive, previous fully denoised, video diffusion models, diffusion models depend

备注：

点击查看摘要

Abstract:Current few-step autoregressive video diffusion models depend on previous fully denoised clean frames as context for all denoising steps of the current frame. However, these clean frames leak excessive local details, which causes the model to take shortcuts, resulting in compromised temporal semantics and dynamics. Inspired by the perspective of diffusion as masking, we explore the impact of noisy contexts on few-step autoregressive generation. Yet, simply applying contexts with the same noise levels provides insufficient guidance, leading to poor temporal consistency. To resolve this dilemma, we introduce In-Context Forcing, a progressive autoregressive paradigm that utilizes contexts with decreasing noise levels. By applying less masking to distant frames and more masking to adjacent ones, this approach provides adaptive guidance, effectively ensuring both robust temporal consistency and high inter-frame dynamics. Furthermore, by decoupling the strict dependence on previous clean frames, our paradigm enables cross-frame parallel denoising, achieving substantial inference acceleration without sacrificing performance. Extensive experiments on VBench demonstrate that our method significantly outperforms state-of-the-art approaches in both visual fidelity and inference speed.

123. 【2608.05233】Coherence-Oriented Dream Scene Visualisation

链接：https://arxiv.org/abs/2608.05233

作者：Azra Açıl,Simon Colton

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Dream Scene Visualiser, difficult to communicate, emotionally intense, intense but difficult, Scene Visualiser

备注： short paper accepted at ICCC 2026

点击查看摘要

Abstract:Dreams can be emotionally intense but difficult to communicate. We describe the Dream Scene Visualiser (DSV) system which turns written dream descriptions into a temporal sequence of four panel images visualising the dream. This starts with a large language model prompted to split a dream description into four chronological parts. Then a text-to-image model produces images for each part with visual coherence maintained across the sequence, and DSV regenerates any image not suitably matching the text. We evaluate DSV over 50 visualisations from dream descriptions in DreamBank, and report quality, fidelity and coherence results via objective measures employing the CLIP, DINOv2 and Qwen2-VL vision-language models.

124. 【2608.05226】NeuroAdaptTrainer: A Fiji/ImageJ Plugin for YOLO-Based Neuron Segmentation, InteractiveCorrection and Transfer Learning

链接：https://arxiv.org/abs/2608.05226

作者：Daniela Eraso-Casas,Gerard Villarroya-Pique,Esther Serrano-Pertierra,M. Teresa Fernández-Sánchez,Antonello Novellie,Angel Rio-Alvarez,Víctor M. González

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：neuroscience research, traditionally performed, semi-automatic tools, neuronal cultures, routine and time-consuming

备注：

点击查看摘要

Abstract:Neuron counting and segmentation in microscopy images of neuronal cultures is a routine and time-consuming task in neuroscience research, traditionally performed through manual inspection or semi-automatic tools. We present NeuroAdaptTrainer, an open-source Fiji/ImageJ plugin that integrates a YOLO instance-segmentation model directly into the microscopist's workflow. The plugin allows a user to run automatic neuron detection on a single image or a batch of images, manually correct the resulting detections from within Fiji, and use those corrections to adapt the model to new imaging conditions via transfer learning. A built-in external validation module allows the base and adapted models to be compared quantitatively on a held-out annotated set. NeuroAdaptTrainer lowers the barrier for non-specialist users to benefit from deep-learning-based segmentation while keeping expert supervision at the center of the workflow.

125. 【2608.05217】A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization

链接：https://arxiv.org/abs/2608.05217

作者：Anadi Goyal,Nandish Chattopadhyay,Anupam Chattopadhyay,Chandan Karfa

类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)

关键词：Vision Transformers, increasingly rely, latency budgets, meet energy, energy and latency

备注： Accepted for publication at AIIoT 2026

点击查看摘要

Abstract:Vision Transformers (ViTs) increasingly rely on input-adaptive inference, such as token pruning and early halting, to meet energy and latency budgets. This survey examines a recent class of adversarial efficiency degradation attacks that target these mechanisms to increase computation without necessarily degrading accuracy. We unify and compare two representative attacks, SlowFormer (a universal adversarial patch) and DeSparsify (per-image perturbations), across three popular token-pruning frameworks: A-ViT, ATS, and AdaViT. We standardize reporting using GFLOPs, accuracy loss, and an Attack Success (AS) metric that measures how much of the model's compute savings the attack takes away. Understanding these attacks is crucial for designing countermeasures that not only mitigate risk but also remain lightweight, since deployment often occurs in low-power settings such as mobile or embedded devices. To organize our analysis, we focus on three questions: how input-adaptive optimizations (e.g., token pruning and early halting) create attack surfaces for efficiency degradation; how such attacks operate in practice and which optimizations are most vulnerable; and which defenses exist today and whether they meaningfully restore efficiency under attack.

126. 【2608.05215】VLAff: Vision-Language-Affordance Model for Unified Actionable Affordances

链接：https://arxiv.org/abs/2608.05215

作者：Jihoon Oh,Kento Kawaharazuka,Kei Okada

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：scalable robot learning, Learning manipulation skills, affordances, actionable affordances, scalable robot

备注： 8 pages, 5 figures. Accepted to IEEE/RSJ IROS 2026. Project page: [this https URL](https://ojh6404.github.io/vlaff/)

点击查看摘要

Abstract:Learning manipulation skills from human videos is promising for scalable robot learning. However, the embodiment mismatch between humans and robots makes this challenging. One promising solution is to learn object-centric actionable affordances that are embodiment-agnostic. In this work, we propose a framework that leverages egocentric human videos with state-of-the-art 3D Structure-from-Motion and hand mesh reconstruction to extract actionable affordances such as visual, grasp, and trajectory affordances that explicitly encode where to interact, how to grasp, and how to move. We construct EgoAffordance, a large-scale dataset comprising 204K episodes with 5.6M visual affordances and 11.6M grasp and trajectory affordances. Building on this, we introduce VLAff, a large vision-language model-based unified foundation model that learns cross-modal correlations across all actionable affordances. Given a visual observation and instruction, VLAff generates visual affordance heatmaps, grasp poses, and trajectories, which are then converted into directly executable actions by utilizing 3D scene information. Through extensive experiments, we demonstrate that VLAff not only achieves state-of-the-art performance on visual affordance prediction, but can also be effectively applied to real robot applications such as zero-shot manipulation and affordance-guided robot learning.

127. 【2608.05213】StyleComposer: Training-Free Multi-Reference Style Composition

链接：https://arxiv.org/abs/2608.05213

作者：Sanghyeok Lee,Jihye Kang,Namhyuk Ahn

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：style, attribute, Abstract, color, texture

备注：

点击查看摘要

Abstract:The style of a painting is not monolithic: color, texture, and structure may come from different sources. Existing reference-guided methods transfer them as one style signal, leaving each attribute's source and strength outside the user's control. We ask where in a diffusion model one attribute can change while the others hold, and find that no single representation isolates all three. The proposed StyleComposer therefore routes each style attribute through the representation where it separates best and coordinates the routes over denoising time. Without training or inversion, it satisfies three references and the prompt jointly more closely than prior methods, and exposes one strength slider per attribute. Project page: this https URL

128. 【2608.05210】Innocent Panels, Hateful Stories: Evaluating and Detecting Hateful Intent in Multi-Turn Visual Story Generation

链接：https://arxiv.org/abs/2608.05210

作者：Ye Leng,Junjie Chu,Yiting Qu,Mingjie Li,Yun Shen,Yang Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR)

关键词：Nazi propaganda picture, propaganda picture book, notorious Nazi propaganda, Der Giftpilz, Picture books

备注： 16 pages, 5 figures, 10 tables

点击查看摘要

Abstract:Picture books and comics have long been used to disseminate hateful narratives because they are easily understood even by children, as exemplified by the notorious Nazi propaganda picture book \emph{Der Giftpilz}. Recently, frontier text-to-image (T2I) systems such as Gemini and GPT-Image have enabled conversational generation with consistent characters and scenes across turns, making hateful visual stories, namely ordered image groups that collectively convey hateful narratives, cheap and scalable to produce. Although prior work has studied hateful content generation by T2I systems, it focuses on individual images, leaving group-level hateful meaning largely unexplored. We aim to address the gap. Concretely, we introduce \texttt{HatefulStoryPrompts}, comprising 330 multi-turn configurations from 55 hateful stories across two languages and three visual styles, and evaluate five frontier models over 4,950 attempts. Every model completes over 80\% of the stories, with the strongest reaching 99.0\%. We further evaluate existing moderation systems on \texttt{HatefulVisualStory}, a human-labeled dataset of 969 hateful image sets and 990 benign controls, and find that they frequently miss group-level hateful meaning: dedicated safety models achieve at most 34.9\% recall, while a strong vision-language model reaches 67.5\%. Finally, we propose complementary proactive and post-generation defenses. An interaction-aware monitor achieves 97.3\% recall for prompt-only sessions and 92.6\% when the user supplies the first image, while post-generation methods jointly analyzing completed image groups reach 80.2\%. Our work shows that, as image generation evolves from isolated outputs to coherent visual narratives, safety must evolve accordingly, from per-image moderation to stateful reasoning over interactions and image relationships.

129. 【2608.05209】MapTCL: Temporal Consistency Learning via Bidirectional Alignment for Vectorized HD Map Construction

链接：https://arxiv.org/abs/2608.05209

作者：Hyeonseo Kim,Juyeb Shin,Hyeonjun Jeong,Hiwon Shin,Dongsuk Kum

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Constructing reliable online, dynamic urban environments, urban environments due, Constructing reliable, maps remains challenging

备注： Accepted at 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

点击查看摘要

Abstract:Constructing reliable online HD maps remains challenging in dynamic urban environments due to moving objects and occlusions. While recent works employ feature-level temporal fusion to address this, they rely solely on per-frame ground truth supervision. Consequently, they lack an explicit objective to directly penalize the geometric noise and temporal jitter between consecutive online HD maps. To address this, we propose MapTCL, an auxiliary training strategy that formulates temporal consistency loss between current and past frames via bidirectional alignment. Specifically, Bidirectional Vector Consistency Learning (BVCL) models the geometric and semantic discrepancies between associated past and current vector instances as an auxiliary loss. We also employ Raster map Consistency Learning (RCL) as an additional loss to stabilize dense BEV features. By jointly training with these dual losses, MapTCL improves the temporal stability of generated HD maps. Extensive experiments on two standard benchmarks demonstrate the effectiveness of our approach. As a versatile plug-and-play module, MapTCL consistently enhances existing baseline models, achieving gains of +3.7 mAP +2.8 C-mAP on nuScenes and +3.1 mAP +2.5 C-mAP on Argoverse 2 without additional inference overhead.

130. 【2608.05154】RIG-RoPE: Relation- and Instance-Gated Rotary Positional Encoding with Duration-Aware Temporal Coordinates

链接：https://arxiv.org/abs/2608.05154

作者：Donggen Li

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Rotary positional encoding, split positional channels, Rotary positional, modern language models, positional encoding

备注： Preliminary technical report. 15 pages, 1 table

点击查看摘要

Abstract:Rotary positional encoding (RoPE) is a core component of modern language models and has been extended to multimodal LLMs through multidimensional variants such as multimodal RoPE (M-RoPE), which split positional channels into temporal, height, and width subspaces. This report identifies two limitations of static multidimensional position assignment in interleaved multimodal contexts. First, height/width rotations may be applied to token pairs whose spatial displacement is not a well-defined geometric object, producing cross-modal and inter-instance spatial interference. Second, temporal coordinates are often treated as equal-step counters, so a text token, an image block, and a video segment can advance the temporal phase by comparable amounts despite different information density. We propose RIG-RoPE, a relation- and instance-gated RoPE mechanism with duration-aware temporal coordinates. RIG-RoPE augments each token with a modality indicator, a visual instance identifier, and a scalar information-duration coordinate. It enables H/W rotations only for query-key pairs from the same visual instance; otherwise the unknown spatial displacement is marginalized rather than set to zero. Temporal rotations use interpolated cumulative block durations: text tokens consume unit duration, images use a dimension-aware logarithmic spatial scale, and videos further apply a logarithmic temporal extension over effective frames. We provide a gauge-invariance argument for avoiding ordinary cross-instance spatial rotation, an impossibility result for static IDs under shared H/W subspaces, and a duration-consistency argument against equal-step multimodal time. RIG-RoPE adds no learned parameters and can be implemented inside tiled attention kernels with constant additional metadata per token. This preliminary report establishes the formulation and validation path without claiming empirical superiority.

Comments:
Preliminary technical report. 15 pages, 1 table

Subjects:

Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2608.05154 [cs.CL]

(or
arXiv:2608.05154v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2608.05154

Focus to learn more

              arXiv-issued DOI via DataCite</p>

131. 【2607.06420】HoloCount: A Holistic Visual Counting Benchmark for MLLMs

链接：https://arxiv.org/abs/2607.06420

作者：Jinhong Deng,Limeng Qiao,Guanglu Wan

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Multimodal Large Language, Large Language Models, Visual counting, requiring a seamless, fundamental pillar

备注： Technical report

点击查看摘要

Abstract:Visual counting is a fundamental pillar of multimodal intelligence, requiring a seamless integration of fine-grained grounding and spatial reasoning. While Multimodal Large Language Models (MLLMs) have achieved remarkable success in qualitative scene understanding, their quantitative precision remains a significant bottleneck, often characterized by persistent numerical hallucinations. Existing counting benchmarks primarily focus on basic perception in simplified contexts, failing to capture the complex failure modes that emerge under logical constraints or adversarial conditions. To address these limitations, we introduce HoloCount, a holistic and diagnostically rich benchmark structured around a three-level hierarchical taxonomy. HoloCount evaluates MLLMs across: (1) Semantic Counting, focusing on atomic and property-based enumeration; (2) Analytical Counting, assessing logical composition through spatial and set-based reasoning; and (3) Robustness Testing, probing model integrity against adverse scenarios and grounded counter-priors, such as high-density scenes and linguistic biases. Through an exhaustive evaluation of over 20 state-of-the-art MLLMs, we reveal a critical performance gap: even top-tier models degrade significantly as tasks transition from perception to complex analytical reasoning and adverse scenarios. Our findings provide a systematic landscape of current MLLM counting capabilities and offer a roadmap for developing more grounded and reliable multimodal systems. The dataset is available at this https URL.

132. 【2608.05669】SafeDivertor: Faithful Divertor Heat Flux Reconstruction from Macroscopic Plasma State Signals via Time-Frequency Prior Exploitation

链接：https://arxiv.org/abs/2608.05669

作者：Hao Si,Zehua Chen,Qingquan Yang,Xiao Wang,Dengdi Sun,Wanli Lyu,Gaoting Chen,Guosheng Xu,Hang Su,Jin Tang,Jun Zhu

类目：Plasma Physics (physics.plasm-ph); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：magnetic-confinement fusion devices, device-specific material properties, understanding plasma-wall interactions, protecting plasma-facing components, requires heat-conduction modeling

备注：

点击查看摘要

Abstract:Divertor heat-flux analysis is essential for understanding plasma-wall interactions and protecting plasma-facing components in magnetic-confinement fusion devices, while conventional infrared-based inversion is usually performed after discharge and requires heat-conduction modeling with device-specific material properties, divertor geometry, and boundary conditions. Rather than accelerating this conventional infrared-based inversion paradigm, we introduce a new online-oriented signal-based reconstruction paradigm that directly reconstructs time-resolved radial heat-flux profiles from multi-source macroscopic plasma-state signals available during discharge. To enable systematic study of this task, we construct \textbf{DivMPS2HF}, a multi-source discharge dataset that provides the data foundation and benchmark for signal-based divertor heat-flux reconstruction. We further propose \textbf{SafeDivertor}, a task-driven framework designed to address the key challenges of signal-based heat-flux reconstruction. It employs physical prior-aware initialization to provide radial-distribution guidance for target channels, input perturbation to reduce over-reliance on specific heterogeneous signals, spectral-aware reconstruction optimization to exploit time-frequency priors and preserve transient dynamics, and progressive training to stabilize the optimization of these complementary objectives. Experiments on DivMPS2HF demonstrate that SafeDivertor achieves the best overall performance among the evaluated time-series baselines across all five metrics, establishing a new performance benchmark for signal-based divertor heat-flux reconstruction. The source code will be released on this https URL

133. 【2608.05471】A Foundational EDM2-Based Generative Model for High-Resolution Synthetic Fetal Ultrasound Imaging from Open Datasets

链接：https://arxiv.org/abs/2608.05471

作者：Harvey Mannering,Yilin Zhang,Ziao Liu,Zhiwu Huang,Jacqueline Matthew,Miguel Xochicale

类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Medical Physics (physics.med-ph)

关键词：Prenatal ultrasound imaging, assessing fetal health, Prenatal ultrasound, limited by scarce, imaging is key

备注： Short paper for the 30th Conference on Medical Image Understanding and Analysis

点击查看摘要

Abstract:Prenatal ultrasound imaging is key for assessing fetal health, but AI progress is limited by scarce, privacy-restricted, and hard-to-annotate datasets. We propose a high-resolution fetal ultrasound synthesis framework based on the EDM2 diffusion architecture, trained on multiple public datasets to generate 512x512 images across six anatomical classes. Our method achieved improved image quality with lower FID scores and enhanced downstream fetal plane classification, reaching 93.36% ensemble accuracy after fine-tuning, surpassing real-data-only training. Clinical evaluation by an experienced fetal ultrasound specialist (10+ years) on 100 images yielded a mean realism score of 2.67/5, with real images rated higher than synthetic. Artefacts included smoothing, speckle irregularities, and anatomical inconsistencies. Code, data, models and other resources to reproduce this work are available at this https URL.