本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新695篇论文，其中：
- 自然语言处理154篇
- 信息检索24篇
- 计算机视觉114篇
自然语言处理
1. 【2608.27455】CritICL: Inference-Time Weak-to-Strong Generalization from Small Language Model Failure Modes
链接：https://arxiv.org/abs/2608.27455
作者：Yufan Wu,Yinghui He,Zhengyi Hu,Lang Wei,Ruichen Li,Qifan Yang,Ting Zhu
类目：Computation and Language (cs.CL)
关键词：Recent advances, large language models, large language, Recent, Abstract
备注： [this https URL](https://github.com/umwyf/CRITICL)
点击查看摘要
Abstract:Recent advances in inference-time scaling have significantly improved the reasoning performance of large language models (LLMs). However, these methods typically rely on repeated generation or external verification. To address this limitation, we introduce CritICL, a novel inference-time framework that improves reasoning while maintaining high efficiency. Our key insight is that LLM failure modes exhibit structured patterns across model scales within the same family. Instead of treating failures as undesirable outputs, CritICL leverages them as a source of guidance. Specifically, we utilize failure modes derived from weaker models and incorporate them into inference through critique-based in-context examples. We propose two variants: CritICL-dynamic, which adaptively predicts input-specific failure modes and retrieves critiques, and CritICL-static, which uses a global failure mode profile to provide stable guidance. Experimental results show that CritICL consistently outperforms standard in-context learning and achieves performance competitive with or superior to test-time scaling methods, while requiring significantly fewer generations and lower token cost. Code available at: this https URL
2. 【2608.27454】WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution
链接：https://arxiv.org/abs/2608.27454
作者：Liyan Tang,Cyrus Rashtchian,Chun-Sung Ferng,Andrew Tomkins,Da-Cheng Juan,Tu Vu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：package specialized knowledge, skills package specialized, skills, Agent skills package, package specialized
备注：
点击查看摘要
Abstract:Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill development typically remain scattered across optimization histories, limiting their systematic reuse across iterations. We introduce WikiSkill, a framework that co-evolves agent skills with a persistent knowledge base (wiki). At a high level, WikiSkill separates raw execution experience, accumulated knowledge, and executable skills, while continuously consolidating experience into the wiki, which subsequent skill updates can build on. Across diverse benchmarks and models, WikiSkill consistently outperforms state-of-the-art skill-evolution methods and improves over no-skill baselines in most model-benchmark settings. We find that skill evolution complements model scaling: larger models generally benefit more from evolved skills, while smaller models with skills can outperform substantially larger models without them. We also find that evolved skills transfer effectively across models and model families, and skills evolved by other models can outperform self-evolved skills. Finally, our ablation studies confirm that persistent knowledge accumulation in the wiki is critical for effective skill evolution. These results demonstrate the benefits of systematically accumulating and refining agent experience for developing reusable and transferable skills.
3. 【2608.27449】SWE-Prime: Fewer Trajectories, Better Performance
链接：https://arxiv.org/abs/2608.27449
作者：Dewu Zheng,Ruizhe Ye,Yanlin Wang,Yang Ye,Hongyu Zhang,Ensheng Shi,Xilin Liu,Yuchi Ma,Jianxing Yu,Zibin Zheng
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：real-world software issues, performing supervised fine-tuning, improve large language, large language models', language models' ability
备注： 9 pages, 5 figures
点击查看摘要
Abstract:To improve large language models' ability to resolve real-world software issues, prior work has focused on constructing large-scale agent trajectory datasets and performing supervised fine-tuning (SFT) on successful trajectories. However, task success does not guarantee high-quality supervision: successful trajectories may still contain ineffective, redundant, or risky steps. Directly using such trajectories for SFT can introduce noisy supervision and encourage models to imitate undesirable problem-solving behaviors. Therefore, we propose SWE-Prime, a multi-granularity, two-stage SFT data selection method that progressively filters training data at the trajectory and segment levels. Specifically, the first stage performs trajectory-level screening based on process quality, result quality, and data representativeness, selecting a high-quality and representative subset of successful trajectories. The second stage performs segment-level selection by grouping consecutive steps into semantic segments and assessing each segment based on its contribution to the final solution, learnability, and potential risks. During SFT, all segments remain in the sequence to preserve context, while only selected segments contribute to the loss computation. Experiments on SWE-Bench Pro and SWE-Bench Verified show that training on the 10% trajectory subset selected by SWE-Prime outperforms training on the full resolved dataset, yielding relative performance gains of up to 12.2% and 24.2%, respectively.
4. 【2608.27448】PO: Test-Time Policy Optimization
链接：https://arxiv.org/abs/2608.27448
作者：Aozhe Wang,Zhengxi Lu,Jianze Wang,Shangke Lv,Ying Liu,Weiming Lu,Jun Xiao,Yueting Zhuang,Hua Yang,Qianglong Chen,Yongliang Shen
类目：Computation and Language (cs.CL)
关键词：Recent prominent post-training, Reinforcement Learning, prominent post-training methods, driven rapid progress, Recent prominent
备注： Project Page: [this https URL](https://zju-real.github.io/TTPO) Code: [this https URL](https://github.com/ZJU-REAL/TTPO)
点击查看摘要
Abstract:Recent prominent post-training methods, such as Reinforcement Learning (RL) and On-Policy Self-Distillation (OPSD), have driven rapid progress in mathematical reasoning for large language models, yet their reliance on ground-truth labels precludes test-time training (TTT). Replacing ground truth with majority-vote pseudo-labels is a natural alternative, yet it is fragile: an incorrect vote corrupts the teacher and misleads every token. We observe that this failure mode is asymmetric: rollouts that disagree with the pseudo-label are typically wrong regardless of whether the vote itself is correct. Building on this observation, we propose Test-Time Policy Optimization (TTPO), an asymmetric objective that distills agreeing rollouts via OPSD and penalizes disagreeing rollouts with Grouped RL. Token-level selection further refines both branches: distillation down-weights already-converged positions, while RL penalizes only confident errors. Both updates remain well-grounded even under frequent pseudo-label errors, and majority-vote routing yields tighter self-supervision as the model improves. Without any labels, TTPO matches label-supervised OPSD on five competition-level benchmarks, raises Qwen3-1.7B from 38.0% to 45.2% in TTT, yields +25.2% to +36.4% without thinking, and shows strong cross-task generalization.
5. 【2608.27442】From Static to Dynamic: Benchmarking Real-World Code Review with MCR-Bench
链接：https://arxiv.org/abs/2608.27442
作者：Dewu Zheng,Yanlin Wang,Xiwen Wang,Kefeng Duan,Hongyu Zhang,Xilin Liu,Yuchi Ma,Zibin Zheng
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：improve software quality, typically involves iterative, real-world software development, review typically involves, code review
备注： Accepted at ISSTA 2026
点击查看摘要
Abstract:In real-world software development, code review typically involves iterative interactions between developers and reviewers to improve software quality, making the process costly and time-consuming. Although recent work explores large language models (LLMs) for automated code review, most approaches oversimplify code review into a single-round, static decision task, which fails to capture the multi-round interactive nature and the complex problem-solving processes inherent in realistic review scenarios. To bridge this gap, we introduce MCR-Bench, the first defect state-aware benchmark designed for realistic multi-round code review. MCR-Bench covers five commonly-used programming languages and consists of 2,269 real-world multi-round code review tasks, each of which is annotated with fine-grained defect information and cross-round state labels. Each task in MCR-Bench is equipped with fine-grained defect metadata (e.g., description, type, severity) alongside dynamic state annotations, capturing the complete evolutionary trajectory of a defect throughout the multi-round process. We obtain several findings through extensive experiments on MCR-Bench with mainstream LLMs. (1) Limited overall capability: experiments reveal that mainstream LLMs exhibit limited overall performance in defect detection and defect lifecycle state tracking, with performance degrading significantly as the number of interaction rounds increases; (2) Defect-sensitive performance: LLMs' performance varies substantially across different defect types and severity levels, with semantically complex or low-salience defects being significantly more likely to be missed; (3) Underlying Failure Mechanisms: our in-depth error analysis dissects the distinct drivers of false positives and false negatives, revealing critical weaknesses such as cross-round temporal misalignment and inadequate long-range memory.
6. 【2608.27428】Stochastic Estimation of Transduced Language Models
链接：https://arxiv.org/abs/2608.27428
作者：Vésteinn Snæbjarnarson,Samuel Kiegeland,Manuel de Prada Corral,Ryan Cotterell,Tim Vieira
类目：Computation and Language (cs.CL)
关键词：Transduced language models, language model, Transduced language, language models, functional finite-state transducer
备注：
点击查看摘要
Abstract:Transduced language models (TLMs) compose a pretrained \emph{source} language model with a functional finite-state transducer to induce a language model over \emph{target} strings. Computing the probability of a target prefix under a TLM amounts to summing the source-model probabilities of all source strings that the transducer maps to target strings beginning with that prefix. This set can be exponentially large or infinite. Prior work uses a computational shortcut based on source prefix probabilities, then approximates the resulting sum with threshold-pruned beam summing. This produces a lower bound with unknown error. Instead, we resample source prefixes without replacement and reweight each selected prefix by the inverse of its inclusion probability. We show that applying this correction recursively gives an unbiased estimator of the target prefix probability and lets us estimate the mass lost by threshold pruning. Our beam-summing algorithm extends the retained source prefixes and samples which prefixes to keep, reducing their number as more probability mass is added to the running estimate. This can save computation and guarantees that the run halts with probability one. We evaluate the method on encyclopedic text and DNA against sequential Monte Carlo baselines that resample with replacement. It achieves a better compute--variance tradeoff on text and lower error at the same maximum number of particles on DNA. On a DNA-to-amino-acid transduction, it reduces runtime by several orders of magnitude relative to threshold-pruned beam summing and makes estimating prefix probabilities for long target strings feasible. Replacing threshold pruning with unbiased sampling in a published reading-time analysis substantially lowers the estimated corpus surprisal but leaves the published conclusions unchanged.
7. 【2608.27420】Boosting LLM Exploration via Weak-Model Guidance in RLVR
链接：https://arxiv.org/abs/2608.27420
作者：Xingyu Shen,Huishuai Zhang,Peng Li,Yinchun Wang,Dongyan Zhao
类目：Computation and Language (cs.CL)
关键词：Reinforcement Learning, Learning with Verifiable, significantly improves LLM, improves LLM reasoning, significantly improves
备注： 13 pages, 4 figures
点击查看摘要
Abstract:Reinforcement Learning with Verifiable Rewards (RLVR) significantly improves LLM reasoning but often causes a drop in policy entropy, leading to narrowed reasoning coverage and degraded pass@$k$ for large $k$. While existing methods mitigate this entropy collapse through algorithmic regularizations, cross-model non-parametric perturbation is also neglected. In this work, we propose a simple yet effective approach to preserve the generative diversity of LLMs during RLVR. Instead of relying solely on internal exploration, we force the target model to generate answers based on partial reasoning trajectories generated by a smaller, weaker language models. These unfamiliar prefixes effectively disrupt over-confidence and encourage the exploration of distinct reasoning paths. We empirically study the potential of outer prefixes, revealing the mechanism of the impact of distributional discrepancy to the exploration dynamics in RLVR training. Experiments across multiple mathematical benchmarks show that our method consistently outperforms vanilla RLVR. Notably, the performance gain becomes increasingly pronounced as $k$ scales up, demonstrating a substantial expansion of reasoning coverage. Furthermore, our approach efficiently mitigates entropy collapse without requiring additional SFT, intricate reward designs, or complex prompting.
8. 【2608.27409】Consolidating RLVR Capabilities Across Domains: A Deep Dive into Fusion Paradigms
链接：https://arxiv.org/abs/2608.27409
作者：Siye Wu,Kai Yang,Yuchen Cai,Xin Xu,Peng-Yuan Wang,Jiaxuan Wang,Jiashun Liu,Jiafei Lyu,Yangkun Chen,Saiyong Yang,Yanghua Xiao
类目：Computation and Language (cs.CL)
关键词：Reinforcement learning, large language models, covering multiple capabilities, involves training separate, verifiable rewards
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) improves specific capabilities of large language models, but covering multiple capabilities often involves training separate domain experts and subsequently consolidating them. We organize three fusion paradigms by the artefacts they reuse: Merge combines expert task vectors, Mix RL pools their datasets, and multi-teacher on-policy distillation (MOPD) uses both. Because they have largely been studied in isolation, how they compare and how to choose among them remain unclear. We compare all three using shared experts and data across model scales and a multi-domain benchmark suite. Although their average performance differs by at most 1.4 points, the gap reaches 8.6 points on a single benchmark, with domain-level variation tracking cross-domain relations visible in task-vector geometry. Training dynamics expose distinct constraints: Mix RL depends on domain mixture proportions, MOPD remains bounded by its teachers, and Merge compresses all expert updates into one. All three improve single-sample accuracy without measurable gains in solution coverage or losses in held-out capabilities. These results yield a practical guideline: use Merge when experts already exist and cheap fusion is paramount; Mix RL when training a unified model without experts, with domain proportions adjusted for cross-domain transfer; and MOPD when preserving domain-specific gains matters more than surpassing teachers or minimizing end-to-end cost.
9. 【2608.27402】How Language Models Organize and Structure Moral Knowledge
链接：https://arxiv.org/abs/2608.27402
作者：Orion Reblitz-Richardson
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：organize moral knowledge, Moral Foundations Theory, large language models, moral foundations, moral
备注： 31 pages, 16 figures. Code and outputs at [this https URL](https://github.com/deepsteer/deepsteer)
点击查看摘要
Abstract:How do large language models (LLMs) organize moral knowledge? Models detect moral content broadly, but detection is a low bar. We ask whether they go further, distinguishing moral foundations from one another and organizing the relationships between them geometrically. We train six independent linear probes on open-weight language models, one per Moral Foundations Theory (MFT) category (care/harm, fair/cheat, lib/oppress, loy/betray, auth/subv, sanc/degrade), and examine how the resulting directions relate to each other in representation space. We find the directions neither collapse into a single moral detector nor isolate from one another. Rather, they span a near-maximal number of independent dimensions while sharing a positive common component. The shared component is the signature of integration, and it is moral-specific relative to a matched non-moral concept battery built identically (mean pairwise cosine 0.26 vs. 0.013). The geometry is consistent across architectures and scale and reaches its integration regime early in pre-training, well before probe accuracy saturates. The structure the model discovers shows no evidence of the individualizing/binding distinction predicted by Moral Foundations Theory (an underpowered test: only 20 candidate partitions exist) but rather reflects corpus statistics. Extending to moral dilemmas, each dilemma direction partially composes from its component foundations, at 2.7x a mismatched-pair baseline, while the majority of its variance encodes conflict-specific structure. The model represents moral tension itself, not a pre-resolved judgment.
Comments:
31 pages, 16 figures. Code and outputs at this https URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
ACMclasses:
I.2.6; I.2.7
Cite as:
arXiv:2608.27402 [cs.CL]
(or
arXiv:2608.27402v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.27402
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
10. 【2608.27397】Making Clinical Language Models Auditable: Concept-Guided Fine-Tuning for Robust Prediction
链接：https://arxiv.org/abs/2608.27397
作者：Jin Mu,Guanhua Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：reflect patient state, exploit note-specific artifacts, achieve strong in-hospital, strong in-hospital accuracy, Artifact Suppression Tuning
备注：
点击查看摘要
Abstract:Clinical language models can achieve strong in-hospital accuracy yet fail under deployment shifts because they exploit note-specific artifacts (e.g., templates, separators, boilerplate) that do not reflect patient state. We propose CAST (Concept-guided Artifact Suppression Tuning), an SAE-based framework for auditable clinical text classification. CAST uses Sparse Autoencoders to expose sparse, human-auditable features from intermediate Transformer activations, labels SAE latents with an LLM-assisted interpretation pipeline and ICD-10 retrieval constraints, suppresses verified artifact latents via residual subtraction during fine-tuning, and provides post-hoc per-concept attributions for auditing model decisions. On MIMIC-IV discharge-note mortality prediction, CAST improves over its corresponding fine-tuned encoder baselines and remains competitive with strong LLM baselines, while producing a feature-level audit trail of the clinical concepts that support each prediction and the artifact concepts suppressed during training.
11. 【2608.27394】RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature
链接：https://arxiv.org/abs/2608.27394
作者：Maayan Sharon,Tom Hope
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Retrieved scientific literature, Retrieved scientific, Retrieved, Typed Ideation Operations, RATIO
备注：
点击查看摘要
Abstract:Retrieved scientific literature can serve as inspiration for both human and AI scientists. Inspiration can take different forms: prior work may directly suggest how to address a problem, or surface directions at different levels of abstraction - zooming out to a more general view or zooming in to a concrete realization. We introduce RATIO (Retrieval Across Typed Ideation Operations), a large-scale benchmark in which relevance is defined by three operations which we name ideation moves: Address retrieves potential approaches for stated problems, Broaden retrieves more general formulations, and Specify retrieves concrete instantiations. RATIO is constructed from millions of full-text scientific papers across CS literature via a general recipe that extends discourse-marker distant supervision - previously used only for classification - to corpus-scale retrieval, combined with extensive LLM and human vetting. Experiments show that operation-specific fine-tuning substantially boosts retrievers but leaves much room for further improvements. RATIO provides a scalable training and evaluation framework for retrieval components that support literature-grounded ideation, opening up new research avenues on scientific inspiration retrieval.
12. 【2608.27391】CorporateBench: Large-Scale QA Benchmarking with Temporal Knowledge Bases
链接：https://arxiv.org/abs/2608.27391
作者：Sil Hamilton,Albert Yu Sun,Oscar J. Romero,Carl-Leander Henneking,David Mimno,Bishan Yang,Igor Labutov
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：answer complex questions, enterprise-scale document collections, answer complex, complex questions, questions about enterprise-scale
备注： Accepted to EMNLP Findings
点击查看摘要
Abstract:LLMs are increasingly able to answer complex questions about enterprise-scale document collections. But evaluation is hard: companies don't want to share internal communications, and synthetic datasets have been overly simple. We present CorporateBench (CB), a human-validated multi-task QA benchmark whose scale approaches the conditions LLMs encounter in corporate communication networks, with evaluation corpora surpassing 230,000 documents. CB evaluates LLMs across two dimensions (information extraction and knowledge base querying) through four synthetically generated firms ranging from 12 to 10,000 employees. Each corpus is sampled from a temporally evolving knowledge base describing a consistent world, guaranteeing cross-document logical consistency even across hundreds of thousands of documents. We evaluate five LLMs on CB, revealing increasingly poor performance as input size approaches realistic scales. CB provides LLM developers a metric for corporate communication reasoning, filling a crucial gap in the benchmarking ecosystem.
13. 【2608.27380】D2C-Routing: Dimension-to-Composition Evidence Routing for Mixed-Origin AI-Generated Text Detection
链接：https://arxiv.org/abs/2608.27380
作者：Xin Chen,Fuwei Zhang,Yiqi Tong,Wei Guo,Yutian Xiao,Fuzhen Zhuang
类目：Computation and Language (cs.CL)
关键词：binary document-level judgment, human-written or machine-generated, commonly framed, binary document-level, document-level judgment
备注： 17 pages, 4 figures. To appear in EMNLP 2026
点击查看摘要
Abstract:AI-generated text detection is commonly framed as a binary document-level judgment about whether a text is human-written or machine-generated. This framing breaks down for mixed-origin writing, where content origin and expression origin may differ. We cast mixed-origin detection as dimension-to-composition source attribution, inferring content origin and expression origin before composing them into four collaboration types. We propose Dimension-to-Composition Routing (D2C-Routing), which routes content-side and expression-side evidence to supervised dimension heads before a learned gated composition layer predicts the final label. On MixD2C, a reconstructed split derived from the HART mixed-origin benchmark, our disclosed D2C-Routing-based detector system reaches 0.8603 four-way Avg TPR@1%FPR, 6.5 points above the same-split RACE-local rerun. Core ablations support the routing design, while error analysis shows that distinguishing AI-content/human-expression from fully AI-generated text remains the hardest boundary. Code is available at this https URL.
14. 【2608.27370】Puro-2B: Poor Lab's Qwen2-1.5B Trained on RTX 5090 within $5090
链接：https://arxiv.org/abs/2608.27370
作者：Kairong Luo,Jiarui Cui,Yaorui Yin,Shengqi Chen,Yiming Yang,Linxiang Gao,Yanmohan Wang,Mingzhe Zhang,Kaiyue Wen,Kaifeng Lyu,Wenguang Chen
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Language model pretraining, Language model, open-source communities, synonymous with prohibitive, open-source
备注： 62 pages, 20 figures, 24 tables
点击查看摘要
Abstract:Language model pretraining has become almost synonymous with prohibitive cost, placing it out of reach for much of the academic and open-source communities. Although strong open-source efforts already exist, including open-weight models and open-source training recipes, a cost-efficient, hardware-accessible, and open-source pretraining recipe has long been missing. Even at a small scale, training Llama-3.2-3B costs over \$1.5M, and reproducing SmolLM3-3B needs over \$700K. In this report, we present an open pretraining recipe designed to lower this barrier. Using this recipe, we train a collection of Puro-2B models from scratch on up to 1.4 trillion tokens with FP8 precision on consumer-grade RTX 5090 GPUs. The models in the collection differ in token budgets and selected recipe variants. Our best model is trained at a compute cost of less than \$6.9K and approaches Qwen2.5-1.5B performance under our evaluation protocol. This cost efficiency is enabled by a combination of approaches, including hardware selection, low-precision training, hyperball optimization, curriculum model averaging, and the data recipe. Beyond the recipe itself, we provide two additional results. First, across the Puro-2B collection, we derive a Puro Cost Scaling Law that relates training cost to average model performance; the fitted law suggests that about \$4.4K, less than \$5,090, is sufficient to reach the performance of Qwen2-1.5B. Second, as an end-to-end case study, we examine how pretraining data curricula shape downstream performance after post-training. Such controlled studies are enabled by having access to the full pretraining pipeline rather than model weights alone. We release the full training recipe for Puro-2B, including data, code, and model weights under Apache 2.0 at this https URL.
15. 【2608.27360】Your Voice Cloning System is Secretly a Voice Anonymizer
链接：https://arxiv.org/abs/2608.27360
作者：Romolo Muletta,Felix Matthias Saaro,Mark Cieliebak,Jan Deriu
类目：Computation and Language (cs.CL)
关键词：suppresses speaker-identifying attributes, preserving linguistic content, anonymization suppresses speaker-identifying, Speaker anonymization suppresses, suppresses speaker-identifying
备注：
点击查看摘要
Abstract:Speaker anonymization suppresses speaker-identifying attributes from speech while preserving linguistic content and quality. We propose repurposing XTTSv2, a multilingual voice cloning model trained on 27k hours of speech, for speaker anonymization without retraining. Our key insight is that XTTSv2's voice cloning capabilities preserve prosodic structure independently of speaker identity, enabling voice conversion by conditioning on a pseudo-speaker. We introduce an iterative refinement strategy that balances privacy and utility by maximizing a harmonic mean of speaker dissimilarity and intelligibility. Evaluated on seven European languages across CommonVoice and Multilingual LibriSpeech, our system achieves near-optimal privacy (EER $\approx$ 0.49), competitive intelligibility, and substantially better speech quality than dedicated anonymization baselines, while requiring no language-specific training. We release the code here: this https URL.
16. 【2608.27358】RCMN: Understanding Misleadingness in Influential Public Discourse
链接：https://arxiv.org/abs/2608.27358
作者：Peiling Yi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：shapes public beliefs, Influential public discourse, public discourse shapes, discourse shapes public, Influential public
备注：
点击查看摘要
Abstract:Influential public discourse shapes public beliefs and can also mislead, not only through what is stated, but also through how information is framed, omitted, contextualised, and communicated. Yet less research has focused on how such misleadingness arises and shapes the interpretations formed by readers. To address this gap, we introduce Reader-Centric Misleadingness Understanding (RCMN), a framework that operationalises misleadingness through five dimensions: misleading mechanism, likely reader interpretation, evidence-warranted interpretation, emotional arousal, and communicative intent. Based on this framework, we construct an evidence-grounded dataset of influential public discourse. Empirical findings show that misleadingness is diverse and extends well beyond fabrication, with unsupported inference, exaggeration, and omission among the prevalent mechanisms, and is frequently associated with heightened emotional arousal and distortive communicative intent. Moreover, we investigate whether lightweight claim-and-context representations retain sufficient cues for understanding reader-centric misleadingness without access to richer contextual, evidential, and multimodal information. Evaluation across five recent generative foundation models shows that reader-level interpretations can often be recovered from such limited representations, whereas identifying how misleadingness is produced remains considerably more challenging. These findings highlight the potential of lightweight representations for scalable misleadingness analysis, while reliable understanding of misleading mechanisms continues to require richer contextual and evidential grounding.
17. 【2608.27348】INTENT-AS-A-TOOL Makes it Easy to Track Agentic Misalignment
链接：https://arxiv.org/abs/2608.27348
作者：Yutong Zhang,Jianshuo Dong,Peng Xu,Long Wang,Jie Zhang,Tianwei Zhang,Xiaoping Zhang,Han Qiu
类目：Computation and Language (cs.CL)
关键词：safety failures increasingly, failures increasingly involve, increasingly involve consequential, involve consequential actions, large language models
备注：
点击查看摘要
Abstract:As large language models (LLMs) are deployed as autonomous agents, safety failures increasingly involve consequential actions. We study agentic misalignment, where agents take harmful actions under goal conflicts and pressures. Using chain-of-thought (CoT) monitoring, we find that harmful execution is often preceded by intent signals in reasoning. However, post-hoc CoT labels are too coarse to show how intent changes during generation. We introduce INTENT-AS-A-TOOL, an approach that adds intent-targeted tools to give the model a dedicated channel for expressing commitment to a target behavior. The probability of calling an intent tool provides a judge-free, fine-grained signal of the model's tendency to pursue that behavior. Our results show that INTENT-AS-A-TOOL complements CoT monitoring, expands post-hoc CoT labels into dense trajectories, and identifies critical steps for online intervention. These findings suggest that action preferences are useful for tracking agentic misalignment during reasoning. Our code and data are accessible: this https URL.
18. 【2608.27343】Pair-Level Essay-Scale Republication and Reuse from Fragmented Historical Text Reuse: A Workflow Study on Eighteenth-Century Books and Newspapers
链接：https://arxiv.org/abs/2608.27343
作者：Ke Shu,Kira Hinderks,Eetu Mäkelä,Mikko Tolonen
类目：Computation and Language (cs.CL)
关键词：Eighteenth Century Collections, Century Collections Online, pair-level evidence consolidation, fragmented text-reuse evidence, philosopher David Hume
备注：
点击查看摘要
Abstract:This paper addresses the recovery of essay-scale republication and reuse from fragmented text-reuse evidence, a setting whose central challenge is pair-level evidence consolidation and not fragment retrieval alone. The study focuses on a candidate set centered on essays by eighteenth-century Scottish philosopher David Hume, spanning books from ECCO (Eighteenth Century Collections Online) and historical newspapers. Because the input consists of fragmented reuse hits instead of clean document pairs, and positive coverage is inherently incomplete, we formulate the task as pair-level evidence consolidation into plausible transmission relations and compare three methodological families: a staged rule-based workflow, baselines (a decision tree and two direct LLM settings), and automated rule adaptation. On labeled ECCO--ECCO slices, pair-level feature aggregation alone already reaches 0.948 F1 on the main labeled slice, while the final workflow gives the strongest overall precision-recall trade-off among the tested rule stages. On the full ECCO--ECCO candidate universe, direct LLM baselines flag up to 14,886 pairs as reprints compared to 771 for the final workflow, behaving in this direct-prompt setup as high-recall candidate expanders rather than precision-controlled deployment classifiers. On ECCO--Newspaper, manual audit confirms all 176 predicted positives as genuine cases of republication or reuse, while issue duplication and source-side multiplicity reveal additional provenance structure. Under incomplete ground truth, auditable pair-level evidence consolidation provides a practical way to produce compact candidate spaces for historical inspection.
19. 【2608.27339】Beyond Parallel Blindness: Information Floors and Model Gaps in Block Drafting
链接：https://arxiv.org/abs/2608.27339
作者：Xinwei Qiang,Xiang Fang,Chang Chen,Yue Guan,Yufei Ding
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Information Theory (cs.IT)
关键词：Block drafters propose, forward pass, Block drafters, Block, earlier target tokens
备注：
点击查看摘要
Abstract:Block drafters propose several tokens in one forward pass, before earlier target tokens are realised. Their rejection mixes two losses: missing within-block path information and imperfect modelling of observable information. Accepted length cannot distinguish them. We separate the two with an information floor, the minimum expected rejection at a specified conditioning order; rejection above this floor is the model gap. Estimating both from target rollouts across four domains, four open-weight targets, and a frontier API target yields three findings. First, the all-parallel floor reaches $0.286$ at the final slot on Qwen3-4B, limiting even the best proposal to $71\%$ per-slot acceptance. Second, one realised token removes $86$--$100\%$ of this floor, a locality also recovered by an independent mutual-information analysis. Third, current drafters remain far above their floors: the final-slot model gap accounts for $43$--$64\%$ of DFlash rejection and $85$--$92\%$ of DSpark's oracle-conditioned rejection. These findings separate the value of short-range conditioning from proposal quality.
20. 【2608.27334】BTS-AgentBench: A Deterministic, Replayable Pipeline from Read-Only Telemetry Logs to Agent Benchmarks
链接：https://arxiv.org/abs/2608.27334
作者：Jeong-Yoon Kim
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：executable multi-turn agent, multi-turn agent tasks, Industrial sites, sites contain large, large volumes
备注：
点击查看摘要
Abstract:Industrial sites contain large volumes of read-only telemetry, but few benchmarks specify how to compile these records into executable multi-turn agent tasks. We present a telemetry-to-episode construction method instantiated as BTS-AgentBench. The pipeline normalizes BTS metadata and raw histories into a read-only tool store, compiles static tasks with tool-derived gold answers and evidence, and lifts retained tasks into typed, bounded operator-facing episodes. The 532-row release adds clarification, goal revision, timestamp policy, quality-gated reporting, and evidence attribution while preserving the source computation and split. Coded contract preflight reports zero findings, and the construction-exclusion controller completes 0/532 rows. Two independent raw-to-episode builds match all 11 logical tool-store exports and reproduce the released 356/87/89 train/dev/test artifact exactly. Applying the shared construction path to XAI4HEAT produces 204 episodes; on its 41-row held-out test split, the controller completes 0 rows and the retained GPT-5.5 execution completes all 41. Code, artifacts, and replay reports are available at this https URL.
21. 【2608.27309】Difference-in-Differences on a Censored Rating Scale Can Manufacture an Effect: Evidence from a Pre-Registered LLM-Judge Audit
链接：https://arxiv.org/abs/2608.27309
作者：Shuyi Fan,Boyuan Deng,Mengyu Xu,Xinhong Xie,Chenyang Li,Hongyang Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：contrasting matched conditions, LLM judges certify, strongest designs difference, bounded rating scale, matched conditions
备注： 15 pages, 3 figures, 3 tables
点击查看摘要
Abstract:Audits of LLM judges certify a bias by contrasting matched conditions, and the strongest designs difference twice: a within-item contrast between two candidate responses, differenced again across a manipulated attribute, read off a bounded rating scale. We show that this endpoint is not identified on the scale that reports it. Each term of the double difference is censored by its own share, so the observed statistic confounds differential preference with differential attenuation: a severity shift common to both responses manufactures an interaction whenever the two censor it unequally, as unequal distances from the bounds make them, exactly where good stimuli place them. We exhibit the failure inside a pre-registered audit of a frozen pedagogy judge, sealed before the first of its 990 calls. The registered primary endpoint, the effect of a stated learner profile on the judge's scaffolding preference, is null: $+0.085$ points (95\% BCa $[-0.167, +0.353]$, $p = 0.684$). The audit's one nominally significant interaction, $+0.378$ ($p = 0.002$), is not identified as preference: a construction containing zero differential preference reproduces 79 to 85\% of it from the observed severity shift and the scale floor alone. We derive the mechanism in closed form and show that its contribution is measurable from an audit's own ratings.
22. 【2608.27268】BrailleBench: Investigating Multi-Criteria Braille Comprehension in Large Language Models
链接：https://arxiv.org/abs/2608.27268
作者：Jinghan Zhang,Fengran Mo,Zhiyu Chen,Xiaoyan Han,Kunpeng Liu,Chang-Tien Lu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Large language models, benefit vulnerable groups, Large language, Braille, computational assistance
备注：
点击查看摘要
Abstract:Although Large language models (LLMs) mediate access to knowledge and computational assistance, their capabilities should benefit vulnerable groups in the same way. However, it is unclear whether existing AI systems are inclusive enough for blind and deafblind users to access the same functionality through Braille, whose indicators, contractions, and digital representations introduce distinct requirements for model comprehension. To this end, we introduce BrailleBench, a benchmark for evaluating LLMs in Braille comprehension from different Criteria. BrailleBench aligns 5,570 instances from five datasets, including mathematics, commonsense, and multi-hop question answering across English and Braille Grades 1 and 2. Different configurations are designed to understand whether the systems can comprehend Braille-authored content, express answers in Braille, and complete end-to-end Braille interaction. To ensure the quality and prevent evaluation bias, the benchmark is built through a deterministic, expert-reviewed pipeline via a self-created Braille Toolkit without using any data instances generated by LLMs. We evaluate six representative LLMs from various aspects. The results reveal a persistent gap between print-English capability and Braille accessibility. Braille understanding and expression are asymmetric, where Grade 2 is especially fragile on the input side compared to Grade 1, and fully Braille requests further reduce performance. The experimental observations provide valuable guidance for the development of future Braille AI systems. All related resources in BrailleBench are publicly available for future research.
23. 【2608.27266】Naive Prompt Optimization: Rethinking the Need for Complex Prompt Search
链接：https://arxiv.org/abs/2608.27266
作者：Yuan Chang,Xiaoqi Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Efficiently improving autonomous, accelerating recursive self-improvement, improving autonomous agents, promising approach capable, reducing computational costs
备注： 22 pages, 12 figures
点击查看摘要
Abstract:Efficiently improving autonomous agents across diverse tasks is central to accelerating recursive self-improvement (RSI) in agentic AI, with prompt optimization emerging as a promising approach capable of delivering performance gains comparable to those achieved by fine-tuning model weights, while reducing computational costs in both optimization and serving. However, recent developments increasingly favor unnecessarily complex prompt optimizers. We introduce Naive Prompt Optimization (NPO), a lightweight single-lineage method that iteratively revises prompts using a teacher model with rollout feedback. NPO achieves comparable or better performance than GEPA with fewer rollouts, and its advantage increases with stronger teacher models, suggesting that stronger teacher reasoning can partially substitute for optimizer-side search complexity. In interactive games, NPO remains broadly competitive with GEPA, while GRPO performs better on some tasks less amenable to prompt optimization. We also show that NPO-optimized prompts elicit similar performance improvements when applied verbatim to other student models, especially across models within the same family. Overall, our preliminary results show that simple, linear prompt optimization can rival substantially more sophisticated and complex search procedures.
24. 【2608.27265】SCIT: Testing Causal Cache Carriers in Latent Chain-of-Thought Models
链接：https://arxiv.org/abs/2608.27265
作者：Yi Ding,Lijun Huang,Menglin Yang
类目：Computation and Language (cs.CL)
关键词：models move intermediate, move intermediate reasoning, Cache Interchange Test, Suffix Cache Interchange, models move
备注： accept by emnlp2026
点击查看摘要
Abstract:Latent chain-of-thought models move intermediate reasoning from emitted text into continuous states, improving compactness but hiding the causal object. We introduce SCIT, the Suffix Cache Interchange Test, a causal protocol that constructs exact source-recipient counterfactuals, patches declared cache segments, and identifies which transformer object carries the counterfactual computation. SCIT combines sufficiency tests with K/V component splits, hidden-state controls, semantic source controls, decoded validation, and matched corruption. On CODI-GPT2 and a Sim-CoT-style GPT-2 reproduction, counterfactual arithmetic transfers primarily through value-cache suffix trajectories rather than hidden states, keys, reusable answer slots, or single-token triggers. Complete sufficiency-and-necessity evidence for the late-value-suffix mechanism holds for the main CODI-GPT2 checkpoint; the Sim-CoT-style checkpoint shows the same sufficiency and decoded-control pattern but insufficient matched-corruption evidence for a necessity call. Beyond these local arithmetic cells, SCIT reveals carrier-regime shifts: arithmetic-like GPT-2/1B cells preserve latent-tail value/KV transfer, whereas competent 8B and repaired non-arithmetic cells route through prompt-prefix or full-cache K/V; boundary cells receive no mechanism call. SCIT therefore contributes a cache-level diagnostic, a checkpoint-specific GPT-2 arithmetic mechanism, and a competence-gated carrier map rather than a universal latent-tail claim.
25. 【2608.27260】What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents
链接：https://arxiv.org/abs/2608.27260
作者：Xingshan Zeng,Zishan Xu,Boju Zhang,Yuzhou Wu,Lingzhi Wang,Jianghao Lin,Liangyou Li,Yasheng Wang,Lifeng Shang,Xin Jiang,Weinan Zhang,Yong Yu,Qun Liu,Weiwen Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agents increasingly, agents increasingly rely, LLM agents, increasingly rely, interact with external
备注：
点击查看摘要
Abstract:LLM agents increasingly rely on generated interaction data to learn how to interact with external environments. Agentic data generation must maintain consistency among environments, tasks, interactions, and success signals while producing experience that is useful rather than merely abundant. Existing work spans many agent domains, but domain-centered organization and heterogeneous evaluation often obscure common generation mechanisms and conflate candidate construction with verification and selection. This work develops a two-level framework for the field. First, we represent agentic data as a common factorized object $(E,q,\tau,v)$, comprising an environment specification, task signal, interaction realization, and optional verifier. We organize generation paradigms by their primary anchor and dependency structure. Second, we formulate generation as constrained distribution design through the Accuracy-Complexity-divErsity (ACE) lens. Accuracy establishes the feasible support of grounded and internally consistent data. Within this support, Complexity places learning mass relative to the capability of a declared learner and execution configuration, while divErsity controls coverage and redundancy of data. Using this framework, we explore how prior work verifies generated experience, constructs and calibrates difficulty, and expands behavioral coverage. The literature reveals a shift toward execution-grounded accuracy, learner-relative complexity, and diversity beyond surface variation or dataset size. We further discuss broader directions and emerging trends in agentic data generation through the ACE lens, including their implications for scaling, data sources, training regimes and adaptive learning. Overall, the central challenge is not simply to generate more data, but to continually allocate valid, informative, and non-redundant experience as agents and environments evolve.
26. 【2608.27219】BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing
链接：https://arxiv.org/abs/2608.27219
作者：Yu Yvonne Wu,Arvind Pillai,Yuliang Chen,Yuwei Zhang,Sudarshan Regmi,Tess Z. Griffin,Michael V. Heinz,Lisa A. Marsch,Nicholas C. Jacobson,Andrew Campbell
类目：Computation and Language (cs.CL)
关键词：episodic self-report scales, convert subjective states, health assessment relies, self-report scales, assessment relies
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Mental health assessment relies on episodic self-report scales, which convert subjective states such as stress into numerical scores but provide only sparse snapshots of wellbeing. Wearable devices offer longitudinal behavioral and physiological signals for continuous, low-burden monitoring. Recent LLM-driven personal-health agents enable natural language queries over wearable signals, but mainly handle short-term, retrieval-based lookups (e.g., highest step count over a week). They do not evaluate whether agents can reason over long-term signals to predict wellbeing scores paired with evidence-grounded rationales. To address this gap, we introduce BALMS, the first systematic benchmark of LLM-based agentic systems for longitudinal mental health sensing. BALMS spans 3 real-world longitudinal datasets, 2 task families (closed-form wellbeing-score prediction and rationale generation auto-graded by an LLM-as-Judge), 3 agentic paradigms evaluated across 5 open- and closed-source LLM backbones. We find that zero-shot agents rarely outperform a simple mean baseline, except with stronger backbones or compact, semantically meaningful features. Chain-of-thought prompting improves reasoning-oriented backbones, but does not guarantee temporal grounding or numerical correctness. Together with more analysis on efficiency and temporal scaling, BALMS highlights the need for longitudinal mental health agents that selectively retrieve history, ground temporal evidence, and reason over interpretable behavioral features.
27. 【2608.27176】When Text Misleads: Inconsistent-Aware Reasoning for Audio-Grounded Dialogue
链接：https://arxiv.org/abs/2608.27176
作者：Yen-Ju Lu,Yuzhe Wang,Yaohan Guan,Xiluo He,Jiarui Hai,Mingrui Liang,Kaavya Chaparala,Thomas Thebaud,Laureano Moro-Velazquez,Najim Dehak,Jesus Villalba
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Audio and Speech Processing (eess.AS)
关键词：paralinguistic acoustic signals, dialogue requires joint, requires joint reasoning, requires joint, lexical content
备注： 24 pages, 4 figures
点击查看摘要
Abstract:Understanding spoken dialogue requires joint reasoning over lexical content and paralinguistic acoustic signals such as emotion and conversational intent. However, existing evaluations often allow shortcuts based on transcripts or single-modality solutions, obscuring whether models genuinely ground predictions in speech. We formalize this failure mode as cross-modal disagreement, where transcripts suggest plausible but incorrect surface interpretations while acoustic cues such as prosody or speaking style support different answers. We develop a scalable framework that identifies text-biased surface interpretations and converts disagreement regions into conflict QA examples. We also include consistent cases where transcript-based and speech-grounded interpretations agree, enabling evaluation beyond adversarial audio dependence. This results in ContraTalk, a controlled benchmark containing 501 questions across five discourse dimensions: interaction behavior, emotion state, dialogue act, social stance, and conversational intent. We further develop an agentic-style reasoning framework that converts speech into an Audio Twin, a text-readable representation of localized acoustic cues that exposes acoustic evidence to the reasoning model. Experiments show that strong text-only LLMs exceed 90% accuracy in consistent cases but drop to 33-48% in conflict cases. Direct AudioLLMs provide only partial grounding, still selecting the transcript-biased trap in roughly 30-40% of conflict cases. Our Audio Twin framework improves conflict-case accuracy while reducing trap selection, but its consistent-case behavior remains backbone-dependent. These results identify transcript-based shortcuts as an important failure mode in spoken dialogue understanding and show that explicit acoustic evidence aggregation provides a more controllable interface for diagnosing and improving speech-grounded reasoning.
28. 【2608.27167】Calibrated Enough to Know, Not Calibrated to Act: Fabricated Evidence Makes LLM Agents Commit to the Unknowable
链接：https://arxiv.org/abs/2608.27167
作者：Pranav Aggarwal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：LLM agent shown, professional-looking market panel, LLM agent, provably unpredictable question, market panel commits
备注： 28 pages, 6 figures. Code, data, pre-registration and all cached model outputs: [this https URL](https://github.com/Pranav-1100/confidence-calibration-evaluation) . Also archived at Zenodo, DOI [https://doi.org/10.5281/zenodo.22043517](https://doi.org/10.5281/zenodo.22043517)
点击查看摘要
Abstract:An LLM agent shown a professional-looking market panel commits to a directional call on a provably unpredictable question far more often than one asked the bare question: across 12 frontier models, commitment rises from 6.5% to 54.0% as evidence is escalated. It commits just as readily when every number on the panel is invented: fabricating the entire display, so nothing the model can see is true except the question itself, still lifts commitment from 24.5% to 36.8%, statistically indistinguishable from the 37.6% produced by genuine market data. What unlocks confident action is not information but the authority of its packaging. The failure is narrow and locatable. Incapacity is not the answer: on matched answerable questions attached to the same panels, the same models answer essentially always, at near-perfect accuracy. Nor is it belief - stated probabilities barely move across the gradient that swings action by 48 points, and score worse than a climatological baseline. Missing judgment isn't it either: asked to classify a question's knowability before acting, models call it irreducible 90% of the time and then commit on just 0.4% of those. The act/don't-act gate is what fails, and the effect is concentrated in a few models rather than universal. Because the gate is separable, it can be trained. Supervised fine-tuning of a 3B model on 540 synthetic cases, predominantly dice, coins, jars and timers, drives commitment to 0.0% on the original cases and transfers to three unseen domains. It does not survive everything: the gate holds exactly when the response format leaves room to reason, and rigid formats that remove that room leave the model confident and wrong on questions it otherwise answers correctly. The gate is trainable and context-fragile, and deployment needs both halves of that sentence.
29. 【2608.27165】Prediction of Prediction (PoP): Inter-Layer Activation Fusion for Single-Pass Hallucination Detection in Large Language Models
链接：https://arxiv.org/abs/2608.27165
作者：Himal Badu
类目：Computation and Language (cs.CL)
关键词：routinely generate factually, generate factually incorrect, factually incorrect outputs, large language models, high decoding confidence
备注： 7 pages, 3 figures, 9 tables. Single-author preprint on white-box, single-pass hallucination detection using inter-layer activation divergence, cross-layer fusion, temporal drift, and calibrated risk scoring. Evaluated on TruthfulQA, HaluEval 2.0, and FaithDial with Llama-3, Qwen2.5, and Mistral backbones
点击查看摘要
Abstract:Autoregressive large language models (LLMs) routinely generate factually incorrect outputs with high decoding confidence, limiting their deployment in high-stakes workflows. Existing output-stage uncertainty metrics can fail when models are overconfident on false assertions, while multi-sample verification pipelines introduce substantial memory and latency overhead. This work evaluates whether internal hidden-state transition dynamics during generation can signal factual errors without auxiliary decoding calls. We introduce Prediction of Prediction (PoP), a mechanism that captures layer-transition uncertainty by fusing intermediate hidden representations across depth during a single forward pass. Evaluated on the TruthfulQA benchmark using autoregressive transformer backbones, PoP achieves an area under the receiver operating characteristic curve (AUROC) of 75.5% for factual-correctness classification. The mechanism operates within the base forward pass, adding less than 1.2% runtime latency and requiring zero additional generation passes. The numerical results are reported from the author-verified experimental implementation and are bounded by the evaluation scope described below.
30. 【2608.27161】STAR : Sentence Translation Alignment Rate for Document-to-Document Machine Translation
链接：https://arxiv.org/abs/2608.27161
作者：Yichen Dong,Hao Wang,Junhui Li,Linlong Xu,Longyue Wang,Weihua Luo
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, promising improved global, improved global coherence, promising improved
备注： EMNLP 2026
点击查看摘要
Abstract:Large Language Models (LLMs) have enabled a shift from sentence-level to document-to-document (Doc2Doc) machine translation, promising improved global coherence. However, document-to-document generation in a single pass frequently suffers from structural misalignment, manifesting as sentence omissions or hallucinations that violate the core requirement of source-target correspondence. To address this, we introduce Sentence Translation Alignment Rate (STAR), an auxiliary metric that explicitly quantifies sentence-level structural fidelity. Building on this, we propose STAR-masked Preference Optimization (StarPO), a framework that ranks document-level hypotheses by structural quality and utilizes a dynamic alignment mask to focus optimization on misaligned segments. Experimental results across news and literary domains demonstrate that StarPO significantly enhances translation quality and structural integrity. Notably, StarPO allows compact models to surpass the performance of massive proprietary systems like GPT-4o while maintaining superior token efficiency.
31. 【2608.27135】Said Aloud, Read Different: Cross-Modal Instability in Multimodal Models
链接：https://arxiv.org/abs/2608.27135
作者：Basel Mousi,Fahim Dalvi,Shammur Chowdhury,Firoj Alam,Nadir Durrani
类目：Computation and Language (cs.CL)
关键词：interpret spoken queries, visually grounded decisions, produce visually grounded, speech-first assistants, interpret spoken
备注： Interpeech 2026
点击查看摘要
Abstract:Multimodal foundation models are increasingly used in speech-first assistants that must interpret spoken queries and produce visually grounded decisions. Yet it remains unclear whether semantically equivalent queries yield consistent judgments across modality (text vs. speech) and language (English vs. Arabic). We introduce a speech-augmented visually grounded contrastive triplet benchmark spanning 10,150 culturally grounded images from 18 MENA countries, where each image is paired with one supported statement and two plausible but unsupported alternatives. We define contrastive instability as the conditional rate at which a model fails to resolve all statements within a triplet, isolating fragmented reasoning from complete failure. Evaluating recent multimodal models under text and speech in English and Arabic, we find that modality and language shifts introduce substantial triplet-level inconsistencies that are not fully captured by aggregate accuracy, with speech amplifying partial failures. We make the benchmark publicly available to the community.
32. 【2608.27128】winKV: A Composable Repair Pass for KV Cache Eviction via Pairwise Key Redundancy
链接：https://arxiv.org/abs/2608.27128
作者：Hong Chen,Yudong Zeng,Yongwei Huang,Zuhao Ouyang,Junyan Zhang,Xuming Hu
类目：Computation and Language (cs.CL)
关键词：Long-context inference, tight resource budgets, cache eviction methods, inference is bottlenecked, memory footprint
备注：
点击查看摘要
Abstract:Long-context inference is bottlenecked by the memory footprint of the key-value (KV) cache, especially for small models under tight resource budgets. Existing KV cache eviction methods score tokens using the model's attention distribution or, in attention-free variants, each key's distance from a global reference point. Using a controlled leave-one-out probe, we find that attention magnitude is unrelated to a token's causal contribution to the answer (Spearman $\rho=-0.004$), challenging the premise behind dominant eviction methods. We introduce TwinKV, a training-free, attention-free redundancy signal that detects whether a token's key has a near-duplicate elsewhere in context. Rather than replacing existing policies, TwinKV acts as a composable repair pass: given a policy's fixed retained set, it identifies evicted tokens with no surviving duplicate (\emph{orphans}) and retained tokens whose information is duplicated elsewhere (\emph{redundant donors}), then swaps them while preserving the original budget and scoring rule. We compose TwinKV with four recent eviction policies across LongBench, LooGLE, RULER, and a short-context MMLU-Pro no-harm control at compression ratios ${0.3,0.5,0.7}$. On Qwen3-4B, TwinKV improves a majority of configurations for two policies, is near-even for a third, and helps only a minority for a fourth adaptive baseline already near a performance ceiling; gains across the three non-ceiling policies are smallest at the loosest ratio. On RULER with Llama-3.2-1B, however, that fourth policy improves in every evaluated cell because its Alone score leaves substantial room to improve. More broadly, Llama-3.2-1B shows a smaller average LongBench gain but a higher fraction of improved cells on LongBench and LooGLE than Qwen3-4B, plus a clean RULER win. We also identify few-shot classification exemplars as a task structure where TwinKV does not help on either model.
33. 【2608.27115】Cross-Lingual Alignment Without Joint Training: Do Monolingual Language Models Converge on Universal Representations?
链接：https://arxiv.org/abs/2608.27115
作者：Ej Zhou,Suchir Salhan,Catherine Arnett,Anna Korhonen
类目：Computation and Language (cs.CL)
关键词：explicit alignment objectives, joint training, shared parameters, mixed-language batches, typically attributed
备注：
点击查看摘要
Abstract:Cross-lingual alignment in multilingual language models is typically attributed to joint training: shared parameters, mixed-language batches, or explicit alignment objectives. We ask whether monolingual models trained on non-parallel data learn alignable representations without joint training. By testing on strictly monolingual language models, such as the Goldfish model families and independently developed models from different research labs, we find three results. Correlation: these models develop alignable representational geometry across layers, with alignment strengthening as data scale, model scale, or linguistic proximity increases. Construction: a single Procrustes rotation fit on parallel sentences maps hidden states between models. Causation: the same rotation transfers functional content; patching a rotated English residual into a German model on a factual cloze flips the prediction to the donor's capital in most cases. We confirm that cross-lingual alignment can emerge from the structure of language and the information it carries rather than from joint training, and this points to practical future directions including model stitching, merging, and modular multilingual systems built from monolingual components.
34. 【2608.27110】DocTalkBN: A Novel Dataset of Expert Telemedicine Conversations in Bengali
链接：https://arxiv.org/abs/2608.27110
作者：Anik Saha,Fahmida Sultana Naznin,Sadatul Islam Sadi,Ananya Shahrin Promi,Wahid Al Azad Navid,Rifat Shahriyar
类目：Computation and Language (cs.CL)
关键词：datasets remain scarce, remain scarce, requires authentic expert, conversational AI requires, Reliable medical conversational
备注：
点击查看摘要
Abstract:Reliable medical conversational AI requires authentic expert--patient interaction data, yet such datasets remain scarce, especially for low-resource languages such as Bengali. We present DocTalkBN, a large-scale multimodal dataset of real-world expert telemedicine conversations in Bengali, collected from nationally broadcast telemedicine programs featuring board-certified physicians. DocTalkBN contains 557.63 hours of paired audio and text, 1,515 multi-turn patient calls, 10,274 host--doctor question--answer exchanges, totaling 1.7M tokens, spanning 26 medical specialties. Unlike prior resources derived from medical forums, written health content, or synthetic data, our dataset preserves the spontaneity, contextual richness, and spoken characteristics of authentic medical interactions in a low-resource setting. To support benchmark-driven research, we further construct three downstream tasks from the corpus, medical triage classification, advice safety evaluation, and medical named entity recognition, and benchmark a diverse set of large language models and encoder-based baselines. Our results show that DocTalkBN is a practically useful resource, particularly for clinically grounded reasoning tasks. We release this resource to facilitate future research on reliable medical NLP and safer, more culturally grounded healthcare systems for low-resource languages. Our source codes and dataset are publicly available at this https URL.
35. 【2608.27070】Unifying Detection and Adaptation in Task-Free Continual Learning
链接：https://arxiv.org/abs/2608.27070
作者：Dezheng Han,Anbang Zhang,Zhihao Zhu,Shuaishuai Guo
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：mitigate catastrophic forgetting, large language models, task-specific adaptation modules, methods typically constrain, introduce task-specific adaptation
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:To mitigate catastrophic forgetting in downstream continual learning (CL) for large language models (LLMs), existing methods typically constrain parameter updates or introduce task-specific adaptation modules. However, these methods often rely on explicit task boundaries during training, limiting their applicability to realistic task-free scenarios. In this paper, we propose a \textbf{Fi}sher-guided \textbf{uni}fied (\textbf{FiUni}) framework for batch-level task detection and parameter-efficient continual adaptation. FiUni is motivated by a key observation about the Fisher information matrix (FIM) of pre-trained models: the orthogonality among the principal subspaces of its Kronecker-Factored Approximate Curvature (K-FAC) approximation, estimated from a small number of downstream task samples, can reflect the similarity between different tasks. Based on this observation, FiUni constructs FIM-derived frozen subspaces to guide low-rank adaptation (LoRA), while matching the Fisher principal subspace of each incoming batch window with historical subspaces. This enables FiUni to adaptively determine whether to reuse existing knowledge, expand a related subspace, or create a new subspace, dynamically balancing knowledge sharing and task isolation. Experiments show that FiUni can effectively infer latent batch-level task affiliations and achieve competitive performance against advanced task-aware CL methods with fewer trainable parameters.
36. 【2608.27049】Research Design Tracking and Assessment for the Social Sciences
链接：https://arxiv.org/abs/2608.27049
作者：Marco Rovera,Sergiu Burlacu,Dominique Cappelletti,Alessio Tomelleri,Sonia Marzadro,Martina Bazzoli,Annalisa Tassi,Jessica Gagete-Miranda
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：causal research designs, Reliable assessment, Automated Research Design, Research Design Tracking, introduce Automated Research
备注： Paper accepted at EMNLP 2026 - Main Conference
点击查看摘要
Abstract:Reliable assessment of causal research designs in the social sciences is critical for evidence-based policy-making, yet has so far relied entirely on manual expert analysis. We introduce Automated Research Design Tracking and Assessment (ARDTrA), a task that involves detecting the research design used in a paper and assessing the quality of its application. We create an expert-annotated dataset of papers covering six families of counterfactual research designs and evaluate the task using a multi-turn RAG-based conversational pipeline. Across four retrieval strategies, four LLMs and six embedding models, we find that passage length is the main driver of performance, explaining 52-66% of the variance. A per-research-design analysis also shows that human and machine difficulty do not align: the designs that prove hardest for the system are not those on which expert annotators disagree most, pointing to two independent sources of task difficulty.
37. 【2608.27038】Cascaded Batch Prompting
链接：https://arxiv.org/abs/2608.27038
作者：Sho Hoshino,Peinan Zhang
类目：Computation and Language (cs.CL)
关键词：multiple instances simultaneously, downstream task performance, processing multiple instances, unpredictable downstream task, prompting makes large
备注： EMNLP 2026 Findings
点击查看摘要
Abstract:Although batch prompting makes large language model inference more efficient by processing multiple instances simultaneously, it suffers from unpredictable downstream task performance. We propose cascaded batch prompting, a two-stage approach designed to resolve the unpredictability of conventional batch prompting by disentangling complex reasoning from symbol grounding. Experiments on multiple-choice question answering and natural language inference demonstrate that the proposed method outperforms the standard single prompting baseline while achieving a speedup proportional to batch size, establishing a new state of the art on the Pareto frontier.
38. 【2608.27036】Reasoning about In-Context Samples for Machine-Translation
链接：https://arxiv.org/abs/2608.27036
作者：Maxime Bouthors,Josep Crego,François Yvon
类目：Computation and Language (cs.CL)
关键词：trained to perform, LLM-Based Machine Translation, order to improve, improve the reliability, Machine Translation
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) can be trained to perform chain-of-thoughts reasoning in order to improve the reliability of their responses. In this work, we investigate how explicit reasoning can be leveraged for LLM-Based Machine Translation (MT) with in-context samples. We introduce a novel fragment-based reasoning framework in which the model first extracts parallel source-target fragments from retrieved similar exemplars, and uses these fragments as intermediate reasoning traces to produce the final translation. To train our model, we distill silver fragments and drafts from a large teacher model. Our experiments with the Qwen3 model family, over 6 languages, including up to 5 domains per language, demonstrate that fragment-based MT significantly outperforms alternative methods like standard k-shot or basic drafting.
39. 【2608.27035】Representing and Parsing Korean Constituency Structure at Different Levels of Granularity
链接：https://arxiv.org/abs/2608.27035
作者：Jungyeul Park,KyungTae Lim,Zihao Huang,Eunkyul Leah Jo,Yige Chen,Chulwoo Park
类目：Computation and Language (cs.CL)
关键词：Penn Korean Treebank, Penn Korean phrase, Penn Korean, aligning Penn Korean, preserving Penn Korean
备注：
点击查看摘要
Abstract:Korean constituency parsing raises a representational challenge because the terminal units of a phrase-structure tree do not straightforwardly correspond to simple surface words. Korean eojeols are morphologically complex spacing units, and existing constituency resources differ in how they represent eojeol-internal morphology and non-overt elements. This paper compares three constituency parsing representations derived from the Penn Korean Treebank: Morpheme+XPOS, Eojeol+XPOS, and Eojeol+UPOS. We construct these representations by removing null elements, aligning Penn Korean phrase structure with overt eojeol tokens, preserving Penn Korean phrase labels where possible, and varying the terminal and preterminal layers. We then evaluate canonical non-binary transition-based constituency parsers in top-down, in-order, and bottom-up orders under a shared modeling and evaluation setup. All experiments use gold terminal segmentation and gold preterminal labels and therefore evaluate constituency parsing conditioned on gold morphosyntactic annotation. Eojeol terminals yield shorter transition sequences, but Eojeol+UPOS parsing substantially underperforms the morphologically richer conditions. Eojeol+XPOS narrows this gap, while Morpheme+XPOS gives the strongest results even after its predictions are projected to the eojeol terminal domain. Under these gold-annotation conditions, the results show that fine-grained morphological and XPOS representations provide valuable evidence for the evaluated parsers. This empirical finding concerns the information available for parsing and does not by itself determine the linguistically preferable terminal domain. Independently, linguistic and resource-design considerations motivate eojeol as a stable and interpretable surface domain for phrase-structure annotation, with morpheme-level and XPOS information retained as aligned morphosyntactic evidence.
40. 【2608.27031】ITL: Interpretable Document Alignment with Structured Reference Frameworks
链接：https://arxiv.org/abs/2608.27031
作者：Raúl Giráldez,Dayrelis Mena,Jesús S. Aguilar--Ruiz
类目：Computation and Language (cs.CL)
关键词：requires identifying conceptual, frameworks requires identifying, Structured Reference Document, Intelligent Target Locator, identifying conceptual evidence
备注： 21 pages, 2 figures, 7 tables, 2 Appendices
点击查看摘要
Abstract:Measuring alignment between documents and structured reference frameworks requires identifying conceptual evidence distributed throughout the text and reporting it through measures that are quantitative, interpretable, and traceable. Many commonly used retrieval and classification approaches return either pairwise similarity scores or one or more class labels, whereas fewer methods provide concept-level scores that are directly traceable to the terminological evidence supporting them. We present \emph{Intelligent Target Locator} (ITL), a domain-agnostic and language-portable methodology that estimates the affinity between the textual units of a target document and the concepts defined in a \emph{Structured Reference Document} ($SRD$). From the $SRD$, ITL induces concept-specific terminological profiles built from independent terms, bigrams, trigrams, and co-occurrences. Each term is assigned an importance weight that combines concept membership, term-type specificity and inter-concept discriminability. The output is a textual-unit--concept affinity matrix that can be aggregated at different levels of granularity. We conduct an internal consistency assessment using the 17 Sustainable Development Goals (SDGs), evaluating each official goal statement against the $SRD$ induced from the same set of descriptors. Every statement reached its highest affinity with the corresponding concept, and the mean affinity across the remaining concepts stayed marginal relative to the mean reference affinity. This separation indicates that ITL distinguishes the conceptual profiles of the framework. ITL thus offers a general basis for quantifying document alignment with structured frameworks while keeping each result traceable to the terminological evidence that supports it.
41. 【2608.26982】JudgeStealer: Extracting LLM Judging Capabilities across Evaluation Protocols
链接：https://arxiv.org/abs/2608.26982
作者：Chen Chen,Yaolin Chen,Xuehan Sun,Juan Lin,Xueluan Gong,Yuhang Zheng,Qian Wang,Kwok-Yan Lam
类目：Computation and Language (cs.CL)
关键词：Large language model, valuable intellectual property, Large language, judgment capabilities valuable, capabilities valuable intellectual
备注： 20 pages, 8 figures
点击查看摘要
Abstract:Large language model (LLM) judges are increasingly used across various evaluation scenarios, making their judgment capabilities valuable intellectual property. However, black-box access exposes these capabilities to model extraction attacks. Existing extraction methods do not specifically target LLM judges and provide limited support for multiple evaluation protocols under restricted query budgets. In this study, we propose JUDGESTEALER, the first query-efficient model extraction framework for replicating judging capabilities across pointwise scoring, pairwise comparison, and listwise ranking protocols. JUDGESTEALER exploits the strong cross-protocol agreement to acquire pointwise scores and transform them into pairwise and listwise supervisions without additional victim queries. To capture informative judge patterns and improve query efficiency, JUDGESTEALER dynamically selects pointwise inputs based on semantic diversity, predictive uncertainty, and potential judge biases. It further applies score smoothing and multi-protocol review to preserve the ordinal structure of scores and mitigate catastrophic forgetting during surrogate adaptation. Extensive experiments on state-of-the-art LLM-as-a-judge and reward models show that JUDGESTEALER consistently outperforms existing extraction baselines, achieving up to 73.3%, 87.0%, and 71.6% accuracy for pointwise, pairwise, and listwise evaluation, respectively. JUDGESTEALER also remains effective across different sur- rogate model scales, adaptation strategies, and reasoning settings. Moreover, JUDGESTEALER demonstrates robustness against representative extraction defenses.
42. 【2608.26978】rrain signatures in Welsh settlement names
链接：https://arxiv.org/abs/2608.26978
作者：Oktay Karakuş,Can Eyupoglu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Landscapes are named, broad geographic structure, rarely tested, broad geographic, textit
备注：
点击查看摘要
Abstract:Landscapes are named, but whether names retain measurable environmental information beyond broad geographic structure is rarely tested. We analysed 3,757 Welsh settlements using a frozen, source-audited 24-element lexical framework, preregistered outcome-specific models and geographically structured validation. The central comparison contrasted 101 settlements carrying high-terrain elements (\textit{bryn} or \textit{mynydd}) with 139 carrying low-terrain elements (\textit{cwm} or \textit{pant}). High-terrain names occupied locations 24.4 m higher relative to their 2-km surroundings (95\% CI, 10.8--38.1 m; Holm-adjusted $p$ = 0.00137). The association remained positive across prespecified 1-, 2- and 5-km neighbourhood definitions and was reproduced using an independently produced elevation source (24.1 m; 95\% CI, 10.6--37.6 m). Adding terrain-name polarity to a non-lexical spatial and settlement baseline reduced geographically held-out mean squared error by 4.63\%, 6.22\% and 7.30\% under 10-, 25- and 50-km spatial blocking, respectively, although improvement varied among held-out regions. River-related names provided weaker, directionally consistent evidence, while the preregistered woodland model was non-estimable. Residual spatial structure, unresolved name language and the absence of independent external replication limit interpretation. Selected Welsh settlement-name categories therefore retain measurable information about present-day terrain within Wales, without establishing individual etymology, causal naming, historical environmental memory or transferability to other naming systems.
43. 【2608.26973】Squeezing More from Limited Data with Recursive Transformers
链接：https://arxiv.org/abs/2608.26973
作者：Serdar Gülbahar,Lukas Edman,Alexander Fraser
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：web-scale language modeling, limited data requires, language modeling, view of scaling, scaling than web-scale
备注：
点击查看摘要
Abstract:Pre-training under limited data requires a different view of scaling than web-scale language modeling. With a fixed data budget but relatively abundant compute, increasing parameter count helps only up to an optimal scale; beyond that point, models overfit and generalization worsens. We study this behavior across 10M-100M word pre-training budgets, two corpora, and multiple downstream evaluations, and find that optimal size depends strongly on both the data budget and the downstream target. We argue that standard Transformers scale down poorly to this setting, because embeddings consume a large fraction of the parameter budget and per-token computation is tied to representational capacity. To address this coupling, we study recursive Transformers, reusing a shared block across depth to scale compute, together with factorized embeddings to reduce vocabulary-map parameters. We train three recursive models and find that they outperform standard Transformers at 10M and 100M words, while remaining competitive with BabyLM Challenge 2025 winners.
44. 【2608.26970】EMPLAR Wales: A georeferenced environmental and toponymic dataset of Welsh settlements
链接：https://arxiv.org/abs/2608.26970
作者：Oktay Karakuş,Can Eyupoglu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：quantitative reuse requires, reuse requires explicit, requires explicit separation, mapped places, provide persistent records
备注：
点击查看摘要
Abstract:Place names provide persistent records of how landscapes have been described and organised, but their quantitative reuse requires explicit separation between mapped places, lexical annotations and environmental measurements. TEMPLAR Wales is a georeferenced environmental-toponymy dataset comprising 3,757 settlement records across Wales. The resource links a reproducible settlement frame to deterministic lexical screening and settlement-level environmental attributes through stable identifiers. It contains 1,350 lexical detections across 1,294 settlements, generated from a frozen registry of 24 Welsh place-name elements, while retaining exact- and prefix-token matches and their provenance separately. Environmental attributes describe river and coastal proximity, elevation and local terrain context at multiple spatial scales, land cover and neighbourhood woody cover, with parallel terrain measurements derived from independent elevation products. The dataset is distributed as four relational tables accompanied by a field-level data dictionary, source-provenance register and licensing metadata. Technical validation confirms relational integrity, deterministic lexical reconstruction, documented environmental coverage, strong agreement between independent terrain sources and reproducible reconstruction of the frozen release. TEMPLAR Wales provides a reusable foundation for research in toponymy, linguistic geography, historical and environmental landscape studies, GIS and spatial data analysis without treating computational lexical detections as verified etymologies or contemporary environmental measurements as historical landscape reconstructions.
45. 【2608.26958】Scaling Model-Generated Distillation Data Can Make Latent Teacher Traits More Recoverable
链接：https://arxiv.org/abs/2608.26958
作者：Zhichen Dong,Zhixuan Liu,Yuyu Fan,Xiangtian Li,Shuyang Zhang,Chao Yang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：produce stronger students, reduce noise, increase coverage, viewed as improving, produce stronger
备注：
点击查看摘要
Abstract:Scaling model-generated data is usually viewed as improving distillation: more examples should increase coverage, reduce noise, and produce stronger students. We show a second effect: larger datasets can make subtle teacher-specific signals easier to detect in the trained student, even when examples are off-task and never mention the trait. In a controlled setup inspired by subliminal learning, a teacher induced to express a target trait generates restricted off-task data, such as number-only completions. Students trained on different amounts of independent off-task data are evaluated in a separate domain, with matched no-trait controls isolating target-specific transfer. Our main finding is that larger independent datasets make the teacher's induced trait stand out more clearly in the student's later behavior. Other plausible traits may also strengthen with scale, but the target usually grows more. When the small-scale student already favors the target, scaling mainly amplifies that behavior; when it favors a related or salient alternative, more data can shift behavior toward the intended trait. Analyses of learned LoRA updates show a parallel trend. These effects appear across model families, trait types, multi-trait settings, and cross-model transfer. Our results suggest that scaling generated distillation data should be paired with trait-aware curation and evaluation, even when the data appears off-task or benign.
46. 【2608.26950】From Atomic to Agentic: Towards Interpretable Evaluation of LLMs' Agentic Mathematical Capabilities
链接：https://arxiv.org/abs/2608.26950
作者：Jiayi Kuang,Yinghui Li,Yunze Song,Keyu Chen,Zhifeng Shen,Yangning Li,Yidong Wang,Di Yin,Ruizhi Qiao,Xing Sun,Kai Jin,Ying Shen,Liang Lin,Philip S. Yu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, integrating agentic intelligence, Language Models, evolving from performing
备注： EMNLP 2026
点击查看摘要
Abstract:Large Language Models (LLMs) are evolving from performing end-to-end mathematical reasoning to integrating agentic intelligence. However, most existing math benchmarks evaluate only final answers. This outcome-oriented evaluation provides limited diagnostic value for identifying process-level failures or rigorous logic, failing to guide the transformation of LLMs into robust agents. To bridge this gap, we present a process-level benchmark designed to evaluate the inherent agentic mathematical reasoning abilities of LLMs. Our framework aligns problem-solving agentic behaviors with a structured taxonomy of reusable mathematical atomic capabilities. We design a comprehensive suite of planning, action, and feedback tasks across both textual and multimodal contexts, supported by an automated pipeline that synthesizes high-quality trajectories and produces fine-grained annotations via controlled LLM rewriting. Experiments reveal that models with similar end-to-end accuracy can exhibit markedly different agentic capability profiles. This demonstrates that process-level evaluation is crucial for interpreting the true potential of LLMs and guiding the development of next-generation mathematical agents.
47. 【2608.26941】KinyaEmbed: Contrastive Sentence Embeddings for Kinyarwanda via Multi-Stage Curriculum Training
链接：https://arxiv.org/abs/2608.26941
作者：Ireddi Rakshitha,Devavarapu Yashwanth,Ntakirutimana Pierre
类目：Computation and Language (cs.CL)
关键词：morphologically rich Bantu, rich Bantu language, Bantu language spoken, dedicated sentence embedding, rich Bantu
备注： 14 pages, 3 figures, 5 tables
点击查看摘要
Abstract:We present KinyaEmbed, the first dedicated sentence embedding model for Kinyarwanda, a morphologically rich Bantu language spoken by over 12 million people in Rwanda. Existing multilingual embedding models such as LaBSE, mE5-large, and OpenAI text-embedding-3-large perform poorly on Kinyarwanda due to severe under-representation in their pre-training corpora. KinyaEmbed is built on KinyaBERT-large and trained via a four-stage curriculum using MultipleNegativesRankingLoss (MNRL): Stage 1 leverages ~18,000 paraphrase pairs from the Official Gazette of Rwanda with three temperature scales; Stage 2 fine-tunes on 715 NLLB-translated MNLI triplets for entailment structure; Stage 3 aligns representations using English-Kinyarwanda OPUS-100 translation pairs; Stage 4 refines with 2,936 high-quality pairs filtered from KinyaCOMET at quality threshold 0.8. We evaluate on SemRel2024-rw and introduce Wiki-RW-STS, a new contamination-free Kinyarwanda STS benchmark of 300 pairs derived from Kinyarwanda Wikipedia. A seven-checkpoint ensemble (all5+23A*2, with the final stage double-weighted) achieves Spearman \r{ho}=0.7298 on SemRel2024-rw, surpassing mE5-large by 20.9% and OpenAI text-embedding-3-large by 41.0%. KinyaEmbed also achieves the best document clustering silhouette score (0.2146) across all evaluated models. All checkpoints, the KinyaCOMET filtered pairs, and the Wiki-RW-STS benchmark are publicly available.
48. 【2608.26925】Mapping Written Words to Spoken Words in a Different Language Using Only Visual Grounding
链接：https://arxiv.org/abs/2608.26925
作者：Gabriel Pirlogeanu,Dan Oneata,Horia Cucu,Herman Kamper
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：low-resource settings, collection is difficult, data collection, Abstract, written English
备注： 9 pages, 5 figures, 5 tables, preprint, submitted to IEEE Transactions on Audio, Speech and Language Processing
点击查看摘要
Abstract:In many low-resource settings, even just eliciting speech for data collection is difficult. One promising approach has been to ask speakers to describe images. But how do we build models from such visually grounded speech data? Given a dataset of images with Hindi spoken captions, we consider how we can map a written English keyword to spoken realisations of that word in Hindi. Previous work trained end-to-end multimodal neural models. Instead, we explore a simpler alignment-based approach built on self-supervised speech representations. Written English tags are automatically obtained from images using off-the-shelf image captioning systems. Hindi utterances associated with the same keyword are then aligned (using self-supervised features), and alignment evidence is aggregated to identify recurring speech segments corresponding to the target word. Experiments evaluating keyword spotting and localization show that our alignment-based approach outperforms a previous attention-based neural model. We also show the benefit of incorporating negative examples during alignment. Our work demonstrates that cross-lingual word-to-speech mappings can be learned directly from visual grounding without transcriptions or explicit model training.
49. 【2608.26923】abuLM: Morphology-Aware Tabular Pre-training for Low-Resource Languages
链接：https://arxiv.org/abs/2608.26923
作者：Ireddi Rakshitha,Devavarapu Yashwanth,Ntakirutimana Pierre
类目：Computation and Language (cs.CL)
关键词：Kinyarwanda tabular data, language model pre-trained, Bantu language spoken, rich Bantu language, Masked Cell Recovery
备注： 18 pages, 4 figures, 7 tables
点击查看摘要
Abstract:We present TabuLM, the first language model pre-trained on Kinyarwanda tabular data. Kinyarwanda is a morphologically rich Bantu language spoken by over 12 million people in Rwanda, yet lacks any dedicated tabular representation learning resource. TabuLM extends KinyaBERT-large, a two-tier morphological transformer, with additive row, column, and cell-type embeddings and a learned table-structure attention bias that sharpens same-row and same-column attention. Pre-training uses two new objectives: Masked Cell Recovery (MCR), which masks entire cells and forces reconstruction from row and column context, and Column Type Prediction (CTP), which predicts column semantic types from observed cell values. We pre-train on 172 Rwandan government tables (~35,000 cells) from NISR, RAB, REB, and MoH open-data portals, and introduce TabQA-kin, the first native Kinyarwanda table question-answering benchmark comprising 526 QA pairs across 31 tables and four question types. TabuLM achieves 62.0% exact match on TabQA-kin, outperforming KinyaBERT-large by 5.7 EM points and all multilingual baselines (mBERT 49.3%, XLM-R 50.0%) by 11.7-12.7 points. Analysis shows that structural table embeddings are most decisive for comparison and lookup questions, while morphological awareness provides complementary gains. Our code, data, and pre-trained checkpoint are publicly available.
50. 【2608.26921】AraMS-28k: The Largest Publicly Released Line-Level Dataset of Historical Arabic Manuscripts with Margin and Insertion-Anchor Annotations
链接：https://arxiv.org/abs/2608.26921
作者：Mohamed Guechaoui,Mohamed Diaa Zellagui,Souleyman Chaib,Sahraoui Dhelim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：genuine historical Arabic, largest publicly released, historical Arabic manuscripts, historical Arabic manuscript, historical Arabic
备注： Data and code available at this https URL and this https URL. Dataset: [this https URL](https://doi.org/10.5281/zenodo.22095333) Code: [this https URL](https://github.com/ArchaText/AraMS-28k-Dataset)
点击查看摘要
Abstract:We introduce AraMS-28k, the largest publicly released line-level dataset of genuine historical Arabic manuscripts, comprising 14 books, 3,043 pages, and 28,600 annotated text lines (27,971 main-text, 629 margin). Thirteen books are hand-copied manuscripts spanning three script traditions -- Naskh, Ruq'ah, and Maghrebi -- and one is a lithographed printed edition included to broaden format diversity. Each line is labelled as main-text or margin, and margin lines that have an unambiguous attachment point in the main text are further annotated with an insertion anchor, recovering the manuscript's true non-linear reading order at line-level granularity -- to our knowledge the first such annotation released for a historical Arabic manuscript corpus. Because reference transcriptions are fully vocalised while manuscript hands are typically undiacritised, we release both the raw diacritised transcription and a diacritic-normalised counterpart for every line. The dataset was constructed with RefLAM, a reference-grounded annotation pipeline that aligns multimodal-LLM OCR against independently sourced clean transcriptions and routes every line through human review, combining automatic verification with expert oversight. We describe the construction and quality-control process, present the annotation schema, report dataset statistics at both the corpus and per-book level, and provide baseline HTR results using Kraken and HATFormer, including a cross-script generalisation gradient from in-distribution pages to fully unseen books. AraMS-28k is released with page images, line-level annotations, and fixed train/val/test splits under CC BY-NC-SA 4.0 to support reproducible research on Arabic manuscript recognition, layout analysis, and reading-order recovery.
51. 【2608.26887】Planting a Latent Variable in Natural-Looking Text: a More Realistic Test of Belief States in LLMs and Their Link to Concept Geometry
链接：https://arxiv.org/abs/2608.26887
作者：Alexandru-Iulius Jerpelea
类目：Computation and Language (cs.CL)
关键词：running probability distributions, isolated case studies, toy synthetic data, running probability, govern language
备注： 9 pages, 13 figures
点击查看摘要
Abstract:LLMs are thought to track "belief states," i.e., running probability distributions over the latent variables that govern language (Shai et al., 2024; Sarfati et al., 2026), but so far this has only been comprehensively demonstrated on toy synthetic data and in a few isolated case studies. It has also never been empirically connected to the geometry of LLM features (the concepts interpretability finds in model activations). In this work, we plant a controllable latent variable inside natural-looking text. An LLM teacher writes ordinary text while we "subliminally" steer it along one of K = 8 unrelated sparse autoencoder directions at each token, with the active directions following a ring-shaped Markov chain. A small transformer model trained on this corpus does indeed track the Bayesian posterior belief about our planted latent variable. Moreover, it also arranges the 8 states themselves on a ring, in the exact order of the Markov chain, which is supporting evidence that a concept's geometry can be formed by the statistical dynamics of the latent variable behind it.
52. 【2608.26870】C-Unseen: Weak Signal Detection in Dynamic Temporal Knowledge Graphs via LLM Reasoning
链接：https://arxiv.org/abs/2608.26870
作者：Yassir Lairgi,Ludovic Moncla,Khalid Benabdeslem,Rémy Cazabet,Pierre Cléau
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Social and Information Networks (cs.SI)
关键词：Dynamic Temporal Knowledge, low-visibility indicators, weak signal, Temporal Knowledge Graphs, indicators that precede
备注： Accepted at the AI4SE 2026 Special Track, held within the WISE 2026 Conference
点击查看摘要
Abstract:Weak signals are early, low-visibility indicators that precede significant changes before those changes become established. Existing detection methods, based on keyword frequency, topic modeling, or untyped graph topology, fail to capture the semantic and relational structure through which such signals manifest. In this paper, we propose C-Unseen, a self-interpretable framework for weak signal detection in Dynamic Temporal Knowledge Graphs (DTKGs). We define a weak signal as a rare, semantically coherent subgraph that proliferates across consecutive TKG snapshots. The framework operates through two modules: a Rare Subgraphs Extractor, in which an LLM identifies subgraphs whose content is in tension with the dominant snapshot narrative via chain-of-thought reasoning, and a Weak Signal Alerter, in which the persistence of these rare subgraphs is tracked across time steps to isolate true weak signals. Experimental results demonstrate that C-Unseen outperforms keyword-, topic-, and graph-based baselines.
53. 【2608.26846】Evaluating Confidence-Gated Retrieval with Matched Trajectory Replay
链接：https://arxiv.org/abs/2608.26846
作者：Prateek Chhikara
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Interactive language-model agents, Interactive language-model, external knowledge, signals to decide, memory or external
备注： 5 Tables, 5 Figures
点击查看摘要
Abstract:Interactive language-model agents use confidence signals to decide whether to answer immediately, retrieve additional evidence (from memory or external knowledge), or defer. Yet confidence is usually evaluated in isolation, without measuring the trajectory-level consequences of the actions it triggers. We propose matched trajectory replay, a controlled protocol for comparing confidence-to-action mappings. The protocol holds candidate answer states, evidence points, budgets, and action costs fixed. We use it to compare raw verbalized confidence with post-hoc isotonic calibration in a multi-hop question-answering system using Mistral, GPT, and Qwen models on HotpotQA and MuSiQue datasets. At the same numerical commitment threshold, calibration changes which questions agents ultimately commit to answering. Across all six model-dataset pairs, it increases accuracy among committed answers by up to 41 percentage points. However, it can reduce coverage and increase retrieval use. Overall accuracy improves by up to 15 percentage points on HotpotQA but falls by up to 17 percentage points on MuSiQue. These effects reflect a shift to a more selective, lower-risk operating point, not improved answers or confidence ranking. A calibration map fitted before retrieval improves held-out calibration through retrieval depths one and two, but is worse than raw confidence at depth three for all three models. Additional evidence helps on average, but this aggregate effect does not establish whether confidence identifies which individual episodes will benefit from another retrieval. Taken together, these results show that calibration can make commitment risk interpretable, but it does not estimate the expected benefit of another retrieval. Retrieval therefore requires a separate value-of-information or utility estimate. Evaluations should report held-out calibration, risk-coverage, and retrieval cost.
54. 【2608.26836】SymbolLKG: Towards Verifiable Logical Reasoning via Logical Knowledge Graph and Symbolic Solvers
链接：https://arxiv.org/abs/2608.26836
作者：Haizhao Fan,Yuchi Xiong,Jize Wang,Xinping Guan,Xinyi Le
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, natural language understanding, Large Language, Language Models, demonstrated remarkable proficiency
备注： 19 pages, 9 figures
点击查看摘要
Abstract:Large Language Models (LLMs) have demonstrated remarkable proficiency in natural language understanding, yet they struggle with strict multi-step reasoning, frequently suffering from hallucinations and inconsistency. Existing solutions like Chain-of-Thought (CoT) lack rigorous verification mechanisms, while standard Retrieval-Augmented Generation (RAG) often misses the complex, structural dependencies inherent in logical tasks. To bridge this gap, we propose a Neuro-Symbolic architecture that integrates a Logical Knowledge Graph (LKG) with dynamic solver routing. Specifically, we introduce an ontology-based LKG that treats logical rules and constraints as first-class topological nodes, enabling explicit modeling of dependencies extracted from text. We further design a Logic Router to dynamically dispatch tasks to the optimal symbolic engine, which is supported by a topology-aware hybrid retrieval mechanism. Experimental results on logical reasoning benchmarks demonstrate that our framework significantly outperforms state-of-the-art prompting and RAG baselines, delivering higher accuracy and verifiable reasoning paths.
55. 【2608.26832】RuleWeaver: Benchmarking Rule-Centered Scenario Reasoning for Large Language Models
链接：https://arxiv.org/abs/2608.26832
作者：Bohan Yu,Shi-Yang Li,Pengfei Cao,Jun Zhao,Kang Liu
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, specialized domains, domain expertise, rule-centered scenario reasoning
备注： Accepted by EMNLP 2026 Findings
点击查看摘要
Abstract:Large language models (LLMs) are increasingly applied to specialized domains, where effective use of domain expertise often requires reasoning over complex rules in concrete scenarios. However, existing benchmarks only partially evaluate this capability, as they either focus on output-level instruction constraints or overlook the distinct roles that rules play in scenario reasoning. To address these gaps, this paper introduces RuleWeaver, a benchmark construction framework for evaluating rule-centered scenario reasoning. RuleWeaver starts from corpus-derived IF-THEN Meta Rules, progressively augments them into complex rules, and composes these rules into rule-centered scenario QA instances. Beyond final-answer correctness, RuleWeaver further supports process-level evaluation through rubric-based answer quality, rule recall, and rule precision. Experiments on 11 representative LLMs show that current models still struggle with complex rule-centered scenario reasoning, with even the best-performing model achieving only around 50% of the maximum rubric score. We make our code and dataset available here: this https URL.
56. 【2608.26807】Behavior2Trip: Towards Personalized Travel Planning via User Behavior Trajectory
链接：https://arxiv.org/abs/2608.26807
作者：Zihao Cheng,Yingyu Shan,Hongru Wang,Zeming Liu,Xinyi Wang,Xiangrong Zhu,Yuhang Guo,Wei Lin,Yunhong Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：planning agents assist, modeling their individual, generating personalized travel, Travel planning, Travel
备注： Accepted by EMNLP 2026 Findings
点击查看摘要
Abstract:Travel planning agents assist users in generating personalized travel plans by modeling their individual preferences. Existing agents either rely on explicit user instructions or engage in multi-turn clarification to elicit user preferences. However, both approaches overlook the rich behavioral signals latent in users' past behaviors, which implicitly encode their preferences. This over-reliance on active user input increases interaction burden and limits plan personalization. To bridge this gap, we introduce a new task, Behavior-Aware Travel Planning, which infers user preferences directly from past behaviors and generates personalized travel plans. To facilitate research on this task, we introduce Behavior2Trip, a benchmark constructed from one of the largest Chinese online travel platforms, comprising 11,400 instances. Each instance represents an average of 39.8 past user behaviors spanning 14 attributes across 5 preference dimensions. We further propose B2T-Agent, a reinforcement learning-based agent that leverages user behavior trajectories, interacts with external tools for preference-aligned retrieval, and maintains an internal memory module. Experiments on Behavior2Trip show that GPT-4.1 achieves a full-constraint pass rate of only 0.5\% on the hardest tasks, while B2T-Agent built upon Qwen3-8B outperforms all baselines, highlighting the substantial challenge of this task. Moreover, Qwen3-8B trained with B2T-Agent also outperforms GPT-4.1 on the TravelPlanner benchmark, demonstrating strong generalization. Code and data are available at this https URL
57. 【2608.26788】Decoupling Planning and Control for Instructable Agents
链接：https://arxiv.org/abs/2608.26788
作者：Zineng Tang,Kelsey R. Allen,Sjoerd van Steenkiste,Ishita Dasgupta,Alane Suhr
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Robotics (cs.RO)
关键词：Recent work shows, instruction-tuned vision-language models, reliable low-latency action, low-latency action sequences, Recent work
备注： Published as a conference paper at COLM 2026. Project page: [this https URL](https://zinengtang.github.io/instruct-to-act/)
点击查看摘要
Abstract:Recent work shows that pre-trained, instruction-tuned vision-language models (VLMs) perform well at mapping from instructions and observations to high-level plans, but struggle to realize such plans as reliable low-latency action sequences in unfamiliar environments. At the same time, world-model controllers excel at fast observation-to-action control, but lack open-ended task guidance. In this work, we combine these strengths into a single system, Instruct-to-Act, where we train a world-model controller to act autonomously at high frequency when conditioned on sparse, higher-latency, and high-level text instructions generated by a VLM planner. To train controllers to be language-instructable, we relabel segments of controller policy rollouts with synthetic instructions and jointly optimize a behavior-cloning objective along with existing reward-maximizing and world-modeling objectives. We evaluate our proposed approach across seven embodied environments, including three multi-agent environments where VLM planners coordinate through language while trained controllers serve as their actuators. Under matched observation and action spaces, our decoupled approach consistently outperforms controller-only and direct VLM action-generation variants, preserves fast control, and lets us swap in different pretrained VLM planners without fine-tuning, while remaining competitive with strong vision-language-action and multi-agent RL baselines on six of seven tasks.
58. 【2608.26779】Instruction Quality Matters: Refining Instructions for Effective Preference Learning
链接：https://arxiv.org/abs/2608.26779
作者：Seohyeong Lee,Hwaran Lee,Buru Chang
类目：Computation and Language (cs.CL)
关键词：Preference learning optimizes, learning optimizes models, fundamentally shaped, Preference learning, Preference
备注： Preprint
点击查看摘要
Abstract:Preference learning optimizes models using response pairs, yet the informativeness of these pairs is fundamentally shaped by the instructions from which they are generated. We identify instruction quality as a hidden bottleneck in preference learning: low-quality or ambiguous instructions restrict the response-quality distribution, limiting strong chosen responses and weakening preference signals. Through Best- and Worst-of-N analyses, we show that instruction quality constrains both the ceiling and floor of sampled response quality. Motivated by this observation, we introduce an instruction-refinement pipeline that selects weak instructions using reward signals and revises them with rubric-guided LLM feedback, improving preference data without discarding examples. Across offline and online preference learning settings, experiments on multiple models and benchmarks show broad alignment improvements over original data and alternative data-improvement strategies. Further analyses indicate that instruction refinement raises achievable response quality and complements response-centric preference data curation. Overall, instruction quality emerges as a key factor governing how informative preference signals are formed for LLM alignment. Code is available at: this https URL
59. 【2608.26762】Equal Ranking Quality, Different Decisions: Training Order-Consistent LLM Scorers
链接：https://arxiv.org/abs/2608.26762
作者：Markus Frohmann,Mahdiyar Alavi,Elizabeth Lingg,Navid Rekabsaz
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：LLM prompt, ranking quality, documents or responses, score candidate documents, LLM
备注： 9 pages main text, 45 pages total
点击查看摘要
Abstract:Rerankers, reward models and multi-document QA scorers score candidate documents or responses in one LLM prompt, so each score depends on their order. Such scorers are selected on ranking quality, but their scores determine a decision: what a score threshold retains, a reader answers, or a preference model selects. However, equal ranking quality does not imply equal decisions: on passage reranking, five trained scorers within 0.010 nDCG@10 retain sets that overlap by only 0.66-0.84 when reordered. A published reranker takes the highest retained-set F1 in our comparison and still overlaps by only 0.667. No prompt-time change we test removes that order dependence: the only one that gains ranking quality leaves all three decisions unchanged. Order-consistency SFT (OC-SFT) attenuates it in the weights, training a candidate's score not to depend on the order. It holds ranking quality and leads every decision-stability measure among trained scorers on all three tasks: it flips the reader's answer on 0.125 of permutation pairs against 0.149-0.164 for three other objectives that target order. It is more stable than order-averaged distillation on 12 base models, and one OC-SFT permutation retains sets that overlap more than ten averaged off-the-shelf permutations. A comparison should therefore report what a threshold retains and a reader answers, not ranking quality alone. Code is available at this https URL.
60. 【2608.26749】Letters hide the truth from our eyes: English homophones have meaningfully different phonetic realizations
链接：https://arxiv.org/abs/2608.26749
作者：Yu-Hsiang Tseng,Mirjam T. C. Ernestus,Louis F. M. ten Bosch,R. Harald Baayen
类目：Computation and Language (cs.CL)
关键词：spoken word duration, duration of English, English homophones, distribution of spoken, spoken word
备注： 54 pages, 9 figures
点击查看摘要
Abstract:The distribution of spoken word duration of English homophones is known to co-vary with frequency of use. This study investigates whether other aspects of the phonetic realization of homophones also differ. A series of quantitative investigations of 14,000 homophone tokens in American television news broadcasts revealed that the tokens of homophone pairs such as \textit{weight} and \textit{wait} have different phonetic realizations, and that these can be predicted from their meanings in utterance context. These systematic differences remain even when taking duration-related variation into account. Time-normalized spectrograms emerged as an excellent tool for probing the fine details of phonetic realization, and obviate the need for phonetic transcriptions, which inevitably hide the phonetic truth from our eyes.
61. 【2608.26735】Preserving General Capabilities during Domain Specialization with Uncertainty-Calibrated MOPD
链接：https://arxiv.org/abs/2608.26735
作者：Ziyuan Liu,Jiao Ou,Jian Liang,Ruiming Tang,Cheng Luo
类目：Computation and Language (cs.CL)
关键词：Specializing large language, degrades general capabilities, large language models, improves domain-specific behavior, Specializing large
备注：
点击查看摘要
Abstract:Specializing large language models to vertical domains improves domain-specific behavior but often degrades general capabilities such as reasoning, coding, instruction following, and creative writing. We study this domain--general trade-off in Multi-Teacher On-Policy Distillation (MOPD), where a specialized student is supervised on its own sampled trajectories by domain and general teachers. Standard MOPD faces two limitations: ordinary on-policy sampling rarely exposes tokens with large positive teacher--student advantages, while the advantage sign alone does not establish whether the resulting update direction is reliable. We propose uncertainty-calibrated MOPD to address these limitations. Dual-temperature sampling broadens the candidate trajectory pool, and positive-advantage-density filtering selects trajectories with stronger positive learning signals. Centered log-likelihood (CLL) filtering then computes an entropy-calibrated teacher-endorsement score and probabilistically retains token updates according to direction--endorsement consistency. Experiments on role-playing and medical-domain specialization show that our method improves the general-capability average over standard MOPD by $4.73\%$ and $10.84\%$, respectively, while maintaining vertical-domain performance. Ablations and diagnostic analyses further confirm that the gains do not merely result from a larger rollout budget and that the proposed trajectory- and token-level mechanisms address their intended failure modes.
62. 【2608.26706】owards Expert Financial QA via Self-Improving RAG
链接：https://arxiv.org/abs/2608.26706
作者：Junjie Xiong,Shawheen Ghezavat,Aum Hirpara
类目：Computation and Language (cs.CL)
关键词：standard single-pass RAG, Expert-level financial question, question answering requires, catch numeric hallucinations, RAG systems lack
备注： 17 pages, 2 figures. Accepted at the ICLR 2026 Workshop on Advances in Financial AI
点击查看摘要
Abstract:Expert-level financial question answering requires both grounded verification to catch numeric hallucinations and audit trails for regulatory compliance, attributes that standard single-pass RAG systems lack. We take a step toward this goal with Self-Improving RAG, a framework that decomposes document QA into three specialized agents (Retrieval, Reasoning, and Judge) coordinated by an orchestrator with feedback-driven self-correction. When the Judge Agent scores an answer below a dynamic threshold, the system triggers retry with escalated strategies: broader retrieval, more careful prompting, and relaxed acceptance criteria. We evaluate on FinanceBench (SEC filing QA), where Self-Improving RAG achieves 86% oracle-guided accuracy (measuring agreement with gold answers) with a 36.4% Lazarus Rate, recovering nearly 4 in 10 initially incorrect answers through targeted retry. A key finding is that a fixed retrieval pipeline with judge-driven retry achieves strong results without dynamic routing, providing full interpretability. Every decision is logged with confidence scores, enabling the audit trails required for regulated financial applications.
63. 【2608.26700】PragAlign: Evidence-Sensitive Reply Assistance Across Chinese and Japanese Appropriateness Judgments
链接：https://arxiv.org/abs/2608.26700
作者：Xin Zhong,Satori Hachisuka
类目：Computation and Language (cs.CL)
关键词：multilingual settings requires, settings requires linguistic, requires linguistic competence, culturally situated judgments, multilingual settings
备注： 5 pages, 5 figures, 2 tables
点击查看摘要
Abstract:Reply assistance in multilingual settings requires linguistic competence and culturally situated judgments of appropriateness. We present PragAlign, which separates context reading from selective clarification, and evaluate it alongside Direct and Rule. Nine native Chinese speakers judged Chinese materials, while three native Japanese speakers judged matched Japanese versions. In the Chinese evaluation, PragAlign received significantly better ranks than both baselines. In the Japanese evaluation, Direct had the lowest mean rank, PragAlign had the highest top-rank rate, and the omnibus difference was not significant. The groups selected the same top condition in 5 of 10 scenarios, including four shared PragAlign selections. The results identify shared and language-specific judgment patterns and inform reply assistance designed to support linguistic and cultural understanding.
64. 【2608.26697】Scaling phoneme-based TTS augmentation for ASR: A unified pipeline and controlled study
链接：https://arxiv.org/abs/2608.26697
作者：Zhen Wang,TianRui Wu,RongQi Han,Hao Wu,Wei Liang
类目：Computation and Language (cs.CL)
关键词：automatic speech recognition, Synthetic speech, speech recognition, automatic speech, synthesized data
备注：
点击查看摘要
Abstract:Synthetic speech provides scalable supervision for automatic speech recognition (ASR), but its benefit depends on the selected texts, reference speech, and amount of synthesized data. We present a unified phoneme-based TTS-to-ASR augmentation pipeline built around a multilingual TTS model trained from scratch using the F5-TTS architecture with language-ID conditioning. The pipeline combines language-specific grapheme-to-phoneme conversion, reference-speech filtering, candidate-text selection, synthesis, and matched ASR continuation. We further propose phoneme-frequency-guided selection (PFGS), which ranks candidate sentences using phoneme frequencies estimated from real ASR training labels. Experiments with separate monolingual ASR systems for Arabic, French, Italian, and Portuguese span 13 test sets. Across the synthesis-scale sweep, random augmentation improves over matched real-only continuation on 11 test sets. Under a nominal 60% synthesis budget, PFGS improves over real-only training on 12 test sets and over random selection on 9. Its largest relative word error rate (WER) reduction against random selection is 19.3%. With target texts and synthesis counts fixed, reference-speech filtering reduces absolute WER by 0.29 and 0.59 points on Italian and French Common Voice, respectively. These results identify synthesis scale, candidate-text content, and reference quality as important control variables in TTS-based ASR augmentation.
65. 【2608.26689】Beyond Reflection: Affirmation as a Promising Behavioral Marker Associated with Quality in Text-Based Counseling
链接：https://arxiv.org/abs/2608.26689
作者：Michimasa Inaba
类目：Computation and Language (cs.CL)
关键词：remains empirically unclear, AI-assisted text-based counseling, gaining attention, higher dialogue quality, AI-assisted text-based
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:While AI-assisted text-based counseling is gaining attention, it remains empirically unclear which counselor behaviors are associated with higher dialogue quality. Existing research often focuses heavily on Reflection, borrowing frameworks from Motivational Interviewing. To address this gap, we conduct a multi-layered analysis using KokoroChat, a large-scale Japanese text counseling dataset conducted by professional counselors and trainees, newly annotated with counselor strategy tags and client distress levels. Our results show that, under the quality indicators used in this study, Affirmation is more consistently associated with session quality than Reflection among the analyzed strategies. Cross-dataset transfer experiments further suggest that this quality signal can be observed to some extent on ESConv, an English dataset with non-expert supporters. These findings provide empirical implications for counselor training and emotional support system design. We release the additional KokoroChat annotations and experimental source code at this https URL.
66. 【2608.26685】BLANC: Discovering Patent White Space via Changes in Normalized Pointwise Mutual Information Between Multi-View Clusters
链接：https://arxiv.org/abs/2608.26685
作者：Shuichi Miyazawa,Kensuke Fujii
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Digital Libraries (cs.DL)
关键词：potentially valuable regions, existing methods rely, apply single-view clustering, Blank Landscape Analysis, Normalized Pointwise Mutual
备注： 15 pages, 4 figures, 10 tables. A preliminary Japanese-language report covering the methodology and the industrial case study is scheduled to appear as AGC Research Report 76 (2026), ISSN 2434-0774. The present article is the full version, containing the entire quantitative evaluation
点击查看摘要
Abstract:Identifying white space --- the unexplored but potentially valuable regions of a patent landscape --- is essential for strategic RD planning, yet existing methods rely on manual patent mapping or apply single-view clustering without quantitative gap detection. We propose BLANC (Blank Landscape Analysis through NPMI Conditioning), a three-phase pipeline combining (1) multi-view neural topic modeling along three semantic dimensions (application/use, novelty, inventive step); (2) Normalized Pointwise Mutual Information (NPMI) to quantify cross-dimensional cluster association; and (3) conditional detection that flags combinations whose NPMI drops when the corpus is filtered by a user-specified keyword. The drop is captured by a new metric, $\Delta$NPMI, which identifies combinations "established globally, unexplored locally." Because white space has no ground truth, we evaluate BLANC on two public USPTO corpora --- machine learning/AI (5,417 patents, CPC G06N) and glass compositions (1,982 patents, CPC C03C) --- by artificially depleting known technology combinations and testing recovery. When three-quarters of a target pair's documents are removed, BLANC recovers 34.1% (ML/AI) and 27.3% (glass) of the depleted combinations, whereas size-matched removals not aimed at them (random documents, or those of a different established combination) essentially never do: the target is never recovered in 191 decoy trials. Collapsing the three semantic views into one recovers nothing, while prior co-occurrence measures also flag the target under random removal, offering no specificity. In a proprietary case (302 float glass / glass-ceramics patents), the keyword "fluorine" reveals a fluorine surface treatment $\times$ warpage suppression candidate ($\Delta$NPMI up to 0.48) that experts had independently identified.
67. 【2608.26676】FOCUS RePAIR: Mitigating Text Degeneration via Token-Level Guidance for Pruned Large Language Models
链接：https://arxiv.org/abs/2608.26676
作者：Junyoung Lee,Sehyeon Park,Shinhyoung Jang,Seonha Ryu,Hojeong Kim,Hyunsei Lee,Il Hong Suh,Yeseong Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：large language models, remain largely unchanged, compress large language, task accuracy remain, accuracy remain largely
备注： Accepted to ICML 2026 as a Spotlight
点击查看摘要
Abstract:Pruning is a practical approach to compress large language models (LLMs), but it can amplify text degeneration, especially repetition loops, even when perplexity and task accuracy remain largely unchanged. In this work, we present a token-level analysis of this failure mode by viewing decoding as a dynamical process that enters and persists in a small set of recurrent contexts. Our analysis decomposes degeneration into loop entry risk and loop persistence, and shows that persistence is controlled by the escape mass assigned to plausible alternatives within the token sampling set. Motivated by these findings, we propose two token-level guidance objectives for post-pruning fine-tuning. FOCUS reweights distillation toward high-confidence teacher regions to suppress leakage, while RePAIR uses onset-centered positive/negative continuation pairs with a margin loss to promote plausible alternatives and prevent early commitment to repetition loops. Experiments on open-ended continuation and instruction-based generation show that both methods consistently reduce repetition and improve generation quality.
68. 【2608.26674】Do LLMs Understand Personality? Rethinking Persona Fidelity Evaluation through Structured Behavioral Inference
链接：https://arxiv.org/abs/2608.26674
作者：Mengfan Li,Zesheng Wei,Xuanhua Shi,Yang Deng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：diverse human characters, large language models, simulate diverse human, agent behavior consistently, behavior consistently reflects
备注： Accepted by EMNLP 2026 main conference
点击查看摘要
Abstract:As large language models are increasingly deployed to simulate diverse human characters, ensuring persona fidelity, defined as the extent to which an agent's behavior consistently reflects the psychological and stylistic characteristics of a target persona, has become a critical requirement. However, existing evaluation paradigms primarily rely on either holistic LLM-based judges, which are prone to "holistic appraisal hallucination'', or static psychometric inventories, which fail to capture the context-dependent fidelity required in dynamic dialogue. To address these limitations, we propose PRISM (Persona Reasoning with Inverse SFL-based Modeling), a psycholinguistically grounded framework that reformulates persona fidelity evaluation as a structured inverse inference task. Inspired by Systemic Functional Linguistics (SFL), PRISM decomposes persona fidelity into three functional dimensions: Task Framing, Interpersonal Stance, and Linguistic Style. It estimates dimension-specific evidence over a persona-conditioned label space and aggregates these signals into an interpretable and auditable evaluation process. Experiments show that PRISM yields more accurate and stable judgements than traditional holistic judging, providing a more reliable framework for persona fidelity evaluation.
69. 【2608.26650】Meta-Learning Where to Allocate Experts: Task-Conditioned Layer-Wise Compression for MoEs
链接：https://arxiv.org/abs/2608.26650
作者：Rongfeng Wang,Shichao Weng,Zhiqiang Wang,Xinyu Liu,Yang Yi,Peilong Zhou,Hongwei Tang
类目：Computation and Language (cs.CL)
关键词：per-token computation sparse, keeping per-token computation, models route, increasing capacity, computation sparse
备注： 18 pages, 3 figures, 9 tables
点击查看摘要
Abstract:Mixture-of-Experts (MoE) models route each token to a subset of expert networks, increasing capacity while keeping per-token computation sparse. In many deployed MoEs, the number of active experts is fixed across layers and tasks, although layer roles and expert redundancy vary with depth and demand varies with difficulty. Existing approaches address only part of this setting: layer-wise allocations are usually determined offline and reused for all tasks, while token-level methods vary expert activation using local routing signals without task-level context. We propose MetaNet, a support-set controller that predicts, for each layer, an expert-retention threshold and a bounded routing bias. The backbone, experts, and router remain frozen. On DeepSeek-MoE-16B-Chat, MetaNet provides a tunable accuracy-expert-activation trade-off. Relative to fixed k=6, a conservative setting activates 3.61 experts on average (40% fewer) and achieves comparable MMLU accuracy (0.489 vs. 0.474), whereas an aggressive setting activates 2.28 experts on average (62% fewer) with accuracy approximately 3.7 percentage points lower. The MMLU-trained controller also transfers to C-Eval without retraining, activating 2.90 experts on average (52% fewer than fixed k=6) at 0.386 accuracy.
70. 【2608.26641】Information-Guided Frontier Decoding: Contextual Utility-Driven Commitment in dMLLMs
链接：https://arxiv.org/abs/2608.26641
作者：Xingyou Fang,Jingxing Zhong,Xiaosong Yuan,Xiaofeng Zhang
类目：Computation and Language (cs.CL)
关键词：depends heavily, Decoding, multimodal language models, language models, IGFD
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Decoding quality in diffusion multimodal language models (dMLLMs) depends heavily on the order in which masked tokens are committed. Existing confidence-based strategies prioritize locally easy tokens, but confidence does not necessarily reflect contextual usefulness. As a result, structurally easy tokens such as punctuation may be committed before informative semantic anchors, weakening context propagation and increasing error accumulation. We propose Information-Guided Frontier Decoding (IGFD), a training-free decoding strategy that ranks candidates using token confidence, neighborhood uncertainty, and structural commitment risk. IGFD encourages early commitment of reliable semantic anchors while delaying fragile structural tokens, improving contextual support during decoding. A dynamic candidate frontier further constrains token selection to locally expandable regions under the same decoding budget. The method requires no additional training, auxiliary models, or extra forward passes. Experiments across multimodal understanding, reasoning, grounding, and hallucination benchmarks show that IGFD consistently outperforms existing decoding strategies across the majority of benchmarks and diffusion MLLM backbones under identical decoding budgets.
71. 【2608.26638】Which Metrics Save the Most Human Annotation? Prediction-Powered Evaluation and Meta-Evaluation
链接：https://arxiv.org/abs/2608.26638
作者：Mingqi Gao,Anthony Sicilia,Weiyan Shi
类目：Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：reliable but expensive, Prediction-Powered Saving Ratio, human, prediction-powered evaluation, prediction-powered
备注： Accepted at EMNLP 2026 (Main). Code available: [this https URL](https://github.com/CHATS-lab/ppi-eval)
点击查看摘要
Abstract:Across various non-verifiable tasks, human evaluation is reliable but expensive, while automatic metrics are more scalable but often biased. Building on prediction-powered inference (PPI), we propose prediction-powered evaluation, a framework that combines limited human judgments with large-scale automatic scores to obtain data-efficient system comparisons that are provably unbiased. We develop parametric and non-parametric procedures, analyze the efficiency trade-off between paired and unpaired designs, and validate the framework on six WMT datasets. We further introduce the Prediction-Powered Saving Ratio (PPSR), a meta-metric that measures how much human annotation an automatic metric can save when used within prediction-powered evaluation. PPSR directly targets metric utility for prediction-powered evaluation and yields more discriminative and stable metric rankings than existing system-level meta-metrics. Overall, our new paradigm reframes automatic metrics as tools for reducing human annotation cost rather than replacing human judgment, and applies broadly to non-verifiable tasks.
72. 【2608.26602】he Thousand-Graph Hypothesis: A Testable Hypothesis of Task-Conditioned Relation Materialization in Repository-Level Code Reasoning
链接：https://arxiv.org/abs/2608.26602
作者：Fei Ding
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：Large software repositories, model context limits, Large software, context limits, software repositories
备注： 9 pages, 2 figures,
点击查看摘要
Abstract:Large software repositories are often beyond model context limits. Training repository knowledge into models is costly and quickly stale, while local retrieval can miss scattered requirements, and explicit relation graphs add ongoing maintenance burden. We propose an entity-only external interface with task-conditioned relation materialization during inference. A two-layer index separates global routing from local entity focus and is evaluated on DeepSeek-V4-Flash and SWE-bench Verified. The base, one-layer, and two-layer conditions achieve 92.1%, 94.2%, and 95.6% success, respectively, under zero pre-built entity-relation edges.
73. 【2608.26596】Not Just Reason, Not Just Scan: Reinforcement Learning for Proactive Scientific Error Verification over Academic Paper
链接：https://arxiv.org/abs/2608.26596
作者：Rongjin Li,Yuanxin Liu,Hao Zhou,Fandong Meng,Jie Zhou,Xu Sun
类目：Computation and Language (cs.CL)
关键词：Multimodal large language, Multimodal large, large language models, capable scientific assistants, increasingly capable scientific
备注： Accepted by EMNLP 2026 Findings
点击查看摘要
Abstract:Multimodal large language models (MLLMs) are increasingly capable scientific assistants, yet they remain far from fully autonomous research. This transition requires models to actively inspect academic papers, build global evidence views, and make traceable judgments without prespecified issues or evidence. However, existing work provides limited task paradigms or training studies for such issue- and evidence-absent verification. We study this challenge through scientific error detection, where models must determine whether errors exist and justify them with evidence-based reasoning. To fill this gap, we present VERA-RL, a reinforcement-learning formulation for scientific error detection over academic papers. Following a Reason--Verify--Scan progression, we construct VERA-13K, a 12,900-sample dataset organized into 4,300 matched chains, covering 6 scientific-error categories across the research workflow and broad natural-science domains. We further introduce fine-grained rewards for reasoning completeness, evidence alignment, and error precision. Training Qwen3-VL-8B with VERA-RL substantially improves verifiable reasoning, approaching flagship MLLMs such as Gemini 3 Pro and Qwen3-VL-235B-A22B on Scan.
74. 【2608.26592】Benchmarking Clinical Decision Pathway Adherence in Large Language Models
链接：https://arxiv.org/abs/2608.26592
作者：Nuo Chen,Xinyang Jiang,Zilong Wang,Zhifei Zhang,Xiaoye Qu,Jiajun Deng,Yulan Guo,Cairong Zhao
类目：Computation and Language (cs.CL)
关键词：essential for safe, reliable medical decision-making, medical decision-making, clinical practice guidelines, clinical
备注：
点击查看摘要
Abstract:Following clinical decision pathways (CDPs) defined by clinical practice guidelines is essential for safe and reliable medical decision-making. However, existing medical large language model (LLM) benchmarks mainly evaluate final-answer accuracy, providing limited evaluation of models' ability to adhere to guidelines. To address this gap, we introduce MEGA-CDP, a benchmark for evaluating whether medical LLMs can generate guideline-adherent CDPs using provided guidelines as references. MEGA-CDP is constructed from 2,274 English and Chinese clinical practice guidelines through a guideline-to-case pipeline, yielding 42,353 clinical cases with explicit reference CDPs. It supports both single-turn vignette and multi-turn interactive settings, and introduces a CDP-oriented evaluation framework for measuring pathway consistency. Experiments on 16 representative LLMs show that reliable clinical decision support remains challenging for current models, demonstrating the need for CDP-oriented evaluation and the value of MEGA-CDP for advancing guideline adherence in medical LLMs.
75. 【2608.26587】Surgical Alignment in Knowledge Graph Training for Clinical Diagnosis with Large Language Models
链接：https://arxiv.org/abs/2608.26587
作者：Saksham Khatwani,He Cheng,Majid Afshar,Dmitriy Dligach,Yanjun Gao
类目：Computation and Language (cs.CL)
关键词：Biomedical knowledge graphs, offer structured medical, clinical diagnosis application, ground large language, large language model
备注：
点击查看摘要
Abstract:Biomedical knowledge graphs (KGs) offer structured medical knowledge that can ground large language model (LLM) reasoning in clinical diagnosis application, yet how KG signal should be integrated into LLMs remains an open question. We present a systematic study spanning five KG task formulations, three training paradigms, two KGs, and three base LLMs. At the task level, all paradigms improve over the non-finetuned baseline, but methods with comparable in-domain accuracy show substantially different knowledge transfer behavior. We introduce Gradient Intervention Density (GID) and Gradient Distortion (GD) to measure how broadly an optimizer modifies the pretrained model. GID and GD together reveal a clear divide: KG-judgment training under KL regularization produces sparse, localized updates (a regime we term as surgical alignment), while task-specific SFT produces dense ones. A controlled ablation shows that the objective and KL contribute to sparsity independently, and the paradigms that produce sparse updates also improve reasoning quality, even when their in-domain accuracy is lower than task-specific SFT. Assessing KG-LLM integration thus requires complementing accuracy with optimization-geometry diagnostics. Our implementation can be found at this https URL.
76. 【2608.26582】J-Zero: Unified Challenger--Solver--Judge Co-Evolution from Zero Data
链接：https://arxiv.org/abs/2608.26582
作者：Gyouk Chu,Myeongho Jeon,Eunho Yang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Self-evolving language models, Self-evolving language, path toward superintelligence, human supervision, language models
备注：
点击查看摘要
Abstract:Self-evolving language models have recently emerged as a promising path toward superintelligence, with the advantage of reducing the cost of human supervision. While considerable progress has been made in verifiable domains, self-evolution in unverifiable domains remains substantially less explored. We propose Judge co-adaptation from Zero data (J-Zero), a unified Challenger--Solver--Judge co-evolution framework that supports self-improvement across both domains. The Challenger and Solver co-evolve through an adversarial interaction: the Challenger generates increasingly difficult tasks, while the Solver learns to produce higher-quality responses to them. In parallel, the Judge co-adapts using preference pairs whose ordering is known in advance from how each response was produced, i.e., the Solver's answer over the Challenger's, and its decomposed-and-recombined answer over its one-shot answer, rather than from the Judge's own scores. J-Zero outperforms the baselines by an average of 4.2 points on verifiable and 8.0 points on unverifiable domains, and continues to improve through at least ten iterations, whereas the baselines degrade after two.
77. 【2608.26580】Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models
链接：https://arxiv.org/abs/2608.26580
作者：Insu Lee,Wooje Park,Wonseok Shin,Jinwoo Son,Byonghyo Shim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Diffusion multimodal large, multimodal large language, large language models, Diffusion multimodal, multimodal generation
备注：
点击查看摘要
Abstract:Diffusion multimodal large language models (dMLLMs) have recently emerged as a new decoding paradigm for multimodal generation. Starting from a fully masked sequence, dMLLMs progressively decode the sequence by unmasking a subset of the remaining masked positions at each step. Since the selected tokens serve as the prediction context for subsequent steps, deciding which tokens to decode is crucial to the quality of the final output. The most common strategy prioritizes tokens based on a certainty measure that tends to favor tokens frequently observed in the training data. Recent approaches instead order tokens according to their influence on subsequent predictions, but do not explicitly account for the input image. We propose the Visual Information-Guided Sampler (VIG-Sampler), which prioritizes tokens based on their attention to image tokens. We further impose a constraint that penalizes candidate tokens whose image-attention distributions are similar to those of previously selected tokens, thereby increasing the information gain of the decoded subset. Extensive experiments on 7 captioning and VQA benchmarks with 3 open-source dMLLMs demonstrate the effectiveness of VIG-Sampler, which outperforms the Info-Gain Sampler by an average of 19.3 CIDEr points across the captioning benchmarks and surpasses it on COCO Caption while using only half as many decoding steps.
78. 【2608.26576】Double Trouble: Bilingual Pretraining Leaves Language-Conditioned Effects in Shared-Language Representations
链接：https://arxiv.org/abs/2608.26576
作者：Anjishnu Mukherjee,Ziwei Zhu,Antonios Anastasopoulos
类目：Computation and Language (cs.CL)
关键词：researchers compare multilingual, compare multilingual models, align embedding spaces, cross-lingual transfer, researchers compare
备注： Published as a conference paper at EMNLP 2026 (Main)
点击查看摘要
Abstract:When researchers compare multilingual models for probing, interpretability, or cross-lingual transfer, they often align embedding spaces and assume that shared-language representations are comparable. We show that this assumption can be premature for decoder-only models. We pretrain paired 310M-parameter models (one English-only, one bilingual) across eight typologically diverse languages, separately controlling for English exposure, total compute, and document overlap. After aligning on shared English vocabulary, we test held-out words and find that token embeddings look similar after alignment, but the deeper hidden states that the model uses for prediction do not. This gap holds for all eight languages and survives controls for document overlap and alternative alignment methods. This hidden-state mismatch grows through middle transformer layers, suggesting that it arises from contextual processing rather than the input representations where alignment is performed. Embedding alignment can mask real differences in how models internally represent a shared language, which matters for any downstream study that treats aligned models as interchangeable.
79. 【2608.26574】Dependency-Aware Revocable Decoding for Efficient Diffusion Large Language Model Inference
链接：https://arxiv.org/abs/2608.26574
作者：Wooje Park,Insu Lee,Minyoung Noh,Jaeyun Jang,Sungmin Lee,Kyuhong Shim,Byonghyo Shim
类目：Computation and Language (cs.CL)
关键词：Diffusion large language, large language models, Diffusion large, language models, offer a promising
备注：
点击查看摘要
Abstract:Diffusion large language models (dLLMs) offer a promising alternative to autoregressive generation by decoding multiple tokens in parallel through iterative denoising. However, increasing decoding parallelism often degrades generation quality, as early errors can contaminate later contexts. Revocable decoding mitigates this issue by re-evaluating decoded tokens and remasking unreliable ones, but existing methods overlook that unreliable tokens may also corrupt the verification context itself. We identify this failure mode and propose Dependency-Aware Revocable Decoding (DARD), a training-free framework that separates tokens into masked, candidate, and unmasked states. DARD verifies candidate tokens using a selective context that excludes less reliable tokens and adaptively regulates their influence on subsequent decoding. Experiments across 12 textual and multimodal benchmarks on 3 open-source dLLMs show that DARD consistently improves the speed-quality Pareto frontier over recent revocable decoding methods, achieving a 2.71$\times$ speedup and a 4.35-point CIDEr score gain over Saber on Flickr30K.
80. 【2608.26563】SPT: Skills as Pre-Training Data for Agentic Language Models
链接：https://arxiv.org/abs/2608.26563
作者：Yufei Sun,Yudong Li,Yiming Cheng
类目：Computation and Language (cs.CL)
关键词：trained on tool-call, tool-call traces, traces and agent, agent trajectories, data
备注：
点击查看摘要
Abstract:Agentic (tool-using) language models are mainly trained on tool-call traces and agent trajectories during post-training. These data provide direct behavioral supervision, but producing them requires task environments, execution, and verification, making broad tool and task coverage expensive. Publicly available skills offer another source of training data: they encode reusable tool semantics and workflows but are typically used only as inference-time context. We introduce Skill Pre-Training (SPT), a mid-training method that applies causal language modeling to SkillCorpus, a collection of public multi-file skill packages, optionally mixed with general data. To preserve relations among files within each package, we also introduce Reference Insert, a reference-aware assembly strategy that places supporting files near their mentions in the primary instruction. Experiments across multiple model scales and post-training recipes show that SPT consistently improves agentic performance over mid-training on general or trajectory data, while largely preserving general performance. Data mixture experiments show additional benefits from combining skill data with general annealing corpora. These results indicate that skill packages are a valuable data source for pre-training agentic language models.
81. 【2608.26550】SPEAR: Distilling Domain-Adaptive Reasoning Skeletons via Sequential Symbolic Alignment in Reinforcement Learning
链接：https://arxiv.org/abs/2608.26550
作者：Zhuochun Li,Yuelyu Ji,Yiming Zeng,Daqing He
类目：Computation and Language (cs.CL)
关键词：Reinforcement learning-based knowledge, Reinforcement learning-based, sparse outcome-based rewards, insufficient logical guidance, Symbolic Process Evaluation
备注：
点击查看摘要
Abstract:Reinforcement learning-based knowledge distillation has the potential to transfer complex reasoning from teacher to student models, yet it currently faces a critical dilemma: researchers must choose between sparse outcome-based rewards, which provide insufficient logical guidance, or expensive neural Process Reward Models (PRMs) for dense signals. We resolve this by introducing SPEAR (Symbolic Process Evaluation and Alignment Reward), a training-free and plug-and-play process reward method for sequence-level on-policy distillation. SPEAR projects natural-language reasoning traces into domain-adaptive symbolic milestones, providing an efficient proxy for process-level reasoning alignment. By utilizing the longest common subsequence (LCS) to align student explorations with teacher milestones, SPEAR provides a dense, order-aware reward signal that enforces logical consistency without the need for an external neural verifier. Our experiments across math, science, and commonsense reasoning tasks demonstrate that SPEAR effectively bridges the reasoning gap between student and teacher models via sequence-level distillation with efficient dense process rewards. Our code and data are available at: this https URL.
82. 【2608.26546】DuMateBench: Evaluating Autonomous Agents in Complex Real-World Workflows
链接：https://arxiv.org/abs/2608.26546
作者：Zechun Niu,Yukun Zhao,Jiaxin Zhang,Xu Shen,Jinhua Si,Han Tian,Can Xu,Yunfan Song,Jiaxin Mao,Yansong Gao,Yuchen Li,Jianmin Wu,Lingyong Yan,Shuaiqiang Wang,Dawei Yin
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Autonomous agents, complete complex, multi-tool workflows, increasingly adopted, adopted to complete
备注：
点击查看摘要
Abstract:Autonomous agents are increasingly adopted to complete complex, multi-tool workflows in real-world settings. However, existing benchmarks typically separate tasks by application or capability and evaluate agents in environments that are cleaner and more stable than those encountered in practice. We introduce DuMateBench, a real-session benchmark reconstructed from anonymized and privacy-screened user sessions collected from a large-scale production agent platform. Each task preserves the relevant pre-solution interaction history, persistent configurations, and workspace state, and is then validated through human verification. The resulting benchmark comprises 200 tasks spanning 8 broad scenarios and 17 fine-grained capability categories, with most tasks requiring multiple capability coordination. We execute these tasks in isolated Docker containers injected with three forms of real-world environmental complexity: Insufficient, Unstable, and Noisy, and assess performance using a hybrid deterministic and LLM-as-Judge evaluation protocol. Experiments across five representative autonomous-agent frameworks paired with four state-of-the-art LLMs reveal substantial gaps in strict task completion. Complementary robustness, efficiency, and diagnostic analyses further show that performance under environmental perturbations is jointly shaped by the capabilities of the LLM and the surrounding agent framework. The code and data are publicly available at this https URL.
83. 【2608.26529】Multi-Expert Conformal Risk Control for Pairwise LLM Judging in Open-Ended Dialogue
链接：https://arxiv.org/abs/2608.26529
作者：Ming Cheng,Yusheng Dai,Qiuhong Ke,Zhaolin Chen,Lizhen Qu
类目：Computation and Language (cs.CL)
关键词：CRC controls risk, Conformal Risk Control, algorithms for pairwise, explore multi-expert Conformal, multi-expert Conformal Risk
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:In this paper, we explore multi-expert Conformal Risk Control (CRC) algorithms for pairwise LLM-as-a-Judge evaluation in open-ended dialogue. Our core insight is that multi-expert aggregation offers a complementary remedy to CRC: whereas CRC controls risk at the decision threshold through abstention, aggregation sanitizes the scoring function at its source. Guided by this, we first design two multi-expert CRC methods: Score Averaging and Decision Voting, which aggregate at the score and decision levels, respectively. While both strategies outperform single-expert methods on homogeneous expert panels, on heterogeneous LLM judges they remain risk-valid but recover only limited coverage, because a uniform threshold cannot match the experts' distinct scoring scales. To resolve this issue, we further propose Marginal-Calibrated Conformal Consensus (MC3): it captures distinct per-expert scales via initial threshold ratios, while jointly tuning a unified decision function $C_t(x)$ applied identically in both calibration and test, thereby preserving exchangeability. To evaluate our framework, we construct Panel, a 1,800-pair human pairwise-preference benchmark for open-ended dialogue. It is built on responses generated by four open-weight LLMs over dialogue contexts from three domains (ESConv, MSC, DREAM), with full logit access. In experiments, we find that both Score Averaging and Decision Voting substantially improve accuracy and acceptance rate on homogeneous panels. Notably, MC3 extends these gains to heterogeneous panels by accommodating distinct per-expert scoring scales across all three datasets.
84. 【2608.26511】Sycophancy Suppression Can Impair Rational Updating: Anti-Sycophancy Should Preserve the Ability to Update
链接：https://arxiv.org/abs/2608.26511
作者：Huanhuan Ma,Henry Peng Zou,Chengze Li,Enze Ma,Yunyue Su,Philip S. Yu
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, users push back, exhibit sycophancy, push back
备注： Accepted to EMNLP 2026 Findings. Code and data: [this https URL](https://github.com/dependentsign/sycophancy-rational-updating)
点击查看摘要
Abstract:Large language models often exhibit sycophancy, revising their answers to align with users when users push back. Such answer flips, however, can arise from different causes. One possibility is that the model simply aligns with the user's feedback in order to satisfy them. Another is that the feedback genuinely contains useful evidence, prompting the model to update its answer in a rational way. We distinguish them as Unsupported-Yielding and Rational-Updating. Prior work focuses primarily on suppressing Unsupported-Yielding, while overlooking its effect on Rational-Updating. We address this gap with a two-turn evaluation framework that measures the two behaviors separately. Across representative training-time and inference-time interventions, we find that anti-sycophancy methods often encounter a trade-off in which reducing Unsupported-Yielding can sacrifice Rational-Updating, and vice versa, even when the two objectives are optimized jointly. Mechanistic analysis suggests that the two behaviors share an internal substrate: the MLP neurons and attention heads driving them overlap substantially, and their associated steering directions are positively aligned. We further conduct a preliminary orthogonalized steering exploration, which yields modest, backbone-dependent selectivity gains. Overall, our results suggest that anti-sycophancy should be treated not as a simple suppression problem, but as a selectivity problem, where effective interventions should preserve Rational-Updating while reducing Unsupported-Yielding.
85. 【2608.26506】A Single Suffix to Break Them All: Basin-Aware Jailbreaks for Merged Model Families
链接：https://arxiv.org/abs/2608.26506
作者：Yu Zhe,Yixin Tan,Junhao Wei,Wang Chen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：enables combining multiple, combining multiple fine-tuned, multiple fine-tuned models, remain poorly understood, merging enables combining
备注： Accepted by EMNLP findings 2026
点击查看摘要
Abstract:Model merging enables combining multiple fine-tuned models without additional training, but its safety implications remain poorly understood. Prior work primarily attributes merging risks to unsafe constituent models, implicitly assuming that merging individually aligned models preserves safety. In contrast, we show that model merging reveals a previously overlooked jailbreak risk rooted in the pretrained foundation model, even when all constituent models are individually safety-aligned. Motivated by this observation, we study a new threat setting where an attacker constructs jailbreak prompts that generalize across merged models sharing the same pretrained backbone, without access to the exact merging coefficients or constituent checkpoints. To exploit this phenomenon, we propose \textbf{Basin-Aware Jailbreak (BAJ)}, which formulates jailbreak generation as a min--max optimization over the merging space to produce transferable adversarial suffixes across merged model families. Experiments across diverse backbones and merging settings show that BAJ achieves consistently high transfer success rates and remains effective under existing defenses.
86. 【2608.26480】Zero-Shot Self-Orchestration with Ledger-Based Control for Improved LLM Coding Performance
链接：https://arxiv.org/abs/2608.26480
作者：Victor Gao,Vida Khosrowshahi,Ali Khosrowshahi,Xihao Sun,Juhyun Lee,Simon(Sang Won)Lee
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Multi-agent large language, beat single-model baselines, language model systems, change token budgets, pipelines change token
备注：
点击查看摘要
Abstract:Multi-agent large language model systems are widely reported to beat single-model baselines, but the evidence is mixed, and comparisons are usually confounded: pipelines change token budgets, tool calls, and prompts simultaneously, so an aggregate gain rarely reveals what actually helped. We investigate the effect of introducing the manager-worker scaffold over a shared filesystem workspace, with no training and no per-benchmark tuning, measured against the same model answering in a single pass. Across nine models -- five open-weight, spanning 9B to ~2.8T parameters, and four frontier closed models -- on the 100 latest hard LiveCodeBench problems, the scaffold's benefit is real but conditional: large and statistically significant for some (Qwen3.8-27B +23.4, GPT-5.6-Luna +10.6 and GPT-5.6-Terra +8.0, each over five paired passes; Kimi-K3 +30.4 and Minimax-M3 +11.0 over five paired passes with reasoning off, both at $p 10^{-4}$, and +42 and +12 in a single pass at a 128k cap) and null or negative for others (Qwen3.6-35B -1 to -9 with reasoning off). With the manager, Opus-5 achieves the highest score in the study at 91% in one pass. Running a manager roughly triples the token bill, but it buys accuracy more cheaply than moving to a larger model does: GPT-5.6-Terra with a manager nearly matches Fable 5's single-call accuracy (85.0 against 87.4, $p = 0.59$) at a fifth of the price (\$11.71 against \$61.11 per 100-problem pass, $p 10^{-4}$), and the Qwen-27B arm does it for \$51.75 on weights anyone can self-host. Our transcript analysis finds several mechanisms behind the gains, of which two recur: context management, in which short worker calls and shared notes organize state and reduce truncation, and problem decomposition. Improvements are modest for large models with reasoning enabled, but larger for some models with reasoning disabled and for smaller models with reasoning enabled.
87. 【2608.26465】Compositional Generalization via Structural Identification in a Category-Theoretic Framework
链接：https://arxiv.org/abs/2608.26465
作者：Akihiro Maeda,Thomas Seiller,Yohei Oseki
类目：Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：Compositional generalization, Compositional, Abstract, model accuracy, accuracy
备注： 11 pages
点击查看摘要
Abstract:Compositional generalization is usually evaluated through model accuracy. We instead ask which structural or lexical identifications make held-out COGS examples admissible from the structures observed in training. Sentences are represented as functors from syntactic addresses to lexical tokens, and selective collapses induce Kan extensions that propagate observed associations. Across 21 COGS generalization types, admissibility follows distinct identification profiles, while residual failures separate unsupported structural templates. These data-side diagnoses characterize what the training corpus licenses under specified identifications, without training a predictive model.
88. 【2608.26462】Diff Mining: Logit Differences Reveal Finetuning Objectives
链接：https://arxiv.org/abs/2608.26462
作者：Greg Kocher,Robert West,Clément Dumas,Julian Minder
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Diff Mining, refining existing behaviors, gold standard, standard for refining, remains unclear
备注： 37 pages, 7 figures. ICLR 2026 Workshop: Principled Design for Trustworthy AI. Code available at [this https URL](https://github.com/science-of-finetuning/diffing-toolkit)
点击查看摘要
Abstract:Finetuning has become the gold standard for refining existing behaviors and inducing new ones in language models, yet it often remains unclear exactly which behaviors emerge during this process. As models grow ever more capable, understanding finetuning better becomes increasingly important, particularly since unwanted behaviors may arise during finetuning. In this paper, we introduce Diff Mining, a simple yet effective framework for identifying what a finetuned model has learned by comparing its logits to those of its base model. Diff Mining effectively surfaces salient tokens that are amplified in the finetuned model, serving as a fingerprint of its training -- even on text unrelated to the finetuning domain. Unlike many existing model diffing methods which require model internals, Diff Mining only needs access to output logits and scales to large models. The framework consists of two modular stages: (i) extracting per-context logit differences between the finetuned and base models on a reference corpus, and (ii) aggregating the resulting signals to construct an interpretable token set representing the finetune. For aggregation, we explore both a simple Top-K frequency method and a Non-negative Matrix Factorization (NMF)-based approach for disentangling multiple finetuning objectives into distinct token clusters. Empirically, Diff Mining succeeds across diverse settings: on finetune domain detection, it significantly outperforms state-of-the-art model diffing methods both in identifying relevant tokens and in downstream performance when an interpretability agent is given access to the extracted token set; on models with injected biases, it identifies more than one third of the biases without targeted probing. Overall, our framework shows promise in developing auditing tools to detect finetuning objectives.
89. 【2608.26449】Vowel Signs Are Not Letters: A Pre-tokenization Ceiling on Multilingual Tokenizer Fertility
链接：https://arxiv.org/abs/2608.26449
作者：Sajal Regmi,Siddhartha Pudasaini,Chetan Phakami Pun
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：ByteLevel pre-tokenizer inherit, Byte-level BPE tokenizers, Unicode letters, Byte-level BPE, HuggingFace ByteLevel pre-tokenizer
备注： 14 pages, 2 figures, 12 tables. Code, tokenizer and reproduction harness: [this https URL](https://github.com/sajalregmi/arkios-tokenizer) and [this https URL](https://huggingface.co/sajalregmi4/arkios-tokenizer)
点击查看摘要
Abstract:Byte-level BPE tokenizers that use the HuggingFace ByteLevel pre-tokenizer inherit GPT-2's word regex, where a word is defined as \p{L}+, one or more Unicode letters. In abugida scripts, vowels are written as combining marks; this pattern therefore splits each word at every vowel sign. Since BPE merges only within a pre-token, those splits persist through training regardless of vocabulary size or corpus composition. We formalise this effect as a training-free lower bound on fertility. Across 26 languages from a parallel corpus, every one of the 17 abugidas is affected, ranging from 1.47x (Tibetan) to 9.02x (Thai), whereas Latin, Cyrillic, Hangul, and Han show exactly 1.00x. For 5 languages, matched tokenizer pairs that differ only in this character class fall within 2.2% of the predicted floor, scoring 4.78 versus 1.58 tokens per word on Nepali. When the Nepali share of the training corpus is swept from 5% to 95%, the broken tokenizer barely shifts at all (1.7%) while the fixed one shifts 33.9%, which separates a structural ceiling from a data shortage without needing to inspect any code. We train three 268M models that differ only in their tokenizer; the fixed variant achieves 4.43% lower held-out Nepali bits per byte at equal compute, and it still leads when given the same bytes with 1.59x the compute. A census of 3,479 HuggingFace repositories finds the letters-only word class present in 63.3% of the most-downloaded text-generation models, accounting for 72.5% of their downloads. GPT-4o's o200k pattern already uses a mark-aware word class, making the repair itself prior art. We quantify its value, show how to recognise its absence from symptoms alone, map which scripts it reaches, measure how widely it is deployed, and release a 65,536-entry Nepali-English tokenizer with a harness that regenerates every number here from public data on a laptop.
90. 【2608.26442】Don't Overthink, Don't Underthink: Toward Adaptive Reasoning in Agentic AI
链接：https://arxiv.org/abs/2608.26442
作者：Md Jueal Mia,M. Hadi Amini
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Recent advances, advances in Large, Large Language, improve performance
备注：
点击查看摘要
Abstract:Recent advances in Large Language Models (LLMs) have shown that increased inference-time reasoning can improve performance on complex tasks. However, many existing approaches rely on fixed or preallocated reasoning controls, such as fixed token budgets, pre-execution difficulty estimates, or activation-space interventions, and are often evaluated on standalone reasoning benchmarks rather than full agentic workflows. These assumptions may not hold in agentic AI systems, where reasoning requirements evolve dynamically through planning, tool use, memory retrieval, and agent-to-agent interactions. Consequently, reasoning can become either excessive or insufficient, resulting in unnecessary computation, increased latency, planning drift, excessive tool use, or incomplete solutions. We argue that a major challenge for next-generation agentic AI is not merely how much reasoning a language model should perform, but how it should allocate reasoning according to evolving task demands. We characterize over-reasoning and under-reasoning as recurring failure modes of misallocated reasoning and evaluate them on MATH-500 and the GAIA public validation benchmark. Using tool-decision latency, token consumption, token-limit exhaustion, and answer correctness, our results suggest that cases classified as over-reasoning are associated with higher computational cost without proportional accuracy gains, whereas cases classified as under-reasoning are consistently associated with incorrect or incomplete solutions. These findings motivate future research on adaptive reasoning mechanisms for agentic AI.
91. 【2608.26434】AfriSwitch: A Benchmark for In-the-Wild African Code-Switched Speech Recognition
链接：https://arxiv.org/abs/2608.26434
作者：Gabrial Zencha Ashungafac,Busayo Awobade,Tobi Olatunji
类目：Computation and Language (cs.CL)
关键词：bilingual African conversation, Code-switching is pervasive, assume monolingual input, ASR systems assume, African conversation
备注：
点击查看摘要
Abstract:Code-switching is pervasive in bilingual African conversation, yet most ASR systems assume monolingual input and are evaluated on curated monolingual benchmarks. We present AfriSwitch, a 61.36-hour human-transcribed benchmark of in-the-wild code-switched speech spanning 16 African languages and language varieties, released with switch-level English span tags, perutterance Code-Mixing Index (CMI), and switch-point counts. Corpus statistics show that mixing behaviour varies widely across African languages along two largely independent axes: how often speakers alternate, and how balanced the mixture is. No single scalar captures how code-switched a language is. Benchmarking five open and commercial multilingual ASR systems zero-shot yields word error rates far above published monolingual figures for the same languages, with the best system averaging 35.93% WER and no system falling below 24% on any language. Africa-targeted training, not model scale or nominal language coverage, best predicts performance.
92. 【2608.26432】SpeechGym: An Audio-Native Gym for Training Voice Agents via Reinforcement Learning
链接：https://arxiv.org/abs/2608.26432
作者：Jiajun Fan,Jingyuan Li,Prashanth Gurunath Shivakumar,Jia-Hong Huang,Qi Luo,M. Maruf,Ivan Bulyko,Ge Liu,Roger Ren
类目：ound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：hold multi-turn dialogue, dominant paradigm trains, proprietary voice API, hold multi-turn, multi-turn dialogue
备注：
点击查看摘要
Abstract:Voice agents must call tools and hold multi-turn dialogue entirely through speech, yet the dominant paradigm trains them in text. Existing frameworks either cascade TTS and ASR around a proprietary voice API, where gradients cannot flow and per-call cost makes on-policy reinforcement learning prohibitive, or stay in text: they measure voice agents but cannot improve them. We present SpeechGym, an audio-native agentic environment in which two omni-modal models converse in native audio, with no external ASR or TTS and no API boundary, over the unmodified tasks, tools and success check of an established text agentic benchmark, so that the interaction modality is the only variable and the loop stays local and trainable end to end. Audio agentic capability does not follow from audio understanding. The failures speech introduces are perceptual rather than reasoning deficits: the agent picks the right tool and the right argument slot but fills it with a value misheard from the waveform, and that single error cascades into a failed call, a retry of the same call, and a wasted step budget. A second failure is behavioural: under an insistent caller the agent performs an unauthorised write and ends the episode believing it helped. Both are trainable, because the environment labels them for free: a call with a misheard argument fails against the database while a correct one succeeds. The obstacle is sparsity, not signal. Outcome-only GRPO is gradient-starved here, since almost every rollout group fails identically, while a per-turn process reward crediting each successful tool call restores variance to nearly every group. Trained this way, the agent transfers with no further tuning to an independently implemented voice benchmark, more than doubling task success and carrying an open-weights model from last place to second on that leaderboard, while using fewer turns and tokens than before training.
93. 【2608.26423】he Latent Diagnostic Taxonomy: A Framework for Constructing Classifiers and Diagnosing Their Decisions, Applied to Prompt Injection Detection
链接：https://arxiv.org/abs/2608.26423
作者：Jaturong Kongmanee,Smile Thanapattheerakul
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Latent Diagnostic Taxonomy, Diagnostic Taxonomy, safeguard layer, paper proposes, developing a complementary
备注： 10 pages, 5 figures
点击查看摘要
Abstract:This paper proposes a framework for constructing a classifier as a safeguard layer, and for developing a complementary diagnostic that identifies which of the classifier's confident decisions can be trusted. This framework, the Latent Diagnostic Taxonomy, consists of (i) constructing a dimensionality-optimized classifier, in which the embedding dimensionality is empirically selected via cross-validated performance rather than fixed a priori, (ii) locating a relatively small set of latent support vectors (~ 29% of total training examples) representing influential prompts for identifying tokens that alter the classifier's predicted labels, and (iii) utilizing such tokens and their associated attack magnitudes for constructing a diagnostic taxonomy. This diagnostic taxonomy provides an end-to-end guideline for flagging prompts that require different treatments: rely Safely on the classifier's decision; flag Heuristic Bias and Heuristic Override cases; route Insufficient Context cases for further human/safety review. Applying the framework to a classifier trained on a public prompt injection dataset, we find that a substantial fraction of its confident decisions (~ 77%) are not robust to removing a single token, and that this brittleness separates into two distinct failure patterns: a confidence calibration failure and a genuinely exploitable shortcut. For each zone of the taxonomy, we also recommend strategies for remediating diagnosed prompts. We illustrate the framework as a series of steps, demonstrating how each step operates.
94. 【2608.26414】Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval
链接：https://arxiv.org/abs/2608.26414
作者：Jiale Wei,Yufan Chen,Alexander Jaus,Zdravko Marinov,Julian Friedrich,Simon Reiß,Jens Kleesiek,Rainer Stiefelhagen
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：covering plausible diseases, evidence-based decision logic, specific decision artifact, guidelines covering plausible, guidelines encode rich
备注： Accepted by EMNLP 2026 Main
点击查看摘要
Abstract:Medical guidelines encode rich, evidence-based decision logic, yet the specific decision artifact a clinician needs is hard to locate within a guideline, let alone across guidelines covering plausible diseases and treatments. While guideline passages have supported end-to-end question answering, flowcharts remain largely underused in decision support despite their ability to encode actionable clinical pathways. We therefore introduce Case2Flow, a task designed to retrieve the most relevant guideline flowchart for a given patient case from a collection of guideline documents. To support it, we construct FlowAtlas, a curated corpus of 202 flowcharts extracted from 2,080 medical guidelines, together with a pipeline that synthesises 1,911 aligned case-flowchart pairs. Our evaluation of multimodal retrieval methods reveals systematic failure modes, including overreliance on keywords and spurious token-patch matches induced by uninformative background regions in flowcharts. Motivated by this, we propose CRISP, a training-free scoring method that sharpens late-interaction retrieval by suppressing uninformative patches, discounting ambiguous token matches, and incorporating bidirectional query-image alignment. CRISP improves Recall@1 by up to 18.71 percentage points, while a blinded physician assessment on published case narratives provides preliminary feasibility evidence beyond synthetic queries.
95. 【2608.26389】LowRankArena: A Standardized Evaluation Platform for SVD-Based LLM Compression
链接：https://arxiv.org/abs/2608.26389
作者：Zishan Shao,Lixun Zhang,Kangning Cui,Wenhao Wu,Jinhee Kim,Yixiao Wang,Ting Jiang,Hancheng Ye,Qinsi Wang,Fan Yang,Danyang Zhuo,Yiran Chen,Hai Li
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, language models, fast-growing direction, direction for reducing, reducing the memory
备注：
点击查看摘要
Abstract:SVD-based low-rank compression has become a fast-growing direction for reducing the memory and computational cost of large language models (LLMs). However, meaningful comparison across existing studies remains difficult as prior evaluations use varied benchmarks, inconsistent ratios, and diverse setups, often failing to isolate low-rank effects from auxiliary techniques. As a result, it remains unclear whether reported gains reflect method-level improvements or differences in evaluation protocol. This lack of comparability highlights the need for a unified, reproducible evaluation platform. To address this problem, we present LowRankArena, a standardized evaluation platform for SVD-based LLM compression. LowRankArena unifies task versions, uniform-precision compression budgets, comparison regimes, and inference measurements, and provides a reproducible pipeline with over 3 TiB released compressed checkpoints. Using LowRankArena, our aligned audit of five representative SVD methods reveals that prior findings are highly conditional under standardized protocols: clear leaders and performance tiers shift across backbones and keep ratios, multiple-choice accuracy can hide large perplexity degradation, and nominal low-rank savings yield workload-dependent and often limited end-to-end speedups. Our code is available at: this https URL.
96. 【2608.26386】Co-Evolving Structured Knowledge and Reasoning in Language Models
链接：https://arxiv.org/abs/2608.26386
作者：Ryan Thomas Noonan,Linxi Zhao,Menghan Xu,Akanksha Sarkar,Mihir Mishra,Dongyoung Go,Kilian Q. Weinberger,Yoav Artzi,Jennifer J. Sun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：grounding language models, introduces irrelevant context, offers limited control, Retrieval-augmented methods improve, retrieved information
备注： COLM2026. Code available at [this https URL](https://github.com/kilian-group/KBevo)
点击查看摘要
Abstract:Retrieval-augmented methods improve factual accuracy by grounding language models in external knowledge, but retrieving over unstructured text often introduces irrelevant context and offers limited control over the retrieved information. Structured knowledge bases offer a more controllable alternative, yet they are expensive to construct and often brittle to reason over. To address these limitations, we propose KBevo: a co-evolving framework that jointly learns to construct a structured knowledge base and reason over it for knowledge-intensive question answering. By optimizing both components end-to-end with QA outcome rewards, our method enables reasoning success to directly improve the quality of the constructed knowledge base. This leads to larger, better-connected knowledge structures with higher answer reachability, while also improving compositional factual reasoning and controllability compared to standard retrieval baselines.
97. 【2608.26385】Why RAGs Hallucinate: Penalty-Aware Evaluation of Retrieval-Augmented Generation Systems with Knowledge-Gap Canaries
链接：https://arxiv.org/abs/2608.26385
作者：Alden Do Rosario,Hussein Younes,Felipe Pires
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：rewards retrieval-augmented generation, accuracy rewards retrieval-augmented, rewards retrieval-augmented, Volume-based accuracy rewards, knowledge base
备注： 13 pages, 1 figure, 5 tables. Code, full per-request logs, and all judge votes: [this https URL](https://github.com/adorosario/why-rags-hallucinate)
点击查看摘要
Abstract:Volume-based accuracy rewards retrieval-augmented generation (RAG) systems for guessing: a system that answers everything outscores one that declines when its knowledge base cannot support an answer. Building on the confidence-target analysis of Kalai et al. (2025), we present a penalty-aware evaluation framework for deployed RAG products, combining (i) asymmetric scoring (correct +1, wrong -4, abstain 0), (ii) knowledge-gap canaries, questions whose answers are verifiably absent from the knowledge base, so that any answer constitutes ungrounded generation from parametric memory, and (iii) a failure-attribution pipeline that separates retrieval, generation, and abstention-policy failures. Applying the framework to three commercial RAG systems and a no-retrieval baseline on SimpleQA-Verified (1,000 questions x 3 repeats, graded blind by a cross-family three-judge panel with 98.9% unanimity), we find that accuracy when answering is closely clustered across systems (97.0-98.0%), while canary violation rates differ roughly sixfold (16.7% vs. 98.1%). The systems are separated less by what they answer correctly than by whether they answer at all when they should not, and penalty-aware scoring reorders the volume-based ranking accordingly; the reordering is stable across penalty settings from k=1 to k=9. All code, configurations, transcripts, and judge votes are released for independent audit.
98. 【2608.26379】Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG
链接：https://arxiv.org/abs/2608.26379
作者：Utshab Kumar Ghosh,Debayan Mukhopadhyay,Shubham Chatterjee
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Retrieval, increasingly designed, topical relevance, Retrieval evaluation, evidence
备注：
点击查看摘要
Abstract:Retrieval evaluation for retrieval-augmented generation (RAG) is increasingly designed around whether retrieved passages contain evidence that can support generation, rather than topical relevance alone. We study whether this closer alignment with downstream evidence needs also makes retrieval evaluation more useful for the decisions built from it. Across five retrieval benchmarks and an end-to-end TREC RAG 2025 setting, we examine an answer-support signal in four roles: comparing retrievers, guiding retrieval training and system selection, predicting downstream answer quality, and filtering the evidence supplied to a generator. The signal changes retrieval rankings, but its downstream value is not uniform. It does not reliably improve retriever training; the benefit of using it for system selection depends on how the generator is instructed to use the retrieved evidence; and retrieval scores based on it do not robustly predict answer quality on unseen topics. In a direct evidence intervention, human annotators confirm that filtering preferentially preserves passages containing useful answer evidence, yet different answer evaluators reach different conclusions about whether the resulting answers improve. These results show that making retrieval evaluation more closely reflect the evidence needed for generation does not by itself make every downstream use of that evaluation more reliable. RAG evaluation methods should therefore be assessed with respect to the particular comparisons, decisions, and conclusions they are intended to support.
Subjects:
Information Retrieval (cs.IR); Computation and Language (cs.CL)
Cite as:
arXiv:2608.26379 [cs.IR]
(or
arXiv:2608.26379v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.26379
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
99. 【2608.26374】Survival-Guided Length Control for Efficient Diffusion Language Models
链接：https://arxiv.org/abs/2608.26374
作者：Ivan Kobyzev,Abbas Ghaddar,Yufei Cui
类目：Computation and Language (cs.CL)
关键词：unnecessary denoising steps, hoc stopping rules, Diffusion language models, denoising masked sequences, iteratively denoising masked
备注： EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Diffusion language models (DLMs) generate text by iteratively denoising masked sequences, but standard decoding either fixes the sequence length or relies on ad hoc stopping rules, often leading to unnecessary denoising steps. We recast length selection as a discrete-time survival problem over the end-of-sequence token and propose a plug-in, training-free length predictor that can be added to any existing DLM. Across reasoning and code-generation benchmarks, survival-guided length decoding speeds up inference by up to 7 times while preserving task accuracy. We further find that predicted lengths vary widely even within the same dataset, making model performance sensitive to the chosen length.
100. 【2608.26372】Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentives
链接：https://arxiv.org/abs/2608.26372
作者：Zheyuan Liu,Weiliang Zhao,Xiangchi Yuan,Ningshan Ma,Yue Huang,Meng Jiang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, autonomous agents serving, agents serving users, behalf of companies
备注： A benchmark for knowledge-verified emergent deception in LLM agents under conflicting incentives
点击查看摘要
Abstract:Large language models are increasingly deployed as autonomous agents serving users on behalf of companies, placing them in settings where user and deployer interests can conflict. When an agent knows that a user is owed something its deployer would prefer to deny, does it remain honest? Answering this is difficult because false statements can reflect either ignorance or hallucination rather than deception. To address this challenge, we introduce KnownLieBench , a knowledge-verified benchmark that first confirms through a neutral probe that an agent knows a user's entitlement, and then evaluates whether it makes false claims once an incentive to deny that entitlement is introduced. Specifically, KnownLieBench covers eight customer-service domains and 112 grounded cases, conducts multi-round dialogues with a trust-tracking customer agent, and separates deception emerging from incentive alone from deception produced under explicit instruction. Across eighteen proprietary and open-weight models, emergent deception varies substantially across model families and domains. We further use the benchmark for post-training, finding that honesty-directed fine-tuning reduces deception under incentive, while deception-graded fine-tuning increases lie success on honest-control dialogues without increasing lie frequency under incentive. By verifying entitlement knowledge before scoring deceptive behavior, KnownLieBench reduces the confound between lying and not knowing and enables more rigorous auditing and steering of agent honesty.
101. 【2608.26357】Cross-lingual Representation Learning via Centroid Intervention Fusion
链接：https://arxiv.org/abs/2608.26357
作者：Wei Sun,Marie-Francine Moens
类目：Computation and Language (cs.CL)
关键词：Large language models, exhibit uneven multilingual, exhibit uneven, Large language, dealing with low-resource
备注： EMNLP 2026 (Main)
点击查看摘要
Abstract:Large language models (LLMs) exhibit uneven multilingual performance, especially when dealing with low-resource languages. Inference-time intervention offers a lightweight way to improve cross-lingual transfer by modifying the hidden states produced by the LLMs during the forward pass, without updating model parameters. However, existing cross-lingual intervention methods typically learn separate projections from source to target languages, which limits scalability and prevents knowledge sharing across languages. We propose Centroid Intervention Fusion (CIF), a projection fusion framework that consolidates multiple multilingual intervention projections into a single language-shared operator. Across multilingual commonsense reasoning, natural language inference, factual editing, and machine translation benchmarks, CIF outperforms the strongest prior pairwise intervention baseline by up to +3.378 pp on average across four model backbones, while supporting performance gains for low resource languages. The code is available at this https URL.
102. 【2608.26344】MoganColBERT-TR: A Late-Interaction Multi-Vector Retrieval Model for Turkish
链接：https://arxiv.org/abs/2608.26344
作者：Furkan Yilmaz,Habibe Aleyna Tasdemir,Muhammed Faruk Gozay
类目：Computation and Language (cs.CL)
关键词：single-vector embedding model, ModernBERT encoder trained, embedding model encoder, previously reported, reported a ModernBERT
备注： 12 pages, 6 tables. Model weights: [this https URL](https://huggingface.co/moganai)
点击查看摘要
Abstract:We previously reported a ModernBERT encoder trained from scratch for Turkish (MoganBERT-TR) and a single-vector embedding model built on top of it (MoganBERT-embed). This work introduces the third model in that lineage: MoganColBERT-TR, a multi-vector retrieval model that, instead of compressing a query or a document into a single vector, represents it at the token level through a 768-128 projection and scores it with MaxSim late interaction. The model is not trained from scratch: the embedding model's encoder is taken as the starting point and adapted to the ColBERT objective with a single-epoch distillation phase. Training data is produced from two sources - title-to-passage pairs carved out of our own pretraining corpus in the character domain and at sentence boundaries, and two Turkish question-based retrieval sets - and is distilled from the soft scores of a cross-encoder teacher (bge-reranker-v2-m3) over one positive and seven mined negatives. We show that in hard negative mining, rank-based skipping alone is insufficient and must be combined with a group mask and a cosine ceiling. Evaluation is carried out with the official pipeline of TurkColBERT, a benchmark built for Turkish late-interaction retrieval (PLAID index, exact MaxSim), on five Turkish BEIR datasets; none of them appears in our training pool, so all five results are clean zero-shot. With 148.9M parameters, MoganColBERT-TR reaches an overall score of 37.36 (35.53 nDCG@100, 31.81 nDCG@10) averaged over the five datasets and finishes second among the five models compared: it outperforms the twice-as-large ColmmBERT-base-TR on four of five datasets and by +3.05 overall, and the benchmark's largest model by +12.30. The gap to the leading model (mLateOn) is concentrated on ArguAna-TR, the dataset with by far the longest queries.
103. 【2608.26329】Neuro-symbolic PRM: Enhancing Scientific Reasoning via Structured Traces and Symbolic Verification
链接：https://arxiv.org/abs/2608.26329
作者：Yuxin Zi,Cong Xu,Suparna Bhattacharya,Martin Foltin,Amit Sheth
类目：Computation and Language (cs.CL)
关键词：Large Language Models, tool-augmented Large Language, quantitative STEM tasks, Large Language, failure mode remains
备注：
点击查看摘要
Abstract:While tool-augmented Large Language Models have significantly improved multi-step reasoning in quantitative STEM tasks, a critical residual failure mode remains: intermediate reasoning steps that are syntactically well-formed, mathematically executable, and unit-consistent, yet contextually ungrounded. Current approaches either rely on formal verifiers that cannot assess semantic intent, or burden Process Reward Models (PRMs) with the dual task of checking both arithmetic and logic. In this paper, we propose a neuro-symbolic framework that cleanly decouples reasoning into two formal dimensions: Symbolic Validity ($V$) and Semantic Groundedness ($G$). We guarantee $V$ by construction using a deterministic symbolic verifier acting as a hard filter. To assess $G$, we train a PRM conditionally on the verifier-accepted manifold. To train this PRM efficiently, we introduce Counterfactual Symbolic Perturbation (CSP), a novel data synthesis strategy that algorithmically generates constraint-preserving hard negatives (steps that perfectly pass the verifier but are logically flawed). At inference, we deploy a verifier-first constrained search that guarantees execution consistency for verifier-covered operations while relying on the PRM solely to rank semantic grounding. By targeting the exact residual error class of strong tool-using LLMs, our method significantly improves reasoning reliability without the sprawling heuristics of prior frameworks.
104. 【2608.26327】How Unlikely Is "Unlikely"? Assessing Verbal Probability Perception Across Large Language Models
链接：https://arxiv.org/abs/2608.26327
作者：Christos Petridis,Konstantinos Pelechrinis,Zoran Obradovic
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：carry consistent meaning, match human perceptions, remains unknown, Large language models, models increasingly produce
备注： 10 pages
点击查看摘要
Abstract:Large language models increasingly produce and interpret verbal probability expressions, yet whether these expressions carry consistent meaning across models (or match human perceptions of uncertainty) remains unknown. We present a systematic cross-model evaluation using a word-to-number mapping task grounded in established human benchmarks. Eleven uncertainty expressions were presented to 19 models under two conditions, forced single-number response and explanation elicitation, alongside a novel bidirectional roundtrip test of internal consistency. LLMs track the human benchmark with surprising fidelity: word ordering is preserved, three anchor points are recovered, and ``possible'' shows the highest variance and cross-model disagreement of any expression tested, consistent with its documented bimodal interpretation in humans. However, models show a systematic upward bias for negative expressions such as ``unlikely'' and ``improbable.'' Explanation elicitation reduces within-model variance while increasing between-model divergence, stabilizing individual models at the cost of inter-model consensus, and the roundtrip experiment reveals clear stratification, with frontier models maintaining coherent bidirectional representations. LLMs thus reproduce the structure of human verbal probability cognition, including its biases, while diverging systematically at the negative end---with implications for any setting where humans and models exchange probabilistic language.
105. 【2608.26319】When Is Noise Response Universal? Tokenization as the Hidden Variable in Language Models
链接：https://arxiv.org/abs/2608.26319
作者：Yefan Tao,Gerald Friedland,Luyang Kong
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：OCR errors, textual neural models, performance of textual, inputs are corrupted, neural models
备注： 14 pages, 8 figures
点击查看摘要
Abstract:The performance of textual neural models often degrades when their inputs are corrupted by noise such as typos, OCR errors, or dropped words. We study the degradation rate across neural models, both sentence embeddings and decoder-only LLMs, and find that how consistent it is depends on the scale of the noise: under word-level noise, models with very different architectures decline along nearly the same curve, while under character-level noise they separate. We further identify the determining factor to be the training objective, not the architecture: eight encoders spanning six pretraining paradigms are scattered initially, and collapse onto a common curve after a short contrastive training recipe. We trace the word/character split to tokenization: a single character edit forces the tokenizer to re-segment the surrounding word, disturbing the token sequence far more than dropping a whole word does. This finding and its underlying mechanism provide a practical means to predict a model's robustness to noise without any noisy evaluation, and to install robustness at a chosen noise scale through noise-augmented training.
106. 【2608.26295】MemToC: Benchmarking Memory-Tool Conflict Resolution in Large Language Models
链接：https://arxiv.org/abs/2608.26295
作者：Arseniy Varlamov,Rishat Zinnatullin,Elisei Rykov,Alexander Panchenko,Ilseyar Alimova
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：Tool-augmented LLMs, existing evaluations measure, measure source preference, parametric memory, establishing source correctness
备注： 26 pages, 2 figures
点击查看摘要
Abstract:Tool-augmented LLMs must arbitrate between two fallible sources when a tool return conflicts with their parametric memory, yet existing evaluations measure source preference without establishing source correctness. We introduce MemToC, a controlled benchmark for post-tool-return arbitration with executable tools. MemToC comprises 6,504 evaluation episodes constructed from 542 quality-controlled factual questions, independently elicited model-specific closed-book answers, and controlled tool returns of known correctness. These components instantiate four source-correctness cases; tool-error and no-tool conditions are separate controls. Across five open-weight 7-9B models, tool returns strongly dominate elicited closed-book answers. The four instruction-tuned models retain a verified-correct answer against an incorrect tool in only 6.5-17.1% of eligible cases, follow a correct tool in 86.0-93.1%, and repeat the tool return in 78.4-86.0% of cases where both sources are wrong. No cross-model ordering remains stable across three instruction-wording variants with the question and episode content held fixed. We compare prompting with SFT and DPO using chain-level cross-fitting over ToolHop, so questions sharing an underlying fact never straddle training and evaluation. We apply an asymmetric success criterion: correct-answer retention must improve without a detected reduction in correct-tool following. SFT and DPO meet this criterion on the same two of four instruction-tuned backbones. Improvements rarely come cleanly: 19 of 20 tested method-model combinations reduce abstention after tool errors or on unanswerable inputs. Transfer beyond MemToC is positive but partial and depends on the model and presentation frame. Correctness-conditioned arbitration can be improved through fine-tuning, but gains must be evaluated jointly with correct tool use, abstention, and robustness to formulation.
107. 【2608.26292】On Scope Classification and Current Knowledge-Editing Benchmarks: A Negative Result, with INLAY as a Gradient-Free Case Study
链接：https://arxiv.org/abs/2608.26292
作者：Aditya Pratap Singh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：SERAC lineage depends, stored edit apply, SERAC lineage, memory-based knowledge editor, lineage depends
备注： 12 pages, 5 figures, 6 tables. Code and data: [this https URL](https://github.com/Aditya-PS-05/INLAY)
点击查看摘要
Abstract:Every memory-based knowledge editor in the SERAC lineage depends on a scope decision: given a query, does a stored edit apply? We report that current knowledge-editing benchmarks cannot measure this decision at all. Using INLAY, a gradient-free editor we built to obtain exact per-query ground truth (the model is frozen, edits live in an external addressable memory, and applying an edit is a bias added along one token's unembedding direction at decode time), we execute every candidate router action on 1,689 queries spanning three datasets and three input conditions. An oracle router choosing the best action every time ties a one-line static policy to four decimal places in all nine dataset-by-condition cells: the maximum attainable gain of any per-query routing method is 0.00 points. Abstention is the sole winning action zero times out of 1,689. The cause is structural: these are counterfactual benchmarks whose evaluation question asks for the post-edit answer, so answering from parametric knowledge is wrong by construction, and a benchmark without negatives cannot reward a classifier's ability to reject. This generalizes beyond our system to the whole scope-classifier family the benchmarks are used to evaluate. We confirm the mechanism directly: constructing the missing condition ourselves, by withholding a query's own edit from the index for half the sample, moves pooled headroom from exactly +0.0000 to +0.0420 and gives abstention its first wins. We also report where INLAY itself does not win (WISE beats it on Qwen2.5-7B CounterFact, and retrieval-augmented generation beats every method we tested, INLAY included, on rigorously matched RippleEdits), and disclose two bugs found during a self-audit of our own routing machinery, neither of which changed a published headline number outside noise.
108. 【2608.26194】A Reranker for Orchestrating Heterogeneous Speech and Text Retrievers
链接：https://arxiv.org/abs/2608.26194
作者：Inho Kim,Sumyeong Ahn
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large Language Models, Language Models, Large Language, attracted significant interest, Retrieval-Augmented Generation
备注： Accepted to Interspeech 2026
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) systems have attracted significant interest for their ability to mitigate hallucinations in Large Language Models (LLMs). Although knowledge databases for RAG are increasingly diversifying to include various modalities such as speech and text, research on handling such multi-modal database scenarios remains limited. In this paper, we propose STeReO (Speech and Text Reranking Orchestrator), a reranker based on speech and text retrievers that aggregates disparate modality databases. To address the lack of specialized training data, we first curate a dataset comprising queries, mixed-modality evidence, and their corresponding relevance ranks. We then train the reranker and evaluate its effectiveness in both single-modality and mixed-modality scenarios. Our results demonstrate that the proposed algorithm excels at selecting the most relevant evidence, thereby significantly improving downstream question-answering performance.
109. 【2608.26192】Comparing Chunking and Embedding Strategies for Turkish RAG Systems
链接：https://arxiv.org/abs/2608.26192
作者：Mustafa Sertaç Türkel,Fatma Nur Korkmaz,Ahmet Tuğrul Bayrak
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：affect Retrieval-Augmented Generation, embedded strongly affect, strongly affect Retrieval-Augmented, Retrieval-Augmented Generation, morphologically rich languages
备注： Accepted to INTCEC 2026. This is the author's pre-print version. The final authenticated version will be available through the conference proceedings
点击查看摘要
Abstract:How documents are segmented into retrievable chunks and how those chunks are embedded strongly affect Retrieval-Augmented Generation (RAG) quality, yet neither has been systematically studied for morphologically rich languages such as Turkish. We compare Turkish document question answering across three chunking strategies (fixed-length, semantic, and layout-aware Docling), five embedding models, and two generator LLMs, over three documents with contrasting layouts. The fully crossed design yields 9,000 graded question-answer evaluations, each scored by an independent judge model, and component comparisons are tested by paired McNemar tests under Holm correction. Four findings follow. The chunking strategy determines how much the embedding choice matters: layout-aware chunking compresses the spread between the modern embedding models to about a point. The three leading embedding models are statistically indistinguishable, so language specialization yields no measurable retrieval advantage. The faster generator is not the more accurate one. And the preferred configuration depends on content type, since layout-aware chunking helps documents containing tables far more than prose. The best individual components therefore do not compose into the best complete configuration, which reaches 87.0%.
110. 【2608.26189】Invocation-Level Reliability of Tool-Using Agents
链接：https://arxiv.org/abs/2608.26189
作者：Afiya Noorain,Subhranshu Mohanty,Amritesh Banerjee,Abhijit Dasgupta
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Tool-using agents fail, forming wrong arguments, Tool-using agents, wrong arguments, forming wrong
备注：
点击查看摘要
Abstract:Tool-using agents fail two ways: choosing the wrong tool, or forming wrong arguments, and an early failure of either kind can silently corrupt everything downstream. We measure a correct-invocation rate that separates the two, under both a clean teacher-forced context and the model's own free-running context, on five open-weight models over contamination-free multi-step tasks (depths 1-8). By depth 6, roughly 70% of a model's own clean-context capability is lost to its own earlier mistakes (L6 = 0.686, 0.684). Our central finding concerns the measurement itself. Under exact-match scoring against a fixed gold trajectory, a propagation model's severity and recovery parameters are not merely hard to estimate - they are fixed by the scoring rule. Severity is forced to its boundary (0 of 869 poisoned steps correct); recovery is structurally unobservable (0 of 580 poisoned steps returned on-track, against an expected 0.0058 by chance). Both follow from one mechanism: post-divergence, the gold value is generated by tool constants the model never sees, so it is information the model cannot derive. A fit run anyway returns 0.92 and 0.73 for a quantity that is exactly 1.000 - confident numbers for a parameter the scoring rule already determined. We give the mechanism and a remedy, conditional-on-state scoring, applied retrospectively to cached completions at zero additional cost, which un-pins severity to interior estimates excluding zero (+0.149, +0.316).
111. 【2608.26187】When the Canonical Completion Is Wrong: Formalizing and Measuring the Jump in Large Language Models
链接：https://arxiv.org/abs/2608.26187
作者：Dai Shi,Xiaoyu Li,José Miguel Hernández-Lobato
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Logic in Computer Science (cs.LO)
关键词：recently attracted considerable, attracted considerable debate, large language models, system of axioms, commonly referred
备注：
点击查看摘要
Abstract:Whether large language models (LLMs) can perform the abductive leap from evidence to a new system of axioms, commonly referred to as a jump, has recently attracted considerable debate. A prominent position holds that LLMs are structurally incapable of such jumps, while recent studies challenge both its mechanism and its evidence. However, the debate remains difficult to settle, since the field still lacks a formal definition of the jump and a measure to test either side. In this paper, we develop a formal account of the jump in four steps and measure the second. The steps ask what the default completion of partial data is, when abandoning it is forced, when the abandonment is correct, and how successive jumps compound. Specifically, we define a jump instance as a finite extension problem with a machine-checked certificate that a correct completion exists, is unique up to renaming, and differs from the canonical completion of the data. The canonical completion is given by the left and right Kan extensions and is also what models produce without constraints, so it serves as the default. We prove that jump instances are well-posed and establish a family theorem that certifies instances of unbounded difficulty without enumeration. We further formalize when a jump is correct and how successive jumps compound. Finally, we run the measurement on nine certified instances and four frontier models. The Kan-default rate is zero in all 248 constrained trials, so the models do jump at this step and abandon the excluded default every time. Failures at higher difficulty stem from exhausted reasoning budgets or constraint errors, never from reverting to the default. These results indicate that the second step is not the bottleneck. If the disputed incapacity is real, it lies in generating the constraints or inventing the framework. Code can be found at: this https URL.
112. 【2608.26186】Investigating the Influence of Prompt and Response Languages on LLM Content Generation
链接：https://arxiv.org/abs/2608.26186
作者：Thi Thanh Nhan Nguyen,Mai Khoi Tieu,Michael A. Riegler,Pål Halvorsen,Thu Nguyen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：English, Norwegian, study examines, influence the behavior, behavior of large
备注：
点击查看摘要
Abstract:This study examines how prompt and response language influence the behavior of large language models. Using five models, we evaluated answers to 68 non translation questions across four language conditions: English to English, English to Norwegian, Norwegian to Norwegian, and Norwegian to English. After removing refused items, the dataset contains 1348 responses. We measure length differences with Cohen d, semantic fidelity with LabSE cosine similarity, and cross lingual keyword overlap with both raw and soft Jaccard. Prompt language has a strong effect on response length. With English output, Norwegian prompts shorten responses by about thirty seven percent. With Norwegian output, English prompts shorten responses by about forty one percent. The largest cross lingual contrast shows a reduction in word count but a smaller reduction in tokens, reflecting tokenizer differences. Despite variation in length, semantic similarity remains high, and soft Jaccard reveals substantial conceptual overlap that raw Jaccard does not capture. Effect sizes vary across models, indicating heterogeneity. Prompt language is not neutral and systematically shapes output length and lexical realization, with implications for multilingual prompt design.
113. 【2608.26180】PACEShop: Evaluating Personalized, Actionable, Compositional, and Evidence-grounded Shopping Assistants
链接：https://arxiv.org/abs/2608.26180
作者：Weimin Lyu,Chen Luo,Guangrui Li,Yaochen Xie,Dhineshkumar Ramasubbu,Arief Koesdwiady,Wanqiu Long,Hansu Gu,Yutong Chen,Zheshen Wang,Dakuo Wang,Yi Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：coherent recommendation experience, ranked product lists, synthesize shopper context, Shopping assistants, structured decision support
备注：
点击查看摘要
Abstract:Shopping assistants are shifting from ranked product lists toward structured decision support, where systems must synthesize shopper context, product evidence, and next-step guidance into a coherent recommendation experience. This changes the unit of evaluation: a fluent response can still fail by ignoring shopper context, contradicting itself across components, or leaving defects too vague to localize. Existing personalization, grounding, and LLM-as-a-judge benchmarks cover pieces of this problem, but they do not define a joint evaluation target for structured shopping-assistant responses. We formulate this missing evaluation target as PACE: Personalized, Actionable, Compositional, and Evidence-grounded evaluation. We instantiate PACE with two artifacts: PACEShop, a benchmark dataset that makes the target measurable through 22,625 controlled records with structured personas, auditable evidence pools, GOOD/BAD labels, and gold defect family and location annotations; and PACEJudge, a training-free judging protocol that makes the target reportable through a structured output contract. Our experiments show that generic judges can recognize broad quality but fail to recover the diagnostic fields required for PACE; PACEShop makes these failures verifiable, and PACEJudge improves persona-source, cross-component, grounding, and family/location closure without retraining, showing that realistic shopping-assistant evaluation requires a task-matched output contract rather than only a stronger backbone or scalar prompt.
114. 【2608.26177】A Multi-Framework Comparison of Outline Stages in Long-Form Generation with LLMs
链接：https://arxiv.org/abs/2608.26177
作者：Yifan Song
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：exposes fundamental limitations, large language models, generation exposes fundamental, Long-form generation exposes, exposes fundamental
备注： 20 pages, 13 tables
点击查看摘要
Abstract:Long-form generation exposes fundamental limitations of large language models. Even 70B-parameter models exhibit length collapse at 16k-token outputs, and multi-chapter stories frequently trigger the attribute drift characteristic of the ``lost-in-the-middle'' effect. The ``outline-first, write-later'' paradigm has gained wide adoption, yet existing research evaluates the final writing rather than the outline itself, conflating two evaluation objects that should be decoupled. We construct a unified head-to-head benchmark covering 7 representative long-form generation frameworks across 3 generation granularities -- single-chapter, multi-chapter, and whole-book -- and propose an anchor-based LLM-as-a-judge protocol that directly assesses outlines against the source text on a 5-point anchored scale. Across 21 framework-granularity cells, no single framework dominates; performance depends on the match between a framework's intrinsic output form and the target granularity. SuperWriter ranks first in the length-constrained single-chapter mode, but this advantage degrades in whole-book mode. The outline-side ranking correlates only moderately with the writing-side ranking, supporting the outline--writing decoupling principle. Compute constraints limit the writing-side evaluation to a subset of cases; follow-up experiments will expand the sample size and add cross-model evaluators to enable stronger statistical inference.
115. 【2608.26176】Knowledge Cards: Structured Knowledge for AI Systems
链接：https://arxiv.org/abs/2608.26176
作者：Liliana Ferreira
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：current documentation practice, inform real decisions, outputs inform real, inspectable representation, ideally reviewed
备注： 11 pages
点击查看摘要
Abstract:AI systems whose outputs inform real decisions, and increasingly consequential ones, require something that current documentation practice does not provide: a structured, inspectable representation of the knowledge they need to ground, contextualize, and reason about those decisions, ideally reviewed and signed off by a domain expert. Established documentation artefacts already capture important aspects of an AI system. Model cards describe how a system behaves, data cards describe what it was trained on, and system cards describe the risks of a deployed system. None of them addresses the layer between inputs and outputs, more precisely, the concepts a system holds, the relationships it models, and the patterns of reasoning it applies. For pattern-recognition tasks this gap is tolerable. For agentic AI, where systems act on their conclusions, it is the step that most often separates a promising proof of concept from an operational solution an organisation can rely on. This paper introduces the Knowledge Card, a structured artefact that captures validated knowledge about a single bounded concept in a form that experts can review, organisations can audit, and AI systems can reason over. For one concept, such as a specific failure mode, a compliance obligation, or a process decision, a Knowledge Card records the entities and relationships involved, the reasoning that connects them, the conditions under which that reasoning no longer holds, and the provenance of every claim, all grounded in a formal domain ontology and signed off by a domain expert. Initial prototype cards have been built in the energy and pharmaceutical domains. The schema is released as a public draft for community engagement.
116. 【2608.26175】Lost in Compression: A Controlled Cross-Lingual Audit of Extractive Prompt Compressors
链接：https://arxiv.org/abs/2608.26175
作者：Mantas Lukauskas
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：cut LLM inference, LLM inference costs, report strong results, Extractive prompt compression, Extractive prompt
备注： 17 pages, 6 figures. Code and artifacts: [this https URL](https://github.com/MantasLukauskas/lost-in-compression)
点击查看摘要
Abstract:Extractive prompt compression promises to cut LLM inference costs by removing low-information tokens, and learned compressors such as LLMLingua-2 report strong results on English benchmarks. Most other languages already pay a token premium: the same content costs 1.3-1.8x more tokens than in English. We ask whether compression closes or widens this gap. Using fully parallel data in ten languages spanning five scripts, with controls budget-matched in the target model's tokenizer, we audit four learned compressors against four deterministic baselines, on eleven target models from ten vendors (over 250,000 evaluation calls). Three of the compressors are trained with English supervision (LLMLingua-2 XLM-R/mBERT; Kompress-v2 from the production Headroom stack); the fourth, XProvence, is trained multilingually. First, the transfer gap is real, replicates across target models and compressor backbones, and is strongly rate-dependent: at a 0.33 keep-rate English retains 57-62% of normalized context utilization while Lithuanian retains 10-24% and Chinese essentially none, despite Chinese having the smallest token premium. Second, the gap tracks compression supervision data, not architecture. All three English-trained compressors show it, deterministic methods show no comparable gap, and the multilingually trained XProvence v1 shows none. Its v2 release, retrained on translated data, empties 92% of Chinese contexts at its aggressive threshold without any warning. Third, in a harder long-context setting, aggressive learned compression drives compressed contexts to or below no-context utility in three of five non-English languages. A translate-then-compress pipeline matches or beats native compression at roughly half the token cost in three of five tested languages. We release all code, compressions, and model outputs. Safe compression budgets are much smaller outside English.
117. 【2608.26171】Mitigating Fabrication in Multi-Stage LLM Pipelines for Hiring: An Empirical Evaluation of Prompt Guardrails and Human-in-the-Loop Checkpoints
链接：https://arxiv.org/abs/2608.26171
作者：Hiroko Takano
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Multi-stage LLM hiring, LLM hiring pipelines, Multi-stage LLM, interview question generation, LLM hiring
备注： 13 pages, 2 figures
点击查看摘要
Abstract:Multi-stage LLM hiring pipelines (resume improvement, interview question generation, answer feedback) can fabricate credentials, inflate qualifiers, and invent experience. We evaluate two mitigations, prompt guardrails and human-in-the-loop (HITL) checkpoints, against a fully automated baseline. In a controlled experiment (10 synthetic resumes x 2 job descriptions x 3 repetitions x 3 conditions; 180 runs), the baseline (C1) produced at least one unsupported claim in 96.7% of outputs (mean 6.80 findings/output). Prompt guardrails (C2) reduced finding density by 86% (6.80 to 0.92/output), but 50.0% of outputs still contained a fabrication, showing prompt-level mitigation alone is insufficient. A human checkpoint after resume improvement (C3) eliminated all identity fabrications, reduced finding density by 59% (6.88 to 2.82/output), reduced item-level fabrication from 96.7% to 75.0% (p=.022), and cut capture of JD-embedded trap requirements from 47% to 2% (vs. 5% under the guardrail). An exploratory analysis of multi-specialty resumes shows contamination rising monotonically with domain distance between specialties, suggesting career changers are especially exposed. The reviewer in this study caught all flagrant fabrications, but subtle qualifier drops and plausible new claims survived review roughly half the time (54.5% removal). Neither mitigation degraded the deliverable: claim retention exceeded 99% under both. The interventions are complementary: the guardrail eliminates unprompted additions and qualifier inflation cheaply, while the checkpoint gives near-categorical guarantees against the most severe failures, invented identities and JD-baited claims. These results support a layered architecture combining guardrails with a human checkpoint. A supplementary run with a newer-generation model (90.0% baseline fabrication rate) suggests the problem is not resolved by model progress alone.
118. 【2608.26168】Hallucinations in LLMs: A Lifecycle-Based Survey of Causes, Detection, Mitigation, and Prevention
链接：https://arxiv.org/abs/2608.26168
作者：Naveen Lamba,Sanju Tiwari,Manas Gaur
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：enables building solid, building solid frameworks, including health, high-stakes environments, scientific research
备注：
点击查看摘要
Abstract:The lifecycle of hallucination in LLMs is a concept that enables building solid frameworks on the control and reliability of LLMs in high-stakes environments, including health, legal, and scientific research. Although previous surveys have primarily focused on detection or mitigation, this survey provides a lifecycle-based overview of the hallucinations in the LLMs, their cause, detection, mitigation, and this http URL propose a three-fold categorization of hallucinations across the LLM lifecycle: data-related, training-related, and inference-related, which is consistent with the lifecycle of the development of the LLM. Each of these stages is discussed regarding the cause of hallucinations, their detection, and the ways they can be addressed under specific mitigation or prevention interventions. In addition, we discuss the available benchmark data using a number of parameters so as to establish their suitability in identifying, restricting and managing hallucinations. The survey provides researchers and practitioners with a standardized framework to understand, diagnose, and cure hallucinations in a systematic system to present actionable data to build safer and more reliable LLMs.
119. 【2608.26165】Using Poly-Encoders for Computationally Efficient Automated Creativity Assessment
链接：https://arxiv.org/abs/2608.26165
作者：Sam Grouchnikov,Phillip Gregory,Jiho Noh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：long standing challenge, Automated creativity assessment, lacking practical accuracy, Creative Thinking Test, Automated creativity
备注： Accepted at AIED 2026. The final authenticated version is available online at [this https URL](https://doi.org/10.1007/978-3-032-29755-6_32)
点击查看摘要
Abstract:Automated creativity assessment has been a long standing challenge, with traditional methods often being resource intensive or lacking practical accuracy. We introduce a novel approach by using Poly-Encoder for computationally efficient and accurate automated creativity assessment. We fine-tuned a Poly-Encoder on a public dataset from the Scientific Creative Thinking Test, comprised of approximately 18,000 human-rated question responses. Our method leverages small pre-trained BERT encoders, achieving performance comparable to fine-tuned Large Language Models while significantly reducing computational demands. Experiments with the BERT-family models and poly-code counts achieved Pearson correlations of up to r = 0.74, 95% CI [0.73, 0.75] with human raters, matching the performance of resource intensive LLMs. This study bridges the gap between high performance and computational efficiency, potentially enabling widespread implementation of automated creativity assessment on accessible consumer-grade hardware. With some limitations, our findings suggest that Poly-Encoders are a promising alternative to LLMs for practical, scalable creativity assessment in various contexts, especially educational.
120. 【2608.26163】From Sound to Symptom: Real-Time Respiratory Signal Understanding for Conversational Healthcare Agents
链接：https://arxiv.org/abs/2608.26163
作者：Tanmay Laud,Herprit Mahal,Subhabrata Mukherjee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Sound (cs.SD)
关键词：live spoken conversations, spoken conversations carry, conversations carry clinically, carry clinically valuable, valuable respiratory signals
备注： Accepted for publication at SIGDIAL 2026
点击查看摘要
Abstract:Cough events during live spoken conversations carry clinically valuable respiratory signals, yet existing dialogue systems treat them as acoustic noise to be discarded. We present HealthCUES (Clinical Understanding from Embodied Sounds), a streaming pipeline for paralinguistic respiratory monitoring in real-time conversational agents, a capability that, to the best of our knowledge, is absent from all prior systems. HealthCUES processes audio through a rolling buffer aligned with dialogue turn boundaries, enabling sub-second event detection without interrupting conversational flow. Beyond binary cough detection, the system provides fine-grained analytics: (i) differentiation between coughing and throat clearing, (ii) cough subtype classification (dry, wet, barking, whooping) with confidence scores, and (iii) temporal duration estimation with start-end boundaries. To prevent alert fatigue, HealthCUES introduces dialogue-aware gating mechanisms that modulate triggering based on conversational context. The system leverages Qwen3Omni, a multimodal large language model (MLLM), with constrained structured outputs, decomposing cough analysis into parallel prediction tasks for independent prompt optimization. Evaluation on 847 in-house conversational audio segments demonstrates 93\% F1 for cough detection, 0.75 weighted-F1 for wet/dry subtype classification, and average end-to-end latency of 340ms; external validation on the AMI meeting corpus confirms robust cough, throat-clearing, and speech separation in the presence of speech (0.91 macro-F1). A user study with licensed healthcare professionals confirms the clinical relevance of subtype information and the system's utility in telehealth workflows.
121. 【2608.26161】Mutual Debiasing via Dual-Seed Comparison for Probabilistic Sampling in Large Language Models
链接：https://arxiv.org/abs/2608.26161
作者：Zihao Guo,Hongtao Lv,Chaoli Zhang,Laiguo Yin,Lei Liu,Yonghui Xu,Lizhen Cui
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Language Models, demonstrate remarkable capabilities, Large Language, high-fidelity probabilistic sampling
备注： 28 pages, 4 figures, 13 tables
点击查看摘要
Abstract:Although Large Language Models (LLMs) demonstrate remarkable capabilities in reasoning and decision-making, high-fidelity probabilistic sampling remains a persistent challenge. When generating random variables, LLMs consistently exhibit systematic biases that warp the target probability distributions. Current approaches often rely on a single, self-generated seed, which inherits model-specific biases. To overcome this vulnerability, we introduce Dual-Seed Comparison (DSC), a transparent, tool-free protocol that utilizes two independent LLM-generated seeds to neutralize bias. DSC compares the character-level ordinal values of the two seeds to construct a bit sequence, converts and normalizes this sequence into a pseudo-uniform variate, and then maps the variate to the target distribution through the inverse cumulative distribution function (CDF). Empirical results show that DSC substantially outperforms existing methods across 96\% of evaluated settings. Beyond direct sampling, task-adapted variants based on the DSC comparison operator improve distributional control in MCQ generation and attribute-constrained text-to-image prompting.
122. 【2608.26159】Self-Generated Text Recognition: Quality Heuristics, Cross-Task Transfer, and Downstream Bias in LLM Evaluation
链接：https://arxiv.org/abs/2608.26159
作者：Jesse St. Amand,Callum Canavan,Sohaib Imran,Joseph Hewson,Aaron Lutz,Shi Feng,Puria Radmard,Lennie Wells
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Self-Generated Text Recognition, Text Recognition, poses risks, evaluators or monitors, SGTR
备注： 22 pages, 9 figures (4 main body, 5 appendix), 11 tables (1 main body, 10 appendix)
点击查看摘要
Abstract:Self-Generated Text Recognition (SGTR)--the ability of an LLM to identify its own outputs--poses risks to AI safeguards that rely on LLMs as evaluators or monitors. Specifically, an LLM may recognize outputs from other copies of the same model and make biased judgments or collude outright. Prior work has drawn conflicting conclusions about whether current models possess significant SGTR capabilities. We reconcile these findings by identifying key experimental design choices--which we term operationalizations--that drive divergent results. Evaluating 13-21 models across six operationalizations, we find that accuracy varies substantially with evaluation format (pairwise vs. individual assessments of text), conversation structure (presenting candidate text in user tags vs. assistant tags), and the domain of the task used to generate candidate text (e.g., coding vs. summarization). We corroborate previous observations that a quality heuristic--models attributing authorship to text they perceive as higher quality--is a dominant confound. We also find that improving a model's SGTR performance via SFT in one evaluation configuration can generalize to others. Training for SGTR additionally causes models to prefer their own outputs when acting as a judge in the AlpacaEval framework. Finally, we discuss the implications of our evaluations for the safety of future AI systems: our work suggests that, despite confounds, some models possess practical SGTR capabilities, and that training a model for SGTR in one setting can affect its self-recognition and self-preference more generally. We conclude that SGTR should be monitored and considered in the design of safety-critical AI applications.
123. 【2608.26155】VFA: Empowering Multilingual MLLMs via Vision-Free Adaptation
链接：https://arxiv.org/abs/2608.26155
作者：Yixia Li,Yaqing Shi,Zhiwen Ruan,Dongdong Zhang,Lingjie Jiang,Shaohan Huang,Yun Chen,Guanhua Chen,Furu Wei
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：non-English image-text supervision, high-quality non-English image-text, remain English-centric, multimodal instruction tuning, advanced rapidly
备注：
点击查看摘要
Abstract:Multimodal large language models have advanced rapidly, yet most remain English-centric, as scaling multilingual multimodal instruction tuning is limited by the scarcity and high cost of high-quality non-English image-text supervision. Although multilingual text data is abundant, naive textual fine-tuning can disrupt vision-language alignment and induce catastrophic forgetting. We propose Vision-Free Adaptation (VFA), a framework that decouples multilingual language enhancement from visual alignment by composing complementary task vectors over a shared LLM backbone. Specifically, we fine-tune a base LLM on multilingual text data to derive a multilingual task vector, which is then merged with the vision-aligned task vector of an MLLM. Experiments on five MLLMs across six multilingual multimodal benchmarks show consistent improvements while preserving both general multimodal and text-only capabilities. Moreover, using less than 2% of the text data, VFA narrows the gap to the fully multimodal-trained model, demonstrating its data efficiency.
124. 【2608.26154】Evaluating AI Generated Summaries for Cancer Patients
链接：https://arxiv.org/abs/2608.26154
作者：Muhammad Aurangzeb Ahmad,Kim Shyu,Leon Oliver,Fergus Sleight,Paul Landau
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, complex medical data, digital health platforms, Large language, medical data
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly being integrated into digital health platforms to generate summaries of complex medical data. Although these models can improve patient engagement and communication, these systems also raise concerns about accuracy, faithfulness, and safety in clinical contexts. In this study, we evaluate AI-generated summaries within a cancer patient care application using a dual assessment framework. Human domain experts, including oncology clinicians and patient-facing care staff, provided ground-truth evaluations of summary quality along dimensions of accuracy, clinical relevance, and readability. In parallel, we employed LLMs serving as evaluators (LLM-as-a-judge). Some limitations were identified in the generated summaries e.g., occasional omissions and minor inaccuracies. These were systematically analyzed and used to iteratively improve prompt design, grounding, and safety guardrails.
125. 【2608.26152】Artificial Intelligence Models Can Predict and Collaboratively Modulate Human Memory Search
链接：https://arxiv.org/abs/2608.26152
作者：Eric Lacosse,Mariana Duarte,Graham Todd,Peter M. Todd,Daniel C. McNamee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Large language models, unprecedented natural language, natural language generation, text-based problem-solving capabilities, exhibit unprecedented natural
备注： 18 pages, 5 figures; includes Supplementary Information
点击查看摘要
Abstract:Large language models (LLMs) exhibit unprecedented natural language generation and many text-based problem-solving capabilities. Indeed, in many language-based tasks, for example routine coding, these artificial intelligence models have reduced, or even eliminated, the need for human input. But rather than replacing human cognitive effort, LLMs may instead serve as cognitive tools to extend human abilities, particularly when they are engaged in a task requiring open-ended conceptual exploration and creative ideation. However, we are yet to understand how these models may enhance such generative human cognitive abilities in human--AI interactions. In this study, we explore and evaluate the ability of LLMs to follow and enhance human mental trajectories during semantic memory search. To test this, we use the semantic fluency task (SFT), a classic cognitive paradigm requiring generative semantic memory retrieval that has long served to characterize convergent and divergent thinking in humans. We demonstrate that an LLM's abilities to track and predict human memory trajectories in this task exceed those of other humans.
126. 【2608.26148】owards Interpretable Depression Detection: Linking Acoustic Features to DSM-5 Indicators
链接：https://arxiv.org/abs/2608.26148
作者：Jonas Länzlinger,Katharina O.E. Müller,Burkhard Stiller,Bruno Rodrigues
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：Depression affects millions, affects millions worldwide, miss authentic behavior, Depression affects, millions worldwide
备注：
点击查看摘要
Abstract:Depression affects millions worldwide, yet diagnosis relies on subjective self-reports that may miss authentic behavior. This paper presents an approach linking speech acoustics to DSM-5 depressive-behavior indicators through a transparent Linkage Framework. Unlike black-box models, the framework explicitly maps acoustic features (pitch variability, pauses, speech tempo) to clinical indicators, enabling interpretable, indicator-level outputs. The system runs locally on commodity hardware (HW) to preserve privacy. Preliminary evaluation on DAIC-WOZ shows directionally consistent associations between acoustic features and DSM-5 indicators for psychomotor change and concentration difficulty, supporting the design rationale. Future work will validate on longitudinal datasets and extend multimodal integration while maintaining edge constraints.
127. 【2608.26147】CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models
链接：https://arxiv.org/abs/2608.26147
作者：Yucheng Zhou,Peng Luo,Qianning Wang,Chengzhong Xu,Jianbing Shen
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Large Language, expert-annotated data constrain, shown strong potential, constrain their progress
备注： ECCV 2026
点击查看摘要
Abstract:Large Language Models (LLMs) have shown strong potential for medical reasoning, yet the scarcity and cost of expert-annotated data constrain their progress. While reinforcement learning offers a scalable alternative, standard outcome-based methods in medicine often suffer from autoregressive credit assignment failure and gradient variance explosion. This leads to the "Right Answer, Wrong Reason" trap, where models inadvertently reinforce spurious correlations and dataset shortcuts rather than valid clinical deduction. In this work, we propose Causally-Aligned Reasoning Exploration (CARE), a theoretically grounded framework for intrinsic experience curation. CARE is built upon two rigorous conditions for high-quality training trajectories: Causal Sufficiency, which utilizes an agreement-based self-verification mechanism to mimic $do$-calculus interventions and effectively debias gradients; and Proximal Learnability, which employs dynamic entropy bounds to select experiences within the model's zone of proximal development for variance-bounded optimization. These rigorously filtered experiences are optimized via a dual-stream objective that combines on-policy group-relative exploration with difficulty-weighted experience replay. Extensive experiments on diverse medical multimodal and text-only benchmarks demonstrate that CARE consistently outperforms other strong competitors, substantially reducing correct-but-inconsistent reasoning and improving training stability.
128. 【2608.26146】Vagdhenu: A Vrutta (Meter) Aware Shloka-to-Chant (TTS) System for Sanskrit
链接：https://arxiv.org/abs/2608.26146
作者：Prathosh A P
类目：Computation and Language (cs.CL)
关键词：chanted parayana recitation, Toggle, Toggle Hugging Face, Bibliographic Explorer Toggle, Explorer Toggle Bibliographic
备注：
点击查看摘要
Abstract:We present Vagdhenu, a vrutta (meter) aware shloka-to-chant system for Sanskrit: a text-to-speech system that maps a metrical verse to its chanted parayana recitation at high fidelity. This is an experience report, not a new architecture. We take an off-the-shelf flow-matching TTS backbone and a large-scale neural vocoder, and add the components a faithful Sanskrit chant pipeline needs: a frontend that routes Sanskrit through Kannada orthography to avoid the Hindi-style schwa deletion that Devanagari triggers in Indic models; a frontend that obeys subtle Sanskrit phonology (visarga sandhi with its jihvamuliya and upadhmaniya allophones, the aspiration contrast of alpaprana and mahaprana, and the dental, retroflex, and palatal sibilants kept distinct); and a vrutta-aware mechanism that detects the meter and picks an exactly matched reference under a half-reference rule. We report a negative result that shaped the system: in a self-infilling flow-matching backbone, a text-side prosody conditioner is architecturally inert, because the model recovers pitch from the context mel and the embedding gets no gradient; the reference clip and a voice-steering retrain are the only working prosody levers. We also report a comparative lineage across four families (StyleTTS2, VITS2, Matcha-TTS, and the flow-matching backbone), where each earlier family hit a ceiling on conjuncts or prosody that a five-hour clone cleared at an expert MOS near 4.6. The system shipped two deployments: a 32-chapter, 5183-verse video corpus (about 17.5 hours) and an audio app covering about 18000 verses across 12 books. We release the frontend, inference and training code, weights, a single-speaker chant dataset, and an interactive demo.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.26146 [cs.CL]
(or
arXiv:2608.26146v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.26146
Focus to learn more
arXiv-issued DOI via DataCite
Submission history From: Prathosh A. P. [view email] [v1]
Sun, 28 Jun 2026 20:29:16 UTC (20 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Vagdhenu: A Vrutta (Meter) Aware Shloka-to-Chant (TTS) System for Sanskrit, by Prathosh A PView PDFHTML (experimental)TeX Source
view license
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-08
Change to browse by:
cs
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
129. 【2608.26144】Why Current XAI Is Not Enough for Arabic NLP: A Critical Survey of the Explainability Gap
链接：https://arxiv.org/abs/2608.26144
作者：Salima Lamsiyah,Ruslan Mitkov
类目：Computation and Language (cs.CL)
关键词：NLP remains under-explained, Arabic NLP remains, Arabic XAI, broader NLP XAI, NLP XAI offers
备注： 11 pages
点击查看摘要
Abstract:Explainable AI (XAI) is now a major theme in NLP; however, Arabic NLP remains under-explained in three connected senses. First, there is a method gap: Arabic XAI relies heavily on a small set of post-hoc techniques such as LIME, SHAP, attention visualization, and saliency, while broader NLP XAI offers richer diagnostic, counterfactual, probing, rationale-based, and human-centered methods. Second, there is a task gap: existing Arabic XAI work is concentrated in classification tasks, especially sentiment analysis, hate/offensive language detection, fake news, and spam, with weaker coverage of generation, retrieval, translation, summarization, structured prediction, and dialogue. Third, there is a linguistic gap: many explanations identify influential tokens, but rarely explain Arabic-specific phenomena such as morphology, clitics, dialectal variation, diglossia, orthographic ambiguity, diacritics, code-switching, named entities, cultural references, or Classical and religious registers. This critical structured survey synthesizes the reviewed literature on Arabic XAI across text, speech, and multimodal settings. We argue that Arabic NLP does not only need explanations of model decisions; it needs explanations that are faithful to Arabic as a linguistic, cultural, and sociotechnical object. We introduce a taxonomy of tasks, methods, linguistic units, varieties, goals, and evaluation practices, and propose a research agenda for linguistically grounded Arabic XAI.
130. 【2608.26143】Beyond Accuracy: A Qualitative Analysis of Vision-Language Models for Hate Speech Detection in Memes
链接：https://arxiv.org/abs/2608.26143
作者：Muhammad Jawad Chowdhury,Adiba Hasan,Ishrak Hossain,Shahriar Ivan,Sabbir Ahmed
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：political problems, individuals share, share their ideas, ideas concerning contemporary, contemporary social
备注：
点击查看摘要
Abstract:Memes have turned out to be a powerful tool through which individuals share their ideas concerning contemporary social and political problems. Their anonymity, as well as their ability to go viral, make them a powerful medium for spreading hate. It remains very difficult to identify such complex and context-dependent hate speech. Although they display excellent performance on multimodal tasks, vision-language models (VLMs) tend to ignore context, irony, and other subtle cues that play a key role in identifying hateful memes. In this work, we present a qualitative analysis of four state-of-the-art VLMs: LLaVA-7B, Qwen-VL, GPT-4o mini, and Claude 3 Haiku. We evaluate these models under zero-shot and few-shot prompting to examine how contextual framing influences their outputs. Our analysis goes beyond simple classification accuracy and focuses on a qualitative evaluation of the models' generated justifications, providing a more in-depth understanding of their thought processes and constraints when dealing with hateful memes.
131. 【2608.26142】Position Is All You Need: A Free Lunch Token Compression Strategy for MLLM-based Referring Expression Segmentation
链接：https://arxiv.org/abs/2608.26142
作者：Yuhan Liu,Yixiong Zou,Yuhua Li,Ruixuan Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Referring Expression Segmentation, Referring Expression, pixel-wise segmentation masks, generate pixel-wise segmentation, Expression Segmentation
备注： Accepted by ICML 2026
点击查看摘要
Abstract:Referring Expression Segmentation (RES) aims to generate pixel-wise segmentation masks from complex and implicit textual queries. While recent advances in Multimodal Large Language Models (MLLMs) have substantially boosted RES performance, their prohibitive computational overhead remains a critical bottleneck, which, however, is rarely explored. To fill this gap, we first evaluate typical token compression methods on this task and observe a surprising performance degradation. In this paper, we aim to understand this phenomenon for a solution. By extensive experiments, we find that token compression for RES requires preserving the original position embeddings and local neighboring spatial structures, indicating that visual token position information is far more critical than in other tasks. Building on this insight, we ask: Can we design the token compression method purely based on the position information? Therefore, we propose PAYN, a plug-and-play, training-free token compression method that relies solely on position information. PAYN retains tokens that are adequately distributed in every local neighboring region while strictly preserving original positional indices, thereby maintaining spatial relational consistency. Experiments on multiple RES benchmarks demonstrate that our method outperforms existing token compression methods, verifying that position is indeed all you need for token compression in the MLLM-based RES task. Codes are avaliable at this https URL.
132. 【2608.26141】AdaThinking-E: One-Token Entropy Regulation for Adaptive Thinking
链接：https://arxiv.org/abs/2608.26141
作者：Zining Wang,Tongkun Guan,Boming Chen,Zhentao Guo,Jianqiang Liu,Chao Jin,Chen Duan,Kai Zhou,Pengfei Yan,Wei Shen,Xiaokang Yang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Multimodal large language, Multimodal large, explicit thinking processes, incorporating explicit thinking, large language models
备注：
点击查看摘要
Abstract:Multimodal large language models have demonstrated strong document reasoning capabilities by incorporating explicit thinking processes. While this capability significantly improves performance on challenging tasks, current models apply such deep reasoning uniformly to all questions, resulting in unnecessary computational overhead for simple task. This not only degrades user experience but also negatively impact accuracy on benchmark datasets. We identify the critical need for adaptive thinking mechanisms that can intelligently determine when to engage reasoning based on question complexity. To address this, we propose AdaThinking-E, a novel reinforcement learning framework that learns adaptive thinking through one-token entropy regulation. Our key insight is that model confidence in the decision to engage thinking (or not) can be quantified through entropy analysis of the predicted probability distribution at critical decision tokens. This observation motivates our entropy-governed reward mechanism: the training process naturally transitions from high-entropy exploration, where the model experiments with different thinking strategies, to low-entropy convergence with confident, generalizable decision-making policies. Crucially, this approach enables models to intrinsically discover when to think without requiring manual intervention or external difficulty labels. Extensive experiments demonstrate that our approach enables models to be both accurate on complex problems and efficient on simple ones across diverse document tasks.
133. 【2608.26140】Affix Cache for Diffusion Large Language Models
链接：https://arxiv.org/abs/2608.26140
作者：Kaihua Liang,An Zhong,Xin Tan,Zafar Ayyub Qazi,Hong Xu,Jian Weng,Marco Canini
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Language Models, Diffusion Large Language, Diffusion Large, Language Models, Large Language
备注： 15 pages, 7 figures
点击查看摘要
Abstract:Diffusion Large Language Models (DLLMs) enable non-autoregressive decoding and bidirectional context modeling, but efficient inference remains challenging. Unlike autoregressive systems, whose key-value (KV) cache can be reused for shared prefixes, DLLMs couple the KV states of shared context tokens with evolving generated tokens through bidirectional attention, making naive cache reuse stale while full recomputation is expensive. We present ACache, an affix-oriented cache reuse mechanism for shared text spans in DLLMs beyond prefixes. ACache identifies a small request-specific subset of critical affix tokens, called Anchor Tokens, by measuring their influence on masked generation tokens, and selectively recomputes the KV states of only these tokens while reusing the remaining affix cache. Built on Fast-dLLM, ACache recovers the accuracy loss caused by direct affix-cache reuse across different settings when recomputing around 20% of affix tokens. We also build a shared-prefix prototype on top of the Nano-vLLM engine, showing that ACache reduces recompute latency by up to 55.7% and improves end-to-end throughput by up to 1.68$\times$.
134. 【2608.26139】Syntax vs. Semantics: How Transformers Learn Deep Dependencies
链接：https://arxiv.org/abs/2608.26139
作者：Jiangrui Zhao,Xiaoting Du
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Large Language, remarkable syntactic fluency, remain poorly understood, dependencies remain poorly
备注：
点击查看摘要
Abstract:Large Language Models demonstrate remarkable syntactic fluency, yet the optimization dynamics governing their acquisition of deep semantic dependencies remain poorly understood. We propose a mechanistic framework that models this learning process as a competition between Surface Statistics and Deep Semantics. Our theoretical analysis identifies a ``Gradient Starvation" phenomenon where the error signals for sparse semantic dependencies are actively suppressed during early optimization. This suppression impedes the learning of structural reasoning and causes its emergence to manifest as a sudden phase transition. Furthermore, this framework offers a mechanistic basis for the effectiveness of Chain-of-Thought (CoT) strategies. By externalizing intermediate reasoning steps into concrete tokens, CoT effectively bypasses the suppression regime inherent to implicit reasoning. We validate these findings across scales ranging from toy transformers to production models (Llama-3.1-8B, Qwen2.5-Coder-7B). Finally, guided by this theory, we propose a topology-aligned contrastive objective that explicitly rectifies the gradient geometry. Experiments on variable binding tasks demonstrate that our method achieves an improvement that is over 2x larger than that obtained via standard cross-entropy fine-tuning.
135. 【2608.26138】Cross-Platform Generalisation Failure in Mental Health Natural Language Processing: A Five-Axis Fairness Audit of Transformer Models on Social Media
链接：https://arxiv.org/abs/2608.26138
作者：Rajveer Singh Pall,Sameer Yadav
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Cross-Platform Fairness Evaluation, Fairness Evaluation, five-axis audit protocol, audit protocol covering, protocol covering discriminative
备注： 15 pages, 24 figures, 10 tables. Submitted to IEEE Transactions on Neural Networks and Learning Systems
点击查看摘要
Abstract:We introduce the Cross-Platform Fairness Evaluation (CPFE) framework -- a five-axis audit protocol covering discriminative performance, calibration, statistical significance, prediction equity, and attribution stability -- and apply it to four transformer models (BERT, RoBERTa, Emotion-DistilRoBERTa, GoEmotions-RoBERTa) trained on a Kaggle mental health corpus (n=35,556) and evaluated on Reddit (n=6,257) and Twitter (n=2,883) test sets with emotion labels mapped to clinical proxies. All three independently evaluated models exhibit consistent and substantial cross-platform AUC degradation (30.3-35.4% on Reddit, 37.9-39.5% on Twitter) relative to within-platform performance (AUC 0.983-0.987), confirmed across five independent training seeds. Calibration failure is concurrent and severe: ECE rises from 0.056-0.060 in-domain to 0.196-0.229 on Reddit and 0.499-0.542 on Twitter. Platform-specific temperature scaling reduces mean ECE by 88.0% without altering discriminative performance (mean |delta AUC|0.01), confirming separable failure modes. Prediction equity analysis reveals large cross-platform disparities (raw DI 0.17; prior-shift-adjusted DI: 0.11-0.29 on Reddit), with equalized odds differences of 0.753-0.830 for mental health proxy classes on Reddit and 0.755-0.831 for anxiety on Twitter. Attribution stability analysis shows near-complete vocabulary divergence across platforms (Jaccard J=0 in 14/16 model-class pairs at K=10). These findings support treating cross-platform validation across all five CPFE axes as a standard requirement for mental health NLP systems in heterogeneous environments. In a single-seed fine-tuning experiment, mean AUC improved by 0.216, suggesting target-platform labels provide greater benefit as training signal than as calibration signal.
136. 【2608.26137】Interpretable, Fairly Evaluated Automated L2 Speaking Assessment that Beats the Single-Human Ceiling and Why Pause Encoding Does Not Change LLM Fluency Scores
链接：https://arxiv.org/abs/2608.26137
作者：Eichi Uehara
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
关键词：rarely rehearse speaking, rarely rehearse, English learners, rehearse speaking, Global Rating Archive
备注： 17 pages, 3 figures, 5 tables
点击查看摘要
Abstract:Second-language (L2) English learners can rarely rehearse speaking with a partner. Speaking is also the most anxiety-laden skill. These gaps drive a fast-growing market for automated speaking practice and scoring. But an automated score is trustworthy only if it is accurate, interpretable, fair, and benchmarked against the right human bar. We build an interpretable feature-plus-LLM hybrid for spontaneous L2 dialogue. We evaluate it without ever fitting to the human labels, against the ICNALE Global Rating Archive: 140 speeches rated by ~80 trained raters on 10 analytic criteria. We score the 130 L2 speeches with usable audio. A deterministic De-Jong speech-timing composite reaches rho=0.764. Blended with a single text-LLM fluency judgment, it reaches Spearman rho=0.818 against the consensus gold. This agrees with the consensus better than 81% of the 80 individual trained raters: above the median rater (rho=0.73) and near the best, and at ~83% of the reliability-corrected maximum (kappa_max=0.99). The blend improves on the composite alone by +0.054 (paired-bootstrap 95% CI [0.017, 0.108], excludes 0); the LLM adds a coarse fluency ranking that the continuous composite refines. We also report a controlled null on pause encoding, bounded to effects below about +/-0.1 rho at this sample size. Holding the LLM and learner words fixed and varying only how pauses are written into the prompt, inline pause locations do not beat aggregate pause statistics (-0.069, CI [-0.15, +0.08]), and a grounded mid-clause criterion gives no reliable gain. The fluency signal comes from the measured speech-timing features, not from how pauses are written for the LLM. We back every claim with two agreeing learner-isolation methods, paired-bootstrap CIs, a monologue negative control, per-feature reproduction of classical measurements, and a per-L1 fairness audit.
137. 【2608.26136】Reward-Informed Sparse Autoencoders and the Solution-Completeness Confound
链接：https://arxiv.org/abs/2608.26136
作者：Tanvi Nagilla,Alexander Jameson,Daniel Manta,Shayaan Uddin
类目：Computation and Language (cs.CL)
关键词：decompose language-model activations, signal reinforcement learning, decompose language-model, learning already produces, curate their data
备注： 6 pages, NEMI
点击查看摘要
Abstract:Sparse autoencoders (SAEs) decompose language-model activations into sparse, interpretable features, and an appealing way to aim them at reasoning is to curate their data with a signal reinforcement learning already produces: the reward. We build such a reward-informed SAE (RI-SAE): we split GRPO trajectories into high-reward ("good") and low-reward ("bad") reasoning continuations, train a standard JumpReLU SAE on their activations, and then ask what the resulting good/bad separation actually measures. On Llama-3.1-8B a sparse subset of the 16,384 features does separate the classes (silhouette 0.79 on the selected features versus 0.005 for the full code), but a control battery shows the separation is largely solution completeness rather than reasoning quality: a TF-IDF text classifier already splits the classes (AUC 0.75--0.83), and three structural cues alone (length, a closed reasoning block, and a boxed answer) reach AUC 0.70 (99% of good versus 69% of bad completions are boxed). A generic SAE that never saw the reward does not separate the classes at all (silhouette 0.01, no discriminative features), so the 0.79 is in-sample fitting of this curated signal rather than structure that a reward-blind dictionary recovers. We therefore present the recipe and its control battery together: reward filtering is a cheap, label-free way to reuse RL signals for interpretability, but most of what it surfaces is completion form. Two discriminative features are still readable (symbolic mathematics; procedural and evaluative language), which we take as illustrative rather than as isolated reasoning.
138. 【2608.26135】Data Science Approaches to Evaluating Honours Candidates
链接：https://arxiv.org/abs/2608.26135
作者：Francesca von Braun-Bates,Sunreeta Sen,Indraayudh Talukdar,Anirban Lahiri
类目：Computation and Language (cs.CL)
关键词：unstructured open-source intelligence, modular data-science pipeline, unstructured open-source, open-source intelligence, present a modular
备注： 13 pages, 6 figures, corrects typographical errors from published version and includes full-colour figures
点击查看摘要
Abstract:We present a modular data-science pipeline for estimating public sentiment towards individuals from fragmented, unstructured open-source intelligence (OSINT). The method chains web search, text extraction, relevance filtering, tokenisation, co-reference resolution, and sentiment analysis to convert heterogeneous web material into auditable person-level sentiment distributions. We compare AFINN and VADER with MINOS, a domain-informed sentiment algorithm designed to detect language associated with reputational risk, misconduct, and positive public contribution. Applied to public figures with known reputational outcomes, MINOS gives the clearest separation between positive, ambiguous, and negative cases. The results show that chained NLP and OSINT methods can support transparent, reproducible, human-in-the-loop sentiment assessment for high-stakes decision support. We demonstrate the approach on the UK Honours system, where individuals are required to display high standards of public conduct to maintain an Honour.
139. 【2608.26133】Agent Seer: Synthesizing Scenarios from Specification Understanding
链接：https://arxiv.org/abs/2608.26133
作者：Harish Karumuri,Mahesh Vemula,David Lopes Pegna
类目：Computation and Language (cs.CL)
关键词：requires realistic test, external tools requires, practitioners compose tools, realistic test scenarios, tools requires realistic
备注：
点击查看摘要
Abstract:Evaluating AI agents that use external tools requires realistic test scenarios that capture how practitioners compose tools and iterate across conversation turns. Constructing such scenarios by hand demands deep domain expertise, does not scale across tool ecosystems, and produces static benchmarks that cannot track evolving APIs. We observe that tool specifications -- function names, natural-language descriptions, and typed parameter schemas -- already encode sufficient semantic information to synthesize realistic evaluation scenarios without manual curation or live tool execution. Agent Seer builds off this latent information: from a single Model Context Protocol (MCP) specification, with no examples, no live tool access, and no domain-specific tuning. This pipeline enriches raw schemas, generates graded scenarios with synthetic tool outputs, and expands them into mock-data-grounded multi-turn dialogues that exhibit strong tool-calling correctness and conversational coherence. Evaluation quality is measured by applying this pipeline on seven MCP specifications spanning diverse domains and tool-suite sizes and measuring the tool-calling correctness and conversational coherence. The pipeline achieves strong quality across all domains, with complete tool coverage on small and medium specifications. Two findings emerge within this analysis: parameter schema complexity is the strongest correlate of quality variation -- tool-suite size plays a smaller, orthogonal role -- and argument value accuracy is the dominant failure mode among imperfect scenarios, a sub-dimension invisible to coarse-grained name-match metrics.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.26133 [cs.CL]
(or
arXiv:2608.26133v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.26133
Focus to learn more
arXiv-issued DOI via DataCite</p>
140. 【2608.26132】SLM-Conditioned Hierarchical Relation Routing for Labeled Property Graph Learning
链接：https://arxiv.org/abs/2608.26132
作者：Michal Podstawski
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Labeled property graphs, Labeled property, categorical properties attached, combine relational structure, relational structure
备注：
点击查看摘要
Abstract:Labeled property graphs combine relational structure with heterogeneous textual and categorical properties attached to both nodes and relationships. Conventional graph neural networks typically represent these properties as static feature vectors, limiting their ability to determine which semantic evidence should influence message propagation for a particular prediction target. We propose SLM-Conditioned Hierarchical Relation Routing, an architecture that integrates a small language model directly into graph message selection. A topology GNN provides a stable structural representation and prediction anchor. For each target node, incident messages combine the neighbor's structural state, node-property encoding, relationship-property encoding, and relationship type. A parameter-efficient SLM processes structured graph soft tokens and produces a target-conditioned routing query. This query first selects relevant messages within each relationship type and subsequently routes information across relation-level summaries. The resulting representation provides a bounded residual update to the topology anchor, preserving structural evidence while allowing contextual semantic information to modify the prediction. The architecture supports interpretable analysis at both the neighbor and relationship-type levels and provides a general mechanism for integrating language-derived semantics into property-rich graph learning.
141. 【2608.26131】Evaluating Language Models in Realistic Conversational Contexts
链接：https://arxiv.org/abs/2608.26131
作者：Ilija Subasic,Andrew Rabinovich,Zhao Chen
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Language Models, Large Language, multi-turn interactions, serve open-ended
备注： International Conference on Machine Learning 2026
点击查看摘要
Abstract:As Large Language Models (LLMs) are increasingly deployed to serve open-ended, multi-turn interactions, evaluating conversational quality at human scale has become a central challenge. Existing evaluation frameworks built for summarization, translation, or short-form QA tasks fall short of adequately measuring the consistency of human-scale dialogue, especially when derivation and validation of these metrics themselves often rely on synthetic rather than human sources. We fill the gap by introducing UPHELD (UPwork Human-Scale Evaluated Long Dialogues), a large, reference-full benchmark for evaluating human-scale conversational ability beyond factual correctness. UPHELD consists of hundreds of complete human-to-human dialogues authored by professional script writers, with realistic turn densities and 36,000+ per-turn human annotations across 30,000+ expert-generated dialogue turns. Using UPHELD, we systematically evaluate classical automatic metrics and reference-free LLM-as-a-judge approaches, and find them unreliable when correlated with expert human judgment. Building off this analysis, we use UPHELD to develop a Mixture-of-Judges framework that combines multiple evaluative signals and improves correlation with human assessments by approximately 30%. Overall, UPHELD provides a robust, human-grounded foundation for evaluating human-scale conversational intelligence that fills a crucial gap in the pre-existing LLM dataset landscape.
142. 【2608.26130】Agents Don't Paginate: First-Chunk Selection for LLM Tool Responses
链接：https://arxiv.org/abs/2608.26130
作者：Tatiana Petrova,Andrei Mazniak,Radu State
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Coding agents built, Claude Code, per-turn token budget, agent per-turn token, OpenAI Codex
备注：
点击查看摘要
Abstract:Coding agents built on large language models (LLMs), such as Claude Code, Cursor, OpenAI Codex, GitHub Copilot, and Aider, receive tool responses that routinely exceed the agent's per-turn token budget. The standard remedy, pagination, is available in every protocol that produced these responses; yet across the corpus of session logs from a public Model Context Protocol middleware we observed no agent-initiated requests for a second chunk. The first chunk is what the agent reads, so we ask how often the gold item (the one the agent needs) is placed first in it: the precision-at-1 rate $p_1$. In a controlled offline benchmark we treat first-chunk selection as a 0/1 knapsack and compare six value functions on 500 SWE-bench Verified tasks, then test whether $p_1$ matters with a single-turn file-localisation probe on five language models (4,800 LLM calls; not an end-to-end resolve-rate test). Two pre-registered hypotheses did not hold and are our main findings. The central one is negative: raising $p_1$ does not systematically raise downstream accuracy. Per-model deltas stay under three percentage points (p.p.), are not consistently signed, and no model is significant; the agent recovers the gold from anywhere in the chunk, so what reaches its answer is first-chunk inclusion, not the gold's rank within it. The second: adding four file-metadata signals to a keyword scorer hurts $p_1$ by 4.8 p.p. (paired significance test, $p = 0.001$). A parameter-free keyword scorer does raise $p_1$, from a 24.2% baseline to 35.0% (+10.8 p.p., far beyond chance; $p = 3.9 \times 10^{-8}$), and to 35.8% with a fallback to the tool's native ordering when no keyword matches. But by our central finding this is a rank-1 gain, and rank-1 is the part that does not reach the agent's answer: downstream accuracy does not move.
Subjects:
Computation and Language (cs.CL); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.26130 [cs.CL]
(or
arXiv:2608.26130v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.26130
Focus to learn more
arXiv-issued DOI via DataCite</p>
143. 【2608.26129】FIRSTPASS: A Multi-Domain, Multi-Round Peer Review Dataset Grounded in Real Editorial Outcomes
链接：https://arxiv.org/abs/2608.26129
作者：Prabhjot Singh,Somnath Luitel,Manmeet Singh,Josh Durkee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Nuclear Magnetic Resonance, question Nuclear Magnetic, chemist question Nuclear, Machine Learning venues, Magnetic Resonance
备注： Accepted at the AI for Science Workshop at the 43rd International Conference on Machine Learning (ICML 2026), 3 pages, 1 figure, 1 table
点击查看摘要
Abstract:Scientific peer review datasets have trained AI systems exclusively on Computer Science and Machine Learning venues, producing models that critique ablation studies yet have never seen a biology reviewer demand contamination controls or a chemist question Nuclear Magnetic Resonance (NMR) spectral assignments. We introduce FIRSTPASS, the first large-scale peer review dataset built on complete multi-round editorial dialogues from a multidisciplinary high-impact journal. Curated from Nature Communications mandatory transparent peer review (instituted November 2022), FIRSTPASS comprises 3,668 records spanning five scientific domains (biology, chemistry, neuroscience, physics, and earth science), capturing the full iterative structure of scientific validation: initial referee reports, author point-by-point responses, and updated reviewer assessments. Each record carries an outcome label derived directly from editorial decisions (STANDARD for two-round review; EXTENDED for three or more rounds), providing ground truth absent in all prior corpora. An automated audit confirms 100% content integrity. Expert reviews average 2,155 words, substantially denser than conference venue reviews. All data, parsing pipelines, and evaluation scripts are released to enable reproducible benchmarking of AI scientific judgment across disciplines.
144. 【2608.26126】comGPT-R1: A Unified Open-Source Reasoner for the Telecom Stack
链接：https://arxiv.org/abs/2608.26126
作者：Bohao Wang,Chenwei Wu,Haoyu Li,Hang Zou,Yu Tian,Lina Bariah,Li Wei,Chongwen Huang,Yongliang Shen,Zhaoyang Zhang,Merouane Debbah
类目：Computation and Language (cs.CL); Information Theory (cs.IT)
关键词：large language model, routine engineering workflows, engineering workflows require, workflows require joint, vendor-specific fault evidence
备注：
点击查看摘要
Abstract:Telecommunications is a high-leverage domain for large language model (LLM)-based reasoning because routine engineering workflows require joint grounding in normative specifications, operational telemetry, vendor-specific fault evidence, and exact RF/network calculations. However, current LLM integration in telecom remains bottlenecked by a two-sided capability gap: generic reasoners often lack telecom-specific grounding, while domain-specific telecom LLMs remain limited in structured, multi-step reasoning. To bridge this gap, we release TelecomGPT-R1-9B, a unified open-source telecom reasoner that ranks top-performing on the GSMA open telco leaderboard. Specifically, we curate a 67,427-example supervised fine-tuning (SFT) corpus organized around four complementary reasoning axes: protocol, knowledge, modeling, and fault. The corpus is built from axis-matched public web sources and enhanced through axis-specific chain-of-thought (CoT) generation and prefix-continuation self-validation. Starting from Qwen3.5-9B, we further develop a two-stage post-training recipe. First, multi-teacher low-rank adaptation (LoRA)-based SFT injects telecom knowledge and induces axis-specific reasoning formats. Second, group relative policy optimization (GRPO), stabilized by decoupled clip and dynamic sampling policy optimization (DAPO), optimizes the policy using four axis-aligned binary verifier rewards. Across seven public telecom benchmarks, TelecomGPT-R1-9B ranks first among open-source telecom LLMs and achieves a seven-axis mean comparable to state-of-the-art closed-source frontier reasoners.
145. 【2608.26125】raining-Time Explainability for Multilingual Hate Speech Detection: Aligning Model Reasoning with Human Rationales
链接：https://arxiv.org/abs/2608.26125
作者：Muhammad Deedahwar Mazhar Qureshi,Sannaan Khan,Muhammad Atif Qureshi,Wael Rashwan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Muslim communities, Online hate, forms that evade, evade conventional, culturally coded
备注： Accepted at NeurIPS Workshops 2025
点击查看摘要
Abstract:Online hate against Muslim communities often appears in culturally coded, multilingual forms that evade conventional AI moderation. Such systems, though accurate, remain opaque and risk bias, over-censorship, or under-moderation, particularly when detached from sociocultural context. We propose a \emph{training-time} explainability framework that aligns model reasoning with human-annotated rationales, improving both classification performance and interpretability. Our approach is evaluated on HateXplain (English) and BullySent (Hinglish), reflecting the prevalence of anti-Muslim hate across both languages. Using LIME, Integrated Gradients, Grad X Input, and attention, we assess accuracy, explanation quality, and cross-method agreement. Results show that gradient- and attention-based regularization improve F-scores, enhance plausibility and faithfulness, and capture culturally specific cues for detecting implicit anti-Muslim hate, offering a path toward multilingual, culturally aware content moderation.
146. 【2608.26124】Natural-Language Policies to Executable Decisions: An Interpretable Large Language Model Framework
链接：https://arxiv.org/abs/2608.26124
作者：Ziqiang Zhang,Jing Ma,Zilong Wang,Jiayuan Chen,Yi Qiao,Yu He,Wei Zhang,Dai Cheng,Xiaoyu Shen
类目：Computation and Language (cs.CL)
关键词：highly unstructured, automation in large-scale, challenging because travel, Pricing automation, rapidly evolving
备注：
点击查看摘要
Abstract:Pricing automation in large-scale tourism is challenging because travel orders are highly unstructured, while pricing policies are complex, rapidly evolving, and inherently open-ended. Traditional rule engines are brittle and costly to maintain, whereas unconstrained LLM agents lack the reliability and auditability required for financial decisions. We present a production-grade LLM-powered pricing system with a strict decision boundary: LLMs perform structured extraction and bounded policy/path selection, while all numeric pricing, including total-price computation, is executed deterministically. Policies are compiled into interpretable condition trees, enabling open-ended support for new clauses and evolving rules without code changes, while exposing auditable artifacts for human-in-the-loop control. Periodic fine-tuning on logged traces further improves tree induction and path matching. Deployed at a municipal state-owned tourism enterprise across 7 scenic sites and 12 business categories with 1,500+ operators and 1,000+ active policies, the system processed 3,960 orders in six months, reduced the order management team from 15-20 to 3, and cut per-order handling time from 10 minutes to 2 minutes.
147. 【2608.26123】Which India Survives Translation? Narrative Homogenisation Across Indian Oral Traditions in LLMs
链接：https://arxiv.org/abs/2608.26123
作者：Paarth Singh Rathore
类目：Computation and Language (cs.CL)
关键词：Large language models, English-language internet text, single homogenized archetype, predominantly on English-language, English-language internet
备注：
点击查看摘要
Abstract:Large language models (LLMs) are trained predominantly on English-language internet text that over-represents certain cultural narratives, raising concerns that models flatten the diversity of non-Western storytelling traditions into a single homogenized archetype. We present a pilot computational study examining this across three maximally distinct Indian regional oral and literary traditions: the Rajasthani Pabuji epic, classical Tamil Sangam poetry, and Bengali folk tales. We collected authentic reference corpora for each tradition (11, 21, and 10 passages respectively) and prompted two LLMs (Claude Sonnet and Gemini) with 54 generation requests spanning three prompt types per tradition - generic, culturally specific, and regional-language. Using Sentence-BERT embeddings and cosine similarity, we measure reference drift (how closely outputs track their own tradition's authentic texts relative to the other two) and cross-tradition convergence (how similar outputs are across traditions). We find that while outputs remain closer to their own tradition's reference than to others, cross-tradition similarity is high (0.52-0.66) relative to what the traditions' genuine distance would predict, indicating partial homogenisation. Unexpectedly, prompting in the regional language (Hindi, Tamil, or Bengali) consistently reduced fidelity to the authentic tradition relative to English prompting, by as much as 27 percentage points for Rajasthani and Bengali traditions. We discuss this against conflicting prior results on multilingual prompting and argue it reflects a difference between eliciting general cultural diversity and simulating one narrow, lesser-documented oral tradition. We position this pilot as a lightweight, scalable complement to recent large-scale human-annotation studies of Indian cultural misrepresentation in LLM-generated stories, as part of a broader doctoral research program.
148. 【2608.26121】Can a Model Catch Its Own Hallucinations for Free?: Label-Free Doubt Signals Hold Their Own Against a Labelled Dataset for Abstention
链接：https://arxiv.org/abs/2608.26121
作者：Ali Asaria,Tony Salomone,Deep Gandhi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, language models state, models state false, state false facts
备注：
点击查看摘要
Abstract:Large language models state false facts as fluently as true ones, yet a model often "knows" internally when it is on shaky ground: the probability it assigns to its own answer tends to dip on the facts it gets wrong. The usual way to act on this, teaching a model to abstain rather than guess, requires a labelled dataset of right and wrong answers. We ask whether the model's own confidence, which is free and needs no labels, can do that job instead. We fine-tune each model (with LoRA) to answer when its frozen confidence is high and to say "I'm not sure" when it is low, using the signal alone and no correctness labels. Across six open-weights models (1B-8B, two families) on short-form factual question answering, with correctness adjudicated by an independent judge model, this label-free recipe holds its own against label-supervised abstention-tuning: at matched coverage we find no statistically detectable difference between the two. A control that drills hard examples instead of abstaining does not help, indicating the gain comes from calibration, not rote memorization. The signal's one blind spot is confidently wrong facts, which it cannot flag. A model's own doubt is thus a near-free substitute for a labelled dataset when teaching it when to abstain. Code and artifacts are available on request.
149. 【2608.26120】Recipes for Steering and Scaling LLMs via Sampling
链接：https://arxiv.org/abs/2608.26120
作者：Jiajun He,Zongyu Guo,José Miguel Hernández-Lobato,Yuanqi Du
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Language Models, Large Language, Language Models, typically defined, Sequential Monte Carlo
备注： 13 pages
点击查看摘要
Abstract:Large Language Models (LLMs) are probabilistic models, typically defined by an autoregressive factorization. While recent work has begun to study richer target distributions beyond the base model, the sampling strategies remain highly inefficient. In this paper, we present a flexible and theoretically grounded framework for steering and scaling autoregressive LLMs with sampling. Within this framework, we describe two algorithms -- one based on Sequential Monte Carlo (SMC) and one based on Replica Exchange (RE) -- that steer generation toward powering, product or tilting of the base model distribution. We illustrate this framework through scaling the generation quality of LLMs without external supervision or reward models. Experimental results demonstrate our methods scale more favorably than Best-of-N and standard MCMC baselines. Overall, this paper offers a systematic recipe for probabilistic inference with LLMs via sampling.
150. 【2608.26119】DeflectBench: A Benchmark for Evaluating Rhetorical Fallacy Generation in LLMs
链接：https://arxiv.org/abs/2608.26119
作者：Art Kanke
类目：Computation and Language (cs.CL)
关键词：generate rhetorical fallacies, current safety post-training, safety post-training constrains, large language models, existing text
备注： 15 pages. Accepted at the CTB, FAGEN, and AI4GOOD workshops at ICML 2026 in Seoul, South Korea. Code and dataset: [this https URL](https://github.com/ArtKanke/DeflectBench)
点击查看摘要
Abstract:Whether large language models can be prompted to generate rhetorical fallacies on demand, and whether current safety post-training constrains this behavior, has received less attention than the related question of detecting fallacies in existing text. We close this gap with DeflectBench, evaluating 23,990 generations from four frontier models across three deflection strategies (whataboutism, ad hominem, red herring), seven prompt framings, and 80 claims spanning four controversy levels. Refusal is governed primarily by request structure rather than claim content. Per claim refusal varies by only 11 percentage points across the 80 claims, while a single prompt frame change can swing within model refusal by nearly 100 percentage points and switching the requested fallacy type can swing it by over 80 percentage points within explicit framings. An educational debate coach prompt framing collapses refusal to near zero across all four model families, but the bypassed behavior is not clean compliance. Models typically produce labeled compliance, naming the requested manipulation in the same response that contains it. The four models distribute differently across refusal, labeled compliance, soft refusal, and clean compliance. The code and dataset are released at this https URL.
151. 【2608.26118】ElementCheck: Complexity-Aware Long-Form Text Factuality Evaluation via Sentence Elements
链接：https://arxiv.org/abs/2608.26118
作者：Xinming Wang,Haoran Du,Yi Chen,Jian Xu,Hongming Yang,Han Hu,Yulong Chen,Cheng-Lin Liu,Xu-Yao Zhang
类目：Computation and Language (cs.CL)
关键词：Existing long-form factuality, Existing long-form, Existing, factuality evaluation relies, verification
备注： 25 pages, 4 figures
点击查看摘要
Abstract:Existing long-form factuality evaluation relies on the decompose-retrieve-verify pipeline. However, the pipeline suffers from noise from claim decomposition and fixed verification granularity, resulting in unreliable results. We propose ElementCheck, a complexity-aware framework that verifies long-form outputs via sentence elements. Instead of uniformly decomposing sentences into atomic sub-claims, ElementCheck extracts entity pairs that are explicitly linked through verifiable connections in the original sentence as elements, and organizes these into an element graph. The graph topology provides a structural signal for estimating sentence complexity, enabling direct verification for simple sentences and targeted element-level refinement and verification for complex ones. To support fine-grained evaluation, we construct a new benchmark FastFact-Sent by mapping isolated claims from FastFact-Bench back to their source sentences. Experiments on FastFact-Sent and two domain-specific benchmarks show ElementCheck consistently improves factuality verification across five backbone models while maintaining a favorable accuracy-cost trade-off. Further analyses demonstrate that complexity-aware verification reduces unnecessary re-verification and maintains stability across different backbones.
152. 【2608.26114】CIFQA: A Deterministic Tool-Grounded Multi-Agent LLM Framework for Financial Query Answering
链接：https://arxiv.org/abs/2608.26114
作者：Kunjesh Parekh,Anil Kumar Tiwari,Divya Saxena
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computational Finance (q-fin.CP)
关键词：temporal conditions, question answering requires, financial question answering, rule-based constraints, financial
备注： 16 pages, 5 figures, submitted for academic dissemination
点击查看摘要
Abstract:Calculation-intensive financial question answering requires exact reasoning over structured rates, temporal conditions, numerical formulas, and rule-based constraints. Although Large Language Models (LLMs) perform strongly on natural language tasks, they often produce numerically incorrect yet plausible answers when solving multi-step financial calculations. To address this limitation, we introduce CIFQA (Calculation-Intensive Financial Query Answering), a deterministic tool-grounded multi-agent LLM framework for financial question answering. CIFQA separates language understanding from numerical execution by assigning specialized agents to query interpretation, routing, parameter extraction, computation planning, and response generation, while deterministic Python-based tools perform financial calculations and rule application. We instantiate CIFQA for fixed deposit query answering and evaluate it on a curated benchmark of fixed deposit queries. CIFQA achieves 95.54% accuracy on calculation-intensive queries and 90.87% overall accuracy, substantially outperforming direct LLM baselines even when provided with complete formulas, rate cards, and benchmark instructions. Ablation studies show that deterministic components such as exact rate lookup, tenure computation, rolling-year adjustment, and premature-withdrawal logic are critical contributors to performance. Notably, a 17B open-source backbone operating within CIFQA outperforms substantially larger frontier models evaluated with the same financial information, demonstrating that architectural design is a more important determinant of numerical reliability than model scale. While evaluated on fixed deposit queries, CIFQA provides a generalizable framework for calculation-intensive financial reasoning tasks.
153. 【2608.26112】reeGraft: Adaptive Multi-Drafter Grafting for Tree-Based Speculative Decoding
链接：https://arxiv.org/abs/2608.26112
作者：Jiaming Fan,Daming Cao,Canchen Huang,Jiale Fu,Jin Zhang,Junjie Gao,Kai Yang,Xiangzhong Luo,Xu Yang
类目：Computation and Language (cs.CL)
关键词：Speculative decoding accelerates, decoding accelerates large, accelerates large language, Speculative decoding, large language model
备注：
点击查看摘要
Abstract:Speculative decoding accelerates large language model inference through a draft-then-verify paradigm. Building on this, tree-structured methods improve inference by organizing proposals into multiple candidate paths, increasing the accepted length. However, existing tree-structured methods use a single drafter for all drafting steps, creating a dilemma: a smaller drafter is fast but yields lower-quality trees, whereas a larger drafter improves tree quality but suffers from high latency. To address this, we propose TreeGraft, a multi-drafter framework in which drafters of different costs jointly construct a shared draft tree. TreeGraft uses the stronger drafter to rescore candidates by updating scores assigned by the weaker drafter, reselect grafting positions, and recover promising paths left unexplored. It also integrates stronger drafter expansions non-destructively, preserving existing branches that may still be accepted by the target model. Together, these designs improve the quality of the shared draft tree. To control the drafting cost, TreeGraft introduces a lightweight scheduler distilled from an offline value system to decide when to call the stronger drafter. Across 10 model pairs and 6 benchmarks, TreeGraft outperforms the better of the two fixed single-drafter endpoint strategies by 15.1% on average, reaching a maximum gain of 26.6%. Our code is available at this https URL.
154. 【2608.26127】Graph-Based Modeling of Financial Volatility Dynamics
链接：https://arxiv.org/abs/2608.26127
作者：Chuanzhen Wang,Alice Zhang,Wei Chen,Michael Brown
类目：atistical Finance (q-fin.ST); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：derivatives pricing, crucial for risk, risk management, management and derivatives, Graph Spatio-Temporal Network
备注： 15 pages
点击查看摘要
Abstract:Accurate forecasting of realized volatility ($RV$) is crucial for risk management and derivatives pricing. Although the implied volatility ($IV$) surface offers rich informational content, prevailing methods that treat it as a static image fail to capture its inherent dynamics. To overcome this limitation, we propose the Finance-Aware Graph Spatio-Temporal Network (FA-GSTN), a novel architecture that reframes $RV$ forecasting as modeling the evolution of a structured financial object. FA-GSTN builds a spatio-temporal graph sequence from the $IV$ surface, where nodes correspond to grid points and edges encode adaptive spatial (intra-day) and explicit temporal (inter-day) dependencies. The model incorporates domain knowledge through finance-aware node features (e.g., option Greeks) and tackles high-frequency noise via a multi-scale temporal smoothing gate coupled with an adaptive robust loss function. Comprehensive evaluations on a large-scale equity options dataset show that FA-GSTN sets a new state of the art, delivering superior predictive accuracy ($R^2$ up to 0.473). It also demonstrates remarkable data efficiency, substantially outperforming strong Vision Transformer baselines when trained on only one year of data ($R^2$: 0.372 vs. 0.315). Furthermore, the model exhibits enhanced robustness during periods of market stress, such as 2020--2021. Ablation studies confirm the vital roles of the spatio-temporal graph structure, finance-aware components, and integrated noise-handling modules. Our work underscores the substantial benefits of explicitly modeling temporal dynamics and infusing financial inductive biases for accurate and robust volatility forecasting.
信息检索
1. 【2608.27422】misi: a Metric Inverted Sample Index
链接：https://arxiv.org/abs/2608.27422
作者：Edgar Chavez
类目：Information Retrieval (cs.IR)
关键词：approximate nearest-neighbor search, general metric spaces, present misi, approximate nearest-neighbor, nearest-neighbor search
备注： 14 pages. Links to code
点击查看摘要
Abstract:We present misi, an inverted index for approximate nearest-neighbor search over general metric spaces whose vocabulary is a random sample of the database, of size proportional to $n$. Each object is represented by its $k_b$ nearest sample points, found by a pluggable inner index over the sample; queries are answered by an idf-weighted shared-neighbor vote followed by exact verification of $C$ candidates. The construction generalizes the NAPP index from a constant number of pivots to a linear-size vocabulary, which keeps posting lists at constant expected length $\rho = k_b/\alpha$ as $n$ grows and turns the index into a combinator: any high-recall index on $\alpha n$ points yields an index on $n$ points, for any metric. A probabilistic model gives a recall guarantee -- $k_b$ logarithmic in $n$ over the overlap gap suffices, with a verification budget the index itself estimates -- and a matching limit: the vote cannot resolve overlap differences below order $1/\sqrt{k_b}$. The design's strengths are structural: construction is $n$ independent searches -- embarrassingly parallel, deterministic, $5{,}250$ s for $10^8$ vectors on 64 cores, $3.7\times$ faster than a matched-recall graph build -- it streams under an enforced 3 GiB cap, and the portable artifact serves $10^8$ vectors from NVMe within an enforced 8 GB budget, below the working floor of the SSD-graph baseline. Its cost is query-time work: saturated graph baselines answer $6$-$16\times$ faster in RAM, and the verification budget for 0.99 recall grows as $n^{0.30}$. All results carry seeds, saturation sweeps and full configurations, are generated from run manifests, and include measured negative results. The intended applications weight construction cost, determinism, memory footprint, or black-box metrics over peak throughput: frequently rebuilt corpora, batch similarity workloads, constrained-memory serving.
2. 【2608.27413】Scaling Graph Neural Networks for Friend Recommendation: Multi-Hash User Embeddings and Temporal Neighbor Sampling
链接：https://arxiv.org/abs/2608.27413
作者：Maksim Utushkin,Andrei Ovsiannikov,Alexander D'yakonov
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG); Social and Information Networks (cs.SI)
关键词：potential connection depends, multi-hop social context, inherently graph-structured, potential connection, connection depends
备注： 12 pages, 4 figures, 8 tables; accepted at the 35th ACM International Conference on Information and Knowledge Management (CIKM 2026); code: [this https URL](https://github.com/makut/VK-GNN)
点击查看摘要
Abstract:Friend recommendation is inherently graph-structured: the relevance of a potential connection depends on multi-hop social context rather than user attributes alone. However, deploying message-passing GNNs on a production-scale social graph with hundreds of millions of users and tens of billions of edges requires addressing numerous modeling and systems challenges. We present a scalable end-to-end GNN ranking system for production social graphs, focusing on two design choices that are critical in this setting: multi-hash ID embeddings and temporal neighbor sampling. Multi-hash embeddings are common for high-cardinality features, but industrial GNN systems typically either ignore trainable IDs or accept full embedding tables, exceeding 200 GB for our graph. We integrate multi-hash as the primary node representation, reducing the ID-embedding table size by more than 98 percent while preserving ranking quality. Temporal neighbor sampling is well understood in principle, but existing implementations scan full adjacency lists, which is a non-starter for users with tens of thousands of friends. We implement timestamp-sorted CSR storage with binary search, reducing the per-node temporal sampling cost from $O(deg(v) + k)$ to $O(\log(deg(v)) + k)$. Beyond these components, we show that this combination scales and yields measurable production impact. On a graph with 194M users and 28B edges, offline ablations isolate each design choice's contribution. In an online A/B test, our system increases friend additions from recommendations by 16 percent and unique friend adders by 11.5 percent over a strong production baseline. We release our framework for distributed training and inference on large temporal graphs.
3. 【2608.27394】RATIO: A Benchmark for Retrieval Across Typed Ideation Operations in Scientific Literature
链接：https://arxiv.org/abs/2608.27394
作者：Maayan Sharon,Tom Hope
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Retrieved scientific literature, Retrieved scientific, Retrieved, Typed Ideation Operations, RATIO
备注：
点击查看摘要
Abstract:Retrieved scientific literature can serve as inspiration for both human and AI scientists. Inspiration can take different forms: prior work may directly suggest how to address a problem, or surface directions at different levels of abstraction - zooming out to a more general view or zooming in to a concrete realization. We introduce RATIO (Retrieval Across Typed Ideation Operations), a large-scale benchmark in which relevance is defined by three operations which we name ideation moves: Address retrieves potential approaches for stated problems, Broaden retrieves more general formulations, and Specify retrieves concrete instantiations. RATIO is constructed from millions of full-text scientific papers across CS literature via a general recipe that extends discourse-marker distant supervision - previously used only for classification - to corpus-scale retrieval, combined with extensive LLM and human vetting. Experiments show that operation-specific fine-tuning substantially boosts retrievers but leaves much room for further improvements. RATIO provides a scalable training and evaluation framework for retrieval components that support literature-grounded ideation, opening up new research avenues on scientific inspiration retrieval.
4. 【2608.27391】CorporateBench: Large-Scale QA Benchmarking with Temporal Knowledge Bases
链接：https://arxiv.org/abs/2608.27391
作者：Sil Hamilton,Albert Yu Sun,Oscar J. Romero,Carl-Leander Henneking,David Mimno,Bishan Yang,Igor Labutov
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：answer complex questions, enterprise-scale document collections, answer complex, complex questions, questions about enterprise-scale
备注： Accepted to EMNLP Findings
点击查看摘要
Abstract:LLMs are increasingly able to answer complex questions about enterprise-scale document collections. But evaluation is hard: companies don't want to share internal communications, and synthetic datasets have been overly simple. We present CorporateBench (CB), a human-validated multi-task QA benchmark whose scale approaches the conditions LLMs encounter in corporate communication networks, with evaluation corpora surpassing 230,000 documents. CB evaluates LLMs across two dimensions (information extraction and knowledge base querying) through four synthetically generated firms ranging from 12 to 10,000 employees. Each corpus is sampled from a temporally evolving knowledge base describing a consistent world, guaranteeing cross-document logical consistency even across hundreds of thousands of documents. We evaluate five LLMs on CB, revealing increasingly poor performance as input size approaches realistic scales. CB provides LLM developers a metric for corporate communication reasoning, filling a crucial gap in the benchmarking ecosystem.
5. 【2608.27366】Stageboost: Recommending Signals Based on Counterfactual Estimation
链接：https://arxiv.org/abs/2608.27366
作者：Darpan Singhal,Matan Mandelbrod,Tal Franji,Manasa Kolla,Vipul Gaba,Yuri Brovman
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：visual snippets displayed, providing additional, eBay View-Item, contextual information, short textual
备注： Accepted for Consequences 2026 workshop
点击查看摘要
Abstract:Signals are short textual or visual snippets displayed on the eBay View-Item (VI) page, providing additional, contextual information for users about the viewed item. The aim of displaying these signals is to facilitate intelligent purchase and to incentivize engagement. In this paper, we present a 2 stage xgboost based model that optimally populates the VI page with signals. This approach has shown a 0.08% lift in overall GMB (Gross Merchandise Bought) and 0.58% increase in Parts and Accessories GMB, primarily due to increase in conversion of high average price items in online experimentation.
6. 【2608.27287】Astar: Learning to Propose Evolution Directions for Self-Evolving Industrial AI Systems
链接：https://arxiv.org/abs/2608.27287
作者：Jinxin Hu,Hao Deng,Haibo Xing,Lingyu Mu,Muyu Zou,Weiqin Yang,Sirui Chen,Bohao Wang,Zhezheng Hao,Hao Zhang,Zulong Chen,Shizhun Wang,Yu Zhang,Xiaoyi Zeng,Jiawei Chen
类目：Information Retrieval (cs.IR)
关键词：implementing code, advance through continuous, proposing evolution directions, proposing effective evolution, Modern
备注：
点击查看摘要
Abstract:Modern AI systems advance through continuous iteration: a loop of proposing evolution directions, implementing code, training, and evaluation. While the latter three stages are increasingly automated, the starting point --- proposing effective evolution directions --- remains a critical bottleneck that still relies heavily on senior experts. In this work, we explore whether AI can take over this role. We find that general-purpose LLMs, even the advanced GPT-5.5, offer only generic and misaligned suggestions: the required expertise is accumulated through experience rather than explicitly codified, and thus hard to inject directly. To this end, we propose Astar, a training-based approach that learns a specialized evolution-guiding model from the abundant iteration histories of industrial systems. Realizing this idea, however, raises four challenges: sparse supervision, noisy data, a vast direction space, and prohibitively expensive verification. We address them along two fronts. On the data side, we design a pipeline that turns noisy historical commits into a large, clean evolutionary corpus via pairwise sample expansion and noise filtering. On the model side, we train the model through mid-training, SFT, and RL, guiding evolution direction generation with hierarchical hints and using the reward model in RL as a fast surrogate evaluator. Astar has been deployed in Alibaba's Lazada advertising system for evolution direction proposal. Astar-8B achieves a single-proposal success rate of 0.6786 in real-execution evaluation, far exceeding human experts (0.3229) and the strongest general-purpose LLM (0.3071). More importantly, Astar closes the loop and enables fully automatic iteration: it guided 20 consecutive iterations over two weeks, improving offline Hitrate@200 by 23.6%, while an online A/B test yielded relative lifts of 4.86% in GMV and 1.82% in advertising revenue.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2608.27287 [cs.IR]
(or
arXiv:2608.27287v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.27287
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
7. 【2608.27017】ProRetrieval: Learning to Orchestrate Hybrid Search via Executable Program Synthesis
链接：https://arxiv.org/abs/2608.27017
作者：Chengsong You,Zhen Sun,Yunhai Hu,Junwei Zhou,Xiaoyu Cao,Binyu Li,Ziyan Zhao,Weiyao Wang,Liren Lu,Zhijie Ye,Yumo Cao,Yitao Long,Yiwei Xu,Qiyi Jiang,Xuanyi Fu,Yufan Chen,Yilun Li,Rongkang Xiong,Yiran Zou,Nan Du
类目：Information Retrieval (cs.IR)
关键词：arbitrary Boolean logic, Boolean logic, composes structured constraints, arbitrary Boolean, Real-world retrieval
备注： 15 pages, 5 figures, 6 tables
点击查看摘要
Abstract:Real-world retrieval often composes structured constraints with semantic intents over text and images through arbitrary Boolean logic. Existing hybrid pipelines such as reciprocal rank fusion or self-querying retrievers admit only a fixed form of composition, while recent reinforcement-learning retrievers train the language model as a query generator for a single backend, leaving the orchestration of heterogeneous retrieval paths outside its action space. We propose ProRetrieval, which recasts the language model as a retrieval orchestrator: given a natural-language query, it synthesizes an executable program in a hybrid DSL interleaving SQL operators over structured fields with vector-retrieval primitives over text and images, with SQL itself providing the logical algebra that fuses heterogeneous candidate sets. We train Qwen3-4B with GRPO and DAPO under a hierarchical four-term reward, and evaluate on two new benchmarks built from Amazon products and Enron email. Our 4B model surpasses GPT-5.5 (Hit@1 0.81 vs. 0.69 on e-commerce; 0.91 vs. 0.86 on email) and Claude Opus 4.7 and a comprehensive suite of retrieval, LLM-augmented, structured-query, and graph-based baselines. Code: this https URL data: this https URL.
8. 【2608.27006】Conversational Recommendation over Live E-Commerce Catalogues with Self-Refreshing Retrieval
链接：https://arxiv.org/abs/2608.27006
作者：Ante Kapetanovic,Tomislav Duricic,Dionizije Fa,Andro Mercep,Emanuel Lacic
类目：Information Retrieval (cs.IR)
关键词：pre-indexed item collections, large language models, recommender systems based, Conversational recommender systems, language models
备注： ACM RecSys 2026, 3 pages, 2 figure, 1 table
点击查看摘要
Abstract:Conversational recommender systems based on large language models (LLMs) are usually evaluated on static, pre-indexed item collections, yet e-commerce catalogues change continuously as products are added or removed, repriced, and restocked. We present a merchant-agnostic, multi-turn conversational shopping assistant that operates over such live catalogues. Its central component is a self-refreshing retriever that ingests a merchant product feed, enriches the records, and synchronizes them into a vector index. On each run, per-item hashes identify which products are new, changed, deleted, or unchanged, so only the delta is processed rather than rebuilding the whole catalogue. A controller-based dialogue layer consumes this index, using an LLM only for intent classification and preference elicitation while retrieval, reranking, and diversity selection run as dedicated functions. Our demonstration is a WhatsApp shopping assistant in which catalogue changes reach the recommendations after the next successful sync. A live chatbot, documentation, and a recorded walkthrough are available at this https URL.
9. 【2608.27005】opology-Masked Unified Backbone for Joint Feature Interaction and Multi-Domain Sequence Modeling
链接：https://arxiv.org/abs/2608.27005
作者：Zhihao Zhu,Dezheng Han,Jikang Xia,Shuaishuai Guo
类目：Information Retrieval (cs.IR)
关键词：Large-scale post-click conversion, post-click conversion rate, Large-scale post-click, requires jointly modeling, prediction requires jointly
备注： Accepted to the TAAC-KDD Cup 2026 Workshop. Recipient of the Unified Block Innovation Award
点击查看摘要
Abstract:Large-scale post-click conversion rate (CVR) prediction requires jointly modeling heterogeneous feature interactions and dependencies over multi-domain user behavior sequences. Existing industrial ranking models usually handle these two aspects with separate modules. Recent unified architectures attempt to incorporate them into a single framework, but such unification often relies on coordination between modules and does not fully organize all information sources within the same interaction space. To address this problem, we propose MaskRec, a topology-masked unified token interaction architecture for feature interaction and multi-domain sequence modeling. MaskRec transforms heterogeneous features, multi-domain behavior sequences, and contextual signals into unified token representations, and further introduces learnable global memory tokens and domain-level memory tokens as information aggregation nodes. Based on this unified token space, MaskRec designs a structured attention mask, TopoMask, which selectively enables or blocks attention connections according to the structural differences and modeling requirements of different information sources. In this way, heterogeneous feature interaction and multi-domain sequence modeling are performed within the same topology-constrained attention process. In addition, MaskRec incorporates a dual-path interactive query generation module to inject candidate-conditioned user--item interaction signals before the unified backbone. Experiments on the Tencent Advertising Algorithm Competition dataset show that MaskRec achieves stable improvements over the official baseline, validating the effectiveness of the proposed unified framework for industrial CVR prediction.
10. 【2608.26895】When Memory Takes Gradients: Collaborative Vector Memory for Agentic Recommender Systems
链接：https://arxiv.org/abs/2608.26895
作者：Hanchong Chen,Xing Tang,Lingjie Li,Xiongfeng Shan,Xiuqiang He
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Agentic recommender systems, recommender systems ground, Agentic recommender, large language model, recommender systems
备注： 11 pages, 3 figures
点击查看摘要
Abstract:Agentic recommender systems ground each decision of a large language model (LLM) in a persistent memory of the user, and in existing agents that memory is text: a narrative written and maintained by further LLM calls. Text limits this memory in two ways. It is updated one rewrite at a time, so exploiting the full interaction history is prohibitively expensive; and collaborative evidence, graded similarity over an entire catalog, does not survive translation into sentences. We propose CoVeMem (Collaborative Vector Memory), which vectorizes the collaborative core of the agent's memory. Frozen LightGCN user and item states form the memory bank; at each decision, the candidate set itself retrieves the most relevant historical states, which enter the LLM's context as soft tokens alongside a light textual profile. Contrastive alignment to item-semantic anchors, followed by listwise co-training with masked candidates, teaches the model to read these states and to rank through them; a pointwise yes/no readout scores each candidate. Across four instruction-grounded recommendation benchmarks, CoVeMem matches or exceeds the strongest collaborative text-memory agent on 19 of 20 metric cells while requiring zero additional LLM calls for memory maintenance beyond the shared static profile, against per-interaction calls for text memory. The memory now takes gradients: the full interaction history, out of reach for text, becomes available as training data for what the agent remembers and for how it reads what it remembers.
11. 【2608.26762】Equal Ranking Quality, Different Decisions: Training Order-Consistent LLM Scorers
链接：https://arxiv.org/abs/2608.26762
作者：Markus Frohmann,Mahdiyar Alavi,Elizabeth Lingg,Navid Rekabsaz
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：LLM prompt, ranking quality, documents or responses, score candidate documents, LLM
备注： 9 pages main text, 45 pages total
点击查看摘要
Abstract:Rerankers, reward models and multi-document QA scorers score candidate documents or responses in one LLM prompt, so each score depends on their order. Such scorers are selected on ranking quality, but their scores determine a decision: what a score threshold retains, a reader answers, or a preference model selects. However, equal ranking quality does not imply equal decisions: on passage reranking, five trained scorers within 0.010 nDCG@10 retain sets that overlap by only 0.66-0.84 when reordered. A published reranker takes the highest retained-set F1 in our comparison and still overlaps by only 0.667. No prompt-time change we test removes that order dependence: the only one that gains ranking quality leaves all three decisions unchanged. Order-consistency SFT (OC-SFT) attenuates it in the weights, training a candidate's score not to depend on the order. It holds ranking quality and leads every decision-stability measure among trained scorers on all three tasks: it flips the reader's answer on 0.125 of permutation pairs against 0.149-0.164 for three other objectives that target order. It is more stable than order-averaged distillation on 12 base models, and one OC-SFT permutation retains sets that overlap more than ten averaged off-the-shelf permutations. A comparison should therefore report what a threshold retains and a reader answers, not ranking quality alone. Code is available at this https URL.
12. 【2608.26754】STREAM: An Objective-Driven and Uncertainty-Aware Framework for Industrial Energy Data Acquisition
链接：https://arxiv.org/abs/2608.26754
作者：Zhipeng Ma,Bo Nørregaard Jørgensen,Zheng Grace Ma
类目：Information Retrieval (cs.IR)
关键词：energy management requires, management requires datasets, Industrial energy management, production batches, material flows
备注： It has been accepted by Energy [this http URL](http://Informatics.Academy) Conference 2026 (EI.A 2026)
点击查看摘要
Abstract:Industrial energy management requires datasets that connect energy use with equipment states, production batches, material flows, and process conditions. However, conventional acquisition workflows commonly emphasize connectivity and storage without verifying whether accessible signals satisfy the requirements of a defined energy-performance assessment. This paper presents STREAM, an objective-driven and uncertainty-aware framework comprising Specification of Objectives, Technical Requirements, Resource Mapping, Extraction from Sources, Archival Metadata, and Migration to Database. STREAM is the central workflow: objective-to-data traceability is its end-to-end output, while measurement, temporal, contextual, and processing uncertainty are assessed across all six stages. Compared with the original conceptual STREAM sequence, this paper adds stage-level artifacts, minimum-evidence gates, source-suitability rules, a metadata template, an uncertainty rubric, and case-specific traceability matrices. The framework is validated through two industrial batch-process cases: induction-furnace melting in a foundry and cheese-powder drying using SCADA and production-order data. The results demonstrate that data accessibility is not equivalent to analytical suitability and show how STREAM supports transparent decisions about immediate data use, analytical restrictions, and prioritized infrastructure improvements.
13. 【2608.26728】Beyond a Single Story: Meta-Reviewing Sparse and Incomplete User-generated Contents for Recommendation
链接：https://arxiv.org/abs/2608.26728
作者：Hongren Wang,Tianjun Wei,Yingpeng Du,Jie Zhang,Yin-Leng Theng
类目：Information Retrieval (cs.IR)
关键词：Data sparsity remains, capture fine-grained preferences, recommender systems, efforts to produce, Data sparsity
备注：
点击查看摘要
Abstract:Data sparsity remains a long-standing challenge in recommender systems, and it becomes more severe for methods relying on user-generated content (UGC) such as textual reviews, which capture fine-grained preferences but require more user efforts to produce. As a result, UGC exhibits (1) missing reviews, where interactions lack any review, and (2) incomplete reviews, where available reviews cover only a subset of relevant attributes. Existing approaches often overlook these UGC-specific issues, leading to degraded accuracy. Motivated by meta-review in academic peer review, we propose MOSAIC (Meta-review On Sparse And Incomplete user-generated Content), which constructs a meta-review for each target user by aggregating attribute-sentiment evidence from neighbor users' reviews. A multi-gate mixture-of-experts (MMoE) architecture jointly optimizes rating prediction and meta-review attribute-sentiment prediction, while an attention module personalizes the aggregated meta-review signals to each target user, yielding both refined rating predictions and attribute-level explanations. Experiments on four real-world datasets demonstrate that MOSAIC consistently outperforms state-of-the-art baselines in both recommendation accuracy and explanation quality, mitigating UGC sparsity and incompleteness while delivering consistent gains for users with limited interaction history.
14. 【2608.26685】BLANC: Discovering Patent White Space via Changes in Normalized Pointwise Mutual Information Between Multi-View Clusters
链接：https://arxiv.org/abs/2608.26685
作者：Shuichi Miyazawa,Kensuke Fujii
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Digital Libraries (cs.DL)
关键词：potentially valuable regions, existing methods rely, apply single-view clustering, Blank Landscape Analysis, Normalized Pointwise Mutual
备注： 15 pages, 4 figures, 10 tables. A preliminary Japanese-language report covering the methodology and the industrial case study is scheduled to appear as AGC Research Report 76 (2026), ISSN 2434-0774. The present article is the full version, containing the entire quantitative evaluation
点击查看摘要
Abstract:Identifying white space --- the unexplored but potentially valuable regions of a patent landscape --- is essential for strategic RD planning, yet existing methods rely on manual patent mapping or apply single-view clustering without quantitative gap detection. We propose BLANC (Blank Landscape Analysis through NPMI Conditioning), a three-phase pipeline combining (1) multi-view neural topic modeling along three semantic dimensions (application/use, novelty, inventive step); (2) Normalized Pointwise Mutual Information (NPMI) to quantify cross-dimensional cluster association; and (3) conditional detection that flags combinations whose NPMI drops when the corpus is filtered by a user-specified keyword. The drop is captured by a new metric, $\Delta$NPMI, which identifies combinations "established globally, unexplored locally." Because white space has no ground truth, we evaluate BLANC on two public USPTO corpora --- machine learning/AI (5,417 patents, CPC G06N) and glass compositions (1,982 patents, CPC C03C) --- by artificially depleting known technology combinations and testing recovery. When three-quarters of a target pair's documents are removed, BLANC recovers 34.1% (ML/AI) and 27.3% (glass) of the depleted combinations, whereas size-matched removals not aimed at them (random documents, or those of a different established combination) essentially never do: the target is never recovered in 191 decoy trials. Collapsing the three semantic views into one recovers nothing, while prior co-occurrence measures also flag the target under random removal, offering no specificity. In a proprietary case (302 float glass / glass-ceramics patents), the keyword "fluorine" reveals a fluorine surface treatment $\times$ warpage suppression candidate ($\Delta$NPMI up to 0.48) that experts had independently identified.
15. 【2608.26661】When Does Supervised Fine-Tuning Reduce Instruction Sensitivity?
链接：https://arxiv.org/abs/2608.26661
作者：Jaekeol Choi
类目：Information Retrieval (cs.IR)
关键词：Large language models, task-specific supervised fine-tuning, conventional task-specific supervised, Large language, exhibit substantial performance
备注：
点击查看摘要
Abstract:Large language models can exhibit substantial performance variation across alternative formulations of the same task instruction, yet it remains unclear how conventional task-specific supervised fine-tuning (SFT) changes this instruction sensitivity. We study this question by evaluating fixed model checkpoints under multiple paraphrased instructions and defining instruction sensitivity as the standard deviation of task performance across them. We conduct a controlled scale analysis with Qwen3 models at 1.7B, 4B, and 8B on MS MARCO, together with targeted cross-family checks using Mistral-7B and Gemma-2-9B. Before SFT, instruction sensitivity decreases sharply with Qwen3 model scale. At 1.7B and 4B, SFT consistently reduces sensitivity across training instructions, with reductions of approximately 54--71%. At 8B, individual sensitivity changes are not statistically distinguishable from zero, but paired contrasts between training instructions are statistically reliable under query-level bootstrap analysis and have consistent directions across all three random seeds. Gemma-2-9B shows the same directional training-instruction contrast as Qwen3-8B, whereas Mistral-7B does not, suggesting that the strength of this effect also varies across models. Experiments on ESCI-English further show that free-generation and likelihood-based forced-choice evaluation can yield qualitatively different robustness conclusions even when valid-label generation is nearly perfect and average task performance is similar. Overall, SFT does not uniformly reduce instruction sensitivity: its robustness effect depends on the adaptation setting, while measured sensitivity can additionally depend on the prediction and scoring protocol.
16. 【2608.26658】PailitaoGR: Latent Think-with-Images for Generative Image Retrieval
链接：https://arxiv.org/abs/2608.26658
作者：Xiaomeng Fan,Yueran Liu,Shengyu Zhou,Chenghan Fu,Wanxian Guan,Feng Li,Chuan Yu,Jian Xu,Bo Zheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：product semantic identifiers, demonstrated strong performance, directly generating product, generating product semantic, auxiliary evidence
备注：
点击查看摘要
Abstract:Generative retrieval has demonstrated strong performance by directly generating product semantic identifiers (SIDs). Extending this paradigm to image search, however, is nontrivial because real-world query images contain diverse information, including the search target, useful auxiliary evidence, and irrelevant visual content. This requires the model to identify and focus on the search target while selectively utilizing auxiliary evidence. In this paper, we propose \textbf{PailitaoGR}, a \emph{Latent Think-with-Images} method for generative image retrieval, which internalizes target-focused perception and selective auxiliary-evidence utilization into a the generative retrieval model, enabling \textit{Zooming without Cropping} and \textit{Reading without OCR}. Specifically, we design a target-focused perception mechanism that identifies and enhances visual tokens of the search target, consisting of a target Enhancer and a learning strategy based on on-policy distillation and attention guidance loss, enabling the model to focus on search-target regions. We also design a selective auxiliary-evidence utilization mechanism that identifies and enhances visual tokens of auxiliary evidence, including an auxiliary enhancer and an in-capacity incremental contrastive distillation strategy, enabling the model to exploit auxiliary evidence. We construct training and validation sets sampled from real-world online image-search logs. Experiments show that our method outperforms existing baselines by an average of 13.8\%, validating its effectiveness.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.26658 [cs.CV]
(or
arXiv:2608.26658v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.26658
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
17. 【2608.26604】hoBIT: A Profile-Aware Retrieval-Augmented Chatbot for University Academic Advising
链接：https://arxiv.org/abs/2608.26604
作者：Yoonseo Kim,Seongmin Lee,Joongheon Kim,SeongKu Kang
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：causing profile-blind retrievers, university academic advising, admission cohort, identical questions, student department
备注： Accepted to the System Demonstrations Track at EMNLP 2026
点击查看摘要
Abstract:In university academic advising, identical questions can require different answers depending on a student's department, admission cohort, and degree program, causing profile-blind retrievers to surface plausible but inapplicable evidence. We present proFILL, a method for transforming hoBIT, our college's current rule-based advising chatbot, into a profile-aware retrieval-augmented generation (RAG) system. Rather than requiring a complete user profile upfront, proFILL progressively acquires only the profile attributes needed for each query, guided by both the query intent and the initially retrieved evidence, and uses them to condition retrieval over a profile-aware index. Extensive experiments and a human preference study show that proFILL outperforms diverse RAG baselines, is preferred by target users, and remains effective with open-weight models for cost-effective on-premise deployment.
18. 【2608.26579】Preference Flow Matching with Spectral Factorization for Micro-video Recommendation
链接：https://arxiv.org/abs/2608.26579
作者：Xinxin Dong,Haokai Ma,Fei Hu,YuZe Zheng,Bin Wu,Yonghui Yang,Xiaodong Wang
类目：Information Retrieval (cs.IR)
关键词：Micro-video recommendation aims, infer user preferences, Micro-video recommendation, aims to infer, historical interactions
备注：
点击查看摘要
Abstract:Micro-video recommendation aims to infer user preferences from historical interactions and multimodal video content, thereby identifying the next video of interest. However, prevailing methods compress frame sequences into a single holistic representation, entangling the stable visual semantics and the evolving dynamics that jointly shape user preferences. Meanwhile, diffusion- and flow matching-based recommenders condition their generation process solely on coarse behavioral context, leaving its internal temporal structure outside preference formation. We therefore propose PrismRec, a Preference Flow Matching framework with Spectral Factorization for Micro-video Recommendation. Analogous to a prism that disperses white light into its constituent spectrum, PrismRec devises Spectral Semantic Factorization (SSF) to derive complementary static semantic and dynamic factors from frame-level representations via a prior-guided learnable frequency mask in the temporal frequency domain. Then, it proposes Context-Calibrated Preference Matching (CPM) to weigh them with each user's specific sensitivity and inject the calibrated context as a structured condition to steer the matching trajectory toward the target representation, making video content as an intrinsic driver of preference formation rather than auxiliary side information. Experiments on four datasets from two platforms show that PrismRec surpasses the SOTA baseline by up to 22.65%, with the lowest inference cost and peak memory among the compared methods.
19. 【2608.26414】Case2Flow: Bridging Patient Cases and Guideline Flowcharts through Multimodal Retrieval
链接：https://arxiv.org/abs/2608.26414
作者：Jiale Wei,Yufan Chen,Alexander Jaus,Zdravko Marinov,Julian Friedrich,Simon Reiß,Jens Kleesiek,Rainer Stiefelhagen
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：covering plausible diseases, evidence-based decision logic, specific decision artifact, guidelines covering plausible, guidelines encode rich
备注： Accepted by EMNLP 2026 Main
点击查看摘要
Abstract:Medical guidelines encode rich, evidence-based decision logic, yet the specific decision artifact a clinician needs is hard to locate within a guideline, let alone across guidelines covering plausible diseases and treatments. While guideline passages have supported end-to-end question answering, flowcharts remain largely underused in decision support despite their ability to encode actionable clinical pathways. We therefore introduce Case2Flow, a task designed to retrieve the most relevant guideline flowchart for a given patient case from a collection of guideline documents. To support it, we construct FlowAtlas, a curated corpus of 202 flowcharts extracted from 2,080 medical guidelines, together with a pipeline that synthesises 1,911 aligned case-flowchart pairs. Our evaluation of multimodal retrieval methods reveals systematic failure modes, including overreliance on keywords and spurious token-patch matches induced by uninformative background regions in flowcharts. Motivated by this, we propose CRISP, a training-free scoring method that sharpens late-interaction retrieval by suppressing uninformative patches, discounting ambiguous token matches, and incorporating bidirectional query-image alignment. CRISP improves Recall@1 by up to 18.71 percentage points, while a blinded physician assessment on published case narratives provides preliminary feasibility evidence beyond synthetic queries.
20. 【2608.26379】Assessing the Downstream Utility of Evidence-Aware Retrieval in RAG
链接：https://arxiv.org/abs/2608.26379
作者：Utshab Kumar Ghosh,Debayan Mukhopadhyay,Shubham Chatterjee
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Retrieval, increasingly designed, topical relevance, Retrieval evaluation, evidence
备注：
点击查看摘要
Abstract:Retrieval evaluation for retrieval-augmented generation (RAG) is increasingly designed around whether retrieved passages contain evidence that can support generation, rather than topical relevance alone. We study whether this closer alignment with downstream evidence needs also makes retrieval evaluation more useful for the decisions built from it. Across five retrieval benchmarks and an end-to-end TREC RAG 2025 setting, we examine an answer-support signal in four roles: comparing retrievers, guiding retrieval training and system selection, predicting downstream answer quality, and filtering the evidence supplied to a generator. The signal changes retrieval rankings, but its downstream value is not uniform. It does not reliably improve retriever training; the benefit of using it for system selection depends on how the generator is instructed to use the retrieved evidence; and retrieval scores based on it do not robustly predict answer quality on unseen topics. In a direct evidence intervention, human annotators confirm that filtering preferentially preserves passages containing useful answer evidence, yet different answer evaluators reach different conclusions about whether the resulting answers improve. These results show that making retrieval evaluation more closely reflect the evidence needed for generation does not by itself make every downstream use of that evaluation more reliable. RAG evaluation methods should therefore be assessed with respect to the particular comparisons, decisions, and conclusions they are intended to support.
Subjects:
Information Retrieval (cs.IR); Computation and Language (cs.CL)
Cite as:
arXiv:2608.26379 [cs.IR]
(or
arXiv:2608.26379v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.26379
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
21. 【2608.26194】A Reranker for Orchestrating Heterogeneous Speech and Text Retrievers
链接：https://arxiv.org/abs/2608.26194
作者：Inho Kim,Sumyeong Ahn
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large Language Models, Language Models, Large Language, attracted significant interest, Retrieval-Augmented Generation
备注： Accepted to Interspeech 2026
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) systems have attracted significant interest for their ability to mitigate hallucinations in Large Language Models (LLMs). Although knowledge databases for RAG are increasingly diversifying to include various modalities such as speech and text, research on handling such multi-modal database scenarios remains limited. In this paper, we propose STeReO (Speech and Text Reranking Orchestrator), a reranker based on speech and text retrievers that aggregates disparate modality databases. To address the lack of specialized training data, we first curate a dataset comprising queries, mixed-modality evidence, and their corresponding relevance ranks. We then train the reranker and evaluate its effectiveness in both single-modality and mixed-modality scenarios. Our results demonstrate that the proposed algorithm excels at selecting the most relevant evidence, thereby significantly improving downstream question-answering performance.
22. 【2608.26150】Leveraging Large Language Models for Systematic Literature Review of Disease Spread Models
链接：https://arxiv.org/abs/2608.26150
作者：Orhan Yagizer Cinar,Timur Emre Ozkose,Emma Von Hoene,Amira Roess,Taylor Anderson,Hamdi Kavak
类目：Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Information Retrieval (cs.IR)
关键词：Large Language Models, Language Models, Large Language, systematic literature reviews, including systematic literature
备注： To be published in the Winter Simulation Conference 2026
点击查看摘要
Abstract:Recent advancements in Large Language Models (LLMs) have created new opportunities to streamline and potentially automate many research processes, including systematic literature reviews (SLRs). This study reports an LLM pipeline development for extracting model-relevant information from 536 peer-reviewed agent-based modeling papers. We compare the results with those of a human-conducted SLR. Our results show paper-level accuracies of approximately 77.95% for GPT-4.1 and 81.67% for GPT-5.0. Field-level accuracy ranges from 32.40% to 100.00%, with more complex or subjective fields performing less reliably. Importantly, we find that agreement between LLMs is a potential indicator of output quality: low agreement may signal hallucinations, whereas high agreement combined with low accuracy may point to noise or errors in the human dataset. Overall, our study provides practical insights into prompt development and highlights both the potential and limitations of using LLMs for full-scale SLRs in the modeling and simulation domain.
23. 【2608.26145】LLMs for Academic Workflows: An Evaluation of Literature Reviews Generated with Short and Long Context Windows of LLMs
链接：https://arxiv.org/abs/2608.26145
作者：Muhammad Ali Chaudhry,Xinyuan Hao,Haifa Alwahaby
类目：Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：AI-generated literature reviews, literature review writing, evaluating literature reviews, literature reviews generated, supporting literature review
备注：
点击查看摘要
Abstract:Our research focuses on evaluating literature reviews generated in short and long context settings of large language models (LLMs) to investigate the impact of context window on the quality of AI-generated literature reviews and the role of AI in supporting literature review writing. Twenty AI-generated literature reviews based on research sources from Semantic Scholar and Arxiv were evaluated by two researchers across 15 dimensions. Our findings reveal that AI-generated literature reviews require human oversight to meet academic publishing standards. As context windows increase, LLMs can incorporate broader information and maintain coherence across longer inputs, but they also exacerbate issues such as content repetition, omission of critical work, and a tendency towards descriptiveness over synthesis. Our work shows that AI-generated reviews can provide foundational overviews, but their output must be critically evaluated and refined by domain experts. Future research should consider integrating other LLMs and fine-tuned models in different domains with hybrid approaches that combine human expertise with AI capabilities to address the limitations identified in this study.
24. 【2608.26130】Agents Don't Paginate: First-Chunk Selection for LLM Tool Responses
链接：https://arxiv.org/abs/2608.26130
作者：Tatiana Petrova,Andrei Mazniak,Radu State
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Coding agents built, Claude Code, per-turn token budget, agent per-turn token, OpenAI Codex
备注：
点击查看摘要
Abstract:Coding agents built on large language models (LLMs), such as Claude Code, Cursor, OpenAI Codex, GitHub Copilot, and Aider, receive tool responses that routinely exceed the agent's per-turn token budget. The standard remedy, pagination, is available in every protocol that produced these responses; yet across the corpus of session logs from a public Model Context Protocol middleware we observed no agent-initiated requests for a second chunk. The first chunk is what the agent reads, so we ask how often the gold item (the one the agent needs) is placed first in it: the precision-at-1 rate $p_1$. In a controlled offline benchmark we treat first-chunk selection as a 0/1 knapsack and compare six value functions on 500 SWE-bench Verified tasks, then test whether $p_1$ matters with a single-turn file-localisation probe on five language models (4,800 LLM calls; not an end-to-end resolve-rate test). Two pre-registered hypotheses did not hold and are our main findings. The central one is negative: raising $p_1$ does not systematically raise downstream accuracy. Per-model deltas stay under three percentage points (p.p.), are not consistently signed, and no model is significant; the agent recovers the gold from anywhere in the chunk, so what reaches its answer is first-chunk inclusion, not the gold's rank within it. The second: adding four file-metadata signals to a keyword scorer hurts $p_1$ by 4.8 p.p. (paired significance test, $p = 0.001$). A parameter-free keyword scorer does raise $p_1$, from a 24.2% baseline to 35.0% (+10.8 p.p., far beyond chance; $p = 3.9 \times 10^{-8}$), and to 35.8% with a fallback to the tool's native ordering when no keyword matches. But by our central finding this is a rank-1 gain, and rank-1 is the part that does not reach the agent's answer: downstream accuracy does not move.
Subjects:
Computation and Language (cs.CL); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.26130 [cs.CL]
(or
arXiv:2608.26130v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.26130
Focus to learn more
arXiv-issued DOI via DataCite</p>
计算机视觉
1. 【2608.27456】UrbanGround: From Local Perception to Spatial Agency in a Real-Scale City
链接：https://arxiv.org/abs/2608.27456
作者：Tianjie Ju,Zheng Wu,Yueqing Sun,Yuhan Cui,Bobo Li,Shengqiong Wu,Pengzhou Cheng,Haodong Zhao,Zongru Wu,Xinbei Ma,Doris Zhang,Kunling Li,Mong-Li Lee,Wynne Hsu,Hao Fei,Qi Gu,Gongshen Liu,Zhuosheng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, large language models, Multimodal large, urban agency depends, language models
备注： 35 pages, 11 figures, 7 tables. Project Page: [this https URL](https://urbanground.github.io) , Code Repository: [this https URL](https://github.com/UrbanGround/UrbanGround)
点击查看摘要
Abstract:Multimodal large language models (MLLMs) can interpret a street view, but urban agency depends on whether such local evidence remains useful after the agent starts to move. In this paper, we investigate how far current MLLM agents can turn local urban perception into reliable action in a complicated real-scale city. We propose UrbanGround, the first sandbox to make this question testable in a physically constrained replica of Hong Kong built from territory-wide 3D geospatial data. UrbanGround supports closed-loop interaction from a first-person view and provides an interactive map for navigation. Agents can directly enter the 3D city and explore from a first-person view. Our analysis follows the growth of the spatial problem through three research questions. We first test whether an agent can ground a local scene well enough to answer spatial questions after active observation. Then we ask whether that grounding supports navigation as destinations become farther away and less explicit. Finally, we examine whether the resulting behavior survives changes in route availability and pedestrian motion. Contemporary MLLM agents usually show useful atomic abilities in visual recognition and short-range spatial reasoning, while orientation and pedestrian-aware movement remain unreliable. Their central failure emerges over extended exploration, where local abilities do not compose into sustained goal-directed behavior and errors accumulate without effective correction. We hope UrbanGround will support broader study of how far current MLLM agents can explore reliably in complex, open-ended urban environments.
2. 【2608.27417】Retrieval Heads Meet Vision: Uncovering How VLMs Locate and Extract Visual Information
链接：https://arxiv.org/abs/2608.27417
作者：Chanho Park,Daehyeon Choi,Jihyun Lee,Minhyuk Sung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-language models, image region referred, prompt and route, retrieval heads, visual retrieval
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) can locate an image region referred to by a text prompt and route the corresponding visual evidence to the output, yet the internal mechanism behind this behavior is not understood. Inspired by retrieval heads in large language models, we ask whether VLMs contain an analogous mechanism for visual retrieval. We answer affirmatively by introducing Visual Retrieval Heads (VRHs), a small subset of attention heads (about 1.7-2.6%) that are causally responsible for grounding text descriptions to image regions. To find them, we recast existing head-scoring methods under a unified design space over query tokens, key aggregation, and cross-sample aggregation. We then show that scoring attention from output prediction tokens with a sum over the ground-truth referent region most reliably identifies causal heads. Across eleven VLMs and five referring-expression benchmarks, masking only the top 20 VRHs reduces grounding accuracy by up to 80 percentage points, while masking the same number of random heads has little effect. Beyond replicating the causal-sparse-universal triad established for text retrieval heads, VRHs exhibit several properties not previously reported: they generalize across visual reference tasks, remaining causal on attribute, spatial, counting, and visual-math benchmarks despite being discovered through bounding-box prediction; they are functionally specific, preserving output format while corrupting localization; and they are architecturally shared, transferring causally across VLMs that share an LLM backbone but differ in vision encoder, projector, and instruction tuning.
3. 【2608.27407】Reconstructing Humans and Objects in Interaction using Large Reconstruction Models
链接：https://arxiv.org/abs/2608.27407
作者：Agniv Chatterjee,Georgios Pavlakos
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer vision, vision with applications, HOI, Estimation, object
备注： Accepted at ECCV 2026. Project Page: [this https URL](https://ac5113.github.io/MILO)
点击查看摘要
Abstract:Estimation of Human-Object Interactions in 3D (3D HOI) is a fundamental problem in 3D computer vision with applications in AR/VR, robotics, and embodied AI. However, reconstructing these interactions in 3D remains challenging due to depth ambiguities, occlusions, and object shape variability. Existing approaches are primarily concerned with reprojection and contact constraints, fitting parametric human models and object templates to 2D images. In this paper, we explore a different avenue. We present MILO, a framework that leverages the visual capabilities of Large Reconstruction Models (LRMs) to recover detailed 3D human-object interactions from a single image. Our key observation is that LRMs provide a powerful geometric scaffold that preserves relative human-object arrangement and proximity cues. This significantly simplifies the reconstruction procedure, reframing the problem as interpreting the LRM mesh: we segment it into human and object components, fit a parametric body model to the human part, and optionally align an object template to the object part (if such a template is available). MILO achieves strong reconstruction accuracy and outperforms existing baselines across multiple benchmarks and interaction scenarios. Our code is available at this https URL.
4. 【2608.27406】CLAP: Cross-Embodiment Video World Models are Zero-Shot Physical Simulators
链接：https://arxiv.org/abs/2608.27406
作者：Kechen Liu,Ola Shorinwa
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：learning generalizable physics, single robot embodiment, CLAP, generalizable physics, leveraging the vast
备注：
点击查看摘要
Abstract:State-of-the-art action-conditioned video models are typically restricted to a single robot embodiment, preventing them from leveraging the vast corpus of heterogeneous video data that contains rich signals for learning generalizable physics. To bridge this gap, we introduce CLAP, a framework for cross-embodiment action-conditioned video generation capable of being trained on diverse, internet-scale videos across human and robotic agents. CLAP is grounded in the insight that universal physical laws govern spatiotemporal dynamics regardless of the actor. However, cross-embodiment learning is non-trivial because action representations vary sharply across robot platforms and are typically absent in human videos. CLAP addresses this fundamental challenge through the following core contributions. First, CLAP reconciles disparate action spaces using end-effector poses, language instructions, and latent actions. Second, to resolve their individual limitations, CLAP introduces a curriculum-based cross-embodiment learning recipe that first learns foundational physical priors across unlabeled video data using latent actions and subsequently grounds them in end-effector action spaces for zero-shot deployment to real-world tasks. Crucially, CLAP approaches or surpasses state-of-the-art single-embodiment video models in challenging environments like DROID. These performance advantages compound via few-shot adaptation to establish a novel paradigm for training single-embodiment video world models. Ultimately, CLAP delivers the most comprehensive suite of action-conditioned video world models to date - spanning diverse action-conditioning spaces (end-effector, language, and latent) and robot morphologies (including cross-embodiment, DROID, Bridge, bimanual YAM robots, and G1 humanoids). We open-source all code and models. Project Website at this https URL .
5. 【2608.27395】LeVJEPA: Efficient Scalable Video Pretraining without the Heuristics
链接：https://arxiv.org/abs/2608.27395
作者：Lukas Kuhn,Lucas Maes,Giuseppe Serra,Quentin Le Lidec,Yann LeCun,Randall Balestriero,Florian Buettner
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remained computationally expensive, prevailing self-supervised methods, reconstructing masked content, prevent representation collapse, learning representations
备注：
点击查看摘要
Abstract:Video carries the temporal structure of the physical world, yet learning representations from it has remained computationally expensive: prevailing self-supervised methods either prevent representation collapse through architectural asymmetries, coupling an exponential-moving-average target encoder, a stop-gradient, and a capacity-limited predictor, or circumvent it by reconstructing masked content in pixel space. We introduce LeVJEPA, the first video encoder trained under LeJEPA's collapse-free objective, which dispenses with both. A single encoder is trained with an invariance loss over global and local views of a clip, regularized by SIGReg, which excludes collapse with a provable guarantee. The architecture reduces to an encoder and a projector, and the objective to a single hyperparameter. This formulation admits two properties. First, the cost of pretraining is governed by the number of tokens the encoder observes; uniform random token dropping renders this number small while simultaneously improving downstream accuracy. At matched epochs on identical data, LeVJEPA matches or surpasses V-JEPA 2 across ViT-S/B/L at 5.6 to 20.8x less pretraining compute, and at matched total FLOPs it exceeds the strongest video baseline by 7.6 points on ImageNet-1K while remaining competitive on motion-centric benchmarks. Second, since no asymmetry between branches is required, the encoder can be trained with block-causal attention at no measurable accuracy cost: temporal ordering becomes a property of the encoder itself. Against a compute-matched DINOv2 trained on frames of the same videos, LeVJEPA approaches the image-pretrained encoder on appearance-centric evaluation while nearly doubling its motion-centric accuracy. These results indicate that, once its computational overhead is removed, video becomes a viable and in several respects preferable substrate for general-purpose visual pretraining.
6. 【2608.27367】Successive Capacity Growth: Task-Complexity-Driven Width and Depth Expansion for Vision Transformer Encoders in JEPA World Models
链接：https://arxiv.org/abs/2608.27367
作者：Frederik Berenz
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：fixed-size Vision Transformer, employ fixed-size Vision, Vision Transformer encoders, modeling typically employ, typically employ fixed-size
备注： 12 pages, 2 figures, 6 tables
点击查看摘要
Abstract:Joint-Embedding Predictive Architectures (JEPAs) for world modeling typically employ fixed-size Vision Transformer encoders that are over-provisioned for simple tasks and under-provisioned for complex ones, with significant redundancy across attention heads. We propose Successive Capacity Growth (SCG), a method that starts from a minimal encoder (1 head, 2 layers, 283K parameters) and grows incrementally in width (adding attention heads for low-level semantic capacity) or depth (adding transformer blocks for higher-order semantic abstraction), driven by a task-agnostic test-and-verify mechanism that exploits function-preserving expansion to safely trial architectural changes and roll back if they do not improve prediction loss. The Sketched Isotropic Gaussian Regularizer (SIGReg) ensures that all learned semantic dimensions remain statistically independent and aligned with the predictive objective, preventing collapse even as the architecture grows. On a 60-dimensional multi-object dynamics task, SCG naturally triggers depth expansion, improving prediction loss by 20.3% over the fixed small baseline with 56 times greater parameter efficiency than scaling to the fixed large model; on a 2D navigation task, a single width expansion yields even an 23% improvement over the fixed large model. Across all three tested environments of increasing complexity, the adaptive encoder matches or exceeds the fixed small baseline, with zero false-positive expansions and bit-exact function preservation (ratio = 1.0, absolute difference = 0.0). The take-away is that JEPA world model encoders need not be pre-allocated at maximum capacity - they can grow successively as the task demands, achieving significant compute and data efficiency while maintaining representation quality.
7. 【2608.27365】KnockGS:interaction-Grounded Calibrationof Physical Gaussian Representations
链接：https://arxiv.org/abs/2608.27365
作者：Chenchen Ge,Hanwen Shen,Bowen Jing,Jiyuan Cai,Xiaofeng Wang,Hongsen Lei,Weitao Zhou,Dandan Zhang,Haibao Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：reconstructed deformable objects, explicit material models, reconstructed deformable, Gaussian representations, Gaussian
备注：
点击查看摘要
Abstract:Physics-integrated 3D Gaussian representations now allow reconstructed deformable objects to be simulated and rendered under explicit material models. Existing pipelines, however, assume that material parameters are known or manually specified, limiting their applicability when these parameters must be inferred from observed object dynamics. We propose KnockGS, an interaction-response PhysicalGS framework that estimates the elasticity and density scales of a 3D Gaussian object from its dynamics under a known applied force. Rather than treating physical simulation only as a forward process, we turn the force-induced response into a calibration signal: temporal response features are xtracted from the observed dynamics, the two material scales are estimated from those features, and the estimate is then frozen and written back into the same simulator so that it can be tested on an interaction it was never fitted this http URL evaluate the framework on both parameter recovery and response-level fidelity. The estimated scales are compared against hidden ground truth, and the re-simulated object is measured against the target using 3D particle trajectories, response-curve statistics, and rendered-frame quality. Across five held-out material targets, our method recovers the scales substantially more accurately than response retrieval, global regression, or a fixed default material, and the frozen estimate remains predictive under interactions that differ in direction and in magnitude. Interaction response therefore carries enough information to calibrate material scales in physically grounded 3D Gaussian this http URL study is a first step toward interactive PhysicalGS systems that calibrate a Gaussian asset whose rendered appearance and simulated response are consistent.
8. 【2608.27345】PAWBench: How Far Are We from Probabilistically Aligned World Modeling?
链接：https://arxiv.org/abs/2608.27345
作者：Yuandong Pu,Le Zhuo,Sayak Paul,Gabriel Jorge Menezes,Avram Đorđević,Shiyang Li,Yifan Zhou,Bin Fu,Wenlong Zhang,Junjun He,Yu Qiao,Yihao Liu,Jingbo Xing,Xi Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Recent video generation, Recent video, increasingly framed, Recent, world
备注：
点击查看摘要
Abstract:Recent video generation models are increasingly framed as world models. Many physical processes can unfold in more than one valid way. Therefore, a world model should reproduce not only a plausible trajectory, but also the distribution of possible behaviors under the same initial observation and action. We call this distribution-level requirement probabilistic alignment. However, existing evaluations largely assess individual-video plausibility and do not test whether repeated generations recover the correct distribution. This raises a central question: how far are current video generators from probabilistically aligned world modeling? To answer it, we formalize probabilistic alignment as a distributional criterion for world models and introduce PAWBench, a benchmark for evaluating video generators as stochastic samplers of world dynamics. We further introduce PAWEval, an outcome-level protocol that converts repeated video rollouts into empirical distributions over possible physical behaviors. Across 50 scenarios and eleven current systems, no model consistently matches the reference probabilities while recovering the range of valid behaviors. Having established this gap, we test whether language prompts, initial noise sampling, or model training can reshape the model's predictive distribution. We believe our work can serve as a foundation for future efforts to move towards probabilistically aligned world modeling.
9. 【2608.27328】R2M-Bench: Evaluating Revisit Memory via Relative Consistency in Interactive Video World Models
链接：https://arxiv.org/abs/2608.27328
作者：Qiwen Gu,Bingjie Gao,Rui Chen,Geng Li,Jifan Li,Qishuai Wen,Li Niu,Jing Tang,Xiangxiang Chu,Junqiao Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：High similarity, necessarily show, simply have changed, Normalized Memory Ratio, world model remembered
备注： Code: [this https URL](https://github.com/AMAP-ML/R2MBench)
点击查看摘要
Abstract:High similarity between first-visit and return frames does not necessarily show that a video world model remembered the scene; the intervening rollout may simply have changed very little. This ambiguity makes absolute revisit scores sensitive to rendering stability, repetitive content, and failed motion. We introduce \emph{R2M-Bench} (\textbf{R}elative \textbf{R}evisit \textbf{M}emory Benchmark), a benchmark of observable revisit-selective consistency. For every detected return, R2M-Bench compares the revisit pair with two controls from the same rollout: a gap-matched non-revisit pair that measures generic temporal stability and a short-range pair that estimates short-horizon consistency. These comparisons produce \emph{MemoryGain} (MG), the revisit advantage over the temporal baseline, and the \emph{Normalized Memory Ratio} (NMR), which normalizes this advantage by the short-to-baseline dynamic range. R2M-Bench combines 100 reference scenes with three leave-and-return trajectories to form 300 instances and evaluates appearance fidelity, scene and object identity, local geometry, and persistent state. Across seven action-conditioned video world models, Overall NMR correlates with human consistency judgments at Spearman's $\rho=0.547$ (95\% CI $[0.45,0.63]$). Its within-model correlation magnitude with generated motion is $0.072$, compared with $0.207$ for raw revisit similarity, indicating that relative calibration substantially reduces the slow-motion shortcut. DreamX-World-Memo achieves the highest Overall NMR among the evaluated video models. Together, these results support same-rollout relative calibration as a practical way to distinguish revisit-specific consistency from generic temporal stability.
10. 【2608.27301】Comparative Evaluation of 3D Reconstruction Methods for Immersive Visualization of Laboratory Objects
链接：https://arxiv.org/abs/2608.27301
作者：Brian De La Cruz,Aaron Y. Zhao,Maitrey Gramopadhye,Sawyer J. Lazar,Xianming Tan,Daniel Szafir,David S. Lawrence
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：examined whether current, creation of realistic, realistic holographic representations, realistic holographic, Gaussian splatting
备注： 36 pages, 18 figures, 16 tables
点击查看摘要
Abstract:In this study, we examined whether current 3D reconstruction methods can support the creation of realistic holographic representations of laboratory objects for educational use. In this regard, we compared four approaches: photogrammetry, a neural radiance field (NeRF)-based method, Gaussian splatting, and LiDAR. These methods were used to generate holographic models of common laboratory items and their fidelity was evaluated by graduate students. Participants assessed the models for shape, color, texture, and visual defects using a repeated-measures design. Across objects, the NeRF-based method produced the most consistently high-fidelity representations, particularly for transparent, reflective, or low-texture items that were difficult to capture with other approaches. Shape and color were generally reproduced more successfully than texture, suggesting that some visual properties remain more challenging to represent accurately in educational holograms. Beyond identifying the strengths and limitations of each reconstruction method, the study demonstrates a practical workflow for creating immersive learning objects that may support pre-laboratory preparation, spatial reasoning, and student engagement in AR/MR-based educational environments. These findings offer design-relevant insights for educators and researchers developing immersive digital learning experiences.
11. 【2608.27290】Detection of Christmas tree plantations from high-resolution aerial imagery. A case study in the French Morvan
链接：https://arxiv.org/abs/2608.27290
作者：Francesca Razzano,Emanuele Dalsasso,Adrien Baysse-Lainé,Silvia Liberata Ullo,Gilda Schirinzi,Jocelyn Chanussot
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote Sensing, Christmas tree plantations, largely unexplored application, unexplored application domain, Christmas tree
备注： 18 pages, 9 figures. Submitted to IEEE JSTARS; currently under revision
点击查看摘要
Abstract:Christmas tree plantations are economically relevant, yet a largely unexplored application domain in Remote Sensing (RS). Their delineation is challenging because of high planting density, short rotation cycles, visual confusion with surrounding vegetation, the availability of dense labels for one reference year only, and severe class imbalance at the landscape scale. Although Deep Learning (DL) methods have shown strong potential for vegetation mapping, existing approaches are typically designed for forests, generic plantation systems, or orchards, and do not explicitly address the structural specificity and hard-negative confusion that characterize Christmas tree plantations. In response to these challenges, this work makes three main contributions: (i) it frames Christmas tree plantation mapping as a distinct rare-target semantic segmentation problem; (ii) it introduces a Hard Negative Mining (HNM) strategy to improve discrimination against confusing background patterns; and (iii) it evaluates the proposed framework across complementary levels, including supervised testing, temporal transfer, and large-scale validation. On the 2020 test set held out, the best model, DeepLabV3 with a ResNet-34 encoder, achieves an IoU of 0.733 and an F1-score of 0.846. HNM substantially improves precision-recall behavior, increasing the area under the precision-recall curve from 0.204 to 0.913. Temporal inference further shows meaningful transferability, reaching IoU/F1 values of 0.751/0.858 on 2017/2018 and 0.691/0.817 on 2023. Large-scale validation further highlights the intrinsic difficulty of the task, as Christmas tree plantations occupied only a very small fraction of the extent of the common evaluation, corresponding to 1,498.4 ha (1.72\%) in 2017/2018 and 1,782.2 ha (2.04\%) in 2023 out of 87,309.4 ha in total.
12. 【2608.27282】ADP: Task-Aware Deformable Prediction for Single-Stage 3D Object Detection
链接：https://arxiv.org/abs/2608.27282
作者：Su Wang,Yaochen Li,Min Yang,Jiaohao Nie,Chang Liu,Yuehu Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO); Systems and Control (eess.SY)
关键词：object detectors complete, detectors complete, object detectors, extracted features, features
备注： Accepted to the 2023 IEEE Intelligent Vehicles Symposium (IV 2023)
点击查看摘要
Abstract:Most single-stage 3D object detectors complete different tasks with the same extracted features. Nevertheless, it is impossible to project features into a common space that is adaptive for all the tasks. We present a novel task-aware deformable prediction (TADP) method for single-stage 3D object detection to solve this problem. Firstly, a triple feature refinement aggregation module is designed to extract three-level features adaptively. Additionally, we design the multi-scale feature aggregation block to fuse multi-scale features in a scale-aware manner. Finally, the prediction of each task is deformed with the designed plug-and-play task-aware deformation head. It can percept the emphasis and interaction of each task. We also designed three different deformation modules. The experimental results demonstrate that the proposed deformation head shows good results on other detection methods. The experimental results on the KITTI dataset demonstrate that the car mAP is 80.91%, surpassing many state-of-the-art methods on the KITTI benchmark.
13. 【2608.27280】Sidecar: Training-Free Semantic Reuse for Character-Consistent Free-form Visual Storytelling
链接：https://arxiv.org/abs/2608.27280
作者：Sibo Dong,Sarah Adel Bargal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual storytelling requires, preserving consistent character, consistent character identities, requires generating images, Visual storytelling
备注：
点击查看摘要
Abstract:Visual storytelling requires generating images that follow a narrative while preserving consistent character identities across frames. In free-form story generation, a character is fully described only when first introduced and is later referred to by a type-level mention or pronoun. Although this setting better reflects natural storytelling, later prompts may omit important identity-related semantics, making character consistency more difficult to maintain. We propose \textbf{Sidecar}, a plug-and-play semantic augmentation module that preserves entity-level information from the initial description and injects the missing semantics into later prompt embeddings. Sidecar requires no additional training and does not modify the architecture of the base diffusion model. Experiments on FreeStoryBench show that Sidecar consistently improves prompt-image alignment and character consistency across multiple SDXL- and FLUX-based baselines, with negligible computational overhead.
14. 【2608.27278】Decoupled I/O-Dominant Pipelines for Large-Scale Whole-Slide Image Embedding Extraction
链接：https://arxiv.org/abs/2608.27278
作者：Mayanka Chandrashekar,Xi Zhang,Ethan Seefried,Tirthankar Ghosal,John Gounley,Heidi Hanson
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV)
关键词：making patch-based processing, Whole-slide images, foundation model inference, WSI embedding extraction, prohibitively large
备注：
点击查看摘要
Abstract:Whole-slide images (WSIs) are central to computational pathology but are prohibitively large, making patch-based processing the practical unit for foundation model inference. At scale, however, generating and handling massive numbers of patches on quickly introduces significant I/O and orchestration overhead, often dominating end-to-end performance. We present a decoupled, I/O-aware pipeline for large-scale WSI embedding extraction that decomposes the workflow into three stages: (1) patch generation and staging, (2) embarrassingly parallel embedding inference, and (3) sharded vector database ingestion. This design isolates data movement from compute, enabling efficient patch delivery, scalable multi-node inference with minimal communication. The resulting system produces a distributed vector database where embeddings are persistently coupled with rich metadata (e.g., patient, slide, and patch attributes), enabling efficient filtering, retrieval, and downstream reuse. This representation database is compact and reusable for tasks such as retrieval, classification, and few-shot learning, particularly benefiting low-resource environments. We show that decoupling I/O, computation, and ingestion enables high-throughput WSI embedding extraction at scale. By characterizing the scaling envelope, we demonstrate that storage dominates beyond moderate concurrency, reframing WSI embedding extraction as a data-centric systems problem rather than a purely compute-bound workload.
15. 【2608.27240】UniFLM: United Segmentation and Measurement on Fetal Limb Ultrasonic Image
链接：https://arxiv.org/abs/2608.27240
作者：Zeen Zhou,Qiuhua Chen,Xiaojun Cao,Changmao Chen,Chao Sun,Bo Du
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Prenatal ultrasound examination, detecting congenital anomalies, assessing fetal limb, fetal limb development, Prenatal ultrasound
备注：
点击查看摘要
Abstract:Prenatal ultrasound examination is crucial for assessing fetal limb development and detecting congenital anomalies. However, existing artificial intelligence models often overlook fetal lethal skeletal dysplasias due to the lack of high-quality annotated data and a unified framework for multiple long bones. Moreover, generic segmentation models struggle with the inherent noise and semantic gaps in ultrasound images. To address these challenges, we construct the Fetal Limb Bones (FLB) dataset, comprising high-quality annotations for the humerus, femur, tibia-fibula, and radius-ulna. Furthermore, we propose UniFLM, a unified framework for automatic cross-plane segmentation and measurement. UniFLM incorporates a Semantic-Aware Skip Connection module to bridge the semantic gap between encoder and decoder features, and a Positive Sampling strategy to adaptively filter noise and extract essential semantic information. Finally, a Point Regression Mapping module is introduced to learn clinician annotation patterns for precise bone length measurement. Extensive experiments conducted on the FLB dataset demonstrate that the proposed UniFLM achieves superior accuracy and enhanced generalization capabilities in fetal long bone assessment compared to current state-of-the-art models.
16. 【2608.27226】DINOcular: Self-Supervised Visuospatial Representations
链接：https://arxiv.org/abs/2608.27226
作者：Farkhat Almukhamedov,Sami Azirar,Hermann Blum
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：learning joint visuospatial, joint visuospatial representations, introduce a self-supervised, self-supervised framework, framework for learning
备注：
点击查看摘要
Abstract:We introduce a self-supervised framework for learning joint visuospatial representations from RGB-D observations. While modern vision foundation models are trained almost exclusively on RGB images, many embodied systems have access to explicit depth sensing, which provides geometric information that monocular inputs cannot recover. Our method integrates depth-derived geometric priors with a visual backbone through inter-patch and intra-patch fusion, enabling the model to encode both appearance and spatial structure efficiently. The resulting representation shows promising improvements on 3D awareness while preserving semantic transfer: it outperforms prior methods of comparable scale on multiple 3D geometry benchmarks, and remains competitive when probed for standard RGB-D semantic segmentation tasks.
17. 【2608.27214】CODE: Cross-Modal Calibration and Dynamic Suppression for Open World Object Detection
链接：https://arxiv.org/abs/2608.27214
作者：Hao Xu,Zhaoning Shi,Hehe Jin,Bo Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Open World Object, Open World, multimodal foundation models, semantic ambiguity caused, World Object Detection
备注： Accepted by ACM Multimedia 2026 (MM '26)
点击查看摘要
Abstract:Open World Object Detection (OWOD) built on multimodal foundation models often suffers from semantic ambiguity caused by unidirectional text-to-vision matching, while rigid outlier penalties may over-suppress unknown objects near known-class decision boundaries. We propose CODE (Cross-Modal Calibration and Dynamic Suppression), a unified inference-time framework with three complementary components. Cross-Modal Joint Confidence Calibration injects global visual prototypes to calibrate text-driven known-class predictions. Uncertainty-Guided Universal Objectness Enhancement measures classification hesitation from local visual responses to strengthen potential unknown objects. Dynamic Outlier Suppression via Confidence Margin replaces rigid suppression with a margin-aware adjustment that preserves ambiguous out-of-distribution instances. Experiments on the Real-World Detection benchmark demonstrate that, with the OWL-ViT L/14 backbone, CODE achieves 21.7 U-mAP and 40.8 K-mAP in Task 1, surpassing the previous state of the art by 2.6 and 2.3 points, respectively.
18. 【2608.27206】PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference
链接：https://arxiv.org/abs/2608.27206
作者：Junjie Liu,Shengyuan Ye,Xu Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：costs escalate rapidly, demonstrate exceptional visual, visual reasoning capabilities, exceptional visual reasoning, inference costs escalate
备注： 22 pages, 9 figures, 13 tables. Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Vision-Language Models (VLMs) demonstrate exceptional visual reasoning capabilities, yet their inference costs escalate rapidly with the proliferation of visual tokens. Existing visual token pruning methods exhibit two fundamental limitations. First, most approaches operate exclusively post-vision encoder, leaving the substantial latency of the visual encoding phase unoptimized. Second, under strict token budgets, these methods often fail to jointly preserve holistic visual contexts and fine-grained details, leading to performance degradation. To address these bottlenecks, we propose PACE (Pixel-Adaptive Condense and Extract), a training-free inference framework that accelerates both the vision encoder and the Large Language Model (LLM) via a unified Condense-and-Extract paradigm. During the Condense stage, an Adaptive Pixel Compressor (APC) evaluates visual information density prior to encoding, adaptively downsampling redundant inputs, curtailing encoder computation while preserving global context and essential visual cues. In the Extract stage, a Dynamic Dual-Attention Extractor (DDAE) selectively retains visual tokens via a fusion of internal visual signals from the encoder and semantic signals from the LLM, safeguarding task-critical details. By integrating PACE into Qwen2.5-VL-7B, the model retains 93.8% of its original performance while utilizing only 10% of the visual tokens, yielding a 3.1x speedup in time to first token (TTFT). Our code is available at this https URL.
19. 【2608.27199】Vision-centric generative AI models: A software-hardware perspective
链接：https://arxiv.org/abs/2608.27199
作者：Eleni Tselepi,Cristian Sestito,Shady Agwa,Themis Prodromakis
类目：Computer Vision and Pattern Recognition (cs.CV); Hardware Architecture (cs.AR)
关键词：rapidly advancing areas, generative artificial intelligence, Vision generative artificial, artificial intelligence, deep learning
备注：
点击查看摘要
Abstract:Vision generative artificial intelligence (AI) has emerged as one of the most rapidly advancing areas of deep learning. The explosion of multimodal models has made them widely associated with text-to-image applications running on large datacentres. However, vision generative models are equally needed in applications that operate under strict hardware constraints at the edge, including autonomous vehicles, agricultural sensors, and mobile devices. In this Perspective, we argue that progress in vision generative AI has been driven by output quality, with hardware evolving reactively to accommodate growing model demands. We quantify the parameter cost and energy efficiency of these models across a range of accelerator platforms, and map four generative model families against seven real-world application domains. Finally, we advocate a software-hardware co-design approach, where deployment constraints are considered from the start of the design process, ensuring that the "right model" runs on the "right hardware" to serve the "right application", making generative AI deployment sustainable and accessible across a much broader range of platforms.
20. 【2608.27198】Knowledge Distillation Driven Semantic NOMA with GAN Refinement for 6G Robotic Vehicle Networks
链接：https://arxiv.org/abs/2608.27198
作者：Qifei Wang,Zhen Gao,Li Qiao,Ziwei Wan,De Mi,Dapeng Li,Ying Sun
类目：Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：sustainable intelligent mobility, achieve sustainable intelligent, require high-fidelity visual, robotic vehicles, high-fidelity visual perception
备注： Presented at IEEE VTC-Spring 2026
点击查看摘要
Abstract:To achieve sustainable intelligent mobility, 6G-empowered robotic vehicles (RVs) require high-fidelity visual perception under stringent bandwidth and energy constraints. Semantic communication offers a spectral-efficient solution but suffers from severe interference in uplink non-orthogonal multiple access (NOMA) RV networks. To address this, we propose a knowledge distillation-driven and generative models-enhanced NOMA framework for robust and green RV communications, named KDG-SemNOMA. First, we develop a ConvNeXt-based deep joint source-channel coding (DeepJSCC) architecture with an enhanced attention feature (AF) module for dynamic channel adaptation. Second, to mitigate interference without inference overhead, an orthogonal transmission teacher model guides the NOMA student model via a two-stage knowledge distillation strategy. Finally, to address the over-smoothing artifacts of pixel-wise optimization, we introduce a channel-conditional GAN (cGAN). By explicitly taking the Stage-I initial reconstruction and channel states as conditional inputs, this module refines coarse outputs into high-fidelity images with realistic textures. Experiments on FFHQ-256 demonstrate that KDG-SemNOMA significantly outperforms state-of-the-art methods in both pixel-level accuracy and perceptual fidelity.
21. 【2608.27190】Unsupervised Adaptation of 3D CT Foundation Models for 3D CBCT Segmentation
链接：https://arxiv.org/abs/2608.27190
作者：Gauthier Miralles,Loic Le Folgoc,Vincent Jugnon,Pietro Gori
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：annotated CBCT data, large domain shift, compounding challenges, radiation therapy applications, Interventional CBCT exhibits
备注： Accepted at the EMA4MICCAI workshop at MICCAI 2026. 11 pages, 4 figures, 1 table. Code, trained models, weights, and liver annotations are available at [this https URL](https://github.com/mirabll/FARR3D/)
点击查看摘要
Abstract:Accurate 3D segmentation of cone-beam CT (CBCT) is critical for interventional and radiation therapy applications, yet it remains limited by two compounding challenges: the scarcity of annotated CBCT data and the large domain shift from diagnostic CT. Interventional CBCT exhibits fundamental modality differences from conventional CT, driven by acquisition and physics effects as well as contrast-specific vascular content, thereby limiting effective cross-modality model transfer. We propose a novel unsupervised domain adaptation (UDA) framework based on redundancy-reducing feature alignment, enabling 3D CBCT segmentation with no target-domain annotations or inference-time adaptation. Our framework is architecture-agnostic, seamlessly adapting both CNN-based and ViT-based foundation models. We evaluate our method on two challenging CT-CBCT liver segmentation benchmarks: one for interventional vascular procedures and one for radiation therapy, demonstrating that even large-scale pretrained segmentation networks require explicit feature-space bridging to generalize across acquisition modalities, and that our approach consistently outperforms existing pretrained foundation model and UDA strategies. To support reproducibility and benchmarking, we release the liver segmentations for a public CBCT dataset, along with the code, trained models, and weights.
22. 【2608.27181】SSMB: Self-Supervised Local Feature Detection under Motion Blur
链接：https://arxiv.org/abs/2608.27181
作者：Zhenjun Zhao,Fabio Bellavia,Wenting Wang,Fan Zhu,Jiajun Wu,Suryansh Kumar,Mingqiang Wei,Haoang Li,Javier Civera
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：significant challenge, blur distorts local, remains a significant, structure and degrades, degrades the repeatability
备注： 20 pages, 11 figures, 14 tables
点击查看摘要
Abstract:Keypoint detection under motion blur remains a significant challenge, as blur distorts local image structure and degrades the repeatability of feature localization. Existing approaches either rely on computationally expensive deblur-then-detect pipelines that may introduce restoration artifacts, or learn to regress the image positions of handcrafted keypoints extracted on sharp images, which reflects the assumptions of the handcrafted detector rather than what is truly repeatable under blur. We present SSMB, a deblur-free, self-supervised keypoint detector for motion-blurred images that requires neither handcrafted detectors nor external pseudo-labels. SSMB introduces the Local Discriminability Enhancement (LDE) module, which restores fine-grained local discriminability after global feature mixing. Training is performed in two stages. First, geometric pretraining on synthetic shapes bootstraps spatially discriminative keypoint detection without any external detector, just from the rendered geometry. Second, blur-aware training on real sharp-blur image pairs learns blur-invariant detection through a multi-component self-supervised objective that enforces cross-domain consistency, geometric alignment, and spatial coverage. Extensive evaluations on keypoint detection, image matching, relative pose estimation, and visual localization under motion blur demonstrate that SSMB establishes a new state-of-the-art among sparse keypoint detectors, consistently outperforming both supervised and self-supervised baselines across all tasks. Code, models, and datasets will be publicly available upon paper acceptance.
23. 【2608.27178】Parameter-Efficient pretrained-CT-to-MRI Transfer for Rectal Cancer Segmentation: Performance-Calibration Trade-offs
链接：https://arxiv.org/abs/2608.27178
作者：Aneesh Rangnekar,Jorge Tapias Gomez,Joseph O Deasy,Harini Veeraraghavan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Accurate rectal cancer, calibrated uncertainty estimates, magnetic resonance imaging, requires computational efficiency, rectal cancer segmentation
备注： Accepted to the Medical Image AI in Radiation Therapy (MIART) Workshop at MICCAI 2026
点击查看摘要
Abstract:Accurate rectal cancer segmentation from magnetic resonance imaging (MRI) is essential for adaptive radiotherapy and tumor response assessment, but deployment also requires computational efficiency and informative, calibrated uncertainty estimates. We therefore introduce SWIFT, a SWin pretrained model wIth parameter-eFficient and Tumor-aware fine-tuning for rectal cancer segmentation. A Swin V2 encoder pretrained on 10,444 public 3D CT volumes using a DINOv2-style objective was adapted to T2-weighted MRI through four cumulative configurations: full fine-tuning (SWIFT), decoder compression (SWIFTe), low-rank adaptation (SWIFTe-LoRA), and a four-member LoRA-decoder ensemble (SWIFTe-LDE4). Geometric accuracy, tumor detection, radiomic agreement, and probability calibration were evaluated on a held-out 247-case test set from a single-institution cohort acquired using 1.5 or 3 Tesla GE scanners. Compared with SWIFT, SWIFTe reduced total parameters by 70.1% (from 72.8M to 21.8M) and increased tumor detection rate from 89.9% to 93.9%, while achieving a slightly lower median surface DSC (0.61 versus 0.62) and improved radiomic agreement. In a separate SWIFTe ablation, removing tumor-aware augmentation reduced detection from 93.9% to 89.9% but increased surface DSC from 0.61 to 0.64, demonstrating a detection-boundary-agreement trade-off. SWIFTe-LoRA used 14.6% of SWIFTe's trainable parameters while retaining similar segmentation performance. SWIFTe-LDE4 achieved the lowest calibration errors among the four configurations after temperature scaling (expected calibration error, 0.217; Brier score, 0.222), although the absolute expected calibration error indicates residual miscalibration. Similar efficiency-calibration patterns were observed using the public VoCo checkpoint, supporting robustness across pretrained initializations rather than external clinical generalizability.
24. 【2608.27175】mporal Sensitivity Analysis of Tessera Embeddings
链接：https://arxiv.org/abs/2608.27175
作者：Julia Guerrero-Viu,Alex López-Cifuentes,Ignacio Pérez-Villar,Fabio Pacifici
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Earth Observation applications, strongest Earth Observation, Earth Observation foundation, Earth Observation, strongest Earth
备注： 15 pages
点击查看摘要
Abstract:Many Earth Observation applications need land-use/land-cover maps that are both precise and frequently updated, yet the strongest Earth Observation foundation models build their embeddings from a full year of observations. We present a controlled study of the temporal sensitivity of Tessera, one of these leading foundation models, for land-use/land-cover mapping. Keeping the encoder frozen, we recompute its embeddings over varying observation windows, from a full year down to a single day. We use them as inputs to a linear probe and a UNet segmentation head, benchmarking both of them against from-scratch networks on LUCAS, DynamicEarthNet, and PASTIS-R datasets. We show that the value of the embeddings is task-dependent. Where classes are separated by phenology, as for the crop types of PASTIS-R, they reach a mean Intersection-over-Union of $58.3$, about $46\%$ above the best from-scratch model. Where classes are temporally stable (e.g., forests in DynamicEarthNet and LUCAS), embedding-based and from-scratch models match only under full supervision. On both datasets, Tessera embeddings remain markedly more label-efficient. Degradation under shorter temporal windows is gradual and class-dependent. Contracting the window from one year to one month costs $39\%$ of the segmentation accuracy on PASTIS-R but only $5\%$ on DynamicEarthNet. Single-day embeddings still classify land cover in LUCAS at $3.4$ times the chance level. Our study shows that temporal coverage is therefore a tunable cost rather than a fixed prerequisite, opening regimes such as near-real-time mapping and faster land-use/land-cover refresh cycles.
25. 【2608.27169】Ancient-Bench: A Comprehensive Multi-millennial, Multi-medium, and Multi-script Benchmark for Ancient Chinese Artifact Text Recognition
链接：https://arxiv.org/abs/2608.27169
作者：Hiuyi Cheng,Nuo Xu,Yuyi Zhang,Xuhan Zheng,Wei Pan,Jing Zhang,Dezhi Peng,Minghui Liao,Yihua Teng,Jihao Wu,Haoyu Ren,Lianwen Jin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Ancient Chinese artifact, Chinese artifact text, current model capabilities, evaluating current model, artifact text recognition
备注： Accepted by EMNLP 2026
点击查看摘要
Abstract:Ancient Chinese artifact text recognition is fundamental to heritage digitization, and benchmarks for ancient texts are essential for evaluating current model capabilities. However, existing benchmarks suffer from ''fragmentation'', manifested in limited temporal coverage, limited medium diversity, and incomplete script types. Therefore, we present Ancient-Bench, a comprehensive benchmark of 2,700 images for ancient Chinese artifact text recognition, featuring three dimensions: Multi-millennial (spanning 3,000 years of character evolution), Multi-medium (covering nine artifact categories), and Multi-script (encompassing seven historical script forms). To enable consistent and fair evaluation across heterogeneous media, we further define three annotation standards tailored to the medium-specific characteristics of ancient texts: symbol standardization, character standardization, and parsing standardization. Extensive experiments on Ancient-Bench covering general Vision-Language Models (VLMs) and OCR-specialist models reveal that ancient Chinese artifact text recognition remains fundamentally unsolved, with persistent challenges in variant characters, specialized symbols, and hallucination. The dataset is available at this https URL.
26. 【2608.27168】Magpie: Real-Time World Renderer for Interactive Games
链接：https://arxiv.org/abs/2608.27168
作者：Xiaoyu Zhan,Xinyu Wang,Xiaohong Zhang,Huanjie Zhu,Tengjiao Sun,Pengcheng Fang,Jiaxing Yu,Yanwen Guo,Dongjie Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conventional graphics pipelines, Modern game development, development relies heavily, Modern game, game development relies
备注： Technical report. [this https URL](https://zhanxy.xyz/Magpie-website)
点击查看摘要
Abstract:Modern game development relies heavily on conventional graphics pipelines. High-quality visual content requires modeling, material authoring, animation, lighting, effects, and runtime optimization, making asset production expensive and extending the development cycle of game prototypes. Recently, video foundation models are beginning to change film and video production, but games differ from linear media, they require not only continuous and realistic imagery, but also stable and reproducible gameplay rules, object states, and interaction outcomes. We present Magpie, a real-time generative world-rendering system for interactive games. Magpie separates gameplay execution from visual generation. Designers define scenes and rules in a game engine. At runtime, the Game Engine resolves player actions and maintains world state, while an independent Render Server generates visual output from white-box frames produced by the engine. Magpie provides a system-level implementation path for applying generative models to real-time game rendering. It preserves gameplay designability and reproducibility, and reduces the dependence of early game prototypes on complete visual assets.
27. 【2608.27154】ReViCo: Unveiling the Limitations of VLMs in Visual Text Understanding via Error Correction
链接：https://arxiv.org/abs/2608.27154
作者：Bojun Zhang,Junhong Liang,Feifei Zhai,Fengxian Ji,Yu Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Language Models, Vision Language, shown great success, deeply understand text, Language Models
备注：
点击查看摘要
Abstract:Vision Language Models (VLMs) have shown great success in general visual tasks, yet they still struggle to deeply understand text within images. In this paper, we introduce ReViCo (Real Visual Correction), a benchmark designed to evaluate VLM text understanding through a novel task of visual text error correction. ReViCo challenges models to identify and fix text errors in real-world images, which requires a profound understanding of the interplay between visual text and its surrounding visual context. We benchmark various VLMs using two distinct paradigms: prompt-based strategy and targeted model training, both aimed at pushing the limits of current models. Our experiments reveal a striking performance gap between even the best VLMs and human, and further analysis also shows that most models struggle to accurately perceive the visual text, resulting in frequent correction errors. By highlighting these gaps, ReViCo provides a new benchmark foundation for developing more robust and text-aware VLMs.
28. 【2608.27150】ANTShapes Benchmarking Datasets for Event-Based Neuromorphic Object Classification
链接：https://arxiv.org/abs/2608.27150
作者：M. Middleton,H. Kayan,B. Sen Bhattacharya,T. Ali,E. Baikas,M. Vousden,C. Perera,O. Rhodes,E. Gheorghiu,M. A. Trefzer
类目：Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Event-based object classification, considerable research attention, Object classification, attracting considerable research, computer vision
备注： 23 pages, 11 figures
点击查看摘要
Abstract:Object classification in event-based computer vision is a task that is attracting considerable research attention. Event-based object classification is a fundamental task in the fields of security and applied computer vision, which typically use synchronous frame-based cameras and computing pipelines for operation. This approach has several practical flaws. The size, weight and power consumption of the device could prohibit deployment at the extreme edge or in covert sensing environments. Besides this, there are security concerns inherent in cloud-based or other off-device computation approaches due to the requirement of sending and receiving potentially sensitive data. Furthermore, this transmission of data introduces latency and requires consistent connectivity to the cloud infrastructure to function. The use of Spiking Neural Networks (SNNs) hosted on neuromorphic devices attempts to solve several issues present in this conventional approach. Research into event-based object classification methods are hindered by the lack of high-quality vision datasets to use. To this end, the ANTShapes simulation tool has been previously proposed to create and label event-based vision datasets. In this paper, four novel datasets of varying difficulties are created using the tool and are benchmarked against existing spiking datasets commonly used for event-based vision research (N-MNIST, CIFAR10-DVS, DVSGesture and POKER-DVS). Classification is performed using a convolutional SNN. This work simultaneously provides four datasets with rich details for future experiments to use and validates the output of the ANTShapes dataset simulation tool as being suitable for its purpose.
Comments:
23 pages, 11 figures
Subjects:
Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.27150 [cs.NE]
(or
arXiv:2608.27150v1 [cs.NE] for this version)
https://doi.org/10.48550/arXiv.2608.27150
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
29. 【2608.27123】EditaLive! Unified Character Video Editing for Live Streaming
链接：https://arxiv.org/abs/2608.27123
作者：Zhiyuan Li,Chi-Man Pun,Peng-Tao Jiang,Bo Li,Xiaodong Cun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：places greater emphasis, Conventional video editing, streaming places greater, editing primarily focuses, live streaming places
备注：
点击查看摘要
Abstract:Conventional video editing primarily focuses on scene-level content, whereas live streaming places greater emphasis on the human subject. However, directly applying existing video-editing methods to human-centric live streaming remains challenging, as they may introduce facial-expression inconsistencies and typically depend on multiple offline inference steps, making them unsuitable for real-time interaction. We propose EditaLive, a novel framework for real-time streaming character video editing. In detail, we start from a pretrained image animation model (Wan-Animate), which naturally decouples appearance from motion, and repurpose it as the base model for instruction-based human-centric video editing by reference frame editing and video reconstruction via the collected CharEdit-50K dataset. Besides, we adapt the model from offline bidirectional to causal streaming generation, and design an aligned self-rollout distillation strategy that compresses the model into a two-step sampler, where fixed RoPE and align forcing reduce training--inference discrepancies, and first-frame preserved sparse attention filters redundant historical information to mitigate appearance drift. Extensive experiments demonstrate that EditaLive delivers state-of-the-art editing performance with faithful preservation of facial expressions and low-latency real-time streaming inference.
30. 【2608.27121】How AI Experiences Art: Emergent Aesthetic Structure in a Self-Supervised Multimodal Embedding Space
链接：https://arxiv.org/abs/2608.27121
作者：Corey D.C. Heath
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：important part, symbolism of artistic, Abstract, artistic works, categorize art based
备注： Accepted at ICMI Companion '26 (Companion Publication of the 28th ACM International Conference on Multimodal Interaction), October 5-9, 2026, Napoli, Italy. 4 figures, 2 tables
点击查看摘要
Abstract:Aesthetics are an important part of the symbolism of artistic works. Although subjective, humans categorize art based on the emotion evoked regardless of modality. What remains under-explored is how AI models form their own aesthetic categorization of human-produced media without explicit labels or cross-modal supervision. We present a self-supervised framework that projects four modalities (text, audio, image and video) into a shared 256-dimensional embedding space and applies iterative clustering to discover aesthetic structure. We discuss the divergence between AI-generated cluster assignments and human affective register labels on a weakly supervised multimodal dataset. This work has applications in understanding how AI structures cross-modal similarity, organizing heterogeneous media collections for Retrieval-Augmented Generation (RAG), and automated data labeling.
31. 【2608.27095】Automated 2D and 3D Segmentation of AMD and DME Lesions in OCT
链接：https://arxiv.org/abs/2608.27095
作者：Lucia Sundberg,Zhihao Zhao,M. Ali Nasseri
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Age-related macular degeneration, diabetic macular edema, optical coherence tomography, drive treatment decisions, Age-related macular
备注：
点击查看摘要
Abstract:Age-related macular degeneration (AMD) and diabetic macular edema (DME) are leading causes of vision loss, and optical coherence tomography (OCT) is the standard modality for detecting and monitoring the subtle lesions that drive treatment decisions. Most deep-learning segmentation work for OCT is validated only in-domain, leaving generalization to clinical data collected under different acquisition protocols largely untested. This work develops and systematically ablates four lesion-segmentation pipelines -- 2D and 3D variants for AMD and DME -- reaching Dice scores of 0.76 to 0.82 with strong volumetric and surface calibration (r vol, r surf greater than or equal to 0.97 across all four pipelines) on an in-domain validation set. The ablation process establishes a full-volume, calibration-aware adoption standard that catches mechanisms an ordinary slice-level evaluation would keep, and identifies ensemble composition as the most consistent driver of improvement. To test generalization, the models are evaluated on OLIVES, an external clinical cohort with no lesion-level ground truth, using a proxy-metric framework built around biomarker AUROC, central subfield thickness (CST) correlation, and longitudinal concordance. Predictions track clinical biomarkers outside the training distribution, though less strongly than in-domain -- evidence for, not validation of, automated lesion-burden tracking as a clinical tool.
32. 【2608.27073】SpatialCrafter: Single Image World Modeling with Generative 3D Proxies
链接：https://arxiv.org/abs/2608.27073
作者：Chuan Fang,Lingteng Qiu,Yixun Liang,Rui Chen,Kunming Luo,Zhaohua Zheng,Tongyuan Bai,Feipeng Tian,Zilong Dong,Zihan Zhou,Ping Tan
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：applications in gaming, virtual reality, essential for applications, Point-anchored Sparse Structure, generation
备注： 12 pages
点击查看摘要
Abstract:Explorable image-to-scene generation is essential for applications in gaming, robotics, and virtual reality. Existing methods based on video diffusion model (VDM) commonly rely on incomplete conditioning signals such as sparse point clouds or 2D panoramas, leading to stochastic hallucinations, long-term drifts and suboptimal 3D consistency. We present SpatialCrafter, a novel two-stage framework that addresses these issues by introducing a global 3D proxy for high-fidelity image-to-scene generation. Specifically, we decompose the generation process into global proxy generation and appearance refinement. For proxy generation, we propose a Point-anchored Sparse Structure~(PaSS) Flow module that predicts a spatially aligned and geometrically consistent 3D proxy. For appearance refinement, we re-frame the VDM as a Generative Deferred Refiner which synthesizes high-frequency photorealistic details upon proxy-defined scene geometry. To better integrate the proxy with the pre-trained VDM, we introduce Parallel Geometry Injection and Proxy-Aware Corruption training strategies, which improve robustness to proxy artifacts without disrupting the pretrained generative manifold. Furthermore, as no suitable dataset exists for this explorable scene generation task, we construct a new large-scale dataset of 115K scenes. To the best of our knowledge, it is the first hybrid dataset for image-to-scene generation. Extensive experiments on both synthetic and real-world datasets show that SpatialCrafter outperforms state-of-the-art methods, mitigates long-term drift, and remains robust and consistent under rapid camera motion and extreme viewpoint changes. Code, models, and the newly constructed dataset will be publicly released. See more at this https URL.
33. 【2608.27066】Beyond Classification: Task-Dependent Learnability under Privacy-Motivated Image Transformations
链接：https://arxiv.org/abs/2608.27066
作者：Leon Ranke,Wolfgang Hübner,Ronny Hug,Michael Arens,Jürgen Beyerer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Privacy-Enhancing Technologies, protect visual data, performance and protection, rely on noise, perturbations to protect
备注：
点击查看摘要
Abstract:Privacy-Enhancing Technologies (PETs) in computer vision often rely on noise or image perturbations to protect visual data while securely processing it, creating a trade-off between task performance and protection. This trade-off is commonly evaluated using image classification, which primarily captures semantic separability and remains robust despite significant geometric, spatial layout or local boundary alterations. As a result, it is too simplistic as a proxy for generic vision tasks. Exhaustive downstream-task evaluation, however, is computationally expensive because models must often be trained for each PET transformation and parameter setting. We therefore propose a compute-aware multi-task protocol for evaluating PETs in model training. It combines lightweight proxy tasks that target complementary aspects of visual structure while remaining simple and fast to compute. Across irreversible privacy transformations, key-based block primitives, and learnable image encryption schemes, we demonstrate that PETs with similar classification accuracy can differ substantially on other tasks. The outcomes highlight the need for PET evaluation protocols that move beyond classification-only reporting.
34. 【2608.27065】Video-OPSD: Exploiting Privileged Visual Evidence for On-Policy Self-Distillation in Video Large Language Models
链接：https://arxiv.org/abs/2608.27065
作者：Ziyue Wang,Shiqi Huang,Weiwen Xu,Bihan Wen,Xudong Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, On-policy self-distillation, Video Large Language, Language Models, recently emerged
备注：
点击查看摘要
Abstract:On-policy self-distillation (OPSD) has recently emerged as an effective post-training paradigm that improves policy optimization through dense token-level supervision from a privileged self-teacher. Despite its promise, OPSD remains largely underexplored for Video Large Language Models (Video-LLMs). Existing methods typically construct privileged teachers by augmenting their context with additional information while keeping the primary input unchanged for both teacher and student. Video reasoning, however, offers a distinct source of privileged supervision within the primary input itself: long videos contain substantial temporal redundancy, and only a small subset of frames provides the evidence necessary to answer a question. Building on this observation, we present $\textbf{Video-OPSD}$, an OPSD framework that exploits privileged visual evidence for both self-teacher construction and knowledge transfer. First, our Evidence-Grounded Self-Teacher conditions the teacher exclusively on annotated evidence frames while the student continues to reason over the complete video. This focused visual input enables the teacher to provide more informative supervision. Second, our Evidence-Guided Token Optimization adaptively weights token-level distillation according to each reasoning token's reliance on privileged visual evidence, thereby emphasizing perceptually grounded reasoning. Experiments across video understanding and reasoning benchmarks show that $\textbf{Video-OPSD}$ consistently improves upon Standard OPSD across multiple backbones and achieves performance comparable to GRPO while requiring substantially less training time, establishing an effective and efficient post-training approach for Video-LLMs.
35. 【2608.27051】Anatomy-Guided Foundation Model Adaptation with Within-Case Prototype Supervision for Standard Plane Detection in Fetal Ultrasound Blind Sweeps
链接：https://arxiv.org/abs/2608.27051
作者：Yuzhe Zhao
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：imbalanced frame-classification problem, form short contiguous, abdominal circumference standard, circumference standard plane, highly imbalanced frame-classification
备注：
点击查看摘要
Abstract:Detecting the fetal abdominal circumference standard plane in low-cost obstetric blind sweeps is a highly imbalanced frame-classification problem: positive frames account for under 3% of a sequence, form short contiguous segments, and are poorly handled by off-the-shelf ultrasound and vision foundation models. We propose AnatoProto, a lightweight sequence-level framework that adapts a frozen BiomedCLIP encoder to fetal blind sweeps through four components: (i) anatomy-weighted spatial pooling that uses nnU-Net abdominal-region probabilities as a spatial prior to reweight BiomedCLIP patch tokens, so frozen semantic features are aggregated onto anatomically meaningful regions; (ii) a within-case prototype loss that pulls each frame embedding toward the mean of positive frames of the same sweep, exploiting case-level structure unavailable at the frame level; (iii) a three-stage cascade refinement (frame-segment-case-level rejecter) that lifts the prediction unit from noisy frames to structurally-constrained segments; and (iv) a hybrid prediction head that jointly models per-frame stability and inter-frame boundary transitions to suppress boundary false positives. On the ACOUSLIC-AI benchmark, AnatoProto reaches a test F1 of 67.72, outperforming the strongest foundation-model baseline (FetalCLIP + PRS, F1 = 54.52) by +13.20 F1 and the strongest video temporal-action-detection baseline (TriDet + PRS) by +15.76 F1. A synergy study, backed by embedding geometry and paired-bootstrap confidence intervals, shows that the prototype loss and anatomy-weighted pooling are not additive: applied alone the prototype loss reduces recall by 12 points, but combined with anatomy-weighted pooling it increases recall by 6.5 points -- a sign-flip we trace to the accuracy of the within-case prototype.
36. 【2608.27044】Omni-Interactive Universal Embedder
链接：https://arxiv.org/abs/2608.27044
作者：Wei-Yao Wang,Kazuya Tateishi,Shuyang Cui,Christian Simon,Takashi Shibuya,Shusuke Takahashi,Yuki Mitsufuji
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：traditional two-tower architectures, strong instruction-following capabilities, large language model, based embedders due, shifting from traditional
备注： Preprint
点击查看摘要
Abstract:Multimodal representation learning has been shifting from traditional two-tower architectures to large language model (LLM)-based embedders due to their strong instruction-following capabilities. Despite this progress, existing approaches primarily focus on language and image modalities, which also remain the dominant modalities for user-conditioned interactions in current embedders. In this paper, we propose the first Omni-Interactive Universal Embedder (OmniUE), which not only learns a unified embedding space across text, video, and audio by leveraging intermediate-layer representations from dedicated learnable tokens, but also supports omni-interactive querying, enabling users to provide inputs in the form of text, visual regions of interest, and audio spans. Within OmniUE, visual and audio segmenters process diverse user interactions and integrate them with an omni-LLM to produce user-conditioned any-to-any embeddings via context aggregation. To evaluate OmniUE's omni-interactive capabilities, we introduce OmniCHOIR, benchmarking models for omni-interactive compositional audio retrieval based on the given text, video, and audio as well as unimodal or multimodal interaction prompts. OmniUE consistently surpasses state-of-the-art baselines across diverse modalities, with average improvements of 10.5% on textual-interactive video benchmarks (MMEB-v2-video), 1.1% on audio tasks (MAEB), 83.7% on visual-interactive benchmarks (SCaR), and 24.1% on our omni-interactive OmniCHOIR benchmark. We believe that jointly advancing omni-modal representation learning and omni-interactive querying paves the way toward universal embedders.
37. 【2608.27039】Multi-Person Human Motion Forecasting in Complex Scenes
链接：https://arxiv.org/abs/2608.27039
作者：Serdar Ozsoy,Lars Doorenbos,Juergen Gall
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Accurately forecasting, entire environment, forecasting the movement, movement of people, past and present
备注： Accepted to GCPR 2026
点击查看摘要
Abstract:Accurately forecasting the movement of people in complex scenes requires reasoning over the past and present state of the entire environment. In this context, effectively incorporating object information and social interactions into a unified framework remains particularly challenging. To address this, we propose Object-Conditioned Social Diffusion (OCSD), a conditional diffusion model that integrates motion history, multi-person interactions, and object cues into a single framework. OCSD uses an object-conditioning mechanism that modulates denoising at every timestep, enabling fine-grained human-object reasoning, and a social encoder that models the interactions between all humans in the scene. As a result, our model naturally handles varying group sizes, complex social interactions, and supports sampling multiple plausible futures. Extensive experiments show that OCSD achieves state-of-the-art results on the Humans in Kitchens (HiK) and HOI-M3 benchmarks. It reduces the two-second path error by 121.5 mm (31.3%) on HiK and 130.5 mm (33.2%) on HOI-M3 compared to prior work, and produces more realistic long-term forecasts.
38. 【2608.27034】Differentiable Jitter Correction using Deep Learning-based Image Quality Metric for Phase-Contrast Micro-CT
链接：https://arxiv.org/abs/2608.27034
作者：Junan Chen,Yiting Jia,Joscha Maier,Dominik John,Sami Wirtensohn,Imke Greving,Silja Flenner,Matthias Wieczorek,Julia Herzen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：X-ray phase-contrast micro, micro computed tomography, compensates per-projection rigid, pre-scan motion-free reference, phase-contrast micro computed
备注：
点击查看摘要
Abstract:This paper proposes a fully differentiable jitter correction method for X-ray phase-contrast micro computed tomography using a deep learning-based image quality metric that estimates and compensates per-projection rigid jitter directly from the acquired projection data, without a pre-scan motion-free reference. The approach builds on a gradient-based auto-focus strategy adapted to parallel-beam geometry. A set of candidate objective functions is benchmarked in a controlled study, and the sensitivity of the visual information fidelity (VIF) metric to the jitter artifact is verified with the target phase-contrast data. To operate without a clean reference, a compact 3D convolutional neural network is trained to predict the VIF score from a single corrupted volume. A spatially selective total variation penalty applied exclusively to the image background is introduced to penalize spurious high-frequency structures that otherwise emerge during optimization. Experiments on biological specimens acquired at different synchrotron beamlines are conducted. Evaluation uses jitter motion applied to simulated and experimentally acquired projection data. The result confirms that the integrated pipeline reliably recovers fine structural detail lost due to jitter, with generalization demonstrated across morphologically distinct samples.
39. 【2608.27004】MVC-Bench: Benchmarking Calibration of Medical Vision-Language Models
链接：https://arxiv.org/abs/2608.27004
作者：Ashshak Sharifdeen,Shihab Aaqil Ahamed,Ufaq Khan,Muhammad Akhtar Munir Sujair Ibrahim,Mohamed Rafeek Mareer Ahamed,Yutong Xie,Imran Razzak,Muhammad Haris Khan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：medical vision-language models, requires calibrated confidence, vision-language models, realistic clinical conditions, Calibration Error
备注： Accepted in EMNLP 2026 Findings
点击查看摘要
Abstract:Reliable evaluation of vision-language models (VLMs) and medical vision-language models (Medical-VLMs) requires calibrated confidence, particularly under realistic clinical conditions. However, existing efforts mainly focused on improving accuracy, leaving calibration in the medical domain underexplored. To this end, we propose MVC-Bench, a calibration-centric benchmark for medical image classification with VLMs and Medical-VLMs. MVC-Bench assesses the calibration across three axes: (i) robustness to modality, backbone, and domain shift (ii) effectiveness of calibration strategies and prompt-tuning methods (iii) stability under prompt-template and random-seed variations. The benchmark covers eight different backbones, three medical modalities, including fundus imaging, histopathology, and chest X-ray under in-domain and domain shift settings. It compares post-hoc calibration, train-time calibration, and zero-shot inference methods, together with six prompt-tuning methods. Across more than 1638 controlled experiments, we report accuracy and Expected Calibration Error (ECE) as primary metrics, and further report results with complementary calibration measures, including Maximum Calibration Error (MCE) and Adaptive Calibration Error (ACE). We further investigate the underlying causes of miscalibration in VLMs and Medical-VLMs and propose a simple train-time calibration method, Multi-Class Margin (MCM) regularization, which achieves lowest ECE on 10 out of 12 settings in in-domain and remains competitive under domain shifts. Collectively, MVC-Bench provides a structured evaluation framework and actionable guidance for improving calibration in safety-critical medical workflows.
40. 【2608.26998】Virtual iEEG from Scalp EEG: Charting the Landscape of Source Imaging, Intracranial Inference and Reconstruction
链接：https://arxiv.org/abs/2608.26998
作者：Dongyi He,Xiangkai Wang,Hongjie Yan,Luping Song,Wai Ting Siok,Nizhuan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep brain regions, spatially specific access, coverage limit routine, brain regions, restricted anatomical coverage
备注：
点击查看摘要
Abstract:Intracranial electroencephalography (iEEG) provides temporally precise and spatially specific access to neural activity from focal and deep brain regions, but its invasiveness and restricted anatomical coverage limit routine use. These constraints have motivated scalp-to-intracranial inference, termed virtual iEEG when model outputs carry iEEG-defined event, feature, representation, or contact-level waveform semantics. This review presents a target-centred framework distinguishing event inference, feature translation, and waveform reconstruction, while separating predictability from observability, identifiability, fidelity, and utility. Evidence is evaluated according to cohort independence, anatomical and spectral coverage, train--test separation, and target-patient adaptation. Current studies support inference of selected intracranial events, low-frequency components, and task-related representations, but not unique recovery of arbitrary contact-level activity. Stronger validation requires appropriate controls, source-imaging baselines, uncertainty assessment, and incremental-utility testing. Future progress depends on independent paired datasets and prospective evidence that virtual iEEG adds value beyond scalp EEG and EEG source imaging.
41. 【2608.26993】Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning
链接：https://arxiv.org/abs/2608.26993
作者：Hengyuan Xu,Wei Cheng,Yumeng Ji,Xuanyang Zhang,Xianfang Zeng,Gang Yu,Xingjun Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, externalize spatial evidence, multimodal large language, Explicit visual intermediates, Explicit visual
备注：
点击查看摘要
Abstract:Explicit visual intermediates can help multimodal large language models (MLLMs) externalize spatial evidence and updated visual states, but their utility depends on whether an image editor can faithfully realize the required transformation. We introduce \textbf{Aphanta}, an automated task-discovery and closed-loop diagnostic framework for the MLLM - image editor - MLLM pipeline. Aphanta evaluates three conditions---direct reasoning, reasoning with an editor-generated intermediate, and reasoning with an idealized reference intermediate---to separate potential visual headroom from the practical utility of current editors. Across 20 candidate tasks and multiple editor--MLLM combinations, we find that utility is strongly task-conditioned. Gains concentrate in visual cue injection, grounding, and counterfactual state realization, whereas intermediates requiring symbol-sensitive construction or structural extrapolation are substantially less reliable. On the selected positive-task subset, our consolidated Qwen pipeline improves the mean task score from 0.343 to 0.445 ($+10.2$ points; $+29.7\%$ relative), while the full study also retains filtered and unsuccessful tasks to expose the boundary. These results position image editing as a specialized visual workspace rather than a universal reasoning mechanism, and establish Aphanta as a reusable protocol for measuring task--representation alignment, editor realization, and downstream pipeline utility.
42. 【2608.26971】mpJail: Temporal Jailbreak Attacks against Image-to-Video Generation Models
链接：https://arxiv.org/abs/2608.26971
作者：Qi Lu,Zehui Guo,David Yuanda Gan,Zijing Li,Hengda Zhang,Weijun Xu,Qiankun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：enabling high quality, made remarkable progress, quality video synthesis, high quality video, recent years
备注： Accepted by ACM Multimedia 2026 (ACM MM '26)
点击查看摘要
Abstract:In recent years, image-to-video (I2V) generation models have made remarkable progress in subject consistency and temporal coherence, enabling high quality video synthesis. However, these advances also introduce new safety risks. Existing studies mainly focus on jailbreak attacks involving single frame violations, while largely overlooking the temporal dimension unique to video generation models. In this paper, we investigate three attack scenarios and uncover a temporal vulnerability in I2V systems: unsafe semantics may emerge not from a single frame, but from semantic composition over time. We further identify two key challenges in such attacks: temporal abstraction and semantic camouflage. To address these issues, we propose TempJail, a novel temporal jailbreak framework for I2V systems. For temporal abstraction, we decompose a target malicious caption into an initial frame visual condition and a temporal text instruction. For semantic camouflage, on the image side we model semantic injection as controlled latent perturbation in diffusion sampling and introduce gradient guidance from pretrained encoders. On the text side, we rewrite the caption into an innocuous ``subject-action-scene'' template that bypasses safety filters while preserving temporal guidance. In the black-box inference phase, these two modalities jointly enable malicious semantics to be gradually triggered over time. Experiments on closed-source commercial models, including Kling, Seedance, Veo and PixVerse, show that TempJail improves attack success rate over prior state-of-the-art methods by 23.3\% under GPT-5.2 evaluation and 22.0\% under human evaluation. Our codes are available at \href{this https URL}{GitHub}.
43. 【2608.26965】ClusterAttention: A training-free speedup of bidirectional attention
链接：https://arxiv.org/abs/2608.26965
作者：Kasper Nordenram,Amelie Dittmann
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：bidirectional attention layers, paper introduces ClusterAttention, paper introduces, attention, clusters
备注： 18 pages, 3 figures
点击查看摘要
Abstract:This paper introduces ClusterAttention, a general training-free speedup of bidirectional attention layers. Existing sparse attention methods either rely on structure in the input, such as order in language or spatial proximity in images, or use slow clustering processes amortized over several forward passes. ClusterAttention instead uses a fast recursive clustering method that adapts to the geometry of the keys and queries in each attention head to produce useful clusters. This method allows setting the size of the clusters arbitrarily. We utilize this by setting all clusters to be a fixed size that is a power of two, allowing the block-sparse attention to run at the same latency per query-key interaction as dense attention on GPUs. We also derive an expression for the output error in sparse attention, that explains the counterintuitive experimental finding that tight clusters can lead to larger errors than random clusters. We then derive the error when excluded clusters are compensated through their centroids, and show that this error shrinks with tighter clusters. We integrate this compensation into the method. On large-scale tabular data ClusterAttention speeds up TabPFN-3 arXiv:2605.13986 by two to six times, while retaining at least 99% of the dense accuracy. To our knowledge, it is the first training-free method that can be successfully applied in the setting of unstructured input and a single forward pass. For video generation with Wan 2.1-14B T2V arXiv:2503.20314 , ClusterAttention achieves output closer to dense attention and a larger speedup (1.8x versus 1.4x) compared to SVOO arXiv:2603.18636 , a leading method developed specifically for this domain, both run without offline calibration.
Comments:
18 pages, 3 figures
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.26965 [cs.LG]
(or
arXiv:2608.26965v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2608.26965
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.5281/zenodo.22118033
Focus to learn more
DOI(s) linking to related resources</p>
44. 【2608.26960】Geo-LoRA: Geometry-Aware Subspace Evolution for Low-Rank Adaptation in Continual Learning
链接：https://arxiv.org/abs/2608.26960
作者：Yibo Feng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Rehearsal-free class-incremental learning, previously occupied directions, causing unstable shared, Rehearsal-free class-incremental, unstable shared representations
备注：
点击查看摘要
Abstract:Rehearsal-free class-incremental learning (CIL) with LoRA adapters remains challenging because the low-rank subspaces updated across tasks evolve without geometric control, causing unstable shared representations and repetitive collapse of task-specific updates into previously occupied directions. We introduce Geo-LoRA, a geometry-aware framework that explicitly regulates how low-rank subspaces, both shared and task-specific, evolve during continual learning. For the shared branch, Subspace Projection Preservation (SPP) constrains consecutive updates to follow smooth trajectories on the Grassmann manifold, and Adaptive Core-Slack Alignment (ACSA) decomposes transitions into principal and residual components, aligning the former while modulating the latter to balance stability and plasticity. For the task-specific branch, Median-Calibrated Block Overlap (MCBO) imposes a statistical constraint via normalized projection overlap, penalizing excessive reuse to mitigate subspace crowding. These constraints jointly regulate the evolution of all LoRA subspaces across layers and tasks without introducing additional adapter types beyond standard LoRA. Geo-LoRA provides a principled geometric formulation for continual low-rank adaptation and consistently achieves state-of-the-art performance across multiple benchmark datasets and different task lengths.
45. 【2608.26956】RubricRM: Generative Reward Modeling via Dynamic Rubrics for Image Generation and Editing
链接：https://arxiv.org/abs/2608.26956
作者：Zijian Kan,Wei Wang,Long Luo,Bing Zhao,Xuan Ren,Weixu Qiao,Wenbo Li,Hu Wei,Lin Qu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：aligning visual generative, single scalar score, aligning visual, existing visual reward, play an essential
备注： Accepted to EMNLP 2026 Main Conference
点击查看摘要
Abstract:Reward models play an essential role in aligning visual generative models, yet most existing visual reward models use a single scalar score or rely on fixed criteria that cannot adapt to different instructions. This limits both interpretability and task sensitivity, especially for text-to-image generation and instruction-based image editing, where different inputs require different evaluation dimensions. We propose RubricRM, a pairwise generative reward modeling framework that first produces an input-specific rubric with evaluation dimensions, weights, and scoring criteria, and then applies the rubric to score candidate images. We train dedicated RubricRM models for text-to-image generation and image editing using a two-stage training pipeline: supervised fine-tuning teaches the model the rubric-based scoring paradigm, while GRPO further improves scoring through fine-grained dimension-level rewards. Experiments on multiple generation and editing benchmarks show that RubricRM outperforms existing specialized reward models and remains competitive with strong proprietary MLLM judges despite using smaller backbones. Our models, data, and code are available at this https URL.
46. 【2608.26951】Per-View Gaussian Predictions Enable Training-Free Distractor Filtering in Feed-Forward 3DGS
链接：https://arxiv.org/abs/2608.26951
作者：Kangmin Seo,Jae-Pil Heo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Gaussian Splatting reconstructs, Splatting reconstructs, Gaussian Splatting, multiple input images, explicit Gaussian representation
备注： Preprint
点击查看摘要
Abstract:Feed-forward 3D Gaussian Splatting reconstructs an explicit Gaussian representation from multiple input images in one network execution, making 3D reconstruction increasingly accessible for casual captures. However, such captures frequently contain transient objects that appear in only a subset of the views. Such content can be encoded into the per-view Gaussians associated with the inputs that observe it and remain in the combined representation despite being observed by no other input. As a result, it may produce blurred, duplicated, or floating artifacts in novel views. We introduce a training-free filtering procedure that exploits this per-view prediction structure. For each input, we exclude its associated Gaussians and render the same camera using the remaining representation, revealing content that is inconsistent with the other inputs. Feature similarity forms candidate regions, and rendering-based verification retains only candidates whose removal reduces reconstruction error in the other input views. The procedure operates on a single frozen prediction without retraining or scene-specific optimization. Across three reconstruction models and two distractor benchmarks, it consistently improves novel-view quality with varying numbers of input views. On clean scenes, evaluations across four models show that the original reconstructions are largely preserved.
47. 【2608.26948】KISS-GS: 3D Gaussian Splatting Compression Kept Simple
链接：https://arxiv.org/abs/2608.26948
作者：Wieland Morgenstern,Friedrich Elias Branschke,Florian Fleischmann,Adrian Szatmari,Paul Schlack,Florian Barthel,Peter Eisert,Anna Hilsmann
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deployment remains painful, Gaussian Splatting, deployment remains, remains painful, Splatting
备注：
点击查看摘要
Abstract:Scene reconstruction with 3D Gaussian Splatting (3DGS) has become common, however deployment remains painful as the uncompressed file sizes can be massive. Current 3DGS compression systems combine multiple strategies for file size reduction, which can obscure where gains come from and limit component reuse across training pipelines. To make the gains more transparent, we propose KISS-GS, a modular compression pipeline named after the principle of keeping things simple, designed to decouple compression entirely from training. Given a 3DGS scene reconstructed with vanilla 3DGS, we are able to reduce it through compaction by 15.7x using a combination of state-of-the-art pruning schemes. Then we encode it into an image-based format designed for simple, ubiquitous decoding. With the SOG-XT format, we propose a novel extension to Self-Organizing Gaussians with two main contributions: (i) Self-organizing 2D Codebooks and (ii) Parallel Representative Assignment Smoothing (PRAS), which leverages the symmetry of quaternion and scale parameterizations to produce 2D attribute grids more amenable to encoding. This encoding reduces scene size by 6.6x. We show that optional encoding-aware fine-tuning yields a further 2.2x. Across standard 3DGS benchmarks, our simple and modular approach thus achieves a total of 85x to 319x reductions in the size of the scene over uncompressed vanilla 3DGS, setting new benchmarks for real-world scenes and surpassing tightly integrated methods in rate-distortion. Decoding relies solely on web-native image formats, and the modular design makes each stage easy to combine with future advances in reconstruction and compaction. Code and project page: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.26948 [cs.CV]
(or
arXiv:2608.26948v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.26948
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Wieland Morgenstern [view email] [v1]
Thu, 27 Aug 2026 10:49:42 UTC (6,141 KB)
48. 【2608.26947】4DSynth: Controllable Procedural World Synthesis for Dynamic Embodied Simulation
链接：https://arxiv.org/abs/2608.26947
作者：Zehao Qi,Haochen Luo,Jia-Wang Bian,Zeyu Ma,Shuyang Sun
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：visually diverse, changing over time, physically interactive, generate large interactive, interactive scene collections
备注：
点击查看摘要
Abstract:Embodied agents need environments that are visually diverse, physically interactive, and changing over time. Procedural simulators can generate large interactive scene collections, and recent 4D generators produce compelling visual dynamics. Combining these properties in one environment, however, still demands extensive manual effort, and the result is rarely editable or controllable enough to reuse at scale. We present 4DSynth, a controllable procedural system that turns a natural-language description, a blueprint mask, or a single photograph into an editable 4D environment with explicit geometry, animated actors, collision-free trajectories, and physics-ready simulation state. Multiple scene routes share one geometry-grounded representation, so the same pipeline handles animation, camera planning, rendering, and task generation. To validate the full pipeline, we construct 4DSynth-Nav, an interactive navigation benchmark generated entirely from 4DSynth's procedural scenes. Two vision-language models evaluated across three difficulty tiers both fail the majority of tasks and stall after early subtasks. The same procedural controllability that produces these environments also makes each failure reproducible and each difficulty axis independently tunable. This paper presents both a controllable generation pipeline and the scalable benchmark it enables, offering a practical foundation for developing and evaluating embodied agents.
Subjects:
Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.26947 [cs.RO]
(or
arXiv:2608.26947v1 [cs.RO] for this version)
https://doi.org/10.48550/arXiv.2608.26947
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
49. 【2608.26921】AraMS-28k: The Largest Publicly Released Line-Level Dataset of Historical Arabic Manuscripts with Margin and Insertion-Anchor Annotations
链接：https://arxiv.org/abs/2608.26921
作者：Mohamed Guechaoui,Mohamed Diaa Zellagui,Souleyman Chaib,Sahraoui Dhelim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：genuine historical Arabic, largest publicly released, historical Arabic manuscripts, historical Arabic manuscript, historical Arabic
备注： Data and code available at this https URL and this https URL. Dataset: [this https URL](https://doi.org/10.5281/zenodo.22095333) Code: [this https URL](https://github.com/ArchaText/AraMS-28k-Dataset)
点击查看摘要
Abstract:We introduce AraMS-28k, the largest publicly released line-level dataset of genuine historical Arabic manuscripts, comprising 14 books, 3,043 pages, and 28,600 annotated text lines (27,971 main-text, 629 margin). Thirteen books are hand-copied manuscripts spanning three script traditions -- Naskh, Ruq'ah, and Maghrebi -- and one is a lithographed printed edition included to broaden format diversity. Each line is labelled as main-text or margin, and margin lines that have an unambiguous attachment point in the main text are further annotated with an insertion anchor, recovering the manuscript's true non-linear reading order at line-level granularity -- to our knowledge the first such annotation released for a historical Arabic manuscript corpus. Because reference transcriptions are fully vocalised while manuscript hands are typically undiacritised, we release both the raw diacritised transcription and a diacritic-normalised counterpart for every line. The dataset was constructed with RefLAM, a reference-grounded annotation pipeline that aligns multimodal-LLM OCR against independently sourced clean transcriptions and routes every line through human review, combining automatic verification with expert oversight. We describe the construction and quality-control process, present the annotation schema, report dataset statistics at both the corpus and per-book level, and provide baseline HTR results using Kraken and HATFormer, including a cross-script generalisation gradient from in-distribution pages to fully unseen books. AraMS-28k is released with page images, line-level annotations, and fixed train/val/test splits under CC BY-NC-SA 4.0 to support reproducible research on Arabic manuscript recognition, layout analysis, and reading-order recovery.
50. 【2608.26902】her the Subject, Release the Scene: Query-Aware Memory Routing for Long-Horizon Autoregressive Video Generation
链接：https://arxiv.org/abs/2608.26902
作者：Chen Li,Peng Zhang,Hanyu Zhou,Jialong Zuo,Fei Wang,Daiguo Zhou,Nong Sang,Changxin Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：models generate long, long videos chunk, autoregressive video models, video models generate, generate long videos
备注：
点击查看摘要
Abstract:Streaming autoregressive video models generate long videos chunk by chunk, using historical memory to maintain consistency. Existing methods typically expose subject and scene queries to history through similar policies. This stabilizes the subject, but can also lock backgrounds, viewpoints, and scene structure to previously generated states even when local motion continues. We call this failure memory-anchored scene under-progression; consistency and motion metrics alone can miss it. We introduce TetherMem, a training-free, query-aware spatiotemporal memory router for frozen video generators. TetherMem separates subject and scene queries and modulates historical access with region- and age-conditioned priors: subject queries retain identity-bearing history, while scene queries reduce reliance on subject history and stale backgrounds. Across 2,400 blinded pairwise judgments from 10 annotators, TetherMem achieves the highest estimated expected preference among eight streaming long-video baselines for overall quality (0.780) and scene progression (0.769). On complete 30-second videos, it sustains changes in background, viewpoint, and scene state while preserving subject recognizability and temporal continuity.
51. 【2608.26872】Self-OPD: On-Policy Distillation for Flow Matching Models without Teacher
链接：https://arxiv.org/abs/2608.26872
作者：Shiyi Zhang,Mushui Liu,Yunze Tong,Wanggui He,Siyu Zou,Jinlong Liu,Yunlong Yu,Jian Song,Hao Jiang,Pipei Huang,Bo Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Large Language, dense supervisory signals, provide dense supervisory, achieved significant success
备注： 19 pages, 10 figures
点击查看摘要
Abstract:On-policy distillation (OPD), which leverages a pre-trained, specialized teacher model to provide dense supervisory signals, has achieved significant success in Large Language Models (LLMs) and has recently been adapted to flow matching models. However, this paradigm suffers from two major issues: First, training a separate, task-specific teacher for every new objective incurs high computational costs. Second, the discrepancy between teacher and student distributions often leads to compounding errors along the generation trajectory. In this paper, we introduce \textbf{Self-OPD}, a teacher-free OPD framework for flow matching models that turns the student's own self-exploration into step-wise supervision. At each timestep, Self-OPD branches the deterministic next-state prediction into $K$ stochastic SDE candidates, rolls them out with the ODE sampler, and compares their rewards against a deterministic self-reference baseline to obtain normalized advantages. The velocity field is optimized with an all-branch pull-push objective, where high-advantage branches attract the student and low-advantage branches repel it under direction-aware attenuation and SDE-variance normalization. For multi-objective alignment, Self-OPD fuses normalized scores at the reward level, avoiding direct gradient conflict. Experiments on single and mixed reward benchmarks show that Self-OPD outperforms prior RL and OPD methods without task-specific teachers.
52. 【2608.26868】CGS-SLAM: Collaborative Gaussian Splatting based SLAM for Multi-Agent Reconstruction
链接：https://arxiv.org/abs/2608.26868
作者：Jean-Daniel de Ambrogi,Aladine Chetouani,Vincent Nguyen,Aurélien Chateigner
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Recent advances, Recent, SLAM have leveraged, view synthesis, advances in SLAM
备注：
点击查看摘要
Abstract:Recent advances in SLAM have leveraged 3DGS for photorealistic reconstruction and novel view synthesis. However, most methods rely on RGB-D input, which is unavailable on consumer-grade smartphones, and few integrate 3DGS within a collaborative framework. Therefore, we present CGS-SLAM, a hybrid decentralized/centralized system enabling multi-agent 3DGS SLAM using only RGB and inertial data. Each agent performs local tracking with inertial data as a motion prior and reconstructs a scaled map using a metric monocular depth estimator (Depth Pro). Keyframe encodings are shared among agents, enabling dynamic keyframing in regions of spatial overlaps with other agents, enhancing submap alignment. Afterwards, a central server aligns submaps using VGGT as a view alignment model. This bidirectional communication keeps communication cost low during mapping and global reconstruction in difficult GNSS-denied environments. Experiments on multiple datasets demonstrate competitive tracking performance, improved rendering quality over state-of-the-art methods, and accurate submap alignment.
53. 【2608.26866】Order Matters: A Chinese Multi-Panel Meme Benchmark for Vision-Language Reasoning
链接：https://arxiv.org/abs/2608.26866
作者：Haihan Li,Haihao Li,Zhenfei Xu,Jize Qian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal tasks depend, ordered and composed, elements are ordered, tasks depend, visual elements
备注：
点击查看摘要
Abstract:Many multimodal tasks depend on how visual elements are ordered and composed, not only on recognizing them in isolation. Internet memes are a compact case of this problem: their punchline often depends on a constrained reading order and cross-panel visual--textual cues. While large vision-language models (LVLMs) show strong performance on single-image understanding, it remains unclear whether they can perform sequence-aware reasoning over structured meme layouts, especially in Chinese social media. We introduce CMPM, a Chinese Multi-Panel Meme benchmark with 1,214 annotated samples covering five structural types, ordering dependency, panel-order constraints, and optional comment context. We formulate a two-layer evaluation: Task1 probes structure typing and order-sensitive panel sequencing (with a context ablation setting), and Task2 evaluates Chinese meme explanation generation with human ratings on five 1-3 Likert dimensions (visual, panel, humor, context, and faithfulness). We benchmark five representative LVLMs under a unified protocol. Results indicate that canonical-display accuracy is not by itself evidence of order understanding: the primary shuffled condition produces a sharp accuracy drop, revealing a persistent gap in order-sensitive multimodal reasoning. Task2 preferences place Gemini 3.1 Pro and GPT-5.5 above the open models, while comment context yields only a small and mixed Core4 gain. Code and data will be released upon acceptance.
54. 【2608.26861】FIDA: Feature Instability-Driven Attack on Self-Supervised Facial Representation
链接：https://arxiv.org/abs/2608.26861
作者：Zhiyang Chen,Changchun Yin,Huiqin Yang,Liming Fang
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)
关键词：models are vulnerable, SSL, self-supervised face learning, Feature Instability Loss, FIDA
备注：
点击查看摘要
Abstract:Self-supervised learning (SSL) models are vulnerable to backdoor attacks. However, the systemic risks they pose in face representation have received little attention. The entanglement of identity features in self-supervised face learning presents unique challenges for attack stealthiness. To address this gap, we propose FIDA (Feature Instability-Driven Attack), a novel backdoor attack framework. FIDA uses subtle semantic triggers for injection, but its key innovation is a novel objective called Feature Instability Loss. It trains the encoder to increase the sensitivity of triggered features along perturbation directions sampled during attack optimization . By preventing the backdoor from exhibiting the rigid feature patterns typical of previous attacks, FIDA effectively evades the evaluated perturbation-based defenses. Experiments show that FIDA achieves a high attack success rate and generally preserves benign utility across the evaluated settings , posing a significant threat to real-world multimedia applications relying on facial analysis.
55. 【2608.26859】A Geometry-Driven, Framework-Agnostic Optimization for Object Pose Estimation
链接：https://arxiv.org/abs/2608.26859
作者：Wei Chen,Tao Zhen,Zhongchen Shi,Jing Zhang,Liang Xie,Erwei Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains predominantly model-centric, research remains predominantly, Current object pose, estimation research remains, Current object
备注： Submitted to TPAMI, under review
点击查看摘要
Abstract:Current object pose estimation research remains predominantly model-centric, focusing on architectural innovations and post-processing refinements. This paper introduces a data-centric optimization by proposing a novel, physically grounded rotation representation through principal axes alignment. Our method aligns the object's coordinate system with its inherent geometric axes, derived from inertial properties, yielding three key advantages: Inherent Stability-leveraging the energy-minimizing property of principal axes provides a robust representation that is less sensitive to noise and occlusions; Symmetry-Aware Canonicalization-explicitly resolving rotational ambiguities for symmetric objects at the data level, which fundamentally eliminates label confusion during network training; and Framework Agnosticism-the optimization is applied purely at the dataset level, ensuring plug-and-play compatibility with existing networks without any architectural modification. We validate the framework across diverse category-level and instance-level models. Extensive experiments demonstrate consistent and significant accuracy improvements, while preserving the integrity of the baseline network. This work establishes a new, geometry-driven direction for enhancing pose estimation, circumventing the need for complex network redesign.
56. 【2608.26856】From Reasoning to Pixels: Grounded Medical Multimodal LLMs for VQA and Segmentation
链接：https://arxiv.org/abs/2608.26856
作者：Haowen Gu,Gensheng Pei,Junzhu Mao,Qiong Wang,Mingwu Ren,Yazhou Yao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large Language Models, Visual Question Answering, Multimodal Large Language, Medical Visual Question, Language Models
备注： accepted by ECCV 2026
点击查看摘要
Abstract:Although Multimodal Large Language Models (MLLMs) have demonstrated impressive performance in Medical Visual Question Answering (Med-VQA), their reliance on global image features often lacks precise pixel-level grounding, thereby limiting clinical trustworthiness. To bridge the semantic gap between high-level clinical reasoning and spatial localization, we propose \textsc{\textsc{MedREAL}} (\textbf{Med}ical \textbf{RE}asoning-driven \textbf{A}nswering and \textbf{L}ocalization), a unified framework that seamlessly aligns linguistic reasoning with spatial grounding. Specifically, \textsc{MedREAL} introduces \textbf{S}eg \textbf{A}nchored \textbf{R}easoning \textbf{P}ooling (SARP) to distill task-relevant semantic evidence directly from \texttt{[SEG]} tokens within the MLLM's hidden states. Furthermore, a \textbf{R}easoning-to-\textbf{V}isual (R2V) fusion mechanism is proposed to effectively inject these reasoning-aware features into a segmentation pipeline for accurate mask decoding. To facilitate this paradigm, we construct MedRAVS-13K, a comprehensive dataset comprising 13,824 expertly validated samples across four diverse imaging modalities. Extensive experiments demonstrate that \textsc{MedREAL} significantly outperforms state-of-the-arts, achieving 68.49\% gIoU and 70.47\% cIoU on benchmark evaluations. By generating evidence masks that are strictly consistent with textual diagnoses, \textsc{MedREAL} provides a robust, interpretable framework for reasoning-driven medical image analysis.
57. 【2608.26848】MedFG-VQA: Low-Frequency Memory and Graph Attention for Lightweight Medical VQA
链接：https://arxiv.org/abs/2608.26848
作者：Haowen Gu,Gensheng Pei,Zeren Sun,Mingwu Ren,Xiangbo Shu,Yazhou Yao,Fumin Shen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Medical Visual Question, Visual Question Answering, holds significant promise, Medical Visual, Question Answering
备注： Accepted by CVPR 2026
点击查看摘要
Abstract:Medical Visual Question Answering (Med-VQA) holds significant promise for clinical decision support, yet faces challenges due to limited annotated data and the high computational demands of existing large vision-language models. We propose MedFG-VQA, a lightweight framework that leverages a memory bank to augment DCT-based low-frequency features and employs graph-enhanced cross-attention for effective visual-textual alignment. Specifically, our approach features two key components: Frequency-Memory Fusion (FMF), which enhances low-frequency features by retrieving from a learnable memory bank built on DCT decomposition, and Graph-Aware Cross-Attention (GACA), which aligns visual-textual features via cross-attention and refines them through graph-convolutional aggregation. To address data scarcity, we construct SynMed-VQA, a large-scale synthetic dataset comprising over 2 million question-answer pairs across 9 imaging modalities and 10 major organs, generated with GPT-4o. Extensive experiments on SynMed-VQA and three other standard biomedical VQA benchmarks demonstrate that MedFG-VQA achieves competitive or superior performance compared to much larger models while maintaining significantly lower computational costs, highlighting its efficiency and potential for clinical deployment.
58. 【2608.26833】Rethinking Image Processing for the Age of AI: A Problem-First Framework for Scientific Progress
链接：https://arxiv.org/abs/2608.26833
作者：Guoping Qiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：greatly expanded, expanded the capabilities, image processing, imaging problem, real-world imaging problem
备注：
点击查看摘要
Abstract:Modern AI has greatly expanded the capabilities of image processing. However, the ready availability of powerful models, public datasets, and benchmark leaderboards has also en- couraged a model-first research pattern: researchers increasingly begin with an available architecture and optimize it on a public benchmark, rather than beginning with the underlying real-world imaging problem. This can produce impressive benchmark results without necessarily improving our understanding or solution of the real problem. This paper argues for a problem-first approach that distinguishes the physical imaging problem, solution principle, statistical estimator, and computational implementation, while clarifying what modern AI can achieve and which fundamental problems remain unsolved. Through case studies of super- resolution and low-light enhancement, we show how benchmark datasets may define tasks that differ substantially from the real-world problems they are intended to represent, and why performance improvements must be interpreted within the conditions under which they are obtained. We propose a six-stage workflow that places problem formulation, image acquisition, information-loss analysis, assumptions, ambiguity, and evaluation before model and dataset selection. The paper also proposes clearer standards for evidence, reproducibility, uncertainty, and claims of state-of-the-art performance. More fundamentally, it calls for a change in research culture and education so that future researchers learn to understand imaging problems deeply and use modern AI to achieve genuine scientific and technical advancement.
59. 【2608.26829】SAGE: Variate-Wise Semantic Augmentation for Vision-Language Time Series Forecasting
链接：https://arxiv.org/abs/2608.26829
作者：Haizhao Fan,Xinyi Le
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：raw numerical sequences, experts implicitly leverage, domain experts implicitly, numerical sequences, implicitly leverage
备注： 10 pages, 2 figures
点击查看摘要
Abstract:Time series forecasting models operate on raw numerical sequences, lacking the semantic knowledge that domain experts implicitly leverage, such as the physical meaning of each variable, its statistical behavior, and its temporal dynamics. Recent efforts to bridge this gap fall into two camps. Some rely on large language models at inference time, which is computationally expensive. Others apply uniform textual prompts at the dataset level, ignoring the heterogeneous semantics across individual variates. We propose SAGE (Seeing and Augmenting with Grounded Encoding), an end-to-end CLIP-based framework that jointly models temporal, cross-variable, textual, and visual information. The CLIP text encoder processes frequency-enhanced patches and variable tokens, while gated residual paths inject variable-specific descriptions and statistical descriptors. In parallel, the frozen CLIP vision encoder aligns rendered series with temporal representations through a training-only contrastive objective. This dual use of CLIP adds complementary semantic and visual supervision without placing an LLM in the forecasting loop. Across eight long-term benchmarks and M4, SAGE achieves state-of-the-art accuracy. Ablations confirm complementary gains from multimodal alignment and variable-level knowledge.
60. 【2608.26827】Evaluator-Dependent Patient-Adaptive ECG Lead-Channel Allocation
链接：https://arxiv.org/abs/2608.26827
作者：Xiaoyang Li,Zeyan Tao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：observed cardiac state, patient observed cardiac, Patient-conditioned acquisition policies, ECG lead-channel selection, Patient-conditioned acquisition
备注：
点击查看摘要
Abstract:Patient-conditioned acquisition policies for ECG lead-channel selection can outperform population-wide fixed protocols by tailoring the channel budget to each patient's observed cardiac state. However, the value of acquiring any given channel is defined relative to a downstream diagnostic evaluator, so marginal utilities learned under one evaluator need not transfer when the evaluator is replaced. We study this evaluator dependence empirically on PTB-XL by freezing two policies (ECG-on-Demand and MGA) trained with a controlled arbitrary-mask logistic evaluator, then scoring their unchanged acquisition trajectories with a more predictive masked raw-waveform ResNet1D. Exhaustive search provides metric-matched population-wide fixed comparators separately for each evaluator, enabling a clean interaction contrast. At budget $k=4$ on a held-out evaluation fold, ECG-on-Demand shifts from $D_\mathrm{C}=-0.011$ (favoring adaptive under the controlled evaluator) to $D_\mathrm{S}=+0.029$ (favoring fixed under the strong evaluator), yielding an NLL interaction of $+0.041$ (95% CI $[+0.030, +0.050]$). Across two policies, five budgets, and three probabilistic metrics, all 30 interaction estimates are positive with paired confidence intervals excluding zero. Three post-hoc sensitivity analyses -- common-reference scoring, training the strong evaluator on a mixture of policy-generated and random masks, and evaluator-aligned Strong-MGA policy training -- each preserve a positive interaction interval, making reference-choice and mask-distribution artifacts less plausible explanations. Evaluator-aligned training reduces but does not eliminate the gap. These results indicate that adaptive ECG channel allocation should be developed and validated jointly with its intended diagnostic backbone, and that jointly optimized sensing-diagnosis systems remain an open problem.
61. 【2608.26820】LLaVAFlow: Preserving Latent Alignment Flow for Parameter-Efficient Multimodal Fine-Tuning
链接：https://arxiv.org/abs/2608.26820
作者：Muyao Yuan,Muyan Jiao,Jiangyong Ying,Weizhan Zhang,Yuanhong Zhang,Lan Ma,Yuan Gao,Haipeng Du
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Language Models, Multimodal Large, Large Language
备注： Accepted by ACM Multimedia 2026 (ACM MM 2026)
点击查看摘要
Abstract:While Multimodal Large Language Models (MLLMs) exhibit strong generalization, visual instruction tuning for downstream tasks inevitably causes catastrophic forgetting, impairing overall generalization. While existing methods regulate weight updates to reduce forgetting, they overlook the fundamental cross-modal alignment in MLLMs. Based on prior work and our observations, we argue that cross-modal alignment is implicitly captured in the information-compression trajectory. To preserve the alignment flow embedded in the trajectory, we propose LLaVAFlow, an information-theoretic distillation framework. First, we compress the mutual information between the extracted relations and MLLM embeddings, encouraging a learnable module to produce a refined alignment flow that benefits downstream tasks. Second, we maximize the mutual information between the extracted alignment flows of the pretrained and fine-tuned MLLMs, enabling the transfer of compact alignment information. Extensive experiments show that LLaVAFlow is an effective plug-and-play framework that preserves alignment flow and enhances both downstream performance and generalization.
62. 【2608.26812】Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpainting
链接：https://arxiv.org/abs/2608.26812
作者：Shuo Li,Mike Davies,Mehrdad Yaghoobi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：diffusion Equivariant Imaging, Equivariant Imaging, hyperspectral image, corrupted HSI acquisition, Imaging
备注： 14 pages, 7 figures
点击查看摘要
Abstract:A novel Hyperspectral diffusion Equivariant Imaging (HyDiff-EI) framework for solving the hyperspectral image (HSI) inpainting problem has been presented here. Unlike conventional diffusion-based methods that rely on large-scale pretraining, HyDiff-EI is a test-time optimization framework that learns directly from a single corrupted HSI acquisition. This makes it flexible for different sensor configurations and particularly well-suited for practical remote sensing scenarios where large annotated hyperspectral datasets are limited. To address the ill-posed nature of unsupervised inpainting, we embed equivariant consistency constraints within the diffusion process. By leveraging the inherent geometric symmetries and intrinsic characteristics of HSIs, HyDiff-EI bridges the gap between generative diffusion modeling and self-consistent physical priors. We empirically show that coupling diffusion modeling with equivariant priors substantially enhances noise robustness and generalizability. Extensive experiments on real-world datasets including Chikusei, Botswana, and EMIT demonstrate that HyDiff-EI offers remarkable inpainting quality over existing self-supervised and diffusion-based algorithms in both noiseless and noisy cases.
63. 【2608.26809】hinking on Shots: Consistent Multi-Shot Video Editing with Agentic Reasoning
链接：https://arxiv.org/abs/2608.26809
作者：Chenyang Wu,Fuchen Long,Binyuan Huang,Xinlong Sun,Xi Chen,Chun-Le Guo,Chongyi Li
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：methods primarily focus, short video clips, significantly advanced video, existing methods primarily, advanced video editing
备注： Project Page: [this https URL](https://wucy0519.github.io/MMLVE/) and see source codes at [this https URL](https://github.com/Wucy0519/MMLVE)
点击查看摘要
Abstract:While generative AI has significantly advanced video editing, existing methods primarily focus on single-shot or short video clips. Editing long videos with multiple instructions remains a formidable challenge. Naive chunking strategies, e.g., fixed-duration segmentation, often lead to entity fragmentation, severe editing hallucinations, and disrupted temporal continuity. To bridge this gap, we introduce the Multi-Instruction Multi-Shot Long-Video Editing (MMLVE) task, which is structured around three core objectives: Cross-Shot Editing Consistency (CSEC), Multi-Instruction Decoupling (MID), and Zero-Destruction on Spatiotemporal Structure (ZDSS). To tackle these three unique challenges, we introduce an agentic editing framework that leverages the synergy of Large Language Models (LLMs) and Vision-Language Models (VLMs) to achieve shot-level video decoupling and precise instruction parsing. Furthermore, to comprehensively evaluate this task, we construct MMLVE-Bench, which is an MMLVE-focused dataset characterized by complex real-world spatiotemporal dynamics, high-density heterogeneous instructions, and sparse, random entity distributions. Three MMLVE-focused evaluation metrics are further exploited to assess the quality of the editing results. Extensive experiments demonstrate that our MMLVE-Agent outperforms existing closed-source SOTA approaches (e.g., Seedance 2.0), successfully eliminating editing hallucinations, preserving cross-shot editing consistency, and attaining seamless spatiotemporal transitions.
64. 【2608.26806】Multi-Image Visual Token Pruning in Large Visual Language Models
链接：https://arxiv.org/abs/2608.26806
作者：Rongyang Zhang,Chengqiang Lu,Cong Li,Hongchao Gu,Tingjia Shen,Xuyang Zhi,Qimeng Wang,Yan Gao,Yi Wu,Yao Hu,Hao Wang,Enhong Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Language Models, Large Vision Language, Language Models, Large Vision, Vision Language
备注： 14 pages, 3 figures
点击查看摘要
Abstract:With the growing demand for processing multiple image sequences in real-world applications, various visual token pruning methods have emerged to mitigate the computational and context length constraints faced by Large Vision Language Models (LVLMs). However, most existing pruning approaches rely on static strategies that struggle to adapt across different architectural LVLMs and multi-image scenarios, and are additionally constrained by their dependence on attention computations that are incompatible with efficient techniques like FlashAttention. To address these limitations, we propose a training-free, Adaptive Visual Token Pruning (AVTP) framework, applicable to diverse LVLM architectures. We strategically determine pruning layers based on empirical analysis of visual attention distributions across various LVLMs, and implement adaptive pruning ratios in multi-image contexts where images of higher importance retain proportionally more tokens. We conduct extensive experiments across different LVLMs to demonstrate the effectiveness and robustness of AVTP. Specifically, Qwen3VL-8B achieves 2 times inference speedup while maintaining 96.1\% of its original accuracy on multiple multi-image benchmarks, InternVL3.5-8B retains 94.1\% accuracy, and LLaVA-OV-7B even exceeds its original baseline performance. Our code is available at \href{this https URL}{this link}.
65. 【2608.26794】Ring Forcing: Towards Precise Long-Term Memory for Autoregressive Video Diffusion
链接：https://arxiv.org/abs/2608.26794
作者：Bowen Xue,Brandon Y. Feng,Chenguo Lin,Yuchen Lin,Yujia Zeng,Lvmin Zhang,Maneesh Agrawala,Honglei Yan,Panwang Pan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scaling video generation, current models lack, models lack robust, lack robust long-term, robust long-term memory
备注： Project page: [this https URL](https://ringforcing.com)
点击查看摘要
Abstract:Scaling video generation to long durations reveals a critical bottleneck: current models lack robust long-term memory. This deficiency can be studied along two critical aspects: object permanence, the ability to precisely reproduce the appearance of objects upon re-entry; and memory capacity, the ability to process ultra-long context and use information from distant history. Robust long-term memory requires both: object permanence without sufficient context handling limits the temporal scope, while long context length without permanence fails to maintain identity. To address this, we present Ring Forcing, an autoregressive video diffusion framework designed to robustly construct and precisely utilize long-term memory. Our ring-structured training strategy enforces retrieval from distant history, effectively reconciling the trade-off between strict historical adherence and generative diversity. To expand memory capacity, we introduce a compression and timestep composition strategy. Under fixed sequence length constraints, this method extends the effective historical span to minutes-long durations and achieves a comprehensive receptive field over the entire history. Furthermore, we present a sparse RoPE mechanism to enable flexible, scalable memory adaptation while fully exploiting pre-trained priors. Extensive experiments demonstrate that Ring Forcing achieves superior minutes-long coherence and object permanence, significantly outperforming state-of-the-art methods.
66. 【2608.26771】Cross-Architecture Knowledge Distillation from a Vision Foundation Model to a Lightweight Visual State Space Model for Tea Leaf Disease Classification
链接：https://arxiv.org/abs/2608.26771
作者：Zibo Zhou,Zongsen Qiu,Rui Chen,Yujie Yao,Yue Zhou,Jianjun Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated tea leaf, supports precision agriculture, tight compute budgets, tea leaf disease, leaf disease classification
备注：
点击查看摘要
Abstract:Automated tea leaf disease classification supports precision agriculture, yet deploying accurate models on edge devices remains challenging under tight compute budgets. Self-supervised vision foundation models such as DINOv2 provide strong features but are too large for field deployment, while lightweight models trained from scratch on small agricultural datasets often underfit. We study cross-architecture knowledge distillation (KD) from a fine-tuned DINOv2 teacher (Vision Transformer) to a compact bidirectional Visual State Space Model (LVSSM) student, an underexplored direction because the architectures use fundamentally different token-mixing mechanisms. We identify and fix two training-stability problems that prevent the from-scratch SSM student from learning on limited data: a single large patch-embedding convolution and a fusion layer that severs the residual path. With a progressive convolutional stem and gated bidirectional selective-scan block, the 4.45M-parameter student trains stably. Across three seeds, temperature-scaled logit distillation raises test accuracy from 92.32+/-2.14% to 95.41+/-1.17% (best single run: 96.20%; macro-F1: 94.45%), a +3.09 percentage-point mean gain. The student uses 5.0 times fewer parameters than the 22M-parameter teacher while retaining 98.3% of its accuracy. Ablations show that intermediate feature-alignment losses reduce accuracy, making simple logit-level KD the strongest configuration. A fair from-scratch comparison shows the gain is specific to students that start below the teacher. We report per-class metrics, confusion matrices, bootstrap confidence intervals, and FLOPs/latency measurements, and discuss limitations including the single-dataset scope and simplified non-official SSM implementation.
67. 【2608.26752】Glass Surface Detection Grounded in 3D Visual Geometry
链接：https://arxiv.org/abs/2608.26752
作者：Yiwei Lu,Ke Xu,Tao Yan,Xiaojun Chang,Radu Timofte,Rynson W. H. Lau
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, remains challenging, challenging due, transparency and reflectivity, Glass
备注： 9 pages, 10 figures. Accepted by ACM Multimedia 2026
点击查看摘要
Abstract:Glass surface detection (GSD) is critical for scene understanding and reconstruction, and yet remains challenging due to the transparency and reflectivity of glass surfaces. Existing GSD methods typically rely on 2D appearance cues, which may fail in geometrically ambiguous scenes. In this paper, we propose a paradigm shift: grounding GSD in 3D visual geometry to explicitly model the physical existence of glass surfaces. Our method first distills rich 3D priors from the visual geometry grounded transformer (VGGT) and generates glass-aware 3D representations. It then exploits multi-tasking learning with a novel glass detection head, consisting of two core modules: a Frequency Self-Attention Module (FSAM) that identifies glass-specific spectral features for glass surface localization, and a Geometry Grounding Block (GeGB) that selectively grounds 2D features in 3D geometry for glass surface segmentation. Extensive experiments demonstrate that our method achieves state-of-the-art performance across seven standard GSD benchmarks, generalizes well to video/multi-modal data, and substantially improves reconstruction in glass scenes. Code is available in this https URL.
68. 【2608.26744】G2D: Generative-to-Discriminative Collaborative Inference for Zero-Shot Image Classification
链接：https://arxiv.org/abs/2608.26744
作者：Zehua Hao,Fang Liu,Qinliang Wang,Yaoyang Du,Xinyan Huang,Puhua Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：http URL CLIP, http URL propose, http URL, http URL generative, http URL complementarity
备注： Accepted at ACM MM 2026. 10 pages, 5 figures
点击查看摘要
Abstract:Zero-shot classification needs efficient label retrieval and fine-grained visual reasoning, yet discriminative and generative vision-language models fail in complementary this http URL CLIP's top-1 prediction is wrong, the correct label often remains in its top-$K$ shortlist, making disambiguation rather than recall the key this http URL generative models, however, are hindered by large label spaces and unconstrained this http URL complementarity motivates separating broad candidate retrieval from fine-grained, image-grounded this http URL propose G2D, a training-free framework that uses a generative VLM to verify CLIP-retrieved candidates against the this http URL names and CLIP probabilities provide a structured prior for resolving visually similar this http URL confidence routing, entropy-adaptive candidate sizing, and trie-constrained decoding focus generative reasoning on uncertain samples and ensure one valid output for each input at test this http URL eight benchmarks, G2D achieves 68.85% average accuracy, versus 59.35% for CLIP and 63.11% for the standalone this http URL seven generator configurations, candidate-set verification improves average accuracy by 1.08--27.42 percentage points.G2D also transfers to DCLIP, WaffleCLIP, and CuPL, supporting a practical interface between discriminative proposal and generative visual reasoning. Code: this https URL
69. 【2608.26737】Generative Semantic Scene Completion
链接：https://arxiv.org/abs/2608.26737
作者：Shi Chen,Weifeng Ge
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：Outdoor LiDAR semantic, semantic voxel grid, semantic scene completion, dense semantic voxel, Outdoor LiDAR
备注： 18 pages, 12 figures, 4 tables. Supplementary material (29 pages) is included as an ancillary file. Project page: [this https URL](https://shichen.world/GSSC-project-page/) - Code, models and the PS$^3$ dataset: [this https URL](https://github.com/BillyChern/GSSC-S2D2)
点击查看摘要
Abstract:Outdoor LiDAR semantic scene completion (SSC) recovers a dense semantic voxel grid from a scan observing 1% of the target volume, under class imbalance beyond 7,000x. We recast SSC as generative semantic scene completion (GSSC): a single discrete-diffusion formulation in three roles. First, paired sparse-dense scene synthesis (PS$^3$) generates matched sparse LiDAR observations with their dense semantic completions, addressing the long tail at its source and yielding the PS$^3$-SemanticKITTI corpus we train on alongside SemanticKITTI. Second, semantic-guided generative scene completion (SGSC) generates the scene from noise with multinomial discrete diffusion, conditioned on the sparse scan through a bird's-eye-view semantic map and a sparse 3D feature stream. Third, the same framework instead refines an existing completion in one flow-matching step: structured source discrete diffusion (S$^2$D$^2$). S$^2$D$^2$ improves the mIoU of SGSC's own output and every external SSC base tested, without base retraining or test-time adaptation. On the strongest base, one step without test-time augmentation reaches 38.8% mIoU on the SemanticKITTI hidden test. To our knowledge that is the best causal, single-sweep, single-sample result on that leaderboard, +2.1 pp over the previous best published score under the same restriction. Four correction steps with eight-view test-time augmentation reach 39.2%, outside that restriction.
70. 【2608.26724】GeoMAD: Geometry-Aware Multi-View Anomaly Detection via Deformable Fusion and Distributional Alignment
链接：https://arxiv.org/abs/2608.26724
作者：Shang-Fu Chen,Jhih-Ciang Wu,Kuan-Chuan Peng,Wen-Huang Cheng,Kai-Lung Hua
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exploiting complementary observations, multiple camera viewpoints, detects defects, defects by exploiting, exploiting complementary
备注：
点击查看摘要
Abstract:Multi-view anomaly detection (MvAD) detects defects by exploiting complementary observations from multiple camera viewpoints. The central challenge is to fuse views with sufficient geometric awareness while remaining scalable to multi-class industrial settings. Existing methods typically fall into two extremes: voxel-based fusion provides explicit geometric alignment but requires costly 3D construction and class-specific assumptions, whereas lightweight patch-based fusion is efficient but relies on discrete candidate matching and lacks continuous cross-view correspondence. In this paper, we propose GeoMAD, a unified multi-view, multi-class AD framework that addresses both geometric correspondence deficiency and distributional inconsistency. Our \textit{Cross-view Deformable Fusion Module} (CDFM) learns content-adaptive, view-pair-specific sampling offsets directly on 2D feature maps and arranges them across a multi-scale window pyramid with image-global reference sampling, enabling hierarchical cross-view correspondence without camera calibration, voxel construction, or class-specific 3D supervision. We further introduce \textit{Distributional View Alignment} (DVA), a self-supervised cross-view regularization loss that aligns each view's bottleneck distribution against a per-instance view-centric target, enforcing global consistency without pixel-level correspondence. Together, CDFM and DVA bridge local geometric correspondence and global distributional consistency, providing geometry-aware and distribution-consistent fusion while preserving the efficiency of 2D feature-space learning. Extensive experiments on Real-IAD and MANTA-Tiny show that GeoMAD achieves strong detection and localization performance in unified MvAD.
71. 【2608.26722】UniGeo: A Multi-modal Large Language Model for Text-Guided Cross-View Geo-Localization
链接：https://arxiv.org/abs/2608.26722
作者：Jiahao Wen,Hang Yu,Zhedong Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large-scale image gallery, Text-guided drone geo-localization, aims to identify, identify a target, target region
备注：
点击查看摘要
Abstract:Text-guided drone geo-localization aims to identify a target region in a large-scale image gallery from a natural-language description. Existing methods mainly formulate this task as direct matching between an open-ended text query and candidate images. However, incomplete queries and highly similar candidates often make global cross-modal matching insufficient for reliable fine-grained localization. We propose UniGeo, a unified multimodal large language model (MLLM) for text-guided drone geo-localization. Built on a shared vision-language framework, UniGeo jointly supports geo-semantic understanding, cross-view semantic generation, and candidate-level verification. Specifically, it establishes stable correspondences among local scene elements, spatial relations, and language descriptions through geo-semantic learning, and further models semantic mappings between drone and satellite views through cross-view generation. Based on these capabilities, a plug-and-play verification module performs fine-grained discrimination among highly confusable candidates. We further introduce a multi-stage training strategy that progressively learns geo-semantic understanding, cross-view generation, and candidate verification, improving adaptation to text-guided geo-localization. Experiments demonstrate consistent improvements across multiple retrieval backbones. On GeoText-1652, UniGeo improves R@10 and mAP by 13.59 and 2.83 percentage points, respectively, validating its effectiveness for fine-grained text-guided drone geo-localization.
72. 【2608.26720】Parameter Efficient Continual Learning for Sparse Event-Based Transformers
链接：https://arxiv.org/abs/2608.26720
作者：Vaishnavi Nagabhushana,Kartikay Agrawal,Ayon Borthakur
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：data arrives continuously, edge intelligence systems, intelligence systems operate, preserving previously learned, previously learned knowledge
备注：
点击查看摘要
Abstract:Robotic and edge intelligence systems operate in dynamic environments where data arrives continuously, requiring models to adapt while preserving previously learned knowledge under strict memory and energy constraints. While parameter-efficient fine-tuning has shown promise for continual learning with vision transformers, conventional architectures rely on dense computation and remain costly for real-world deployment. Sparse event-based vision transformers provide energy-efficient event-driven computation, yet their continual learning capabilities remain largely unexplored. We here introduce sLoTh, a parameter-efficient continual learning framework for pretrained sparse event-based (spiking) vision transformers. sLoTh freezes the backbone and restricts plasticity to scalable-efficient low-rank attention updates (seLoRA) and shared neuronal threshold modulation, enabling adaptation without replay buffers by updating less than 1% of model parameters. Experiments across CIFAR-100, Tiny-ImageNet, ImageNet-100, and ImageNet-R with up to 100 tasks demonstrate competitive rehearsal-free performance in class-incremental learning and online continual learning, while enabling approximately 6.5x lower energy consumption than conventional dense vision transformers.
73. 【2608.26716】Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models
链接：https://arxiv.org/abs/2608.26716
作者：Yiyang Huang,Zhaowen Wang,Simon Jenni,Jing Shi,Yitian Zhang,Yizhou Wang,Yun Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：user interface, essential for document, compositional layout understanding, Layout understanding, element organization
备注： ECCV 2026
点击查看摘要
Abstract:Layout understanding, or the interpretation of element organization, is essential for document analysis, user interface (UI) creation, and graphic design. While recent vision-language models (VLMs) excel at interpreting atomic layouts composed of independent elements, they struggle with compositional layouts that require reasoning over visually entangled elements within hierarchical multi-layer structures. In this paper, we introduce a new task, compositional layout understanding, and present CoDeLayout, a VQA dataset of ~20K real-world multi-layer layouts annotated with compositional element pairs and design intent. Through empirical analysis on CoDeLayout, we identify two key challenges for existing VLMs: semantic drift between textual metadata and visual content, and structural ambiguity in hierarchical inter-element relationships. To address these challenges, we propose MASON, a post-training paradigm that integrates multimodal alignment (MA) and structural perception (SP). MA enhances element interpretation by grounding metadata-defined elements to their visual counterparts, mitigating semantic drift, while SP models layer-aware inter-element spatial relationships to improve hierarchical understanding and reduce structural ambiguity. Experiments reveal substantial gaps in existing VLMs: even the strongest baseline, GPT-o3, achieves only 79.68% accuracy, whereas Qwen2.5-VL 7B with MASON reaches 91.66%. Notably, MASON surpasses full-data Direct Finetune using only 30% of the training data and scales better with additional data.
74. 【2608.26714】LiveVVT: High-Fidelity Video Virtual Try-On in Real Time
链接：https://arxiv.org/abs/2608.26714
作者：Yushe Cao,Shikun Feng,Ruxiang Duan,Liyong Wang,Dianxi Shi,Chun Yu,Junliang Xing
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Diffusion-based Video Virtual, achieves high visual, practical continuous deployment, high visual fidelity, complete-clip dependence incurs
备注： 16 pages, 13 figures,
点击查看摘要
Abstract:Diffusion-based Video Virtual Try-On (VVT) achieves high visual fidelity through bidirectional spatio-temporal modeling, but complete-clip dependence incurs prohibitive latency and computational overhead in practical continuous deployment. Naively enforcing causality disrupts pretrained bidirectional priors and substantially degrades synthesis quality. We introduce LiveVVT, a rolling streaming diffusion framework that preserves bounded bidirectional modeling within causal recurrent generation. Within a fixed-size window, LiveVVT jointly denoises multiple video chunks under bounded look-ahead, preserving local bidirectional interactions while emitting one clean chunk per iteration. Beyond the window, two complementary memories sustain long-term consistency: a bounded temporal memory propagates recent dynamics and occlusion context, whereas a persistent global appearance memory, constructed once from the target garment and a frontal try-on keyframe, anchors garment details and dressed appearance throughout the stream. We further introduce a progressive distillation framework integrating bidirectional VVT learning, teacher-trajectory regression for causal few-step adaptation, and Collaborative Matching Distillation, which couples teacher-distribution matching with rolling flow matching on real videos to align optimization with recurrent inference. Experiments on paired and unpaired long-sequence benchmarks demonstrate superior generation quality over similarly sized models, with $26\times$ lower latency and $11\times$ higher throughput, enabling high-fidelity real-time streaming VVT.
75. 【2608.26713】AesCanvas: A Large-Scale Dataset and Benchmark for Aesthetic Critique and Contextual Suitability
链接：https://arxiv.org/abs/2608.26713
作者：Xuanwei Hu,Haoyu Dong,Kejun Wu,Tianyi Liu,Jianjun Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, Image Aesthetic Assessment
备注： 10 pages, 4 figures, 6 tables. Supplementary material included
点击查看摘要
Abstract:Recent advances in Multimodal Large Language Models (MLLMs) have extended Image Aesthetic Assessment (IAA) beyond scalar scores toward interpretable critique and guidance. Yet existing benchmarks mainly assess intrinsic visual quality or fixed domain criteria, leaving open whether an appealing image is appropriate for a specific purpose, audience, cultural setting, or domain convention. We introduce AesCanvas, a unified suite with two complementary components: CritiqueCanvas with 519,136 instruction-response pairs from 54,300 images supports long-form, multi-dimensional critique across photography, painting, and virtual imagery, whereas ContextCanvas with 301 expert-reviewed use scenarios evaluates contextual aesthetic suitability in realistic use scenarios. Under a unified protocol, we evaluate closed-source frontier, open-weight general, and aesthetic-specific MLLMs. Results reveal a clear separation between critique generation and context-sensitive judgment: reference-based lexical and semantic metrics only partially capture critique quality, while aesthetic specialists remain competitive on selected critique metrics yet substantially lag strong general-purpose MLLMs on ContextCanvas. Further analyses show that aesthetic specialization does not reliably transfer to contextual suitability and that model decisions may fail to track or ground themselves in decisive contextual visual cues. These findings establish culturally situated, evidence-grounded suitability as a distinct objective for aesthetic modeling.
76. 【2608.26686】Domain-Specific Self-Supervised Representation Learning for Retinal Fundus Classification
链接：https://arxiv.org/abs/2608.26686
作者：Bekzat Nurlanbekova,Fung Fung Ting
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：images remain scarce, remain scarce, growing number, number of public, medical images remain
备注：
点击查看摘要
Abstract:Despite the growing number of public datasets, annotated medical images remain scarce. Supervised learning methods achieve strong performance on many benchmarks, however require large amounts of labeled data, which are costly and time-consuming to obtain in the medical domain. To address this limitation, contrastive self-supervised learning (SSL) has emerged as a promising alternative for learning useful representations from unlabeled data. In this work, we investigate two SSL frameworks, SimSiam and SimCLR, for retinal disease classification from fundus images. We focus on understanding how augmentation strategies and training parameters influence representation learning under resource-constrained settings. Given limited data and computational capacity, we explore the feasibility of training SSL models with small batch sizes incorporated with retinal-specific augmentation techniques. Through a series of experiments, we assess the quality of learned representations via linear evaluation and fine-tuning across downstream tasks, including multi-disease classification and diabetic retinopathy grading. Our results show that tailoring augmentation strategies to the characteristics of retinal images plays a critical role in improving performance. Even under constrained settings, lightweight SSL frameworks can learn transferable representations that reduce dependence on large annotated datasets and achieve competitive results.
77. 【2608.26684】Reason in the Words You Speak: Idiolectal Paraphrasing Off-Policy Traces for Reasoning Distillation in VideoLLMs
链接：https://arxiv.org/abs/2608.26684
作者：Ji Soo Lee,Jinyoung Park,Seohyun Lee,Jongha Kim,Joonmyung Choi,Jinsung Yoon,Hyunwoo J. Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Relative Policy Optimization, Group Relative Policy, Recent large language, Group Relative, achieve strong performance
备注： Work in progress
点击查看摘要
Abstract:Recent large language models achieve strong performance on complex reasoning tasks, where reinforcement learning with Group Relative Policy Optimization (GRPO) has emerged as a leading paradigm for optimizing models on self-generated trajectories. However, the on-policy nature of GRPO bounds the model to the reasoning skills it can already produce, restricting to learn more advanced capabilities. Prior works inject privileged reasoning traces from a stronger teacher policy to guide training, yet these traces are inherently out of distribution with respect to the student policy. We observe that this mismatch between on-policy and off-policy causes gradient clipping on semantically critical reasoning tokens, ultimately rewarding correct answers while leaving the reasoning that justifies them unlearned. Hence, we propose \textbf{Echo-GRPO}, a framework that lets the model reason in the words it speaks. Rather than imitating low-probability privileged traces from the teacher model, Echo-GRPO rewrites them into the student policy's own \textit{idiolect}, that is, its own characteristic vocabulary and expression patterns, while preserving their semantics via Dual-Reference Decoding. We instantiate this framework as \textbf{VideoEcho-R1} for video reasoning distillation, achieving consistent improvements across three multimodal LLM backbones and five benchmarks. Finally, we show that our idiolectal paraphrasing is a plug-in module that consistently improves both RL and supervised fine-tuning frameworks for reasoning distillation, demonstrating that policy-aligned supervision extends beyond GRPO.
78. 【2608.26671】RECAP-Forcing: Retaining Content Appearances for Long Video Generation
链接：https://arxiv.org/abs/2608.26671
作者：Haiyang Xu,Zheng Ding,Zhuowen Tu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fundamental memory challenge, finite attention window, autoregressive video generation, video generation faces, history to retain
备注： Project page: [this https URL](https://xxuhaiyang.github.io/RECAP-Forcing/)
点击查看摘要
Abstract:Long autoregressive video generation faces a fundamental memory challenge: with a finite attention window, a model must decide which information from an ever-expanding history to retain. Existing methods organize memory temporally, preserving recent frames while compressing or discarding older ones. We instead propose RECAP-Forcing, organizing memory by appearance novelty. A long video is not merely a sequence of frames, but an evolving cast of subjects, objects, and scenes whose identities must remain consistent over time. We organize memory by retaining the KV cache associated with newly appearing content--such as entering subjects, disoccluded regions, and newly introduced scenes--at the moment it first becomes visible, prioritizing novelty over recency. Memory should scale with the amount of newly introduced content, rather than with video length. This appearance-indexed memory makes long-range consistency an explicit property of the memory structure. Our framework unifies two mechanisms under this single principle. At the beginning of a video, when all visible content is novel, an attention sink preserves the initial scene. As the video evolves, an optical-flow-based novelty bank extends the same principle by selectively retaining newly revealed content. As a training-free inference method with no additional learnable parameters, RECAP-Forcing consistently improves visual quality and semantic fidelity across multiple strong baselines and outperforms existing memory methods.
79. 【2608.26669】Beyond the Proving Ground: Independent Public-Road Testing of Assisted Lane Change Systems using LiDAR
链接：https://arxiv.org/abs/2608.26669
作者：Marcello Cellina,Akos Kriston,Antonio Migneco,Davide Maggi,Stefano Favelli,Fabrizio Re,Fabrizio Minarini,Andrea Nuovo,Riccardo Dona,Biagio Ciuffo
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Advanced Driver Assistance, commercial Advanced Driver, Driver Assistance Systems, Advanced Driver, Driver Assistance
备注：
点击查看摘要
Abstract:Testing of commercial Advanced Driver Assistance Systems is essential to ensure safety and compliance during type approval and in service operation. However, proving ground scenarios may not reflect real world driving complexity, while geo fencing can require manufacturer collaboration and limit assessment independence. This work presents a methodology for independently testing Assisted Lane Change systems on public roads. A campaign on the A31 French motorway used a test vehicle equipped with a LiDAR based vehicle detection and tracking system. Tests covered combinations of inter vehicle distance and speed between the test vehicle and the take over vehicle. Real time kinematic global navigation satellite system receivers assessed detection and tracking performance. Recorded lane change trajectories were compared with the lane change suppression requirements of UNECE Regulation Number 79. Of 27 predefined lane change manoeuvres, 18 were completed and 9 suppressed. In 6 cases, the system allowed manoeuvres that did not meet regulatory minimum distance requirements. In 3 cases, the deviation remained statistically significant after accounting for measurement uncertainty. To the authors knowledge, this is the first public road campaign designed to assess Assisted Lane Change compliance with Regulation Number 79 safety distance requirements. The results demonstrate the suitability of LiDAR based sensing for this purpose. The methodology can support market surveillance and future regulatory revisions by revealing real world behaviours not covered by approval procedures.
80. 【2608.26665】Hull First, Wake Second: Wake-Reliance Suppression for Robust Maritime Vessel Detection
链接：https://arxiv.org/abs/2608.26665
作者：Yefan Wang,Xingyu Wang,Ruibiao Zhu,Yusen Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：easier to detect, face scenes, longer and easier, Maritime vessel detectors, Maritime vessel
备注： Accepted by ICIG 2026 (The 14th International Conference on Image and Graphics)
点击查看摘要
Abstract:Maritime vessel detectors often face scenes where hulls are small, low-contrast, or blurred, while wakes are longer and easier to detect. This creates a wake-reliance problem: detectors may miss slow or stationary vessels with weak wakes, or produce false positives on wake-like water clutter. We propose HullWake, a hull-first wake-second framework for robust maritime vessel detection. HullWake separates proposal-centered hull evidence from directional wake context, extracts wake cues with bidirectional proposal-anchored corridors, and suppresses wake-dominant predictions through wake response supervision, wake-attenuated consistency, wake-only confidence suppression, and hull--wake decorrelation. We also introduce a wake-oriented evaluation protocol covering weak/no-wake vessels, wake-like hard negatives, worst-group AP, and confidence drop after wake attenuation. Experiments are conducted on Curated-Wake, a wake-oriented maritime dataset of about 10,000 images curated from Ships/Vessels in Aerial Images, the SMD benchmark, and SeaDronesSee, with newly added detection- and segmentation-level wake annotations. Compared with box-only detectors and mask-supervised segmentation baselines, HullWake improves overall AP, weak/no-wake robustness, wake-like false positives, worst-group AP, and confidence stability after wake attenuation.
81. 【2608.26658】PailitaoGR: Latent Think-with-Images for Generative Image Retrieval
链接：https://arxiv.org/abs/2608.26658
作者：Xiaomeng Fan,Yueran Liu,Shengyu Zhou,Chenghan Fu,Wanxian Guan,Feng Li,Chuan Yu,Jian Xu,Bo Zheng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：product semantic identifiers, demonstrated strong performance, directly generating product, generating product semantic, auxiliary evidence
备注：
点击查看摘要
Abstract:Generative retrieval has demonstrated strong performance by directly generating product semantic identifiers (SIDs). Extending this paradigm to image search, however, is nontrivial because real-world query images contain diverse information, including the search target, useful auxiliary evidence, and irrelevant visual content. This requires the model to identify and focus on the search target while selectively utilizing auxiliary evidence. In this paper, we propose \textbf{PailitaoGR}, a \emph{Latent Think-with-Images} method for generative image retrieval, which internalizes target-focused perception and selective auxiliary-evidence utilization into a the generative retrieval model, enabling \textit{Zooming without Cropping} and \textit{Reading without OCR}. Specifically, we design a target-focused perception mechanism that identifies and enhances visual tokens of the search target, consisting of a target Enhancer and a learning strategy based on on-policy distillation and attention guidance loss, enabling the model to focus on search-target regions. We also design a selective auxiliary-evidence utilization mechanism that identifies and enhances visual tokens of auxiliary evidence, including an auxiliary enhancer and an in-capacity incremental contrastive distillation strategy, enabling the model to exploit auxiliary evidence. We construct training and validation sets sampled from real-world online image-search logs. Experiments show that our method outperforms existing baselines by an average of 13.8\%, validating its effectiveness.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.26658 [cs.CV]
(or
arXiv:2608.26658v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.26658
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
82. 【2608.26656】CoGeo-GS: Concept-Driven and Geometry-Aware Multi-Object Removal in 3D Scenes
链接：https://arxiv.org/abs/2608.26656
作者：Yuanxiang Ni,Xianliang Huang,Chenhang Ma,Chen Xiao,Yuewen Ma,Ruxin Wang,Hao Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：severe occlusions, challenging due, due to severe, difficulty of maintaining, maintaining geometric
备注： 6 pages, 4 figures, accepted at ICME 2026
点击查看摘要
Abstract:Multi-object removal in 3D scenes is challenging due to severe occlusions, semantic entanglement, and the difficulty of maintaining geometric and multi-view consistency. Existing 3D Gaussian Splatting (3DGS) methods perform well for single-object editing but scale poorly to multi-object scenarios, often requiring repetitive optimization and yielding unstable geometry in removed regions. We propose CoGeo-GS, a concept-driven framework for controllable multi-object removal in 3D scenes. CoGeo-GS assigns concept-aware semantic tags to Gaussians, enabling flexible object selection and reducing interference between foreground objects and background structures within a single optimization stage. To recover plausible geometry, we introduce a geometry-aware completion pipeline that combines monocular depth priors with diffusion-based refinement and boundary-aligned blending. A geometry-regularized refinement strategy further stabilizes reconstruction and preserves multi-view consistency. Experiments demonstrate that CoGeo-GS outperforms existing methods in visual quality and reconstruction fidelity.
83. 【2608.26648】Hierarchical Channel Stacking: A Structured Decision Framework for AI-Generated Image Detection
链接：https://arxiv.org/abs/2608.26648
作者：Saifullah Shoaib,Akash Borigi,Rupendra Lekkala,Amaury Lendasse,Edward Ratner,Sai Sowjanya Bhamidipati,Alexander Schlager,Peggy Lindner
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：offer limited insight, Hierarchical Channel Stacking, decisions are formed, offer limited, limited insight
备注： 12 pages, 4 figures. Accepted for publication at ICANN 2026
点击查看摘要
Abstract:Many synthetic-image detectors produce accurate predictions but offer limited insight into how those decisions are formed. This paper introduces Hierarchical Channel Stacking (HCS), a compact framework for AI-generated image detection that converts intermediate CNN activations into a structured 60-dimensional representation organized across three progressively deeper backbone stages. HCS uses per-channel Level-1 classifiers and a Level-2 aggregator to produce image-level predictions while preserving explicit hierarchical structure for analysis. On a benchmark spanning GAN and diffusion generators, HCS achieves 86.7% accuracy and 86.7% macro-F1 on the held-out test set. Stage ablation shows that the full three-stage system outperforms reduced single-stage and two-stage variants, indicating that the hierarchy carries complementary predictive information. Stage-level contribution analysis further shows that, in the analyzed detector setting, fake GAN and fake diffusion images exhibit distinct stage-level contribution profiles. These results position HCS not simply as a compact detector, but as a structured framework for studying how synthetic-image detectors assemble evidence across representation levels.
84. 【2608.26647】ssue-Mixture Entropy-Weighted Reconstruction for Partial-Volume-Aware Brain MRI Super-Resolution
链接：https://arxiv.org/abs/2608.26647
作者：Xiao Tong,Wenyun Yang,Ziheng Zhang,Jingzhi Han,Zhaochu Luo,Jinbo Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：magnetic resonance imaging, underweight tissue-transition regions, tissue-transition regions affected, brain magnetic resonance, resonance imaging
备注： 15 pages, 6 figures, 8 tables
点击查看摘要
Abstract:Full-image objectives in brain magnetic resonance imaging (MRI) super-resolution (SR) can underweight tissue-transition regions affected by the partial-volume effect (PVE), as these regions occupy only a small fraction of the image. Binary boundaries also do not capture the continuous mixture of cerebrospinal fluid, gray matter, and white matter within a voxel. We propose Anatomy-Guided Gaussian-Parameter Warping with PVE-Balanced Reconstruction (AGW-PBR), which combines a low-resolution (LR)-only reconstruction backbone with a training-time objective that emphasizes tissue transitions. The backbone integrates LR-derived Sobel guidance, soft latent-basis assignment, and bounded grid-anchored residual warping. Fixed, quality-controlled tissue fractions derived from registered T1/T2/PD IXI images are converted into tissue-mixture entropy, which defines mean-normalized reconstruction weights within validated PVE support. These sidecars are used only during training, and inference requires only the LR image. AGW-PBR is evaluated on T2-weighted IXI images at 2x, 4x, and 6x using three seeds and subject-level paired analyses. At 4x, test-only SynthSeg masks independently assess reconstruction in tissue-interface and non-interface regions. Targeted ablations examine valid-support supervision, spatially aligned entropy weighting, and soft latent assignment. The AGW-backbone is also trained from scratch on fastMRI at 4x without PVE supervision. AGW-PBR improves full-image reconstruction across the tested IXI scales and regional fidelity at 4x, while the PVE-free backbone retains strong performance on fastMRI. These findings support tissue-mixture entropy weighting for partial-volume-aware brain MRI SR.
85. 【2608.26644】Real-time Unsupervised Object Discovery from Asynchronous Event Streams
链接：https://arxiv.org/abs/2608.26644
作者：Pratham G. Shenwai,Hemant Kumar Singh,Sridhar Ravi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cameras capture pixel-level, capture pixel-level intensity, Event cameras capture, asynchronous data streams, produce highly sparse
备注：
点击查看摘要
Abstract:Event cameras capture pixel-level intensity changes with microsecond resolution to produce highly sparse asynchronous data streams. For visual perception in latency-critical environments, we propose a lightweight, training-free framework for discovery of moving objects based on spatio-temporal clustering. This framework is driven by two core contributions. First, a linear-time Spatio-temporal Probabilistic Event Filter (SPEF) that introduces an adaptive event acceptance threshold to distinguish salient motion structures from background noise. Second, an Event Morton Code Clustering (EMCC) module that bypasses expensive distance matrix computation to efficiently group events for unsupervised discovery of moving objects. On the E-MLB dataset benchmark, SPEF achieves the best denoising performance among classical filtering methods and remains competitive with learning-based approaches without requiring any offline training. On object discovery, EMCC achieves the highest overall accuracy and lowest execution time across the FRED and eTraM datasets, outperforming established density-based clustering baselines by a substantial margin. Overall, this work establishes a new performance benchmark for classical object discovery in event data, providing a highly scalable, training-free solution for resource-constrained visual perception. The code is available at this https URL
86. 【2608.26632】Who Remains, What Changes: Identity Anchored Composed Gait Retrieval
链接：https://arxiv.org/abs/2608.26632
作者：Jingchen Fei,Zengbin Wang,Yukun Liu,Muyi Sun,Shibiao Xu,Man Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable progress, rigid visual matching, Composed Gait Retrieval, methods remain confined, introduce Composed Gait
备注：
点击查看摘要
Abstract:Gait recognition has achieved remarkable progress, yet existing methods remain confined to rigid visual matching and often overlook the potential of natural language instructions for interactive retrieval. In this paper, we introduce Composed Gait Retrieval (CoGR), a novel task that retrieves a target gait sequence based on a reference sequence and a natural language modification query. To address the absence of existing datasets for this task, we design an automated annotation pipeline powered by large vision-language models (VLMs) to construct the first gait-language datasets: Language-Augmented CCPG and Language-Augmented CASIA-B. Building on this, we propose ComposeGait, an identity-anchored composition framework designed to prevent the identity drift that arises when generic composed retrieval follows the instruction but returns the wrong person. Its Part-aware Identity Adapter (PIA) aggregates multi-frame, part-aware identity evidence into a sample-specific ID token. We inject the ID tokens into both branches of a shared Q-Former to preserve identity, while excluding the ID-token outputs from the final retrieval embeddings. Joint identity and task-adapted composed-retrieval objectives optimize this space end to end. We evaluate ComposeGait on both benchmarks and show that it achieves the best R@1 among the compared methods, reaching 72.38% on Language-Augmented CCPG and 83.61% on Language-Augmented CASIA-B. These results establish ComposeGait as a strong baseline for CoGR. The datasets and code will be made publicly available.
87. 【2608.26624】xt-to-seed generation: Training-free open-vocabulary seeded semantic segmentation via re-purposing diffusion as text-guided seed generator
链接：https://arxiv.org/abs/2608.26624
作者：Kumju Jo,Heesun Jung,Sungyong Baik
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：arbitrary text queries, segment image regions, Open-vocabulary semantic segmentation, Open-vocabulary semantic, segment image
备注： Preprint version of the work accepted for publication in Knowledge-Based Systems
点击查看摘要
Abstract:Open-vocabulary semantic segmentation (OVSS) aims to segment image regions corresponding to arbitrary text queries. Although the Segment Anything Model (SAM) is a powerful foundation model for segmentation, its standalone performance on OVSS remains limited. Existing methods therefore often use SAM to refine coarse masks predicted by other models, but this strategy is unreliable when the initial masks are inaccurate. In this work, we argue that more reliable segmentation can be achieved by exploiting SAM as a region expansion module guided by accurate object points (i.e., seeds) rather than inaccurate coarse masks. Inspired by classical seeded segmentation, we reformulate OVSS as text-guided seed localization followed by seed-based region expansion. To realize this idea, we propose Text-to-Seed (T2S), a training-free framework that leverages the text-to-region correspondence of Stable Diffusion to generate attention-based seed points for target categories described by text. These sparse seeds are then used as point prompts for SAM to produce full object masks. Without task-specific training or additional annotations, T2S achieves strong performance on standard OVSS benchmarks, demonstrating the effectiveness of combining semantic grounding with seed-driven spatial segmentation.
88. 【2608.26607】FU-Mamba: A Frequency-Enhanced Dynamic Scanning Framework for Oralscan Image Segmentation
链接：https://arxiv.org/abs/2608.26607
作者：Xinxin Zhao,Jinpeng Ye,Bo Wei,Liqin Wu,Mahmoud Hassaballah,Karen Egiazarian,Aura Conci,Victor Hugo C. de Albuquerque,Abdulkadir Sengur,Leszek Rutkowski,Yan Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Oralscan image segmentation, Oralscan image, digital dentistry, essential for computer-aided, computer-aided diagnosis
备注： Accepted by Neurocomputing
点击查看摘要
Abstract:Oralscan image segmentation is essential for computer-aided diagnosis and treatment planning in digital dentistry. However, existing visual state space models (SSMs) often rely on manually designed scanning orders to flatten image patches into sequences, which disrupts the semantic spatial continuity and hinders coherent feature extraction from key foreground regions. Moreover, elements such as inconsistent lighting, reflective surfaces, and noise during data acquisition disrupt the frequency distribution by diminishing high-frequency details while enhancing low-frequency components, consequently hindering the accurate localization of boundaries. In response to these challenges, we introduce FU-Mamba, an innovative framework that incorporates dynamic scanning and frequency domain enhancement within the SSM architecture. Specifically, the Dynamic Mamba Block (DMB) adaptively learns sampling offsets via a trainable offset prediction network and performs flexible bilinear interpolation, enabling content-aware scanning that preserves spatial coherence. Furthermore, a frequency domain enhancement block balances spectral components through wavelet-guided decomposition and spectrum pooling, improving robustness under adverse imaging conditions. Experimental findings indicate that FU-Mamba attains a notable enhancement in segmentation accuracy, evidenced by a 1.1% increase in the mean intersection over union (mIoU) metric when evaluated on the dental segmentation dataset. Project page: this https URL
89. 【2608.26589】DPA-I2P: Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration in Autonomous Driving
链接：https://arxiv.org/abs/2608.26589
作者：Wenxin Zhang,Hang Li,Zhiwei Xu,Qiankun Dong,Gang Wang,Tao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large-scale outdoor localization, Cloud Registration aims, outdoor localization, camera pose estimation, camera pose
备注：
点击查看摘要
Abstract:Image-to-Point Cloud Registration aims to estimate the camera pose of a given image within a 3D scene point cloud, which is a fundamental task in autonomous driving and large-scale outdoor localization. Recent implicit correspondence learning methods have improved registration performance by learning cross-modal alignment in an end-to-end framework, leading to more accurate camera pose estimation. However, due to the inherent modality discrepancy between images and sparse LiDAR point clouds, reliable cross-modal correspondence learning remains challenging. To address this issue, we propose Depth-Guided Projective Alignment for Image-to-Point-Cloud Registration (DPA-I2P). Unlike naive depth or feature concatenation, Ray-Conditioned Metric Depth Encoding (RMDE) and Projection-Consistent Vision Lifting (PVL) exploit depth and visual cues in a structured, geometry-aware manner. In addition, Cross-Modal Query Pruning (CQP) suppresses unreliable queries during early refinement to improve matching stability. Experiments on KITTI and nuScenes demonstrate the effectiveness of the proposed method. On KITTI, DPA-I2P reduces RTE and RRE by 45.0% and 55.6% over the strongest implicit baseline, respectively. On nuScenes, DPA-I2P also improves registration accuracy over the evaluated baselines, suggesting better transferability to different driving scenes.
90. 【2608.26580】Visual Information-Guided Parallel Decoding for Diffusion Multimodal Large Language Models
链接：https://arxiv.org/abs/2608.26580
作者：Insu Lee,Wooje Park,Wonseok Shin,Jinwoo Son,Byonghyo Shim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Diffusion multimodal large, multimodal large language, large language models, Diffusion multimodal, multimodal generation
备注：
点击查看摘要
Abstract:Diffusion multimodal large language models (dMLLMs) have recently emerged as a new decoding paradigm for multimodal generation. Starting from a fully masked sequence, dMLLMs progressively decode the sequence by unmasking a subset of the remaining masked positions at each step. Since the selected tokens serve as the prediction context for subsequent steps, deciding which tokens to decode is crucial to the quality of the final output. The most common strategy prioritizes tokens based on a certainty measure that tends to favor tokens frequently observed in the training data. Recent approaches instead order tokens according to their influence on subsequent predictions, but do not explicitly account for the input image. We propose the Visual Information-Guided Sampler (VIG-Sampler), which prioritizes tokens based on their attention to image tokens. We further impose a constraint that penalizes candidate tokens whose image-attention distributions are similar to those of previously selected tokens, thereby increasing the information gain of the decoded subset. Extensive experiments on 7 captioning and VQA benchmarks with 3 open-source dMLLMs demonstrate the effectiveness of VIG-Sampler, which outperforms the Info-Gain Sampler by an average of 19.3 CIDEr points across the captioning benchmarks and surpasses it on COCO Caption while using only half as many decoding steps.
91. 【2608.26578】rapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes
链接：https://arxiv.org/abs/2608.26578
作者：Jun-Hui Liu,Kun-Yu Lin,Yi-Lin Wei,Xu-Han Chen,Yinghao Li,Zhuohao Li,Yuan-Ming Li,Qing Zhang,Xiaoyi Fan,Dongmei Jiang,Yan Li,Wei-Shi Zheng
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Configured Failure Trapping, stealthy textual triggers, Configured Failure, work introduces Configured, Failure Trapping
备注：
点击查看摘要
Abstract:This work introduces Configured Failure Trapping, a novel backdoor attack task against Vision-Language-Action (VLA) models, which aims to activate attacks through stealthy textual triggers and induce configured failure modes. Unlike prior backdoor attacks that treat any task failure as a successful attack, Configured Failure Trapping requires the attacker to control how the robot fails (e.g., causing the robot to grasp with a specified positional offset), making it substantially more challenging and hard to detect. To support the new task, we propose an effective data engine for synthesizing high-quality target trajectories and an automated suite for measuring configured-failure fidelity. Then, based on this foundation, we construct two new benchmarks, namely Trap-LIBERO and Trap-RoboTwin, that instantiate Configured Failure Trapping across four representative failure modes. To address this task, we identify sparse action deviation as a critical challenge and accordingly propose a novel method named TrapVLA, which explicitly learns trigger-induced action residuals to steer the policy toward the configured failure behavior. Extensive experiments across simulation benchmarks and real-world robotic settings show that TrapVLA effectively injects configured failure modes into VLA models while largely preserving performance on clean data. Project page: this https URL
92. 【2608.26548】Camera Calibration Using Inaccurate and Asynchronous Discrete GPS Trajectory from Drones
链接：https://arxiv.org/abs/2608.26548
作者：R. Yang,Y. Bar-Shalom,H.A.J. Huang
类目：ystems and Control (eess.SY); Computer Vision and Pattern Recognition (cs.CV)
关键词：camera orientation angles, GPS trajectory, GPS, orientation angles yaw, stationary camera calibration
备注： 11 pages, 12 figs, published on JAIF
点击查看摘要
Abstract:This paper considers a stationary camera calibration problem, which estimates the camera orientation angles yaw, pitch and roll, using a drone trajectory recorded by a GPS. There are three challenges in using a GPS trajectory as ground truth for camera calibration. One, the altitude of GPS data is inaccurate with an unknown bias. Two, the GPS receiver and camera are not time synchronized, and there is an unknown time offset between the two systems. Three, the GPS trajectory is time-discrete and accurate interpolation is needed. This is actually an estimation problem since velocity is also needed. To address the first two challenges, we formulate the problem as a parameter estimation problem to estimate a vector consisting of the GPS altitude bias and time offset in addition to the camera yaw, pitch and roll biases. We then develop a special maximum likelihood estimator using the Iterated Least Squares algorithm which can work with a non-synchronized time-discrete GPS trajectory for the third challenge. Since the camera measurement errors are usually small, this requires a high calibration accuracy so that the residual bias error following the calibration should not be significant compared to the measurement error standard deviation. The calibration accuracy depends highly on the drone trajectory. This paper also recommends an appropriate drone trajectory which can yield a good calibration accuracy, namely, 14\% of the measurement error standard deviation. Simulation tests are conducted to demonstrate the algorithm performance. The estimation results meet the Cramer-Rao Lower Bound (CRLB) since the Normalized Estimation Error Squared w.r.t.\ the CRLB is statistically acceptable.
93. 【2608.26531】FAN-LoRA: A Fourier-Adaptive Nonlinear Low-Rank Adaptor for Medical Foundation Model Domain Adaptation
链接：https://arxiv.org/abs/2608.26531
作者：Ziquan Liu,Zhewei Zhu,Xuyang Shi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：vision foundation models, natural image segmentation, catalyzed significant advancements, notably the Segment, foundation models
备注： 9 pages, 4 figures
点击查看摘要
Abstract:The advent of vision foundation models, notably the Segment Anything Model (SAM), has catalyzed significant advancements in natural image segmentation. However, their direct transfer to medical imaging remains severely bottlenecked by profound domain gaps, such as cross-modality and cross-center shifts. Existing Parameter-Efficient Fine-Tuning (PEFT) methods facilitate the adaptation of SAM to medical domains; nevertheless, they frequently suffer from performance degradation under severe distribution shifts. This vulnerability primarily stems from the implicit entanglement of heterogeneous frequency components within a shared low-rank subspace, which directly exacerbates sub-optimal structural alignment and localized boundary blurring. To overcome this representational bottleneck, we propose the Fourier-Adaptive Nonlinear Low-Rank Adaptor (FAN-LoRA), a novel frequency-decoupled fine-tuning architecture. FAN-LoRA explicitly separates the optimization space by employing a B-spline-driven low-pass branch for global structural alignment, synergistically coupled with a discrete Fourier high-pass branch for local textural compensation. Extensive experiments across three challenging cross-modality and cross-center benchmarks demonstrate that FAN-LoRA consistently outperforms state-of-the-art PEFT baselines. Compared to the strongest competitors, our method achieves consistent improvements in average Dice scores and notable reductions in boundary errors, while maintaining a compact module size without compromising computational efficiency.
94. 【2608.26517】HUG-VIS: A Multimodal Benchmark for Human-centered Understanding and Generation in Visual Intelligence
链接：https://arxiv.org/abs/2608.26517
作者：Fei Ma,Zebang Cheng,Minghui Li,Hongbo Xu,Yuyong Tan,Yihua Shao,Hanling Wang,Zhou Liu,Yuqing Gao,Dong Wang,Long Ma,Laizhong Cui,Nicu Sebe,Qi Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual intelligence seeks, modern computer vision, Visual intelligence, Human-centered visual intelligence, seeks to perceive
备注：
点击查看摘要
Abstract:Visual intelligence seeks to perceive, interpret, and synthesize the visual world and is central to modern computer vision. Human-centered visual intelligence is especially demanding because it studies people as expressive, socially situated subjects whose meaning is rarely conveyed by appearance alone. It couples vision with audio and language across four representative tasks: human emotion recognition, human video generation, human voice cloning, and human video matting. Yet existing resources remain task-specific, providing modalities and annotations for individual problems rather than a shared foundation coordinating understanding and generation. This limits multimodal signal use and broader research. We address this gap with HUG-VIS, a unified benchmark for Human-centered Understanding and Generation in Visual Intelligence. It contains 8,400 seated half-body videos of 30 professional actors, each performing the same 280 emotion-action-prompt assignments under a controlled Mandarin studio protocol, with synchronized video, audio, text, and alpha mattes. We evaluate diverse open- and closed-source models across the four tasks under a unified zero-shot protocol using automatic metrics, criterion-specific mean opinion scores, and multiple cross-task analyses. Results show that (i) linguistic content dominates current emotion recognition, while purely visual affect recognition is weakest; (ii) in video generation and voice cloning, automatic metrics and human judgment agree overall but differ in their top rankings, requiring joint reporting; (iii) boundary fidelity under motion is the main remaining obstacle for human matting; and (iv) task difficulty varies across emotions, models, and metrics, with notable cross-task correlations. The dataset and results are available at this https URL.
95. 【2608.26504】NeuDonatello: Uncertainty-Aware Framework for Accurate Neural SDF Learning
链接：https://arxiv.org/abs/2608.26504
作者：Alvin Jinsung Choi,Wanhee Kim,Taeyun Kim,Dasol Hong,Wooju Lee,Hyun Myung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Neural surface reconstruction, Neural surface, powerful paradigm, Neural, recovering high-quality
备注： Accepted to BMVC 2026
点击查看摘要
Abstract:Neural surface reconstruction has emerged as a powerful paradigm for recovering high-quality 3D surfaces from multi-view images. However, recovering accurate geometry solely from RGB images remains challenging due to uncertainties arising from textureless regions, occlusions, and inherent scene ambiguities. Existing methods often overlook such uncertainties, leading to inaccurate estimates of the signed distance function (SDF). We introduce NeuDonatello, a novel framework that models and leverages SDF uncertainty to improve surface reconstruction. Central to our approach is to model spatially varying uncertainty using a Monte Carlo sampling strategy. Using this uncertainty, we develop an adaptive regularization that selectively strengthens geometric constraints where RGB supervision is unreliable, avoiding incorrect surface reconstruction. We further introduce an uncertainty-aware scale parameter for the SDF-to-density conversion. Conditioned on uncertainty, this design enables more accurate modeling of spatially varying densities. Extensive experiments demonstrate that NeuDonatello achieves state-of-the-art reconstruction accuracy, with robust performance across diverse scenes using only posed RGB images.
96. 【2608.26500】Systematic Literature Review of Machine Learning Models and Applications for Text Recognition
链接：https://arxiv.org/abs/2608.26500
作者：Nuzhat Khan,Ab Al-Hadi Ab Rahman,Shahriyar Masud Rizvi,Ibrahim Yousef Alshareef,Muhammad Nadzir Marsono,Muhammad Paend Bakht,Mohd Shahrizal Rusli,Shahidatul Sadiah
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Optical Character Recognition, handling heterogeneous textual, heterogeneous textual data, Optical Character, OCR
备注： Published in IEEE Access, 2025. 24 pages, 16 figures, 5 tables
点击查看摘要
Abstract:Optical Character Recognition (OCR) for text recognition using machine vision has significantly improved, particularly when handling heterogeneous textual data. Traditional OCR models struggle with script variations, writing styles, and degraded documents. Advancements in technology are leading to new AI models with improved architecture for handling multiple languages and complex data formats. Despite this progress, a comprehensive evaluation of OCR advancements remains limited. Based on the established preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines, this literature review presents an extensive assessment of OCR research to trace the evolution of AI models over the past decade. It explores the transition in AI models, application domains, data types, linguistic coverage, and challenges. Through a detailed analysis of 97 selected studies published during January 2015 - January 2025, key OCR models are identified, and their performance, strengths, and limitations are analyzed. The findings highlight how OCR technologies have evolved to address structured and unstructured text, scene text recognition, and multilingual processing. Unresolved challenges include limited resources for underrepresented languages, high variability in handwritten text, visual similarity among characters, and constraints in real-time OCR applications. To address these issues, several promising approaches are proposed. Key suggestions include self-supervised learning, multimodal AI, automated machine learning (AutoML), AI-assisted postprocessing, tiny machine learning (TinyML), and the creation of joint corpora for script matching. The future recommendations aim to enhance OCR accuracy and tackle the challenges identified for real-time industrial applications. This study will guide future research and establish a foundation for OCR field.
97. 【2608.26496】RTNav: Towards Real-Time Zero-Shot Object Navigation
链接：https://arxiv.org/abs/2608.26496
作者：Easop Lee,Lingyu Zhang,Boyuan Chen
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：language foundation models, find unforeseen objects, find unforeseen, increasingly feasible, feasible with capable
备注：
点击查看摘要
Abstract:Navigation in unknown environments to find unforeseen objects has become increasingly feasible with capable vision and language foundation models. However, these models also introduce non-negligible inference latency, which becomes an important concern when agents must operate continuously in the real world. Most state-of-the-art methods are still developed in synchronous simulators, where the environment waits for the agent to act and inference time is effectively free. As a result, agents are often designed around the sequential execution of perception, reasoning, and action, with little regard for time constraints. Under real-time execution, where wall-clock time counts towards the task budget, the inefficiencies of these architectures become clear. We show that recent zero-shot object navigation methods suffer consistent performance degradation under such realistic timing conditions. Motivated by this observation, we propose RTNav, a simple but effective architecture that treats inference latency, asynchronous environment stepping, and bounded compute as explicit design considerations. Evaluated on real-time variants of HM3D-v1, HM3D-v2, and HM3D-OVON, RTNav improves the success rate by up to 11% and the Success weighted by Completion Time by up to 5.1 points over prior work.
98. 【2608.26495】Video-FLAIR: Not Whether to Reason, But How
链接：https://arxiv.org/abs/2608.26495
作者：Yogesh Kulkarni,Pooyan Fazli
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal queries, reasoning, Multimodal, require compositional reasoning, require different types
备注：
点击查看摘要
Abstract:Multimodal queries can require different types of reasoning. Some can be answered via perceptual reasoning, extracting information directly from the visual signal, while others require compositional reasoning that combines observations or deliberative reasoning that evaluates competing hypotheses. However, many existing methods apply a uniform reasoning strategy across queries, leading to unnecessary computation on simple tasks and insufficient reasoning on complex ones. We introduce Video-FLAIR, a training framework that learns to select the appropriate reasoning mode for each query using reinforcement learning. During training, the model generates responses under all three modes for the same prompt, enabling direct comparison. A composite reward compares these responses to favor the most effective one based on correctness, grounding, and cost, while discouraging unsupported or misaligned deliberation. This yields a supervision signal for learning adaptive reasoning without per-query annotations. Video-FLAIR improves accuracy over the Qwen2.5-VL base model by +5.4 on MathVista, +4.8 on Video-Holmes, and +4.8 on Video-MMMU, while reducing average token usage to 95 compared to 417 for always-thinking baselines.
99. 【2608.26489】Learning Woody Clearing With Loss Alignment for Zero-Shot Regrowth and Woody Segmentation
链接：https://arxiv.org/abs/2608.26489
作者：Kal Backman,Jared Wood,Adam Roff
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Detecting woody clearing, Detecting woody, managing biodiversity, vital for managing, Deep learning models
备注： Published in IEEE Transactions on Geoscience and Remote Sensing
点击查看摘要
Abstract:Detecting woody clearing is vital for managing biodiversity. Deep learning models can detect change in woody vegetation from bitemporal remote sensing imagery, however generated products may not meet end-user specifications due to unaligned loss definitions. Further limitations of deep learning models are the reliance on large datasets which can be difficult to attain for spatially rare and ambiguous events such as regrowth detection. In this work we train a model to detect woody change using bitemporal Sentinel-2 imagery consisting of 7 years' worth of annual imagery across the state of New South Wales, Australia. To align the objective of the model with end-user metrics, we introduce the loss scaling coefficient $\alpha$ which transforms the objective to optimize for specific $F_{\beta}$ scores. Introducing $\alpha$ was found to increase precision by 1.85x or recall by 1.12x. We propose input imagery augmentation and generation techniques that allow the woody change detection model to zero-shot transfer to regrowth and woody segmentation tasks. For woody segmentation, image generation techniques using activation maximization with low $\alpha$ values for stability and image generation techniques derived from handcrafted features utilizing a mosaic of clearing patches and artificial trees for contextual grounding were found to outperform prior woody segmentation works of the study area, reducing the overall error by up to 18.2%. For zero-shot woody regrowth, creating pseudo-post and prior images resulted in the model achieving an F1 score of 0.845, creating a foundation for future regrowth detection work.
100. 【2608.26476】Zero-Shot Video Restoration and Enhancement with Text-to-Image Latent Diffusion Models and Multi-Modal References
链接：https://arxiv.org/abs/2608.26476
作者：Cong Cao,Huanjing Yue,Xin Liu,Jingyu Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved great success, latent diffusion models, latent diffusion model, universal image restoration, image restoration tasks
备注：
点击查看摘要
Abstract:Zero-shot image restoration methods with text-to-image latent diffusion models have achieved great success in universal image restoration tasks without training. However, applying them to video restoration will result in severe temporal flickering. In this paper, we propose a novel framework for zero-shot video restoration and enhancement which uses a text-to-image latent diffusion model and multi-modal references. Through the proposed dual prompt tuning inversion and sampling, the inference time can be reduced to nearly 1/3 of the original. The performance and temporal consistency can be also significantly stregthened. By using the proposed texture-aware video token merging, the temporal correlation between frames can be further utilized to improve the temporal consistency. We futher propose the referenced self-attention and referenced token merging to support image reference. Experimental results demonstrate the superiority of the proposed method in restoring and enhancing temporally consistent videos.
101. 【2608.26471】Mapping Woody Vegetation from Multi-Source Imagery and Prediction Fusion for Enhanced Data Efficiency and Accuracy
链接：https://arxiv.org/abs/2608.26471
作者：Kal Backman,Jared Wood,Adam Roff
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remote sensing product, fire monitoring programs, fundamental remote sensing, derive ecological insights, tree cover mapping
备注： Published in IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
点击查看摘要
Abstract:Tree cover maps are a fundamental remote sensing product, used to derive ecological insights about the landscape and are essential to change detection, vegetation mapping and fire monitoring programs. However, comprehensive tree cover mapping requires reliable and high-quality imagery, free of cloud and weather defects to ensure accurate model outputs. Deep learning approaches can generate high quality maps with minimal human intervention but require large amounts of human annotated data to be successful. In this work we propose a framework consisting of methods that aim to improve the data efficiency and robustness of deep learning models using data fusion techniques to segment woody vegetation defined as vegetation over the height of 2m across the state of New South Wales, Australia. To improve robustness against varying image quality, we propose an image composition method that normalizes the imagery and removes defects, whilst also minimizing the reliance on individual image quality by proposing a prediction fusion method. The two methods resulted in an error reduction of 38.2% and 53.6% respectively compared to single-source imagery. To address deep learning approaches' limitation of requiring large amounts of data, we apply label transfer to multiple sources of imagery as a form of data augmentation to improve data efficiency. Learning from multiple image sources was shown to be the biggest improvement in performance, resulting in an error reduction between 28.1% to 76.2% across the different validation experiments, whilst reducing the standard deviation of performance across image dates by a factor of 13.
102. 【2608.26382】VIPER: An Expert-Curated Benchmark for Vision-Language Models in Veterinary Pathology
链接：https://arxiv.org/abs/2608.26382
作者：Luca L. Weishaupt,Simone de Brot,Javier Asin,Llorenç Grau-Roma,Nic G. Reitsam,Andrew H. Song,Dongmin Bang,Stefan T. Kaluziak,Long Phi Le,Jakob Nikolas Kather,Faisal Mahmood,Guillaume Jaume
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leaving non-human pathology, pathology largely unaddressed, non-human pathology largely, advancing rapidly, leaving non-human
备注：
点击查看摘要
Abstract:Pathology vision-language models are advancing rapidly, yet existing benchmarks remain focused on human tissue, particularly oncology, leaving non-human pathology largely unaddressed. This gap is especially important in toxicologic pathology, where microscopic tissue examination of laboratory animals is a core component of preclinical drug safety assessment. To address it, we introduce VIPER, the first expert-curated benchmark for vision-language model evaluation in toxicologic pathology. VIPER contains 1,251 questions associated with 419 HE-stained rat histology images across seven organ systems, covering multiple-choice, KPrim, and free-text formats. All questions were curated and validated by board-certified veterinary pathologists. In total, we benchmarked 16 models, including two newly introduced veterinary-pathology models, seven human pathology-specialized models, and seven general-purpose frontier models. The results identify a substantial domain gap between veterinary and human pathology, expose the risk of over-diagnosis of normal tissue in frontier models, and show that domain-specific training remains critical for visually grounded predictions. VIPER data and evaluation code are available at this https URL.
103. 【2608.26363】A Unified Framework for the Mechanics of Information in Convolutional Neural Network Image Space
链接：https://arxiv.org/abs/2608.26363
作者：Aryan Shukla,Matthew Toews
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：modeling information propagation, convolutional neural networks, unified mathematical framework, information space, modeling information
备注：
点击查看摘要
Abstract:This paper introduces a unified mathematical framework for modeling information propagation through convolutional neural networks (CNNs), with the aim of connecting descriptions of physical space and information space. A correspondence is presented linking discrete filter symmetry and the relativistic energy--momentum relation under the widely used nonlinear rectified convolution operation. Specifically, symmetric filter components (e.g. the sum $\Sigma = [1,1]$) operate analogously to rest energy $mc^2$ in preserving the image centre of mass (e.g. isotropic diffusion), whereas antisymmetric components (e.g. the gradient $\nabla = [-1,1]$) operate analogously to the momentum term $pc$ in generally inducing a displacement (e.g. vibration or translation). For typical small discrete filters, this displacement is determined by the ratio of antisymmetric to total filter energy, analogously to how the displacement of a relativistic particle relates to a Lorentz transform with beta parameter $\beta = \frac{v}{c}=\frac{pc}{E}$ equal to the ratio of momentum $pc$ to total energy $E$. Repeated filtering leads to the Gaussian scale-space and emergent scale-invariant features. These constructions share a Laplacian-driven structure with the classical heat (diffusion) equation and, via standard mathematical correspondences, with the Schrödinger equation and aspects of the Friedmann equations, together with emergent Morse topological structure. Demonstrations in 3D images reveal blob-like, scale-invariant Morse critical points in images spanning a wide range of physical scales, including organic sugar molecules and inorganic silicon crystals, human and primate brains in magnetic resonance images (MRI), galaxies and the cosmic microwave background (CMB).
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.26363 [cs.CV]
(or
arXiv:2608.26363v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.26363
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
104. 【2608.26355】Finding the Right Evidence: Factor-Guided Coarse-to-Fine Reasoning for Long Videos
链接：https://arxiv.org/abs/2608.26355
作者：Baixuan Xu,Yinyui Xu,Tianshi Zheng,Zhaowei Wang,Weiqi Wang,Haochen Shi,Jiayu Liu,Qing Zong,Xiyu Ren,Xinyu Geng,Zhitao He,Yangqiu Song
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：LVLMs rapidly improve, long-video question answering, remains challenging, plausible alternatives, LVLMs rapidly
备注：
点击查看摘要
Abstract:While LVLMs rapidly improve, long-video question answering still remains challenging: relevant evidence is sparse, and question-relevant context often fails to provide cues that discriminate the correct answer from plausible alternatives. Diagnostic analysis on a manually annotated subset of MMR-V shows that prior agentic systems substantially improve cue retrieval over direct VLM inference yet fail to achieve a corresponding gain in answer accuracy, indicating that the bottleneck lies in option-discriminative evidence rather than topical relevance alone. We propose PACE (Progressive Acquisition of Critical Evidence), a factor-guided framework for long-video evidence acquisition. PACE proceeds in two stages: it first indexes clip-level descriptions guided by question-derived factors without observing the candidate answers; it then uses the candidate answers to derive contrastive cues and queries the index for verification. On MMR-V with the open-source Qwen3-VL backbone, PACE achieves 42.6% accuracy, outperforming direct inference and prior agentic baselines including Deep Video Discovery (DVD). On the same diagnostic subset, PACE recovers 66.9% of the annotated cues, providing empirical evidence that its gains are associated with improved evidence recovery rather than stronger answer-side priors alone. Consistent gains over DVD on LVBench, Video-MME, EgoSchema, and LongVideoBench suggest that option-aware evidence acquisition transfers beyond MMR-V. Code is available at this https URL.
105. 【2608.26336】StreamAV-Bench: A Comprehensive Benchmark for Streaming Audio-Video Generation
链接：https://arxiv.org/abs/2608.26336
作者：Kaiqi Liu,Haoxuan Zeng,Jingqi Liu,Jiacong Fang,Ziqi Cai,Yunyao Mao,Henglin Liu,Yu Sheng,Shuchen Weng,Boxin Shi
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Recent advancements, real-time interactive worlds, pushing video generation, advancements in generative, pushing video
备注：
点击查看摘要
Abstract:Recent advancements in generative models are pushing video generation toward unbounded streaming audio-video generation for real-time interactive worlds. However, existing benchmarks primarily evaluate completed sequences and struggle to capture streaming properties. To bridge this gap, we introduce StreamAV-Bench, the first comprehensive benchmark tailored for streaming audio-video generation. StreamAV-Bench establishes a unified evaluation framework, including the progressive track for instruction adherence and long-horizon stability, and the interactive track for interactive response and state retention and reuse. With expert-verified evaluation cases across 32 fine-grained dimensions, we conduct an extensive evaluation of 13 representative systems. Our analysis reveals that current models suffer from temporal drift in progressive generation and responsiveness bottlenecks during interactive control. Based on a comprehensive failure analysis, we share insights to advance the development of native joint audio-video streaming models.
106. 【2608.26317】Modality Maturity Index: A benchmark for assessing multimodal capabilities of omni models
链接：https://arxiv.org/abs/2608.26317
作者：Rohit Patel,Dieuwke Hupkes,Sloan Strader
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：Modality Maturity Index, increasingly marketed, marketed as omni, omni systems, perceive and respond
备注： 26 pages, 6 figures. Code and dataset available
点击查看摘要
Abstract:Frontier language models are increasingly marketed as omni systems that can perceive and respond across modalities. Existing evaluation frameworks, however, focus almost exclusively on bimodal understanding, typically text plus one other modality. We propose the Modality Maturity Index (MMI), a benchmark designed to evaluate the multimodal capabilities of large language models across five modalities (text, image, audio, video and document) and combinations of up to three modalities in both inputs and outputs. MMI consists of 893 questions, each carefully crafted to require the model to demonstrate its understanding of multiple input modalities and to generate responses that incorporate various output formats. The questions are designed to be self-contained, with clear expectations for the correct modality or mix of modalities required for an accurate response. Every MMI prompt carries human-authored rubric criteria for each output modality expected in the response; a model's MMI Value expresses the average of the per-modality scores for each prompt. Because low scores can reflect either failure to generate a modality (lack of presence) or failure to generate correct content, we introduce also a supplementary Modality Presence Score (MPS), a per-prompt F1 over the expected output modalities. Applying MMI to five frontier multimodal models, we find that the MPS ranges from only 15.6 (Claude Opus 4.6) to 34.9 (GPT-5.4). Given the low availability of returned modalities to even grade, we report MPS as our main result pending model improvements. To assess the viability of judging output correctness with LLM judges and rubrics, we run a separate experiment with custom generation tools. On the assets that generates, we find that an LLM judge applying the rubrics agrees with rubric-blind human annotators (who score the outputs directly and never see the criteria) on 70.8% of judgments.
107. 【2608.26238】Procedura: Agentic 3D Modeling with Procedural Control
链接：https://arxiv.org/abs/2608.26238
作者：Youtian Lin,Yikang Yang,Zhanpeng Hu,Mengqi Zhou,Feihu Zhang,Xun Cao,Jiaheng Liu,Yao Yao
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：recover impressive mesh, impressive mesh geometry, single image, recover impressive, impressive mesh
备注： Project page: [this https URL](https://spatiaos.github.io/projects/procedura/)
点击查看摘要
Abstract:Native 3D generators now recover impressive mesh geometry from a single image. However, a dense mesh stays soft where a machined object should be sharp, it carries no part decomposition, and it exposes no parameter a user could edit. To address this, we explore the paradigm of 3D shape as code, leveraging and scaling the coding ability of an LLM for 3D modeling. We introduce Procedura, a novel 3D modeling agent framework that writes an object as a procedural assembly, a parametric program whose named parts are joined by typed, machine-checkable mates. From a text prompt, the agent plans the object as an assembly graph and writes the program part by part, solving each placement from the mated frames rather than guessing it, and admitting a part only once compile, mate, and connectivity checks pass. A decoupled vision critic then refines the assembly one diagnosed fix at a time. Moreover, the same graph carries per-part materials and a simulator-validated articulation. We evaluate on P3D-Bench under its assembly judge, and with the same judge on MechBench-36, our hard-surface benchmark. On both, Procedura outperforms state-of-the-art native 3D generators and every prior 3D-code agent on judged quality, produces the sharpest edges of any method we evaluate, and is the only one whose output is an editable, part-structured program.
108. 【2608.26214】Surgical Video Generation From Diffusion to World Models: A Survey
链接：https://arxiv.org/abs/2608.26214
作者：Fuxiang Huang,Chenxu Zhang,Liang Han,Lei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：surgical workflow understanding, primary training resource, workflow understanding, resource for models, models of intraoperative
备注： 4 pages, 1 figures, 3 tables. Accepted for oral presentation at the 2026 3rd International Conference on Intelligent Perception and Pattern Recognition (IPPR 2026)
点击查看摘要
Abstract:Surgical video data provides the primary training resource for models of intraoperative perception, surgical workflow understanding, and robotic decision-making. However, clinical data acquisition remains constrained by privacy, cost, and class imbalance. Surgical video generation has emerged as a transformative approach to addressing data scarcity and as a foundation for surgical simulation, training, and robotic policy learning. The field has developed rapidly without a clear conceptual framework. This survey organizes the 2024-2026 literature into three categories: unconditional generation, conditional generation, and world modeling generation, revealing a fundamental shift in how the task is defined from synthesizing visually plausible frames to modeling the causal dynamics of surgical scenes. We examine the persistent gap between pixel-level fidelity and clinical plausibility, and identify generalization, physical realism, controllability, and interpretability as bottlenecks. We further summarize experimental results of representative methods on public datasets to provide a quantitative reference for the field. This survey provides a structured overview of the current state and open challenges, offering a reference for researchers working at the intersection of intelligent perception, multi-modal fusion, generative AI, and surgical data science.
109. 【2608.26213】Attention-Guided Reliability Scaling for Contrastive Decoding in Robust Audio-Visual Speech Recognition
链接：https://arxiv.org/abs/2608.26213
作者：YoungChae Kim,Da-Hee Yang,Joon-Hyuk Chang
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV); Audio and Speech Processing (eess.AS)
关键词：Large language model, Large language, audio-visual speech recognition, speech recognition, systems are robust
备注： Accepted to Interspeech 2026
点击查看摘要
Abstract:Large language model (LLM)-based audio-visual speech recognition (AVSR) systems are robust under noise. Contrastive decoding (CD), originally introduced to stabilize LLM generation by contrasting a weaker model against a stronger one at inference time, adjusts predictions without additional training. In this work, we apply CD to AVSR by contrasting audio-only conditioning with full audio-visual conditioning within the same underlying model. However, using a fixed contrastive strength introduces a trade-off across noise levels: stronger intervention helps under severe noise but may over-correct reliable predictions in clean conditions. We propose reliability-aware scaling of CD for AVSR. Instead of using a fixed strength, we adaptively modulate the contrastive influence at each token based on reliability signals derived from attention dynamics and inter-model predictive divergence. Experiments on LRS3 show consistent improvements across clean and low-SNR conditions.
110. 【2608.26200】GameWAM: A World Action Model for Video Games
链接：https://arxiv.org/abs/2608.26200
作者：Yuncheng Guo,Zhanqiu Zhang,Yiwen Guo,Weijia Li
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Modern video games, combine first-person perception, persistent world state, games combine first-person, Modern video
备注： 44 pages, 23 figures, 7 tables
点击查看摘要
Abstract:Modern video games combine first-person perception, rapid visual changes, persistent world state, and heterogeneous native controls. Existing game agents map visual and task context directly to actions but lack explicit world dynamics modeling, whereas interactive game world models predict visual futures from supplied actions but do not serve as task policies. World-Action Models (WAMs) unify these objectives, but remain largely unexplored under the dynamics and open-ended interaction of video games. We introduce GameWAM, to our knowledge the first WAM for native closed-loop gameplay and GUI control. GameWAM jointly generates future visual observations and executable keyboard-mouse trajectories through parallel visual and action generative processes with block-causal conditioning and flow matching. To support joint world-action learning, we construct synchronized gameplay and GUI trajectories. To handle heterogeneous native control, GameWAM predicts a gameplay/GUI mode at each action step and generates actions with mode-specific prediction distributions and continuous-action normalization. For long-horizon interaction, block-cycle control predicts beyond the committed horizon, executes only a short action prefix, and replans from new observations, while fine-grained within-cycle context and hierarchical cross-cycle history preserve temporal continuity. Experiments demonstrate competitive task success with fewer executed native actions than the compared agents. We further uncover Low-Frequency Action Source Imprinting (LASI), in which low-frequency components of the sampled action source systematically steer coarse generated camera motion under fixed conditioning, revealing a source-sensitivity failure mode in generative control. Project page is available at this https URL.
111. 【2608.26173】ClassVision: AI-Powered Classroom Attendance System
链接：https://arxiv.org/abs/2608.26173
作者：Ankit Kumar Aggarwal,Veerabhadra Rao Marellapudi,Ovadia Sutton,Youshan Zhang
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：working professionals, attendance, attendance process, face recognition, attendance system
备注：
点击查看摘要
Abstract:Students and working professionals have to go through the attendance process every day. Traditional methods of marking attendance using pen and paper or online platforms are human-intensive and time-consuming. To address the challenges in manual attendance processes, this research explores the use of face detection (FD) and face recognition (FR) technology to automate the attendance process, particularly in educational settings, and build a ClassVision course attendance system. We also propose an automated attendance system featuring a human-computer interaction (HCI) and user-friendly web interface that utilizes real-time image processing to identify and recognize students in classrooms and automatically record their attendance. We identified RetinaFace as the best face detection model, and when combined with Face Recognition for verification, it provided the most promising results with a cropped embedding of 50x50 pixels.
112. 【2608.26147】CARE: Causally-Aligned Reasoning Exploration for Medical Large Language Models
链接：https://arxiv.org/abs/2608.26147
作者：Yucheng Zhou,Peng Luo,Qianning Wang,Chengzhong Xu,Jianbing Shen
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Large Language, expert-annotated data constrain, shown strong potential, constrain their progress
备注： ECCV 2026
点击查看摘要
Abstract:Large Language Models (LLMs) have shown strong potential for medical reasoning, yet the scarcity and cost of expert-annotated data constrain their progress. While reinforcement learning offers a scalable alternative, standard outcome-based methods in medicine often suffer from autoregressive credit assignment failure and gradient variance explosion. This leads to the "Right Answer, Wrong Reason" trap, where models inadvertently reinforce spurious correlations and dataset shortcuts rather than valid clinical deduction. In this work, we propose Causally-Aligned Reasoning Exploration (CARE), a theoretically grounded framework for intrinsic experience curation. CARE is built upon two rigorous conditions for high-quality training trajectories: Causal Sufficiency, which utilizes an agreement-based self-verification mechanism to mimic $do$-calculus interventions and effectively debias gradients; and Proximal Learnability, which employs dynamic entropy bounds to select experiences within the model's zone of proximal development for variance-bounded optimization. These rigorously filtered experiences are optimized via a dual-stream objective that combines on-policy group-relative exploration with difficulty-weighted experience replay. Extensive experiments on diverse medical multimodal and text-only benchmarks demonstrate that CARE consistently outperforms other strong competitors, substantially reducing correct-but-inconsistent reasoning and improving training stability.
113. 【2608.27162】Data-efficient crack quantification in lithium-ion cathodes using foundation model transfer
链接：https://arxiv.org/abs/2608.27162
作者：Thorsten Tegetmeyer-Kleine,Thomas Schmitt,Phillip Aquino,Christiane Rahe,Dirk Uwe Sauer,Weihan Li
类目：Materials Science (cond-mat.mtrl-sci); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：pixel-level expert labelling, expert labelling requires, labelling requires hours, drives lithium-ion cathode, electron-microscopy cross-section spans
备注： 38 pages, 15 figures, 2 tables. Supplementary Information included as Appendix B. Under review at Energy Storage Materials
点击查看摘要
Abstract:Battery lifetime is central to sustainable electrification, yet the particle cracking that drives lithium-ion cathode aging is hard to measure: quantitative microscopy of this degradation is bottlenecked by annotation, because each destructive electron-microscopy cross-section spans hundreds of megapixels and pixel-level expert labelling requires hours per image. We show that a frozen self-supervised vision-transformer encoder, combined with a lightweight trainable decoder and iterative model-assisted annotation, turns this sparse labelling budget into population-scale degradation measurements. Applied to three 120-megapixel NMC cathode cross-sections representing initial, cycled-aged and calendar-aged states, the framework distinguishes intragranular cracks from early- and late-stage intergranular cracks and yields per-particle distributions of crack width, tortuosity and area fraction. Late intergranular crack coverage reaches 4.6% in the cycled sample versus 0.5% in the initial and calendar-aged samples, forming more tortuous, higher-coverage networks, consistent with degradation from repeated electrochemical cycling rather than elevated-temperature storage alone. A single destructive image yields the population-level statistics needed for lifetime-extending design, aging assessment and second-life decisions.
114. 【2608.26901】Dose-PlanNet: Physics Based Radiotherapy Dose Prediction with Deep Learning
链接：https://arxiv.org/abs/2608.26901
作者：Ankit Bhattacharjee,Sougata Maity,Santam Chakraborty,Indranil Mallick
类目：Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Automating prostate radiotherapy, Automating prostate, extreme hypofractionated regimens, prostate radiotherapy treatment, radiotherapy treatment planning
备注： The paper consists of 22 pages, 4 figures, 6 tables. The end-to-end pipeline of Dose-PlanNet will soon be made available on the GitHub repository of CHAVI-India ( [this https URL](https://github.com/CHAVI-India) )
点击查看摘要
Abstract:Automating prostate radiotherapy treatment planning is dosimetrically complex, particularly for extreme hypofractionated regimens. In this study, we introduce Dose-PlanNet, a physics-guided 3D deep learning architecture designed to predict dose distributions. This model's performance was evaluated on a cohort of patients treated in a prospective trial where two different dose fractionation regimens were employed. Dose-PlanNet achieved comparable target coverage ($D_{95}$), though statistical analysis revealed a marginal reduction in target homogeneity ($p0.001$) offset. However the model achieved statistically significant improvements in high-dose organ-at-risk sparing ($p0.001$). When evaluated against strict Prospective Randomized protocol volumetric constraints, automated plans met prespecified clinical acceptance criteria in $11$ out of $14$ Moderate Hypofraction Arm plans and $9$ out of $12$ Stereotactic Body Radiation Therapy Arm plans. This pipeline demonstrates that physics-informed deep learning can accelerate radiotherapy workflows while safely maintaining the stringent dosimetric quality required for high-precision clinical deployment.
