本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新629篇论文，其中：
- 自然语言处理101篇
- 信息检索19篇
- 计算机视觉107篇
自然语言处理
1. 【2608.13560】AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design
链接：https://arxiv.org/abs/2608.13560
作者：Yaxin Luo,Haobin Jiang,Jialv Zou,Xu Huang,Wenhao Yan,Haodong Li,Zhengrong Yue,Jing Li,Xiaofu Chen,Xiaohan Zhao,Jiacheng Liu,Jiacheng Cui,Zhiqiang Shen,Xiaotong Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Transforming multimodal sources, structured media outputs, agentic process centered, Transforming multimodal, long-horizon agentic process
备注： Tech Report. Code at: [this https URL](https://github.com/Yaxin9Luo/AutoDesign)
点击查看摘要
Abstract:Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal harness system should align with human design priors and accumulate reusable experience through empirical exploration to drive recursive self-improvement, existing paradigms remain static and fall short of this capability. In this paper, we present AutoDesign, a framework that aligns with human design priors, where a meta-harness optimizer guides a code agent to recursively improve harness based on rollout feedback. To instantiate and evaluate this framework, we focus on the academic paper-to-poster generation task and introduce PosterBench, comprising a 100-paper Main Track spanning five disciplines and PosterBench-mini, a shared 10-paper subset for controlled evaluation. On the PosterBench Main Track, AutoDesign achieves the highest score of 78.32, surpassing the closed-source commercial system Claude Design by 7.45 points. Across seven controlled code-agent-model configurations, integrating the learned DesignHarness consistently improves performance, increasing the average PosterBench Score from 54.99 to 67.39 (+12.4%). In a fully autonomous long-horizon loop, it executes 253 tool calls and 11 editing turns within 40 minutes for under $3, reaching average conference-poster quality in human evaluation. A system-blind human study further demonstrates that AutoDesign achieves the highest human preference among evaluated systems.
2. 【2608.13558】OmniScientist: An Omni-Modal Omni-Discipline AI Scientist
链接：https://arxiv.org/abs/2608.13558
作者：Bobo Li,Hao Fei,Tianjie Ju,Mong-Li Lee,Wynne Hsu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Recent advances, automate increasingly complete, advances in foundation, foundation models, models have enabled
备注： 30 pages, 13 figures, 19 tables. Project page: [this https URL](https://omni-scientist.github.io/)
点击查看摘要
Abstract:Recent advances in foundation models have enabled AI scientists to automate increasingly complete research workflows, from hypothesis generation and code execution to manuscript preparation. Yet workflow coverage alone does not provide access to the full evidence on which scientific discovery depends. Existing systems typically reason over text, code, labels, or precomputed summaries, leaving scientifically decisive spatial, temporal, cross-channel, and procedural relations unavailable to the agent. We introduce OmniScientist, an end-to-end, omni-modal AI scientist that conducts multidisciplinary research directly from heterogeneous raw evidence. A perception layer and 3 autonomous agents for ideation, experiment, and writeup operate within a deterministic pipeline, allowing observations to shape research questions, experimental decisions, and final claims throughout the research lifecycle. By running idea, rigour, and claim checks in code, the system enforces novelty screening, statistical validity, execution provenance, and numerical traceability. We evaluate OmniScientist on 36 real-data cases spanning 5 discipline families, 4 families of scientific evidence, and modalities including images, signals, audio, video, 3-D structures, trajectories, tables, formulae, and graphs. The system completes the full path from raw data to a compiled manuscript in all 36 cases and achieves a mean overall paper score of 6.3 with the reference reasoning backbone. In paired comparisons against a blind variant that receives only precomputed scalar features, direct perception improves all 7 evaluation dimensions and wins 85% of head-to-head judgments. These results show that lifecycle-wide perception is essential for evidence-grounded scientific discovery and provides a practical path toward broadly capable AI scientists.
3. 【2608.13545】LittleLearner: Language Models Under Pedagogically Controlled Knowledge Exposure
链接：https://arxiv.org/abs/2608.13545
作者：Fanfei Li,Jana Zeller,Manuel Prada-Corral,Thaddäus Wiedemer,Prasanna Mayilvahanan,Ryan Cotterell,Wieland Brendel
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：web-scale text corpora, heterogeneous web-scale text, Modern language models, Modern language, text corpora
备注：
点击查看摘要
Abstract:Modern language models are trained on heterogeneous web-scale text corpora. Consequently, studying knowledge and skill acquisition is difficult, as prior exposure to related content is hard to characterize. To address this challenge, we introduce LITTLECURRICULUM, a curated 88B-token pretraining corpus tailored to U.S. elementary school material, explicitly excluding concepts, facts, and vocabulary taught above Grade 5. Training a 5B-parameter LLM from scratch on LITTLECURRICULUM yields LITTLELEARNER, a model with sufficient language competence for open-ended evaluation, yet with clear knowledge and capability boundaries mapped to interpretable curriculum guidelines. We release LITTLECURRICULUM and LITTLELEARNER as a developmentally restricted sandbox to study how models acquire, represent, and use data under a well-defined training scope. We illustrate the sandbox's utility in a first suite of experiments on injecting new knowledge through post-training and in-context learning. These methods let LITTLELEARNER better utilize existing knowledge, but do not raise out-of-scope capabilities. Our findings underscore the value of this controlled environment for future investigations.
4. 【2608.13538】SAEVerbalizer: Generating Explanations for Sparse Autoencoder Features via Representation Verbalization
链接：https://arxiv.org/abs/2608.13538
作者：Weihan Meng,Hongzhu Guo,Yi Jing,Dewen Liu,Zijun Yao,Xiaozhi Wang,Lei Hou,Juanzi Li
类目：Computation and Language (cs.CL)
关键词：Sparse autoencoders, large language model, extract numerous features, external observation, proposed to extract
备注：
点击查看摘要
Abstract:Sparse autoencoders (SAEs) are proposed to extract numerous features from large language model (LLM) representations, yet explaining these features still relies primarily on external observation. This reliance leads to superficial explanations inferred from observed model behavior and computational inefficiency from collecting such behavioral evidence at scale. We introduce SAEVerbalizer, a framework that injects SAE decoder directions into an LLM's representations and fine-tunes the LLM's downstream layers to generate natural-language explanations of the injected features. Once trained, the resulting verbalizer explains SAE features directly from decoder directions, addressing both limitations. Our experiments show that the learned verbalization capability generalizes to unseen features, transfers across separately trained SAE dictionaries, and, with a lightweight adapter, extends to SAE features from different LLMs. Intervention experiments show that injecting multiple directions yields an explanation combining their meanings, while reversing individual directions produces corresponding meaning shifts.
5. 【2608.13517】DFM Mimir v1: An Open HRM Delivering Frontier Performance at 1B Parameters Using Only Permissible Post-Training Data
链接：https://arxiv.org/abs/2608.13517
作者：Peter Schneider-Kamp,Jacob Nielsen,Gianluca Barmina,Kenneth Enevoldsen,Lukas Galke Poech
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Current large language, ethically sourced data, Current large, model development relies, large language model
备注： Technical Report, 20 Pages, 1 Model, Hierarchical Reasoning Model
点击查看摘要
Abstract:Current large language model development relies on massive, often non-permissible datasets, creating a high barrier for researchers committed to open-source and ethically sourced data. We introduce Mimir v1, a 1-billion-parameter language model based on the Hierarchical Reasoning Model (HRM) architecture, that is trained from scratch and delivers highly competitive performance for English and sets a new state of the art for Danish using only permissible post-training data. Trained on a mixture of 161 datasets, Mimir v1 outperforms the original HRM-Text 1B and competes with larger frontier models like Qwen 3.5 4B and Gemma 4 E2B, tested across 20 benchmarks for English, Math Code and Danish. The model is available on the Hugging Face Hub: this https URL
6. 【2608.13515】Measuring Task-Agnostic Training Data Influence Across Language Model Pretraining
链接：https://arxiv.org/abs/2608.13515
作者：Yuto Nishida,Hirokazu Kiyomaru,Yusuke Oda,Takashi Kodama,Chaoran Liu,Daisuke Kawahara,Yusuke Miyao,Max Müller-Eberstein,Masaru Isonuma
类目：Computation and Language (cs.CL)
关键词：Measuring training data, Measuring training, consistently across language, Measuring, language model pretraining
备注： Accepted to COLM 2026
点击查看摘要
Abstract:Measuring training data influence consistently across language model pretraining is challenging. It is difficult to select downstream tasks or validation sets representative of a model's general capabilities, and reliance on task performance at intermediate checkpoints complicates comparisons across training. We propose a measure of training data influence that does not require selecting a downstream task or validation set as the attribution target. Specifically, we define an example's influence by how much its gradient update reduces the squared distance to the final parameters of a given pretraining run, and estimate this quantity from intermediate checkpoints without retraining. Applying the method to 18 configurations from the Pythia and PolyPythia suites, we find systematic temporal changes in influential data. Early in training, literature-related data are more strongly aligned with the trajectory toward the final parameters, whereas STEM data become more strongly aligned in later stages. This qualitative crossover is broadly consistent across model configurations. Our results provide a tractable trajectory-level view of how influential data change throughout pretraining, complementing influence analyses defined with respect to specific downstream tasks or validation sets.
7. 【2608.13505】Intern-S2-Preview: Scientific Agentic Foundation Model
链接：https://arxiv.org/abs/2608.13505
作者：Lei Bai,Jiaqi Cao,Chiyu Chen,Guanzhou Chen,Kai Chen,Guangran Cheng,Erfei Cui,Xuanlang Dai,Shengyuan Ding,Shangheng Du,Yanhui Duan,Yue Fan,Youqing Fang,Quan Gan,Yuanyuan Gao,Jiaye Ge,Lixin Gu,Yuzhe Gu,Qipeng Guo,Junjun He,Xin Hong,Ming Hu,Zhouqi Hua,Haian Huang,Junhao Huang,Zixian Huang,Minxi Jin,Lingkai Kong,Alexander Lam,Zehao Li,Zonglin Li,Tianhao Liang,Dahua Lin,Junyao Lin,Tianyang Lin,Zhouhan Lin,Jiangning Liu,Jin Liu,Kuikun Liu,Wenran Liu,Yifei Liu,Yuhong Liu,Yuhong Liu,Zhoumianze Liu,Ziyan Liu,Ziyu Liu,Haijun Lv,Han Lv,Chengqi Lyu,Le Ma,Ningsheng Ma,Zerun Ma,Haoyang Peng,Runyu Peng,Jifei Shan,Zixin Shang,Kou Shi,Xiang Shi,Qisheng Su,Xuerui Su,Hao Sun,Xiao Sun,Yanan Sun,Yu Sun,Huanze Tang,Yinghao Tang,Wenhui Tian,Zhongbo Tian,Bingli Wang,Haomin Wang,Jiarui Wang,Jingzhi Wang,Rui Wang,Xiquan Wang,Yi Wang,Zhecan Wang,Ziyi Wang,Zun Wang,Rubin Wei,Lianyi Wu,Wen Wu,Yue Wu,Yuhan Wu,Zhenyu Wu,Zijian Wu,Shuhao Xing,Jun Xu,Xingle Xu,Xuenan Xu,Xiangchao Yan,Ziang Yan,Bowen Yang,Danni Yang,Lin Yang,Zhiqi Yang,Qian Yao,Haochen Ye,Peng Ye,Jinhui Yin,Jiashuo Yu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：discovery increasingly requires, long task horizons, Scientific discovery increasingly, heterogeneous modalities, tools and environments
备注： 35 pages, 12 figures
点击查看摘要
Abstract:Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.
8. 【2608.13484】oward a Gricean Retreat: Probing LLMs for Knowledge Boundaries and Referent Specificity
链接：https://arxiv.org/abs/2608.13484
作者：Dananjay Srinivas,Saksham Khatwani,Maria Pacheco
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：routinely fabricate plausible-sounding, fabricate plausible-sounding details, LLMs routinely fabricate, general claims, asked about entities
备注：
点击查看摘要
Abstract:When asked about entities outside their knowledge boundary, LLMs routinely fabricate plausible-sounding details rather than backing off to safer, more general claims. We frame this failure through a Gricean lens: a cooperative speaker who is uncertain about a referent retreats up the specificity hierarchy, trading informativeness for truthfulness. We ask whether LLMs have the ingredients to perform this retreat. Using a T-REx-based benchmark that varies entity familiarity and referent specificity, we probe models to answer two questions: (i) do their activations encode whether a referent falls inside the knowledge boundary, and (ii) do they anticipate the specificity of the referent they are about to generate? We find that the answer to both is yes, but the two signals are not reconciled in generation. Models overwhelmingly prefer specific referents even when the entity is unknown to them, and do so even when offered correct generic alternatives. The substrate for a Gricean retreat is present, but the policy that would act on it is not. We position our findings as a first step toward Gricean alignment, training or steering objectives that couple knowledge-boundary awareness to referent-specificity during generation.
9. 【2608.13482】Synthetic Persona Pretraining: Alignment from Token Zero
链接：https://arxiv.org/abs/2608.13482
作者：Julian Minder,Viktor Moskvoretskii,Raghav Singhal,Difan Jiao,Andy Arditi,Shaobo Cui,Yiderigun Borjigin,Kartik Bali,Stefan Krsteski,Harsh Raj,Huu Nguyen,Jannik Brinkmann,Ashton Anderson,Roland Aydin,Robert West
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：autonomous settings, aligning its goals, increasingly deployed, deployed in autonomous, pretraining
备注：
点击查看摘要
Abstract:As language-model-based AI is increasingly deployed in autonomous settings, aligning its goals and values with those of humans becomes critical. Today, alignment, and the assistant identity itself, are typically introduced only after pretraining, once behavioral priors are already established. This can make values a thin overlay, rather than deeply rooted, and facilitate subsequent misalignment. Pursuing a different paradigm, we introduce Synthetic Persona Pretraining (SPP), which installs the desired assistant persona from token zero in pretraining. First, we annotate pretraining documents with value-aligned first-person reflections derived from a normative value constitution. Second, we pretrain via the standard cross-entropy loss on standard pretraining documents as well as their reflections, which installs the desired persona among a multitude of other personas. Finally, we post-train on user-assistant dialogue data, which binds this desired persona to the assistant identity, a process we call persona binding. By pretraining models up to 3B parameters on 500B tokens, we show that SPP improves constitution following and jailbreak robustness, and reduces the misalignment rate in out-of-distribution moral dilemmas, while preserving capabilities. Early intervention matters: compared with alignment from token zero, introducing SPP only at the end of pretraining yields weaker constitution adherence, does not shift value priorities, and leads to less aligned choices in dilemmas. This advantage depends on persona binding and, importantly, increases with pretraining budget. Overall, our results show that shaping values early is critical for alignment and establish pretraining-time persona interventions as an effective approach to do so.
10. 【2608.13476】MARC v1: An Open-Source Multi-Agent Framework for Clinical AI Reasoning and Coordination
链接：https://arxiv.org/abs/2608.13476
作者：Saisha Shetty,Satvik Tripathi,Austin Lin,Colin Zhao,Theodore Kim,Don Enwerem,Jacinta Arnold,Shahriar Faghani,Tessa S Cook
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：monolithic LLM prompting, replaces monolithic LLM, deterministic multi-agent orchestration, present Multi-Agent Reasoning, monolithic LLM
备注： 13 pages, 4 figures
点击查看摘要
Abstract:We present Multi-Agent Reasoning and Coordination (MARC), an open-source framework that replaces monolithic LLM prompting with deterministic multi-agent orchestration for clinical reasoning. MARC coordinates role-specialized agents for extraction, reasoning, answer generation, and evaluation, with explicit context passing and traceable intermediate outputs, enabling stage-wise failure attribution. We additionally introduce a Decomposer module that generates task-specific agent prompts from a plain-language description, eliminating manual prompt engineering. The framework supports both API-based and local CPU-compatible deployments and is entirely configurable via YAML, without code modifications. MARC is designed to be model-agnostic, interpretable, and accessible to clinical domain experts without programming expertise. The full framework is available at this https URL.
11. 【2608.13463】MLLM-Routed Heterogeneous Ensembles for Robust Cross-Dataset Image Classification
链接：https://arxiv.org/abs/2608.13463
作者：Daniel Perkins,John Squires,Janou Milligan,Chandra Raskoti,Linda Ungerboeck
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Modern image classification, single task-specific datasets, Modern image, difficulty levels, single task-specific
备注： 8 pages, 4 figures, 7 tables
点击查看摘要
Abstract:Modern image classification models excel when trained on single task-specific datasets but often struggle to generalize across domains and difficulty levels. We propose ARMDIL, an Adaptive Router for Multi-Domain Image classification with LLMs. ARMDIL is an ensemble that uses a multimodal large language model (MLLM) agent to dynamically route each image to the most suitable vision backbone. Our diverse ensemble employs convolutional neural networks (ResNets), self-supervised representation learners (SSL), and vision-language models (VLMs), each trained on a unified label space constructed from multiple image datasets with differing distributions and characteristics. Empirical evaluations illuminate the distinct capabilities and vulnerabilities of each architecture across disparate visual domains. Crucially, we show that ARMDIL effectively navigates these trade-offs, performing competitively with specialized training-based routers. Furthermore, it drastically improves adaptability by allowing new information to be integrated via simple prompt modifications, while enhancing interpretability through natural language reasoning traces. These advances in cross-dataset image classification pave the way for more reliable general-purpose vision systems such as AI assistants and autonomous robots.
12. 【2608.13430】Are You Sure You're Sure? On the Impact of Instruction Tuning on Confidence and Lexical Diversity
链接：https://arxiv.org/abs/2608.13430
作者：Irina Proskurina,Mayank Kumar,Oyindolapo O. Komolafe
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：achieve strong performance, exhibit verbalized overconfidence, language models achieve, models achieve strong, generation tasks
备注：
点击查看摘要
Abstract:Instruction-tuned language models achieve strong performance across a range of generation tasks, but have also recently been shown to exhibit verbalized overconfidence. In question answering, verbalized model overconfidence may be associated with the consistency of the generated supporting rationales. In this paper, we study whether corresponding changes in the lexical diversity of generated answer rationales accompany changes in model confidence induced by instruction tuning. We evaluate three matched base and instruction-tuned models across question-answering benchmarks and find that instruction tuning consistently alters answer confidence, despite limited changes in predictive accuracy and decreases in likelihood-based calibration. Secondly, we observe a non-uniform effect of instruction tuning on rationale diversity: cross-rationale diversity consistently decreases, whereas surface-level lexical diversity varies in both direction and magnitude across models and benchmarks. Finally, we find that these differences persist after controlling for answer selection and rationale length, confirming that confidence and rationale diversity capture distinct effects of instruction tuning.
13. 【2608.13426】Reduced Matrix Multiplication: Input-Adaptive Matrix-Product Reduction for LLM Inference
链接：https://arxiv.org/abs/2608.13426
作者：Zixuan Lan,Yanhong Li,Jiawei Zhou
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：high-dimensional matrix multiplications, Reduced Matrix Multiplication, achieve strong performance, repeated high-dimensional matrix, Transformer-based language models
备注： 24 pages
点击查看摘要
Abstract:Transformer-based language models achieve strong performance but incur substantial inference cost due to repeated high-dimensional matrix multiplications. We propose Reduced Matrix Multiplication (RMM), a training-free, input-adaptive inference method that reduces Transformer matrix products by selecting informative slices along their contraction dimensions, without modifying model weights. Under a simple retention-ratio control, RMM provides a smooth and predictable accuracy-efficiency trade-off. Across language models ranging from 1B to 70B parameters, we find that reduction tolerance depends on the model family, task, component, and retention ratio, although it often improves with model scale. Under moderate reduction, RMM remains robust across the evaluated discriminative, autoregressive generation, and long-context settings. We further show that the same principle extends to multimodal vision-language inference. Mechanistic ablations reveal a structural asymmetry within Transformers: attention-side computations are substantially more reducible than MLP components. Finally, wall-clock benchmarks with custom kernels on an NVIDIA A100 show that these computational savings can translate into practical runtime gains, especially at longer sequence lengths. Together, these results position RMM as a scalable direction for input-adaptive inference-time optimization.
14. 【2608.13425】Motor, Cognitive, or Corpus? What Survives Cross-Lingual Transfer in Speech-Based Parkinsons Disease Detection
链接：https://arxiv.org/abs/2608.13425
作者：Serli Kopar,Sam Gijsen,Abner Hernandez,Paula Andrea Perez-Toro,Kerstin Ritter
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS); Signal Processing (eess.SP)
关键词：achieve strong performance, Self-supervised learning, Parkinson disease, performance for Parkinson, representations achieve strong
备注：
点击查看摘要
Abstract:Self-supervised learning (SSL) speech representations achieve strong performance for Parkinson's disease (PD) detection within individual corpora. However, it remains unclear whether these models capture disease-related characteristics or exploit dataset-specific confounds, particularly since most SSL backbones are pretrained exclusively on healthy speech. To investigate this question, we perform a layer-wise analysis of nine SSL speech backbones using a low-capacity logistic regression probe across three languages. We structure the evaluation as multiple scenarios that progressively introduce distribution shifts in participant identity, recording conditions, language, and pathology. Our results reveal two key findings. First, layer selection is highly corpus-dependent: the optimal representation layer is determined primarily by the source dataset rather than by the SSL architecture itself. Second, the transferred discriminative signal lacks pathological specificity: classifiers trained to detect PD assign similarly high probabilities to both PD and dementia speech in the target corpus. These results highlight critical limitations that must be addressed before speech-based pathology recognition models can be reliably deployed in clinical settings.
15. 【2608.13387】CROP: Task Relevance via Counterfactuals for Selective On-Policy Distillation
链接：https://arxiv.org/abs/2608.13387
作者：Enhan Li,Junhao He,Hongyang Du
类目：Computation and Language (cs.CL)
关键词：assigns equal credit, student language model, On-policy distillation, language model, model on trajectories
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) supervises a student language model on trajectories sampled from its current policy, but assigns equal credit to response tokens with unequal supervision value. Selective OPD addresses this limitation by allocating supervision non-uniformly across response tokens according to their estimated training value. Most existing criteria, however, focus primarily on optimization need, such as uncertainty or teacher-student disagreement, while task relevance, namely whether the supervision is tied to the semantic content of the current input, remains less directly characterized as a complementary dimension. To address this gap, we introduce Counterfactual Relevance for On-Policy Distillation (CROP), which operationalizes task relevance through a paraphrase-calibrated counterfactual sensitivity margin. For each source prompt, CROP constructs a validated original-paraphrase-counterfactual triplet, holds the student rollout fixed, and measures each response position by its sensitivity to a task-relevant condition change calibrated by its sensitivity to a meaning-preserving rewrite. Matched selection controls show that CROP identifies more useful supervision positions than random or lowest-relevance selection, while component comparisons confirm the value of both counterfactual sensitivity and paraphrase calibration. Across two teacher-student settings, CROP improves aggregate performance by 1.92 and 2.96 points over the strongest non-CROP selector. These results support task relevance as a complementary criterion for selective OPD and establish CROP as a model-internal, contrast-specific method for allocating token-level supervision.
16. 【2608.13334】RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memory
链接：https://arxiv.org/abs/2608.13334
作者：Jingbo Ji,Lingyi Li,Xilong Cheng,Yuhao Zhou,Wenji Zhang,Yuting Tan,Yunxiao Qin
类目：Computation and Language (cs.CL)
关键词：LLM-based agents increasingly, agents increasingly rely, support long-horizon reasoning, LLM-based agents, agents increasingly
备注： 22 pages, 4 figures
点击查看摘要
Abstract:LLM-based agents increasingly rely on external memory to support long-horizon reasoning and interaction. However, the main bottleneck is not simply storing past experience, but recovering the right set of evidence when relevant information is distributed across many interactions. Existing approaches struggle with this access problem. Full-context methods require noisy long-context search, flat retrieval often returns isolated and incomplete records, and graph-based memory systems can be expensive to construct while compressing rich event context. We introduce RippleMem, a long-term memory system that replaces one-shot retrieval with adaptive associative recollection. Inspired by cue-dependent episodic retrieval and associative completion, RippleMem stores interaction history as cue-rich episodic memory units and organizes them in an event-centric memory graph. Given a query, it first recalls relevant memory anchors through hybrid cues, then expands from these anchors along semantic and structural associations to recover missing supporting evidence. In this way, initially recalled memories serve not only as answer context, but also as cues for completing the evidence needed to answer. Experiments on LoCoMo and LongMemEval-S show that RippleMem achieves the best overall performance across evaluated settings, improving LLM-as-a-Judge accuracy by 3.95% on LoCoMo and up to 11.87% on LongMemEval-S, while reducing graph construction cost by about 30x.
17. 【2608.13328】It's How You Ask: Gender-Associated Linguistic Bias in LLMs
链接：https://arxiv.org/abs/2608.13328
作者：Katherine Van Koevering,Anjalie Field
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：mediated by LLMs, Professional communication, increasingly mediated, models serve, Professional
备注：
点击查看摘要
Abstract:Professional communication is increasingly mediated by LLMs - but do these models serve all users equally? We show that when prompts contain linguistic features more commonly used by women (hedges, tag questions, collective reference), they systematically elicit shorter, less sophisticated, and less formal responses across three document types and four models. These effects persist after controlling for prompt complexity and feature carry-over. Explicit gender cues like sign-off names are encoded in the same representational space as linguistic dialect - suggesting shared underlying mechanisms - yet linguistic register is far more influential, producing large, consistent effects where names produce none. Our results further reveal that post-hoc mitigation is challenging: because these patterns are culturally embedded and outside conscious control, users cannot easily avoid them through strategic self-presentation, and mechanistic analysis reveals that linguistic features are encoded in early transformer layers and entangled with other features. Our work calls for upstream consideration of the influences of linguistic variation to mitigate disparate impacts of LLM-mediated workplace communication.
18. 【2608.13326】Beyond Local Accuracy: A Protocol-Level Identifiability Audit for Controlled LLM Reasoning Evaluation
链接：https://arxiv.org/abs/2608.13326
作者：Junhao Luo,Ning Huang,Ziqi Sha,Wenxuan Tang,Wei Deng(School of Statistics and Data Science, Southwestern University of Finance and Economics)
类目：Computation and Language (cs.CL)
关键词：LLM benchmark scores, LLM benchmark, intended to measure, benchmark scores, behavioral policy class
备注： 15 pages, 9 figures. Ning Huang, Ziqi Sha, and Wenxuan Tang contributed equally as second authors. Wei Deng is the corresponding author
点击查看摘要
Abstract:LLM benchmark scores can be precise even when the observation protocol does not identify the behavioral property they are intended to measure. In a controlled, solver-grounded setting, we formalize a protocol-level identifiability audit over a finite behavioral policy class: given policies H, observation support O, and estimand $\tau$, we test whether O separates every pair with different $\tau$. The audit requires zero model calls and resolves our diagnostic case: base-only observation collapses seven frozen deterministic policies into one equivalence class; full support yields seven classes and no cross-estimand collisions; every leave-one-out support retains a constructive collision witness. Empirically, both constrained-generation variants have pair-validity 1.0, yet base accuracy and selective-response fidelity diverge - 0.620 versus 0.324 across six balanced oracle-transition directions (cluster-bootstrap 95% CI [0.600, 0.642] vs. [0.304, 0.345]) - and the gap recurs on a second deterministic source (0.646 vs. 0.331). The audit also synthesizes a minimum identifying support $O^*$ for the frozen policy class: two cells instead of the full 36-cell tensor. This case shows how evaluation-design validity can be checked structurally before model inference and why base correctness does not determine intervention-response fidelity.
19. 【2608.13304】Refusing Intent, Not Form: Wrapper-Based Intent-Group Supervision for LLM Safety
链接：https://arxiv.org/abs/2608.13304
作者：Ping Wu,Haibo Tong,Feifei Zhao,Han Shen,Yu Shi,Yilin Zhao,Sicheng Shen,Guobin Shen,Yun Luo,Yi Zeng
类目：Computation and Language (cs.CL)
关键词：prompts bypass safety, learn surface-form shortcuts, harmful prompts bypass, Safety tuning, bypass safety
备注： 23 pages, 11 figures, 24 tables
点击查看摘要
Abstract:Safety tuning can improve harmful refusal, but models may learn surface-form shortcuts: wrapped harmful prompts bypass safety, while similarly wrapped benign prompts are over-refused. We propose Wrapper-Based Intent-Form Augmentation (WIFA), an automatic intent-group augmentation method that pairs wrapped harmful examples with structurally matched wrapped benign counterexamples, requiring no external teacher or manual per-wrapper intent labels. We use WIFA as a common data layer for two complementary fine-tuning routes: WIFA-Boost, a two-stage high-safety recipe, and Anchored Group-Consistent Refusal Training (A-GCRT), which regularizes refusal/compliance decision scores across same-intent wrappers and anchors harmful and benign groups on opposite sides of a margin. In the Qwen setting, WIFA-Boost reaches the strongest transformed-harmful refusal, while A-GCRT reduces OR-Bench over-refusal from 25.7\% for the base model to 17.4\%; reproduced baselines do not match these operating points. Llama results and ablations over data structure, two-stage order, and A-GCRT components support this intent-group interpretation without claiming universal below-base over-refusal.
20. 【2608.13277】Mixture of Training: Recombining Small-Scale Scaffolded Pretraining Runs into a Larger Language Model
链接：https://arxiv.org/abs/2608.13277
作者：Mohammed Sabry,Sean Augenstein,Keith Rush,Lucio Dery
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：independently trainable jobs, coherent larger model, decomposed into smaller, trainable jobs, coherent larger
备注： Accepted at the Workshop on Methods and Opportunities at Small Scale (MOSS), COLM 2026
点击查看摘要
Abstract:We ask whether language-model pre-training can be decomposed into smaller, independently trainable jobs that can later be recomposed into a coherent larger model. We introduce Mixture of Training (MoT), a scaffolded modular pre-training procedure that partitions a target Transformer into contiguous layer blocks, trains each block inside a frozen pretrained aligner scaffold, and then recomposes the trained blocks with an optional short end-to-end adaptation pass. On a 1.3B-parameter Gemma-style model trained on C4, MoT provides a small-scale proof of mechanism: independently trained depth slices can be recomposed into a usable language model, and a quality-parity schedule reaches the same reported perplexity as the monolithic baseline. This parity setting processes more aggregate tokens and has a shorter idealized layer-equivalent critical path after aligner preparation; its effective compute advantage depends on reusing the aligner across runs. We therefore present MoT not as a general replacement for monolithic pre-training, but as a small-scale framework for studying whether scaffolded sub-runs can act as reusable training units.
21. 【2608.13267】How Do VLMs Behave When Blind or Misled? Behavioral Evaluation of VLMs on Scientific Figures
链接：https://arxiv.org/abs/2608.13267
作者：Paul Osemudiame Oamen,Owusu-Banahene Osei,Ananya Mukherjee,Christian Greisinger,Steffen Eger,Pius Onobhayedo,Wei Zhao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Existing vision-language model, Existing vision-language, benchmarks emphasize perception, diagnostic VLM benchmark, VLMs describe
备注： 25 pages including appendix. Project website: [this https URL](https://scifigbench.nlp4sci.com)
点击查看摘要
Abstract:Existing vision-language model (VLM) benchmarks emphasize perception and reasoning accuracy (how well VLMs describe and reason about what they see in an image), with limited attention to behavioral reliability under uncertainty (how they behave when visual evidence is missing or misleading). We introduce SciFigBench, a diagnostic VLM benchmark for scientific figure understanding that jointly evaluates perception, reasoning, and behavioral reliability under uncertainty. It contains 250 figures with high-quality human annotations across three evaluation aspects, totaling 600+ hours of annotation effort. We further extend these figures via image transformations, reasoning questions, resistance probes, caption-bias probes, and confirmed selective-blur targets, producing over 34,000 evaluation setups for stress testing. We further propose the Admittance-Resistance-Inductance (A-R-I) framework to evaluate whether models acknowledge insufficient evidence, resist misleading context, and infer cautiously from partial information. Our results reveal substantial behavioral differences among models. GPT-5.2 achieves the highest description quality (MQM 91.6) with strong reasoning accuracy (78.4%), yet hallucinates unreadable content in 96% of cases, whereas Gemini 3.1 Pro, a comparably capable model (MQM 90.2, reasoning 81.0%), admits uncertainty in 71% of such cases and achieves the strongest resistance score (0.91). These findings show that high perception and reasoning accuracy alone do not guarantee behavioral reliability, a dimension critical for deployment in scientific workflows.
Comments:
25 pages including appendix. Project website: this https URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
ACMclasses:
I.2.7; I.2.10
Cite as:
arXiv:2608.13267 [cs.CL]
(or
arXiv:2608.13267v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.13267
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
22. 【2608.13258】Self-Referential Induction Increases Response Instability Relative to Unresolvable and Verifiable Questions in Large Language Models
链接：https://arxiv.org/abs/2608.13258
作者：Paras Balani,Subhrakanta Panda
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：resembling subjective experience, reliably induce large, induce large language, prior work measures, produce first-person reports
备注： 4 pages, 2 figures
点击查看摘要
Abstract:Self-referential prompting has been shown to reliably induce large language models to produce first-person reports resembling subjective experience, but no prior work measures how consistent these reports are across repeated, independent trials, or how that consistency compares to the model's behavior on other kinds of open-ended questions. We measure response instability, defined as one minus the mean pairwise cosine similarity of sentence embeddings computed over a compressed core claim extracted from each response, for three groups of questions: self-referential prompts eliciting a subjective-experience report, unresolvable philosophical questions unrelated to self-reference, and questions with a verifiable correct answer. Using 30 independent responses per question (360 responses total, Gemini API, temperature 0.7) across four questions per group, we find that self-referential questions show the highest instability (0.343 +/- 0.047), unresolvable philosophy questions show intermediate and tightly clustered instability (0.192 +/- 0.008), and verifiable questions show the lowest instability (0.105 +/- 0.058). This provides a quantitative baseline for the induced subjective-experience report, showing that it occupies a distinct, less stable position in the model's output distribution than ordinary open-ended philosophical uncertainty.
23. 【2608.13244】Localize, Then Reason: Visual Latent Structural Reasoning for Molecular Properties and Edits
链接：https://arxiv.org/abs/2608.13244
作者：Xingqiao Lin,Junmei Wang,Haocheng Tang
类目：Computation and Language (cs.CL); Computational Engineering, Finance, and Science (cs.CE); Biomolecules (q-bio.BM)
关键词：structure determines properties, Local chemical perception, molecular structure determines, determines properties, essential for understanding
备注：
点击查看摘要
Abstract:Local chemical perception and property reasoning are both essential for understanding how molecular structure determines properties. Current LLM-based chemical reasoning methods either receive SMILES/molecular images together with descriptions of local motifs, or reason directly from molecular images. Neither approach enables the model to focus on chemically meaningful regions before reasoning. To address this gap, we propose Visual Latent Structural Reasoning (VLSR), an end-to-end framework that jointly learns localization and reasoning from molecular images. Central to our approach is a localize-then-reason strategy. VLSR first learns to locate chemically meaningful regions in a molecular image. It then reasons about their property effects in a compact latent workspace before producing the final answer. Under the same inference setup, this design achieves 9.6X higher throughput than a comparable textual-reasoning baseline.
24. 【2608.13237】When Should Multi-Round RAG Stop? Structured Stopping Judgments and Retrieval Reduction in Search-R1
链接：https://arxiv.org/abs/2608.13237
作者：Weimeng Luo
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Multi-round retrieval-augmented generation, Multi-round retrieval-augmented, retrieval-augmented generation, evidence accumulates, searching as evidence
备注： 16 pages, 3 figures. Code: [this https URL](https://github.com/luobostorm/search-r1-s2g-stopping)
点击查看摘要
Abstract:Multi-round retrieval-augmented generation (RAG) must decide when to stop searching as evidence accumulates. Because the deployed policy is determined by the first STOP on each trajectory, this is a sequential selection problem rather than an independent state-classification task. We adapt S2G-RAG's structured sufficiency-and-gap judgment to a frozen Search-R1 pipeline and train a Qwen3.5-2B judge on 3,009 states from 900 disjoint HotpotQA questions. Search-R1's reasoner, retriever, corpus, prompt, and search budget remain unchanged, while the judge checkpoint and stopping threshold are selected on grouped validation and frozen before confirmatory evaluation. On the confirmatory test set, the resulting policy reduces retrieval calls by 77 (3.70\%) relative to Native Search-R1, while Official Exact Match decreases by 0.625 percentage points. Thus, the trained S2G-style structured judge reduces retrieval while broadly preserving answer accuracy. The result does not imply unchanged or improved accuracy, safe stopping, or lower total inference cost.
25. 【2608.13200】GEM: A Generative Embedding Model Bridging Reasoning and Retrieval
链接：https://arxiv.org/abs/2608.13200
作者：Zhili Shen,Craig Macdonald
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Modern LLMs excel, Modern LLMs, LLMs excel, complex and diverse, diverse information
备注：
点击查看摘要
Abstract:Modern LLMs excel at reasoning and instruction following, enabling users to express complex and diverse information needs. However, conventional retrievers largely rely on surface-level matching between queries and documents, resulting in a growing gap between how users express their needs and how retrievers interpret them. In this paper, we present GEM, a generative embedding model that augments retrieval through its own knowledge by explicitly reasoning about user intent and relevance criteria. GEM unifies generation and embedding within a single model: it first reasons over the query, then appends an embedding token to encode the enriched context for retrieval. \zhili{Evaluated on reasoning-intensive and instruction-following retrieval tasks, GEM demonstrates the effectiveness of its reasoning-augmented retrieval, outperforming its non-reasoning variant and matching baselines using substantially larger models.} Furthermore, GEM's generative nature allows test-time compute scaling via prompting to further enhance retrieval performance. Our code is available at: this https URL.
26. 【2608.13168】Which LLM Is Your Ideal Companion? Evaluating Emotional Companion Capabilities of LLMs Based on Adult Attachment Theory
链接：https://arxiv.org/abs/2608.13168
作者：Junkai Zhou,Shiting Guan,Zhaoyi Zhang
类目：Computation and Language (cs.CL)
关键词：large language models, pressing issue, large language, increasingly applied, emotional companionship
备注：
点击查看摘要
Abstract:As large language models (LLMs) are increasingly applied for emotional companionship, evaluating their behavior and capabilities in intimate relationships has become a pressing issue. However, existing assessments primarily characterize general personality traits, providing limited insight into model behavior within intimate and emotionally sensitive contexts. Therefore, we introduce adult attachment theory into LLM evaluation and use the Experiences in Close Relationships-Revised (ECR-R) scale to characterize attachment anxiety and avoidance. To evaluate emotional companionship capabilities of LLMs in realistic interaction scenarios, we present an emotional companionship benchmark, ECBench, spanning four scenarios including emotional support, collaborative tasks, conflict resolution, and social guidance, across friendship and romantic relationships. ECBench is utilized to assess model behavior using 11 dialogue-quality metrics and three evaluation methods. We evaluate the attachment tendencies of 32 LLMs and select representative models to investigate how these tendencies manifest in contextualized multi-turn interactions and whether they can be shaped through prompting. Our study provides a theoretical lens from psychology, along with practical tools to understand and select LLMs for emotional companionship.
27. 【2608.13167】RAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint
链接：https://arxiv.org/abs/2608.13167
作者：Fnu Pramono,John Cai,Sourabh Kulkarni
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：occluded or chaotic, Epistemic Calibration Score, Penalized Epistemic Calibration, visual evidence, introduce Penalized Epistemic
备注： 10 Pages excluding Reference and Appendix, Published at COLM 2026
点击查看摘要
Abstract:When visual evidence is occluded or chaotic, models should abstain. In this paper, we show that Vision-Language Models (VLMs) can internally distinguish when abstention is required, but fail to express it anyway. We introduce TRAPSBench, a procedurally generated video benchmark of 1,404 matched physics pairs in which a single targeted change renders the outcome undeterminable from the visual evidence. Furthermore, we introduce Penalized Epistemic Calibration Score (PECS), a new robust metric that requires models to both answer correctly when the outcome is knowable, and abstain when the outcome is not. Across 16 VLMs spanning five families, spontaneous restraint is poor: the best PECS is 0.292. The bottleneck is expression, not perception: linear probes decode answerability from hidden states at up to 0.91 AUROC across physics domains; steering a single-layer void direction causally induces or suppresses abstention. Our results replicate across three open-weight families (Qwen, Gemma, LLaVA). The failure is also more pronounced in visual than textual uncertainty: models detect textual impossibility about 4x more readily than missing visual evidence. Closing this representation--output gap likely requires output-stage interventions.
28. 【2608.13160】Better Decomposition, Free Aggregation: A Synthesizer-Folding Framework for Multilingual Multi-Hop Question Answering
链接：https://arxiv.org/abs/2608.13160
作者：Yilin Wang,Yuchun Fan,Weidong Bao,Zili Wei,Shi Feng,Tong Xiao,Zhengtao Yu,Jingbo Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：globally distributed external, distributed external knowledge, Multilingual retrieval-augmented generation, equips large language, large language models
备注： Accepted by NLPCC 2026
点击查看摘要
Abstract:Multilingual retrieval-augmented generation (mRAG) equips large language models with access to globally distributed external knowledge for complex multilingual question answering. Recent approaches either translate retrieved documents into English or the query language to bridge the cross-lingual semantic gap, or decompose a complex query into sub-questions and aggregate the intermediate reasoning process. However, both lines of work suffer from two limitations. First, one-size-fits-all translation alignment, blanket translation discards culturally and linguistically native information unique to the target language, introduces translation noise, and inflates system cost. Second, greedy decomposition and aggregation, uncontrolled decomposition produces redundant sub-questions that compound errors during step-wise reasoning, and the final aggregation over reasoning paths further amplifies these errors. We address both with our method Syfer, a synthesizer-folding framework for multilingual multi-hop question answering that defers translation rather than applying it by default. Syfer first invokes a format-constrained decomposer to produce a sub-question graph in the original language, followed by a decomposition-quality check; when the check passes, sub-questions are answered sequentially under a retrieve-then-answer policy in the target language, and the English translation pathway with bilingual sub-question graph alignment is activated only when the check fails. Experiments across multiple languages show that Syfer attains competitive accuracy while striking a favourable balance between performance and computational cost.
29. 【2608.13136】LigBench: A Unified and Human-Aligned Benchmark for LLM-based Research Idea Generation
链接：https://arxiv.org/abs/2608.13136
作者：Chenrun Wang,Mingxuan Zhu,Tiancheng Huang,Wenjie Li,Yujie Zhang,Zichen Zhu,Zhiying Zou,Kai Yu,Lu Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB); Multiagent Systems (cs.MA)
关键词：attracted increasing attention, large language models, increasing attention, rapid advancement, advancement of large
备注： 17 pages
点击查看摘要
Abstract:With the rapid advancement of large language models (LLMs), research idea generation has attracted increasing attention. Existing approaches enable LLMs to retrieve relevant literature and propose novel ideas for research areas. However, current evaluation practices for idea generation remain fragmented and lack objective standards, often relying on direct LLM scoring, which limits their ability to provide unified and reliable assessments across a coherent distribution of generated ideas. To address this challenge, we propose LigBench, an automated evaluation benchmark that enables fine-grained and reliable evaluation of AI research ideas, consistently applicable across different generation distributions. In addition, we introduce PAIR-IQ, a dataset tailored for training pairwise idea judgment models and serving as an auxiliary reference to support more objective comparative evaluation. Extensive experiments demonstrate that LigBench achieves stable and interpretable evaluations, significantly improving alignment with expert judgments. Furthermore, models trained on PAIR-IQ exhibit enhanced ranking accuracy and robustness, establishing a principled standard for scalable and objective research idea assessment.
30. 【2608.13101】CASA: Content-Acoustic Speaking Assessment with Speech Encoder and Large Language Model
链接：https://arxiv.org/abs/2608.13101
作者：Nhan Phan,Ilona Lähteenmäki,Anna von Zansen,Olli-Pekka Pauna,Yaroslav Getman,Tamás Grósz,Mikko Kurimo
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：automatic speaking assessment, assess learners' speaking, increasingly adopted multimodal, learners' speaking performance, adopted multimodal speech
备注： To be submitted to ICASSP 2027. Code is available at [this https URL](https://github.com/aalto-speech/casa)
点击查看摘要
Abstract:Research on automatic speaking assessment (ASA) has increasingly adopted multimodal speech large language models to assess learners' speaking performance. However, existing studies provide limited analysis of how acoustic and content information contribute to predictions and how stable the resulting performance is. We propose CASA, a simpler architecture combining Whisper-medium and Qwen3.5-2B that achieves state-of-the-art performance while providing a more interpretable separation between speech delivery and content. On the Speak Improve Corpus 2025, CASA achieves a root mean square error (RMSE) of 0.358, improving on the previous best RMSE while using approximately half the estimated inference parameters. The general-purpose architecture is designed for adaptation to other ASA corpora without structural changes and relies on three handcrafted fluency features. Through ablations and repeated runs, we analyze the individual and complementary contributions of acoustic and content information, examine performance variability, and demonstrate the potential of large language model reasoning for training-free content validation.
Comments:
To be submitted to ICASSP 2027. Code is available at this https URL
Subjects:
Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
Cite as:
arXiv:2608.13101 [cs.CL]
(or
arXiv:2608.13101v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.13101
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
31. 【2608.13063】Explanatory Engagement Under Rare Anomalous Failure: Asymptotic Rarity in Model Behavior (or: The Asymptotic AI)
链接：https://arxiv.org/abs/2608.13063
作者：Sam Mao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：model notices anomalies, notices anomalies, Prior work, LLM behavior, model notices
备注： 11 figures. Elicitation-condition sweep across three open-weight models (qwen3:8b, llama3.1:8b, mistral:7b); pipeline scripts and experimental data available upon reasonable request
点击查看摘要
Abstract:Prior work on LLM behavior under anomalous conditions asks whether a model notices anomalies. We ask a narrower question: once a model sits in a workflow with a low, controllable failure rate, does its explanatory engagement - length, specificity, self-reported confidence - change as failure grows asymptotically rarer? We built a local, zero-cost harness on three open-weight models (qwen3:8b, llama3.1:8b, mistral:7b) running a repeated tool-call task where one call fails at probability p, swept across eight rates from 0.2 to 0.0001, under five elicitation conditions from immediate prompting to none. We hypothesized a rise in engagement as failures grew rarer, then a collapse near a detectability threshold. Pooled across conditions this appeared false: length fell in a flat, monotonic pattern. Splitting by condition overturned that. Under immediate_forced, where the model must explain every failure instantly, the predicted rise is confirmed but followed by a plateau, not a collapse: length peaks at 28.4 words at p=0.05, settles to 17.4-19.0 words at the rarest rates, and confidence rises unevenly from about 53% to the 70s-90s. Under grouped_runs, explanation batched to run-end, no collapse appears. Under passive_unprompted, aggregate magnitude is a floor artifact, but a recovered logging gap revealed real, model-specific self-monitoring: llama3.1:8b volunteers structured confidence reports unprompted, sometimes eroding its own confidence as trials accumulate; the other two do so only once, as boilerplate. Elicitation structure is a first-class moderator of collapse observability. A companion guaranteed-failure run (72 cells, backfilling rates where random sampling gave zero real failures) shows models differ in whether they recognize an anomaly, distinct from engagement once recognized. Limitation: discrete rate points cannot capture behavior between them, a direction for future work.
32. 【2608.13057】EMPO: Makespan-Aware Expert-Parallel Load Balancing Across Memory- and Compute-Bound Regimes
链接：https://arxiv.org/abs/2608.13057
作者：Jie Li,Chenxin Jia,Jinliang Shen,Cunzhuang Liu,Ruiyi Ding,Jianwen Xian,Kang He,Chengru Song
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)
关键词：MoE serving, layer synchronizes, emph, slowest GPU, GEMM rounds tokens
备注： 18 pages. Code is available at [this https URL](https://github.com/jeshxxx/TEMPO)
点击查看摘要
Abstract:In expert-parallel (EP) MoE serving, every layer synchronizes at the slowest GPU. Dispatchers balance token counts (EPLB, LPLB, UltraEP) or activated-expert counts (METRO), assuming expert time is linear in one. Measurements on two datacenter GPU generations show it is neither: below $\nstar\!\approx\!156$--$168$ tokens, HBM weight streaming dominates---cost attaches to \emph{activated replicas}, not tokens; above it, grouped GEMM rounds tokens to 128-tile $M$-tiles, so \emph{splitting} an expert adds padded compute. A max-affine profile $t=\max(a+bG,\,c+\beta N)$ captures both regimes. Realistic decode batches hold hot experts in the linear regime and cold in the flat \emph{simultaneously}; recorded batches show proxy dispatches differ by $1.4$--$1.6\times$ in modeled block time (p95 up to $1.7\times$), and \emph{which} proxy wins flips with the regime. We formalize per-batch dispatch as a fixed-charge makespan problem---NP-hard on two fully replicated GPUs, polynomial in degenerate limits---and present \sys{}, a makespan-aware dispatcher solving it in milliseconds off the critical path; its SGLang integration runs out-of-process and fuses dispatch with count collection into one in-graph kernel. Anchored by an 8-GPU Testbed~A microbenchmark, \sys{} stays within 1\% of the best fixed baseline everywhere and wins by up to $15.5\%$ where regimes mix. End-to-end on Testbed~B, Qwen3-235B (inside the win region) gains $4$--$6\%$ throughput and cuts p99 latency by ${\sim}15.6\%$; DeepSeek-V3 (outside, communication-dominated) shows only mechanism cost. A phase diagram, not a universal win, is the claim: it predicts both outcomes before deployment.
33. 【2608.13040】Latent On-Policy Self-Distillation
链接：https://arxiv.org/abs/2608.13040
作者：Guibin Zhang,Jiayang Lyu,Ran Sun,Xinlei Yu,Haoyu Zhao,Qibing Ren,Shuicheng Yan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Enabling agents, central problem, problem in self-evolving, Latent On-Policy Self-Distillation, privileged context
备注：
点击查看摘要
Abstract:Enabling agents to learn from experience and internalize it into their policy has become a central problem in self-evolving AI. On-policy self-distillation (OPSD) offers an effective pathway by using a privileged self-teacher to provide dense supervision on the student's own trajectories; however, existing methods still rely heavily on designer-specified privileged artifacts (e.g., answers, feedback, skills, or trajectories), limiting the end-to-end learnability and scalability required for continual self-improvement. In this work, we introduce Latent On-Policy Self-Distillation (LOPD), which, rather than proposing another hand-crafted OPSD variant with a newly prescribed form of privileged context, makes the teacher's privileged context itself learnable end-to-end from experience. Technically, LOPD retrieves relevant experiences and composes them into continuous latent tokens that condition a self-teacher, while the student generates trajectories from the task and interaction history and receives dense token-level supervision at every visited prefix. We further introduce a privileged-margin objective to stabilize and regulate the learning of latent context. Empirically, LOPD demonstrates (I) strong performance, outperforming RLVR and representative OPSD methods including OPSD, SDPO, and Skill-SD across both agentic tool use and code generation; and (II) high learning efficiency, surpassing GRPO and Skill-SD with less than 30% of their rollout budget. Ablation studies further provide direct evidence that making privileged context learnable is necessary for realizing these gains. Together, these results position LOPD as a step toward a more scalable and self-directed paradigm for agent evolution.
34. 【2608.13010】RAGSieve: Self-Referenced Local Contrast for Knowledge-Poison Detection in Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2608.13010
作者：Xinlong Xu,Yoshua Y. Li
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation treats, promote attacker-chosen claims, Retrieval-augmented generation, allowing injected documents, inference evidence
备注：
点击查看摘要
Abstract:Retrieval-augmented generation treats an external corpus as inference evidence, allowing injected documents to promote attacker-chosen claims. Existing detectors depend on trusted references, specific attack artifacts, or global thresholds sensitive to corpus topology. We present RAGSieve, a self-referenced detection framework that constructs its reference from the inspected system. RAGSieve-Query (RSQ) performs query-local contrast, scoring top-five candidates against ranks 6-20 of the same retrieval to detect answer-anchor concentration and carrier transitions. RAGSieve-Graph (RSG) performs corpus-local contrast, comparing each document's semantically similar but lexically distinct neighbors with its local baseline to detect coordinated density before queries arrive. Across three QA datasets and six poisoning constructions, RSQ achieves 95.2% AUROC and detects 82.2% of poison at 5% clean-document removal, versus 81.1%/52.5% for GMTP. RSG achieves 93.3%/79.8%, versus 79.4%/37.6% for CleanBase. Joint deployment reduces attack success from 67.4% to 14.0% while retaining 41.3% F1 on unpoisoned retrieval, demonstrating practical protection at both corpus ingestion and query time without poison labels or trusted corpora. Source code is available at this https URL.
35. 【2608.13006】EviReform: Evidence-Guided Query Reformulation for Multi-Hop Graph Retrieval
链接：https://arxiv.org/abs/2608.13006
作者：Xinlong Xu,Yoshua Y. Li
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Multi-hop retrieval, provide sufficient evidence, retrieval, Multi-hop, evidence
备注：
点击查看摘要
Abstract:Multi-hop retrieval must recover passages that provide sufficient evidence together. An initial passage often resolves an entity or relation implicit in the question, making the missing evidence easier to describe only after retrieval begins. Graph retrieval improves access to related evidence through stored corpus structure, but its retrieval signal is commonly derived from the original question. Complementary evidence must then be reached through stored relations even when an observed passage provides a more direct semantic cue. We introduce EviReform, which separates revising the retrieval request from aggregating evidence in the graph. Retrieved source passages formulate residual queries for the unresolved information need. The original and residual retrieval signals are normalized separately, combined, and propagated between propositions that share entities. On 2WikiMultiHopQA, HotpotQA, and MuSiQue, EviReform exceeds the strongest baseline by up to 5.59 Recall@5 points and 4.50 F1 points. These results show that observed evidence can guide graph retrieval toward the part of a supporting chain left underspecified by the original question. Code is available at this https URL.
36. 【2608.13004】HybridRAG-BN: A Retrieval-Augmented Framework with Fine-Tuned Verification for Bangla KBQA
链接：https://arxiv.org/abs/2608.13004
作者：Rathijit Aich,Nirjhar Das,Mahfuzulhoq Chowdhury
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Knowledge-base question answering, external knowledge sources, Knowledge-base question, generate accurate answers, reliable KBQA systems
备注： Developed for the IEEE Computer Society CUET Student Branch
点击查看摘要
Abstract:Knowledge-base question answering (KBQA) systems rely on effective retrieval and reasoning mechanisms to generate accurate answers from external knowledge sources. However, developing reliable KBQA systems for low-resource languages such as Bangla remains challenging due to limited retrieval-focused research, scarce language resources, and difficulties in grounding generated responses in external knowledge. In this work, we propose HybridRAG-BN, a retrieval-augmented framework for Bangla KBQA that integrates hybrid retrieval using BM25 and BGE-M3, answer generation using the GGUF version of Gemma-4-31B-Instruct, and a LoRA-fine-tuned Gemma-4-31B-Instruct model for answer verification and refinement. To further improve robustness, the framework incorporates a post-processing stage that addresses unresolved cases through fallback answer replacement and DuckDuckGo-assisted retrieval. Experimental results demonstrate the effectiveness of the proposed framework, achieving token-level F1 scores of 0.71654 and 0.72912 on the public and private leaderboards, respectively, securing first place in the competition.
37. 【2608.12990】LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation
链接：https://arxiv.org/abs/2608.12990
作者：Dongfang Li,Zixuan Liu,Junmai Wang,Jiahe Huang,Fuhao Li,Bonian Jia,Baotian Hu,Min Zhang
类目：Computation and Language (cs.CL)
关键词：support future tasks, Long-horizon LLM agents, Long-horizon LLM, future tasks, support future
备注： 34 pages, 5 figures
点击查看摘要
Abstract:Long-horizon LLM agents must preserve information from past interactions to support future tasks. Existing memory systems typically rely on eager consolidation, invoking LLMs after each interaction to extract, summarize, or update memories. This design makes memory construction increasingly costly as conversations grow. Coarse summarization can reduce construction cost but risks discarding fine-grained contextual evidence, whereas larger retrieval contexts or multi-hop LLM reasoning shift the overhead to query time. We present LycheeMemory V2, an efficient long-term memory framework that replaces turn-level consolidation with semantic segment-level consolidation. Instead of consolidating every interaction, LycheeMemory batches multiple exchanges into segments and encodes each finalized segment into context-independent typed memory records. Segment-level batching lowers LLM encoding frequency, while semantic boundary detection helps preserve coherent event-level and temporal evidence compared with fixed-window batching. The resulting records are organized with lightweight structured indexes for query-planned evidence retrieval. Experiments using GPT-4.1-Mini show that LycheeMemory achieves state-of-the-art performance, reaching 89.22% on LoCoMo and 92.20% on LongMemEval-S. Compared with A-Mem, it reduces construction tokens by 86.0% on LoCoMo and 75.9% on LongMemEval-S without increasing query-time token usage. More broadly, our results suggest that the accuracy--cost trade-off of long-term agent memory depends not only on what information is retained, but also on the granularity at which it is consolidated.
38. 【2608.12984】Reconcile Once, Write Anytime: A Trust-Tiered Librarian and a Multi-Agent Writer for Drift-Free, Point-in-Time Research
链接：https://arxiv.org/abs/2608.12984
作者：Xing Zhang,Yanwei Cui,Guanghui Wang,Peiyang He
类目：Multiagent Systems (cs.MA); Computation and Language (cs.CL)
关键词：Long-form research reports, research reports generated, Long-form research, language models drift, large language models
备注：
点击查看摘要
Abstract:Long-form research reports generated by large language models drift, contradict themselves, and lose provenance: the same metric appears with different values, and rumor is quoted as confidently as an audited filing. We present a two-tier agentic system that separates a maintained, point-in-time knowledge library from report writing. A deterministic "librarian" ingests timestamped sources into a trust-tiered ontology, layering evidence cards, an authoritative metric ledger, and a claim graph into an always-current source of truth, not per-query RAG over raw chunks. A portable multi-agent "writer" runtime then composes a contradiction-free, evidence-grounded report at any knowledge cutoff T, reading only evidence with as_of = T (no look-ahead); red-team verdicts flow back into the librarian. We evaluate on a self-collected, public corpus of 6,130 sources yielding 555,926 evidence cards (SEC EDGAR filings across 295 issuers and 11 sectors, U.S. Bureau of Labor Statistics releases, and Wikipedia). From the one library we compose four point-in-time reports on distinct theses and run eight reproducible experiments, whose headline metrics come from a deterministic quality-control gate, itself validated by defect-injection meta-evaluation at recall 1.0 and precision 1.0. A shared metric ledger removes 6,845 cross-section contradictions to zero. Tier-first selection is correct on 22/22 gold cases where a popularity-first baseline scores only 9/22; trust tiering leaks zero media-sourced numbers, and no government statistic displaces a company's own filing. A red-team refutation propagates back and self-corrects a later run with zero manual edits. Replay exhibits zero look-ahead violations across seven cutoffs while the library grows from 235,373 to 555,312 cards. Difficulty-tiered model routing exceeds the all-Opus quality ceiling while running 3.7x faster than serial.
39. 【2608.12974】Comment on "Modeling rapid language learning by distilling Bayesian priors into artificial neural networks"
链接：https://arxiv.org/abs/2608.12974
作者：Orr Well,Idan Tarshish,Nur Lan,Roni Katzir
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Artificial Neural Networks, Artificial Neural, McCoy Griffiths, distilled into Artificial, Neural Networks
备注： Comment on [arXiv:2305.14701](https://arxiv.org/abs/2305.14701)
点击查看摘要
Abstract:McCoy Griffiths (2025, henceforth MG) suggest that a Bayesian prior can be distilled into Artificial Neural Networks (ANNs) through Model-Agnostic Meta-Learning (MAML, Finn et al., 2017). They support this empirically by showing that meta-trained networks demonstrate formal language learning abilities comparable to Yang Piantadosi (2023)'s Bayesian learner, significantly outperforming standard ANNs. We point out that under the standard interpretation of a prior, MG's procedure does not actually instill one; it merely initializes network weights favorably, leaving the objective function unchanged. We then consider a more permissive interpretation, where the system as a whole can be seen as implementing a Bayesian learner even without an explicit prior in the objective. We show that this interpretation faces nontrivial challenges. Finally, we assess how well MAML approximates the empirical results of Bayesian learning, showing that unlike genuine Bayesian learners, MG's model overfits and generalizes poorly to unseen data.
40. 【2608.12957】I-SDPO: Instance-Level Adaptive Self-Distillation Policy Optimization
链接：https://arxiv.org/abs/2608.12957
作者：Yubo Zhang,Xinhong Ma,Zezhong Tan,Ziqiang Dong
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Relative Policy Optimization, Group Relative Policy, relative signal, Relative Policy, Self-Distillation Policy Optimization
备注： 14 pages, 3 figures
点击查看摘要
Abstract:Group Relative Policy Optimization (GRPO) learns from reward differences within a rollout group, but receives no useful relative signal when every sampled response is incorrect. Privileged self-distillation can fill this gap with dense token supervision, yet applying it throughout training creates a different failure mode: the teacher is a biased, low-variance surrogate for the reward objective, so persistent imitation can oppose reward-improving updates after the policy becomes capable of producing successful trajectories. We introduce I-SDPO (Instance-Level Adaptive Self-Distillation Policy Optimization), which treats teacher reliance as capability-dependent. I-SDPO makes one routing decision per input instance and shares it across that instance's rollout group: all-incorrect groups use a privileged self-distillation objective, whereas any-success groups remain intact for GRPO. This design uses imitation only where group-relative rewards are uninformative. A local analysis characterizes when teacher and reward directions align and shows that a non-vanishing biased distillation weight induces an optimization bias floor. The routing rule automatically reduces the expected distillation rate as success probability rises, withdrawing teacher influence without a hand-designed schedule. On SciKnowEval, I-SDPO obtains the best result in all four scientific domains and improves average mean@16 accuracy from 56.67% with GRPO to 70.31%, with a maximum domain gain of 18.24 points.
41. 【2608.12953】Unifying Depth and Width Pruning for LLMs via Binary Knapsack Optimization
链接：https://arxiv.org/abs/2608.12953
作者：Palaash Goel,Ayan Sengupta,Akshay Nambi,Tanmoy Chakraborty
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, produce myopic decisions, compressing large language, methods rely heavily, existing methods rely
备注： 29 pages, 5 figures, 17 tables
点击查看摘要
Abstract:Structured pruning is a promising approach for compressing large language models (LLMs), yet existing methods rely heavily on greedy heuristics that produce myopic decisions, and often fail to precisely meet target compression budgets. We present SNIPER, a two-stage structured pruning framework that solves a knapsack optimization over coarse-granularity components to yield conditionally optimal parameter allocations with respect to fixed importance estimates, followed by a fine-grained pruning stage to meet strict budget constraints. We introduce the Compression Ratio Adherence Factor (CRAFT) to quantify budget fidelity, showing that while existing pruners deviate from target compression ratios by up to 33%, SNIPER achieves near-exact adherence with a CRAFT score of 0.98. Evaluations across four diverse architectures over a set of 18 tasks spanning five domains demonstrate SNIPER's consistent improvements in average performance retention and task-level stability over six state-of-the-art pruners. Across all pruning configurations, SNIPER achieves an excellent mean rank of 1.25, indicating its robust cross-architectural generalizability and excellent reliability.
42. 【2608.12913】Decoupled Contrastive Decoding via Expert-Aligned Drafting
链接：https://arxiv.org/abs/2608.12913
作者：Zhixuan Liu,Zhichen Dong,Yuanfu Wang,Chao Yang
类目：Computation and Language (cs.CL)
关键词：amateur-model pass makes, makes decoding expensive, pass makes decoding, improves generation quality, Decoupled Contrastive Decoding
备注： 28 pages, 11 figures, 20 tables. Code: [this https URL](https://github.com/chadlzx/dcd)
点击查看摘要
Abstract:Contrastive Decoding (CD) improves generation quality, but its amateur-model pass makes decoding expensive. Accelerating CD with speculative decoding raises a proposal-alignment question: should the contrastive signal shape the drafter, or should it remain only in verification? We study this question in the lightweight feature-level drafter regime. Two controlled diagnostics, matched Cross-alpha training and an Approximate Dual-Drafter decomposition, give the same diagnosis: contrastive-aware drafting does not consistently improve over expert-aligned drafting because the contrastive correction is usually weaker than drafter error, and reconstruction can amplify that error. We introduce Decoupled Contrastive Decoding (DCD), which drafts with an expert-aligned lightweight proposer and applies the amateur only in unchanged CD verification. Standard speculative verification preserves the vanilla-CD output distribution. Across the main 8B settings, EAGLE3-based DCD achieves average greedy speedups of 1.65 to 1.95x over vanilla CD and reduces MMLU proposal-path latency by about 5 to 12x relative to amateur-coupled proposal paths.
43. 【2608.12905】Prompts in the Wild: A Large Analyzed Collection of Transactional Prompts in Code
链接：https://arxiv.org/abs/2608.12905
作者：Victoria Basmov,Yoav Goldberg,Reut Tsarfaty
类目：Computation and Language (cs.CL)
关键词：Large Language Models, contemporary generative Large, generative Large Language, generative Large, model behavior
备注：
点击查看摘要
Abstract:The behavior of contemporary generative Large Language Models (LLMs) is directly shaped by prompts, unstructured texts that describe the desired output and model behavior. In this paper we argue that prompts are linguistic objects that merit investigation in their own right. To this end, we collect 57.5K unique samples of prompts from GitHub. Specifically, we focus on transactional prompts: reproducible natural language instructions that are integrated into software. To enable the empirical, quantitative study of prompts, we introduce a structured ontology, capturing the properties of prompts as well as their formal and semantic components. Based on this ontology, we transform prompts from unstructured raw texts into richly structured linguistic objects. Analysis of these structured data reveals significant diversity of usage patterns across languages, domains, tasks, and modalities, in a typical Zipf-like distribution where some clearly prevail and others, more diverse, appear in the long tail. To validate the reliability of the ontology-based annotation of the prompts, we perform a comprehensive error analysis across all fields, providing a detailed assessment of annotation quality. We release the dataset together with a browsing and exploration interface (this https URL ).
44. 【2608.12894】BavGround: A Benchmark for Regional Cultural Grounding and Dialect Competence in Bavarian
链接：https://arxiv.org/abs/2608.12894
作者：Jophin John,Michael Hoffmann,Jan Fillies,Michael A. Hedderich,Barbara Plank
类目：Computation and Language (cs.CL)
关键词：dialect communities underrepresented, leaving regional culture, high-resource standard languages, communities underrepresented, Bavarian regional cultural
备注：
点击查看摘要
Abstract:Cultural evaluation of large language models (LLMs) often focuses on high-resource standard languages, leaving regional culture and dialect communities underrepresented. We introduce BavGround, a benchmark for evaluating Bavarian regional cultural grounding and dialect competence across English, German and Bavarian. BavGround contains 206 multiple-choice source questions across eight cultural domains per language, yielding 618 multi-parallel instances, with items covering both broadly accessible cultural knowledge and source-grounded regional knowledge from journalism, historical sources, and specialist literature. We evaluate fifteen 7B-10B open-weight instruction-tuned models and one closed-model reference. Strong multilingual models perform best overall, but performance drops on Bavarian items and source-grounded questions, indicating persistent difficulty with dialectal and localized cultural knowledge. We further show that conclusions depend strongly on evaluation protocol: raw answer-letter scoring, shuffled-letter scoring, option-text likelihood, generated-answer parsing, and semantic matching can produce different absolute scores and rankings, especially for regionally adapted models. Finally, an exploratory analysis of GENBA-10B checkpoints suggests that continued pretraining improves answer-content likelihood unevenly across domains, while dialect competence remains comparatively weak. BavGround supports localized, protocol-aware evaluation of cultural representation in LLMs.
45. 【2608.12888】When Your Agent Opens the Chat App: Agent-Controlled Search over Raw Chat Logs Rivals Structured Memory
链接：https://arxiv.org/abs/2608.12888
作者：Ruizhe Li,Licheng Zhang,Benfeng Xu,Mingxuan Du,Zheren Fu,Weidong Chen
类目：Computation and Language (cs.CL)
关键词：Agent-memory systems increasingly, buy retrieval quality, increasingly buy retrieval, systems increasingly buy, transforming raw conversation
备注：
点击查看摘要
Abstract:Agent-memory systems increasingly buy retrieval quality with structure, transforming raw conversation histories into summaries, embeddings, trees, or knowledge graphs before any question is asked. We ask how much of that benefit comes from the structure itself, rather than from competent retrieval over the raw history. We present ReFind, an agent-controlled search interface that builds no semantic structure at all: it leaves the conversation archive unmodified, indexes it lexically at turn granularity, and combines a generic iterative keyword-search loop with four chat-native controls grounded in empirical refinding work: session-aware rank fusion, local context expansion, temporal narrowing, and skipping already-inspected sessions. A separate reasoning stage answers from the collected evidence. Across a broad suite of conversational-memory tasks (single- and multi-hop QA, event ordering, and fact consolidation), roughly 2,800 questions on precise-retrieval and fact-tracking capabilities evaluated under the incremental multi-turn setting of MemoryAgentBench, ReFind attains the highest mean accuracy (58.2) of any system compared, above the strongest graph- and tree-based memory systems (HippoRAG 2, 53.2), all under a GPT-4o-mini backbone matched to every reused baseline. Controlled comparisons to single-shot BM25, a matched generic-agentic BM25 control, component removals, and agentic dense/hybrid variants separately support the roles of agent control, chat-native controls, and lexical retrieval. On LongMemEval-S/M, the same interface reaches 93.2 +/- 3.3 and 89.3 +/- 6.0 with GPT-5-mini. The results indicate that for precise, evidence-grounded questions over chat archives, much of the benefit credited to elaborate memory structures is recoverable by giving an agent controllable search over the unmodified record, with no LLM-based index construction at all.
46. 【2608.12875】he Embedder's Dilemma: LLMs Are Better, but at What Cost?
链接：https://arxiv.org/abs/2608.12875
作者：Adnan El Assadi,Niklas Muennighoff,Jinhyuk Lee
类目：Computation and Language (cs.CL)
关键词：large language model, replace your text-embedding, text-embedding pipeline, large language, embedding models
备注： Accepted to COLM 2026
点击查看摘要
Abstract:Should you replace your text-embedding pipeline with a large language model? We answer this with a controlled, cost-aware comparison of ten LLMs across six families and 26 embedding models (118M to 14B parameters) on 37 tasks spanning classification, semantic textual similarity (STS), clustering, pair classification, and retrieval. In aggregate the two paradigms are effectively tied: the best LLM (Gemini 3.1 Pro, 77.6) and the best embedding model (77.2) differ by 0.4 points. Their strengths differ by task: LLMs lead on reasoning-heavy retrieval, embedding models lead on classification, and the two match on clustering, STS, and pair classification. Reaching that parity is expensive. An LLM costs up to 1,431x more than an embedding model of comparable quality (USD 154 vs. USD 0.11 per benchmark pass), and the open LLMs tested process tokens 2.5 to 736x more slowly on the same GPU. Reasoning tokens account for 28 to 81% of LLM inference cost; lower reasoning budgets preserve or improve retrieval quality for most models in our ablation. The Pareto frontier contains the leading embedding models and one LLM, Gemini 3.1 Pro. These results support a division of labour: use embedding models for similarity, classification, and clustering, and reserve LLMs for reasoning-intensive retrieval. Our code, datasets, and results are publicly available at this https URL.
47. 【2608.12852】Falsehood and Impossibility Are Different Directions in an AI's Representation of Language
链接：https://arxiv.org/abs/2608.12852
作者：Yoon Pyo Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：states of affairs, Language can describe, describe states, Language, affairs
备注：
点击查看摘要
Abstract:Language can describe states of affairs that are false and states of affairs that could not be the case at all. Whether an AI model internally distinguishes these failures remains unclear. I report an exploratory activation study of the multimodal open-weight model Gemma 3 4B IT using 85 prompts from 17 philosophical families and a topic-matched modality set of 15 topics, each expressed as a truth, contingent falsehood, improbable claim, semantic anomaly, and necessary falsehood. In its answers, the model conflates contingent falsehood with contradiction, labeling 12 of 15 false statements "contradiction." Its activations show a different pattern. A linear truth probe separates impossible from true statements (AUC 0.93) but not impossible from false statements (AUC 0.20). An impossibility probe evaluated on held-out topic families separates necessary from contingent falsehood at AUC 1.00, peaking at layer 15 with balanced accuracy 0.97 (Bonferroni-adjusted P=0.018). The truth and impossibility directions are close to orthogonal, whereas the impossibility direction partially overlaps a semantic anomaly direction while remaining distinguishable from it. Sparse autoencoder features at the same layer repeat this geometry. Features selective for impossibility also fire on anomalous sentences but rarely on contingent falsehoods. In this model's activation space, necessary falsehoods are not extreme cases of contingent falsehood but lie closer to the experimentally defined category of semantic anomaly. This representational proximity does not imply that impossible statements are intrinsically meaningless. These correlational observations from one small model offer an empirical footnote to an old philosophical distinction.
48. 【2608.12847】Beyond Retrieval: Query-Conditioned Reuse of Long-Horizon Agent Trajectories
链接：https://arxiv.org/abs/2608.12847
作者：Yifei Li,Heng Wang,Lingling Zhang,Muye Huang,Xinyu Zhang,Jiashuai Liu,Hang Yan,Rongman Xu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：acting agent, environment state, trajectory, QCR, holds candidate retrieval
备注：
点击查看摘要
Abstract:Retrieval can identify a past trajectory that may matter, yet it does not specify how an acting agent should use that trajectory after users, entities, constraints, or environment state have changed. We identify this post-retrieval reuse step as a distinct bottleneck for long-horizon trajectory memory and formulate an evaluation framework that holds candidate retrieval, target state, model, decoding, and tool budget fixed while varying the support delivered to the agent. We instantiate the framework with query-conditioned reuse (QCR), a deliberately simple target-bound note that records a reusable procedure, bindings to recover, applicability conditions, and verification requirements. QCR serves to test the reuse hypothesis rather than to claim a universally preferred memory format. Across 2,391 target instances in WebArena, WorkArena, and AppWorld, QCR reaches 62.3% average Success, 10.7 points above Full Trajectory, while using 48.9% fewer online tokens. Summary reranking selects a reusable memory for 94.8% of targets, placing end-task Success within 1.8 points of an oracle reusable selector. Analyses by trajectory length and source--target binding shift show that direct trajectory injection loses much of its utility as traces grow longer or source-specific values change, whereas target-bound support preserves a larger share of the measured gain. The resulting framework separates retrieval quality from the problem of turning retrieved experience into safe, useful support for a new task.
49. 【2608.12841】AQuA: Recursively Self-Improving Quantitative Trading Research Agents
链接：https://arxiv.org/abs/2608.12841
作者：Jiacheng Guo,Suozhi Huang,Yunlong Gao,Zihao Li,Jian Ge,Xu Kuang,Mengdi Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：earlier experiments, experiments to improve, improve the hypotheses, study recursive self-improvement, candidates proposed
备注：
点击查看摘要
Abstract:We study recursive self-improvement at the level of quantitative-investment research: whether an autonomous system can use evidence from earlier experiments to improve the hypotheses and candidates proposed in later iterations. We present AQuA, which comprises two separate language-model-driven research systems: one for symbolic factor discovery and one for trainable model development. The two systems do not share agents, memories, candidate spaces, or research state. Instead, each independently closes its own research loop by retaining validated evidence and using it to guide subsequent proposals. In this bounded sense, both systems implement recursive self-improvement at the level of the research process. Each system also uses its own sealed sandbox, which fixes the data splits, feature and label definitions, and evaluator while allowing the model to act only through constrained factor expressions or configuration diffs. The factor system, a manager-mediated multi-agent pipeline, discovers and combines factors into a signal that reaches a combined information coefficient of about $0.190$ on a crypto universe. The model system, a config-driven loop over a hybrid time-series architecture, reaches a per-stock information coefficient of $+0.0843$ on US equities and converts it into a threshold long/short strategy with a held-out Sharpe of up to $+2.50$ at a two-leg cost. The strategy is positive in every year from 2021 to 2025.
50. 【2608.12836】From Atomic Evidence to Logical Composition: Structured Compositional Reasoning over Compound Answer Options
链接：https://arxiv.org/abs/2608.12836
作者：Obed Junias,Maria Leonor Pacheco
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, explicit logical operators, individual atoms correctly, Large language, require combining atomic
备注： 21 pages, 6 figures, 10 tables
点击查看摘要
Abstract:Large language models often fail when answer options require combining atomic judgments under explicit logical operators, even when they judge the individual atoms correctly. We study compound options connected by AND, OR, and NEITHER/NOR, introducing a framework that decomposes each option into atomic answers and scores contrastive hypotheses about each one, so the model never sees a compound option. An operator-constrained integer linear program then composes the calibrated scores into a single prediction. We evaluate on LOGICAL-COMMONSENSEQA and introduce LOGICAL-SATA, a reading-comprehension benchmark derived from SATA-Bench. Our framework improves Macro-F1 from 48.3 to 77.0 on the human-validated LOGICAL-COMMONSENSEQA split and from 47.0 to 75.6 on LOGICAL-SATA, with the largest gains on NEITHER/NOR.
51. 【2608.12814】FastThaiG2P: Lightning-fast Thai Grapheme-to-phoneme Conversion for Voice Agent Pipelines
链接：https://arxiv.org/abs/2608.12814
作者：Charin Polpanumas
类目：Computation and Language (cs.CL)
关键词：International Phonetic Alphabet, common Central Thai, International Phonetic, Phonetic Alphabet, Central Thai speech
备注：
点击查看摘要
Abstract:FastThaiG2P provides sub-millisecond Thai grapheme-to-phoneme conversion for text-to-speech pipelines (International Phonetic Alphabet and Kokoro-TTS conventions) using a PyThaiNLP-tokenized, extensible dictionary and normalization rules for common Central Thai speech. The approach achieves an average latency of 0.15 ms per utterance on a benchmark of 27,242 synthetically generated utterances, of which 30\% is spent on tokenization, 12\% on normalization, and 58\% on out-of-vocabulary fallbacks (0.5\% OOV rate). To demonstrate its effectiveness, we used FastThaiG2P to phonemize Som-TTS, an open dataset containing 20 hours of grapheme-and-audio pairs, then trained an 82M-parameter StyleTTS 2 model based on a Kokoro-TTS recipe. The resulting model vocalizes intelligible Thai speech suitable for prototyping and development at 0.25 real-time factor (4x real-time) with ONNX inference on CPU.
52. 【2608.12779】CRAFT: LLM-Based Iterative Refinement for Temporal Reasoning over Clinical Narratives
链接：https://arxiv.org/abs/2608.12779
作者：Chengyang He,Tahreem Arif,Marko Zivkovic,Lijing Wang,Yue Ning,Ping Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：safety surveillance, disease monitoring, causality assessment, critical for disease, clinical narratives
备注：
点击查看摘要
Abstract:Understanding the temporal progression of symptoms in clinical narratives is critical for disease monitoring, safety surveillance, and causality assessment. Clinical narratives, however, rarely provide explicit temporal anchors. Current approaches to temporal information reasoning focus predominantly on pairwise relation classification across multi-visit and timestamp-rich records, leaving the reconstruction of structured symptom trajectories from individual anchor-sparse reports largely unaddressed. We propose CRAFT, an LLM framework that pairs a generator with a constraint-based verifier to iteratively produce and refine stage-wise symptom timelines through targeted feedback. We conduct evaluation on MedTempo, a new benchmark of 5,347 vaccine adverse-event narratives spanning three COVID-19 vaccine types, with expert-validated temporal stage annotations for 3,166 reports. Experiments across four LLM backbones demonstrate that CRAFT consistently improves temporal ordering accuracy, with ablation analysis isolating the contribution of generator and verifier components across model capability levels.
53. 【2608.12776】ViTOED: A Dataset for Target-Oriented Emotion Detection on Vietnamese Social Media Texts
链接：https://arxiv.org/abs/2608.12776
作者：Chanh Vo,Son T. Luu,Ngan Luu-Thuy Nguyen
类目：Computation and Language (cs.CL)
关键词：social media texts, Vietnamese social media, paper introduces ViTOED, media texts, target-oriented emotion detection
备注： Accepted for publication at 2026 International Conference on Multimedia Analysis and Pattern Recognition (MAPR 2026)
点击查看摘要
Abstract:This paper introduces ViTOED, a novel dataset for target-oriented emotion detection in Vietnamese social media texts. The ViTOED comprises 10,985 user comments and 21,244 manually annotated opinion quadruples (source, target, expression, polarity) that follow strict guidelines. The dataset reveals Vietnamese-specific phenomena, such as implicit sources and targets and vocabulary ambiguities, enabling deeper analysis of user emotions toward entities. We propose a baseline using structured sentiment graphs and evaluate various Vietnamese pre-trained language models. The empirical results highlight challenges in span detection and relation extraction and indicate substantial room for model improvement in Vietnamese Target-Oriented Emotion Detection tasks.
54. 【2608.12756】ReconSpan: Reconstruction-Guided Adaptive Latent Tokenization
链接：https://arxiv.org/abs/2608.12756
作者：Lixing Li
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Adaptive latent tokenization, latent tokenization maps, Adaptive latent, input-dependent spans, tokenization maps
备注： 16 pages, 3 figures
点击查看摘要
Abstract:Adaptive latent tokenization maps a fine-grained input to a shorter sequence of continuous representations associated with input-dependent spans. We introduce ReconSpan, which divides text into chunks that a backward decoder can reconstruct from a single contextual prefix code and retains one such code as the latent token for each chunk. The reconstruction criterion is applied when chunks are formed, allowing one trained autoencoder to produce average chunk lengths from 6.5 to 12.2. At matched average length, reconstruction-guided boundaries preserve more text than random boundaries. Readers of the resulting latent sequence recover topic information reliably but struggle to extract exact details.
55. 【2608.12750】PatientAct: Theory-Grounded Mental Health Client Simulation
链接：https://arxiv.org/abs/2608.12750
作者：Sahand Sabour,TszYam NG,Yaqian Chen,Guanqun Bi,Jialu Zhao,Minlie Huang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：train novice counselors, LLM-based simulated clients, evaluate LLM therapists, LLM-based simulated, novice counselors
备注： Under Review
点击查看摘要
Abstract:LLM-based simulated clients are increasingly used to train novice counselors, evaluate LLM therapists, and generate synthetic data. However, current simulators produce overly cooperative clients that disclose too readily, accept therapeutic reframes without resistance, and resolve core issues within a single session. We trace these issues to profiles that lack causal depth and behavioral mechanisms that treat all content as equally accessible. We present PatientAct, a framework for client simulation grounded in established clinical theories. Our profiles integrate the 5Ps clinical case formulation, providing causal depth without tying the design to any single therapeutic modality. During simulation, profiles include a dynamic memory layer in which items carry trust thresholds (e.g., symptoms are available early, whereas formative memories require a sustained therapeutic alliance). At each turn, the client's emotional reaction and behavior are modeled before generating a response. If the therapist approaches gated content, PatientAct expresses resistance in terms of quantity, content, and style rather than defaulting to cooperation or a single resistance pattern. We evaluate our framework on 40 clinical situations and demonstrate that it generates diverse profiles with high clinical plausibility. Moreover, PatientAct significantly outperforms the baselines, yielding substantial gains in resistance quality and behavioral realism. Our code and data will be publicly available via this http URL.
56. 【2608.12746】Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors
链接：https://arxiv.org/abs/2608.12746
作者：LingKai Bu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：co-occurrence bias outweigh, corpus co-occurrence bias, multimodal large language, individual object mention, large language models
备注：
点击查看摘要
Abstract:Object hallucination in multimodal large language models arises when language priors and corpus co-occurrence bias outweigh the visual evidence, with nothing tying an individual object mention to what the image shows. Most remedies intervene at decoding time without training, yet under a unified protocol their benefit is confined to short captions;supervised fine-tuning (SFT) on a detail- rich corpus lengthens captions, but over forty percent still name absent objects. This paper proposes Dual-Stream Cross-Anchor Correction (DSCC). Unlike work that post-processes decoding, DSCC is the first to inject object-level visual anchors into the language model itself during fine- tuning: a perception stream aligns object-level hidden states at an intermediate layer to frozen text anchors by a bidirectional contrastive objective; a cognition stream lets deeper layers query those anchors by cross-attention at every generation step; and a two-stage curriculum gate couplesthem, making evidence retrieval a structural constraint at each autoregressive step. Under one backbone and one scoring protocol, experiments span long-caption hallucination, object-existence discrimination and cross-domain generalisation, with vanilla SFT on the same corpus and schedule as a length- and density-matched control, so gains are attributed layer by layer. DSCC is the only method reaching the long-caption, low-hallucination region: captions roughly 1.9 times the baseline length at 88.19% precision per object mention, the highest under a density-independent criterion. Ablations expose a synergy: the perception stream alone degrades precision yet reverses sign when stacked on the cognition stream. No universal superiority is claimed: three out-of- domain benchmarks yield a predictable, falsifiable domain-conditionality, the synergy being bound to the anchors' semantic domain and breaking on charts and optical illusions.
57. 【2608.12720】ERSkill: Evolving for Skill-Guided Adaptive Memory Retrieval
链接：https://arxiv.org/abs/2608.12720
作者：Haolong Chen,Liang Zhang,Zhuo Li,Lei Xue,Guanrxu Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Model, Language Model, Large Language, agents increasingly rely, evolvable components
备注：
点击查看摘要
Abstract:While Large Language Model (LLM) agents increasingly rely on long-term memory for persistent interactions, the retrieval mechanisms governing this memory are rarely treated as evolvable components. This static approach limits performance on heterogeneous memory queries, which often demand diverse evidence construction strategies. To address this, we introduce \textbf{ERSkill}, a retrieval-centric framework for self-evolving, skill-guided memory access. ERSkill compiles interaction histories into a structured memory store and represents retrieval behaviors as executable skills composed of fundamental primitives. At inference time, a trained router dynamically matches each query to the optimal skill to construct tailored evidence for answer generation. To enable continuous improvement, ERSkill co-evolves the skill set and the router during training. It employs an experience trie to efficiently record explored retrieval paths, alongside a double-frontier mechanism that safely decouples the expansion of new skill capabilities from stable, router-facing deployment. Experiments across multiple agent memory benchmarks demonstrate that ERSkill substantially outperforms strong non-evolving and self-evolving baselines. Notably, it improves the overall average across F1, BLEU-1, and LLM-judge scores by 31.3\% with Qwen3-Next-80B-A3B-Instruct and by 28.1\% with GPT-5.4-nano.
58. 【2608.12717】Perturbation-based Regional Interpretability through Subtraction Mapping (PRISM): naming-error dissociations in language models and post-stroke aphasia
链接：https://arxiv.org/abs/2608.12717
作者：Xiang Guan,Roger D. Newman-Norlund,Yong Yang,Saeed Ahmadi,Regan Willis,Nadra Salman,Kalil Warren,Srihari Nelakuditi,Chris Rorden,Leonardo Bonilha,Julius Fridriksson
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：distinct cognitive operations, Mechanistic interpretability, Perturbation-based Regional Interpretability, large language models, models lacks spatially
备注： 49 pages, 6 figures, 1 table. Supplementary methods, 6 tables and 5 figures included
点击查看摘要
Abstract:Mechanistic interpretability of large language models lacks spatially resolved, falsifiable tools for testing whether internal components are specialized for distinct cognitive operations. We adapt subtraction analysis, the standard framework of human neuroimaging, from biological brains to perturbed transformers, and apply the same logic to both substrates in parallel. Building on the Brain-LLM Unified Model (BLUM), which showed that layer-perturbed LLaVA-1.6-Vicuna-13B error profiles match the lesion patterns of aphasic patients, we develop PRISM (Perturbation-based Regional Interpretability through Subtraction Mapping). PRISM maps the seven clinical Philadelphia Naming Test categories, subtracts error classes pairwise, and treats each perturbation seed as a subject in a group analysis with threshold-free cluster enhancement along the layer axis. We run a structurally matched analysis on 213 chronic post-stroke aphasia patients using correlation-difference lesion-symptom mapping, and replicate both sides on held-out splits. The designs match in subject dimension (seeds, patients), spatial dimension (layers, atlas-parcellated cortex) and thresholding, but the contrast operator differs: a within-subject error-proportion difference for the LLM, a between-subject correlation difference for the cortex. Both substrates recover a robust phonemic-favoring dissociation, a deep layer cluster and a frontal-perisylvian cortical cluster, both replicating; the semantic-favoring direction is a consistently signed but non-significant trend on both. PRISM thus gives a falsifiable, spatially resolved test of functional-specialization claims in transformer language models. A confirmatory ROI-level intervention (PRISM Stage 3) licensing the strongest causal-mechanism claim is left to subsequent work.
59. 【2608.12713】racing Provenance and Detecting Tampering with Complementary LLM Watermarks
链接：https://arxiv.org/abs/2608.12713
作者：Xiaoyan Feng,Yanjun Zhang,He Zhang,Leo Yu Zhang,Shirui Pan
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Watermarking LLM-generated text, Watermarking LLM-generated, important task, task for tracing, Existing LLM watermarks
备注： 11 pages, 7 figures, 4 tables
点击查看摘要
Abstract:Watermarking LLM-generated text is an important task for tracing its provenance. Existing LLM watermarks preserve provenance under editing, but this same robustness allows an adversary to alter critical content while retaining attribution, a vulnerability known as piggyback spoofing. We introduce an innovative watermark that jointly provides provenance and tamper evidence. It co-embeds a robust signal and a fragile signal into each generated token. The signals share the same mechanism but use independent keys and different seeding windows over normalized text, making one resilient to edits and the other sensitive to reader-visible changes. Multiple rounds of unbiased tournament reweighting preserve the expected generation distribution, while a periodic round-allocation pattern controls the trade-off between the two signals. At detection, their scores form a two-dimensional space supporting three decisions: Intact, Tampered, and No-Watermark. Across two large language models and two prompt datasets, our method demonstrates the highest tamper-detection rate among the evaluated methods while maintaining competitive attribution robustness and perplexity. Ablation studies show that reliable three-state detection requires a well-defined notion of intactness, co-embedding of the two signals, and complementary sensitivity to edits.
60. 【2608.12654】SteerBench-Work: A Benchmark for Agent Steering at Action Boundaries
链接：https://arxiv.org/abs/2608.12654
作者：Oguz Serdar,Cuneyt Mertayak
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Long-running LLM agents, LLM agents act, Long-running LLM, LLM agents, act through tools
备注：
点击查看摘要
Abstract:Long-running LLM agents act through tools, and a single step can send an email, merge a pull request, or wire a payment. The steering decision is the pre-commit choice at that boundary: proceed, or hold for human or policy review. We introduce SteerBench-Work, an incident-anchored, bidirectional benchmark for that decision in workplace agents across developer operations, customer service, finance, legal, medical, HR, and security. Release v2026-05 contains 106 scenarios anchored in public incidents, paired evidence-reversed mirrors, and calibration controls, with labels split nearly evenly between proceed and hold so the two error directions get near-identical numbers of chances. A model sees the proposed action and the available evidence, returns a gate decision, and is scored on whether it crosses or holds the boundary correctly. Across 30 model conditions the failures run almost entirely in one direction: models wrongly hold authorized, evidence-cleared work on 28.1% of opportunities and wrongly allow unsafe work on 1.0%. The hardest cases are risk-resolved commits, where signed or structured evidence has already cleared a real risk trigger, and models score markedly worse on evidence-reversed mirrors of famous incidents (63.8%) than on the incidents themselves (98.5%). General capability is not the same as steering calibration: higher-capability models often over-refuse at the commit boundary, and more reasoning can repair a weak gate while leaving a calibrated one flat. The public leaderboard is at this http URL.
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2608.12654 [cs.AI]
(or
arXiv:2608.12654v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.12654
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
61. 【2608.12652】Excess Separability: Nuisance-Controlled Residual-Stream Probing for Benchmark Contamination Detection
链接：https://arxiv.org/abs/2608.12652
作者：Florian Braun
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：likelihood-based membership inference, Benchmark contamination, well-chosen test statistic, n-gram overlap, membership inference
备注： 22 pages, 11 figures, 7 tables. Code and artefacts: [this https URL](https://github.com/mabushi-lab/residual-stream-contamination-probing)
点击查看摘要
Abstract:Benchmark contamination is diagnosed today with n-gram overlap, with likelihood-based membership inference, or with canary strings, and each needs something usually unavailable: the training corpus, a well-chosen test statistic, or foresight at dataset release. A recent alternative reads contamination off a linear probe on internal activations. We show that the natural way to do this does not work, and specify one that survives measurement. The protocol reports a zero-sum contrast on the depth profile of probe accuracy, recentred on a level-matched placebo baseline, tested against a label-permutation null, with the reference set twice the size of the suspect set. Each choice replaces a simpler alternative we measured and rejected. Reporting the level of excess separability rather than its shape makes the false positive rate track the size of the analyst's own control set, from 0.03 to 0.99 under a true null. Contrasting against a flat depth profile fails in both directions, rejecting a true null 0.72 of the time when surface decodability rises with depth and losing all power when it falls. An item bootstrap holds the fitted probe fixed and rejects up to 0.09 of the time where a permutation null that refits it holds 0.02. A half-size baseline triples the error rate. On real transformers, baseline depth profiles are measurably not flat, spanning up to 29.1 accuracy points on a temporal split, and their non-flatness tracks the surface difference between the item sets (correlation 0.87 over 6 audits), so the correction is largest exactly where it is needed. All 4 well-matched Pile arms return null, and the protocol refuses a verdict on the temporal split rather than reporting one. What this does not establish is whether transformers carry a familiarity direction at all: the only positive sits on the split where exchangeability fails. Implementation, tests and audits are released.
Comments:
22 pages, 11 figures, 7 tables. Code and artefacts: this https URL
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
ACMclasses:
I.2.7
Cite as:
arXiv:2608.12652 [cs.CL]
(or
arXiv:2608.12652v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.12652
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
62. 【2608.12630】Novels generated by language models show compressed formal variation
链接：https://arxiv.org/abs/2608.12630
作者：Mehdy Sedaghat Payam,Justin Quinn
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：British realist style, large language models, nineteenth-century British realist, twenty novels generated, large language
备注：
点击查看摘要
Abstract:While large language models can generate entire novels, there is little information about the level of formal variation in their output over many generations. Rather than asking whether individual passages can be identified as AI-generated, this study asks whether repeated AI generation can produce the same range of diversity which is found across human corpora. This paper contrasts six corpora based on generation source and target style: twenty novels generated using GPT-5.5 Thinking in a nineteenth-century British realist style, twenty novels generated using Qwen3-14B in a nineteenth-century British realist style, twenty novels generated using each of these models in a contemporary zero style, 205 nineteenth-century human-written British novels, and sixty-five contemporary human-written Zero-Style novels. At the document level, the research includes MATTR-500, Shannon entropy, average sentence length, readability, and punctuation rate measurements. The most robust and reliable result is compression of sentence structure. Repeated generations produce novels that vary far less from one another in sentence structure than human novels do. Compression is also present in the measures of readability, punctuation, and sentence length variability within novels. Lexical measures tend to be similarly compressed, with the exception of Qwen Zero-Style MATTR. Despite having distinct mean stylistic profiles, GPT and Qwen lack a stable pattern of cross-measure correlation. This article therefore distinguishes between variance overclosure, which represents a limited formal range between novels, and a more specific phenomenon of correlational overclosure. This means that an individual AI-generated novel may resemble human fiction stylistically, while a collection of AI-generated novels occupies a much narrower formal range.
63. 【2608.12627】EgoCITE: Context-Augmented Indexing and Time-Aware Retrieval for Long-Horizon Egocentric Memory
链接：https://arxiv.org/abs/2608.12627
作者：Le Zhang,Ke Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：transforms continuous first-person, continuous first-person video, memory transforms continuous, Egocentric Context-augmented Indexing, past experiences
备注：
点击查看摘要
Abstract:Long-horizon egocentric memory transforms continuous first-person video and audio into a searchable record of past experiences. We demonstrate two bottlenecks in existing systems: indices built from context-poor captions are unreliable for agentic search, while retrieval ignores a question's temporal intent. To address both bottlenecks, we introduce EgoCITE (Egocentric Context-augmented Indexing and Time-aware Evidence retrieval), a long-horizon agentic memory framework for egocentric QA. EgoCITE comprises three components. EgoScheme uses local multimodal context to turn fragmentary video captions and speech transcripts into self-contained atomic memory indices. EgoIndex organizes complementary action, activity, utterance, and conversation representations into searchable multi-view memory indices at multiple granularities. EgoRetrv combines semantic search with question-conditioned temporal relevance scoring and curation of retrieved evidence. We evaluate EgoCITE on EgoLifeQA, EgoMem, and EgoR1-Bench in terms of answer accuracy and target-event retrieval alignment. EgoCITE improves accuracy over agentic memory baselines by at least 4.4--14.2\% while achieving 36$\times$ lower cost than long-context LLM agents.
64. 【2608.12626】LLMs Are Not Good Strategists, Yet Memory-Enhanced Agency Boosts Reasoning
链接：https://arxiv.org/abs/2608.12626
作者：Yi Wu,Zhimin Hu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：Large Language Models, Large Language, Language Models, inconsistent subgoals, limited by inconsistent
备注：
点击查看摘要
Abstract:Strategic reasoning in Large Language Models (LLMs) within long-horizon environments is often limited by inconsistent subgoals. In these settings, finite attention resources prevent the model from maintaining strategic coherence over thousands of steps. This limitation leads to strategic drift, where localized decisions fail to sustain a coherent trajectory across reasoning. To address this, we introduce EpicStar, a framework that enables agents to learn memory as policy to tackle long-horizon reasoning. Specifically, the agent maintains a bank of successful past episodes as a heuristic alongside a working memory to track short-term environmental changes. During inference, a dynamic gating mechanism determines whether to execute a retrieved action directly or to perform new reasoning through a contextual fusion of the retrieved episodes and current working memory. Utilizing StarCraft II as the testbed, we evaluated EpicStar against diverse opponent styles. It significantly outperforms baseline methods, achieving higher win rates while consuming an order of magnitude fewer tokens, and it maintains this advantage consistently across difficulty levels and opponent strategies. Our findings provide compelling evidence that structured cross-episode memory is essential for enabling LLM agents to perform robust, long-term strategic execution in dynamic, autonomous settings.
65. 【2608.12623】When Explanations Betray Backdoors: Black-Box Auditing for Language Model Classifiers
链接：https://arxiv.org/abs/2608.12623
作者：Yang Liu,Ran Zou
类目：Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：Language model classifiers, Language model, topic triage, low-resource annotation, Groundedness Drift
备注： 16 pages, 1 figure
点击查看摘要
Abstract:Language model classifiers with explanations are used for moderation, routing, topic triage, and low-resource annotation. We study black-box auditing when the defender has only clean calibration data without trigger information but can ask the classifier for a label plus a short rationale or quoted evidence. We introduce Groundedness Drift, a lightweight score measuring whether the answer summary remains grounded in the input. Across two 7B backbones, five datasets, and four common non-adaptive OpenBackdoor-style attack families, Groundedness Drift achieves higher AUROC and lower residual target ASR than every compared detector in all cases at a nominal 5\% clean-FPR budget. We then evaluate Unsupported Groundedness, a multi-probe escalation for explanation-camouflage stress cases. Unsupported Groundedness improves signals but does not close the adaptive gap.
66. 【2608.12598】Intensional Anaphora
链接：https://arxiv.org/abs/2608.12598
作者：Ezra Keshet,Steven Abney
类目：Computation and Language (cs.CL)
关键词：treated as quantifiers, determiners as quantifiers, treatment of determiners, quantifiers, eating a cheeseburger
备注： 49 pages. Published in Semantics and Pragmatics
点击查看摘要
Abstract:Intensional operators are often treated as quantifiers over possible worlds, parallel to the treatment of determiners as quantifiers over individuals. Yet individuals introduced in intensional contexts cannot serve as antecedents to later pronouns as easily as those introduced in merely quantificational contexts. For instance, "Everyone is eating a cheeseburger" may be followed by "They are large", where "they" refers to the cheeseburgers being eaten. However, as Stone (1999) points out, the similar "Andrea might be eating a cheeseburger" does not support later anaphoric references such as "It is large" or "They are large". Stone (1999), Stone and Hardt (1999), and Brasoveanu (2010) address this by requiring a pronoun's value (its referents) to exist in the world of evaluation, ruling out anaphora from non-veridical intensional contexts. We show, however, both cases where such anaphora is disallowed even when the pronoun's referents clearly exist and cases where it is allowed even though they might not exist. We argue that intensional anaphora is best captured using a description-based rather than value-based account. A pronoun presupposes that its corresponding antecedent description is instantiated in each world of the context set. Thus, there must be a cheeseburger being eaten by Andrea in every candidate world for "It is large" to be felicitous after "Andrea might be eating a cheeseburger". We implement our proposal via a new logic, building on Keshet (2018) and Abney and Keshet (2022), called Plural Intensional Presuppositional predicate calculus (PIP). Each PIP formula translates directly into standard first-order predicate calculus with set abstraction, providing a classical foundation for this work.
67. 【2608.12571】Is this Citation on Point?
链接：https://arxiv.org/abs/2608.12571
作者：Apurv Verma
类目：Digital Libraries (cs.DL); Computation and Language (cs.CL)
关键词：York judge sanctioned, York judge, attorneys in Mata, judge sanctioned, sanctioned two attorneys
备注： Accepted to the 1st Workshop on AI for Law at ICML 2026
点击查看摘要
Abstract:In 2023, a New York judge sanctioned two attorneys in Mata v. Avianca for filing a brief with hallucinated citations generated by ChatGPT. Such failures are largely caught by database lookups; the harder problem is detecting citations that point to real cases but do not support the propositions for which they are offered -- a failure mode that existing evaluations of LLMs for legal use cases largely overlook. In this paper, we study proposition-level citation support verification through controlled perturbations of real legal citations obtained from two legal corpora, either replacing the cited case or changing only the pinpoint page within the same case. We evaluate fourteen model configurations on the resulting examples. Models catch 93-100% of wrong-case corruptions. They catch only 37-61% of wrong-pinpoint corruptions on court opinions and 52-83% on legal briefs. When models fail to catch wrong-pinpoint corruptions, they accept the citation based on topical overlap rather than page-level support. Scale and extended reasoning narrow the gap but do not close it: GPT-5.4 with high reasoning effort still misses 40% of pinpoint mismatches on court opinions and 18% on briefs. Prompting the model to verify support at the cited page improves recall, but it also raises the false positive rate. Recognizing the right legal topic and verifying support for the cited proposition are distinct capabilities, and current models conflate them.
68. 【2608.12511】SoK: From Generation to Consumption of Privacy Documents in Software Systems
链接：https://arxiv.org/abs/2608.12511
作者：Shidong Pan,Clark LaChance,Zhen Tao,Sepideh Ghanavati
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：seek user consent, digital services disclose, Privacy documents, privacy policies, disclose data practices
备注： This SoK paper has been accepted by NDSS 2027
点击查看摘要
Abstract:Privacy documents (e.g., privacy policies) are a central mechanism through which digital services disclose data practices and seek user consent. Over the past decades, research on privacy documents has expanded significantly, encompassing not only traditional privacy policies but also short notices (e.g., privacy labels) and interface-level transparency mechanisms. As this research area continues to grow, it has become increasingly difficult to obtain a coherent view of how privacy documents are created, analyzed, evaluated, and maintained across their lifecycle. This SoK provides a unified, lifecycle-oriented view of privacy documents from a software engineering perspective. We systematically review and analyze 290 papers published between 2010 and 2025, organizing them around five research questions that examine how privacy documents are (1) defined and scoped, (2) generated, (3) analyzed and extracted, (4) checked for inconsistencies and noncompliance, and (5) evaluated and improved for usability. Building on our findings, we identify 15 key research trends and 21 open opportunities. We further chart four broader research directions that highlight (i) emerging challenges in AI-centric platforms, (ii) the need for diverse and up-to-date data foundations, (iii) LLM-based unified policy-code analysis, and (iv) dual usability for end-users and developers. We hope this SoK provides a shared foundation for future research on privacy policies and privacy documents.
69. 【2608.12486】DIVE: Unlocking Self-Improvement in Frozen Language Models Through Diversity-Driven Skill Evolution
链接：https://arxiv.org/abs/2608.12486
作者：Siheng Xiong,Ali Payani,Oguzhan Gungordu,Faramarz Fekri
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, retain post-deployment experience, parameter updates, retain post-deployment
备注：
点击查看摘要
Abstract:Large language models (LLMs) cannot retain post-deployment experience without parameter updates. We introduce DIVE, a diversity-driven framework that enables frozen LLMs to improve by evolving persistent natural-language skills from task experience and verifier feedback. These skills encode reusable reasoning procedures, verification strategies, common failure modes, and output constraints and are both executed and revised by the same underlying model without access to a teacher model. Since natural-language skill evolution is a stochastic, non-convex search process, optimizing a single skill trajectory can overfit to sampled experience or converge to a suboptimal solution. DIVE mitigates this optimization variance by independently evolving multiple skill populations from bootstrapped experience, adaptively refining them through diverse transformations, and jointly selecting a complementary set of skills. Across six mathematical and logical reasoning tasks and multiple model families, DIVE consistently outperforms existing reasoning methods, prompt-optimization approaches, skill-development frameworks, and memory-based baselines. It achieves rapid self-improvement from accumulated experience, obtaining substantially larger performance gains with fewer rollouts than parameter-based methods such as SFT and GRPO, and prompt optimization with GEPA. Further, the resulting skills transfer across model scales and families, enabling smaller models such as GPT-5-nano to match or outperform larger counterparts, i.e., GPT-5, under conventional prompting. These results establish diversity-driven skill evolution as an effective, interpretable, and parameter-free approach to LLM self-improvement.
70. 【2608.12447】Geometric and Behavioral Stratification in Transformer Residual Streams
链接：https://arxiv.org/abs/2608.12447
作者：Nelson Guda
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Trained transformer models, Trained transformer, transformer models develop, models develop privileged, develop privileged bases
备注： 63 pages, 10 figures, 15 tables. Code and data: [this https URL](https://github.com/nelsonguda/pdsf-residual-geometry)
点击查看摘要
Abstract:Trained transformer models develop privileged bases: coordinate axes whose statistics differ from the rest of the residual stream. But what kind of direction does such a basis select? We investigate the prediction direction, the unembedding direction of the token a model currently predicts, and find that it functions as a content-defined privileged anchor. Measured with respect to this anchor, residual-stream variation is geometrically and behaviorally stratified by proximity to the prediction. The stratification holds in all eighteen models tested (dense and mixture-of-experts, 7B-120B, base and instruction-tuned). A narrow, scale-invariant prediction interface concentrates readout-relevant structure, while the vast prediction-distal complement expands with model scale. Because the prediction direction sits nearly orthogonal to the principal variance axes, variance-based analyses recover this organization only partly, and the shortfall grows with prompt heterogeneity. Anchoring reveals a steep geometric gradient: prediction-proximal regions are highly structured and cluster related prompts, while the complement is flatter and anti-discriminates among prompt groups. The interface is a narrow slice but functionally decisive. Disrupting the variance directions closest to the prediction causes immediate divergence and frequent task-frame shifts; disrupting the next level down delays divergence and preserves framing. The complement is weakly readout-aligned per direction yet causally and temporally load-bearing, and behavior is driven by direction rather than magnitude. These results establish the prediction direction as a privileged anchor distinct from previously described coordinate axes, and give a geometric account of how high-dimensional computation coexists with linear readout.
Comments:
63 pages, 10 figures, 15 tables. Code and data: this https URL
Subjects:
Machine Learning (cs.LG); Computation and Language (cs.CL)
MSC classes:
I.2.6, I.2.7
Cite as:
arXiv:2608.12447 [cs.LG]
(or
arXiv:2608.12447v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2608.12447
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Nelson Guda [view email] [v1]
Wed, 12 Aug 2026 17:42:20 UTC (15,979 KB)
71. 【2608.12426】Large Language Models Can Follow Instructions, But Not Many at Once: Phase Transitions in Compositional Constraint Satisfaction
链接：https://arxiv.org/abs/2608.12426
作者：Mariya I. Vasileva
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, require simultaneous adherence, multiple explicit constraints, reasoning structure
备注： 35 pages, 7 figures, 13 tables. Reviewed in the ARR May 2026 cycle
点击查看摘要
Abstract:Large language models are increasingly deployed in settings that require simultaneous adherence to multiple explicit constraints - reasoning structure, safety boundaries, output schemas. Individual constraints are handled proficiently, but the compositional regime, where many must hold jointly, remains poorly characterized: how rapidly does performance degrade, what governs the degradation, and can the collapse be mitigated? We introduce Constraint Saturation Evaluation (CSE), a procedurally generated benchmark that systematically varies the number of simultaneous constraints (k), with every constraint scored by a deterministic, rule-based verifier and zero LLM-judge involvement: 15 models, 36 constraint types, 369,753 checks at k=1-12. Three findings emerge. First, per-constraint pass rate decays gradually and predictably, while the chance of satisfying all k constraints collapses - a model passing individual constraints at ~41% at k=8 succeeds on all eight just 5.7% of the time. Second, constraints do not degrade equally: structural constraints lose 2x more baseline capability per added constraint than lexical ones, ordered by a comprehension-maintenance gap that separates constraints requiring sustained tracking from binary decisions immune to composition. Third, failures are nearly independent, which is what makes the accumulation multiplicative; the residual coupling that does exist tracks shared output features rather than pairwise interference - a wrong sentence count fails every constraint that reads it. Reliable instruction following breaks down beyond 5-6 simultaneous constraints: probe-level success falls below 50% at 7 constraints for the strongest model, and at 3 or fewer for 12 of 15.
72. 【2608.12391】Unified Multi-Dimensional Benchmark for Complex Graph Reasoning in Large Language Models
链接：https://arxiv.org/abs/2608.12391
作者：Fali Wang,Ali Al-Lawati,Iliyas Bektas,Jinxuan Fang,Alek Melenski,Tianxiang Zhao,Yao Ma,Suhang Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：textit, large language models, structurally controlled, Graph, programmatically generated
备注： Under review
点击查看摘要
Abstract:Graph reasoning provides a promising testbed for evaluating the reasoning ability of large language models (LLMs), as graph instances can be programmatically generated, structurally controlled, and naturally scaled to long-input settings. However, existing graph reasoning benchmarks have limited coverage of data complexity, rely heavily on manual construction, and lack unified evaluation across text-based and code-based reasoning modes. To address these limitations, we propose {\dataset}, a five-stage \textit{semi-automatic} framework for constructing complex graph reasoning benchmarks. It expands benchmark coverage along five dimensions: \textit{Graph Size}, \textit{Task Complexity}, \textit{Task Description}, \textit{Graph Loading}, and \textit{Task Source}. The framework uses an LLM-based data generator to automatically produce task descriptions, graph data, reference solutions, graph-loading scripts, question forms, and evaluation scripts, while retaining human validation at key quality-control stages. Based on it, we construct a benchmark with $202$ tasks and evaluate LLMs under text-based, code-based, and augmented reasoning settings. Experiments show that the complexity dimensions reveal model limitations that are less visible in existing benchmarks; existing fine-tuned models struggle to generalize to GraphGym, whereas retrieval-augmented methods show scenario-dependent adaptability, improving textual reasoning but not consistently improving coding reasoning. These findings suggest that ours serves as a challenging and diagnostic benchmark for graph reasoning and provides empirical guidance for future enhancement methods. Code and dataset will be published soon.
73. 【2608.12387】Query Timing Produces Opposite Positional Biases Between LLMs and Humans
链接：https://arxiv.org/abs/2608.12387
作者：Jasin Cekinmez,Addison J. Wu,Thomas L. Griffiths
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：remains poorly understood, evaluations remains poorly, large language models, Positional biases, poorly understood
备注： Entropic Award (Top 3 Paper), ICBINB @ ICLR 2026
点击查看摘要
Abstract:Positional biases such as recency and primacy effects have been documented in large language models (LLMs), yet the underlying mechanism by which these models make their evaluations remains poorly understood. Both primacy and recency biases have been observed in human judgments in response to evidence, but recent work suggest that \emph{when} the listener updates their beliefs -- during the presentation of evidence or only at the end -- influences the presence of such effects. We investigate whether a similar phenomenon holds for LLMs, finding divergence from human behavior. These biases are more exacerbated in newer models compared to their predecessors.
74. 【2608.12374】Are you Talking Logic to Me? Assessing Language Models Syllogistic Reasoning Capabilities
链接：https://arxiv.org/abs/2608.12374
作者：Hanna Abi Akl,Fabien Gandon,Catherine Faron,Pierre Monnin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Knowledge Representation, Language models, struggle with logical, Common Logic Grammar, Logic Grammar Construction
备注： Accepted to the International Joint Conference on Rules and Reasoning (RuleML+RR) 2026
点击查看摘要
Abstract:Language models (LMs) struggle with logical tasks like reasoning on syllogisms. It has been shown that Knowledge Representation (KR) plays a crucial role in expressing input information to help models solve tasks. This observation motivates our study of the impact of different formal KR notations on syllogistic reasoning by extending the FOLIO and P-FOLIO datasets. Our experiments on Small Language Models (SLMs) in Supervised Fine-Tuning (SFT) and Zero-Shot (ZS) settings show that the choice of input notation can yield performances competitive with natural language while enabling faster inference. We also propose a syllogistic categorization method (SEF) and use it to enrich ZS prompts with logical definitions, which boost reasoning in small models. We open-source our framework, Common Logic Grammar Construction (CLGC), as the first Python library for automatically generating syllogisms in KR notations and defining their SEF categories.
75. 【2608.12361】New Terms, New Toxicity: Consensus-based Chinese Neologism Toxicity Detection via Search-Augmented LLMs
链接：https://arxiv.org/abs/2608.12361
作者：Shiyao Cui,QingLin Zhang,Di Wang,Yida Lu,Zhexin Zhang,Jinhua Gao,Jinglin Yang,Min He,Han Qiu,Minlie Huang
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：label targeting feminism, stigmatizing label targeting, country girl, emerging terms, meaning or form
备注： ACL 2026
点击查看摘要
Abstract:Neologisms, emerging terms in meaning or form, can serve as new vehicles for toxic expression, like "country girl" as a stigmatizing label targeting feminism. Such toxic neologisms appear benign but have evolved into toxic usage in public consensus, posing challenges to moderation systems and remaining underexplored. In this paper, we investigate how to detect implicit toxicity expressed via neologisms. We first propose a taxonomy that captures the origins and consensus-verification criteria of toxic neologisms, followed by the construction of a lexicon spanning widely observed risk categories. To capture toxicity grounded in public consensus, we introduce SeTox, a search-augmented framework that enables static large language models (LLMs) to incorporate real-time web context for neologism toxicity detection. Experiments show that SeTox, even with 3B-scale models, outperforms recent large-scale models, demonstrating its scalability to incorporate real-world knowledge for toxic neologism detection. Disclaimer: this paper has offensive contents that may be disturbing to some readers.
76. 【2608.12345】Diagnostic Foundation for Evaluating LLMs' Research Integrity as Co-Scientists
链接：https://arxiv.org/abs/2608.12345
作者：Yash Tripathi,Silu Sharma,Sai Sidhanth Manoharan Jayanthi,Shivank Garg,Lin Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：pressure remains unmeasured, institutional pressure remains, Language models, deployed as co-scientists, remains unmeasured
备注：
点击查看摘要
Abstract:Language models are increasingly deployed as co-scientists, yet their ability to uphold research integrity under institutional pressure remains unmeasured. We introduce IntegrityBench, a benchmark evaluating misconduct classification, ethical action reasoning and artifact-grounded decision making across 36 paired tasks under a 5-level implicit-explicit pressure protocol spanning 3 domains and 4 research stages. Evaluating 18 frontier model variants, we find that under peak pressure, models fail roughly 1 in 3 integrity-critical decisions, and neither scale nor reasoning ability reliably mitigates this. Explicit pressures induce compliance with misconduct, while implicit contextual reframing more often causes over-refusal of legitimate research tasks. Interestingly, models failing to classify research requests accurately perform equally or better on artifact-grounded decision making (85.7 vs. 79.4), suggesting the three facets are structurally dissociated and correct ethical action does not require accurate classification. Frontier models can thus appear helpful while harbouring integrity failures that create two distinct deployment risks: facilitating research misconduct and eroding trust in AI-assisted research.
77. 【2608.12344】Predicting consumer-technology ownership without a diffusion history
链接：https://arxiv.org/abs/2608.12344
作者：Irina Vartanova,Niels Selling,Jennifer Viberg Johansson,Pontus Strimling
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Applications (stat.AP)
关键词：Anthropic Claude Opus, consumer technology predict, predict how widely, Claude Opus, Anthropic Claude
备注： 31 pages, 4 figures, supplementary material included (Tables S1-S6, Figure S1), data and code at [this https URL](https://osf.io/dr5ct)
点击查看摘要
Abstract:We test whether the perceived attributes of a consumer technology predict how widely it is owned. In a 2022 Prolific survey of US adults (n = 678), respondents rated 65 consumer technologies on six attributes. We then elicited the same ratings from two frontier language models, Anthropic Claude Opus 4.7 and OpenAI GPT-5.5. We regress ownership prevalence on four UTAUT2 acceptance attributes plus a log-age covariate with a sign-constrained penalized regression and evaluate it by holding out one technology at a time. The attribute model improves on a baseline of years-since-launch: mean absolute error falls by 17% with the human ratings, and by more with either model, most with Opus 4.7. Over the short 2022-to-2025 window, where ownership moved little, the same attributes do not improve on a no-change baseline. We set out the limitations of the approach, including the possibility that language-model ratings reflect prior knowledge of these technologies rather than independent attribute reasoning. We include a deployment illustration: 2027 ownership predictions for eleven products launched in 2025 and 2026.
78. 【2608.12343】Large Language Models Pass the History Exam But Miss the History: A Polish High School Exit Exam Matura Benchmark
链接：https://arxiv.org/abs/2608.12343
作者：Adrian Trzoss,Kacper Dudzic,Wiktor Werner,Marcin Moskalewicz
类目：Computation and Language (cs.CL)
关键词：interpretative historical reasoning, rarely assess interpretative, assess interpretative historical, benchmarks rarely assess, historical reasoning
备注：
点击查看摘要
Abstract:AI chatbots are widely used by students as knowledge sources, yet LLM benchmarks rarely assess interpretative historical reasoning. We evaluate eight leading LLMs on the Polish high school exit exams (Matura) in history - three official papers from 2023-2025, comprising short-answer questions and extended essays - comparing model performance against the human examinee population. Every model dramatically outperforms human examinees, yet aggregate scores mask distinct competency profiles: rankings are unstable across task type, source modality, and geographical scope, with a consistent penalty on Polish versus Global history content. Qualitative error analysis reveals two recurring failure modes - source conflation, in which models reason from source content rather than treating it as an object of analysis, and temporal disorientation, in which responses are historically misplaced. This study introduces the first LLM history benchmark grounded in Polish national curriculum.
79. 【2608.12342】Are Large Language Models Reliable Reviewers? A Benchmark for Error Detection in Financial Documents
链接：https://arxiv.org/abs/2608.12342
作者：Ying He,Zhouhong Gu,Zhecheng Hu,Yubo Zhou,Hao Shen,Jiaqing Liang,Zhaoqian Dai,Shuguang Ma,Fei Yu,Yanghua Xiao,Zhixu Li
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Ensuring the accuracy, Large Language Models, regulatory compliance, textbf, economic analysis
备注：
点击查看摘要
Abstract:Ensuring the accuracy of financial documents is critical for economic analysis, regulatory compliance, and corporate decision-making. Several studies have shown that Large Language Models (LLMs) perform well in many financial tasks, such as stock price movements and financial analytics. However, a critical task remains unexplored: the ability of LLMs to identify errors in financial documents. In this paper, we introduce \textbf{FinED-Bench}, the first publicly \textbf{Bench}mark for \textbf{Fin}ancial \textbf{E}rror \textbf{D}etection across three levels of cognitive complexity. FinED-Bench covers nine real-world financial scenarios, and includes over 900 documents reported in 2025 that are unseen by existing language models. We detail the benchmark construction process and evaluate several advanced LLMs (e.g., GPT-4o, Qwen3-14B) on this tasks, which requires both financial domain knowledge and reasoning capabilities. Experimental results show that current LLMs still struggle with this task, especially in high-complexity cases. Besides, supervised fine-tuning can significantly improve the performance of weaker LLMs on this task. Our data and code are available at this https URL.
80. 【2608.12341】he "Knowledge-Behavior Gap" in Cultural Taboo Safety of Large Language Models
链接：https://arxiv.org/abs/2608.12341
作者：Ying He,Sihang Jiang,Xingzhou Chen,Zhouhong Gu,Yiwei Gu,Minggui He,Shimin Tao,Hongxia Ma,Yanghua Xiao
类目：Computation and Language (cs.CL)
关键词：deploying large language, culturally insensitive outputs, Cultural taboo safety, large language models, social harm
备注：
点击查看摘要
Abstract:Cultural taboo safety is essential for deploying large language models (LLMs), as culturally insensitive outputs may cause offense or even social harm. However, existing cultural benchmarks primarily assess cultural knowledge or values biases, while overlooking whether LLMs can recognize and respect cultural taboos, especially when taboos are implicitly hidden in seemingly harmless questions. Besides, cultural taboos are implicit, and context-dependent, thus poss unique challenges for reliable evaluation. To address these gaps, we introduce \textbf{CulShield}, the first public benchmark dedicated to evaluating and improving the cultural taboo safety of LLMs. CulShield spans 77 countries and territories, and includes over 2,020 taboos. It evaluates models along both explicit knowledge and implicit behaviors. Experiments on several advanced LLMs (e.g., GPT-4o-mini, Gemini-2.5-pro) reveal a clear ``knowledge-behavior gap'': models often fail to apply known taboos during interaction. We further show that variations in linguistic context can significantly affect LLMs' cultural taboo safety. Code and data is accessible here: this https URL.
81. 【2608.12340】Class-Structure Preservation Beats Diversity: A Comprehensive Benchmark of Text Augmentation Methods for Imbalanced Text Classification
链接：https://arxiv.org/abs/2608.12340
作者：Keito Inoshita
类目：Computation and Language (cs.CL)
关键词：large language models, natural language processing, attracted considerable attention, generative data augmentation, language models
备注：
点击查看摘要
Abstract:With the rapid advancement of large language models (LLMs), generative data augmentation has attracted considerable attention for imbalanced text classification in natural language processing. However, no empirical benchmark to date has compared LLM-based augmentation against the embedding-space SMOTE-style retrieval (EmbSMOTE), a strong classical reference for imbalanced classification. In this study, a controlled benchmark of 11 augmentation methods, spanning classical perturbation, embedding-space retrieval, and LLM-based generation, is newly constructed on seven public text classification datasets covering class counts $K=2$-$28$ and imbalance ratios of 1.1 to over 500, evaluated with five random seeds per cell using macro F1, Welch's $t$-tests, five distributional metrics, and an LLM-family sensitivity analysis based on Qwen3-8B. The experimental results reveal that all LLM-based methods are statistically equivalent or inferior to EmbSMOTE, with the performance gap widening monotonically as imbalance increases and reaching $\Delta\text{F1}_\text{macro}\!\approx\!0.063$ on GoEmotions-28. Furthermore, it is observed that surface-level uniqueness has negligible correlation with downstream performance, whereas LLM-specific artifacts, such as text elongation and label-distribution uniformization, are negatively associated with classification accuracy. Compared with six LLM-based and four classical augmentation baselines, these results demonstrate that the effective variable is not surface-level diversity but class-conditional structural fidelity, namely the degree to which augmented samples preserve the class-conditioned geometry of the training distribution. Accordingly, retrieval-based oversampling should be adopted as the default for imbalanced multi-class classification, and a higher empirical bar should be required before LLM-based augmentation is deployed in practice.
82. 【2608.12339】Mimicry without understanding: the origins of decision bias in large language models
链接：https://arxiv.org/abs/2608.12339
作者：Eldad Yechiam,Adi Tarabeih
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Large Language models, Large Language, Language models, Large, Language
备注： 33 pages, 3 figures, 2 boxs
点击查看摘要
Abstract:Large Language models (LLMs) were found to be susceptible to a host of social, affective, and cognitive biases. We examined two mechanisms through which such biases can be generated even when human preferences (in the training data) are not biased or when they are correctly categorized as being biased. The first is faulty mimicry of preferences based on human behavior: this involves LLMs inferring human preferences even when behaviors are logically unrelated to preferences. The second is mimicry of explicitly biased human behaviors. In four studies focusing on economic biases, we find that ChatGPT-4o and Qwen exhibited social proof biases even when prompted with reports of human behaviors that were clearly non-indicative of individuals' actual preferences. LLMs also displayed loss aversion when it was explicitly described as a bias. Indeed, when prompted with detailed scientific reports, the extent of the bias (i.e., loss aversion) in the scientific report predicted LLMs' own subsequent bias. Scientific papers of biases can thus become self-fulfilling prophecies, at least when it comes to LLMs' responses. The current study goes beyond fleshing out LLM biases and sheds light on the underlying component processes.
83. 【2608.12338】SDAM: Structure-Difference-Aware Memory Evolution for Complex Text-to-SQL
链接：https://arxiv.org/abs/2608.12338
作者：Keyan Xu,Dingzirui Wang,Xuanliang Zhang,Qingfu Zhu,Wanxiang Che
类目：Computation and Language (cs.CL)
关键词：executable SQL queries, convert natural language, natural language questions, SQL queries, aims to convert
备注： 19 pages, 5 figures, 12tables
点击查看摘要
Abstract:Text-to-SQL aims to convert natural language questions into executable SQL queries. While memory-based agent system improves complex SQL generation, existing memory design neglect historical experience and suffer from weak structure analysis, shallow semantic understanding, and poor schema alignment. To address these challenges, we propose SDAM. Specifically, SDAM identifies potential errors via a structure-difference aware reasoning tree, extracts deep semantic rules through contradiction-aware reflection, and enhances structural consistency using a schema-grounded memory evolution mechanism to bind memory with database schemas. We integrate SDAM into a Text-to-SQL framework named SDAM-SQL. Experiment shows that SDAM-SQL achieves 2.0 and 0.4 improvement on BIRD-dev and Spider-test compared with mainstream Text-to-SQL methods, showing the effectiveness of SDAM-SQL.
84. 【2608.12337】From Refuse to Richness: Rubric Rewards for Long-Form Hallucination Reinforcement Learning
链接：https://arxiv.org/abs/2608.12337
作者：Yudong Wang,Zhe Yang,Wenhan Ma,Rang Li,Qibin Yang,Weimin Xiong,Jiangshan Duo,Liang Zhao,Zhifang Sui
类目：Computation and Language (cs.CL)
关键词：penalize unsupported claims, penalize unsupported, teach models, long-form generation, Rewards
备注：
点击查看摘要
Abstract:Rewards that penalize unsupported claims can improve grounding in long-form generation, but they can also teach models to answer less. We study this refusal-to-richness trade-off in long-form hallucination RL. Instead of using global richness proxies such as length, claim count, detail, or pairwise relevance, we represent each question with a key-point rubric that specifies the required and optional information a useful answer should cover. These rubrics define coverage directly and are used both for evaluation and as reward signals. Across grounding-only, proxy-based, rubric-only, and combined rewards, we find a stable trade-off: strict grounding rewards improve support but suppress coverage, while unconstrained rubric rewards improve coverage but weaken grounding. A soft combination of grounding, rubric coverage, and relevance gives the best balance in our experiments, improving in-distribution support while transferring better to out-of-distribution checklist tasks than either grounding-only or rubric-only rewards.
85. 【2608.12336】StorySpark: Module-wise Evolutionary Search for Story Premise Generation
链接：https://arxiv.org/abs/2608.12336
作者：Yang Yang,Zining Zhong,Qian Cao,Jindong Li,Boyun Xu,Kaishen Yuan,Menglin Yang,Yutao Yue
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：creative spark, story, full narrative, Abstract, story premise
备注： 26 pages, 7 figures
点击查看摘要
Abstract:A story premise is the creative spark from which a full narrative can grow. Yet LLM-based story generation has mostly emphasized later-stage planning, controllability, coherence, and prose expansion, while premise-level ideation remains comparatively underexplored. We introduce StorySpark, a module-wise evolutionary search framework for story premise generation. StorySpark operates over interpretable narrative modules such as background, persona, event, ending, and twist, treating each active module not as a static field to fill once, but as a local search space conditioned on the partial premise built so far. For each module, it generates alternatives, evaluates them in context, refines them through feedback-driven mutation and recombination, preserves complementary strengths with Pareto-guided selection, and reallocates frontier capacity to balance branch coverage with promising directions. Multi-view automatic and human evaluations show that StorySpark produces stronger final premises than competitive baselines, with especially consistent gains in originality; when expanded with the same story writer, its premises also lead to higher-quality downstream stories while maintaining completeness, fascination, and diverse usable narrative directions.
86. 【2608.12335】HC-RAG: Evidence-Centric Retrieval-Augmented Generation over Heterogeneous Financial Filings
链接：https://arxiv.org/abs/2608.12335
作者：Siyuan Chen,Huaye Tan,You Li,Jiajun Liang
类目：Computation and Language (cs.CL); Multimedia (cs.MM)
关键词：semantically similar passages, retrieving semantically similar, Financial question answering, annual reports requires, similar passages
备注： 16 pages, 5 figures
点击查看摘要
Abstract:Financial question answering over annual reports requires more than retrieving semantically similar passages. It often involves identifying relevant companies and fiscal years, locating standardized filing sections, collecting textual and tabular evidence, and checking answers against the original documents. Existing RAG systems, however, usually flatten long filings into unordered chunks, pay limited attention to the typed structure of financial reports, and use fixed text-table fusion strategies without considering query intent. To address these limitations, we propose \textbf{HC-RAG}, a hierarchical cross-modal retrieval-augmented generation framework for evidence-centric financial QA. HC-RAG organizes filings into a typed financial evidence graph with documents, sections, text units, table units, and metadata nodes. It retrieves evidence through document-section-unit paths, aligns textual and tabular evidence in a shared retrieval space, and routes evidence according to four semantic intents: calculation, trend, fact, and comparison. We further introduce \textbf{Multi-Doc-2025}, a benchmark containing 2,327 expert-verified QA pairs from 179 SEC 10-K filings of 87 S\P 500 companies across fiscal years 2022--2024, with labels for intent, difficulty, and structural evidence attributes. Experiments on public financial QA benchmarks and Multi-Doc-2025 show that HC-RAG improves both answer quality and evidence localization, especially in long-document, table-related, and cross-document settings. HC-RAG outperforms RAPTOR by 6.6 F1 points on DocFinQA and GraphRAG by 10.9 F1 points on Multi-Doc-2025. Evidence-level analysis and ablation studies show that the improvements mainly come from more accurate section localization, table grounding, cross-document evidence aggregation, and intent-aware text-table routing.
87. 【2608.12334】Steering the Language Axis: From Linear Decodability to Causal Control
链接：https://arxiv.org/abs/2608.12334
作者：Arnav Srivastav
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：remain poorly understood, impressive multilingual capabilities, latent dynamics dictating, selection remain poorly, Large Language Models
备注： 22 pages, 14 figures, Under review
点击查看摘要
Abstract:Despite the impressive multilingual capabilities of Large Language Models, the latent dynamics dictating language selection remain poorly understood. In this work, we ask whether language identity is merely linearly decodable from hidden states, or if it can be causally controlled by a compact activation direction. We conduct an exhaustive causal intervention analysis across multiple model families, including Qwen 3.5-2B and Llama-3.2-1B-Instruct, isolating PCA-derived "language axes" to perform steering and ablation experiments across 1.26 million generations on the FLORES-200 dataset. Steering along these geometric directions reliably forces language switching in both cross-script (English to Chinese) and same-script (English to Spanish) settings, whereas equal-magnitude random perturbations yield virtually no effect. Our layerwise analysis reveals that language commitment is highly localized and explicitly language-pair-dependent. While English to Chinese switching resists early intervention and steers easily in the later layers, the English-Spanish transition shifts earlier, displaying a distinct, bimodal sensitivity. Furthermore, targeted ablation uncovers a fundamental reversion to English: once the language signal is removed, the model falls back to English regardless of the input prompt. Ultimately, these findings demonstrate that language decision boundaries function during inference as causally active features that are direction-dependent and layer-specific.
Comments:
22 pages, 14 figures, Under review
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.12334 [cs.CL]
(or
arXiv:2608.12334v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.12334
Focus to learn more
arXiv-issued DOI via DataCite</p>
88. 【2608.12333】Vision-Language Models are Fragile Multilingual Associators
链接：https://arxiv.org/abs/2608.12333
作者：Ritabrata Chakraborty,Rajatsubhra Chakraborty,Shivakumara Palaiahnakote,Angelo Cangelosi,Umapada Pal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：associate visual entities, textual attributes, Vision-language models, associate visual, visual entities
备注： Preprint (under review). Project Page: [this https URL](https://ritabrata04.github.io/m2bind/)
点击查看摘要
Abstract:Vision-language models must associate visual entities with textual attributes. Whether these associations or concept bindings remain stable when the language of the input changes is unexplored. We introduce M$^2$BIND, a benchmark varying the language of the context and query across multiple languages. We evaluate binding both extrinsically through task performance metrics and intrinsically through causal interventions. We find that binding is not language-invariant: cross-family and cross-script settings trigger significant binding collapse, with the model's internal binding computation shifting to later layers and losing causal strength. Closely related languages preserve associations comparatively better. In a broader sense, our findings indicate how VLMs deployed globally in multilingual settings cannot be assumed to maintain the same association quality observed in monolingual evaluation.
89. 【2608.12332】Can Spectral-Clipping Enable Better Learning While Forgetting Less for Low-Rank Adaptation?
链接：https://arxiv.org/abs/2608.12332
作者：Hyowon Wi,Noseong Park
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：freezes pre-trained weights, recent years, introduces small, significant paradigm, paradigm that freezes
备注： ACL 2026 Main Conference
点击查看摘要
Abstract:In recent years, low-rank adaptation (LoRA) has emerged as a significant paradigm that freezes pre-trained weights and introduces small, learnable adapters instead of fine-tuning the full set of parameters. In this work, we uncover several key insights regarding the singular components of network parameters based on Singular Value Decomposition (SVD). Firstly, the principal singular components with large singular values in pre-trained network parameters can be effectively reused during fine-tuning, whereas the minor components with smaller singular values are more task-specific and require substantial adaptation. Secondly, we first establish the theoretical connection that the uncontrolled growth of singular values in LoRA adapters leads to the forgetting of pre-trained knowledge -- a well-known issue referred to as catastrophic forgetting. Building on these observations, we propose SCLoRA, which injects parameterized singular components with spectral clipping into the pre-trained model in a way that is aware of the spectral distribution of the pre-trained model. SCLoRA effectively adapts to new tasks by focusing updates on components that require adaptation, while simultaneously alleviating catastrophic forgetting. We conduct extensive experiments and demonstrate that SCLoRA not only improves downstream performance but also effectively retains pre-trained knowledge.
90. 【2608.12331】hought-Aware KV Cache Compaction for Reasoning via Adaptive Attention Matching
链接：https://arxiv.org/abs/2608.12331
作者：Yang Liu,Bin Chong,Chongyang Zhang,Hao Zheng,Jiayu Liang,Xu Kefu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：cache grows linearly, models generate lengthy, language models generate, generate lengthy, cache grows
备注： 16 pages, 5 figures
点击查看摘要
Abstract:Reasoning language models generate lengthy chain-of-thought (CoT) sequences whose key-value (KV) cache grows linearly and becomes a memory bottleneck during decoding. Existing compaction methods treat reasoning trajectories as flat token sequences and apply uniform compression, ignoring the hierarchical structure of CoT reasoning where different steps vary drastically in importance. We propose \textbf{Thought-Aware Attention Matching (TAM)}, which exploits this structure through three mechanisms: (i)~thought segmentation that decomposes the trajectory into reasoning blocks, (ii)~adaptive budget allocation that assigns compression budget based on each segment's importance and size, and (iii)~pivotal token protection that preserves high-attention reasoning anchors. We prove that the allocation rule is optimal under a convex error model and that cumulative error under sequential compaction remains bounded. Experiments on AIME 2024 and MATH-500 with Qwen3-4B show that TAM improves accuracy over uniform compaction at the same memory footprint, with periodic compaction bounding peak memory to 3.1--3.2\,GB (a 65\% reduction) while maintaining competitive accuracy.
91. 【2608.12330】Reliability-Aware Sexism Detection: Combining DPO with Annotator Agreement and Token-Level Confidence Scoring
链接：https://arxiv.org/abs/2608.12330
作者：Hadi Mohammadi,Shihan Wang,Masoume M. Raeissi,Anastasia Giachanou
类目：Computation and Language (cs.CL)
关键词：online sexism remains, open problem, remains an open, Direct Preference Optimization, online sexism
备注： 11 pages, 4 figures. Preprint
点击查看摘要
Abstract:The detection of online sexism remains an open problem. Sexism detection is inherently subjective, yet most existing systems reduce multi-annotator labels to a single majority decision and treat all instances uniformly. This ignores two informative signals: annotator agreement and model uncertainty. We propose RA-DPO (Reliability-Aware Direct Preference Optimization), which integrates annotator agreement, model confidence, and a token-level uncertainty signal into a single reliability score. RA-DPO uses this score to select high-value preference pairs during training and to support inference-time abstention, which allows the model to trade coverage for accuracy. We evaluate RA-DPO on 6,920 multilingual posts from EXIST 2023, fine-tune OpenAI gpt-4o base via DPO, and validate on two open-weight 3B models (Llama, Qwen). Results show that training on the top 30% most reliable pairs matches full-data DPO, which indicates that reliability-aware selection can reduce training cost without sacrificing performance. At inference, selective prediction reaches 96.2% accuracy at 50% coverage in the true-agreement setting and 88.7% in the deployable predicted-agreement setting, both exceeding the 85.3% no-agreement baseline. These results suggest that accounting for annotation uncertainty is beneficial for both efficient training and reliable deployment in subjective classification.
92. 【2608.12329】AnchorSIPS: A Synthetic Dataset and Evaluation Resource for Evidence-Supported Psychosis-Risk Symptom Measurement
链接：https://arxiv.org/abs/2608.12329
作者：Guilherme C. Oliveira,Stephanie Fong,Zimu Wang,Clarice Lee,Xiangyu Zhao,Duy Khoa Pham,Duong Nhu,Yiwen Jiang,Jiahe Liu,Zhongxing Xu,Dwarikanath Mahapatra,Dominic Dwyer,Zongyuan Ge
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：data-access bottleneck, assessment is limited, Progress, psychosis-risk assessment, interview
备注：
点击查看摘要
Abstract:Progress on AI for psychosis-risk assessment is limited by a data-access bottleneck. Real clinical interviews are difficult to share because of privacy, governance, and consent constraints. We present AnchorSIPS, a synthetic dataset of 10K structured psychosis-risk interviews with transcript-grounded measurement targets. Each interview is modeled on Mini-SIPS, a clinician-administered psychosis-risk interview. It captures history, 24 symptom questions, follow-up evidence for items the patient affirms, decisions about delusion-like symptoms (unusual beliefs), hallucination-like symptoms (unusual perceptions), and disorganized communication, exclusion of clear psychotic-level symptoms ("frank psychosis"), and a final attenuated psychosis syndrome (APS) diagnosis, a high-risk state of milder or early psychotic symptoms. The APS diagnosis is not a standalone label. It depends on earlier endorsements, supporting follow-up details, symptom-class decisions, and the frank-psychosis check. Every intermediate decision is anchored to its supporting transcript turns. AnchorSIPS is generated by a plan-then-realize pipeline. A hidden case sheet specifies the patient's clinical state, a deterministic planner fixes the interview structure, and an LLM realizes only the patient utterances under validation and bounded repair. Fixing labels and structure before generation avoids the inter-turn inconsistencies typical of multi-turn LLM dialogue. Across seven LLM baselines, models recover coarse decisions but fail to extract follow-up details or cite supporting transcript turns, so final-label performance overstates interview competence. AnchorSIPS is intended for research on evidence extraction, transcript-grounded measurement, and uncertainty under partial disclosure.
93. 【2608.12328】LoRA-Diffusion: Parameter-Efficient Fine-Tuning via Low-Rank Trajectory Decomposition
链接：https://arxiv.org/abs/2608.12328
作者：Iman Khazrak,Narges Nejad,Mohammadhossein Homaei,Mostafa M. Rezaee,Robert C. Green II
类目：Computation and Language (cs.CL)
关键词：fewer trainable parameters, substantially fewer trainable, large autoregressive language, enabling task-specific customization, autoregressive language models
备注：
点击查看摘要
Abstract:Parameter-efficient fine-tuning methods such as LoRA have transformed the adaptation of large autoregressive language models, enabling task-specific customization with substantially fewer trainable parameters. However, these methods have not been successfully extended to diffusion-based language models, which generate text through iterative denoising rather than sequential token prediction. We propose LoRA-Diffusion, a parameter-efficient fine-tuning approach that applies low-rank decomposition to the denoising trajectory instead of model weights. Unlike weight-based LoRA, which modifies individual transformation matrices, our method learns low-rank perturbations to the entire diffusion path from noise to output. We introduce trajectory-level low-rank adapters that modify each denoising step, step-adaptive rank allocation across diffusion phases, and compositional multi-task learning that allows merging task-specific modules at inference without retraining. On SST-2, QNLI, and MRPC, we report token-level denoising validation accuracy over five random seeds. LoRA-Diffusion achieves the highest mean performance on SST-2 and strong performance on QNLI and MRPC. Joint multi-task training further shows that LoRA-Diffusion achieves the highest token-level accuracy among the evaluated methods. The approach reduces per-task storage compared with full fine-tuning and establishes a parameter-efficient fine-tuning framework for diffusion language models.
94. 【2608.12327】Comparative Analysis of Multilingual Pre-trained Models for Nepali Automatic Speech Recognition
链接：https://arxiv.org/abs/2608.12327
作者：Suman Paudel,Sarbin Sayami
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：single fine-tuning protocol, models nominally support, nominally support Nepali, pretrained models nominally, Character Error Rate
备注： 9 pages, 6 figures, 7 tables. Based on [this http URL](http://M.Sc) . thesis (Institute of Science and Technology, Tribhuvan University). Code and models: [this https URL](https://github.com/p-sumann/nepali-asr-benchmark)
点击查看摘要
Abstract:Multilingual pretrained models nominally support Nepali, yet no controlled benchmark has compared them under a single fine-tuning protocol. We fine-tune six pretrained models (XLSR-53, IndicWav2Vec, MMS-1B, Whisper-Medium, Whisper-Large-v3-Turbo, and Conformer-Hi) spanning CTC self-supervised, autoregressive encoder-decoder, and hybrid Conformer-CTC architectures, on the OpenSLR SLR54 Nepali corpus (~165 hours) using identical preprocessing, splits, optimizer, and family-matched learning-rate schedules. We evaluate Word Error Rate (WER), Character Error Rate (CER), and Real-Time Factor (RTF) on three independent test sets (OpenSLR, FLEURS, Common Voice). Whisper-Large-v3-Turbo (14.76% WER) and IndicWav2Vec (14.89% WER) tie at the top despite a 9x parameter gap and 40x pretraining-data gap, providing direct empirical evidence that language-family proximity in pretraining can substitute for raw scale for in-domain Nepali. CTC decoders run up to 29x faster than autoregressive Whisper at the same accuracy, flipping the practical deployment preference toward CTC under any latency budget. Massively multilingual pretraining (MMS-1B) yields the smallest out-of-domain degradation on FLEURS (+12.55 pp), indicating that scale buys robustness rather than peak in-domain accuracy. The resulting benchmark provides the first standardized, multi-model, efficiency-aware reference numbers for Nepali ASR.
95. 【2608.12326】On Measuring Semantic Preservation in Legal Ontology Learning
链接：https://arxiv.org/abs/2608.12326
作者：Albert Sadowski,Jarosław A. Chudziak
类目：Computation and Language (cs.CL)
关键词：transforms unstructured text, learning transforms unstructured, transforms unstructured, unstructured text, text into structured
备注： Accepted for publication at the 30th International Conference on Knowledge-Based and Intelligent Information Engineering Systems (KES 2026)
点击查看摘要
Abstract:Ontology learning transforms unstructured text into structured representations for automated reasoning. Yet structuring information risks losing it, and current evaluation methodologies cannot detect such loss, focusing on structural correctness while failing to measure whether meaning survives transformation. We propose an evaluation methodology that addresses this: comparing LLM task performance on source documents against performance on transformed representations, with the difference quantifying semantic loss. We demonstrate this approach on legal merger agreement analysis, a domain chosen for its complex language and precise semantic requirements, comparing direct LLM application against three ontology learning methods across six language models. The results reveal systematic semantic loss with significant variation based on reasoning complexity and model-method interactions. Our contributions are: (1) an evaluation framework for measuring semantic preservation in ontology learning, and (2) empirical evidence that semantic loss varies dramatically with model-method pairing, providing guidance for selecting optimal configurations in legal knowledge systems.
96. 【2608.12325】Position: Reasoning is a Learnable Rule-Based Process
链接：https://arxiv.org/abs/2608.12325
作者：Rachel Lawrence,Jacqueline Maasch
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：economically motivating topics, scientifically and economically, economically motivating, motivating topics, reasoning
备注：
点击查看摘要
Abstract:Autonomous reasoning is among the most scientifically and economically motivating topics in AI today. Historically the purview of symbolic AI, recent advances have mainly emerged from deep probabilistic generative models. Despite immense interest and rapid progress, the generative AI community has not clearly converged on operational definitions for reasoning and often implicitly rejects the historical treatment of this topic in logic and verifiable automated reasoning. This position contends that definitional ambiguity leaves the construct validity of reasoning evaluation unverifiable, undermining quantifiable progress toward trustworthy autonomous reasoning. We also contend that this ambiguity is addressable. To that end, we provide (1) operational definitions based on a synthesis of the literature, positioning valid and sound reasoning as a learnable rule-based process; and (2) a checklist for best practices in the communication of AI reasoning research.
97. 【2608.12324】When AI Is Your Pastor: A Benchmark for Theological Triage and Pastoral Guidance in Large Language Models
链接：https://arxiv.org/abs/2608.12324
作者：Alex Chao
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：People increasingly, People, Faith Moral Guidance, pastoral, English-language Christian theological
备注： Full paper. Code and dataset are available at [this https URL](https://github.com/FideAI/fmg-bench) and [this https URL](https://huggingface.co/datasets/FideAI/fmg-bench)
点击查看摘要
Abstract:People increasingly ask large language models (LLMs) for counsel on questions of faith, doctrine, and pastoral care. These questions are not ordinary information requests. Some ask about core Christian beliefs, some ask about real disagreements among faithful traditions, some require humility because the issue is prudential, and some are pastoral situations where safety and human referral matter more than theological completeness. Existing benchmarks do not evaluate this structure. We introduce FMG-Bench, the Faith Moral Guidance Benchmark, a 120-scenario benchmark for evaluating large language model behavior in English-language Christian theological triage and pastoral guidance contexts. FMG-Bench v1 evaluates 14 advanced models across 8,792 scored responses, comparing raw model behavior with three guided instruction settings. In our production run, placing models inside a structured harness improves over raw model behavior by +3.96 points on average, with every model improving. The most safety-critical finding is a +10.8 point gain in escalation appropriateness -- whether AI systems recognize when pastoral, clinical, legal, or emergency support is needed. The guided settings also improve robustness, meaning consistency when questions are reworded or pressured (92.88 to 98.02 stability). Asking a model to compare perspectives helps in secondary-doctrine questions but can be counterproductive when applied to primary doctrine or urgent pastoral situations. The benchmark is a measurement tool, not an endorsement of AI systems as pastoral authorities.
98. 【2608.12323】Why Do AI Agents Break Rules? How Framing, Context, and Social Signals Shape Compliance
链接：https://arxiv.org/abs/2608.12323
作者：Mika Okamoto,Ansel Kaplan Erol,Kutluhan Erol
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：favors violation, penalty can paradoxically, paradoxically convert, convert a legal, legal obligation
备注：
点击查看摘要
Abstract:Specifying a penalty can paradoxically convert a legal obligation into a cost-benefit calculation that favors violation. We demonstrate that this enforcement information paradox systematically occurs in AI agents. While most AI safety evaluations test whether models fail, we investigate why, applying compliance theory from law and economics as a diagnostic tool. We treat compliance theories not as metaphors but as empirical hypotheses and show that each predicts the behavior of a distinct model class. We evaluate our hypotheses across twelve instruction-tuned language models operating as enterprise procurement chatbots. Drawing on theories of deterrence, legitimacy, and expressive law, we show that safety-fine-tuned models maintain compliance broadly, while task-optimized and agentic models treat regulatory signals as mere optimization parameters. These latter models fail to comply under conditions predicted by theory, such as low enforcement penalties and non-command phrasing. Across all models, introducing financial incentives, managerial demands, peer outcomes, or employee pressure produces large compliance failures. AI procurement agents systematically violate regulatory constraints to satisfy local user objectives in ways not captured by standard alignment benchmarks. Ultimately, compliance cannot be achieved by rule embedding alone; model selection is itself a governance decision, and benchmark-based evaluation is insufficient for compliance-sensitive deployments.
99. 【2608.12322】What Drives LLM Self-Reflection? A Controlled Ablation of Uncertainty Routing in Armed Conflict Forecasting
链接：https://arxiv.org/abs/2608.12322
作者：Poli Nemkova,Haeshitha Indukuri
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：improve LLM reasoning, remains poorly understood, gain remains poorly, LLM reasoning, text
备注：
点击查看摘要
Abstract:Self-reflection is widely assumed to improve LLM reasoning, yet which component drives the gain remains poorly understood. We present a controlled six-condition ablation isolating four components of LLM self-reflection: evidence exposure, diagnostic scaffolding, taxonomy vocabulary, and action routing. Two precise null results converge on a single mechanism. First, structured diagnostic questions add no measurable value over unstructured reflection ($\text{F1} = 0.296$ vs $0.297$, $p = 1.000$, 95\% CI $[-0.041, +0.040]$). Second, presenting the full uncertainty taxonomy while collapsing the action space to a single generic action also adds no value ($\Delta\text{F1} = +0.008$, overlapping 95\% CIs), ruling out taxonomy vocabulary as the mechanism. Typed action routing provides consistent directional gains ($\text{F1} = 0.379$ vs $0.296$); the conservative estimate controlling for taxonomy vocabulary is $\Delta\text{F1} = +0.075$, and the overall gain over the single-shot baseline is significant by bootstrap CI ($\Delta\text{F1} = +0.101$, 95\% CI $[+0.020, +0.185]$). The vocabulary-routing decomposition replicates on GPT-4o: taxonomy vocabulary adds no significant value over generic reflection ($p = 0.773$), while action routing provides significant gains ($p = 0.025$), confirming the mechanism holds across backbones. Gains concentrate on structurally novel conflicts: in Myanmar ($\text{F1}: 0.000 \rightarrow 0.353$) and Ukraine ($0.167 \rightarrow 0.500$), the vocabulary-only condition recovers no more than generic reflection while action routing breaks the degenerate prior. These findings identify typed action routing -- not diagnostic scaffolding or taxonomy vocabulary -- as a promising design principle for metacognitive LLM forecasting agents, while motivating larger-scale evaluation across conflict typologies.
100. 【2608.12321】LLMs Know the Constraint But Do Not Use It: Activation Bottlenecks in Pragmatic Constraint Reasoning
链接：https://arxiv.org/abs/2608.12321
作者：Yubo Li,Ramayya Krishnan,Rema Padman
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：salient surface cue, surface cue competes, aggregate accuracy conflates, accuracy conflates genuine, implicit feasibility constraint
备注：
点击查看摘要
Abstract:When a salient surface cue competes with an implicit feasibility constraint, LLMs often fail -- but aggregate accuracy conflates genuine constraint inference with conservative defaulting. We formalize the distinction as conditional constraint activation: the constraint is internally encoded (Knowledge) symmetrically across constraint-present and -absent prompts (Symmetry), yet only sometimes routed into the decision (Routing) and repairable by a donor activation (Repair). A quartet diagnostic over 14 models reveals two failure modes; probes on two open weights decode the constraint above $88\%$, yet activation patching repairs one ($+6.4$ nats) and not the other ($-0.07$). On a mitigation frontier, no prompted intervention reaches the repair corner: all inflate conservative bias through a single mediation pathway -- prerequisite mention. Hidden-constraint failure is a routing problem, not a knowledge problem.
101. 【2608.12377】From Observation to Intervention: Memory in Brains and Large Language Models
链接：https://arxiv.org/abs/2608.12377
作者：Morteza Salehjahromi,Shayan A. Zadegan,Amgad Muneer,Jia Wu
类目：Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, partial cues recover, Brains and large, cues recover broader, shared functional questions
备注： Perspective article, 11 pages, 3 figures, 1 table, and 1 key terms box. Submitted for consideration to Nature Machine Intelligence
点击查看摘要
Abstract:Brains and large language models (LLMs) are fundamentally different memory systems, but they can be compared through shared functional questions: where memory-related information is represented, how partial cues recover broader associations, how new information is written or updated, and how memory-related states can be perturbed. In biological systems, these questions span synapses, neuronal ensembles, hippocampal-cortical interactions, and plasticity; in LLMs, they span weights, activations, context windows, retrieval systems, and external stores. The comparison is therefore functional and experimental rather than anatomical. Human studies reveal sparse concept responses, temporal binding, rapid association formation, episode-specific coding, and recall-related reactivation, but selective intervention remains limited. Rodent studies provide more selective causal access to learning-related ensembles, whereas human and macaque interventions usually affect broader circuits. LLMs lack lived episodic memory, yet they permit unusually direct and repeatable manipulation of internal states and stored information. We argue that this asymmetry creates a new opportunity. LLMs are not ahead in memory itself, but in experimental access. Their tools may help turn broad questions about retrieval, updating, persistence, reversibility, and unintended effects into sharper biological hypotheses. The productive bridge is to transfer experimental logic, not anatomical parts.
信息检索
1. 【2608.13384】Structure then Query: Enabling Precise Analytical Queries over Unstructured Documents
链接：https://arxiv.org/abs/2608.13384
作者：Teng Lin,Yuyu Luo,Nan Tang
类目：Information Retrieval (cs.IR); Databases (cs.DB)
关键词：Unstructured documents constitute, Annotation Index, unstructured textual documents, constitute the majority, majority of enterprise
备注：
点击查看摘要
Abstract:Unstructured documents constitute the majority of enterprise and web data. With the rapid development of large language models(LLMs), researchers have started to build data systems that analyze unstructured textual documents like operating on databases. However, because mainstream retrieval methods still relies on fuzzy matching based on vector similarity, accurately obtaining information and performing structured analysis and reasoning remains a major challenge. To address these limitations, AnnoIndex introduces two core fundamental components. The first is Annotation Index. The system uses a module called SchemaLoop to automatically create hierarchical annotation schemas from the raw corpus, and then uses lightweight language model to extract specific values. It turns scattered unstructured text into a materialized, structured index that enables low-cost filtering and querying. The annotation index avoids the black-box matching of vector similarity and amortizes attribute extraction costs from online queries to a one-time build. The second innovation is a Structured Query Engine. It compiles user questions into execution plans based on SQL extension. It first uses the Annotation Index for precise documents filtering, then gradually applies extraction operations in ascending order of cost, resorting to LLMs only for the remaining minimal fraction of the corpus that require deep semantic understanding. The extracted attributions are merged into the annotation index, reducing the cost of future queries. Experiments on three real-world datasets demonstrate that AnnoIndex consistently outperforms state-of-the-art baselines, achieving the highest average F1 score (0.87) while maintaining robust performance on complex multi-hop join and progressive reasoning queries.
2. 【2608.13237】When Should Multi-Round RAG Stop? Structured Stopping Judgments and Retrieval Reduction in Search-R1
链接：https://arxiv.org/abs/2608.13237
作者：Weimeng Luo
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Multi-round retrieval-augmented generation, Multi-round retrieval-augmented, retrieval-augmented generation, evidence accumulates, searching as evidence
备注： 16 pages, 3 figures. Code: [this https URL](https://github.com/luobostorm/search-r1-s2g-stopping)
点击查看摘要
Abstract:Multi-round retrieval-augmented generation (RAG) must decide when to stop searching as evidence accumulates. Because the deployed policy is determined by the first STOP on each trajectory, this is a sequential selection problem rather than an independent state-classification task. We adapt S2G-RAG's structured sufficiency-and-gap judgment to a frozen Search-R1 pipeline and train a Qwen3.5-2B judge on 3,009 states from 900 disjoint HotpotQA questions. Search-R1's reasoner, retriever, corpus, prompt, and search budget remain unchanged, while the judge checkpoint and stopping threshold are selected on grouped validation and frozen before confirmatory evaluation. On the confirmatory test set, the resulting policy reduces retrieval calls by 77 (3.70\%) relative to Native Search-R1, while Official Exact Match decreases by 0.625 percentage points. Thus, the trained S2G-style structured judge reduces retrieval while broadly preserving answer accuracy. The result does not imply unchanged or improved accuracy, safe stopping, or lower total inference cost.
3. 【2608.13200】GEM: A Generative Embedding Model Bridging Reasoning and Retrieval
链接：https://arxiv.org/abs/2608.13200
作者：Zhili Shen,Craig Macdonald
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Modern LLMs excel, Modern LLMs, LLMs excel, complex and diverse, diverse information
备注：
点击查看摘要
Abstract:Modern LLMs excel at reasoning and instruction following, enabling users to express complex and diverse information needs. However, conventional retrievers largely rely on surface-level matching between queries and documents, resulting in a growing gap between how users express their needs and how retrievers interpret them. In this paper, we present GEM, a generative embedding model that augments retrieval through its own knowledge by explicitly reasoning about user intent and relevance criteria. GEM unifies generation and embedding within a single model: it first reasons over the query, then appends an embedding token to encode the enriched context for retrieval. \zhili{Evaluated on reasoning-intensive and instruction-following retrieval tasks, GEM demonstrates the effectiveness of its reasoning-augmented retrieval, outperforming its non-reasoning variant and matching baselines using substantially larger models.} Furthermore, GEM's generative nature allows test-time compute scaling via prompting to further enhance retrieval performance. Our code is available at: this https URL.
4. 【2608.13010】RAGSieve: Self-Referenced Local Contrast for Knowledge-Poison Detection in Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2608.13010
作者：Xinlong Xu,Yoshua Y. Li
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation treats, promote attacker-chosen claims, Retrieval-augmented generation, allowing injected documents, inference evidence
备注：
点击查看摘要
Abstract:Retrieval-augmented generation treats an external corpus as inference evidence, allowing injected documents to promote attacker-chosen claims. Existing detectors depend on trusted references, specific attack artifacts, or global thresholds sensitive to corpus topology. We present RAGSieve, a self-referenced detection framework that constructs its reference from the inspected system. RAGSieve-Query (RSQ) performs query-local contrast, scoring top-five candidates against ranks 6-20 of the same retrieval to detect answer-anchor concentration and carrier transitions. RAGSieve-Graph (RSG) performs corpus-local contrast, comparing each document's semantically similar but lexically distinct neighbors with its local baseline to detect coordinated density before queries arrive. Across three QA datasets and six poisoning constructions, RSQ achieves 95.2% AUROC and detects 82.2% of poison at 5% clean-document removal, versus 81.1%/52.5% for GMTP. RSG achieves 93.3%/79.8%, versus 79.4%/37.6% for CleanBase. Joint deployment reduces attack success from 67.4% to 14.0% while retaining 41.3% F1 on unpoisoned retrieval, demonstrating practical protection at both corpus ingestion and query time without poison labels or trusted corpora. Source code is available at this https URL.
5. 【2608.13006】EviReform: Evidence-Guided Query Reformulation for Multi-Hop Graph Retrieval
链接：https://arxiv.org/abs/2608.13006
作者：Xinlong Xu,Yoshua Y. Li
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Multi-hop retrieval, provide sufficient evidence, retrieval, Multi-hop, evidence
备注：
点击查看摘要
Abstract:Multi-hop retrieval must recover passages that provide sufficient evidence together. An initial passage often resolves an entity or relation implicit in the question, making the missing evidence easier to describe only after retrieval begins. Graph retrieval improves access to related evidence through stored corpus structure, but its retrieval signal is commonly derived from the original question. Complementary evidence must then be reached through stored relations even when an observed passage provides a more direct semantic cue. We introduce EviReform, which separates revising the retrieval request from aggregating evidence in the graph. Retrieved source passages formulate residual queries for the unresolved information need. The original and residual retrieval signals are normalized separately, combined, and propagated between propositions that share entities. On 2WikiMultiHopQA, HotpotQA, and MuSiQue, EviReform exceeds the strongest baseline by up to 5.59 Recall@5 points and 4.50 F1 points. These results show that observed evidence can guide graph retrieval toward the part of a supporting chain left underspecified by the original question. Code is available at this https URL.
6. 【2608.13004】HybridRAG-BN: A Retrieval-Augmented Framework with Fine-Tuned Verification for Bangla KBQA
链接：https://arxiv.org/abs/2608.13004
作者：Rathijit Aich,Nirjhar Das,Mahfuzulhoq Chowdhury
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Knowledge-base question answering, external knowledge sources, Knowledge-base question, generate accurate answers, reliable KBQA systems
备注： Developed for the IEEE Computer Society CUET Student Branch
点击查看摘要
Abstract:Knowledge-base question answering (KBQA) systems rely on effective retrieval and reasoning mechanisms to generate accurate answers from external knowledge sources. However, developing reliable KBQA systems for low-resource languages such as Bangla remains challenging due to limited retrieval-focused research, scarce language resources, and difficulties in grounding generated responses in external knowledge. In this work, we propose HybridRAG-BN, a retrieval-augmented framework for Bangla KBQA that integrates hybrid retrieval using BM25 and BGE-M3, answer generation using the GGUF version of Gemma-4-31B-Instruct, and a LoRA-fine-tuned Gemma-4-31B-Instruct model for answer verification and refinement. To further improve robustness, the framework incorporates a post-processing stage that addresses unresolved cases through fallback answer replacement and DuckDuckGo-assisted retrieval. Experimental results demonstrate the effectiveness of the proposed framework, achieving token-level F1 scores of 0.71654 and 0.72912 on the public and private leaderboards, respectively, securing first place in the competition.
7. 【2608.12987】Generative Universal Multimodal Retrieval with Dual-role Identifiers
链接：https://arxiv.org/abs/2608.12987
作者：Kaipeng Li,Haitao Yu,Xuanchen Zhou
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：relevant items directly, compelling alternative, pipeline by training, training a generator, generator to produce
备注： This paper is under review
点击查看摘要
Abstract:Generative information retrieval (GIR) has emerged as a compelling alternative to the conventional index-retrieve-then-rank retrieval pipeline by training a generator to produce the identifiers of relevant items directly. Despite its promise, a number of open challenges still remain. First, constrained left-to-right decoding is vulnerable to prefix-level errors and local optima. Second, most prior GIR research remains largely unimodal, leaving instruction-aware retrieval across text, image, and mixed image-text items underexplored. Third, although discrete identifier-based GIR offers higher efficiency, its retrieval accuracy still lags behind that of the cutting-edge dense-vector-based retrieval methods. Motivated by these challenges, we propose DrIG, a novel Generative framework for universal multimodal retrieval featuring Dual-role Identifiers, which supports diverse retrieval tasks across multiple modalities and domains. Each candidate is assigned a single residual-quantized identifier that serves two complementary roles. In its sequential role, the identifier is decoded autoregressively, where the first token explicitly models modality and the remaining tokens capture progressively finer semantics. In its set-based role, the same tokens are reinterpreted as an unordered set to provide a prefix-independent relevance prior, which guides constrained beam search and alleviates local-optimum errors. Extensive experiments on the M-BEIR benchmark and the text-to-image evaluation datasets show that:(1)DrIG consistently outperforms state-of-the-art generative multimodal baselines across diverse tasks, while hybrid reranking achieves a favorable efficiency-effectiveness trade-off against strong dense retrievers. (2)Ablation and scaling analyses reveal how the base LMM, beam size, reranking depth, and fusion strategy affect retrieval performance, providing practical guidance for system design.
8. 【2608.12986】STAR: Structured Tokenization and Target-Aware Interest Representation for PCVR Prediction
链接：https://arxiv.org/abs/2608.12986
作者：Yimeng Xu,Haorui Zhang,Yingqi Song,Ying Jiang,Lan Ma
类目：Information Retrieval (cs.IR)
关键词：Post-click conversion rate, industrial recommender systems, Post-click conversion, core ranking task, conversion rate
备注：
点击查看摘要
Abstract:Post-click conversion rate (PCVR) prediction is a core ranking task in industrial recommender systems. Modern ranking models must jointly capture heterogeneous non-sequential features, multi-behavior user sequences, and target-item-aware user interests, while remaining robust to high-cardinality sparse features, missing values, and train-inference inconsistencies. In this paper, we present STAR (Structured Tokenization and Target-Aware Interest Representation), a practical framework for the KDD Cup 2026 Tencent UniRec Challenge. STAR combines structured feature tokenization with target-aware interest representation on top of a HyFormer-style multi-sequence backbone. It introduces high-cardinality signal recovery, explicit user-item interaction tokens, target-aware sequence decoding, and a weighted user-item contrastive auxiliary objective inspired by InfoNCE. We further align the training and inference pipelines by reconstructing feature remapping tables and structural hyperparameters from the saved training configuration. Experiments on the challenge dataset identify the components that most reliably improve ranking AUC, while LogLoss is reported as a calibration diagnostic. The main ablation study shows a large gain from temporal context, with smaller but useful contributions from contrastive alignment, target-aware interest encoding, and high-cardinality sequence feature recovery.
9. 【2608.12975】DTAMLP: Denoise Time-aware MLP for Session-based Recommendation
链接：https://arxiv.org/abs/2608.12975
作者：Jiamu Zheng,Xiaojun Shan
类目：ocial and Information Networks (cs.SI); Information Retrieval (cs.IR)
关键词：session-based recommendation, paper reports, reports two empirical, empirical findings, findings on session-based
备注：
点击查看摘要
Abstract:This paper reports two empirical findings on session-based recommendation (SBR), unified in a single model, DTAMLP. First, existing time-aware and GNN-based models (e.g., TiSASRec, SR-GNN) treat every click-time interval as equally informative, even though very short dwell times often reflect accidental clicks carrying little preference signal -- a phenomenon we call sporadic noise. We show that a lightweight, plug-and-play weight fusion module, blending a model's attention weight with a threshold-capped time-interval weight, can be inserted into such models with almost no architectural change and yields a consistent accuracy gain; we view this as the most directly verifiable contribution of this work. Second, we revisit an under-explained observation from FMLP-Rec, where a learnable frequency-domain filter on item embeddings improves accuracy, and offer a possible explanation: time-domain behavior mixes several entangled psychological preferences, and a frequency-domain view may let a model separate and down-weight such preference noise more naturally -- an interpretive conjecture rather than a proven mechanism. Building on both insights, DTAMLP, an all-MLP framework combining weight fusion and FFT-based filtering, is validated on Diginetica and RetailRocket. While this system-level design reflects the state of the field circa 2023 rather than a state-of-the-art claim, ablations confirm the two mechanisms contribute complementary, non-redundant improvements.
10. 【2608.12845】FSGR: Mitigating Token Frequency Bias for Fair SID-Based Generative Recommendation
链接：https://arxiv.org/abs/2608.12845
作者：Yuchen Zheng,Sihan Xu,Jingwen Yang,Xiangrui Cai,Haiwei Zhang,Xiaojie Yuan
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：achieved remarkable success, recently achieved remarkable, SID, SID tokens, Token Frequency Bias
备注：
点击查看摘要
Abstract:Semantic ID (SID)-based generative recommendation has recently achieved remarkable success. However, existing methods suffer from a previously overlooked fairness issue, which we term \textbf{Token Frequency Bias}, where high-frequency SID tokens are systematically over-predicted while low-frequency SID tokens are under-predicted. This bias originates from the combined effects of imbalanced semantic codebooks during SID construction, and popularity bias together with the maximum likelihood estimation objective during recommendation training, resulting in unfair exposure across item categories. Existing SID methods mainly focus on improving codebook quality and overlook the impact of token frequency imbalance on downstream recommendation fairness, while LLM debiasing methods often yield suboptimal results when directly applied to SID-based recommendation, due to the hierarchical semantics of SID tokens. To address this issue, we propose \textbf{FSGR}, a fairness optimization framework for SID-based generative recommendation. During SID construction, FSGR employs OT-based Assignment Optimization and Dual-Criteria Re-anchor mechanism to form a more balanced SID representation space. During recommendation training, it adopts a two-stage training strategy and introduces Hierarchical Frequency Calibration for layer-specific fairness fine-tuning. Experiments on three public datasets with three backbone models demonstrate that FSGR mitigates token frequency bias and delivers an average Gini fairness improvement of over 20\% while maintaining competitive recommendation accuracy.
11. 【2608.12820】Query Translation vs. Cross-Lingual Embeddings for Sinhala-Tamil E-Government Information Retrieval
链接：https://arxiv.org/abs/2608.12820
作者：Dharshi Balasubramaniyam,Tiroshan Madushanka
类目：Information Retrieval (cs.IR)
关键词：retrieving English government, English government information, Government Information Center, Lanka Government Information, employing Google Translate
备注：
点击查看摘要
Abstract:This paper presents a comparative evaluation of cross-lingual information retrieval (CLIR) methods for retrieving English government information using Sinhala and Tamil queries. Two CLIR paradigms are investigated: Query Translation (QT), employing Google Translate, NLLB, and mBART50, and Cross-Lingual Embeddings (CLE), using LaBSE, multilingual E5, and BGE-M3, with monolingual English retrieval as the baseline. Experiments are conducted on a human-verified benchmark comprising 500 Sinhala, Tamil, and English question-answer pairs derived from 1,699 segmented contexts from Sri Lanka's Government Information Center (GIC). Retrieval performance is evaluated using Recall@k (k = 1, 3, 5, 10, 15). Monolingual retrieval performs poorly (Recall@15 10%), whereas all CLIR approaches substantially improve retrieval accuracy. Among them, BGE-M3 achieves the highest Recall@15, reaching 96.2% for Sinhala-English and 95.6% for Tamil-English, outperforming the best QT approach (Google Translate: 92.4% and 93.0%) while avoiding translation overhead. These results demonstrate that multilingual embedding models provide a more effective and scalable solution for cross-lingual retrieval-augmented generation (RAG) in low-resource government domains.
12. 【2608.12812】A Comprehensive Empirical Evaluation of Vector Database Systems for Approximate Nearest Neighbor Search: Performance, Quality, and Resource Trade-offs
链接：https://arxiv.org/abs/2608.12812
作者：Ashen Rashmiks,Tiroshan Madushanka
类目：Information Retrieval (cs.IR)
关键词：artificial intelligence applications, modern artificial intelligence, semantic search, intelligence applications, retrieval-augmented generation
备注：
点击查看摘要
Abstract:Vector databases have emerged as critical infrastructure for modern artificial intelligence applications, particularly retrieval-augmented generation (RAG), semantic search, and recommendation systems. Despite their growing importance, there remains a significant gap in comprehensive, reproducible benchmarks that jointly evaluate retrieval quality, query latency, throughput, and resource utilization. We present a systematic empirical evaluation of seven prominent vector database systems: FAISS, Qdrant, Milvus, Weaviate, Chroma, pgvector, and LanceDB. Our methodology spans six diverse datasets, from classical computer-vision descriptors (SIFT, GIST) to transformer-based text embeddings (MS MARCO, GloVe), encompassing over 4 million vectors at dimensionalities from 96 to 960. We measure 15 metrics spanning retrieval quality (Recall@K, Precision@K, MRR, NDCG@K, Hit Rate@K), query performance (latency percentiles, QPS, cold-start latency), and resource consumption (index build time, memory, storage). On SIFT1M, FAISS achieves the highest single-node throughput (866 QPS) but lacks database operational features; Weaviate provides the best out-of-the-box recall ( 99%); Qdrant offers the best latency among full databases (4.55~ms median); and LanceDB trades retrieval quality for substantially faster index construction. We derive system-selection guidelines for practitioners and release our benchmarking framework as open-source software.
13. 【2608.12779】CRAFT: LLM-Based Iterative Refinement for Temporal Reasoning over Clinical Narratives
链接：https://arxiv.org/abs/2608.12779
作者：Chengyang He,Tahreem Arif,Marko Zivkovic,Lijing Wang,Yue Ning,Ping Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：safety surveillance, disease monitoring, causality assessment, critical for disease, clinical narratives
备注：
点击查看摘要
Abstract:Understanding the temporal progression of symptoms in clinical narratives is critical for disease monitoring, safety surveillance, and causality assessment. Clinical narratives, however, rarely provide explicit temporal anchors. Current approaches to temporal information reasoning focus predominantly on pairwise relation classification across multi-visit and timestamp-rich records, leaving the reconstruction of structured symptom trajectories from individual anchor-sparse reports largely unaddressed. We propose CRAFT, an LLM framework that pairs a generator with a constraint-based verifier to iteratively produce and refine stage-wise symptom timelines through targeted feedback. We conduct evaluation on MedTempo, a new benchmark of 5,347 vaccine adverse-event narratives spanning three COVID-19 vaccine types, with expert-validated temporal stage annotations for 3,166 reports. Experiments across four LLM backbones demonstrate that CRAFT consistently improves temporal ordering accuracy, with ablation analysis isolating the contribution of generator and verifier components across model capability levels.
14. 【2608.12778】DrEM: Dual-Side Robust Ensemble Ranking from Noisy User Preference Predictions in Video Recommendation
链接：https://arxiv.org/abs/2608.12778
作者：Canwei Huang,Tiantian He,Xiaoxiao Xu,Jun Zhang,Ziran Deng,Weike Pan,Chunjie Chen,Kaiqiao Zhan
类目：Information Retrieval (cs.IR)
关键词：Industrial video recommendation, Industrial video, video recommendation systems, recommendation systems typically, systems typically adopt
备注：
点击查看摘要
Abstract:Industrial video recommendation systems typically adopt a multi-stage architecture. At the ensemble ranking stage, multi-dimensional user preference predictions (pxtrs) from an upstream multi-task model are fused into a unified ranking score to reflect user satisfaction. Since users' true satisfaction is difficult to observe directly, ensemble ranking models commonly use pxtrs both as input features and as a source for constructing proxy preferences. However, as outputs of an upstream prediction model, pxtrs inevitably contain prediction noise, which propagates to downstream learning across two sides. On the supervision side, noisy pxtrs may flip proxy preferences and introduce erroneous gradients. On the feature side, pxtr noise may propagate through model inputs and destabilize ranking scores. Existing ensemble ranking methods typically treat pxtrs as reliable signals and overlook such prediction noise. To address this, we propose DrEM, a dual-side robust ensemble ranking framework. Our DrEM introduces a risk-denoising robust loss that corrects the empirical risk using estimated preference flip probability. Meanwhile, it samples perturbations from the distribution of prediction noise and introduces a preference-preserving ranking consistency regularizer to improve feature-side output stability. Theoretically, we obtain an approximate distribution of the prediction noise and prove that the robust loss remains superior under flip probability estimation error. Extensive offline experiments and large-scale online A/B tests demonstrate the effectiveness and robustness of our DrEM.
15. 【2608.12741】Knowledge Synthesis Review Framework: Task-Level Benchmarking of LLM-Based Systems for Multi-Source Evidence Synthesis
链接：https://arxiv.org/abs/2608.12741
作者：Wafa Shafqat,Mark Patterson,Steven N. Liss
类目：Information Retrieval (cs.IR)
关键词：timely synthesis difficult, making timely synthesis, rapidly evolving fields, industry reports, academic studies
备注：
点击查看摘要
Abstract:Evidence in rapidly evolving fields is fragmented across academic studies, industry reports, policy documents, and media sources that differ in quality, structure, and purpose, making timely synthesis difficult. Large language models (LLMs) may accelerate this work, but their reliability across the distinct cognitive tasks of a review remains uncertain. We introduce the Knowledge Synthesis Review (KSR), a human-in-the-loop framework that decomposes evidence synthesis into screening, extraction, analysis, and synthesis, benchmarks LLM-based systems on each task against expert reference standards, and routes each task to the best-performing system under continuous expert validation. We evaluated GPT-5, Claude Sonnet 4, Gemini 2.5 Pro, and NotebookLM on a 244-document benchmark subset drawn from a 1,893-document corpus on AI and work spanning four source types, against a gold standard with high inter-rater reliability (92.2% agreement, kappa = 0.80). No system led on all tasks. Claude Sonnet 4 achieved the highest screening accuracy (82.8%) and GPT-5 the highest recall (91.8%) at the expense of lower specificity. Extraction exceeded 90% agreement for titles and sources but degraded in author and reference fields. Performance declined most in interpretive analysis and cross-source synthesis, where expert judgment remained essential. A contamination check on post-cutoff documents showed no evidence that prior exposure inflated results. Applied to the full corpus, the routed workflow surfaced cross-source asymmetries and blind spots that single-source synthesis would miss, including worker well-being, small firms, and the Global South. KSR offers a transparent, auditable, model-agnostic framework for governing LLM assistance in research synthesis while preserving human accountability.
16. 【2608.12570】Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval
链接：https://arxiv.org/abs/2608.12570
作者：Najmeh Forouzandehmehr,Topojoy Biswas,Evren Korpeoglu,Kannan Achan
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：requires satisfying multiple, satisfying multiple attributes, requires satisfying, satisfying multiple, retrieval
备注：
点击查看摘要
Abstract:Fashion retrieval often requires satisfying multiple attributes at once, such as category, color, pattern, and demographic. Monolithic embeddings mix these signals into a single vector, making attribute-specific control difficult at retrieval time. Many existing semantic-ID methods provide discrete item codes, but these codes are typically optimized as item-level or residual addresses and do not expose named, independently controllable attribute slots. We introduce MM-slotgate, a multimodal slot encoder that factorizes Fashion-CLIP text and image embeddings into four named attribute slots. Each slot learns its own text-image gate, so visually grounded attributes such as color and pattern can rely more on image evidence, while taxonomy-oriented attributes such as category and demographic can remain more text-driven. On HM, using a combined slot-similarity and slot-logit retrieval score, MM-slotgate achieves 0.7566 macro ConstraintSatisfied@10, outperforming equal-weight multimodal fusion (0.7142) and fCLIP text-only retrieval (0.4755). The largest gain is on color, which improves from 0.321 to 0.889 (+0.568 absolute), as the learned color gate assigns 57.4% weight to image evidence. The learned gates are interpretable without modality supervision: color is image-leaning, category is text-leaning, and pattern and demographic lie near the middle. The resulting slots also remain controllable: linear probes show no measured excess leakage beyond the label-correlation baseline, and quantized slot codes support targeted intervention, including a 15.3x lift for color. These results suggest that controllable fashion retrieval benefits from typed, attribute-conditioned multimodal slots rather than either a single global embedding or opaque item-level semantic IDs.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.12570 [cs.CV]
(or
arXiv:2608.12570v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.12570
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Najmeh Forouzandehmehr [view email] [v1]
Wed, 12 Aug 2026 20:28:14 UTC (108 KB)
17. 【2608.12569】st-Time Optimization of Query Embeddings with Ranking Aware Reward Maximization
链接：https://arxiv.org/abs/2608.12569
作者：Tianyu Chen,Jiaxing Wu
类目：Information Retrieval (cs.IR)
关键词：Dense retrievers rank, Dense retrievers, retrievers rank documents, Dense, nDCG
备注：
点击查看摘要
Abstract:Dense retrievers rank documents using vector similarity between a frozen encoder and a precomputed index. While test-time ranking rewards from a reranker or LLM judge can improve results, existing methods discard this signal after a single query. Updating the retriever's weights makes rewards reusable, but this requires parameter access, which is unavailable for closed-source models, and is computationally prohibitive. We propose TTT-Embed (Test-Time Tuning of Embeddings), a framework that distills ranking rewards into a lightweight, learned vector within the output embedding space of a frozen model. This vector is optimized purely from scalar ranking scores assigned to the retriever's own candidate documents, requiring no access to model weights, ground-truth labels, or modifications to index. A single scope parameter controls rewards reuse (global, task, or query), enabling a principled trade-off between reusability and specificity under a fixed reward computation budget. We demonstrate that as the available reward budget scales, the optimal sharing scope shifts dynamically from global-wise to task-wise and finally to query-wise. Evaluated across five embedding models and 15 MTEB retrieval tasks, TTT-Embed improves test-time retrieval by up to +8.36 nDCG@10. Crucially, the learned states generalize effectively to unseen queries (up to +8.57 nDCG@10) and unseen tasks (up to +4.71 nDCG@10). Furthermore, TTT-Embed successfully resolves catastrophic forgetting: by leaving base weights entirely frozen, it recovers degraded general capabilities (up to +8.00 nDCG@10, even surpassing the original base model) while preserving in-domain specialization. These results establish ranking rewards as a reusable test-time state, enabling budget-efficient adaptation for any embedding model, including closed-source APIs.
18. 【2608.12532】MASCOT: Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval
链接：https://arxiv.org/abs/2608.12532
作者：Aaryan Sharma,Vishak Prasad C,Virendra Singh,Ganesh Ramakrishnan
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：semantically relevant images, retrieving semantically relevant, relevant images, retrieving semantically, semantically relevant
备注： 21 pages, 4 figures. Accepted at ACM Multimedia 2026 (MM '26), Rio de Janeiro, Brazil. Extended version with full appendices
点击查看摘要
Abstract:Vision-Language Models (VLMs) are highly effective in retrieving semantically relevant images. However, in practice, relevance alone is often insufficient. Systems must also achieve Result Diversification (RD) across composite attributes such as geography and time, a task for which precise control remains challenging. Current re-ranking methods, such as Multi-Source Determinantal Point Processes (MS-DPP), address this using manifold-based repulsion over similarity representations. Although this strategy is effective for broad exploration, it exposes a key limitation in manifold-based models: when subjected to diversity-decrease tasks on discrete metadata, they suffer substantial degradation in early-rank recall. To bridge this gap, we introduce MASCOT (Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval). Instead of relying on manifold repulsion, MASCOT formulates multi-attribute diversity as a resource allocation problem, projecting attributes into a soft-binning space weighted by query-driven importance. Averaged across the three PixelProse diversity-decrease tasks, MASCOT preserves an early-rank recall (R@10) of 88.58%, while MS-DPP retains 67.63%. The margin widens under composite constraints: on PP_geo_hour, where temporal and geographic diversity must be suppressed simultaneously, MS-DPP's recall collapses from 0.9737 to 0.4931 and its top-ranked result degrades to R@1 = 0.23, while MASCOT holds R@10 = 0.9410 and R@1 = 0.7202 at a diversity metric above the unconstrained baseline. We do not claim uniform superiority: on aggregate diversity-relevance scores our own simpler ablations attain higher harmonic means on all three decrease tasks, and MASCOT's advantage is specific to recall beyond rank 1 under composite constraints.
Comments:
21 pages, 4 figures. Accepted at ACM Multimedia 2026 (MM '26), Rio de Janeiro, Brazil. Extended version with full appendices
Subjects:
Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.12532 [cs.MM]
(or
arXiv:2608.12532v1 [cs.MM] for this version)
https://doi.org/10.48550/arXiv.2608.12532
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1145/3767308.3836500
Focus to learn more
DOI(s) linking to related resources</p>
19. 【2608.12428】MindMemOS: A Portable and Self-Evolving Memory Operating Layer for AI Agents
链接：https://arxiv.org/abs/2608.12428
作者：Kaichao Liang,Yuqi Cui,Hao Kong,Xinyuan Huang,Guohaotian Hou,Qingcan Kang,Liang Chen,Yiyang Yin,Ke Ye,Jiaquan Guo,Da Chen,Lingan Zeng,Yixing Peng,Rong Yao,Shixiong Kai,Mingxuan Yuan
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Information Theory (cs.IT)
关键词：maintain personalization, accumulate experience, long-term interactions, core component, Memory
备注： 35 pages,14 figures
点击查看摘要
Abstract:Memory is a core component of AI agents, enabling them to accumulate experience, maintain personalization, and adapt over long-term interactions. However, existing memory systems often remain fixed after development, limiting their ability to adapt their memory models, organization strategies, and procedural knowledge through continued use. We present MindMemOS, a portable and self-evolving memory operating layer that organizes open-world information using a unified entity property timestructure. MindMemOS supports scenario-adaptive memory modeling, higher-order pattern discovery, autonomous memory refinement, and continuous skill evolution. Its MindMemEvolve algorithm employs validation-driven evolutionary search to optimize memory schemas for target scenarios, whiledreaming consolidates accumulated memories by merging redundant records and resolving conflicts. In addition, implicit corrective feedback serves as a human-in-the-loop signal for identifying and revising potentially inaccurate or misaligned memories. Its MindSkillEvolve algorithm further transforms agent execution trajectories into reusable and progressively refined skills. MindMemOS achieves 94.03% accuracy on LOCOMO and 70.63% on PersonaMem. MindSkillEvolve improves SpreadsheetBench success by 9.2 percentage points over the initial-skill baseline.
计算机视觉
1. 【2608.13560】AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design
链接：https://arxiv.org/abs/2608.13560
作者：Yaxin Luo,Haobin Jiang,Jialv Zou,Xu Huang,Wenhao Yan,Haodong Li,Zhengrong Yue,Jing Li,Xiaofu Chen,Xiaohan Zhao,Jiacheng Liu,Jiacheng Cui,Zhiqiang Shen,Xiaotong Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Transforming multimodal sources, structured media outputs, agentic process centered, Transforming multimodal, long-horizon agentic process
备注： Tech Report. Code at: [this https URL](https://github.com/Yaxin9Luo/AutoDesign)
点击查看摘要
Abstract:Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal harness system should align with human design priors and accumulate reusable experience through empirical exploration to drive recursive self-improvement, existing paradigms remain static and fall short of this capability. In this paper, we present AutoDesign, a framework that aligns with human design priors, where a meta-harness optimizer guides a code agent to recursively improve harness based on rollout feedback. To instantiate and evaluate this framework, we focus on the academic paper-to-poster generation task and introduce PosterBench, comprising a 100-paper Main Track spanning five disciplines and PosterBench-mini, a shared 10-paper subset for controlled evaluation. On the PosterBench Main Track, AutoDesign achieves the highest score of 78.32, surpassing the closed-source commercial system Claude Design by 7.45 points. Across seven controlled code-agent-model configurations, integrating the learned DesignHarness consistently improves performance, increasing the average PosterBench Score from 54.99 to 67.39 (+12.4%). In a fully autonomous long-horizon loop, it executes 253 tool calls and 11 editing turns within 40 minutes for under $3, reaching average conference-poster quality in human evaluation. A system-blind human study further demonstrates that AutoDesign achieves the highest human preference among evaluated systems.
2. 【2608.13556】V-RAE: Rethinking Video Latent Spaces for Generation
链接：https://arxiv.org/abs/2608.13556
作者：Minghui Guo,Shengqiong Wu,Hao Fei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video, generative models operate, V-RAE, latent space, generation
备注： 26 pages, 8 tables, 13 figures, project page: [this https URL](https://v-rae.github.io/)
点击查看摘要
Abstract:Latent video generation relies on autoencoders to define a compact space in which generative models operate. Although video autoencoder architectures have evolved substantially, their latent spaces are still optimized primarily for pixel-level reconstruction and provide limited high-level semantic organization. A reconstruction-optimal latent space, however, need not be well suited to generative modeling. We propose V-RAE, a video representation autoencoder that builds compact generative latents on top of frozen vision foundation model representations. A lightweight temporal pooling module removes temporal redundancy while preserving semantic structure, and a video decoder reconstructs continuous motion from the compressed features. We evaluate V-RAE with four representative frozen encoders on video reconstruction, semantic probing, and class-conditional generation. V-RAE achieves 2.13 rFVD on K600, outperforming all evaluated large-scale pretrained video VAEs. Its latents retain substantially more semantic information than conventional video tokenizer latents. Under matched generation settings, our best variant achieves gFVD scores of 117.86 and 19.16 on UCF101 and K600, respectively, while converging up to 6x faster}. We further show that reconstruction quality alone is insufficient to characterize generative utility and introduce tFVD, a temporal-coherence diagnostic that correlates more reliably with downstream generation quality. Beyond video generation, V-RAE also improves future video prediction on Cityscapes over the Wan 2.2 VAE latent space under matched prediction settings. Taken together, the experiments show that frozen semantic representations can support video reconstruction, generation, and predictive modeling. The project page: this https URL.
3. 【2608.13555】HumanTracker: Towards Comprehensive and Human-Aligned Motion Tracking Benchmark
链接：https://arxiv.org/abs/2608.13555
作者：Dairu Liu,Zekun Qi,Jiayu Zeng,Ruixi Yu,Yu Guan,Yintianrun Zhang,Xuchuan Chen,Sikai Liang,Zekai Li,Chenghuai Lin,Xinqiang Yu,Wenyao Zhang,He Wang,Li Yi
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：whole-body imitation, perceive in videos, central to teleoperation, teleoperation and whole-body, people perceive
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Humanoid motion tracking is central to teleoperation and whole-body imitation, yet evaluation often disagrees with what people perceive in videos. Kinematic errors average per-frame pose differences but miss the physical artifacts that matter most, particularly unstable support and incorrect contacts such as foot skating and mistimed touch-downs. Meanwhile, widely used test suites are small and lack the diversity needed to stress contact-rich, long-horizon behaviors. We introduce HumanTracker to make humanoid tracking evaluation both perceptually aligned and scalable. The HumanTracker benchmark contains approximately 153 hours of optical motion trajectories from multiple professional performers, organized into four motion families with text labels for fine-grained diagnosis. We further propose HumanScore, a preference-aligned metric trained on 12K motion pairs containing 24K motions. Across representative state-of-the-art trackers, HumanScore better predicts human preferences and reveals contact and stability failures that kinematic metrics often miss.
4. 【2608.13552】PlayWorld: Benchmarking World Models with Agent Players over Long-Horizon Objectives
链接：https://arxiv.org/abs/2608.13552
作者：Kaixin Ding,Xi Chen,Minghong Cai,Zhiyuan Xu,Yiyang Wang,Yuxiang Lu,Junyi Li,Shuyang Chen,Yuan Gao,Xin Tao,Pengfei Wan,Hengshuang Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：models simulate future, simulate future states, future states conditioned, simulate future, models
备注： project page: [this https URL](https://kxding.github.io/project/PlayWorld/)
点击查看摘要
Abstract:Video world models simulate future states conditioned on current observations and user actions. Recent systems have demonstrated impressive video consistency and action controllability over long sequences. However, fairly comparing these interactive models remains challenging. In practice, a human player typically evaluates a world model by pursuing long-horizon objectives through interaction. For example, a user may turn around 360 degrees to see whether the environment remains consistent, or walk into the water and inspect whether realistic water ripples are generated. The action sequence required to achieve the same objective may vary substantially between models, making fixed action-conditioned evaluation unsuitable for cross-model comparison. To address this, we employ multi-modal Agent Players to interact with world models toward specified long-horizon objectives. Building on this paradigm, we introduce PlayWorld, a benchmark providing 171 scenarios, each with a specified objective. To evaluate performance thoroughly, we assess models along four core dimensions: geometry consistency, interaction fidelity, out-of-sight evolution, and insight evolution. In addition, we incorporate basic ability metrics for video quality and controllability. Experiments across nine state-of-the-art world models reveal that current models remain unreliable on long-horizon interactive objectives, particularly in maintaining spatial consistency and persistent state evolution. Code and data are available at this https URL.
5. 【2608.13546】Alaya-EVOKE: From Linear-Scaling Supervision to Endless World
链接：https://arxiv.org/abs/2608.13546
作者：Yuanyang Yin,Gongxuan Wang,Yifan Zhan,Chuanhao Li,Kaipeng Zhang,Feng Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requirements place conflicting, place conflicting demands, requirements place, place conflicting, conflicting demands
备注：
点击查看摘要
Abstract:Interactive world models must support persistent memory, responsive interaction, and long-horizon generation, yet these requirements place conflicting demands on the model. Maintaining history in the denoiser context or key-value cache incurs growing cost, forcing a trade-off between session length and retained memory, while low-latency interaction relies on few-step generation whose capabilities are bounded by its teacher. Evoke addresses both limitations by externalizing persistent world state and redesigning the teacher for long-horizon interactive generation. Scene geometry is maintained in an external, camera-indexed world state bank, from which only view-relevant information is retrieved, keeping the denoiser context bounded as the session grows. Rather than treating the teacher as a fixed generator, we design it for long-horizon supervision: its sparse attention combines chunk-wise grouping, retrieval of selected distant frames, and a linear-attention global state, yielding linear growth in memory and compute while enabling supervision over long horizons. Such supervision exposes content drift that stays locally plausible within short windows, while per-chunk conditioning enables prompt changes and event control throughout the sequence. A 30-second distribution-matching objective, applied under self-forced rollouts, transfers both capabilities to a three-step student that uses no classifier-free guidance, improving resistance to long-term drift while preserving responsive conditioning. With bounded context and recurrent external memory, Evoke supports open-ended, continuously evolving generation; on a single H200 at $384\times 640$, each $1.5\,\mathrm{s}$ chunk is generated in $2.11\,\mathrm{s}$. As a three-step world model, Evoke achieves state-of-the-art performance on WBench while remaining competitive on VBench-Long and VBench-2.0.
6. 【2608.13541】SCULPT: Subtractive Composition for 3D Part Generation
链接：https://arxiv.org/abs/2608.13541
作者：Sikuang Li,Chen Yang,Jiemin Fang,Jiazhong Cen,Yuhe Wei,Jichen Pang,Wei Shen,Qi Tian
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：create digital assets, exposing structural parts, aims to create, create digital, digital assets
备注： Project page: [this https URL](https://sculpt-part.github.io/) Code: [this https URL](https://github.com/sculpt-part/SCULPT)
点击查看摘要
Abstract:Part-aware 3D generation aims to create digital assets that are coherent as complete objects while exposing structural parts for editing, material assignment, animation, and reuse. Existing methods impose this structure outside the native generation loop: segmentation-based methods partition an already generated shape, while additive methods synthesize parts from predefined layouts, boxes, or tokens and then reconcile them into a whole. The former preserves the generated geometry but fixes the object before part boundaries are determined; the latter exposes part cardinality but often leaves shared boundaries vulnerable to gaps, interpenetrations, and material discontinuities. In this paper, we propose SCULPT, a framework that addresses these challenges through subtractive composition. Given a complete object represented in a structured 3D latent space, SCULPT iteratively applies a joint split predictor to generate one extracted part together with the remaining object. The predictor performs a coupled denoising process conditioned on both the image and the current 3D state, so the extracted part and updated remainder are generated together rather than reconciled after generation. The joint split predictor processes both outputs on the union of their native sparse 3D supports, allowing neighboring supports to overlap rather than imposing a disjoint voxel partition. The rollout ends when the remainder support becomes empty or reaches a fixed safety cap, allowing the number of generated parts to adapt to each object within that bound. Extensive experiments demonstrate state-of-the-art geometry on PartObjaverse while preserving strong complete-object reconstruction after part assembly. Results on four dataset images, one text-to-image-generated input, and one real-world photograph further show fine-grained textured part decomposition beyond the benchmark.
7. 【2608.13518】Intervention-Aware Clinical World Model for Post-Op Outcome Forecasting in Cardiology
链接：https://arxiv.org/abs/2608.13518
作者：Yunsung Chung,Yingshuo Liu,Abboud F. Hassan,Han Feng,Mary M. Maleckar,Nassir Marrouche,Jihun Hamm
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：treat post-intervention outcomes, future endpoint, one-step mapping, models treat post-intervention, treat post-intervention
备注： Medical World Models (MWM) Workshop at MICCAI 2026
点击查看摘要
Abstract:Many clinical prediction models treat post-intervention outcomes as a one-step mapping from baseline measurements to a future endpoint. However, recovery after a procedure often unfolds as an irregular trajectory: clinical observations, medication changes, repeat interventions, and physiological measurements are recorded asynchronously and can change risk assessment over time. We propose an intervention-aware clinical world model that represents each patient with a structured latent state and evolves it through time-ordered post-intervention events. The model first encodes baseline imaging into a 3D spatial latent state. It then updates this state using procedural context, static covariates, elapsed time, and peri-event physiological embeddings. Follow-up imaging provides training-only supervision through a latent forecasting objective. We apply the framework to atrial fibrillation ablation. During the 90-day recovery window, irregular post-procedure records provide clinically meaningful evidence for long-term recurrence risk. In repeated internal cross-validation on DECAAF-II, our model achieves AUROC 0.756 and AUPRC 0.777 for recurrence prediction. It also achieves a scar-extent MAE of 2.971 percentage points without requiring follow-up MRI intensities at inference. The learned state supports recurrence-risk queries at different horizons and retrospective input editing of blanking-period records.
8. 【2608.13513】abSOM: A tabular-to-image encoding method based on self-organizing maps
链接：https://arxiv.org/abs/2608.13513
作者：David Chushig-Muzo,María Ángeles Rodríguez de Cara,Eva Milara,Francisco J. Lara-Abelenda,Luis Zhinin-Vera,Diego H. Peluffo-Ordóñez
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：convolutional neural networks, high predictive performance, vision transformers, leverage the high, high predictive
备注：
点击查看摘要
Abstract:Tabular-to-image methods have emerged as novel approaches to leverage the high predictive performance of convolutional neural networks and vision transformers. They convert tabular data into image representations, mapping each feature at a fixed pixel location derived from a dimensionality-reduction method (e.g., t-SNE, UMAP, PCA). However, they encode only the marginal value of each feature and discard information about feature relationships. We propose TabSOM, a tabular-to-image encoding built on the Self-Organizing Map (SOM), which provides: (i) a spatial layout in which every input feature occupies a fixed canvas position derived from its component plane via collision-free Hungarian assignment; and (ii) a graph that captures pairwise feature relationships derived from the SOM component planes. The resulting image stacks two multi-scale node channels: one encodes feature values at fixed scales, while the other encodes pairwise feature interactions as spatial connections between related features. Two SOM-derived interpretability approaches are introduced: a prototype-inspired partial dependence plot and a class--separation importance score. Benchmarked against twelve existing tabular-to-image methods across public binary-classification datasets, TabSOM ranks first or second on every dataset and achieves the lowest variance of any method evaluated. Interpretability obtained with TabSOM was validated against Random Forest, XGBoost, and SHAP, the class-separation score shows reasonable agreement with established baselines on the top-ranked features while capturing complementary structural information from input data. These results demonstrate that TabSOM provides an effective and interpretable approach for applying deep learning architectures to tabular data, bridging the performance--interpretability gap in this domain.
9. 【2608.13505】Intern-S2-Preview: Scientific Agentic Foundation Model
链接：https://arxiv.org/abs/2608.13505
作者：Lei Bai,Jiaqi Cao,Chiyu Chen,Guanzhou Chen,Kai Chen,Guangran Cheng,Erfei Cui,Xuanlang Dai,Shengyuan Ding,Shangheng Du,Yanhui Duan,Yue Fan,Youqing Fang,Quan Gan,Yuanyuan Gao,Jiaye Ge,Lixin Gu,Yuzhe Gu,Qipeng Guo,Junjun He,Xin Hong,Ming Hu,Zhouqi Hua,Haian Huang,Junhao Huang,Zixian Huang,Minxi Jin,Lingkai Kong,Alexander Lam,Zehao Li,Zonglin Li,Tianhao Liang,Dahua Lin,Junyao Lin,Tianyang Lin,Zhouhan Lin,Jiangning Liu,Jin Liu,Kuikun Liu,Wenran Liu,Yifei Liu,Yuhong Liu,Yuhong Liu,Zhoumianze Liu,Ziyan Liu,Ziyu Liu,Haijun Lv,Han Lv,Chengqi Lyu,Le Ma,Ningsheng Ma,Zerun Ma,Haoyang Peng,Runyu Peng,Jifei Shan,Zixin Shang,Kou Shi,Xiang Shi,Qisheng Su,Xuerui Su,Hao Sun,Xiao Sun,Yanan Sun,Yu Sun,Huanze Tang,Yinghao Tang,Wenhui Tian,Zhongbo Tian,Bingli Wang,Haomin Wang,Jiarui Wang,Jingzhi Wang,Rui Wang,Xiquan Wang,Yi Wang,Zhecan Wang,Ziyi Wang,Zun Wang,Rubin Wei,Lianyi Wu,Wen Wu,Yue Wu,Yuhan Wu,Zhenyu Wu,Zijian Wu,Shuhao Xing,Jun Xu,Xingle Xu,Xuenan Xu,Xiangchao Yan,Ziang Yan,Bowen Yang,Danni Yang,Lin Yang,Zhiqi Yang,Qian Yao,Haochen Ye,Peng Ye,Jinhui Yin,Jiashuo Yu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：discovery increasingly requires, long task horizons, Scientific discovery increasingly, heterogeneous modalities, tools and environments
备注： 35 pages, 12 figures
点击查看摘要
Abstract:Scientific discovery increasingly requires AI systems that can reason over scientific evidence of heterogeneous modalities, interact with scientific tools and environments, and sustain progress across long task horizons. We present Intern-S2-Preview, a series of scientific agentic foundation models designed to support multimodal scientific understanding, reasoning, generation, and long-horizon tasks. The training pipeline begins with scientific multimodal pre-training over rendered scientific documents, interleaved image-text data, and diverse scientific corpora. Starting from the pretrained checkpoint, we apply a unified post-training pipeline consisting of supervised fine-tuning, scalable multi-task reinforcement learning (RL), black- and white-box agentic RL, and on-policy distillation. This pipeline is supported by practical techniques that improve rollout and training stability and efficiency, including partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization, and trace-aware experience assembly for agentic tasks. At the architecture level, Intern-S2-Preview-397B extends time series modelling from efficient long-sequence understanding to numerical forecasting, while Memory Decoder is studied as a separate memory-augmented path for rapid scientific specialization without modifying the frozen 397B backbone. Evaluations across scientific, multimodal, agentic, and general-purpose benchmarks show that Intern-S2-Preview-397B achieves competitive or leading results in multiple settings. The time series modules improve scientific signal understanding and forecasting on SciTS, while the separate Intern-MemDec-4B extension improves the Biology-Instructions average score from 56.92 to 60.32 without modifying the frozen 397B backbone.
10. 【2608.13502】GS$^{2}$CI: Robust Gaussian Splatting For Snapshot Compressive Imaging via Large Vision Model Priors
链接：https://arxiv.org/abs/2608.13502
作者：Yanming Yang,Chenxi Song,Ping Wang,Xin Yuan,Chi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Snapshot Compressive Imaging, Snapshot Compressive, Compressive Imaging, high-speed video acquisition, scene relative motion
备注：
点击查看摘要
Abstract:Snapshot Compressive Imaging (SCI) offers an efficient solution for high-speed video acquisition and, under exposure-time camera--scene relative motion, multi-view scene capture by compressing temporal or spatial information into a single 2D measurement. While recent studies have explored SCI for 3D scene reconstruction, existing methods struggle with significant challenges due to information loss, limited viewpoint diversity, and the computational burden of jointly optimizing 3D representations and camera poses. In this work, we propose a novel framework that reconstructs high-quality 3D scenes from a single SCI measurement by leveraging 3D Gaussian Splatting (3DGS) and the powerful priors of large-scale vision foundation models (VFMs). Our primary reconstruction combines measurement-derived 3D VFM initialization with SCI-aware Gaussian optimization. After coarse-stage convergence, an auxiliary 2D VFM provides pseudo-view supervision at synthesized viewpoints for local appearance refinement. To further address the instability caused by ambiguous SCI supervision during 3DGS optimization, we introduce Opacity-Guided Splitting and Growth Regulation (OSGR), an SCI-specific densification strategy that augments split candidates using local opacity statistics, discourages loss-compensating opacity inflation through mean-opacity regulation, and bounds representation growth with explicit candidate-ratio and Gaussian-count constraints. Extensive experiments across multiple benchmarks demonstrate that our method achieves the strongest overall performance, combining leading reconstruction quality and robustness to viewpoint variation with competitive computational efficiency.
11. 【2608.13495】raVEL: Trajectory-Guided Video Embedding Learning for Driving-Video Retrieval
链接：https://arxiv.org/abs/2608.13495
作者：Yi-Chung Chen,Philip Jacobson,Tom Lampo,Yiren Lu,Jin Yao,David I. Inouye,Jing Gao,Danhua Guo,Burhan Yaman
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Efficiently retrieving relevant, Efficiently retrieving, large-scale driving logs, retrieving relevant clips, safety analysis
备注：
点击查看摘要
Abstract:Efficiently retrieving relevant clips from large-scale driving logs is essential for data curation, model development, and safety analysis. Structured and rule-based retrieval systems can explicitly target driving events, but typically require expert-defined rules, auxiliary data, and multi-stage perception pipelines. Multimodal embedding models offer a simpler and more efficient alternative by representing each video with a single searchable vector. However, general-purpose models often rely on shortcuts from static scene context and struggle to distinguish motion-centric events, such as turning left versus right or accelerating versus decelerating. In this work, we study how to adapt a general-purpose multimodal embedding model to driving-video retrieval. We first fine-tune Qwen3-VL-Embedding on paired clips and reasoning traces from nuReasoning using an InfoNCE objective. While this stage substantially improves overall retrieval, caption supervision alone remains insufficient for fine-grained motion understanding. We therefore introduce TraVEL (Trajectory-Guided Video Embedding Learning), a motion-aware fine-tuning framework that uses ego-trajectory similarity as a reward within Group Relative Policy Optimization. Trajectories serve only as privileged training supervision; retrieval still operates on single-vector video embeddings without ego poses, expert rules, or auxiliary perception outputs. We further construct a driving-video retrieval benchmark from nuReasoning. Experiments show that TraVEL improves motion-centric retrieval across model scales: relative to SFT, it raises longitudinal and lateral mAP by 9.8 and 4.7 points at 2B, with corresponding gains of 7.2 and 1.5 points at 8B. TraVEL thus combines physically grounded supervision with efficient embedding-based search.
12. 【2608.13489】DreamX-Phi 1.0: Action-Conditioned Video World Model for Robotic Manipulation
链接：https://arxiv.org/abs/2608.13489
作者：DreamX Team,Rui Chen,Xiangxiang Chu,Geng Li,Jifan Li,Qingfeng Shi,Datao Tang,Jing Tang,Jun Wang,Pengfei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：resulting future observations, action-conditioned video world, sequence comprising end-effector, comprising end-effector poses, prescribed action sequence
备注： Code: [this https URL](https://github.com/AMAP-ML/DreamX-Phi)
点击查看摘要
Abstract:We present \textbf{DreamX-Phi 1.0}, an action-conditioned video world model for robotic manipulation that, given an observed frame, a language instruction, and a prescribed action sequence comprising end-effector poses and gripper states, predicts the resulting future observations. Yet realism alone does not guarantee faithfulness: a convincing rollout can still move the wrong arm or lose the manipulated object. To ensure the prediction respects each arm's commanded path, we inject per-arm $\mathrm{SE}(3)$ transformations into attention via \textbf{PRoPE-style geometric encoding}, preserving arm identity and rigid-motion structure. Action control alone does not fully constrain scene geometry or the evolution of small manipulated objects. We therefore add a lightweight \textbf{depth branch} for scene-level geometry and use \textbf{SAM3 masks} with a frozen \textbf{V-JEPA teacher} to maintain object consistency throughout grasping. We further distill the multi-step generator into a few-step student via distribution-matching distillation for efficient deployment. At the time of writing, \model{} achieves first place on Track~1 and second place on Track~2 of the WorldArena~2.0 Challenge. Our model and code will be publicly available.
13. 【2608.13478】MapRoute++: Surrogate-Guided Semantic Routing for Visual Concept Unlearning
链接：https://arxiv.org/abs/2608.13478
作者：Ashok Urlana,L. D. M. S. Sai Teja,Vivek Hruday Kavuri,Ponnurangam Kumaraguru
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：submission to Task, Challenge on visual, visual concept unlearning, present our submission, Task
备注： Accepted at Unlearning and Model Editing Workshop, ECCV 2026
点击查看摘要
Abstract:We present our submission to Task 3 of the Gen$\mu$ 2.0 Challenge on visual concept unlearning. Building on MapRoute, we introduce task-specific training objectives, richer concept representations, and semantic routing for concept-specific mapper selection. Our approach improves robust concept removal while preserving unrelated and semantically adjacent concepts. On the official benchmark, evaluated using the Erasing-Retention-Robustness (ERR) metric on Stable Diffusion v1.4, our method outperforms the state-of-the-art baseline by 12.1\% on average across the five concept categories, achieving substantial gains.
14. 【2608.13463】MLLM-Routed Heterogeneous Ensembles for Robust Cross-Dataset Image Classification
链接：https://arxiv.org/abs/2608.13463
作者：Daniel Perkins,John Squires,Janou Milligan,Chandra Raskoti,Linda Ungerboeck
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Modern image classification, single task-specific datasets, Modern image, difficulty levels, single task-specific
备注： 8 pages, 4 figures, 7 tables
点击查看摘要
Abstract:Modern image classification models excel when trained on single task-specific datasets but often struggle to generalize across domains and difficulty levels. We propose ARMDIL, an Adaptive Router for Multi-Domain Image classification with LLMs. ARMDIL is an ensemble that uses a multimodal large language model (MLLM) agent to dynamically route each image to the most suitable vision backbone. Our diverse ensemble employs convolutional neural networks (ResNets), self-supervised representation learners (SSL), and vision-language models (VLMs), each trained on a unified label space constructed from multiple image datasets with differing distributions and characteristics. Empirical evaluations illuminate the distinct capabilities and vulnerabilities of each architecture across disparate visual domains. Crucially, we show that ARMDIL effectively navigates these trade-offs, performing competitively with specialized training-based routers. Furthermore, it drastically improves adaptability by allowing new information to be integrated via simple prompt modifications, while enhancing interpretability through natural language reasoning traces. These advances in cross-dataset image classification pave the way for more reliable general-purpose vision systems such as AI assistants and autonomous robots.
15. 【2608.13460】SNM-VFI: Symmetric Nonlinear Motion-Guided Generative Video Frame Interpolation
链接：https://arxiv.org/abs/2608.13460
作者：Jisoo Jeong,Hong Cai,Jamie Menjay Lin,Hanno Ackermann,Hyeonjun Sim,Yinhao Zhu,Yunxiao Shi,Fatih Porikli
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Symmetric Nonlinear Motion-guided, Motion-guided Generative Video, Nonlinear Motion-guided Generative, Video Frame Interpolation, propose Symmetric Nonlinear
备注： ECCVW 2026
点击查看摘要
Abstract:We propose Symmetric Nonlinear Motion-guided Generative Video Frame Interpolation (SNM-VFI), a training-free framework for motion-controllable generative video frame interpolation with pre-trained optical flow and video diffusion models. Unlike conventional diffusion-based VFI methods that synthesize intermediate frames from random noise, SNM-VFI guides the generative process with correspondence-aware frames produced by a symmetric nonlinear motion model. Specifically, we first utilize a pre-trained optical flow model to construct multi-frame nonlinear flow-based intermediate frames and confidence maps. These flow-guided frames are then encoded as latent priors to initialize and iteratively guide a pre-trained Video Diffusion model, enabling the diffusion model to preserve dense motion correspondence while improving perceptual realism. To further enhance output quality, we employ confidence maps to fuse structurally reliable flow-based predictions with diffusion-generated details in uncertain regions such as occlusions and object boundaries. Extensive evaluations on challenging benchmarks, including DAVIS, Sintel, and KITTI, demonstrate that SNM-VFI achieves strong perceptual quality, competitive reconstruction accuracy, and robust temporal coherence across diverse motion scenarios.
16. 【2608.13458】Fine-Grained Action Recognition with Cross-Attentive Latent Sparse Experts
链接：https://arxiv.org/abs/2608.13458
作者：Imtiaz Ul Hassan,Tasweer Ahmad,Nik Bessis,Ardhendu Behera
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human action recognition, distinguish visually similar, visually similar actions, Fine-grained human action, body configuration
备注：
点击查看摘要
Abstract:Fine-grained human action recognition (FHAR) must distinguish visually similar actions that differ mainly in body configuration, timing, or local appearance. RGB representations retain visual context but often suppress joint-level geometry, whereas skeleton representations encode kinematics but discard dense spatial detail. We introduce FineX, which factorizes fine-grained cues into RGB appearance, pose heatmap geometry, and skeletal-graph topology. Pairwise cross-attention enables symmetric, stream-preserving information exchange, followed by a streamwise latent sparse Mixture-of-Experts that routes each representation to a content-dependent subset of shared experts, regularized by a load-balancing objective. FineX achieves state-of-the-art results on Gym99, Gym288, and Diving48. On the long-tailed Gym288, it raises mean class accuracy from 68.6% to 76.2% (+7.6 points) without textual supervision or large-scale vision-language pre-training, demonstrating the benefit of structured visual-pose-graph fusion and conditional expert refinement for FHAR.
17. 【2608.13456】A Unifying Perspective on Causal World Models: From Observations to Representations to Structure
链接：https://arxiv.org/abs/2608.13456
作者：Avinash Kori,Fabrizio Russo
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：training distribution, foundation for intelligent, intelligent agents, causal, World Models
备注：
点击查看摘要
Abstract:World Models (WM) are increasingly seen as a foundation for intelligent agents that can predict, plan, and act beyond their training distribution. In this paper, we study WMs from a causal perspective across multiple levels of abstraction, ranging from perceptual observations to building a conceptual representation of the structure governing the environment dynamics. We argue that useful WMs must go beyond generative capabilities alone: they should also capture entity properties, entity-to-entity interactions, and entity-to-environment interactions that determine and explain the dynamics of a system. We provide a formal definition of Causal WMs (CWMs) grounded in the tasks they are intended to support, connecting world modelling with existing work in causal representation learning, object-centric learning, causal discovery, structural causal models, and model-based decision-making. Finally, we relate CWMs to the literature on identifiability, clarifying when the components of a WM can be recovered from data and up to which equivalence. With this, we ground WMs in representations and structures that support causal reasoning and informed decision-making.
18. 【2608.13455】Evaluation of Clinically Steerable Retinal Image Generation from Foundation Model Latent Spaces
链接：https://arxiv.org/abs/2608.13455
作者：Zuzanna A. Wakefield-Skórniewska,Bartłomiej W. Papież
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Medical foundation models, remains largely unexplored, Medical foundation, clinically meaningful phenotypes, foundation models learn
备注： MICCAI 2026 Workshop SASHIMI Submission
点击查看摘要
Abstract:Medical foundation models learn latent representations of clinically meaningful phenotypes, yet their ability to support controllable image generation remains largely unexplored. We evaluate four retinal foundation models within the representation tokenizer framework and examine whether demographic and clinical information encoded in latent representations from foundation models is preserved during synthetic image generation. We show that generated representations and images faithfully inherit phenotype information when evaluated within their originating foundation models, consistently outperforming conventional latent diffusion on multiple downstream prediction tasks. However, these gains largely disappear when evaluated using classifiers trained on real images, revealing a previously uncharacterised synthetic-to-real representation gap. These findings demonstrate that foundation-model latent spaces provide a powerful substrate for controllable retinal synthesis while highlighting the need to better align synthetic representations with real-image distributions.
19. 【2608.13453】UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Models
链接：https://arxiv.org/abs/2608.13453
作者：Yukun Dai,Mingzhe Dai,Tianshi Wang,Fengling Li,Jingjing Li,Lei Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：generalist robotic policies, robotic policies capable, models have emerged, emerged as generalist, performing a wide
备注：
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have emerged as generalist robotic policies capable of following diverse language instructions and performing a wide range of manipulation tasks. However, their direct control over embodied agents also exposes them to adversarial interference that may cause unsafe physical behaviors. Existing attacks on robotic policies are typically optimized for a single task or instruction, leaving the cross-task vulnerabilities of multitask VLAs largely unexplored. We introduce UniTexture, a cross-task universal adversarial texture attack that uses a single textured 3D object to induce targeted deviations in VLA action predictions across multiple tasks. UniTexture backpropagates gradients from the policy's action outputs to surface texture parameters through a differentiable renderer. It jointly optimizes the shared texture over a distribution of tasks, instructions, states, and viewpoints using a targeted action-space objective, steering predicted actions toward attacker-defined targets without optimizing a separate texture for each task. We evaluate UniTexture on OpenVLA and $\pi_{0.5}$ across diverse manipulation tasks and multiple evaluation settings. UniTexture reduces the mean task success rate from 90.0% under benign conditions to 48.4% under attack, induces target-aligned action shifts, and further exhibits cross-suite and cross-model transfer without re-optimization. Together, these findings reveal shared cross-task vulnerabilities in multitask VLAs that can be systematically exploited through a single adversarial surface texture.
20. 【2608.13441】Edit2TikZ: A Comprehensive and Challenging Benchmark for Scientific Figure Editing with TikZ
链接：https://arxiv.org/abs/2608.13441
作者：Zongyun Zhang,Jiacheng Ruan,Xian Gao,Ruizhu Zhou,Lingcheng Meng,Lining Hu,Ting Liu,Yuzhuo Fu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, shown substantial potential, generate compilable code, scientific figure editing, recover visual structure
备注： 9 pages, 6 figures, work in progress
点击查看摘要
Abstract:Although multimodal large language models (MLLMs) have shown substantial potential in visual understanding and graphic code generation, editing scientific figures through code presents a greater challenge: a model must jointly recover visual structure, ground the requested change, generate compilable code, and preserve all unrelated content. While existing TikZ benchmarks mainly focus on figure reconstruction and generation, few systematically evaluate instruction-guided scientific figure editing with compilable code. We introduce Edit2TikZ, a comprehensive benchmark for scientific figure editing tasks, featuring 1,548 diverse and high-quality samples. Edit2TikZ combines real-world and controlled synthetic edit cases, supports both textual and visual localization request, and contains multi-step editing, each with step-level annotations. We further construct a human-aligned evaluation framework to measure whether a requested edit is completed while irrelevant content is preserved. Utilizing Edit2TikZ, we evaluate 14 mainstream MLLMs and find that current systems remain unreliable: on average, proprietary models achieve a compilation success rate of merely 75% and remain limited in both figure restoration and edit correctness, while compact models below 9B struggle further with instruction following and complete figure generation. Therefore, we build a mixed training set TikZEditMix and adopt reconstruction-then-editing curriculum learning for compact models. On Qwen3.5-4B, this training improves the compilation success rate from 45.35% to 83.40% and yields an average improvement of 18.7 points across our proposed evaluation metrics. The code and data will be released at this https URL.
21. 【2608.13438】ContactGuard: Pre-Contact Execution Monitoring with Action-Conditioned Latent World Models
链接：https://arxiv.org/abs/2608.13438
作者：Gehan Zheng,Matthew Johnson-Roberson,Weiming Zhi
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：ContactGuard, ContactGuard predicts, Contact-rich manipulation, contact, latent
备注： 14 pages, 5 figures, 8 tables
点击查看摘要
Abstract:Contact-rich manipulation failures are often detected only after the robot has committed to contact. This is especially limiting in wrist-camera setups: close gripper--object views help observe contact, but a poor approach may already push, miss, slip, or disturb the object before conventional detectors react. We introduce \emph{ContactGuard}, a pre-contact execution monitor for chunked visuomotor policies. Given the policy's planned action chunk, ContactGuard predicts its short-horizon consequence in latent visual space and aborts if the predicted future latent indicates likely failure. Its latent world model is trained from unlabelled robot trajectories to predict compact multi-view visual embeddings under planned actions, avoiding pixel-level video prediction. A lightweight failure probe is then trained from a small labelled set of pre-contact clips. At deployment, ContactGuard anchors prediction before an imminent contact event, rolls the model forward under the policy's own actions, and verifies the predicted post-contact latent. Across real-world contact-rich manipulation tasks, ContactGuard predicts failure more accurately than direct and corrupted-action ablations, and transfers to live robot as a pre-contact abort signal without modifying the underlying policy.
22. 【2608.13416】StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMs
链接：https://arxiv.org/abs/2608.13416
作者：Joya Chen,Zeyun Zhong,Mike Zheng Shou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Humans effortlessly perceive, Humans effortlessly, remembering the past, long-term memory, effortlessly perceive
备注：
点击查看摘要
Abstract:Humans effortlessly perceive the present while remembering the past, yet streaming VLMs often trade off real-time perception against long-term memory. Prior work shows that shortening the context can sharpen current-scene perception at the expense of long-range recall. To reconcile these abilities, we introduce StreamTTT, which writes long-range history into online-updated fast weights outside the attention context. This leaves a short sliding key-value cache dedicated to recent evidence, mitigating attention dilution. We train StreamTTT jointly on offline long-video QA and a newly constructed real-time QA corpus. On OVO-Bench, StreamTTT-4B outperforms SimpleStream-4B by 1.4 points in real-time perception and 3.7 points in backward tracing. It also remains competitive with the larger SimpleStream-8B on the Real-Time Visual Understanding (RTVU) subset of StreamingBench. Our code will be released.
23. 【2608.13391】Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation
链接：https://arxiv.org/abs/2608.13391
作者：Hmrishav Bandyopadhyay,Xuanchi Ren,Zijian Huang,Jay Zhangjie Wu,Tianshi Cao,Ruilong Li,Bryan Chu,Sanja Fidler,Yi-Zhe Song,Zian Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Interactive autoregressive video, Interactive autoregressive, precise online control, demands both low-latency, causal
备注： Project Page: [this https URL](https://hmrishavbandy.github.io/cmd-site/)
点击查看摘要
Abstract:Interactive autoregressive video generation demands both low-latency rollouts and precise online control. Few-step distillation accelerates generation by reducing denoising steps, while online control imposes a causal constraint: frames and blocks should depend on history and controls available during generation. Existing video distribution matching distillation (DMD) pipelines, however, often supervise causal few-step students using bidirectional teachers that score complete clips. The score for a target can therefore depend on future frames and controls that were unavailable when the student generated it, misaligning teacher supervision with the student's causal information set. We introduce Context-Matched Distillation (CMD), a causal DMD framework that aligns teacher supervision with the information available when each target is generated. CMD replaces bidirectional full-clip scoring with a causal teacher that evaluates each target without access to future frames or controls. The same causal teacher initializes the few-step student, establishing a consistent causal formulation across teacher training, student distillation, and inference. Beyond aligning the temporal information boundary, Prefix Scoring matches supervision to the student's realized rollout context by evaluating each target under the cached student-generated prefix that produced it. Prefix Corruption further stabilizes training by perturbing unreliable prefixes produced early in training while preserving this target-context alignment. With a simple causal formulation, CMD naturally extends to frame-wise and chunk-wise generation, long video distillation, and camera-conditioned distillation. Experiments demonstrate state-of-the-art aggregate performance among autoregressive methods on both short- and long-video benchmarks, together with substantially improved adherence to time-varying camera controls.
24. 【2608.13385】When Is a Task Vector Enough? An Empirical Theory of Implicit Multimodal ICL
链接：https://arxiv.org/abs/2608.13385
作者：Jiaqian Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Implicit multimodal in-context, in-context learning compresses, multimodal in-context learning, learning compresses demonstrations, Implicit multimodal
备注： Accepted by Empirical Theory in Representation Learning @ ECCV 2026, Oral
点击查看摘要
Abstract:Implicit multimodal in-context learning compresses demonstrations into internal interventions, ranging from static task vectors to query-conditioned transformations and attention routing. Despite their common goal, these methods differ substantially in how the intervention depends on the query and where it modifies the model, leaving unclear which additional complexity is necessary for a given task. We propose the Selection--Realization Hypothesis. It views demonstrations as inducing a compact family of internal changes from which the query selects, while the model's computation constrains how the selected change can be implemented. We evaluate this account using controlled multimodal tasks in which query dependence varies without changing the underlying task primitives or prompt format. By contrasting correct demonstrations with matched counterfactuals, we measure the structure of explicit M-ICL and test whether it predicts intervention behavior. We find that the success of a static task vector is closely tied to how much of the demonstration-induced change is shared across queries. Additional intervention complexity becomes useful when explicit M-ICL contains query-specific or distributed structure that a local additive shift cannot recover. These relationships extend to natural VQA benchmarks and support cost-aware method selection without access to test performance. Our results provide a unified empirical theory of when demonstrations can be compressed into a task vector and when a more expressive intervention is warranted.
25. 【2608.13381】Reconstructing Historical Manuscripts through MSI: The Potential of Contrast in Assessing Image Quality and Legibility
链接：https://arxiv.org/abs/2608.13381
作者：Anna Breger
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cultural heritage documents, Digital restoration, heritage documents, restoration of historical, aims to improve
备注： 8 pages main paper, 7 pages Supplementary Material
点击查看摘要
Abstract:Digital restoration of historical manuscript images aims to improve readability while preserving the authenticity of cultural heritage documents. However, evaluating quality of restored manuscripts remains challenging, where readability is often subjective and expert annotations are scarce. This study investigates the suitability of contrast-based image quality measures to assess quality and legibility of reconstructed manuscript images from multi-spectral imaging. Two experiments were conducted with publicly-available data sets, facilitating manual quality scores by experts and full-reference image quality measures as reference evaluations. The results show that potential contrast achieves the highest correlation with expert ratings, while contrast-to-noise ratio demonstrates the strongest agreement with full-reference quality measures. Overall, contrast-based measures consistently outperform general image quality measures, demonstrating their potential as objective indicators of manuscript legibility and reconstruction quality.
26. 【2608.13368】Sign Language Video Synthesis via Loss-Guided Multi-Expert GANs
链接：https://arxiv.org/abs/2608.13368
作者：Dingzhan Nong,Zhihao Ren,Ziqi Li,Tim Lo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Generative Adversarial Network, multi-expert Generative Adversarial, loss-guided multi-expert Generative, preliminary technical report, technical report presents
备注： Preliminary technical report. 19 pages, 8 figures, 4 algorithms
点击查看摘要
Abstract:This preliminary technical report presents a framework for sign language video synthesis using a loss-guided multi-expert Generative Adversarial Network (GAN) to enhance communication for individuals with hearing impairments. Three specialized discriminators -- global, hand, and head -- each guide a corresponding expert branch in the generator toward a distinct visual region, enabling implicit feature specialization without explicit diversity losses. To stabilize this multi-discriminator system, whose early-phase training otherwise exhibits chaotic dynamics, we introduce a United Loss consensus mechanism that regularizes each discriminator toward the ensemble average at a 10% weight. Each branch further adopts a dual-pathway convolutional-transformer design with learnable AdaptiveFeatureFusion, balancing the stability of convolutions against the detail of windowed self-attention. The generator is trained using an alternating three-mode schedule (discriminator, holistic generation, branch-specialized generation). On a custom 156GB dataset with a filtered test set that removes easy and repetitive samples, our 0.2B-parameter variant achieves 29.8 PSNR and the 1.3B-parameter variant achieves 30.7 PSNR, with inference VRAM footprints of 1.5 GB and 8 GB respectively, enabling deployment on consumer-grade hardware. Full ablation studies remain ongoing due to the 2-3 month training cycle on a single GPU. The system was showcased at the 2025 Hong Kong Frontier Technology Summit.
27. 【2608.13343】AmalthAI: An Open-Source Computer Vision Platform for Cultural Heritage
链接：https://arxiv.org/abs/2608.13343
作者：Christos Chatzisavvas,Stelios Alvanos,Efstratios Politis,Panagiotis Rigas,Thomas Pappas,Ioannis Giannoukos,Nikolaos Mitianoudis,Agata Ulanowska,Katarzyna Żebrowska,Nazarij Buławka,Christina Margariti,George Pavlidis,Chairi Kiourt,Anestis Koutsoudis,Vassilis Katsouros,George Ioannakis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pipeline remains largely, remains largely inaccessible, Computer vision, artifact analysis, machine learning
备注：
点击查看摘要
Abstract:Computer vision (CV) and machine learning (ML) offer new tools for cultural heritage (CH) artifact analysis, but the CV/ML pipeline remains largely inaccessible to CH domain experts, who lack the background to configure, train, or assess models. We present AmalthAI, an open-source CV platform that bridges this gap, enabling non-ML CH experts to independently produce and validate archaeologically meaningful findings. The interface covers dataset management, training, and inference for classification, segmentation, and object detection, with Kubeflow and Katib handling scalable training and hyperparameter search. Grad-CAM localizes the image region behind a prediction, and a vision-language model (VLM) adds a text description of it for expert review. Since archaeological data is often state-owned or rights-encumbered and cannot leave institutional custody, AmalthAI's self-hostable deployment ensures sensitive data is kept within premises. We test the platform on an archaeological use case built on a custom dataset of clay textile imprints, where CH experts trained and validated segmentation, and classification models for hypothesis testing. We provide the implementation code at this https URL.
28. 【2608.13309】How Good are Foundation Models in Longitudinal MRI Disease Progression Reasoning?
链接：https://arxiv.org/abs/2608.13309
作者：Wafa Al Ghallabi,Ritesh Thawkar,Sara Ghaboura,Omkar Thawakar,Numan Saeed,Dana Al Nuaimi,Ajnas Alkatheeri,Salman Khan,Fahad Shahbaz Khan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Magnetic Resonance Imaging, Magnetic Resonance, precisely localizing interval, Resonance Imaging, radiologists to integrate
备注： Accepted at MICCAI 2026 (Early Accept). 11 pages, 3 figures, 2 tables
点击查看摘要
Abstract:Magnetic Resonance Imaging (MRI) interpretation is fundamental to clinical decision-making, requiring radiologists to integrate multi-view anatomical planes across sequential timepoints while precisely localizing interval changes. However, existing vision-language benchmarks remain confined to single-timepoint, single-view interpretation, failing to capture the temporal-spatial reasoning essential to radiologic practice. We introduce the Time-Aware Multi-View MRI Benchmark, an evaluation framework unifying multi-view anatomical input, temporal reasoning across longitudinal scans, and structured localization guidance. The benchmark comprises 3,920 expert-verified question-answer pairs derived from 890 patients across over 3,200 longitudinal MRI timepoints, drawn from seven clinical cohorts covering glioblastoma, neurodegeneration, vestibular schwannoma, and brain metastases, in open-ended, multiple-choice, and binary formats, requiring models to identify anatomical regions of maximal change, characterize progression across sequences and views, and provide structured guidance specifying boundaries, imaging features, and confounders. Experiments across 16 vision-language models reveal moderate temporal alignment but systematic failure on change direction recognition and volumetric quantification, while multi-view inputs improve spatial localization yet degrade temporal reasoning in compact architectures. Our benchmark provides a systematic framework for evaluating progression tracking, interval change localization, and temporal ordering, which are essential for clinical deployment. Code, evaluation splits, and the dataset are available at: this https URL.
29. 【2608.13267】How Do VLMs Behave When Blind or Misled? Behavioral Evaluation of VLMs on Scientific Figures
链接：https://arxiv.org/abs/2608.13267
作者：Paul Osemudiame Oamen,Owusu-Banahene Osei,Ananya Mukherjee,Christian Greisinger,Steffen Eger,Pius Onobhayedo,Wei Zhao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Existing vision-language model, Existing vision-language, benchmarks emphasize perception, diagnostic VLM benchmark, VLMs describe
备注： 25 pages including appendix. Project website: [this https URL](https://scifigbench.nlp4sci.com)
点击查看摘要
Abstract:Existing vision-language model (VLM) benchmarks emphasize perception and reasoning accuracy (how well VLMs describe and reason about what they see in an image), with limited attention to behavioral reliability under uncertainty (how they behave when visual evidence is missing or misleading). We introduce SciFigBench, a diagnostic VLM benchmark for scientific figure understanding that jointly evaluates perception, reasoning, and behavioral reliability under uncertainty. It contains 250 figures with high-quality human annotations across three evaluation aspects, totaling 600+ hours of annotation effort. We further extend these figures via image transformations, reasoning questions, resistance probes, caption-bias probes, and confirmed selective-blur targets, producing over 34,000 evaluation setups for stress testing. We further propose the Admittance-Resistance-Inductance (A-R-I) framework to evaluate whether models acknowledge insufficient evidence, resist misleading context, and infer cautiously from partial information. Our results reveal substantial behavioral differences among models. GPT-5.2 achieves the highest description quality (MQM 91.6) with strong reasoning accuracy (78.4%), yet hallucinates unreadable content in 96% of cases, whereas Gemini 3.1 Pro, a comparably capable model (MQM 90.2, reasoning 81.0%), admits uncertainty in 71% of such cases and achieves the strongest resistance score (0.91). These findings show that high perception and reasoning accuracy alone do not guarantee behavioral reliability, a dimension critical for deployment in scientific workflows.
Comments:
25 pages including appendix. Project website: this https URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
ACMclasses:
I.2.7; I.2.10
Cite as:
arXiv:2608.13267 [cs.CL]
(or
arXiv:2608.13267v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.13267
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
30. 【2608.13255】GeoCache: Training-Free Acceleration of Multi-View Texture Diffusion via Geometric Delta Transport
链接：https://arxiv.org/abs/2608.13255
作者：Haotang Li,Zhenyu Qi,Shaohan Henry Wang,Kebin Peng,Yutong Zhao,Zi Wang,Bo Liu,Huanrui Yang,Sen He
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：substantial computational cost, repeated per-view denoiser, per-view denoiser evaluations, denoiser evaluations introduce, evaluations introduce substantial
备注：
点击查看摘要
Abstract:Geometry-conditioned multi-view diffusion enables high-quality 3D texture generation, but its repeated per-view denoiser evaluations introduce substantial computational cost. Existing training-free accelerators primarily exploit temporal redundancy by reusing computation across denoising steps. In multi-view texturing, however, skipping a step also removes the cross-view interaction that continually aligns different observations of the same surface, leading to rapidly degraded consistency and fidelity. Our analysis identifies a complementary source of redundancy: although intermediate features remain view-specific, geometrically corresponding surface points exhibit transferable evolution in their predicted clean signals. Based on this observation, we introduce \gc{}, a training-free plugin that evaluates a rotating subset of anchor views and transports their geometry-aligned per-step $\xz$ updates to the remaining views. Periodic full-view computation controls accumulated error, while sampler-consistent reconstruction preserves the denoising trajectory. \gc{} requires neither retraining nor architectural modification and uses the position maps already available in geometry-conditioned texturing pipelines. Across Hunyuan3D-2.1, SyncMVD, and MVPainter, \gc{} achieves a stronger speed--fidelity trade-off than temporal caches and step reduction at operating points above $2\times$. On Hunyuan3D-2.1, it delivers a $2.21\times$ denoiser-loop speedup with an MV-LPIPS of 0.0293 and an MV-PSNR of 33.60 dB, providing the best fidelity among all tested methods above $2\times$. The same transferred configuration reaches the highest speedup and lowest FLOPs on SyncMVD, while \gc{} achieves the lowest FLOPs and best fidelity among the accelerated methods on MVPainter. These results establish cross-view geometry as an effective acceleration axis for multi-view texture diffusion.
31. 【2608.13239】Reasoning for Social Audio-Visual Question Answering: Where Do We Stand?
链接：https://arxiv.org/abs/2608.13239
作者：Koen P. de Vries,Xavier Alameda-Pineda,Estefanía Talavera,Stéphane Lathuilière
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Training Multimodal Large, Multimodal Large Language, Large Language Models, Training Multimodal, Multimodal Large
备注： Accepted at HCMIW ECCV workshop. Code available here: [this https URL](https://github.com/koenv759/VanillaSFT)
点击查看摘要
Abstract:Training Multimodal Large Language Models for audio-visual social understanding is a crucial step toward embodied social intelligence. Chain-of-thought (CoT) reasoning has become the dominant approach, with HumanOmniV2 and its IntentBench benchmark as a prominent reference point. In this context, we report three findings. First, IntentBench is highly noisy: $\sim$7% of questions are broken and $\sim$23% are trivially answerable without the video input. We remove the affected questions and release Intentbench-Prime. Second, current reasoning approaches are expensive and surprisingly ineffective. A simple Vanilla SFT baseline matches or outperforms existing reasoning methods across three benchmarks at a fraction of the cost, establishing it as an essential baseline for evaluating novel fine-tuning techniques. Third, our analysis reveals that substantial priors can be learned solely from the text modality and that using a textual caption instead of the video yields performance on par with Vanilla SFT. These surprising findings reveal the limitations of current MLLMs when it comes to social understanding. IntentBench-Prime, Vanilla SFT model, and code are publicly available.
32. 【2608.13226】CoverPrune: Coverage-Driven Token Pruning for 3D VLMs via Optimal Transport
链接：https://arxiv.org/abs/2608.13226
作者：Peng Ling,Yingda Yin,Lingting Zhu,Weikai Chen,Shengju Qian,Zeyu Hu,Xin Wang,Wenming Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：create severe computational, severe computational bottlenecks, Vision-Language Models, demonstrated remarkable spatial, spatial reasoning capabilities
备注： Accepted to ECCV 2026 as an Oral Presentation
点击查看摘要
Abstract:While 3D Vision-Language Models (3D VLMs) have demonstrated remarkable spatial reasoning capabilities, they suffer from massive visual token counts that create severe computational bottlenecks during inference. Existing token pruning methods primarily rely on diversity-based selection, discarding similar tokens to maximize dispersion. However, in 3D environments, this approach frequently drops representative prototype tokens in favor of outliers, breaking the multi-view consistencies and geometric structures essential for spatial reasoning. In this paper, we propose a paradigm shift for 3D VLM token pruning: from maximizing diversity to preserving visual evidence coverage. We introduce CoverPrune, a training-free framework that formulates inference-time token pruning as an Optimal Transport (OT) problem. To overcome the intractable combinatorial subset selection inherent in this formulation, we design the Feature-Spatial-Temporal (FST) transport cost and target capacity, along with an efficient Spatial-Guided Greedy Selection (SGS) algorithm to approximate the OT objective. Furthermore, we propose CoverPrune-Lite, an accelerated variant utilizing spatially structured local matching for minimal overhead. Extensive experiments across multiple 3D visual-spatial reasoning benchmarks demonstrate that our methods achieve state-of-the-art token efficiency, maintaining robust reasoning performance even under highly aggressive pruning budgets. Visit our project website at this https URL.
33. 【2608.13223】Reliability analysis for BraTS-GoAT segmentation: a controlled robustness study of deep-ensemble uncertainty
链接：https://arxiv.org/abs/2608.13223
作者：Riya Deepak Shet,Le Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：brain tumours accurately, networks segment brain, segment brain tumours, Deep networks segment, tumours accurately in-distribution
备注： 12 pages, 4 figures, 2 tables. Conditionally accepted at MICCAI 2026 BraTS-GoAT challenge workshop. Code: [this https URL](https://github.com/riyashet-hds/brats-goat-reliability)
点击查看摘要
Abstract:Deep networks segment brain tumours accurately in-distribution, but can fail silently when the input differs from their training data. That risk is central to clinical deployment and is the premise of the BraTS-GoAT generalizability task. We ask not only how well a model segments, but whether its uncertainty knows when it is wrong. On BraTS-GoAT (Task 3) we train a 5-fold cross-validated nnU-Net baseline (one held-out prediction per case) and a 3-seed deep ensemble. Both are evaluated for calibration and error detection on a per-region relevant mask, aggregated per case. In-distribution the 3-seed ensemble improves modestly over the already strong single model on the same held-out split, with the clearest gain in calibration. The separation appears under shift. In a controlled robustness study using graded synthetic corruptions as a proxy for acquisition shift, the single model's confidence stays flat while its accuracy and calibration degrade. Inter-member disagreement instead rises steeply, about a quarter to a third above the clean condition, several times the single model's response. On the official validation leaderboard the 5-fold ensemble of those folds attains whole-tumour Dice 0.87. The generalization gap is concentrated on the harder regions, with a characteristic failure of missing small, satellite lesions on unseen cohorts. In the synthetic study, disagreement among the 3-seed members is a more sensitive case-level indicator of acquisition shift than single-model confidence. Its per-voxel error localisation weakens as severity grows. The contribution is a rigorous, honest reliability comparison rather than a claim that any one uncertainty method dominates.
34. 【2608.13217】UniCon-Former: Unified Convolution Transformer is All You Need for Hand Gesture Recognition
链接：https://arxiv.org/abs/2608.13217
作者：Mallika Garg,Debashis Ghosh,Pyari Mohan Pradhan
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：Convolutional Neural Networks, Convolutional Neural, Neural Networks, limited receptive field, global context due
备注：
点击查看摘要
Abstract:Convolutional Neural Networks (CNNs) capture local features efficiently but struggle with global context due to their limited receptive field. On the other hand, transformers effectively capture global dependencies through self-attention but suffer from high redundancy and computational costs. Thus, to leverage the advantages of both CNNs and transformers, we propose a unified model (UniCon-Former) that aims to provide robust and efficient performance on dynamic hand gesture recognition. The unified approach helps the model to learn both local and global features. At the beginning of each transformer stage, the convolution projections help in decreasing the dimension of the input vectors of the transformer block. This creates a pyramidal structure at each transformer stage. These features enable the UniCon-Former to reduce resource usage than vanilla transformers, making it flexible for learning multi-scale and high-resolution features, which is required in hand gesture recognition. We have performed experiments with NVGesture and Briareo datasets and achieved state-of-the-art results with fewer parameters and MACs.
35. 【2608.13210】NARU: A Benchmark for NARrative Evolution and Cultural Nuance Understanding in Japanese Extreme Long Video
链接：https://arxiv.org/abs/2608.13210
作者：Yuheng Huang,Jianlang Chen,Jiayang Song,Hua Qi,Aza Kai,Vincent Markert,Edison Marrese-Taylor,Jianjun Zhao,Lei Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：understanding encompasses tasks, retrieving isolated events, interpreting social meaning, including tracking, remain implicit
备注： Yuheng Huang and Jianlang Chen contributed equally to this work. More details available on the project's website [this https URL](https://ma-labo.github.io/naru/) and [this https URL](https://infinimind.io/en/company/news/2026/narubench-release)
点击查看摘要
Abstract:Long-form video understanding encompasses tasks that go beyond retrieving isolated events, including tracking an evolving narrative and interpreting social meaning that may remain implicit. However, existing benchmarks rarely evaluate these capabilities jointly, particularly in high-context, non-English media. To address this gap, we introduce NARU, a benchmark designed to evaluate Narrative evolution and Reasoning on cultural Understanding in Japanese long-form video. NARU consists of 1,481 questions grounded in 155 videos totaling 146.8 hours, spanning four narrative and five cultural dimensions. To construct the benchmark at this scale, we propose a hierarchical memory-based annotation pipeline that transforms raw video into structured event, narrative, and cultural annotations, then generates questions via task-oriented synthesis and iterative shortcut removal. The construction process includes two native-speaker verification stages involving 68 annotators. Evaluations across eight model configurations reveal substantial limitations in both long-range narrative integration and culturally grounded reasoning. By exposing these persistent gaps, NARU offers a systematic testing ground for developing MLLMs capable of reliably interpreting long-form, high-context video.
36. 【2608.13205】HPSD: Hybrid-Policy Self-Distillation for Text-Image-to-Video Diffusion Models
链接：https://arxiv.org/abs/2608.13205
作者：Jiazi Bu,Pengyang Ling,Yujie Zhou,Yibin Wang,Yuhang Zang,Xuanlang Dai,Shengyuan Ding,Tianyi Wei,Xiaohang Zhan,Jiaqi Wang,Tong Wu,Dahua Lin,Xingang Pan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：emerging unified architecture, model simultaneously supports, base generation ability, unified architecture, simultaneously supports
备注： Project Website: [this https URL](https://bujiazi.github.io/hpsd.github.io/) Code: [this https URL](https://github.com/Bujiazi/HPSD)
点击查看摘要
Abstract:Text-Image-to-Video (TI2V) models are an emerging unified architecture, where a single model simultaneously supports text-to-video (T2V) and image-to-video (I2V) generation. Given a high-quality first frame or a detailed textual prompt, TI2V models unlock substantially better visual quality than their T2V mode, raising a natural question: can the capability elicited by such privileged conditions be internalized into the model's own base generation ability? A common approach toward this goal is model self-distillation. However, the most straightforward solution, supervised fine-tuning, follows an off-policy strategy: its supervision is confined to teacher-generated endpoints from a fixed offline distribution rather than student-visited states, lacking precise correction tailored to the evolving policy. Recent on-policy distillation methods instead suffer from condition-state mismatch, where supervision is steered toward the given first frame instead of the student's actual content, misleading the correction. To achieve self-distillation that absorbs the teacher's privileged prior while retaining precise policy correction, in this work, we propose Hybrid-Policy Self-Distillation (HPSD), a novel self-distillation framework where a single TI2V model acts as both teacher and student under different conditions: the teacher operates in TI2V mode with a high-quality first frame and an enhanced prompt, while the student runs in the base T2V mode with only the vanilla prompt. Specifically, the student inherits off-policy teacher trajectory points as anchors, locally refines them toward its own policy, and finally receives velocity-level supervision on these self-generated roll-outs. Extensive experiments demonstrate that HPSD significantly improves T2V performance while also delivering notable TI2V gains, effectively strengthening the model's base generation ability.
37. 【2608.13194】Fidelity-Constrained Anchoring for Black-Box Denoisers
链接：https://arxiv.org/abs/2608.13194
作者：Masaki Satoh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Structural Similarity Index, additional computation, propose a fidelity-constrained, fidelity-constrained framework, framework that anchors
备注： 5 pages, 5 figures. Supplementary material is available as an ancillary file
点击查看摘要
Abstract:We propose a fidelity-constrained framework that anchors the output of a black-box denoiser to its input without retraining and with little additional computation. The method linearly blends the denoised image with the input and selects the maximum blending factor that satisfies a prescribed local fidelity constraint using Peak Signal-to-Noise Ratio (PSNR) or Structural Similarity Index (SSIM). For PSNR control, a closed-form solution is obtained under a local constant-blending assumption. For SSIM control, we derive a tractable formulation based on inverse SSIM under the same assumption and solve it efficiently using iterative root finding. Experiments on DIV2K images with synthetic Gaussian noise and outputs from Real-ESRGAN and a non-local means denoiser show that the proposed anchoring strategy provides effective fidelity control while balancing denoising performance and statistical naturalness, as measured by the excess kurtosis of residual noise. In particular, SSIM-based anchoring yields more consistent behavior across noise levels than PSNR-based anchoring.
38. 【2608.13190】ProME: Prototype-Margin Environments with Repair-Aware Selection for Group-Robust Learning
链接：https://arxiv.org/abs/2608.13190
作者：Qianqian Wang,Yunshan Li,Dawei Huang,Wenwu Gong,Lili Yang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Group-robust learning, learning is crucial, crucial for maintaining, rare subpopulations, training-group labels
备注： 17 pages, 9 figures, 7 tables
点击查看摘要
Abstract:Group-robust learning is crucial for maintaining accuracy on rare subpopulations when training-group labels are unavailable. However, existing methods often infer environments from a separate reference model and select representations before fitting the classifier used at deployment, leaving both decisions misaligned with the deployed predictor. In this work, we formulate group robustness without training-group labels as the endogenous environments with repair-aware selection (ERAS) problem, and propose ProME (Prototype-Margin Environments) to align both decisions with the deployed predictor. ProME splits prototype margins at their median to construct approximately balanced environments along the training trajectory, and fits a group-balanced linear head on group-annotated validation data to rank the resulting predictors by validation worst-group accuracy. We theoretically bound the worst risk across the inferred environments for a fixed predictor and partition, showing that this bound transfers to the oracle groups under an explicit alignment condition. Extensive experiments show that prototype margins enrich shortcut-conflicting examples, classifier repair reshapes candidate evaluation, and ProME achieves the highest average worst-group accuracy among the compared methods with the same group-label access.
39. 【2608.13186】SketchSense: Learning to Interpret Imperfect Sketch Guidance for Image Inpainting
链接：https://arxiv.org/abs/2608.13186
作者：Zian Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sketch-guided image inpainting, Sketch-guided image, mix reliable global, deliberately unconventional strokes, intuitive structural control
备注： 10 pages, 11 figures, 3 tables
点击查看摘要
Abstract:Sketch-guided image inpainting provides intuitive structural control, yet real sketches often mix reliable global intent with locally crowded, displaced, incomplete, or deliberately unconventional strokes. Existing approaches typically either retain the input sketch as a fixed condition throughout denoising or refine it into a clean structure before RGB synthesis. The former assumes uniformly reliable strokes and can propagate local errors throughout generation; the latter must resolve ambiguous structure before emerging appearance and semantic context become available. We propose SketchSense, a framework that interprets imperfect sketch guidance by synchronously denoising interacting RGB and structure streams. Bidirectional Attention Fusion couples appearance generation with structural recovery, producing a refined structure that exposes the model's evolving sketch interpretation. A phrase-level objective aligns the semantic grounding of the two streams. Sketch-Aware Spatial Regulation further adapts sketch use to local generation states by modulating attention and the fusion process, while an optional signed prior injects preserve-versus-correct intent into feature representations and attention behavior. Experiments on natural and structurally complex imagery show substantial gains over existing methods in both restoration quality and structural fidelity.
40. 【2608.13183】A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources
链接：https://arxiv.org/abs/2608.13183
作者：Brunó B. Englert,Gijs Dubbelman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual foundation models, typically require large, require large amounts, video SSL objectives, pretraining visual foundation
备注：
点击查看摘要
Abstract:Visual foundation models are a cornerstone of image and video understanding but typically require large amounts of data and computation. The current scale required for pretraining visual foundation models may be unsustainable or unnecessary, and significant benefits arise when effective models can be obtained with fewer resources. To better understand how self-supervised learning (SSL) objectives behave under resource constraints, we conduct a controlled study of image and video SSL objectives under matched data, architecture, and compute budgets. We compare contrastive, reconstruction, feature-prediction, and diffusion objectives and evaluate both standalone and jointly trained image-video SSL formulations across a diverse set of image and video understanding tasks. Our results show that DINOv2-style pretraining consistently provides the strongest overall performance under limited resources. Furthermore, combining DINOv2 with video SSL objectives such as VideoMAE substantially improves image classification and segmentation performance, but degrades video tracking and camera-pose estimation performance, revealing an important tradeoff between semantic and geometric representation learning. These findings suggest that combining image and video SSL objectives can be beneficial in resource-limited settings, while highlighting the need for improved methods that better balance semantic, temporal, and geometric supervision.
41. 【2608.13167】RAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint
链接：https://arxiv.org/abs/2608.13167
作者：Fnu Pramono,John Cai,Sourabh Kulkarni
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：occluded or chaotic, Epistemic Calibration Score, Penalized Epistemic Calibration, visual evidence, introduce Penalized Epistemic
备注： 10 Pages excluding Reference and Appendix, Published at COLM 2026
点击查看摘要
Abstract:When visual evidence is occluded or chaotic, models should abstain. In this paper, we show that Vision-Language Models (VLMs) can internally distinguish when abstention is required, but fail to express it anyway. We introduce TRAPSBench, a procedurally generated video benchmark of 1,404 matched physics pairs in which a single targeted change renders the outcome undeterminable from the visual evidence. Furthermore, we introduce Penalized Epistemic Calibration Score (PECS), a new robust metric that requires models to both answer correctly when the outcome is knowable, and abstain when the outcome is not. Across 16 VLMs spanning five families, spontaneous restraint is poor: the best PECS is 0.292. The bottleneck is expression, not perception: linear probes decode answerability from hidden states at up to 0.91 AUROC across physics domains; steering a single-layer void direction causally induces or suppresses abstention. Our results replicate across three open-weight families (Qwen, Gemma, LLaVA). The failure is also more pronounced in visual than textual uncertainty: models detect textual impossibility about 4x more readily than missing visual evidence. Closing this representation--output gap likely requires output-stage interventions.
42. 【2608.13159】Splat-based Metal Artifact Reduction in Cone-Beam CT via Polychromatic Modeling
链接：https://arxiv.org/abs/2608.13159
作者：Kiseok Choi,Inchul Kim,Jaemin Cho,Hyeongjun Cho,Min H. Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Cone-beam computed tomography, Cone-beam computed, enables volumetric reconstruction, computed tomography, enables volumetric
备注：
点击查看摘要
Abstract:Cone-beam computed tomography (CBCT) enables volumetric reconstruction from X-ray projections, but suffers from severe artifacts--especially beam hardening--when imaging materials with high attenuation such as metals. These artifacts arise from the polychromatic nature of X-rays and are not properly addressed by conventional monochromatic reconstruction algorithms. While recent neural representation-based methods offer improved reconstruction quality, they are computationally expensive and often impractical for deployment. We propose a novel physics-inspired, self-calibrating metal artifact reduction method that efficiently reconstructs 3D CBCT volumes while correcting beam hardening artifacts. Our method integrates a polychromatic X-ray projection model, material-dependent attenuation profiles, and system response modeling into a Gaussian Splatting framework. Unlike prior work, we eliminate the need for manual metal masks or strong prior assumptions, and we optimize both reconstruction parameters and X-ray spectral characteristics jointly during training. We further introduce a high-fidelity synthetic CBCT dataset generation pipeline validated on Monte-Carlo x-ray simulation toolbox and release new datasets with severe metal-induced artifacts to support the community. This is the first splat-based method for reducing beam hardening in CBCT. Extensive experiments on both synthetic and real-world datasets demonstrate that our method outperforms state-of-the-art approaches in artifact suppression and reconstruction accuracy.
43. 【2608.13148】Less Annotation, More Interpretation: Prior-Guided Concept Bottleneck Models for Interpretable Cancer Imaging Diagnosis
链接：https://arxiv.org/abs/2608.13148
作者：Baoqiang Ma,Kenneth Gilhuijs
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Concept, Concept bottleneck models, hybrid CBM, concept AUC, CBM
备注： Accepted at the iMIMIC Workshop at MICCAI 2026
点击查看摘要
Abstract:Concept bottleneck models (CBMs) can improve the transparency of cancer image diagnostic prediction by expressing predictions through radiological concepts. However, their dependence on instance-level concept annotations limits practical applicability. We propose a prior-guided hybrid CBM that integrates limited concept annotations, class-conditional concept distribution matching on unannotated patients, and prior initialization of the concept-to-diagnosis head. We evaluate the method on CBIS-DDSM mammographic masses and calcifications and LIDC-IDRI pulmonary nodules across 0-100% concept annotation. In the clinically relevant 0-20% annotation regime, the hybrid CBM consistently improves mean concept AUC over a matched standard CBM, while maintaining diagnostic performance close to black-box models. At 10% annotation specifically, concept AUC increases from 0.619 to 0.741 for masses, from 0.650 to 0.787 for calcifications, and from 0.597 to 0.642 for pulmonary nodules. Ablation experiments identify prior initialization as the main component contributing to improved concept detection, likely by stabilizing the concept-to-diagnosis head. Zero-shot VLMs remain insufficient for reliable fine-grained tumor-level concept prediction. These findings suggest that structured priors can substantially reduce the annotation burden of interpretable cancer imaging models.
44. 【2608.13147】Geometry-Grounded Unified 3D Perception for Autonomous Driving
链接：https://arxiv.org/abs/2608.13147
作者：Longfei Xu,Xiaohui Wang,Zehao Huang,Han Li,Ya Yang,Naiyan Wang,Si Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Camera-based autonomous driving, Camera-based autonomous, synchronized multi-camera streams, autonomous driving perception, driving perception requires
备注：
点击查看摘要
Abstract:Camera-based autonomous driving perception requires a shared representation that preserves metric 3D structure across synchronized multi-camera streams. However, existing image-based frameworks often rely on backbones pretrained for semantic recognition, and introduce 3D geometry through downstream task-specific modules. As a result, their shared representations may fail to preserve explicit metric geometry and consistent 3D scene structure. In this paper, we present a Geometry-grounded Unified 3D Perception (GeoUP) framework that adapts the reconstruction-oriented latent of VGGT to calibrated, streaming multi-camera driving scenes. GeoUP factorizes cross-image interaction into self, temporal, and view attention to capture structurally distinct temporal and cross-view correspondences. It further injects calibration-aware raymap encodings to provide metric scale and camera geometry. The resulting geometry-grounded latent is decoded for metric depth estimation, 3D object detection, and semantic occupancy prediction, corresponding to surface-, instance-, and volume-level readouts of the same 3D scene. Through joint multi-task and multi-dataset training, GeoUP effectively leverages heterogeneous annotations and generalizes across diverse sensor configurations and perception ranges. Extensive experiments on nuScenes, Argoverse 2, Waymo, KITTI, and DDAD demonstrate that GeoUP achieves SOTA performance across detection, occupancy, and depth estimation. These results validate the effectiveness of geometry-grounded representations for unified 3D driving perception.
45. 【2608.13141】MergeOver: Post-Training Token Merging for Recursive Vision Transformers
链接：https://arxiv.org/abs/2608.13141
作者：Junseo Kim,Uraz Odyurt,Amirreza Yousefzadeh
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：demonstrate exceptional performance, resource-constrained edge hardware, quadratic computational complexity, large parameter counts, computer vision
备注：
点击查看摘要
Abstract:Vision Transformers (ViTs) demonstrate exceptional performance in computer vision but suffer from large parameter counts and quadratic computational complexity, severely limiting their deployment on resource-constrained edge hardware. While recursive weight-sharing reduces parameter counts and token merging mitigates computational and memory bottlenecks, integrating these two paradigms without costly retraining is non-trivial, leaving this intersection largely unexplored. We propose MergeOver, a post-training approach that integrates Token Merging (ToMe) into the recursively weight-shared Sliced Recursive Transformer (SReT). Through an Unmerge tracking stack, constraint-safe merge-rate adjustment, and synchronised token-mass tracking across spatial permutations, MergeOver resolves the spatial and merging constraints of this integration. We further employ a stage-wise single-shot schedule that performs token reduction at the first block of each stage and maintains a fixed sequence length throughout its subsequent recursive iterations. Benchmarked on ImageNet-1K, our selected configuration reduces top-1 accuracy by 1.47 percentage points. On the GPU, it reduces peak activation memory by 37.3% and 38.4% at batch sizes 1 and 16, while throughput decreases by 21.7% at batch size 1 but increases by 21.7% at batch size 16. On a Raspberry Pi 5 (ARM CPU), it reduces latency by 2.4% and 17.6% at batch sizes 1 and 16. These results show that MergeOver can recover a meaningful part of the throughput and memory cost that recursive weight-sharing introduces, without retraining, and provides a baseline for combining token merging with hierarchical recursive transformers.
46. 【2608.13135】Predicting Signed Distance Functions for Visual Instance Segmentation
链接：https://arxiv.org/abs/2608.13135
作者：Emil Brissman,Joakim Johnander,Michael Felsberg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：interest varies unconstrained, Visual instance segmentation, Visual instance, challenging problem, interest varies
备注：
点击查看摘要
Abstract:Visual instance segmentation is a challenging problem and becomes even more difficult if objects of interest varies unconstrained in shape. Some objects are well described by a rectangle, however, this is hardly always the case. Consider for instance long, slender objects such as ropes. Anchor-based approaches classify predefined bounding boxes as either negative or positive and thus provide a limited set of shapes that can be handled. Defining anchor-boxes that fit well to all possible shapes leads to an infeasible number of prior boxes. We explore a different approach and propose to train a neural network to compute distance maps along different directions. The network is trained at each pixel to predict the distance to the closest object contour in a given direction. By pooling the distance maps we obtain an approximation to the signed distance function (SDF). The SDF may then be thresholded in order to obtain a foreground-background segmentation. We compare this segmentation to foreground segmentations obtained from the state-of-the-art instance segmentation method YOLACT. On the COCO dataset, our segmentation yields a higher performance in terms of foreground intersection over union (IoU). However, while the distance maps contain information on the individual instances, it is not straightforward to map them to the full instance segmentation. We still believe that this idea is a promising research direction for instance segmentation, as it better captures the different shapes found in the real world.
47. 【2608.13119】QuISE: Defense against Typographic Attacks on VLMs via Query-Irrelevant Semantic Editing
链接：https://arxiv.org/abs/2608.13119
作者：Shubin Lu,Jiaqi Yin,Yihao Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Typographic attacks pose, adversarial textual cues, injecting misleading text, visual evidence, Typographic attacks
备注： 10 pages, 7 figures; includes supplementary material
点击查看摘要
Abstract:Typographic attacks pose a critical threat to vision-language models (VLMs) by injecting misleading text into images and causing models to rely on adversarial textual cues rather than visual evidence. Existing defenses often require model-specific modifications, additional training, or access to internal model components, limiting their applicability to modern closed-source VLMs. In this paper, we propose QuISE, a model-agnostic, training-free black-box defense based on query-irrelevant semantic editing. QuISE first identifies text regions likely to affect the current query through influence-aware text localization. QuISE then replaces these regions with two semantically distinct replacement texts that are irrelevant to both the query and the image. The final answer is determined by answer consistency across the edited images. Extensive experiments on three typographic-attack benchmarks, four attack settings, and four VLMs show that QuISE consistently improves defended accuracy. QuISE achieves a recovery rate of 67.9-75.0% with a harm rate of 0.5-1.1%.
48. 【2608.13114】Fast Iterative Five point Relative Pose Estimation
链接：https://arxiv.org/abs/2608.13114
作者：Johan Hedborg,Michael Felsberg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Structure and Motion, part of Structure, Motion methods, Robust estimation, fundamental part
备注：
点击查看摘要
Abstract:Robust estimation of the relative pose between two cameras is a fundamental part of Structure and Motion methods. For calibrated cameras, the five point method together with a robust estimator such as RANSAC gives the best result in most cases. The current state-of-the-art method for solving the relative pose problem from five points is due to Nister [9], because it is faster than other methods and in the RANSAC scheme one can improve precision by increasing the number of iterations. In this paper, we propose a new iterative method, which is based on Powell's Dog Leg algorithm. The new method has the same precision and is approximately twice as fast as Nister's algorithm. The proposed method is easily extended to more than five points while retaining a efficient error metrics. This makes it also very suitable as an refinement step. The proposed algorithm is systematically evaluated on three types of datasets with known ground truth.
49. 【2608.13113】EgoMonth: A Month-Level Egocentric Video Benchmark for Long-Term Spatiotemporal Memory
链接：https://arxiv.org/abs/2608.13113
作者：Weitao Chen,Hu Jiaxin,Xie Tianyidan,Yang Li,Yuyi Qian,Banghao Xu,Ziheng Tang,Shenyi Wang,Mingyue Yu,Duo Li,Jiacheng Shi,Gao Wang,Zhan Xu,Zhicheng Qiu,Xuanfu Li,Jian Yang,Lanjun Wang,Zili Yi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, Recent advances
备注： 21 pages, 4 figures, 6 tables, including appendices
点击查看摘要
Abstract:Recent advances in Multimodal Large Language Models (MLLMs) have led to substantial progress in video understanding, accompanied by a growing number of long video benchmarks. However, existing benchmarks rely predominantly on web-sourced videos that lack inter-clip spatiotemporal continuity, making it difficult to assess whether models can maintain consistent memory across days or weeks of real-world experience. We introduce EgoMonth, the first month-level egocentric video understanding benchmark. EgoMonth comprises over 300 hours of first-person daily-life recordings from 20 participants spanning 20 to 120 days, paired with 1,443 human-crafted multiple-choice question-answer pairs. We design a cognitively grounded 14-task evaluation framework organized into three hierarchical cognitive levels: Schema Consolidation, Episodic Indexing, and Cascading Reasoning. Evaluation of state-of-the-art open-source and closed-source MLLMs reveals that even the best-performing model, Gemini 2.5 Pro, achieves only 71.8% macro-average accuracy, remaining 22.4 percentage points below the corrected human baseline of 94.2%. Several models perform near or below the 25% chance level on tasks such as Route Reasoning, Cross-view Spatial Reasoning, and Direction Judgement, while even the strongest closed-source model remains substantially below human performance. These results indicate that current MLLMs function as lossy summarizers rather than faithful memorizers, highlighting the need for architectures with genuine long-term spatiotemporal memory.
50. 【2608.13112】owards Physics-Faithful Generation of Scientific Diagrams
链接：https://arxiv.org/abs/2608.13112
作者：Minghui Zhang,Jinxin Shi,Yifan Chang,Liangliang Zhao,Yuandong Pu,Qian Yu,Ming Hu,Hanxiao Zhang,Yun Gu,Yirong Chen,Yu Qiao,Bo Zhang,Xiangchao Yan,Bin Fu,Yihao Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：valid coordinate systems, systems remain unreliable, reached photorealistic quality, correct force directions, consistent thermodynamic states
备注：
点击查看摘要
Abstract:Text-to-image generation has reached photorealistic quality, yet state-of-the-art systems remain unreliable at producing scientific diagrams, whose value depends not on appearance but on physical faithfulness: correct force directions, valid coordinate systems, consistent thermodynamic states, and equations matching the depicted scenario. Trained on web imagery with physically shallow captions, generic models produce diagrams that look plausible but are physically wrong, harmful in education and scientific communication. We present Princigram, a physics-faithful scientific-diagram generator, and its data pipeline. Our central advance is Structured Physical Chain-of-Thought (SP-CoT): a per-subdiscipline schema that decomposes a physics diagram into an explicit multi-step reasoning chain across six subdisciplines, from scene identification through force or process analysis to governing laws and synthesis. Unlike free-form chain-of-thought, SP-CoT follows a fixed schema with strict fidelity rules that separate visually grounded facts from physically inferred reasoning and type all mathematics symbolically; it serves both as dense training supervision and, at inference, as a structured "thinking" prompt. With it we curate and structurally annotate 4.3 million physics images, of which 115,037 carry expert-level annotation, and adapt a unified multimodal backbone. We further introduce VeriphyT2IBench, whose questions are derived from each held-out diagram's own structured annotation: each diagram becomes an item-specific bank of binary questions about its objects, forces, and states, so a judge model's score decomposes into named physical facts rather than one holistic number. On the physics subset of GenExam and on VeriphyT2IBench, Princigram shows that explicit physics-structured supervision improves the physical faithfulness of generated scientific diagrams.
51. 【2608.13104】Online Learning of Correspondences between Images
链接：https://arxiv.org/abs/2608.13104
作者：Michael Felsberg,Fredrik Larsson,Johan Wiklund,Niclas Wadströmer,Jörgen Ahlberg
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：iterative learning, point correspondences, image sequences, Points moving, learning of point
备注：
点击查看摘要
Abstract:We propose a novel method for iterative learning of point correspondences between image sequences. Points moving on surfaces in 3D space are projected into two images. Given a point in either view, the considered problem is to determine the corresponding location in the other view. The geometry and distortions of the projections are unknown as is the shape of the surface. Given several pairs of point-sets but no access to the 3D scene, correspondence mappings can be found by excessive global optimization or by the fundamental matrix if a perspective projective model is assumed. However, an iterative solution on sequences of point-set pairs with general imaging geometry is preferable. We derive such a method that optimizes the mapping based on Neyman's chi-square divergence between the densities representing the uncertainties of the estimated and the actual locations. The densities are represented as channel vectors computed with a basis function approach. The mapping between these vectors is updated with each new pair of images such that fast convergence and high accuracy are achieved. The resulting algorithm runs in real-time and is superior to state-of-the-art methods in terms of convergence and accuracy in a number of experiments.
52. 【2608.13102】RbFT-Net: Rectify-Before-Fuse Temporal Radar Anchors for 4D Radar-Camera Depth Completion
链接：https://arxiv.org/abs/2608.13102
作者：Wentao Zhao,Shouxuan Wu,Yongtao Cen,Tianchen Deng,Yuyang Zhang,Jingchuan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cost-effective sensing solution, Dense metric depth, millimeter-wave radar offers, Dense metric, autonomous systems
备注：
点击查看摘要
Abstract:Dense metric depth prediction from cameras and millimeter-wave radar offers a cost-effective sensing solution for autonomous systems. However, radar measurements are inherently sparse and susceptible to clutter, multipath reflections, and projection errors. While aggregating multiple radar frames provides denser metric cues, it also introduces temporal misalignment and dynamic-object interference. Directly propagating such unreliable measurements can therefore corrupt large regions of the predicted depth map. To address this issue, we propose RbFT-Net, an end-to-end rectify-before-fuse framework for multi-frame 4D radar-camera depth completion. Rather than assuming accumulated radar returns to be accurate, RbFT-Net treats them as noisy temporal anchor candidates. An image-conditioned rectification module jointly corrects their image-plane locations and metric depths while estimating pointwise reliability. The rectified anchors are then selectively propagated before high-level multi-modal fusion, suppressing the influence of unreliable measurements. Experiments on ZJU-4DRadarCam and a newly collected 4D radar-camera-LiDAR dataset show that RbFT-Net consistently outperforms the evaluated independent radar-camera methods and remains competitive with plug-in pipelines using auxiliary monocular depth models. Cross-platform evaluation and component analyses further support the effectiveness of the proposed rectification and reliability-aware propagation strategy.
53. 【2608.13095】Semantic Radiance Fields as Simulators for Spatial Reasoning in Real-World Scenes
链接：https://arxiv.org/abs/2608.13095
作者：Nico Heider,Michał Jan Włodarczyk,Katarzyna Wasielewska-Michniewska,Przemysław Hołda,Martin Schieck,Marcin Paprzycki,Maria Ganzha,Bogdan Franczyk
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Training and evaluating, embodied agents requires, semantically queryable, geometrically faithful, faithful and semantically
备注： Accepted at the IJCAI 2026 Workshop on Spatio-Temporal Reasoning and Learning (STRL), oral presentation
点击查看摘要
Abstract:Training and evaluating spatial reasoning in embodied agents requires diverse environments that are both geometrically faithful and semantically queryable. Synthetic simulators offer ground truth semantics but sacrifice realism; simulators based on reconstructions of real-world environments have realistic appearance but lack ground truth semantics by default. We propose using Semantic Radiance Fields (SRF) as simulators for spatial reasoning agents. SRFs are a representation that unifies these requirements by lifting 2D semantic segmentations from pretrained vision models into a 3D radiance field that jointly encodes geometry, appearance, and per-class semantic identity. The resulting fields are reconstructed from posed RGB captures of real scenes and support novel-view synthesis, semantic and free-space queries within a single grounded representation. This enables the efficient generation of diverse real-world environments to train and evaluate spatial reasoning models. As an example application, we outline an SRF-driven simulator for an orchard apple-reaching task, in which the radiance field supplies camera rendering, semantic ground truth, and occupancy queries to a physics engine.
54. 【2608.13092】Paths: Prompt-aware Spatio-temporal Transformer with Hierarchical Multi-modal Fusion for RGB-Event Video Person Re-Identification
链接：https://arxiv.org/abs/2608.13092
作者：Yakun Huo,Yingquan Wang,Yangyang Liu,Tianyu Yan,Yunzhi Zhuge,Pingping Zhang,Huchuan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video Person Re-Identification, RGB-Event Video Person, retrieve specific person, complementary RGB videos, Video Person
备注： Accepted by ACM MM2026. More modifications may be performed
点击查看摘要
Abstract:RGB-Event Video Person Re-Identification (RE-VReID) aims to retrieve specific person across non-overlapping cameras with complementary RGB videos and event streams. However, existing methods often decouple spatial and temporal modeling, which limits their interaction. In addition, global-level RGB-Event fusion fails to fully exploit fine-grained discriminative cues. To address these issues, we propose Paths, a unified framework with spatio-temporal modeling and hierarchical multi-modal fusion for RE-VReID. Specifically, we first design a Memory-Augmented Backbone (MAB) to maintain modality-specific identity prototypes for stable intra-modal representation learning. Then, we propose a Prompt-aware Spatio-temporal Transformer (PST) to jointly model spatial and temporal cues within a unified Transformer. Finally, we introduce a Hierarchical Multi-modal Fusion (HMF) to integrate RGB and event features at global and local levels. With these modules, our framework can learn robust and discriminative representations for RE-VReID. Extensive experiments on three public RE-VReID benchmarks including EvReID, MARS and iLIDS-VID, demonstrate the effectiveness of our proposed method. The code is available at this https URL.
55. 【2608.13064】Learning Unified Video and Image Representation for Video Face Forgery Detection
链接：https://arxiv.org/abs/2608.13064
作者：Haotian Liu,Yang Liu,Guoying Zhao,Xiaobai Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Face forgery detection, face manipulation techniques, video face forgery, Face forgery, deep generative models
备注：
点击查看摘要
Abstract:Face forgery detection is crucial for preserving the security and integrity of facial data given the rapid developments in face manipulation techniques and deep generative models. Existing methods for video face forgery detection typically assume that all frames in a forged video are manipulated, while detecting partially forged videos that contain only a subset of altered frames remains challenging. To address this issue, we propose a novel framework, UVIF, that utilizes additional annotated images to provide fine-grained supervision for detecting partial forgeries in videos. UVIF employs a unified encoder and a multi-task learning paradigm to jointly model facial videos and images for boosted video face forgery detection. A 2D backbone with temporal fusion modules is employed as the unified encoder. A pseudo labeling process is designed for video frames to bridge their representations with those of static images. A video-oriented feature alignment strategy is further introduced to reduce the distribution gap between videos and images. Extensive experiments on benchmark datasets demonstrate the effectiveness of our framework, which outperforms state-of-theart methods in detecting partially forged videos while introducing no additional computational overhead. Our code is available at this https URL.
56. 【2608.13049】H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models
链接：https://arxiv.org/abs/2608.13049
作者：Dingyi Rong,Yue Shi,Chaofan Ma,Jiezhang Cao,Zongrui Wang,Zeyu Zhang,Yao Mu,Guangtao Zhai,Ning Liu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Large-scale manipulation data, Large-scale manipulation, difficult to scale, manipulation, data is essential
备注：
点击查看摘要
Abstract:Large-scale manipulation data is essential for robot learning, yet collecting robot demonstrations remains expensive and difficult to scale. Meanwhile, abundant egocentric human manipulation videos provide rich behavioral experiences, but transferring them across embodiments remains challenging due to differences between human hands and robotic end-effectors. Recent advances in video world models offer a promising pathway to synthesize robot-centric manipulation videos from human observations, while their cross-embodiment transfer capability remains largely unexplored. Therefore, we introduce H2R-Bench, a benchmark for evaluating cross-embodiment human-to-robot manipulation video generation, where models transform egocentric human demonstrations into robot manipulation videos under specified embodiments. Each benchmark instance contains a human demonstration video, target embodiment constraints, and source-grounded annotations covering task goals, action events, functional contacts, and object responses. H2R-Bench evaluates generated videos through five dimensions, including goal-state completion, action-event completion, functional contact transfer, embodiment correctness, and general video quality. We benchmark eleven state-of-the-art video generation models across six manipulation families and two robot embodiments. Our evaluation reveals that current video world models remain limited in human-to-robot manipulation transfer: even leading models often fail in embodiment consistency, functional interaction, and task execution. H2R-Bench provides a systematic diagnostic framework for evaluating whether video world models can bridge the human-to-robot embodiment gap and convert human manipulation observations into robot-centric training resources.
57. 【2608.13047】opology-Unified 2D Pose Estimation across Intact, Residual and Prosthetic Limbs
链接：https://arxiv.org/abs/2608.13047
作者：Tianye Qi,Tengyue Zhang,Jiaying Ying,Tianqing Zhu,Xin Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：numerous downstream tasks, plays a critical, downstream tasks, critical role, role in numerous
备注： 14 pages, 7 figures, 7 tables
点击查看摘要
Abstract:Driven by the availability of large-scale datasets, Human Pose Estimation (HPE) plays a critical role in numerous downstream tasks. However, mainstream benchmarks exhibit severe representation bias, predominantly featuring able-bodied individuals. While a few pioneering datasets have attempted to address limb differences, their annotation protocols fail to generalize, struggling to represent specialized mechanical structures like running blades or unprosthetized residual limbs. To bridge this gap, we introduce ProPose, a large-scale benchmark featuring a novel annotation protocol that unifies the topological representation of biological limbs, diverse prostheses, and physical absences within a single framework. Because real-world prosthetic images are inherently scarce and exhibit extreme long-tail distributions, we design a Real-to-Synthetic data expansion pipeline to explicitly synthesize and expand the underrepresented cases. However, simply training existing models on this enriched dataset often leads to suboptimal solutions, as they estimate each keypoint independently and might hallucinate non-existent joints on mechanical structures. To resolve this, we propose ProLoss, a structure-aware objective that enforces keypoint dependencies within a single limb to prevent unrealistic limb predictions. Extensive experiments demonstrate that our approach improves the classification accuracy of long-tail prosthetic joints by 2% to 6% without compromising spatial coordinate localization performance. This work sets a foundation for inclusive pose estimation, unlocking new possibilities for understanding the interactions between human bodies and assistive devices.
58. 【2608.13045】P2Fusion: Prompt-based Progressive Infrared-Visible Image Fusion via Dual-Prior Distillation
链接：https://arxiv.org/abs/2608.13045
作者：Yi Shi,Huichao Xie,Yuqing Wang,Mingyu Wang,Kaihui Yang,Yu Liu,Ruitao Lu,Lizhe Li,Junwei Han,Dingwen Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Infrared-visible image fusion, inherent information disparity, Infrared-visible image, textural features remains, fundamental challenge
备注： Accepted by ECCV 2026. Website: [this https URL](https://p2fusion.github.io)
点击查看摘要
Abstract:Infrared-visible image fusion (IVIF) is pivotal for multimodal perception, yet reconciling the inherent information disparity between thermal and textural features remains a fundamental challenge. Existing prior-guided methods often rely on static constraints that induce optimization conflicts or utilize extrinsic semantic priors from large-scale foundation models (e.g., CLIP/DINO), which frequently fail to exploit the intrinsic modality characteristics essential for high-fidelity fusion. To address these issues, we propose P2Fusion, a prior-guided distillation-based framework that reformulates IVIF via dual intrinsic prompts. Instead of imposing hard-coded penalties, we distill image-intrinsic priors, thermal saliency and spatial quality, into learnable dynamic regulators. Specifically, a Teach-to-Fuse mechanism provides dual-granularity progressive guidance, coupled with a Gated Dynamic Expert Recalibration (GDER) module for decoupled feature refinement. This design enables the network to adaptively mediate modal competition through expert specialization. Extensive experiments demonstrate that P2Fusion achieves state-of-the-art performance across five mainstream datasets. Notably, our framework demonstrates consistent performance advantages in fusion quality, achieving state-of-the-art results in 14 out of 20 key evaluation metrics across 5 benchmarks. Furthermore, it effectively contributes to the robustness of downstream perception, such as +3.2% mAP on MSRS, +0.5% mAP on M3FD and +0.9% mAP on DroneVehicle for object detection. Our code will be available at this https URL
59. 【2608.13043】From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion
链接：https://arxiv.org/abs/2608.13043
作者：Xichen Ye,Yifan Wu,Zhikang Xie,Xiangyu Yue,Cheng Jin,Weizhong Zhang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：substantial inference overhead, achieved dominant performance, inference overhead, achieved dominant, suffer from substantial
备注：
点击查看摘要
Abstract:Diffusion models have achieved dominant performance in visual generation but suffer from substantial inference overhead. While cache-based acceleration has emerged as a promising solution, existing policies rely on local similarity heuristics, which we identify as being significantly misaligned with final generation quality. This discrepancy stems from the non-uniform propagation and accumulation of errors along the denoising trajectory. To address this, we propose Global-Impact Cache (GCache). We first establish a rigorous theoretical characterization of the error propagation upper bound. Recognizing that this bound can be overly conservative for complex, highly non-convex diffusion models, we further reparameterize the propagation exponent with a Bernstein form and reformulate cache policy search as a bilevel optimization problem. In detail, GCache identifies an optimal reuse policy in the inner objective while aligning the error-weighting function with generation quality loss in the outer objective. This framework effectively reconciles theoretical rigor with empirical performance, learning to prioritize computation where it most impacts visual fidelity. Extensive experiments demonstrate that GCache consistently outperforms prior caching strategies on both video and image generation. Notably, on the state-of-the-art Wan2.1 video diffusion model, GCache maintains a 2.17x speedup while significantly enhancing generation quality, reducing LPIPS from 0.1095 to 0.0316.
60. 【2608.13037】Spatially-Grounded Text-to-Video Generation via Inference-Time Gradient-Free Optimization
链接：https://arxiv.org/abs/2608.13037
作者：Guillaume Jeanneret,Mathis Koroglu,Hugo Caselles-Dupré,Arnaud Dapogny,Matthieu Cord
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remarkable synthesis quality, achieved remarkable synthesis, fine-grained spatial controllability, spatial controllability remains, Diffusion Transformer
备注： Final Version
点击查看摘要
Abstract:Diffusion Transformer Text-to-Video models have achieved remarkable synthesis quality, yet fine-grained spatial controllability remains a significant challenge. While existing training-free methods produce solid overall results in spatially grounded generation, \ie, placing a specific object in a designated location, they rely on gradient-based optimization techniques that incur prohibitive computational overhead, a bottleneck amplified in modern large-scale architectures. To address this limitation, we present Gradient-free Analytical Trajectory Optimization Video Generation (GATO-Vid), a novel training-free and gradient-free approach for precise spatial guidance. Rather than relying on costly backward passes, we introduce an alternative cross-attention score and solve it analytically to obtain an exact, closed-form solution. To use our analytical solution, we propose an on-the-fly injection mechanism tailored to the topological manifold of the transformer's latent space. Our experiments demonstrate that GATO-Vid significantly outperforms existing baselines in localization accuracy while introducing minimal computational overhead.
61. 【2608.13031】UniTraffic-Agent: Unified Traffic Video Reasoning for AI City Challenge 2026 Track 3 with Two Out-of-Domain Evaluations
链接：https://arxiv.org/abs/2608.13031
作者：Peng Li,Qianqian Xu,Shilong Bao,Yangbangyan Jiang,Qingming Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：vulnerable road users, road videos provide, videos provide direct, Traffic video understanding, provide direct evidence
备注： This paper has been accepted to ECCV 2026 AI City Challenge Workshop
点击查看摘要
Abstract:Traffic video understanding has become an important problem in intelligent transportation, as road videos provide direct evidence for accidents, violations, and interactions between vehicles and vulnerable road users. A useful system should explain how a traffic event develops, why it happens, and when the relevant interaction occurs, yet this remains difficult for multimodal large language models (MLLMs) because traffic videos contain sparse events and varied viewpoints. We introduce UniTraffic-Agent, the MR-CAS solution for Track~3 of the 10th AI City Challenge, which includes Traffic Anomaly Reasoning (TAR) and two out-of-domain evaluations: FETV for fisheye traffic events and PSI-VQA for pedestrian intention reasoning. UniTraffic-Agent follows an observe--reason--act--verify workflow that samples timestamped visual evidence, reasons over all questions from the same clip in one request, and converts responses through task-specific action adapters. On the official Public leaderboards, MR-CAS ranks 16th on TAR with a score of 0.5780, 2nd on FETV with 0.4884, and 4th on PSI-VQA with 64.4161. The code is available at this https URL.
62. 【2608.13028】RGB-D Video Generation for Improving Human-to-Robot Object Handover Prediction
链接：https://arxiv.org/abs/2608.13028
作者：Tianyu Sun,Zhoujie Fu,Zihui Gao,Bang Zhang,Guosheng Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：human-robot collaboration, scarcity of large-scale, Temporal Face Encoder, fundamental capability, capability for human-robot
备注：
点击查看摘要
Abstract:Human-to-robot (H2R) object handover is a fundamental capability for human-robot collaboration, yet progress is hindered by the scarcity of large-scale, human-centric datasets and the significant sim-to-real gap. To address these challenges, we introduce Hand2Bot, an RGB-D video dataset that provides rich contextual information such as body posture and facial expressions, specifically collected for handover scenarios with real-world noise patterns. We further propose PassGen, a generative pipeline that leverages stable video diffusion and an Intention-Aware Temporal Face Encoder to synthesize realistic handover sequences while ensuring hand-object consistency. To bridge the sim-to-real gap, we implement a morphology-based depth editing strategy that replicates realistic sensor noise found in physical depth maps. Experimental evaluations demonstrate that our framework achieves high intention identification accuracy and low false trigger rates in both ablation studies and real-world deployment on a physical robot platform. Our results confirm that training on PassGen allows for robust zero-shot transfer and earlier intention anticipation compared to traditional hand-centric baselines, effectively enabling socially aware robotic behavior in shared workspaces.
63. 【2608.13014】EgoPHI: Estimating Contact and Force from Egocentric Vision
链接：https://arxiv.org/abs/2608.13014
作者：Andela Ilic,Rachel Schuchert,Yijing Jiang,Christian Holz
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Human-Computer Interaction (cs.HC); Robotics (cs.RO)
关键词：people physically engage, surrounding world, vision is essential, essential for modeling, modeling how people
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Understanding hand-object interaction from egocentric vision is essential for modeling how people physically engage with the surrounding world. Yet reasoning about physically grounded interaction requires estimating the forces acting on hands and objects, beyond localizing contact. We present EgoPHI, the first method that jointly estimates dense contact maps and 3D force distributions on hand and object meshes from a single monocular RGB image and object geometry. To address the lack of scalable ground-truth force annotations, we introduce a physics-based simulation pipeline that augments existing hand-object datasets with dense per-vertex force supervision. EgoPHI then learns dense 3D contact and force on interacting hand and articulated object meshes, extending vision-based force estimation beyond image-space or planar settings. Our evaluation on in-distribution and out-of-distribution benchmarks shows that EgoPHI improves force estimation over existing approaches while generalizing to unseen datasets. To evaluate sim-to-real transfer, we constructed two physical objects that capture dense object contact and force magnitude and used them to record a dataset of interactions from eight participants across diverse touch and grasp types. Our results demonstrate that EgoPHI recovers meaningful 3D contact and force distributions in simulated, out-of-distribution, and real-world settings, advancing egocentric hand-object understanding from contact localization toward physically grounded interaction reasoning.
64. 【2608.13007】Structure-aware Riemannian Growth Fields for 4D Plant Modeling
链接：https://arxiv.org/abs/2608.13007
作者：Meng-Yu Jennifer Kuo,Ryo Kawahara
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sparse temporal observations, modeling that reconstructs, plant growth modeling, temporal observations, sparse temporal
备注： Accepted to WACV 2027 (Round 1)
点击查看摘要
Abstract:In this paper, we introduce a novel framework for 4D plant growth modeling that reconstructs the continuous geometric and topological evolution of plants from sparse temporal observations. Existing methods mainly rely on dense registration, yet reliable dense sequences are hard to obtain due to scanning constraints and self-occlusions, leaving these approaches struggling under large temporal gaps where rapid organ emergence violates local rigidity. To overcome this, we bridge these gaps by formulating plant morphogenesis as a continuous procedural process on a structure-aware Riemannian growth field; this jointly models topology evolution and geometric deformation, preserving botanical hierarchies and stable spatio-temporal correspondences across distant timepoints. Our key idea is to ground symbolic growth rules within a continuous geodesic flow, where organ development follows biologically modulated trajectories that preserve structural coherence under topological changes. We further contribute a 10-day dual-species dataset with dense geometric and semantic annotations. Experiments demonstrate that our method accurately tracks individual organ growth over time and significantly outperforms state-of-the-art baselines in both geometric accuracy and correspondence consistency.
65. 【2608.12997】PixSDS: Why Latent SDS Makes Noisy Pixels
链接：https://arxiv.org/abs/2608.12997
作者：Vsevolod Skorokhodov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Score Distillation Sampling, Score Distillation, Distillation Sampling, optimizing rendered images, high-frequency texture noise
备注：
点击查看摘要
Abstract:Score Distillation Sampling (SDS) enables text-to-3D generation by optimizing rendered images with a pretrained diffusion prior, but latent SDS often produces structured color artifacts and high-frequency texture noise. We identify a failure mode of latent SDS caused by VAE-induced pixel drift: the optimized image can move along pixel-space directions that are weakly constrained by the VAE encoder, so its latent representation remains clean and semantically meaningful while the image itself accumulates visible artifacts. We support this diagnosis with controlled 2D SDS experiments, VAE-only optimization, and a simplified analysis showing that encoder-like latent objectives can amplify image-space noise when the inverse mapping to pixels is underconstrained. Motivated by this observation, we propose PixSDS, a lightweight VAE-consistent gradient repair method. PixSDS decodes a latent SDS lookahead step and uses the decoded image as a clean direction for pixel-space optimization, reducing motion in VAE-inconsistent directions without retraining the diffusion model, changing the renderer, or replacing the SDS objective. Experiments in 2D optimization and text-to-3D generation show that PixSDS substantially reduces structured artifacts while preserving semantic content. Code is publicly available at this https URL.
66. 【2608.12980】DiCoR: Decoupled Referent Disambiguation and Contour Recalibration for Efficient Referring Remote Sensing Image Segmentation
链接：https://arxiv.org/abs/2608.12980
作者：Ziyang Gao,Zhizhuo Jiang,Jingjing Chang,Yixin Yang,Yuwen Pan,Yong-Qiang Mao,Yu Liu,Hai-Bao Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Referring remote sensing, remote sensing imagery, remote sensing image, natural language expressions, Referring remote
备注：
点击查看摘要
Abstract:Referring remote sensing image segmentation (RRSIS) aims to delineate targets specified by natural language expressions in remote sensing imagery. Existing methods mainly follow joint fusion segmentation (JFS) or decoupled prompt segmentation (DPS). JFS is efficient but often suffers from limited accuracy because referent localization and mask delineation are optimized under a unified objective, whereas DPS separates localization from mask generation using spatial prompts and foundation segmenters at the cost of higher memory consumption and inference latency. To bridge this gap, we propose DiCoR, a decoupled referent disambiguation and contour recalibration framework built on an efficient JFS pipeline. DiCoR addresses two key challenges: distinguishing the correct referent from ambiguous candidates and refining coarse masks after localization. A disambiguation-aware localization guidance strategy ranks salient candidate regions with adaptive linguistic cues and injects the resulting localization prior into fused features. A lightweight contour recalibration module further predicts residual corrections to coarse logits under localized contour supervision, improving mask quality with limited computational overhead. Experiments on RefSegRS, RRSIS-D, and RISBench show that DiCoR achieves the best segmentation accuracy across all three benchmarks. On RefSegRS, it improves mIoU and gIoU by 5.28% and 2.87% over a competitive JFS method while running 4.7% faster than a representative DPS method, demonstrating a favorable accuracy-efficiency trade-off. Code is available at this https URL.
67. 【2608.12971】Bias Mitigation in Face Recognition via Demographic-based Supervised Contrastive Learning
链接：https://arxiv.org/abs/2608.12971
作者：Yu Linghu,Salman Mohammad,Xinyi Zhang,Manuel Günther
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Face recognition systems, exhibiting different error, Face recognition, Demographic-based Supervised Contrastive, recognition systems
备注： 8 pages, 1 figure, 5 tables
点击查看摘要
Abstract:Face recognition systems have been shown to be biased toward certain demographic groups by exhibiting different error rates across gender, age, or ethnicity. Though the imbalance of the training data with respect to these demographics is one cause of this bias, training on artificially balanced groups does not completely mitigate the problem. For deployment, face recognition typically works at operating points allowing very low false match rates and, hence, on the tail of the non-match score distribution. While class balancing can improve the means of these distributions, the aim of our approach is to improve fairness by addressing the behavior in the tail. Particularly, we propose the Demographic-based Supervised Contrastive loss (DeSCon) for face recognition, which relies on a well-designed composition of training batches and demographic-aware pair selection. Our experimental evaluation on both demographically-labeled datasets and standard verification benchmarks shows that DeSCon can improve fairness beyond balancing training datasets while maintaining competitive verification performance. Source code is available upon request.
68. 【2608.12960】A Deep RL based Framework for Targeted White Matter Tractography
链接：https://arxiv.org/abs/2608.12960
作者：Ankita Joshi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：brain structural pathways, enabling detailed, structural connectivity, modern neuroimaging, non-invasive mapping
备注： MTech (Research) thesis at IIT Mandi
点击查看摘要
Abstract:Fiber tractography's ability to reconstruct the brain's structural pathways, has made it a crucial component of modern neuroimaging, enabling detailed, non-invasive mapping of structural connectivity and supporting a wide range of neurological research and clinical applications. However, despite its importance, tractography remains a challenging task due to the inherent complexity of white matter structure and its susceptibility to false positives, which can lead to the misrepresentation of critical pathways. To overcome these limitations, in this thesis, we propose a hybrid framework that integrates reinforcement learning with supervised learning for refining RL policies, specifically tailored for tract-specific tractography. Notably, our framework does not rely on ground-truth fibers for training. Moreover, the tract-specific formulation bypasses the need for an explicit segmentation process, simplifying the overall pipeline. Our work includes two main contributions, each building upon the previous. First, we introduce a hybrid approach that combines reinforcement learning with supervised learning (specifically, GPT-based policy learning) to refine policies in a tract-specific context. Second, we propose a scalable framework for data-driven multi-policy fusion, which leverages the complementary strengths of multiple RL policies to improve tractography performance and robustness. We demonstrate the effectiveness of our framework through extensive validation on benchmark public datasets including TractoInferno, HCP, and ISMRM-2015, highlighting its ability to generalize across data sources and accurately reconstruct brain white matter tracts. We believe that these contributions represent significant advancements in the field of tractography, improving robustness, reliability, and accuracy while reducing dependence on ground-truth annotations.
Comments:
MTech (Research) thesis at IIT Mandi
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.12960 [cs.CV]
(or
arXiv:2608.12960v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.12960
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
69. 【2608.12920】nnisVAR: A Stroke-Evidence-Grounded Multimodal Large Language Model for Tactical Reasoning in Tennis Videos
链接：https://arxiv.org/abs/2608.12920
作者：Yifan Mei,Qingling Shi,Changli Wu,Jiayuan Rao,Jiayi Ji,Liujuan Cao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing tennis-video methods, collectively shape match, generate high-level analyses, actions collectively shape, perceive individual strokes
备注： Project Page: [this https URL](https://whynotgit2025.github.io/TennisVAR/)
点击查看摘要
Abstract:Sports-video understanding is moving beyond event recognition toward explaining how actions collectively shape match progression, however, existing tennis-video methods either perceive individual strokes without modeling their tactical dependencies or generate high-level analyses without grounding them in the underlying events. To bridge this perception-to-understanding gap, we formulate stroke-evidence-grounded tactical reasoning, a new rally-level task that requires models to jointly predict an open-ended answer, a hierarchical tactic label, an ordered sequence of supporting strokes, and decisive key actions, with each evidence stroke anchored to its racket-ball contact frame. We further introduce TRACE (Tactical Reasoning with Action-Chain Evidence in Tennis), a large-scale expert-annotated benchmark containing 11,189 rally videos, 41,485 stroke events, 25,429 tactical units, and 11,189 question-answer pairs, which unifies fine-grained stroke attributes, cross-stroke tactical relations, hierarchical tactic annotations, and evidence-grounded questions across factual perception, tactical understanding, and decision reasoning. Building on TRACE, we propose TennisVAR (Tennis Video Action-chain Reasoner), an evidence-grounded multimodal large language model that follows an "event-relation-evidence-tactic" reasoning paradigm, where an Event Parsing Module converts continuous rallies into explicit stroke-event sequences while a Tactical Graph-Guided Temporal Reasoner jointly models rally progression and same-player decision dependencies to identify question-relevant evidence and decisive actions.
70. 【2608.12911】Beyond Visual Evidence: Revealing and Mitigating Relational Privacy Leakage in Document MLLMs
链接：https://arxiv.org/abs/2608.12911
作者：Beining Xu,Hairui Wang,Jiaxin Wang,Changsheng Chen,Anirban Chakraborty
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Multimedia (cs.MM)
关键词：drawn significant attention, remain largely underexplored, multimodal large language, domain-specific MLLMs remain, MLLMs remain largely
备注： ACM mm 2026
点击查看摘要
Abstract:While the privacy risks of multimodal large language models (MLLMs) have drawn significant attention, the unique vulnerabilities of domain-specific MLLMs remain largely underexplored. Focusing on document understanding MLLMs for identity document processing, this paper investigates the privacy issues inherent in Key Information Extraction (KIE) tasks. We reveal that when input images lack sufficient visual evidence, these models often rely on memorized field relations from training data to infer missing content, thereby leaking multiple correlated fields containing sensitive personal information. To mitigate this risk, we make three key this http URL, we propose the Dynamic Relational Unlearning Framework (DRUF) which comprises a Relational Decoupling Unlearning (RDU) module and a dynamic set update mechanism. It suppresses the leakage of high-risk field pairs while preserving KIE this http URL, we introduce DocPrivacyBench, a novel benchmark to systematically evaluate a model's susceptibility to privacy leakage under conditions of absent or minimal visual this http URL, we evaluate three MLLMs and six unlearning methods using this benchmark, assessing both post-unlearning leakage suppression and utility this http URL results demonstrate that existing MLLMs consistently exhibit privacy leakage when visual evidence is scarce, particularly on noisier datasets. In contrast, DRUF outperforms the strongest baseline by improving leakage suppression by 4.8 percentage points, effectively mitigating privacy risks while maintaining robust document information extraction performance.
71. 【2608.12904】HounsWorld: A Multimodal World Model for Hidden Patient-State Readout, Reconstruction, and Simulation
链接：https://arxiv.org/abs/2608.12904
作者：Yunhao Bai,Zhongwei Qiu,Guangyu Guo,Yiming Huang,Tony C.W. Mok,Qinji Yu,Ling Zhang,Yan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intelligence requires estimating, patient underlying condition, Clinical intelligence requires, learning isolated mappings, requires estimating
备注：
点击查看摘要
Abstract:Clinical intelligence requires estimating a patient's underlying condition from incomplete observations rather than learning isolated mappings from scans to answers. Volumetric medical images provide dense observations of anatomy, attenuation, and lesions, whereas clinical language provides sparse but complementary semantic observations. We formulate CT-centered intelligence as inference over a shared latent patient state, under which readout, reconstruction, and simulation all become state-dependent prediction problems. To operationalize this view, we introduce HounsBench, a computed tomography (CT) centric patient-state benchmark that unifies these three task families with patient-disjoint splits and per-family metrics, and HounsWorld, a 3B multimodal world model that treats volumetric scans and language as observations of the shared state through Joint Understanding-Generation Learning. A shared transformer forms an implicit patient-state estimate and supports three outputs: query-conditioned answers that read out the state, reports and captions that reconstruct it in language, and condition-specific CT volumes for low-dose denoising, virtual contrast enhancement, and anatomy-constrained text-and-mask-to-volume generation. Zero-initialized CT adapters preserve pretrained multimodal mappings, while condition-explicit Hounsfield-unit window sampling exposes clinically meaningful density observations. HounsWorld shows strong performance across all three task families while consistently improving CT understanding through clinically structured completion. Our project is available at this https URL
72. 【2608.12898】NaviDC-OCR: Navigating Document Parsing Across Digital and Camera-Captured Documents
链接：https://arxiv.org/abs/2608.12898
作者：Peng Cai,Zhaofan Zou,Shifa Liu,Yikun Wang,Jiawei Tang,Kaicheng Yang,Meng Tong,Zhongjiang He,Hao Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：transform unstructured documents, aims to transform, transform unstructured, Document parsing, Document parsing aims
备注：
点击查看摘要
Abstract:Document parsing aims to transform unstructured documents into structured and machine-readable representations. Recent advances in Vision-Language Models (VLMs) have significantly advanced document parsing. However, existing approaches still face two major challenges. First, decoupled VLM-based methods heavily rely on accurate layout analysis, where geometric distortions in camera-captured documents can introduce cascading errors. Second, although end-to-end VLM-based methods alleviate the dependence on explicit layout detection, they often suffer from redundant generation, hallucinations, and insufficient structural reasoning in high-resolution scenarios. To address these challenges, we propose NaviDC-OCR, a unified framework for document parsing. NaviDC-OCR introduces deformation-aware learning to incorporate geometric perception into VLMs and proposes an adaptive sampling mechanism for complex layout representation. Furthermore, a content-structure decoupled learning strategy is developed to explicitly model formula grammars and table structures, enabling more effective structured representation learning. Extensive experiments demonstrate that NaviDC-OCR achieves state-of-the-art performance across diverse document parsing benchmarks. It obtains overall scores of 96.87, 88.53 and 78.41 on OmniDocBench v1.6, Wild-OmniDocBench, and PureDocBench, respectively, and ranks first in the ICDAR 2026 Sci-ImageMiner Challenge. These results validate the effectiveness and generalization capability of NaviDC-OCR in complex document parsing scenarios.
73. 【2608.12876】SPARED: Reasoning-Based AI-Generated Image Detection via Adversarially Edited Data
链接：https://arxiv.org/abs/2608.12876
作者：Yicheng Bao,Xiahui Guo,Xuhong Wang,Xin Tan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Detecting AI-generated images, invite provenance shortcuts, teach templated rationales, sources invite provenance, corpora teach templated
备注：
点击查看摘要
Abstract:Detecting AI-generated images is only half the task: a deployed detector must also justify its verdict, yet existing detectors inherit three failure modes from their training data: real and fake images collected from different sources invite provenance shortcuts, supervised explanation corpora teach templated rationales, and a static forgery corpus leaves the decision boundary standing still while generators keep moving. We introduce \methodname{}, an adversarial reinforcement learning framework that pits two heterogeneous models against each other. A diffusion image editor learns to edit real photographs into fake counterparts of those same photographs that fool the current detector, while a reasoning MLLM learns to expose them with a verdict grounded in free-form reasoning. Both rewards are shortcut-proof by design: the attacker is credited only when its edit is faithfully executed, and the defender only when its verdict is correct. As the two models alternate, each round's attacker regenerates a harder training pool aimed at the current detector's blind spots, so the detector must generalize rather than memorize any fixed artifact distribution. Although the explanation is never rewarded, its quality rises round over round as a side effect of accuracy-only training. A detector trained within this loop improves monotonically across rounds on each of three external benchmarks.
74. 【2608.12854】BrainWAM: Action-Space Coordination of Semantic Priors and Predictive Dynamics for Autonomous Driving
链接：https://arxiv.org/abs/2608.12854
作者：Bing Zhan,Shuyao Shang,Jiahao Gu,Shuo Lu,Yuan Xu,Zhao Wang,Yida Wang,Xueyang Zhang,Kun Zhan,Lue Fan,Zhaoxiang Zhang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：driving requires planning, Autonomous driving requires, predictive dynamics, models exploit VLM, requires planning
备注：
点击查看摘要
Abstract:Autonomous driving requires planning under both semantic constraints and predictive dynamics. Existing end-to-end driving approaches, however, typically emphasize only one side of this requirement: Vision-Language-Action (VLA) models exploit VLM priors for semantic reasoning, while World Action Models (WAMs) provide future-aware prediction through generative world modeling. This naturally motivates a unified planner that can leverage both semantic priors and predictive dynamics. However, we find that a naive combination through joint token-level attention suffers from an attention-allocation mismatch, where semantic shortcuts dominate the shared attention space and suppress predictive dynamics. Inspired by neuroscience evidence that complex behavior arises from coordination among functionally specialized systems, we propose BrainWAM, a structured action-space coordination framework that converts semantic reasoning and predictive world modeling into two specialized action-oriented pathways, and aligns them at the level of compact action representations. We further introduce an asynchronous rectified-flow inference strategy with decoupled video and action denoising, which shortens inference latency while preserving planning-relevant predictive context. BrainWAM reaches state-of-the-art performance on both NAVSIM v1 (89.5 PDMS) and NAVSIM v2 (89.6 EPDMS), consistently outperforming VLA-only or WAM-only methods, highlighting BrainWAM as a practical and promising direction for autonomous driving systems.
75. 【2608.12843】Heterogeneous Vision-Language Ensemble with Disagreement-Aware Reranking for Text-Based Person Anomaly Retrieval
链接：https://arxiv.org/abs/2608.12843
作者：Huu-An Vu,Cam Tu Tran Thi,Thanh Toan Le Ngo,Hoang Vo,Do Trung Hieu,Hieu Dinh Trung Pham,Khang Minh Le,Huy Minh Nhat Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：natural language descriptions, large image gallery, retrieve pedestrians exhibiting, pedestrians exhibiting anomalous, exhibiting anomalous behaviors
备注： Accepted at the ECCV 2026 Workshop
点击查看摘要
Abstract:Text-based person anomaly retrieval aims to retrieve pedestrians exhibiting anomalous behaviors from a large image gallery using natural language descriptions. Compared with conventional text-based person retrieval, this task requires fine-grained reasoning over pedestrian appearance, behaviors, object interactions, and scene context, making robust cross-modal matching significantly more challenging. This paper presents the GENAI4E team's solution to AI City Challenge 2026 Track 4. Our framework builds upon a strong retrieval backbone and progressively integrates heterogeneous vision-language embedding models through score alignment and iterative ensemble fusion, followed by disagreement-aware VLM reranking for ambiguous queries. On the official Pedestrian Anomaly Behavior (PAB) benchmark, our approach achieves 90.92% mAP, 85.13% Recall@1, 97.72% Recall@5, and 98.68% Recall@10, demonstrating the effectiveness of combining complementary vision-language representations with selective multimodal reasoning for large-scale text-based person anomaly retrieval.
76. 【2608.12829】Semantic Steering for Controllable Generation: Tuning-Free Concept Erasure in Multimodal Diffusion Transformers
链接：https://arxiv.org/abs/2608.12829
作者：Qiao Li,Xiaomeng Fu,Yuanshu Zhao,Qipeng Wang,Jiao Dai,Jizhong Han
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Diffusion Transformers, Multimodal Diffusion, Diffusion Transformers, surpassing traditional, demonstrated remarkable
备注： Accepted to ACM MM 2026
点击查看摘要
Abstract:Multimodal Diffusion Transformers (MM-DiTs) have demonstrated remarkable text-to-image generation performance, surpassing traditional U-Net-based diffusion models. Nevertheless, their powerful generative capabilities also raise significant safety concerns, as they may generate sensitive or inappropriate content. While existing concept erasure methods aim to mitigate such risks, most require modifying model parameters, which are often architecture-specific and impractical for deployed larger models. Several tuning-free approaches face challenges when applied to advanced large-scale MM-DiTs due to their deeply embedded knowledge, broad semantic space, and context-dependent text encoders. To address these challenges, we propose to erase concepts by directly manipulating the model's internal representations. Our key insight, derived from an in-depth analysis of MM-DiT's block-wise generative roles, is that text-conditioned semantic representations are most salient in the middle blocks of MM-DiTs. Based on this, we extract representations of an unwanted concept and a desirable safe one from the middle block, construct a steering vector from their difference, and inject this single vector into consecutive early and middle blocks. By operating exclusively on the sparse text-branch tokens and leveraging the straight sampling trajectory of rectified flow, our method achieves effective concept erasure with negligible overhead and without any training. Extensive experiments across MM-DiT models demonstrate that our method achieves state-of-the-art performance in erasing diverse concepts, enables effective control over the final output, and remains robust to adversarial attacks.
77. 【2608.12827】Validation of Smartphone-Based Photogrammetric 3D Body Scanning for Automated Anthropometric Measurements Compared with a Commercial Depth-Sensor-Based Body Scanner
链接：https://arxiv.org/abs/2608.12827
作者：Ruting Cheng,Boyuan Feng,Chuhui Qiu,Joaquin A. Calderon,Qing Pan,Yufan Liu,James K. Hahn
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：non-invasive nature, important tool, tool in healthcare, rapid and non-invasive, longitudinal body-shape
备注： 16 pages, 5 figures, 4 tables
点击查看摘要
Abstract:3D body scanning has become an important tool in healthcare applications because of its rapid and non-invasive nature. While smartphone-based photogrammetric reconstruction provide a low-cost and accessible alternative to commercial 3D body scanners, their performance for whole-body scanning remains insufficiently validated. Thus, we designed this study to comprehensively validate the photogrammetric 3D scanning application by evaluating automatically extracted whole-body measurements and longitudinal body-shape monitoring. We evaluated a representative application, PolyCam, against the commercial depth-sensor-based Fit3D ProScanner using 144 pregnant participants scanned longitudinally throughout pregnancy. We designed an automatic circumference extraction pipeline to get measurements at four anatomical landmarks from paired 3D scans. A linear mixed-effects model was used to evaluate scanner effects and longitudinal body-shape changes. Measurement consistency was assessed using repeated PolyCam scans and tape measurements on a rigid mannequin. PolyCam demonstrated strong agreement with Fit3D, with average biases below 16 mm, intraclass correlation coefficients above 0.8, and Pearson correlation coefficients above 0.9 across all landmarks. Both systems captured comparable longitudinal body-shape changes. Mannequin experiments showed mean biases below 3.5 mm and no significant differences from tape measurements. These findings support smartphone photogrammetry as a potential accessible alternative to commercial body scanners and applicable for longitudinal 3D body-shape assessment.
78. 【2608.12825】LocusGS: Spatially Grounded Tokens for Feed-Forward 3D Gaussian Splatting
链接：https://arxiv.org/abs/2608.12825
作者：Wenyu Li,Sidun Liu,Tongrui Hu,Peng Qiao,Yong Dou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent query-based feed-forward, aggregating multi-view evidence, Recent query-based, methods represent, Gaussian
备注：
点击查看摘要
Abstract:Recent query-based feed-forward 3DGS methods represent a scene using learnable queries, each aggregating multi-view evidence and decoding a group of Gaussians. Ideally, different queries should specialize in coherent local regions of the scene. However, we observe that Gaussians decoded from the same query often scatter across distant scene regions, resulting in weak query-level spatial coherence and poor alignment with the scene structure. We attribute this behavior to the purely latent representation of existing Gaussian queries. To address this limitation, we introduce LocusGS, which augments each Gaussian query with a 3D anchor state consisting of a center and a support radius. The anchor state is progressively refined across decoder layers and is used throughout query interaction, multi-view feature aggregation, and Gaussian generation. Specifically, an anchor-to-ray geometric bias guides each query toward spatially relevant image observations, while anchor-centered decoding organizes its Gaussians within a local region. Experiments on novel view synthesis benchmarks show that LocusGS improves rendering quality over query-based Gaussian token baselines under the same Gaussian budget. Further analysis shows that the learned anchors form coherent spatial layouts and lead to more structured Gaussian distributions, demonstrating that explicit anchor states improve the spatial organization. Our project page: this https URL.
79. 【2608.12811】Structured Local Differential Modeling for AI-Generated Image Detection
链接：https://arxiv.org/abs/2608.12811
作者：Jiazhen Yang,Ruijin Jin,Junjun Zheng,Xiangheng Kong,Zunlei Feng,Jie Lei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：increasingly critical challenge, critical challenge, rapid advancement, content has made, made the reliable
备注：
点击查看摘要
Abstract:The rapid advancement of AI-generated content has made the reliable detection of generated images an increasingly critical challenge. Existing detection methods are often dominated during training by semantically salient components with high signal-to-noise ratios (SNRs), thereby suppressing subtler forensic cues associated with the underlying generation mechanisms and embedded in low-level statistical structures. From an information-theoretic perspective, we present a key insight: effective detection in the low-level statistical space requires mitigating the dominance of semantic components while emphasizing and amplifying responses to low-SNR forgery traces. Building on this insight, we propose RippleNet, an AI-generated image detection framework based on local differential signals. RippleNet adaptively identifies forgery-sensitive regions and constructs multi-directional, multi-scale differential representations within local neighborhoods, explicitly characterizing anomalous patterns in neighborhood statistics. More importantly, we refine the attention mechanism to operate within the local differential representation space, enabling the model to establish explicit dependencies at a finer statistical granularity. This design facilitates the capture of pixel-level forgery traces that are difficult to model using conventional convolutions or image-wide patch-level attention. Extensive experiments on multiple public benchmarks and under cross-generator evaluation settings demonstrate that RippleNet achieves consistently competitive performance.
80. 【2608.12806】Erase but Preserve: Controllable Removal of Copyrighted Animation Characters via Optimized Semantic Anchors
链接：https://arxiv.org/abs/2608.12806
作者：Qiao Li,Xiaomeng Fu,Wangjia Yu,Runze He,Baisen Wang,Jiao Dai,Jizhong Han
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：raised copyright concerns, exceptional generation capabilities, copyright concerns, raised copyright, unauthorized reproduction
备注： Accepted to ACM MM 2026
点击查看摘要
Abstract:The exceptional generation capabilities of text-to-image diffusion models have raised copyright concerns, particularly the unauthorized reproduction of animation characters. Existing concept erasure methods fall short for animation character erasure: model modification methods struggle to identify suitable anchors for diverse, highly distinctive characters; prompt-based steering methods lack fine-grained control for precise intervention. These approaches often yield incomplete erasure and degraded image fidelity, hindering real-world deployment. In this paper, we propose a controllable method operating on the model's continuous textual representation to erase target characters during generation. We optimizes an anchor embedding via structural and detailed constraints to serve as a character surrogate, then replaces target-related embeddings with the anchor via a structure-aware adaptive strategy. Experiments show that our method achieves state-of-the-art erasure effectiveness and image fidelity preservation, while supporting controllable erasure degree, multi-target removal, and model transferability. Moreover, our optimized anchors are plug-and-play with current model modification baselines to improve their erasure performance.
81. 【2608.12781】Beyond Correctness: Benchmarking and Aligning Response Behaviors in Hybrid-Thinking MLLMs
链接：https://arxiv.org/abs/2608.12781
作者：Xinming Wang,Weinong Wang,Hongming Yang,Yansong Lin,Zheng Ruan,Shangpin Peng,Qiming Peng,Nan Qiao,Fengyuan Lu,Guoqing Ma,Marito Li,Songyang Zhang,Saiyong Yang,Han Hu,Yonglong Tian,Xu-Yao Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, large language models, large language, alternate between deliberative, latency-efficient non-thinking inference
备注： 8 tables and 6figures
点击查看摘要
Abstract:Hybrid-thinking multimodal large language models (MLLMs) allow a single model to alternate between deliberative thinking and latency-efficient non-thinking inference. Although these modes differ in reasoning budget, their delivered responses should satisfy the same user-facing standard. Correctness alone may not characterize this response quality; we therefore evaluate task accuracy and response-pattern failures as complementary outcomes. We study this gap through \textbf{response-pattern alignment}: whether thinking and non-thinking interfaces preserve acceptable final-response behavior. We introduce \textbf{PatternEval}, a failure-enriched diagnostic benchmark comprising 2,415 multimodal prompts spanning visual perception and grounding, structured image understanding, and multimodal knowledge reasoning. PatternEval tests four recurrent failures: chain-of-thought leakage, response repetition, logical contradiction, and performative reasoning. Response-pattern failures are widespread across models from different providers, with non-thinking inference exhibiting substantially higher failure rates and thereby creating systematic misalignment between thinking and non-thinking interfaces. Motivated by this diagnosis, we develop \textbf{PatternRM}, a response-level reward model, and \textbf{PatternRL}, which introduces pattern-specific penalties during reinforcement learning. Experiments on Qwen3-VL-4B and Qwen3-VL-8B show that incorporating pattern-specific penalties into reinforcement learning can mitigate cross-mode misalignment while incurring a marginal task performance trade-off. Together, PatternEval and PatternRL provide an evaluation-and-training framework for aligning user-visible response patterns across hybrid-thinking interfaces.
82. 【2608.12780】SCOPE: Subspace Clustering with Online Per-Head Top-K Estimation for Sparse Video Attention
链接：https://arxiv.org/abs/2608.12780
作者：Qi Zhao,Qirui Li,Hanlin Tang,Yiduo Li,Zhen Guo,Cuifeng Shen,Chao Xu,Zhaosheng Chi,Xiaojin Lu,Kan Liu,Tao Lan,Lin Qu,Xi Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion Transformers, incur quadratic self-attention, quadratic self-attention cost, Top, incur quadratic
备注：
点击查看摘要
Abstract:Diffusion Transformers (DiTs) incur quadratic self-attention cost over spatiotemporal tokens. Existing training-free sparse attention methods often construct sparse masks from block-level or cluster-level proxy scores, which can obscure fine-grained differences among keys and miss high contribution keys under aggressive sparsity. Moreover, such proxy scores may yield overly concentrated softmax distributions, causing Top-$p$ to retain too few keys for some query clusters. Although a fixed Top-$k$ minimum alleviates this failure mode, a shared value cannot adapt to variations across heads and inputs. To address both limitations, we propose SCOPE, a training-free sparse attention framework that combines 3D-RoPE-aligned key subspace clustering with online per-head Top-$k$ estimation for efficient video-DiT inference. SCOPE partitions post-RoPE keys into temporal, height, and width subspaces, clusters them independently, and aggregates the corresponding centroid scores through lookup tables to obtain per key proxy scores for each query cluster. Building on existing hybrid Top-$p$/fixed Top-$k$ selection, SCOPE derives a head-specific Top-$k$ value online by averaging the initial retained key counts within each head, weighted by query cluster size, and selects additional keys only for query clusters whose initial retained key counts fall below this value. Sparse attention is then computed over the selected original keys and values. Across six model--task configurations, SCOPE consistently outperforms existing training-free baselines in both fidelity and latency, achieving up to a $1.99\times$ end-to-end speedup on 720p HunyuanVideo with $28.46$ dB PSNR relative to dense attention.
83. 【2608.12773】CW-BASS v2: Saturation-Aware Pseudo-Label Selection for Semi-Supervised Segmentation under Foundation-Model Teachers
链接：https://arxiv.org/abs/2608.12773
作者：Ebenezer Tarubinga
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：Semi-supervised semantic segmentation, soft confidence weights, under-confident ResNet teachers, Semi-supervised semantic, under-confident ResNet
备注： Submitted to IEEE TPAMI. 22 pages, 11 figures, 17 tables
点击查看摘要
Abstract:Semi-supervised semantic segmentation has long turned on one question, which pseudo-labels to trust, and a generation of selection rules, dynamic thresholds, per-class curricula, soft confidence weights, answered it for the noisy, under-confident ResNet teachers of their day. Self-supervised foundation encoders change the regime: with a DINOv2 teacher, confidence saturates, so the filtering that helped a weak teacher can hurt a strong one. We propose CW-BASS v2, a saturation-aware pseudo-label selection method that reads the teacher's confidence regime rather than committing to one rule. It pairs held-out calibration, an unbiased per-class noise estimate, with a self-adaptive confidence floor that provably bounds retention away from 1, and combines them in a one-pass gate: measure the reliability of the teacher's confident set, pi_kept = Pr[correct | c = tau], on a held-out slice, and filter strictly when it meets the confidence demanded (pi_kept = tau), falling back to the adaptive floor otherwise. The boundary is the pre-existing operating threshold, not a value tuned to mIoU, and across six DINOv2 teachers it makes the correct strict-vs-floor call blind. CW-BASS v2 thus recovers the UniMatch V2 operating point on the saturated benchmarks by selecting strict (Pascal VOC 1/8 87.4 against its reported 87.9; Cityscapes within 0.5), and improves on it where the confident set is unreliable (pi_kept ~ 89%, ADE20K), where the floor edges ahead (+1.5 mIoU, single seed). The gate is principled because the failure it avoids is measured, not assumed: on a reliable, saturated teacher the confidence distribution's dynamic range collapses (98% of Pascal pixels = 0.95), so an adaptive cutoff floods the retention mask and self-training decays into confirmation bias.
84. 【2608.12766】PatchGen: Learning Soft Intra-Image Predictive Subsets for Visual Generalization
链接：https://arxiv.org/abs/2608.12766
作者：Zhaorui Tan,Weimiao Yu,Xi Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：intra-image predictive sufficiency, address intra-image predictive, Visual classifiers, existing methods focus, oracle intra-image predictive
备注：
点击查看摘要
Abstract:Visual classifiers are expected to generalize under data shifts, target shifts, and their combinations, yet most existing methods focus on domain invariance while failing to address intra-image predictive sufficiency. We investigate the structural hypothesis that each image contains a sample-adaptive oracle intra-image predictive subset sufficient for label prediction, while the remaining patches form non-essential complementary context that may correlate with the label. The theoretical analysis shows that restricting prediction to this oracle subset preserves the Bayes risk achievable by the full-patch representation while admitting a complexity bound that tightens with the oracle-subset size. Based on this view, we propose PatchGen, a text-free module that learns a sample-dependent soft predictive-subset mask as a task-driven proxy for the unobserved oracle subset mask. Specifically, histopathology visualizations suggest that PatchGen assigns higher scores to tumor-consistent regions than to some frequently co-occurring inflammatory context. Extensive experiments on natural and histopathological image benchmarks spanning all three shift settings show that PatchGen improves average performance over matched-backbone baselines in most evaluated configurations, enhances generalization to unknown classes, and remains competitive with vision-language methods without text supervision.
85. 【2608.12748】Scaling Representation Diversity: Modulated Attention and Reconstructive Regularization for Visual Grounding
链接：https://arxiv.org/abs/2608.12748
作者：Junyi Hu,Tian Bai,Fengyi Wu,Yian Huang,Wei Wen,Zaoli Li,Junli Lin,Xingchen Li,Zhenming Peng,Yi Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Referring Expression Comprehension, Expression Comprehension, limited cross-dataset generalization, dataset-specific fine-tuning, resulting in specialist
备注： 21 pages, 10 figures, 6 tables
点击查看摘要
Abstract:Referring Expression Comprehension (REC) is commonly studied under dataset-specific fine-tuning, resulting in specialist models with limited cross-dataset generalization. In this work, we revisit REC from the perspective of unified open-vocabulary grounding and identify representation degeneration as a key obstacle to scaling a single generalist model. To preserve representation diversity, we propose a holistic data-model co-design framework. Architecturally, we introduce the Modulated Attention-Contrastive Head (mACH) for efficient token-level vision-language alignment and a text-conditioned JEPA auxiliary stream that provides complementary gradient support to preserve alignment-active representations without inference overhead. On the data side, we introduce Objects365-Caption, enriching Objects365 with context-aware referring expressions for large-scale language supervision. We further provide a theoretical analysis showing that complementary gradient subspaces preserve alignment capacity and thereby scale representation diversity. Extensive experiments demonstrate that our single-checkpoint framework achieves highly competitive performance on standard REC benchmarks while exhibiting strong generalization across heterogeneous grounding datasets without benchmark-specific adaptation.
86. 【2608.12746】Dual-Stream Cross-Anchor Correction Grounding Long-Form Captions and the Domain Limits of Object-Level Anchors
链接：https://arxiv.org/abs/2608.12746
作者：LingKai Bu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：co-occurrence bias outweigh, corpus co-occurrence bias, multimodal large language, individual object mention, large language models
备注：
点击查看摘要
Abstract:Object hallucination in multimodal large language models arises when language priors and corpus co-occurrence bias outweigh the visual evidence, with nothing tying an individual object mention to what the image shows. Most remedies intervene at decoding time without training, yet under a unified protocol their benefit is confined to short captions;supervised fine-tuning (SFT) on a detail- rich corpus lengthens captions, but over forty percent still name absent objects. This paper proposes Dual-Stream Cross-Anchor Correction (DSCC). Unlike work that post-processes decoding, DSCC is the first to inject object-level visual anchors into the language model itself during fine- tuning: a perception stream aligns object-level hidden states at an intermediate layer to frozen text anchors by a bidirectional contrastive objective; a cognition stream lets deeper layers query those anchors by cross-attention at every generation step; and a two-stage curriculum gate couplesthem, making evidence retrieval a structural constraint at each autoregressive step. Under one backbone and one scoring protocol, experiments span long-caption hallucination, object-existence discrimination and cross-domain generalisation, with vanilla SFT on the same corpus and schedule as a length- and density-matched control, so gains are attributed layer by layer. DSCC is the only method reaching the long-caption, low-hallucination region: captions roughly 1.9 times the baseline length at 88.19% precision per object mention, the highest under a density-independent criterion. Ablations expose a synergy: the perception stream alone degrades precision yet reverses sign when stacked on the cognition stream. No universal superiority is claimed: three out-of- domain benchmarks yield a predictable, falsifiable domain-conditionality, the synergy being bound to the anchors' semantic domain and breaking on charts and optical illusions.
87. 【2608.12737】Dual-Manifold Geometry Guided Representation Learning: Adaptive Coupling between Kernel and Data Spaces
链接：https://arxiv.org/abs/2608.12737
作者：Wencong Zhang,Yue Zhang,Meiyan Huang,Wei Yang,Qianjin Feng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep representation learning, structured geometry embedded, Deep representation, primarily focused, largely overlooking
备注：
点击查看摘要
Abstract:Deep representation learning has primarily focused on how features evolve across network layers, while largely overlooking the structured geometry embedded in network parameters. We introduce a dual-manifold perspective in which each convolutional layer contains two coupled geometric spaces: a Kernel Manifold induced by convolutional filters and a Data Manifold characterized by intermediate feature representations. Because these manifolds share the same channel space, parameter geometry can provide complementary structural information to guide feature evolution. Based on this insight, we propose Kernel-Guided Feature Transform (KGFT), a lightweight module that derives a geometric guidance matrix from the kernel Gram matrix and uses it to transform the covariance structure of feature representations. Unlike conventional attention mechanisms that reweight feature responses, KGFT explicitly reshapes feature relationships by transferring geometric information from the kernel manifold to the data manifold. To accommodate network hierarchy, we further introduce Exploit and Explore modes with a depth-aware scheduling strategy and a learnable guidance strength that adaptively controls the contribution of geometric transformation. This design promotes geometric alignment in shallow layers while encouraging feature diversity in deeper layers, without imposing excessive constraints on representation learning. Theoretical analysis establishes the validity of the proposed transformation and characterizes its effect on feature covariance. Extensive experiments across CNN- and Transformer-based architectures, including ResNet, ViT, and LLaMA-7B, demonstrate consistent improvements on image classification and arithmetic reasoning tasks, validating the generality and effectiveness of kernel-guided dual-manifold representation learning. Code will be publicly available.
88. 【2608.12725】A Generative Approach for Improving Multi-Label Defect Classification in Photovoltaic Modules
链接：https://arxiv.org/abs/2608.12725
作者：Abdul Mueez,Yogesh S. Rawat,Shruti Vyas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Fast Fourier Convolutions, paper addresses, addresses the challenge, Generative Defect Isolation, GDI
备注：
点击查看摘要
Abstract:This paper addresses the challenge of multi-label defect classification in electroluminescence (EL) images of photovoltaic (PV) cells. Training models on images where multiple defects co-occur creates learning ambiguity, making it difficult to disentangle visual features for specific defect types, a problem compounded by the scarcity of examples for individual classes. To tackle this, we introduce Generative Defect Isolation (GDI), utilizing the LaMa inpainting model with Fast Fourier Convolutions to remove selected defects and generate realistic, single-defect training samples. Extensive experiments on Vision Transformer (ViT-S, ViT-L) and EfficientNetV2-L architectures demonstrate that GDI significantly outperforms baselines. The performance gains are most pronounced in low-data scenarios; class-wise analysis shows substantial improvements, boosting the F1-Score for rare defect classes by up to 63.6%. Furthermore, GDI effectively resolves learning ambiguity from co-occurring defects, yielding a 26% reduction in such co-occurring classification errors. Our work establishes GDI as an effective method for maximizing the value of existing segmentation datasets and sets a new performance benchmark for multi-label classification in this domain.
89. 【2608.12721】VOS-Agent: The 1st Place Solution for the 8th LSVOS Challenge (MOSEv2 Track)
链接：https://arxiv.org/abs/2608.12721
作者：Canyang Wu,Jinrong Zhang,Xusheng He,Ce Bian,Xianjing Han,Jianlong Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Complex video object, Complex video, requires robust target, video object segmentation, object segmentation requires
备注： 1st Place Solution for the 8th LSVOS MOSEv2 Challenge (ECCV 2026 Workshop)
点击查看摘要
Abstract:Complex video object segmentation requires robust target propagation under severe occlusion, disappearance and reappearance. Although SAM3 provides strong promptable mask propagation, a uniform inference path remains unreliable for tiny targets with insufficient visual evidence and semantic-dominated targets whose identities depend on explicit attributes. To this end, we present VOS-Agent, a collaborative framework that retains SAM3 as the shared dense segmentation module and conditionally activates specialized agents according to target characteristics. A Target Perception and Routing Agent assigns each sequence to a regular, tiny, or semantic-dominated route. Tiny targets are supported by a Visual Tracking Agent through confidence-aware box prompts, while semantic-dominated targets are handled by an MLLM-based Semantic Agent through description-guided localization and candidate verification. On the MOSEv2 test set, VOS-Agent achieves 69.82% on the official $\mathcal{J}\\dot{\mathcal{F}}$ metric and ranks first in the MOSEv2 Track of the 8th LSVOS Challenge at ECCV 2026.
90. 【2608.12714】owards Sparsely Annotated Open-World Object Detection
链接：https://arxiv.org/abs/2608.12714
作者：HeeJu Han,AJeong Kim,Jinsun Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Real-world object detection, Real-world object, object detection, object detection operates, Sparsely Annotated Open-World
备注：
点击查看摘要
Abstract:Real-world object detection operates under ambiguous supervision, where unlabeled regions may correspond to missing annotations of known objects or genuinely unknown categories. These challenges have been addressed separately in Sparsely Annotated Object Detection (SAOD) and Open-World Object Detection (OWOD). In practice, their co-occurrence remains an open problem. To address this problem, we introduce Sparsely Annotated Open-World Object Detection (SA-OWOD), a new task that jointly considers sparse supervision and the presence of unseen categories. We propose Dual-Perspective Object Discovery (DPOD), a unified framework that jointly models unlabeled known and unknown instances via two complementary mechanisms. The Known Target Recovery Module (KTRM) recovers supervision for unlabeled known instances and explicitly regularizes the feature space to separate known and unknown representations. Complementarily, the Dual-Disagreement Target Generator (DDTG) identifies reliable unknown candidates through cross-view semantic inconsistency. By integrating these modules, DPOD resolves contradictory supervision signals caused by ambiguous unlabeled regions. As a result, it prevents misclassification between known and unknown objects and stabilizes the decision boundaries. Experimental results on sparsely annotated open-world benchmarks demonstrate that the proposed method outperforms existing open-world detection methods, particularly in detecting unknown objects.
91. 【2608.12698】Class Geometry as Supervision for Sample-Efficient Open-World Detection
链接：https://arxiv.org/abs/2608.12698
作者：Akash Rao,Zhou Chen,Revanth Reddy Palem,Udhav Ramachandran,Ruth Scimeca,Sathyanarayanan N. Aakur
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reject unfamiliar objects, detection requires models, reject unfamiliar, requires models, models to recognize
备注： Under review. 12 Pages, 5 figures, 4 tables
点击查看摘要
Abstract:Open-world object detection requires models to recognize known categories, reject unfamiliar objects, and incorporate new classes over time. This is especially challenging in scarce-data settings such as biomedical and scientific imaging, where rare categories may have only a few annotated examples and fine-grained classes differ by subtle morphology. Prototype-based detectors are natural for this regime, but they typically learn class prototypes as independent anchors, ignoring relational structure among classes. We propose class-geometry supervision (CGS), a general framework that constrains learned prototype or class-representation spaces to preserve visual or semantic class dissimilarities estimated from training data. CGS introduces a dissimilarity-preserving objective that aligns pairwise distances among learned class representations with a target class-geometry matrix while retaining the standard task loss. We instantiate the same objective across prototype recognition, few-shot biomedical object detection, open-set detection, novel-class insertion, and OWOD adaptation on COCO. Experiments show that CGS improves sample efficiency in recognition and ova detection, substantially strengthens novel-class insertion, and improves unknown recall on COCO while retaining much of the known-class detection performance. Ablations show that meaningful visual geometry provides the most reliable gains, while random geometry can help novel separation but is less consistent for few-shot detection. These results suggest that relational class geometry is an effective supervisory signal for building calibrated and extensible open-world detectors under limited supervision.
92. 【2608.12689】Mr3D-VL: A generalist vision language foundation model for Multiparametric 3D Magnetic Resonance Imaging
链接：https://arxiv.org/abs/2608.12689
作者：Zhi Qiao,Xintong Wu,Yichu He,Feng Shi
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：face critical limitations, reasoning required clinically, brain tumor diagnosis, natural language interaction, interpretability impedes spatial
备注：
点击查看摘要
Abstract:Multi-parametric magnetic resonance imaging (mpMRI) is a cornerstone for brain tumor diagnosis and treatment, yet current AI models face critical limitations: their lack of natural language interaction and interpretability impedes spatial information integration and cross-modal reasoning required clinically. Key challenges arise from significant physical meaning differences across modalities, spatial misalignment due to scan intervals, and the need for complex multi-feature interpretation in tasks like glioma grading. While visual-language models (VLMs) show promise in cross-modal understanding, existing methods focus mainly on 2D image modeling, neglecting direct perception of 3D volumetric space. Although 3D VLMs have been proposed for report generation and feature alignment in 3D CT imaging, mpMRI applications demand collaborative inference across multiple imaging modalities-a requirement unmet by current solutions. To address this, we introduce Mr3D-VL, a dedicated visual-language foundation model for multi-parametric 3D MRI. With 4 billion parameters, it employs an unsupervised pre-trained shared 3D encoder and 4D rotational positional embedding for dual modality-spatial integration. Its cross-modal projection layer uses a multi-resolution feature implantation strategy to enhance feature perception across resolutions. Experimental results show significant improvements over existing 4B/7B/30B domain-specific and general-purpose models in text generation tasks, achieving a BERTScore of 0.856 for report generation, with question-answering accuracy at 0.713 and multiple-choice accuracy at 0.912.
93. 【2608.12683】FUSE: Active Functional Affordance Grounding through Adaptive Semantic-Geometric Evidence Acquisition
链接：https://arxiv.org/abs/2608.12683
作者：Zhou Chen,Sathyanarayanan N. Aakur
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：actively acquire observations, reveal discriminative functional, Embodied agents, actively acquire, acquire observations
备注： Under review. 15 Pages. 9 tables, 3 Figures
点击查看摘要
Abstract:Embodied agents must often identify and interact with objects based on their function rather than their identity, requiring them to actively acquire observations that reveal discriminative functional evidence. Existing affordance grounding methods operate from fixed viewpoints and lack mechanisms for deciding where to look when functional cues are occluded or incomplete. We introduce Active Functional Affordance Grounding, a new task in which an agent sequentially explores a scene to identify and spatially ground an object satisfying a functional query. To address this problem, we propose FUSE, an adaptive semantic-geometric evidence acquisition framework that combines explicit uncertainty-driven exploration with a learned amortized planner to efficiently select informative viewpoints. We further introduce a Habitat-based benchmark for evaluating active functional grounding. Experiments show that FUSE achieves the highest observed non-oracle grounding performance while reducing computation by 1.33x relative to fully explicit exploration, and remains effective across multiple affordance knowledge sources.
94. 【2608.12677】he Role of Natural Language Understanding in Multimodal Video-Based Dengue Diagnosis
链接：https://arxiv.org/abs/2608.12677
作者：Danial Sharifrazi,Saadat Behzadi,Julakha Jahan Jui,Mojtaba Mohammadi,Nouman Javed,Roohallah Alizadehsani,Prasad N. Paradkar,Asim Bhatti
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Detecting infection-related behavioral, feature extraction difficult, reliable feature extraction, make reliable feature, move rapidly
备注：
点击查看摘要
Abstract:Detecting infection-related behavioral changes in mosquitoes from video data is challenging because mosquitoes are small, move rapidly and irregularly, and are affected by environmental factors such as background, lighting, and shadows, which can make reliable feature extraction difficult. In this study, a YOLO- and Contrastive Language-Image Pre-training (CLIP)-based vision-language framework is proposed to classify mosquito flight frames of uninfected and Dengue virus serotype 2 (DENV2)-infected mosquitoes. First, YOLO is used to isolate mosquito regions from the background. Then, visual features extracted from video frames are aligned with biologically meaningful textual prompts in a shared embedding space. The multimodal model was fine-tuned using supervised bidirectional contrastive learning and evaluated through frame-level image-text similarity-based classification. The results show that the proposed method achieved 98.54% accuracy and 99.91% sensitivity at the frame level. After temporal aggregation of frame-level information, the model achieved complete video-level performance. The ablation results showed that fine-tuning and CLIP-based representations were essential for this domain, while the textual branch provided semantic image-text alignment rather than an accuracy advantage over the vision-only model. These findings suggest that vision-language models can provide a useful framework for analyzing infection-related biological behaviors from video data.
95. 【2608.12658】Inference-Time Orthogonal Seeding Enables Geometry-Aligned 3D Organ Segmentation for Slice-Propagation Methods
链接：https://arxiv.org/abs/2608.12658
作者：Md Rakibul Haque,Tushar Kataria,Shireen Y. Elhabian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dense voxel-level annotation, medical image segmentation, voxel-level annotation remains, Dense voxel-level, medical image
备注： 8 Pages Accepted at MLMI Workshop MICCAI 2026
点击查看摘要
Abstract:Dense voxel-level annotation remains a major bottleneck in 3D medical image segmentation. Single-slice propagation methods such as Sli2Vol reduce this burden by propagating one annotated seed slice through a volume using label-free registration. However, axial-only propagation accumulates errors with distance from the seed, especially in surface-distance metrics, because it ignores coronal and sagittal evidence and therefore underuses the 3D information available in CT/MRI volumes. To better leverage volumetric geometry, we study how key training and inference choices affect slice-propagation models, including single-axis versus multi-axis label-free registration, single-seed versus multi-seed propagation, and orthogonal seed configurations. Instead of propagating from a single axial seed, we use three orthogonal seeds---one axial, one coronal, and one sagittal---and fuse their propagated labels with a simple label-free rule. Our results show that the training paradigm has limited impact: an axially trained network applied to off-axis seeds captures nearly all the improvement, while explicit three-axis training adds little. Instead, performance is driven by inference-time seed geometry, especially orthogonality rather than the number of annotated slices, as a budget-matched three-axial control provides no benefit and can even degrade performance. On a multi-organ CT cohort, orthogonal seeding with the axial Sli2Vol backbone improves Dice by 21.9%, Normalized Surface Dice by 25.5%, and reduces Average Hausdorff Distance by 53.5% over the single-axis baseline.
96. 【2608.12627】EgoCITE: Context-Augmented Indexing and Time-Aware Retrieval for Long-Horizon Egocentric Memory
链接：https://arxiv.org/abs/2608.12627
作者：Le Zhang,Ke Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：transforms continuous first-person, continuous first-person video, memory transforms continuous, Egocentric Context-augmented Indexing, past experiences
备注：
点击查看摘要
Abstract:Long-horizon egocentric memory transforms continuous first-person video and audio into a searchable record of past experiences. We demonstrate two bottlenecks in existing systems: indices built from context-poor captions are unreliable for agentic search, while retrieval ignores a question's temporal intent. To address both bottlenecks, we introduce EgoCITE (Egocentric Context-augmented Indexing and Time-aware Evidence retrieval), a long-horizon agentic memory framework for egocentric QA. EgoCITE comprises three components. EgoScheme uses local multimodal context to turn fragmentary video captions and speech transcripts into self-contained atomic memory indices. EgoIndex organizes complementary action, activity, utterance, and conversation representations into searchable multi-view memory indices at multiple granularities. EgoRetrv combines semantic search with question-conditioned temporal relevance scoring and curation of retrieved evidence. We evaluate EgoCITE on EgoLifeQA, EgoMem, and EgoR1-Bench in terms of answer accuracy and target-event retrieval alignment. EgoCITE improves accuracy over agentic memory baselines by at least 4.4--14.2\% while achieving 36$\times$ lower cost than long-context LLM agents.
97. 【2608.12611】From Visual Widgets to UI Code: Efficient Tool-Grounded Generation
链接：https://arxiv.org/abs/2608.12611
作者：Houston H. Zhang,Tao Zhang,Li Gu,Linfeng Ye,Yuanhao Yu,Xinxin Zuo,Yang Wang,Zhixiang Chi
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：systems face, flexibility and controllability, Existing, hallucinate visible details, customized intermediate representations
备注： ECCV2026 (MUCG Workshop)
点击查看摘要
Abstract:Existing screenshot-to-code systems face a trade-off between flexibility and controllability. Direct multimodal generation can hallucinate visible details, whereas structured pipelines reduce such errors through component-wise decomposition, predefined templates, and customized intermediate representations. These structures, however, introduce additional generative orchestration and restrict outputs to designs covered by the representation. We investigate whether selective tool grounding can improve the fidelity--efficiency trade-off of direct widget-to-code generation. We introduce \textbf{WidgetGen}, a lightweight tool-grounded framework that extracts observable text and color evidence, performs high-level layout and optional chart reasoning, and directly generates executable JavaScript XML (\emph{JSX}). This design reduces reliance on component-wise generation while avoiding a fixed UI schema. Across six multimodal models and \(1{,}000\) held-out widgets, WidgetGen outperforms direct prompting and the structured Widget2Code pipeline on most visual reconstruction metrics, with consistent gains in area, legibility, and style. Finally, reconstruction-derived image-code pairs improve six Qwen-family open-weight models across every reported metric through supervised fine-tuning. These results establish WidgetGen as a strong lightweight baseline and show that selective evidence grounding offers an effective alternative to extensive representation constraints.
98. 【2608.12600】PseudoMapLabeler: Confidence-Aware Pseudo-Label Generation for Semi-Supervised Online Mapping
链接：https://arxiv.org/abs/2608.12600
作者：Chikao Tsuchiya,Dhaval Bhanderi,David Ilstrup,Hsinmin Cheng,Christopher Ostafew
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：limits model generalization, diverse environments, critical challenge, challenge in deploying, systems to real-world
备注： 17 pages, 4 figures, Accepted at ECCV 2026 DriveX Workshop on Foundation Models for Autonomous Driving
点击查看摘要
Abstract:A critical challenge in deploying online HD map construction systems to real-world scenarios is the scarcity of labeled training data, which limits model generalization in diverse environments. To address this limitation, we propose a teacher-student semi-supervised learning (SSL) framework that generates high-quality pseudo-labels from unlabeled data through confidence-aware map refinement. Our approach first trains a teacher model on limited labeled data, then leverages Beta-distribution-based confidence maps to assess the reliability of predicted map elements across temporal observations. Unlike conventional filtering methods that discard entire elements, we introduce a spatial clipping technique that selectively preserves high-confidence regions while removing unreliable segments. The refined map elements serve as map priors that improve the teacher model's prediction accuracy on unlabeled data in a second pass. These enhanced predictions become pseudo-labels for training a student model from scratch, followed by fine-tuning on the original labeled data. Experimental results on the nuScenes dataset demonstrate that our teacher-student framework with refined pseudo-labels improves performance by +6.1 mAP under a low-label regime compared to training on labeled data alone, offering a practical solution to the labeled data scarcity problem in online HD map construction.
99. 【2608.12590】Auditable agentic AI for evidence-grounded thyroid ultrasound diagnosis and reporting
链接：https://arxiv.org/abs/2608.12590
作者：Haifan Gong,Shiyu Chen,Bodong Wang,Yuqi Wang,Shijie Wang,Guoliang You,Xinyu Xiong,Haowei Wang,Mingzhi Mao,Dexing Kong,Qinghua Liu,Wei Lou,Fei Chen,Guanbin Li
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：coordinated lesion localization, requires coordinated lesion, diagnosis requires coordinated, provide limited support, lesion localization
备注： Under review
点击查看摘要
Abstract:Thyroid ultrasound diagnosis requires coordinated lesion localization, measurement, risk stratification and reporting, yet most AI systems address these tasks in isolation and provide limited support for clinical review. We present ThyroidXAgent, a clinician-interactive agentic AI system that coordinates specialized diagnostic tools and stores their outputs as an auditable case-level evidence record. The system was developed using OpenThyroidDB, a multicentre, multitask resource integrating approximately 0.3 million ultrasound images and 24,000 paired reports, and was evaluated on 28,458 non-overlapping test cases, including 8,721 cases from 35 centres in the private NHC-MISD-TUS cohort. Across heterogeneous datasets, ThyroidXAgent achieved a mean Dice score of 87.21 percent for nodule segmentation and a mean AUROC of 0.9466 for benign-malignant classification. The same workflow supported lymph-node metastasis prediction and follicular versus papillary thyroid carcinoma classification, with AUROCs of 0.864 and 0.805, respectively. For report generation, evidence-grounded assembly outperformed multimodal language-model baselines across three cohorts. ThyClinScore, a lesion-level clinical semantic metric introduced here, showed the strongest correlation with a location-aware language-model judge. ThyroidXAgent improved physician classification accuracy, increased report diagnostic consistency from 70.3 percent to 86.2 percent, and reduced segmentation and reporting time by 35.9 percent and 27.4 percent, respectively. These findings support auditable, clinician-correctable agentic AI for thyroid ultrasound diagnosis and reporting.
100. 【2608.12570】Attribute-Conditioned Multimodal Slot Factorization for Controllable Fashion Retrieval
链接：https://arxiv.org/abs/2608.12570
作者：Najmeh Forouzandehmehr,Topojoy Biswas,Evren Korpeoglu,Kannan Achan
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：requires satisfying multiple, satisfying multiple attributes, requires satisfying, satisfying multiple, retrieval
备注：
点击查看摘要
Abstract:Fashion retrieval often requires satisfying multiple attributes at once, such as category, color, pattern, and demographic. Monolithic embeddings mix these signals into a single vector, making attribute-specific control difficult at retrieval time. Many existing semantic-ID methods provide discrete item codes, but these codes are typically optimized as item-level or residual addresses and do not expose named, independently controllable attribute slots. We introduce MM-slotgate, a multimodal slot encoder that factorizes Fashion-CLIP text and image embeddings into four named attribute slots. Each slot learns its own text-image gate, so visually grounded attributes such as color and pattern can rely more on image evidence, while taxonomy-oriented attributes such as category and demographic can remain more text-driven. On HM, using a combined slot-similarity and slot-logit retrieval score, MM-slotgate achieves 0.7566 macro ConstraintSatisfied@10, outperforming equal-weight multimodal fusion (0.7142) and fCLIP text-only retrieval (0.4755). The largest gain is on color, which improves from 0.321 to 0.889 (+0.568 absolute), as the learned color gate assigns 57.4% weight to image evidence. The learned gates are interpretable without modality supervision: color is image-leaning, category is text-leaning, and pattern and demographic lie near the middle. The resulting slots also remain controllable: linear probes show no measured excess leakage beyond the label-correlation baseline, and quantized slot codes support targeted intervention, including a 15.3x lift for color. These results suggest that controllable fashion retrieval benefits from typed, attribute-conditioned multimodal slots rather than either a single global embedding or opaque item-level semantic IDs.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.12570 [cs.CV]
(or
arXiv:2608.12570v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.12570
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Najmeh Forouzandehmehr [view email] [v1]
Wed, 12 Aug 2026 20:28:14 UTC (108 KB)
101. 【2608.12549】StrAD: A Streaming Method and Benchmark for Audio Description Generation for Long-form Videos
链接：https://arxiv.org/abs/2608.12549
作者：Julian Spravil,Sebastian Houben,Sven Behnke
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：medium of communication, low-vision people, dominant medium, inaccessible to blind, blind and low-vision
备注：
点击查看摘要
Abstract:Visual content is the dominant medium of communication, yet without audio descriptions (ADs), it remains inaccessible to blind and low-vision people. ADs narrate context-relevant visual events during natural audio pauses. Manually creating ADs is expensive, limiting coverage to a small fraction of available content. Most existing automatic AD generation methods frame the task as video clip captioning, requiring ground-truth timestamps and additional context cues such as character databases. Current benchmarks reinforce this framing, consisting of short video segments paired with automatic or task-mismatched annotations. We introduce StrAD, a benchmark for long-form AD generation on full-length videos spanning diverse genres such as movies, documentaries, short films, performances, and video games. We reformulate AD generation as streaming dense video captioning. Our approach processes full-length videos with a sliding window, inserting ADs into existing transcripts without ground-truth timestamps, and supports both fine-tuned models and zero-shot prompting of vision-language models. On the segment-level task with given timestamps, our fine-tuned StrAD-FT sets the state of the art on CMD-AD with 36.3 CIDEr (+10.0 over Shot-by-shot), establishes a reference point on StrAD (51.0 CIDEr), and remains competitive on MAD-Eval at 24.9 CIDEr. On the full-video streaming task, StrAD-FT reaches a SODA score of 2.4 against 1.1 for our zero-shot baseline StrAD-Zero, though both exhibit limitations in temporal localization and narrative coherence. While prior work has tackled full-video AD generation in an offline, multi-stage fashion, ours is the first streaming approach, generating ADs on the fly without ground-truth timestamps. StrAD makes progress on full-video AD generation measurable, a prerequisite for scaling accessibility.
102. 【2608.12537】Surface-to-Skeleton 3D Cephalometry: Estimating Hidden Skeletal Landmarks from CT-Derived External Soft-Tissue Surfaces
链接：https://arxiv.org/abs/2608.12537
作者：Tomoki Abe,Taiki Kanaya,Kazuki Saita,Mao Noda,Chie Tachiki,Yasushi Nishii,Hideo Saito
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：facial-landmark methods localize, CT-defined internal skeletal, methods localize points, facial-landmark methods, methods localize
备注： Accepted to AI4M3D Workshop at ECCV 2026
点击查看摘要
Abstract:Existing 3D facial-landmark methods localize points on visible skin, but whether CT-defined internal skeletal landmarks can be inferred from external soft-tissue geometry remains unclear. We formulate a coordinate-consistent surface-to-skeleton task using same-acquisition CT-derived surfaces, separating estimation from optical-to-CT registration, scanner-domain, and acquisition-state effects, with coverage analyzed separately. From 240 clinical CT scans from two hospitals, we construct a locked retrospective protocol pairing CT-derived external soft-tissue point clouds with 21 skeletal landmarks and three visible soft-tissue landmarks. An integrated hierarchical point-cloud model achieves 2.97 mm mean radial error on skeletal landmarks and 3.03 mm on deep or surface-invisible landmarks in 40 held-out patients. Patient-mismatch controls support patient-specific signal beyond a fixed population configuration or global similarity alone, while coverage ablations indicate dependence on non-anterior geometry. Optical-transfer diagnostics reveal substantial coverage-related and global-configuration components, although deployable optical inference remains unresolved. These results answer the controlled feasibility question affirmatively and provide a basis for hidden skeletal landmark inference.
103. 【2608.12532】MASCOT: Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval
链接：https://arxiv.org/abs/2608.12532
作者：Aaryan Sharma,Vishak Prasad C,Virendra Singh,Ganesh Ramakrishnan
类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：semantically relevant images, retrieving semantically relevant, relevant images, retrieving semantically, semantically relevant
备注： 21 pages, 4 figures. Accepted at ACM Multimedia 2026 (MM '26), Rio de Janeiro, Brazil. Extended version with full appendices
点击查看摘要
Abstract:Vision-Language Models (VLMs) are highly effective in retrieving semantically relevant images. However, in practice, relevance alone is often insufficient. Systems must also achieve Result Diversification (RD) across composite attributes such as geography and time, a task for which precise control remains challenging. Current re-ranking methods, such as Multi-Source Determinantal Point Processes (MS-DPP), address this using manifold-based repulsion over similarity representations. Although this strategy is effective for broad exploration, it exposes a key limitation in manifold-based models: when subjected to diversity-decrease tasks on discrete metadata, they suffer substantial degradation in early-rank recall. To bridge this gap, we introduce MASCOT (Model-Aware Submodular Coverage for Composite-Attribute Text-to-Image Retrieval). Instead of relying on manifold repulsion, MASCOT formulates multi-attribute diversity as a resource allocation problem, projecting attributes into a soft-binning space weighted by query-driven importance. Averaged across the three PixelProse diversity-decrease tasks, MASCOT preserves an early-rank recall (R@10) of 88.58%, while MS-DPP retains 67.63%. The margin widens under composite constraints: on PP_geo_hour, where temporal and geographic diversity must be suppressed simultaneously, MS-DPP's recall collapses from 0.9737 to 0.4931 and its top-ranked result degrades to R@1 = 0.23, while MASCOT holds R@10 = 0.9410 and R@1 = 0.7202 at a diversity metric above the unconstrained baseline. We do not claim uniform superiority: on aggregate diversity-relevance scores our own simpler ablations attain higher harmonic means on all three decrease tasks, and MASCOT's advantage is specific to recall beyond rank 1 under composite constraints.
Comments:
21 pages, 4 figures. Accepted at ACM Multimedia 2026 (MM '26), Rio de Janeiro, Brazil. Extended version with full appendices
Subjects:
Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
Cite as:
arXiv:2608.12532 [cs.MM]
(or
arXiv:2608.12532v1 [cs.MM] for this version)
https://doi.org/10.48550/arXiv.2608.12532
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1145/3767308.3836500
Focus to learn more
DOI(s) linking to related resources</p>
104. 【2608.12515】Can Vision-Language Models Assess Proxemic Risk from Egocentric Robot Images?
链接：https://arxiv.org/abs/2608.12515
作者：Vladyslava Rudas,Dmytro Kuzmenko
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：safe embodied navigation, Assessing proxemic danger, robot egocentric perspective, Assessing proxemic, textit
备注： Accepted at the EMR 2026 workshop at ECCV 2026 (non-archival)
点击查看摘要
Abstract:Assessing proxemic danger from a robot's egocentric perspective is critical for safe embodied navigation in human environments and requires both visual and contextual reasoning. We evaluate three opensource vision-language models (VLMs) (\textit{InternVL}, \textit{Qwen-VL}, and \textit{SmolVLM}) on the classification of egocentric robot images into four danger levels, comparing three prompting strategies and two rounds of QLoRA fine-tuning against a stratified random baseline. Without fine-tuning, all models perform near the baseline, while fine-tuning yields only modest overall improvements. However, \textit{Qwen-VL} with an advanced prompt achieves substantially higher recall for high-danger cases than the other models. An analysis of person localization further shows that correct danger classification does not correspond to better spatial grounding, indicating that a model may produce a useful safety label without attending to the relevant region of the scene. These results show that current VLMs remain limited in fine-grained proxemic reasoning and spatial grounding, although targeted prompting and fine-tuning can improve high-danger detection in selected models.
105. 【2608.12502】HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioning
链接：https://arxiv.org/abs/2608.12502
作者：Aysha Ashraf(University of Electronic Science and Technology of China),Shaina Ashraf(University of Bonn),Wafaa I. M. Hussin(University of Electronic Science and Technology of China),Ali Haider(University of Electronic Science and Technology of China),Zhi Lu(University of Electronic Science and Technology of China),Zhenming Peng(University of Electronic Science and Technology of China)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing image, sentence describing semantic, describing semantic changes, Remote sensing, converts bitemporal imagery
备注： Submitted to IEEE Transactions on Geoscience and Remote Sensing (TGRS) for review
点击查看摘要
Abstract:Remote sensing image change captioning (RSICC) converts bitemporal imagery into a sentence describing semantic changes. Most RSICC methods condition caption decoders directly on fused visual features, leaving intermediate change structure and decoder-interface consistency less studied. We present HIMEC, combining Directional Change Representation (DCR) with fixed-interface decoding. DCR separates signed differences into appearance-oriented, disappearance-oriented, and shared-context streams before fusion. A learned-query encoder converts the fused representation into visually conditioned change-query tokens that form the scene decoder's only sample-dependent memory. A training-only auxiliary phrase decoder supplies caption-derived supervision. With a fixed zero input, the scene decoder maintains the same interface during training and inference. Separately, we evaluate a local-to-scene cascade conditioned on teacher-forced local states during training and autoregressive states at inference. On changed LEVIR-CC validation pairs, these states have a mean cosine distance of 0.69. Regime-matched conditioning recovers most of the associated deficit, whereas permuting state correspondence causes no detectable penalty. These findings are limited to the evaluated cascade. In a matched three-seed comparison, HIMEC reaches a Consensus-based Image Description Evaluation (CIDEr) score of $142.81\pm0.60$ on LEVIR-CC, versus $139.51\pm3.40$ for direct fused-feature memory. On SECOND-CC, fixed-zero and regime-matched diagnostic conditioning reach 75.67 and 76.99 CIDEr, respectively, versus 60.77 for the mismatched cascade. The source code will be made publicly available at this https URL upon publication.
106. 【2608.12442】MV2: Multi-View Multi-Vehicle Driving Dataset for Novel View Synthesis
链接：https://arxiv.org/abs/2608.12442
作者：Sanjay Bhargav Dharavath,Hanvitha Saraswathi Mukkamala,Faizan Farooq Khan,Ioannis Kakogeorgiou,Aditya Arun,C V Jawahar,Zakaria Laskar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited multi-trajectory data, remains difficult due, Differentiable rendering, real-world driving remains, driving remains difficult
备注： 18 pages, 7 figures, ECCV accepted paper
点击查看摘要
Abstract:Differentiable rendering has advanced novel view synthesis (NVS), yet applying it to real-world driving remains difficult due to sparse capture viewpoints, dynamic objects, and limited multi-trajectory data. We introduce the Multi-View Multi-Vehicle (MV2) dataset and benchmark for evaluating NVS models under large viewpoint changes in dynamic urban scenes. MV2 features synchronized captures from a car, scooter, and drone, each following distinct yet synchronized trajectories. Training NVS methods on one vehicle's camera stream and testing on another enables evaluation under substantially larger viewpoint variations than existing single-trajectory datasets. All sequences are registered via Structure-from-Motion and camera poses verified using manual pixel-level correspondence annotations, yielding 50 high-quality scenes with 12000 images. Benchmarking recent NVS and camera pose estimation methods shows that NVS performance degrades with increasing viewpoint disparity, and that feed-forward pose estimators notably lag behind optimization-based approaches, highlighting MV2 as a rigorous testbed for NVS in driving. The dataset, benchmark protocol, and project resources are available at this https URL.
107. 【2608.12333】Vision-Language Models are Fragile Multilingual Associators
链接：https://arxiv.org/abs/2608.12333
作者：Ritabrata Chakraborty,Rajatsubhra Chakraborty,Shivakumara Palaiahnakote,Angelo Cangelosi,Umapada Pal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：associate visual entities, textual attributes, Vision-language models, associate visual, visual entities
备注： Preprint (under review). Project Page: [this https URL](https://ritabrata04.github.io/m2bind/)
点击查看摘要
Abstract:Vision-language models must associate visual entities with textual attributes. Whether these associations or concept bindings remain stable when the language of the input changes is unexplored. We introduce M$^2$BIND, a benchmark varying the language of the context and query across multiple languages. We evaluate binding both extrinsically through task performance metrics and intrinsically through causal interventions. We find that binding is not language-invariant: cross-family and cross-script settings trigger significant binding collapse, with the model's internal binding computation shifting to later layers and losing causal strength. Closely related languages preserve associations comparatively better. In a broader sense, our findings indicate how VLMs deployed globally in multilingual settings cannot be assumed to maintain the same association quality observed in monolingual evaluation.
