本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新1341篇论文，其中：
- 自然语言处理156篇
- 信息检索45篇
- 计算机视觉269篇
自然语言处理
1. 【2608.16868】owards Computational Provenance: Carrying Causal-State Evidence in Generated Text
链接：https://arxiv.org/abs/2608.16868
作者：Benjamin Belay
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language model output, provide verifiable evidence, verifiable evidence, relevant internal state, internal state
备注： 16 pages, 1 figure, 7 tables
点击查看摘要
Abstract:A language model's output does not by itself provide verifiable evidence about the internal computation that produced it. We study computational provenance: whether generated text can carry detectable evidence of which causally relevant internal state occurred. We test a bounded form of this idea in two controlled architectures: a modular feed-forward neural network and a transformer-based model. Both architectures are trained on the same arithmetic task with a mandatory pathway through two discrete intermediate states, allowing different internal paths to produce the same answer. We deliberately switch between these paths, authenticate the state actually used, and let that verified state determine a subtle statistical pattern in the generated text that can later be detected. The feed-forward and transformer systems each passed all 128 matched pairs in both their public and separately sealed protected end-to-end evaluations, with the detector recovering the signal associated with the authenticated internal state. The required causal computation also reproduced across five independently trained feed-forward models and three independently trained transformers. In a separate answer-only transformer experiment, our linear probes did not recover a naturally learned intermediate state. These results provide a controlled proof of concept that information about a verified, causally relevant internal state can be preserved in generated text even when the answer is unchanged.
2. 【2608.16844】Proteus: Incremental Memory Activation for Long-Context Sequence Modeling
链接：https://arxiv.org/abs/2608.16844
作者：Reza Bayat,Ali Behrouz,Vahab Mirrokni,Aaron Courville
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：attention-based sequence models, motivated a growing, growing line, line of research, research on memory-based
备注：
点击查看摘要
Abstract:The quadratic cost of attention-based sequence models for long contexts has motivated a growing line of research on memory-based models that can compress context into a compact state. However, most existing memory models expose a static memory throughout the entire sequence. Because early tokens face no compression pressure, they occupy too many degrees of freedom and "pollute" the memory state, leaving little capacity for later context and increasing interference between what is stored and what arrives next. We study a new paradigm of incremental memory activation, where the effective capacity of memory is progressively expanded as the context grows. Imposing an early bottleneck forces the model to compress history more effectively, while unlocking fresh capacity over time reduces interference and improves retention of later context. We instantiate this paradigm in Proteus, a straightforward mechanism that can be incorporated into a broad class of neural memory architectures at no additional cost. We apply Proteus to state-of-the-art models, including SWLA, Comba, Titans, and Hope-Attention, and observe consistent improvements on standard language modeling and reasoning, as well as on long-context retrieval and understanding, with gains that grow at longer context lengths. Overall, our results show that static memory is suboptimal and that scheduling effective capacity is a simple and broadly applicable tool for sequence modeling.
3. 【2608.16834】Model Hypnosis: Strong control of AI via additive subliminal effects
链接：https://arxiv.org/abs/2608.16834
作者：Enric Boix-Adsera,Benedict Tessler
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：seemingly irrelevant cues, control model behavior, strongly control model, call model hypnosis, broadly susceptible
备注：
点击查看摘要
Abstract:We demonstrate that AI models are broadly susceptible to a phenomenon we call model hypnosis, in which individually weak and seemingly irrelevant cues in the prompt can be systematically combined to strongly control model behavior. Model hypnosis occurs across model families and scales, including in frontier reasoning models, and hypnotic prompts can transfer between models. Because the model is controlled by inconspicuous textual choices, such as paraphrases and typos, model hypnosis presents new challenges and avenues for AI safety, and is a major hurdle for AI interpretability.
4. 【2608.16831】Policy Iteration with Human Feedback: Bringing Post-Training RL to In-context Learning
链接：https://arxiv.org/abs/2608.16831
作者：Minh-Ha Nguyen,Cathy Shyr
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Generative pretraining established, reusable task representations, established reusable task, language-based task conditioning, pretraining established reusable
备注： PIHF method paper
点击查看摘要
Abstract:Generative pretraining established reusable task representations; later work on language-based task conditioning and in-context learning showed that a fixed model could adapt its behavior from instructions and demonstrations. Policy Iteration with Human Feedback (PIHF) builds on this development and the recurrent evaluate-and-improve structure of generalized policy iteration. PIHF uses a pretrained language model as its execution substrate and moves persistent revision to a versioned natural-language policy and tool set. A language-model critic and clinical expert review complete-panel reasoning and tool-use trajectories to localize recurrent failures and form candidate revisions; the expert may reinterpret the evidence and retains authority over admission and rollback, while Recall@1 and Recall@5 validate outcomes after candidate execution. Across cumulative ablations and ultra-rare-disease benchmarks, a PIHF-derived policy improved Recall@1 in one proprietary executor and three open-weight executors spanning 3 to 49 billion active parameters. Gains were 32.7 percentage points for GPT-5.4 and 31.1 points for Qwen3.6-35B, a difference of 1.7 points. These results support the feasibility of using pretrained language models as fixed-weight execution substrates for expert-guided policy development in rare-disease diagnosis.
Comments:
PIHF method paper
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2608.16831 [cs.AI]
(or
arXiv:2608.16831v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.16831
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
5. 【2608.16798】ClawGym II: Exploring Black-Box RL on Agent Harness
链接：https://arxiv.org/abs/2608.16798
作者：Huatong Song,Fei Bai,Ming Yang,Renyuan Li,Jia Deng,Jujie He,Zhange Zhang,Daixuan Cheng,Yan Xing,Qi Yun,Xuxing Chen,Danyang Li,Feng Chang,Chuan Hao,Ran Tao,Jian Yang,Bryan Dai,Wayne Xin Zhao,Mingjie Tang,Ji-Rong Wen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：substantially improved performance, coordinating agent interactions, substantially improved, improved performance, long-horizon agent tasks
备注：
点击查看摘要
Abstract:Agent harnesses have substantially improved performance on long-horizon tasks by coordinating agent interactions with the environment. However, reinforcement learning through complex harnesses remains largely unexplored, as scaling such training to long-horizon agent tasks introduces fundamental challenges. In this work, we present a unified black-box RL framework for stable and scalable optimization of general agents through complex harnesses. Concretely, we first build a sandbox-based execution infrastructure that isolates task environments and harnesses within temporary sandboxes for large-scale concurrent rollouts. We then decouple policy optimization from opaque harness execution and place a serving proxy at the model boundary to capture model calls. To reconstruct multi-turn trajectories and improve training efficiency, we organize the captured calls into prefix trees and further adapt both critic-based PPO and critic-free GRPO to optimize over the recovered tree structure. Meanwhile, we maintain training-inference consistency throughout the optimization process. Finally, we introduce mix-harness training, allowing a single model to be jointly optimized by heterogeneous harnesses. With Qwen3-30A3B, black-box RL improves Pass@1 on ClawGym-Bench by 9.98 and 14.81 points through OpenClaw and Claude Code, respectively, while remaining stable over 200-400 optimization steps. Moreover, the framework yields consistent gains on more challenging tasks such as JobBench and OfficeQA. Overall, our framework enables effective, stable, and scalable optimization of general agents through black-box harnesses, supporting unified training across heterogeneous execution systems.
6. 【2608.16794】Neurosymbolic Embodied Agents
链接：https://arxiv.org/abs/2608.16794
作者：Mohammad Albinhassan,Yuming Feng,Alessandra Russo,Pranava Madhyastha
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：generate plausible embodied, incorrectly grounded entities, models generate plausible, plausible embodied plans, violate environment dynamics
备注：
点击查看摘要
Abstract:Language and vision-language models generate plausible embodied plans but do not guarantee executability, as their outputs can violate environment dynamics or act on incorrectly grounded entities. We present a neurosymbolic agent that factors long-horizon household tasks into task-directed visual exploration and constrained symbolic planning. In the first phase, a vision-language model and exploration harness acquire goal-relevant predicates and instance bindings from egocentric observations and grounded interactions, producing a symbolic initial state. In the second, a PDDL transition model restricts decoding to tokens that extend applicable actions. Monte Carlo tree search then evaluates executable continuations using a domain-independent planning heuristic. The resulting plans are executable by construction under the transition model, with transfer to the environment conditioned on correct visual grounding. On VirtualHome and ALFWorld, open 4B-27B models exceed 90% success in both environments, and our smallest agent substantially outperforms a 27B direct visual policy in each. Constraints and search prove complementary rather than interchangeable: in ALFWorld either alone solves under a third of tasks, whereas their combination solves over 95%. The method also uses several times fewer generated tokens than extended thinking and far fewer model-visible images than direct interaction, and residual failures localize to state acquisition rather than plan generation without any specialized training.
7. 【2608.16707】Semantic Bandits: In-Context Exploration-Exploitation is Biased by Semantic Priors
链接：https://arxiv.org/abs/2608.16707
作者：David Eric Austin,Kaheer Suleman,Jackie Chi Kit Cheung
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：require sophisticated environmental, Large language models, sophisticated environmental exploration, Large language, increasingly deployed
备注： 10 pages, 5 figures in main body
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed as decision-making agents in settings that require sophisticated environmental exploration. However, existing work has raised questions about how LLMs actually balance exploration and exploitation. Unlike classical agents, LLM agents engage with tasks through natural language, exposing them to semantic information with no formal counterpart in the task structure. We introduce the semantic bandit, an extension of the multi-armed bandit setting that explicitly considers the textual labels assigned to actions, and use it to study how semantic priors --- inductive biases arising from associations between language and expected reward learned during pre-training, shape LLM exploration behaviour. We find that semantically informative action labels reduce exploration in favour of exploitation, improving performance when aligned with the reward structure and severely degrading it when misaligned. We further find that negative rewards trigger substantially more exploration than equivalent positive rewards, consistent with an expected-scale bias induced by reward conventions common in pre-training data. Overall, we argue that the use of language to define the environment and rewards introduces unavoidable biases derived from the fact that the model is trained on word co-occurence, with implications for the reliability and robustness of LLM agents in real-world decision-making settings.
8. 【2608.16686】Closing the Affective Loop: Multimodal Speaker-Listener Emotion-Dynamics-Aware Empathetic Social Robots
链接：https://arxiv.org/abs/2608.16686
作者：Zi Haur Pang,Casey Kennington,Tatsuya Kawahara
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：emotions dynamically evolve, dynamically evolve, Empathetic social robots, affective, emotions dynamically
备注： This paper has been accepted for presentation at APSIPA ASC 2026
点击查看摘要
Abstract:Empathetic social robots should respond not only to what users say, but also to how their emotions dynamically evolve during interaction. However, existing empathetic dialogue systems are often text-centered and primarily model empathy as a one-way mapping from the user's emotion to the system response, limiting their ability to capture embodied speaker--listener affective exchange. We present AffectLoop, a multimodal speaker-listener emotion-dynamics-aware spoken dialogue system implemented on the Misty II robot. The system tracks the speaker's verbal and facial affective dynamics, estimates the robot listener's own verbal and behavioral affective state, and conditions LLM-based response generation on both affective streams. The robot then generates a short spoken empathetic response together with emotionally congruent embodied behavior, forming a closed speaker--listener affective loop. We evaluate the system in a pilot within-subject study with five participants, comparing it with an otherwise identical utterance-conditioned baseline that omits the speaker- and listener-affective-state inputs. The proposed system received higher overall impression ratings, especially for empathetic response and user satisfaction. Post-hoc log analysis further showed higher speaker-listener affective alignment and stronger valence-based distress recovery. These preliminary results suggest that explicitly modeling both speaker emotional dynamics and listener affective state can improve embodied empathetic interaction.
9. 【2608.16671】Does the LM Head Create a Harmful Gradient Bottleneck? A Causal Test
链接：https://arxiv.org/abs/2608.16671
作者：Anand Murugan
类目：Computation and Language (cs.CL)
关键词：language-model head maps, maps a hidden, hidden state, state of width, vocabulary of size
备注：
点击查看摘要
Abstract:The language-model head maps a hidden state of width D to a vocabulary of size V, so its transpose can return at most D independent directions to the Transformer. Godey and Artzi argue that this severe projection is a harmful optimization bottleneck. We separate the geometry from the causal claim. Our backward-only intervention keeps the ordinary logits and the exact LM-head parameter update while reducing only the rank of the gradient sent into the Transformer. Across five paired seeds on byte-level and BPE-8192 WikiText-2 models, reducing backward rank increases validation loss. An equally ranked factorized forward head, however, increases loss substantially more. At half rank in the larger model, the backward-only loss increase is 0.0586 (95% CI [0.0167, 0.1005]), while the factorized forward head increases loss by 0.1795 ([0.1547, 0.2042]). The vocabulary-space residual also contributes to the ordinary LM-head update, and removing that contribution is harmful. Additional controls show that repeated-token failures are confounded by the number of independently sampled symbols, that adding never-target output classes does not impair learning, and that projection diagnostics do not reliably predict progress in our runs. Tested auxiliary feedback routes do not beat tuned backpropagation. These results confirm strong geometric compression but do not establish that it is a harmful optimization bottleneck.
10. 【2608.16650】PCA-guided Activation Scaling for Monotonic Bidirectional Control over LLM Sycophancy
链接：https://arxiv.org/abs/2608.16650
作者：Zheng Chen,Zhaoxin Feng,Yip Tin Po,Jianfei Ma,Emmanuele Chersoni,Bo Li
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, factual accuracy, tendency to agree, agree with user
备注： accepted by COLM2026
点击查看摘要
Abstract:Large language models (LLMs) exhibit sycophancy, a tendency to agree with user beliefs regardless of factual accuracy. This can reinforce misconceptions, but eliminating it entirely risks over-correction against valid opinions. Effective control must therefore both reduce and increase sycophancy with predictable and gradual effect. Yet, existing methods fail to ensure a bidirectional and monotonic relationship between steering strength and behavioral outcome across models and datasets. We introduce PCA-guided Activation Scaling (PAS), an activation steering framework that decomposes residual stream activations into a PCA-identified sycophancy-honesty subspace and an orthogonal residual, then applies distinct scaling exponents to achieve monotonic, bidirectional control. Across three LLMs and three datasets, PAS achieves strong monotonicity (Spearman $\rho$ = +0.92) and an average shift of 15.4% per direction, compared with 8.7% for the baselines. Ablation studies confirm that the decomposition, asymmetric exponents, and layer selection are each essential for maintaining monotonic control. The data and code are available at this https URL.
11. 【2608.16647】Every Coin Has Two Sides: On the Dual Nature of Generalization in On-Policy Distillation of Large Language Models
链接：https://arxiv.org/abs/2608.16647
作者：Zhaoyi Li,Deyang Kong,Yuan Wei,Evan Yang,Ranran Shen,Mahardika Krisna Ihsani,Ming Yang,Wei Zhang,Chuan Hao,Jian Yang,Ran Tao,Bryan Dai,Shikun Zhang,Wei Ye,Ying Wei,Defu Lian
类目：Computation and Language (cs.CL)
关键词：remains poorly understood, supervising trajectories sampled, On-policy distillation, studies evaluate OPD, behavior remains poorly
备注： Under Review
点击查看摘要
Abstract:On-policy distillation (OPD) transfers teacher capabilities by supervising trajectories sampled from the student's own policy, yet its generalization behavior remains poorly understood, as most studies evaluate OPD on a single domain and on benchmarks close to the training data. We present a controlled study that varies one generalization factor at a time, from in-domain distribution shifts to cross-domain transfer and the multi-teacher setting. We find that OPD transfers a teacher's reasoning behavior rather than its answers to particular problems: training difficulty barely matters, and even problems the teacher never solves are useful. Transfer depends strongly on the origin relationship between teacher and student: same-origin pairs bring the student close to the teacher across languages, reasoning horizons, and even other domains, whereas cross-origin pairs mostly fit the trained distribution. This broad reach is a double-edged sword: since routing prompts to domain experts cannot confine each teacher's influence, combining them yields a mixture-dependent seesaw among their capabilities. These results clarify when OPD generalizes and offer a useful perspective for diagnosing multi-teacher OPD.
12. 【2608.16645】Reconstruction: A Blind Benchmark for Recovering Research Ideas from Pre-Publication Bibliographies
链接：https://arxiv.org/abs/2608.16645
作者：Shaolong Chen,Yanlin Fei,Nazhou Liu,Xinmiao Yu,Lei Li,Rahul Thapa,Madalina Ciobanu,Qingqing Mao,Ritankar Das
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：paper pre-publication bibliography, true research idea, language model recover, pre-publication bibliography, recover the true
备注：
点击查看摘要
Abstract:Can a language model recover the true research idea of a published paper when given only that paper's pre-publication bibliography? We introduce Reconstruction, a blind idea-recovery benchmark that withholds the seed paper and all contemporaneous or future literature, and asks models to propose hypotheses that an independent large language model judge matches against the held-out ground-truth idea. A strict anti-leakage protocol-temporal citation cutoff, anonymous reference IDs, and frozen per-paper bibliographies, which prevents prompt-time leakage of the seed idea. Across six scientific domains and 643 evaluated papers, seven frontier models achieve only modest Match rates (approx. 3-15%). We then evaluate a reference-only multi-agent (top 4) pipeline that combines cross-model review with a Swiss tournament over aligned hypothesis slots, without external web search. Cross-model review plus tournament selection raises Match rates to approx. 23-42% across all six domains, which is an observed approx. 2.4x lift over the best single-model baseline. This draft reports the protocol, anti-leakage design, and current results as an arXiv timestamp.
13. 【2608.16643】oward Better Assessment of LLMs' Performance in Clinical Error Detection
链接：https://arxiv.org/abs/2608.16643
作者：Yifan Zhang,Rahmatollah Beheshti
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Automated detection, decisions to deploy, Automated, models, large language models
备注： Accepted at Machine Learning for Healthcare (MLHC) 2026; to appear in Proceedings of Machine Learning Research (PMLR), Vol. 340
点击查看摘要
Abstract:Automated detection of errors in clinical documentation is a promising application of large language models (LLMs), yet decisions to deploy such models rest on benchmarks that evaluate each clinical note in isolation. Error-detection benchmarks are typically constructed by injecting errors into notes, such that each erroneous note has a natural counterpart. Aggregate discriminative metrics (e.g., balanced accuracy or F1) do not exploit this structure. We show that this omission is consequential. In particular, evaluating 15 diverse LLMs on 4 standardized clinical error-detection test sets across 3 languages, we find that 13 of 15 models fall below the level of random pairwise discrimination, even while achieving F1 scores that standard practice would read as moderate. We also observe that the underlying bias patterns differ across languages: the same model can default to "no error" on one language and over-flag errors on another. To diagnose where discrimination breaks down, we further introduce a procedure to score the evidence models cite in their outputs. We find that while models consistently locate error-relevant content, they fail to produce the corresponding correct verdict on the clean counterpart. Finally, we show that F1 and pairwise accuracy are driven in opposite directions by the same underlying bias, so that ranking models by F1 may systematically promote the weakest discriminators. For safety-critical clinical NLP applications, we advocate for supplementing aggregate metrics with paired evaluations in benchmark reporting. Code and analysis scripts are available at this https URL.
14. 【2608.16627】When Do Explanations Help In-Context Learning? A Comparative Study of Natural Language Explanation Types and Faithfulness
链接：https://arxiv.org/abs/2608.16627
作者：Mahdi Dhaini,Adam Dejl,Juraj Vladika,Volkan Özer,Barbara Plank,Gjergji Kasneci
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Natural language explanations, Natural language, in-context learning, Natural, NLEs
备注：
点击查看摘要
Abstract:Natural language explanations (NLEs) are increasingly used as inputs, for example, as few-shot rationales that influence model behavior in in-context learning (ICL). However, it remains unclear how different types of NLEs compare in their effects on downstream model performance in explanation-augmented prompting. Therefore, we provide a comparative evaluation across six benchmarks and four instruction-tuned models, studying how NLE source (human-written when available, self-generated explanations, generated by an external LLM) and NLE selection (random vs faithfulness-based filtering) affect downstream utility of NLEs when used in ICL settings. Our extensive evaluation shows that, on classification-style benchmarks, adding NLEs to few-shot prompts often improves accuracy over few-shot prompting without explanations; among NLE sources, externally generated LLM-NLEs often provide strong downstream utility and remain competitive with human rationales where both are available, whereas self-NLEs are more sensitive to the selection strategy. On math reasoning, the effects are more model- and source-dependent. We further show that faithfulness-based selection of self-NLEs yields small average gains overall, but can improve or reduce performance depending on the metric, task, and model. Different faithfulness metrics can disagree substantially, affecting which self-NLE examples are selected and their downstream predictive utility. Robustness tests with randomly swapped and out-of-distribution rationales indicate partial robustness, suggesting that semantic alignment contributes to performance gains. Overall, our results provide insights for selecting and reporting explanations that influence model behavior in practical prompting pipelines.
15. 【2608.16620】Palmyra x6 Technical Report: An Agentic, Tool-Use Model Post-Trained via Anchored Supervised Fine-Tuning
链接：https://arxiv.org/abs/2608.16620
作者：Peng Du,Kiran Kamble,Rakshith Vasudev,Zhizhuo Yang,Rohith Nadimpally,Arjun Krishna,Waseem Alshikh,Daniel M. Bikel
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：enterprise-oriented agentic tasks, large language model, language model optimized, Anchored Supervised Fine-Tuning, agentic tasks
备注： 12 pages
点击查看摘要
Abstract:Palmyra x6 is a large language model optimized for use with enterprise-oriented agentic tasks. The model was built by post-training a Mixture-of-Experts base model with Anchored Supervised Fine-Tuning on a compact corpus of verified, synthetic tool-use trajectories, optimized with a Muon + Adam hybrid. The recipe is deliberately conservative and deliberately controlled: 626 trajectories, a single epoch, a low learning rate, and a KL anchor to the frozen base. The model shows substantial gains over the previous default model for Writer Agent, and compares favorably with several recent models on public benchmarks, scoring the highest on BFCL Core at $0.785$ and posts the highest six-benchmark mean of the cohort. Furthermore, the model has shown itself to be competitive or leading relative to comparators in our bias and safety evaluations.
16. 【2608.16577】BabelSteering: Multilingual Safety Alignment via English Steering Vectors
链接：https://arxiv.org/abs/2608.16577
作者：Emma V. Stein,Dominik Meier,Terry Ruas,Jan Philip Wahle,Bela Gipp
类目：Computation and Language (cs.CL)
关键词：Large language models, alignment efforts remain, efforts remain concentrated, Large language, high-stakes settings
备注：
点击查看摘要
Abstract:Large language models (LLMs) are deployed globally in high-stakes settings, yet most safety research and alignment efforts remain concentrated on English. Thus, users interacting with LLMs in other languages may encounter weaker safeguards despite relying on the same systems for similarly sensitive tasks. In this work, we investigate whether safety signals learned from a high-resource language, like English, can improve multilingual safety. We propose BabelSteering, an activation steering method that acts as a lightweight inference- time intervention, using refusal directions derived from English safety supervision to generalize across languages. Our evaluation includes eight languages and jointly measures refusal of harmful requests, over-refusal, and general task utility. The results show that BabelSteering increases the refusal of harmful requests across languages, with only a marginal to no reduction in task utility but with some increase in refusal of pseudo-harmful prompts. For example, for Gemma 7B, we see an average increase in the refusal of harmful prompts across languages of 11 percentage points (pp), with individual languages like Bengali seeing an increase of 17 pp, with no loss of utility on Global MMLU, while pseudo-harmful refusals increase by 13 pp on average. We also introduce a multilingual translation-and-evaluation pipeline to facilitate future work on cross-lingual safety interventions. Overall, our findings suggest that activation steering may provide a practical, low- cost mechanism for extending English-derived safety signals to other languages. Warning: this paper contains examples with unsafe content
17. 【2608.16554】Ask, Condition or Abstain: Reinforcement Learning for Missing-Premise Reasoning
链接：https://arxiv.org/abs/2608.16554
作者：Yongqi Tong,Zhenyu Zhang,Zimi Liu,Kewei Fu,Mingli Song,Haofei Zhang,Junshao Zhang,Hong Zhu,Jiang-Ming Yang,Xin Zhang,Jianshe Li
类目：Computation and Language (cs.CL)
关键词：Answer-only reinforcement learning, realistic queries omit, Answer-only reinforcement, reinforcement learning, realistic queries
备注：
点击查看摘要
Abstract:Answer-only reinforcement learning (RL) trains reasoning models to solve fully specified problems, but many realistic queries omit a premise needed for a unique answer. In this setting, the useful response is not always refusal: the model should ask for the missing premise, condition its answer on the unknown quantity, or abstain when no informative conditional response is available. We present \emph{Ask-Condition-Abstain Reinforcement Learning} (ACA-RL), a data-augmented RL framework for this setting. Its reasoning-graph-guided pipeline converts well-posed problems into missing-premise training instances with localized gap annotations; ACA-RL then trains on these instances with a structured reward over five observable response behaviors. We also introduce the \emph{Missing-Premise Benchmark} (MPB), a 274-instance human-verified benchmark spanning mathematical, logical, and real-world word problems. Across Qwen3 and Llama models, ACA-RL consistently improves on MPB while preserving competitive performance on well-posed reasoning tasks. Together with the released code, MPB, and training data, this work supports a new mission for NLP evaluation: measuring whether models can recognize when a task is underdetermined and handle uncertainty, not only whether they can answer fully specified questions.
18. 【2608.16553】STAGE: Controlled Objective Admission for Multi-Preference LLM Alignment
链接：https://arxiv.org/abs/2608.16553
作者：Yongqi Tong,Zhenyu Zhang,Ruirui Wang,Kewei Fu,Shaoqing Lin,Sijie Dong,Jiang-Ming Yang,Xin Zhang,Jianshe Li
类目：Computation and Language (cs.CL)
关键词：combine reward dimensions, Multi-preference alignment, combine reward, reward dimensions, Multi-preference
备注：
点击查看摘要
Abstract:Multi-preference alignment is often framed as scalarization: combine reward dimensions, then optimize. This leaves a temporal decision underspecified: when should each preference dimension enter policy optimization? We propose \methodname, a stability-guided active-set controller for controlled objective admission. \methodname starts from a small active set, retains admitted objectives, and expands when reward-deviation gates indicate low recent deviation or a patience budget is exhausted. A probing phase estimates a hard-to-easy order, and adaptive weighting emphasizes underperforming active dimensions. Automatic evaluations with 15 training preferences and 16 held-out benchmark columns show that \methodname obtains higher averages than simultaneous scalarization and shared-budget adapted baselines. Component ablations and expansion dynamics further support cumulative retention, gated admission, and probing-derived ordering as useful design choices in this setting. These results position objective-entry timing as a concrete control variable in reward-vector RLHF.
19. 【2608.16539】Listen, Reason, and Segment: Aligning LALMs with Editorial Judgment for Media Chapterization
链接：https://arxiv.org/abs/2608.16539
作者：Tony Alex,Wish Suharitdamrong,Sara Atito,Armin Mustafa,Muhammad Awais,Philip J. B. Jackson,Jiankang Deng,Ismail Elezi
类目：ound (cs.SD); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Large Audio Language, remains largely unrealized, made rapid progress, content distribution remains, distribution remains largely
备注： 19 pages, 9 figures, 8 tables
点击查看摘要
Abstract:Large Audio Language Models (LALMs) have made rapid progress on standardized benchmarks, yet their deployment in practical media workflows, curation, archival indexing, and content distribution remains largely unrealized. We identify automated audio chapterization, the task of segmenting continuous audio streams into thematically coherent chapters, as a demanding and commercially consequential setting that exposes this gap. Chapterization is challenging because boundaries are defined less by objective acoustic events than by subjective editorial judgment, requiring models to reason sequentially over long acoustic contexts and approximate creator-authored boundary decisions. We present AudioChaps, a post-training framework for aligning end-to-end LALMs for this task via Group Relative Policy Optimization (GRPO) guided by Chain-of-Thought (CoT) reasoning. To support training and evaluation, we curate three datasets: AudioChaps-Alignment, derived from creator-annotated chapter boundaries on YouTube; AudioChaps-CoT, which provides structured supervision for well-formatted, high-quality, and evidence-grounded boundary reasoning; and AudioChaps-Eval, a held-out benchmark for audio chapterization. Applying GRPO directly without a Supervised Fine-Tuning (SFT) cold start, AudioChaps-R1-Zero already improves average F1 by 33 points over the state-of-the-art LALM Audio-Flamingo-3-Think. The AudioChaps framework produces our final aligned LALM, AudioChaps-R1, which improves average F1 by 49 points. These results demonstrate that GRPO-trained LALMs can reliably transform unstructured auditory streams into navigable, structured media. Our code, models, and dataset resources will be released upon acceptance at this https URL.
20. 【2608.16536】DSPrompt: Dynamic Soft Prompt Defense Against M-RAG Corruption
链接：https://arxiv.org/abs/2608.16536
作者：Chang Liu,Yuni Lai,Mingyue Cui,Cong Tian,Yunyan Zhang,Xian Wu,Kai Zhou,Bin Xiao
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：inducing harmful outputs, Multimodal Retrieval Augmented, Retrieval Augmented Generation, Augmented Generation, vector space
备注：
点击查看摘要
Abstract:Multimodal Retrieval Augmented Generation (M-RAG) is increasingly vulnerable to adversarial attacks where malicious data are crafted to produce embeddings that align with benign entries in the vector space, deceiving retrieval and inducing harmful outputs. Existing defenses primarily operate at query time, relying on auxiliary detectors, similarity re-ranking, or feature-consistency checks. However, these approaches suffer from non-trivial inference overhead, generalize poorly to unseen attack strategies, and often assume specific attack distributions. To address this, we propose DSPrompt, a Dynamic Soft Prompt defense framework that directly reshapes the retriever's embedding semantics, without modifying the retrieval pipeline. It inserts few learnable soft prompts into each layer of the visual and textual encoders of a frozen retriever, utilizing a shallow-to-deep length schedule that is adaptive to the capacity in the model layers. These prompts are trained under a dynamic min-max scheme: an online multimodal attacker continually crafts hard adversarial documents against the current retriever, while the defender is updated to push such documents out of the top-k while preserving the ranking and diversity of benign evidence. Because the defended encoder can be pre-computed and indexed exactly as in standard dense retrieval, DSPrompt incurs no additional per-query optimization and introduces fewer than 1% additional parameters. Extensive experiments across four benchmarks and three representative poisoning attacks show that DSPrompt substantially reduces the attack success rate and poison retrieval rate while maintaining near-lossless retrieval utility and generation fidelity, consistently outperforming existing defense baselines at a fraction of their computational cost.
21. 【2608.16515】When Context Misleads: Intent-Guided Decoding for Robust Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2608.16515
作者：Haolin Jin,Pengyue Yang,Huaming Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, Retrieval-augmented generation, source trust problem, improves large language, grounding generation
备注：
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) improves large language models by grounding generation in external evidence, but it also introduces a source trust problem: retrieved context may be useful, irrelevant, or even misleading. Existing RAG systems often apply a fixed trust policy toward retrieved evidence, which can either over-trust incorrect context or underuse context when the user explicitly asks for context-following behavior. Therefore, we propose Intent-Guided Decoding (IGD), a framework that arbitrates between retrieved context and parametric memory according to user intent. IGD uses answer-level filtering and token-level correction to steer the final decoding trajectory between retrieved context and parametric memory. We evaluate IGD on three faithful QA benchmarks and three factual-conflict benchmarks across five LLMs, IGD substantially improves factual recovery, achieving gains of up to 65.4 percentage points on factual-conflict benchmarks over Direct RAG, while preserving or improving strict context-following behavior, this findings highlight the importance of balancing factuality and faithfulness in RAG.
22. 【2608.16514】Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans
链接：https://arxiv.org/abs/2608.16514
作者：Mohamed Amine Kerkouri,Marouane Tliba,Aladine Chetouani,Ulas Bagci,Alessandro Bruno
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)
关键词：Human visual search, fovea must land, candidate to confirm, landings form, visual search
备注： Paper accepted at 3rd HCV workshop at ECCV 2026. 12 pages main text, 16 pages supp
点击查看摘要
Abstract:Human visual search is serial: the fovea must land on a candidate to confirm it, and those landings form a scanpath. Whether multimodal large language models (MLLMs), given the same foveated input, search as humans do bears on their use as models of human vision and on attention-alignment scores. We compare three general-purpose MLLMs with human eye-movement scanpaths on goal-directed search (COCO-Search18), driving each model fixation by fixation through an identical, human-matched foveated view and assessing it along three axes: the decision of target presence, the efficiency of reaching the target, and the gaze process itself. The axes dissociate. On the decision and on target acquisition the models match or exceed humans, detecting present targets near ceiling and reaching them on the first saccade more often than people do. The gaze process is not human. Under the human-matched condition, all three share one signature: low-entropy, large-amplitude, self-consistent scanpaths that agree with themselves far more closely than two humans agree with each other. That is consistent with a single-pass, non-serial architecture rather than a limit of acuity. Matched retinal input reproduces where humans look but not how the looking unfolds in time, and no degradation regime recovers human-like search at human-like success. The gap sits on a process axis that answer-alignment and saliency metrics do not measure. Because they miss it, such metrics cannot certify human-like vision, and zero-shot models suit outcome and spatial questions but not temporal, process-level ones.
23. 【2608.16467】Computational KJ-Ho: An Analyst-Bias-Free Insight Extraction Framework from Large-Scale Qualitative Data Using Domain-Specialized LLMs
链接：https://arxiv.org/abs/2608.16467
作者：Kasumi Ban
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：cognitive processing capacity, qualitative research methodologies, underpin consumer-insight generation, Thematic Analysis, Grounded Theory
备注： Concept paper. 38 pages, 1 figure, 2 tables
点击查看摘要
Abstract:The qualitative research methodologies that underpin consumer-insight generation - the KJ method, Grounded Theory, and Thematic Analysis - share a structural constraint: the cognitive processing capacity of the human analyst. Replication research further shows that conclusions vary substantially across analysts analyzing identical data (analyst bias). This paper proposes Computational KJ-Ho (the Kawakita Jiro method), a theoretical framework that computationally realizes the KJ method's epistemology - letting structure emerge from the data itself without imposing the analyst's preconceptions - an orientation we term "analyst-bias-free." The framework employs a domain-specialized LLM built through continued pre-training (CPT) on a marketing-research corpus and supervised fine-tuning (SFT) on expert-curated insight pairs, organized as a three-layer architecture: data structuring, insight extraction, and strategy generation. Two preliminary studies in the Japanese marketing context support the necessity of CPT-based domain specialization. The paper makes five contributions: (1) a theoretical integration of the KJ method, Grounded Theory, and Peircean abduction into a single epistemological commitment of data-driven explanation generation; (2) a three-layer architecture leveraging domain-specialized embeddings for cross-interview analysis; (3) two novel evaluation metrics, InsightExtraction-F1 and MarketingQA; (4) explicit engagement with the WEIRD problem, centering a non-Western methodology; and (5) five practice-derived problem formulations from nearly three decades of marketing-research practice, translated into design requirements. The human analyst retains a supervisory role. This is a concept paper presented ahead of empirical validation.
24. 【2608.16417】D2-ScaleAgent: Dual-Dimensional Scaling for Long Document Understanding
链接：https://arxiv.org/abs/2608.16417
作者：Hao Zhang,Longrong Yang,Lunhao Duan,Ziyang Wang,Qing-Guo Chen,Shanshan Zhao
类目：Computation and Language (cs.CL)
关键词：Multi-modal retrieval-augmented generation, Existing multi-modal RAG, multi-modal RAG methods, multi-modal RAG, retrieval-augmented generation
备注：
点击查看摘要
Abstract:Multi-modal retrieval-augmented generation (RAG) is a key technique for visually rich long document understanding. Existing multi-modal RAG methods are progressively advancing toward multi-agent systems: they first retrieve relevant pages based on a query, and then iteratively understand information within those pages. However, these methods typically rely on fixed workflows and lack the ability to dynamically scale computation at test time, often leading to insufficient evidence. To address this, we propose D2-ScaleAgent, an agentic framework that introduces a dual-dimensional scaling paradigm for retrieval and reasoning. The core of D2-ScaleAgent is a Verifier agent-driven dynamic routing loop based on the intrinsic difficulty of the query, centered around a continuously updated evidence bank that serves as the agent's dynamic working memory: when retrieval needs to be expanded, the agent routes outward (retrieval scaling), decomposing the query into attributes and performing parallel page retrieval, followed by adaptive pruning to ensure comprehensive evidence coverage. When fine-grained reasoning is required, the agent routes inward (reasoning scaling), dynamically selecting sub-agents with varying granularity and count to extract evidence from pages. Finally, D2-ScaleAgent achieves logical closure over the evidence chain. Extensive experiments demonstrate that D2-ScaleAgent is effective on long and visually rich document benchmarks like MMLongBench-Doc, LongDocURL, etc.
25. 【2608.16390】Counting Documents Is Not Counting Text: Unit Bias in Web-PDF Corpus Statistics
链接：https://arxiv.org/abs/2608.16390
作者：Luca Foppiano
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：OCR routing, PDF corpora advertise, language mix, rate they publish, corpora advertise
备注：
点击查看摘要
Abstract:PDF corpora advertise their size in tokens but compute every rate they publish (coverage, OCR routing, re-fetch recovery, language mix) per document, and none decomposes its token total. The two units diverge sharply. On CC-MAIN-2021-31-PDF-UNTRUNCATED (7.9M web PDFs, 32.6B tokens), 3.02% of text-bearing documents hold half the tokens (Gini 0.807); documents over 50 pages are 5.00% of the corpus but 53.53% of its text. The PDFs produced by a TeX{} toolchain are 1.66% of documents and 4.05% of the text. The clearest casualty is Common Crawl's truncation cap: it affected 23.06% of documents and 63.08% of the text. Reconstructing the truncated files and extracting both versions, two widely used libraries recover 11.4% and 1.4% of that text; between 72% and 97% of affected documents yield nothing; roughly 55--62% of the corpus's text is lost. Under the 5 MiB cap adopted in March 2025, 30.19% of tokens would still be truncated, and recovery on those documents rises only from 3.3% to 13.2%. We recommend that corpus statistics be reported in both units: documents and tokens.
26. 【2608.16386】Mint-Agent: Introducing Finance-Native Agentic Foundation Models
链接：https://arxiv.org/abs/2608.16386
作者：Mint-Agent Team,B. Zhang,Yaze Geng,Lei Tang,Yaoyang Yi,Zonghan Wu,Yifan Hu,Kun Wang,Qingsong Wen,Yilei Shao
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：executing precise operations, conclusions remain auditable, recall domain knowledge, executing precise, precise operations
备注：
点击查看摘要
Abstract:Financial agents must do more than recall domain knowledge: they must be both reliable, executing precise operations over grounded evidence, and executive, sustaining long-horizon research whose conclusions remain auditable. We present Mint-Agent, a family of finance-native agentic models designed around these two scales of financial intelligence. Mint-Agent is built upon three pillars: data, harness, and algorithm. Our data engine constructs clean, specialized tasks for atomic financial capabilities and long-horizon agentic execution from real-world financial sources. MintHarness enables stable interaction with open-ended environments and maintains auditable evidence trails across extended research trajectories. Our training recipe combines SFT, critical-step OPD, and RLVR to develop separate financial reasoning and agentic execution experts, which are then unified through model merging and multi-teacher on-policy distillation into compact, general-purpose financial agents. This pipeline yields two flagship models, Mint-Cu (9B) and Mint-Ag (27B). Across professional financial benchmarks, our models demonstrate two defining strengths: (1) Reliability: Mint-Ag achieves 98.33% on RFC-Bench, surpassing GPT-5.6-Sol and Claude-Opus-4.8 by 3.66 and 3.00 points; and (2) Executability: Mint-Cu reaches 69.86% on FinSearchComp T2, outperforming Agents-A1-35B and Nex-N2-mini by 22.83 and 12.78 points, while Mint-Ag achieves 76.00% and 60.49% on FinanceAgentBench v1.1 and v2, respectively. These results establish a path toward trustworthy financial intelligence in which domain expertise, long-horizon execution, and auditable evidence are jointly engineered as a unified foundation for frontier agentic models.
27. 【2608.16379】Unadapted Multilingual ASR on a Garrusi Kurdish Evaluation Set: A Common-Reference Staged Normalization Analysis
链接：https://arxiv.org/abs/2608.16379
作者：Hiwa Asadpour
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Evaluating speech recognition, outputs Arabic script, treats writing-system differences, Kurdish variety written, direct scoring treats
备注： 12 pages A4, 4 tables, 2 figures, pilot study
点击查看摘要
Abstract:Evaluating speech recognition for a Kurdish variety written in a Latin field orthography, using a model that outputs Arabic script, creates a measurement problem before a modelling one: direct scoring treats writing-system differences as recognition errors. Jointly normalizing reference and hypothesis avoids this, but also changes reference tokenization, mixing agreement gains with a change in the scoring denominator. I evaluate MMS-1B-all with the Central Kurdish (ckb) adapter, used as released without adaptation, on 1,722 Garrusi questionnaire segments from five speakers (9,763 reference word tokens; 117.9 minutes). I use a common-reference design: the reference is folded once and fixed at 9,763 tokens, while only the hypothesis representation varies. The raw Arabic-script hypothesis scores 111.70% WER and 100.92% CER, with zero exact word matches. Latin transliteration gives 102.36% WER and 57.89% CER; folding it into the reference's reduced orthography gives 97.85% and 51.20%. Thus RAW-to-FOLDED reduces measured WER by 13.85 points and CER by 49.72 points; folding alone accounts for 4.51 and 6.69 points. Substantial error remains: 14.53% of reference tokens are exact matches, edits are substitution-dominated, and per-segment WER is higher for shorter segments. A Southern Kurdish fine-tuned system (aranemini/southern-kurdish-asr), scored under the same design, performs worse on every speaker (1,703 segments), with 109.56% WER and 55.85% CER. However, 12,330 output characters fall outside the folding table, so these rates must be recomputed against the corrected fixed reference. The MMS output also contains 613 unconverted or unmapped characters, showing that part of the residual error reflects scoring-pipeline limits rather than recognition alone. I will release the fixed reference and segment-level results, subject to source-corpus sharing terms, to support independent checking.
28. 【2608.16353】HalluTracer: Hallucination Detection via Depth-Averaging Truth Signals
链接：https://arxiv.org/abs/2608.16353
作者：Zhihao Guo,Zonghan Wu,Huan Huo,DaYong Ye,Junwei Zhang,Weiran Yao,Zhiwei Liu,Qingsong Wen,Yilei Shao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：factually incorrect text, confidently generate factually, generate factually incorrect, persistent reliability risk, models confidently generate
备注：
点击查看摘要
Abstract:Even well-aligned large language models confidently generate factually incorrect text, making hallucination a persistent reliability risk in high-stakes deployments. These models nonetheless carry linearly separable truthfulness signals in their internal representations. Existing white-box detectors, however, collapse this evidence to isolated components or a single depth, discarding discriminative information distributed across the full forward pass. We introduce HalluTracer, a detection framework that reads and aggregates truthfulness evidence across every layer of the forward pass before the model emits any answer token. A geometric analysis reveals that the per-layer signals are weakly correlated, so that simple depth averaging suppresses layer-specific noise and captures nearly all linearly accessible information. Across six open-source language models and five hallucination benchmarks, HalluTracer consistently outperforms matched white-box baselines, with gains ranging from one to fourteen points. Collectively, our work recasts hallucination detection from a layer-selection problem into a depth-aggregation problem governed by the geometric sparsity of the truthfulness signal.
29. 【2608.16347】Architecture-Dependent Causal Transfer of Activation States Across Large Language Models
链接：https://arxiv.org/abs/2608.16347
作者：Fernando Cardenas Piepereit
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Direct communication, incurring encoding, decoding overhead, token cost, intermediate layer
备注： 13 pages, 3 tables
点击查看摘要
Abstract:Direct communication between AI systems relies on natural language as an intermediate layer, incurring encoding/decoding overhead, token cost, and latency. We ask whether internal activation states can instead be transferred causally between different large language model (LLM) architectures via a learned projection, evaluated at three levels: representational similarity, cross-model retrieval from projected states, and end-to-end causal transfer via activation injection during generation. Using four architecturally diverse open-weight models (Qwen2-0.5B, Phi-3-mini, Mistral-7B, FLAN-T5-base), we find that representational alignment in trained models exceeds a random-initialization null baseline and is best captured by a rank-based metric (mutual k-nearest-neighbour alignment), more robust to activation-magnitude outliers than centered kernel alignment (CKA) or Procrustes analysis. A learned projection network retrieves the correct target-model representation from a held-out set well above chance for the three causal decoder-only model pairs (45-50% top-1 accuracy vs. 5% chance) but at chance level for the encoder-based FLAN-T5. Injecting projected activations into a target model during generation produces a statistically significant, pre-registered causal effect on retrieval-based output similarity for only one of the three decoder-only pairs (Qwen2-0.5B to Phi-3-mini: 23.3% vs. 0.0% under negative control, p=0.047, FDR-corrected); the two pairs targeting Mistral-7B show no such effect despite comparable representational alignment at the hidden-state level. We interpret these results as evidence for causal transfer of the representational vehicle, not of meaning, and conclude that end-to-end activation-state transfer between LLMs, as currently implemented, is architecture-dependent rather than universal.
30. 【2608.16344】IndicQE-APE: A Benchmark for Quality Estimation and Automatic Post-Editing for Indic Languages
链接：https://arxiv.org/abs/2608.16344
作者：Diptesh Kanojia,Archchana Sindhujan,Sourabh Deoghare,Daria Sokova,Shenbin Qian,Girish Koushik,Tharindu Ranasinghe,Constantin Orăsan,Chrysoula Zerva,Ricardo Rei,Frédéric Blain,André F. T. Martins,Marco Turchi,Matteo Negri,Rajen Chatterjee,Anoop Kunchukuttan,Mitesh M. Khapra,Pushpak Bhattacharyya
类目：Computation and Language (cs.CL)
关键词：Indic quality estimation, single resource supports, resource supports training, Indic quality, automatic post-editing
备注： Submitted to WMT 2026 for review
点击查看摘要
Abstract:Indic quality estimation (QE) and automatic post-editing (APE) data is spread across separate releases, so no single resource supports training and evaluation across tasks and language pairs on one footing. We consolidate the WMT 2020--2024 shared-task lineage with an extended English--Malayalam resource into \indicqe: $126{,}754$ instances over nine directional pairs, with up to four label types aligned on the same segment, a direct assessment, a human post-edit, word-level OK/BAD tags and an error explanation, and a test set stratified over four difficulty axes. On it, we benchmark six prompted LLMs and three COMET metrics on segment-level QE, and three systems on APE. Two of the axes are defined partly on the direct assessment and select a compressed slice of it, so each axis is compared against a control drawn from the same language pair with the same score distribution. Only one survives that control: segments whose holistic and token-level quality signals conflict are ranked worse than equally-scored segments of the same language, for all nine systems and all seven pairs that carry the axis. Annotator disagreement, which looks second-hardest without the control, has no effect with it. Few-shot prompting costs every model $\leq$ $3.4$B both correlation and output-format compliance. Within-language accuracy does not make scores comparable across pairs: of the three trained metrics, the one with the best within-language correlation loses most when the pairs are pooled. The benchmark and code will be released.
31. 【2608.16333】Step-Level On-Policy Distillation: Interpolating Between On-Policy Distillation and Supervised Fine-Tuning
链接：https://arxiv.org/abs/2608.16333
作者：Changhui Sun,Lanbo Liu,Hang Lei,Tong Ling,Jiahang Xie,Zhiyong Zheng,Yujia Wang,Hao Liu,Feng Xiao,Lu Liu,Yanlong Du,Zifeng Cheng,Ziwei Jiang,Qing Gu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：teacher logit distribution, OPD, logit distribution, SOPD, On-policy distillation
备注：
点击查看摘要
Abstract:On-policy distillation (OPD) aligns a student model with a teacher's logit distribution on student-generated trajectories. This approach has achieved strong empirical gains and can often surpass conventional off-policy distillation with substantially less data. However, standard token-level OPD can provide only fragmented corrections along an erroneous student trajectory and cannot unfold a complete and correct repair path. Motivated by this limitation, we propose \emph{Step-Level On-Policy Distillation} (SOPD), which combines the long-horizon correction of supervised fine-tuning (SFT) with the on-policy advantage of OPD to provide step-level supervision over complete student-generated trajectories. We show that, at different limits of step length, SOPD reduces to SFT or approximates OPD. Compared with SFT, the teacher responses in SOPD are conditioned on student trajectories and therefore align more closely with student-visited states; compared with OPD, SOPD provides longer-horizon corrections rather than fragmented token-level guidance. Across both reasoning and agent tasks, SOPD substantially outperforms conventional SFT and OPD. For example, on ALFWorld, SOPD improves the average success rate by 13.4 points over Vanilla OPD. We hope this work offers a new perspective for future research on distillation methods.
32. 【2608.16316】Deep Thought Alignment: Trajectory-Level Latent Distillation for Video Reasoning
链接：https://arxiv.org/abs/2608.16316
作者：Ao Shen,Yongheng Zhang,Yinghui Li,Manning Wang,Di Yin,Xing Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Multimodal Models, high computational cost, processing vast amounts, Large Multimodal, Multimodal Models
备注：
点击查看摘要
Abstract:Large Multimodal Models (LMMs) for video reasoning have long been hindered by the high computational cost of processing vast amounts of visual information. This dilemma motivates the transfer of the reasoning capabilities of large models to smaller, more efficient ones. On-Policy Distillation (OPD) offers a promising solution by matching output-token distributions along student-generated trajectories. However, video reasoning often depends on evidence accumulated across multiple frames. In this context, output-level supervision only captures information expressed through token predictions and does not directly constrain the latent representations formed during reasoning. To address this limitation, we propose Latent-OPD, which augments OPD with trajectory-level latent distillation. Specifically, our method focuses on the position at the end of each trajectory, where hidden states effectively summarize the accumulated visual evidence and reasoning context. Furthermore, we introduce a progressive teacher-lookahead strategy, which aligns middle-to-late student layers with increasingly deeper teacher layers. Experiments on six video reasoning benchmarks show that Latent-OPD consistently outperforms output-only OPD. Notably, the improvements are particularly pronounced in scenarios with limited frames, long videos, or tasks requiring complex evidence aggregation. These results establish Latent-OPD as a highly effective approach to frame-efficient video reasoning.
33. 【2608.16303】FTA-Mem: Fact-Time-Affect Anchored Memory for Low-Density Long-Term Dialogue
链接：https://arxiv.org/abs/2608.16303
作者：Chang Liu,Shuyi Zhang,Changsheng Ma,Yongfeng Tao,Minqiang Yang,Bin Hu
类目：Computation and Language (cs.CL)
关键词：emotional-support agents require, agents require memory, require memory mechanisms, agents require, mechanisms for personalized
备注：
点击查看摘要
Abstract:Long-term emotional-support agents require memory mechanisms for personalized understanding across sessions. However, emotional-support dialogue is often low-density: turns are incomplete, evidence is scattered, and user states evolve over time. Existing memory methods usually rely on fixed units, such as turn-level notes or session summaries, which may lose details or introduce redundant noise. We propose FTA-Mem, a structured memory framework for low-density long-term dialogue. FTA-Mem uses Boundary-preserving Window Segmentation (BWS) to form coherent situation fragments, and constructs Fact-Time-Affect Memory Units (FTA Units) that jointly encode factual content, temporal grounding, and affective context. Retrieved units are then synthesized into structured context for answer generation. Experiments on ES-MemEval and LoCoMo show that FTA-Mem improves overall long-term memory question answering across benchmarks with different information-density characteristics. On ES-MemEval, FTA-Mem achieves 0.3871 F1 and 0.6668 BERTScore. Further analysis shows that situation-level FTA construction better balances evidence preservation and construction cost than coarse session-level or overly fine-grained turn-pair construction, providing an effective granularity trade-off for long-term dialogue memory.
34. 【2608.16295】Executable Code Knowledge: Code as a Native, Validation-Carrying Knowledge Representation for AI Coding Agents
链接：https://arxiv.org/abs/2608.16295
作者：Xueping Gao
类目：Computation and Language (cs.CL)
关键词：Executable Code Knowledge, Code Knowledge Unit, relevant snippets, context is current, Code Knowledge
备注： 11 pages. Submitted to AgenticDev 2026, co-located with ASE 2026
点击查看摘要
Abstract:AI coding agents need more than relevant snippets: they need business semantics, validation evidence, relations, and assurance that their context is current. Existing systems usually infer or externalize this knowledge through retrieval, summaries, graphs, rules, or reverse specifications. We investigate a complementary representation in which selected code units directly carry agent-usable knowledge. We introduce Executable Code Knowledge (ECK) and define an Executable Code Knowledge Unit (ECKU) as a source-bound object combining stable identity, semantics, executable behavior, contracts, evidence, relations, provenance, validation state, and a query interface. Our Python prototype supports code-local authoring, manifest export, evidence execution, exact changed-line impact, freshness checking, and agent-facing projections. Across three real Python repositories and 26 controlled patch tasks, direct ECK provides executable test coverage for 11/11 evidence-bearing tasks and exact selectors for 9/11; hiding declared evidence reduces exact recovery to 1/11 (paired exact McNemar p=0.0078). ECK-derived rules recover 11/11 exact selectors, showing that rules are effective delivery artifacts while ECK supplies source binding, validation state, impact, and freshness. Exact changed-line impact matches independently authored labels on all 26 patches (12 unit links; precision, recall, and F1 all 1.000). AST-bounded fingerprints classify 50 positive changes and 17 unrelated same-file controls correctly, whereas static rules snapshots detect none of the 50 stale cases. Model-backed patch-review and cross-layer studies measure projection fidelity rather than independent impact discovery. These results support a hybrid architecture: retrieval for coverage, ECK for source and evidence governance, and projections for delivery.
35. 【2608.16286】Clause Encounters of the Third Kind: Can LLMs Replace Language Teachers?
链接：https://arxiv.org/abs/2608.16286
作者：Kristina Šekrst,Ana Kovačić
类目：Computation and Language (cs.CL)
关键词：actively encourage LLM, organizations now actively, actively encourage, perform the fundamental, fundamental tasks
备注：
点击查看摘要
Abstract:While various organizations now actively encourage LLM use in classrooms, we still lack rigorous, systematic evaluations of how well these models actually perform the fundamental tasks of language pedagogy. This paper examines whether state-of-the-art LLMs can deliver the kind of corrective feedback and methodological explanations that language learners need. The study tests multiple large language models on their ability to identify, correct, and explain common learner mistakes in English, by systematically varying model parameters to investigate how these technical adjustments affect output quality, pedagogical clarity, and consistency, along with using retrieval-augmented generation to query methodological data. The evaluation employs automated metrics (GLEU, BERTScore) but also human expert judgments to capture dimensions that purely computational measures miss: linguistic nuance, cultural sensitivity, and instructional appropriateness. While models demonstrate impressive surface-level correction abilities, their explanations often lack the terminological and domain knowledge that effective language teaching requires, suggesting that current enthusiasm for AI-assisted language learning may be outpacing our understanding of these systems' actual pedagogical competence.
36. 【2608.16276】PolyDebate: A Game-Orchestrated Multimodal System for Debate Skills Practice and Evaluation
链接：https://arxiv.org/abs/2608.16276
作者：Jianing Yin,Weng Pan Kuan,Xiaoyun Liu,Zhiyuan Wen,Yuxuan Li,Milos Stojmenovic,Jiannong Cao
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：trains argument construction, audience awareness, Debate, argument construction, English debate practice
备注： 10 pages, 4 figures, 3 tables
点击查看摘要
Abstract:Debate is a structured form of persuasive communication that trains argument construction, rebuttal, oral delivery, and audience awareness. These skills are valued in education, language learning, and professional communication. Recent AI debate systems and LLM-based judges have advanced argument generation and debate evaluation, but most remain text-centered and rarely support learners through a complete multimodal practice experience. We introduce PolyDebate, a game-orchestrated multimodal system for English debate practice and evaluation. PolyDebate guides learners through staged one-on-one (1v1) debates with an AI opponent, while skill cards, props, and coins make persuasive strategies explicit and turn practice into a game-like interaction. During each session, the system captures learner speech and visual delivery evidence, generates context-aware opponent responses, and produces rubric-informed stage-level and overall feedback. PolyDebate is available as both an immersive Unity 3D game version and a web platform version that share the same workflow and evaluation services. Four studies covering AI opponent quality, evaluation coverage, AI judge feedback, and user perception show that PolyDebate brings debate interaction, gamified scaffolding, multimodal assessment, and structured feedback together in a practical workflow for debate skills practice. The demonstration video is available at this https URL.
37. 【2608.16269】Domain-Agnostic Neural Topic Modeling with Contextual Token-Level Semantic Graph Representation
链接：https://arxiv.org/abs/2608.16269
作者：Seung-Won Seo,Won Ik Cho,Yongmin Yoo
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：pre-trained language models, Recent advances, leveraging general-domain pre-training, achieved strong performance, neural topic models
备注：
点击查看摘要
Abstract:Recent advances in neural topic models with pre-trained language models (PLMs) have achieved strong performance by leveraging general-domain pre-training, yet their topic interpretability often degrades on specialized corpora. This limitation primarily stems from the geometry of the embedding space, where domain-specific terms unseen during pre-training collapse into an indistinguishable region, and neither domain-specific re-training, word-level graph enrichment, nor parameter-efficient fine-tuning can restructure this space without inheriting the capacity ceiling of the underlying encoder. Our key insight is that a learnable graph layer operating on token-level PLM embeddings can acquire corpus-specific semantic structure that the frozen encoder lacks, because token-level graphs preserve document-local context that word-level representations discard and joint optimization with the topic objective reshapes embedding geometry directly from target-domain evidence. We instantiate this insight as DARTopic, a domain-agnostic framework that constructs token-level semantic graphs from frozen PLM embeddings and jointly trains a GNN encoder with topic inference. Across three benchmarks spanning general, biomedical, and legal domains, DARTopic consistently outperforms strong baselines in topic coherence and document clus- tering without any encoder fine-tuning, while demonstrating robustness to PLM choice and favorable runtime efficiency over fine-tuning based alternatives.
38. 【2608.16224】STAIR: Semantic-Temporal Automaton for Interpretable Reasoning in Temporal Question Answering
链接：https://arxiv.org/abs/2608.16224
作者：Xinlong Dai,Jinchuan Zhang,Lei Gao,Xinzhe Hu,Yuefeng He,Hui Gao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：leveraging large-scale pretraining, diverse temporal expressions, interpret diverse temporal, large-scale pretraining, task-specific training
备注：
点击查看摘要
Abstract:By leveraging large-scale pretraining, LLMs can interpret diverse temporal expressions and question formulations without task-specific training. However, existing prompt-based neuro-symbolic systems continue to rely on LLMs for both semantic interpretation and exact temporal inference. Consequently, discrete decisions regarding intervals, time anchors, and ordered states remain vulnerable to probabilistic errors and difficult to verify. We present STAIR, a \textbf{S}emantic-\textbf{T}emporal \textbf{A}utomaton for \textbf{I}nterpretable \textbf{R}easoning. STAIR separates semantic interpretation from precise temporal inference: an answer-free LLM adapter maps complex question formulations to normalized temporal intents, while a deterministic temporal automaton with finite control and guarded transitions executes the corresponding policies over canonicalized evidence. Following a rule-first design, STAIR resolves standard questions without invoking an LLM and applies semantic adaptation only when the rule path fails to produce an executable intent. This approach reduces free-form reasoning, making temporal decisions verifiable and interpretable. Specifically, guarded execution supports precise point-time containment and before/after selection, while semantic adaptation handles non-exact intervals and time-anchored queries. Across the TimeQA-Easy, TimeQA-Hard, TempReason-L2, and TempReason-L3 datasets, STAIR consistently outperforms strong baselines in the TQA task using matched model settings, achieving average F1 improvements of 16.57\% and 3.10\% when utilizing the Qwen2.5-7B and GPT-4o-mini models, respectively. Furthermore, ablations and diagnostic analyses demonstrate that STAIR excels at handling both boundary-sensitive and order-sensitive queries, while its guarded execution and semantic adaptation ensure precise point-time reasoning and inexact intervals, respectively.
39. 【2608.16203】INSPIRE: A Benchmark for Instruction-Aware Speech Retrieval
链接：https://arxiv.org/abs/2608.16203
作者：Chen-An Li,Hung-yi Lee
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：fixed similarity matching, Existing speech retrieval, diverse user intents, Existing speech, retrieval systems rely
备注： Interspeech 2026 long paper
点击查看摘要
Abstract:Existing speech retrieval systems rely on fixed similarity matching and cannot adapt to diverse user intents. We introduce INSPIRE, the first benchmark for instruction-aware speech retrieval, in which natural-language instructions dynamically specify relevance criteria, including semantic content, speaker identity, speaking style, environmental sounds, and their combinations. We evaluate four retrieval paradigms: large audio-language models, cascaded pipelines, self-supervised speech models, and contrastive audio-language models. Our results reveal that no current method robustly handles all retrieval intents. Text-based approaches perform relatively better at semantic retrieval but struggle with paralinguistic attributes, while speech-based models are moderately better at capturing acoustic properties but falter at following instructions. These findings highlight the need for unified architectures capable of instruction-aware speech retrieval.
40. 【2608.16185】LENS: In-Context Search via Latent Evidence Exploration over Dynamic Raw Documents
链接：https://arxiv.org/abs/2608.16185
作者：Xingjun Wang,Gongsheng Li,Qi Fan,Yunlin Mao,Luyan Su,Yingda Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：LLM agents increasingly, dynamic raw-document collections, agents increasingly answer, increasingly answer questions, evidence
备注：
点击查看摘要
Abstract:LLM agents increasingly answer questions over dynamic raw-document collections, where files may change before preprocessing, and relevant evidence (spans, sections, pages, or tables) is query-dependent. Existing retrieval-augmented approaches pre-materialize evidence via fixed chunking, embeddings, or persistent indexes: effective for lookup, yet costly, stale-prone, and committed to a granularity before the query is known. We formulate in-context search as Budgeted Evidence Localization over a latent evidence space induced by dynamic raw documents and propose LENS (Latent Evidence Exploration and Search), an index-free framework. Instead of pre-materializing the evidence space, LENS maintains a query-conditioned belief over candidate units, iteratively selecting candidates via complementary lexical, local, and exploratory proposal policies, updating the belief via an LLM relevance oracle, and narrowing toward high-posterior regions under a controllable budget. Evidence is consolidated into compact, source-grounded regions of interest and compressed into self-organizing knowledge clusters reused across related queries. On a controlled 500-question evaluation with matched corpus snapshots, LENS reaches 62.4% exact match and 84.8% evidence recall vs. 65.2% exact match but 50.4% evidence recall for a ReAct-style baseline. Across scales, LENS gives the strongest supporting-fact localization and answer grounding. On a fixed 150-question fullwiki subset over the raw Wikipedia dump with zero indexing, LENS and ReAct are nearly tied in official answer quality (43.3% vs. 42.7% EM), with LENS grounding more answers in retrieved evidence (84.0% vs. 70.7%). A no-retrieval Closed-Book reference highlights the contribution of model memory. LENS is query-ready after corpus changes, needs no preprocessing or persistent index, and preserves source-grounded evidence localization throughout.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.16185 [cs.CL]
(or
arXiv:2608.16185v2 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.16185
Focus to learn more
arXiv-issued DOI via DataCite</p>
41. 【2608.16168】QUMem: Personalized Memory for Query-Conditioned User-State Inference in LLM Agents
链接：https://arxiv.org/abs/2608.16168
作者：Heng Wang,Yifei Li,Lingling Zhang,Pengyu Li,Xinyu Che,Xinyu Zhang,Zesheng Yang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language model, Large language, external memory systems, evolving interaction histories, change with context
备注： 9pages,3figures
点击查看摘要
Abstract:Large language model (LLM) agents increasingly use external memory systems to support personalization by drawing on long and evolving interaction histories, in which user preferences may be distributed across time, change with context, and conflict with earlier evidence. However, existing systems face three limitations: fixed-turn, fixed-token, or session-based boundaries can mix unrelated dialogue or split an event from its causes, decisions, and outcomes; storing multiple pieces of user information from the same interaction as a single memory binds together items that serve different functions and should be independently retrievable; and treating the current task as a single top-$k$ retrieval query can return fragments that are individually relevant but fail to jointly capture preference evolution, temporal validity, and contextual applicability. We introduce \textsc{QUMem}, a structured memory framework for query-conditioned user-state inference. \textsc{QUMem} first segments interaction histories into variable-length episodes according to semantic continuity, then decomposes each episode into independently retrievable factual, preference, and transferable insight memories while preserving temporal positions and source evidence. At inference time, three sequential agents identify task-specific information needs, plan multi-query retrieval over the typed memory stores, and jointly infer a temporally and contextually valid user state for downstream response generation. \textsc{QUMem} achieves state-of-the-art performance on both PersonaMem and KnowU-Bench, demonstrating the effectiveness of query-conditioned user-state inference for long-term personalization.
42. 【2608.16114】HyperSkill: Self-Evolving LLM Agents via Hypergraph-Structured Skill Memory
链接：https://arxiv.org/abs/2608.16114
作者：Ruiyao Xu,Tiankai Yang,Wei-Chieh Huang
类目：Computation and Language (cs.CL)
关键词：LLM agents increasingly, agentic tasks grow, agents increasingly rely, reuse procedural knowledge, LLM agents
备注： 25 pages
点击查看摘要
Abstract:As agentic tasks grow in complexity, LLM agents increasingly rely on experiential memory to reuse procedural knowledge across tasks. Effective memory design must jointly address what to store, how memory is structured and retrieved, and how memory evolves. Existing systems tackle each only partially: they store trajectories, insights, or workflows as isolated entries, discarding compositional relationships among subtasks and reusable skills; retrieve by flat embedding similarity that ignores relational signals; and maintain memory without leveraging its relational structure. We propose HyperSkill, a hypergraph-based memory framework that jointly improves all three. HyperSkill represents memory as a hypergraph with two node types, subtask steps and reusable skills, where each hyperedge links the subtasks and skills from a single trajectory. Dual-path retrieval queries both subtask and trajectory levels, ranking skills by co-occurrence across retrieved trajectories. Periodic structure-informed maintenance prunes low-utility nodes and merges redundant skills via quality-weighted propagation. Across xBench, GAIA, and WebWalkerQA with GPT-4o and Qwen3-30B-A3B, HyperSkill outperforms ten memory baselines, yielding gains of up to +11.51 on GAIA and +11.18 on WebWalkerQA.
43. 【2608.16096】he Commercial Tax: Rent-vs-Own Blind Spots in Multi-Hop Retrieval Benchmarks
链接：https://arxiv.org/abs/2608.16096
作者：Luis M. Sanchez,Kosrow Dehnad
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Enterprises connect language, Enterprises connect, connect language models, connect language, retrieval systems leave
备注： 23 pages, 4 figures. Replication artifacts (harness, per-question recall vectors, cost model, bootstrap code): [this https URL](https://doi.org/10.5281/zenodo.21972866) ; embedding matrices: [this https URL](https://huggingface.co/datasets/toryx-ai/commercial-tax-musique-embeddings)
点击查看摘要
Abstract:Enterprises connect language models to their own data through retrieval. The benchmarks that rank multi-hop retrieval systems leave out two facts a buyer needs before a published number can be used: whether the retrieval backbone may be deployed commercially, and what it costs to build. On licensing: the field's dense-retrieval anchor, NV-Embed-v2, is licensed cc-by-nc-4.0. Of the four leading MuSiQue systems we audit (HippoRAG-2, PropRAG, SAG, KET-RAG), three depend on it for their best numbers and none says so. On performance: we measure thirteen embedders from eight makers on one identical MuSiQue harness with bootstrap confidence intervals throughout. Until mid-2026 there was a real commercial tax: the best commercially-licensed embedder trailed the anchor by 2.31 Recall@5 points (95% CI [0.91, 3.71], p=0.001). NVIDIA's Nemotron-3-Embed-8B, released 2026-07-16, has closed it: +0.24 at Recall@5 (95% CI [-0.94, +1.43], p=0.69), -0.58 at Recall@10 (p=0.28). It matches the anchor, does not beat it, and is the only entrant that is commercially licensed, free to self-host, and indistinguishable from the anchor; every other entrant meeting the first two conditions sits 5.2 to 14.6 points below. The durable finding is the paid-versus-free divide: API embedders charge per token on every re-index, self-hosted ones charge nothing. On cost: three of five audited systems (adding Microsoft's GraphRAG) do not disclose indexing cost, and the only published GraphRAG dollar figures span 11x inside one third-party paper (USD 2.30 vs USD 24.94 to index a 5.64 MB corpus once); extrapolated to 1 TB that undisclosed choice separates roughly USD 428K from $4.6M. Our cost model keeps one-time embedding apart from recurring answering: at 1 TB, embedding sits 7.5x-900x below graph construction, and a year of answering at 10,000 queries/day sits 350x or more below it.
44. 【2608.16071】Skill2Query: Exploiting Skill Structure to Generate Pseudo-Queries for Agent Skill Retrieval
链接：https://arxiv.org/abs/2608.16071
作者：Lihui Ding,Zihan Guo,Bingwei Lu,Chenyu Zhou,Yuanjian Zhou,Weinan Zhang,Jianghao Lin,Dongdong Ge
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：existing document-level approaches, document-level approaches typically, approaches typically leave, rich internal relations, Pseudo-query generation
备注：
点击查看摘要
Abstract:Pseudo-query generation can alleviate the supervision bottleneck for agent skill retrieval, but existing document-level approaches typically leave the rich internal relations among capabilities, parameters, and usage examples implicit. As a result, generated queries may be topically relevant to a skill while lacking capability grounding and parameter consistency, raising the question of whether explicitly exploiting a skill document's internal structure can produce more effective retrieval signals. We therefore propose Skill2Query, a framework that first parses a skill document into a Skill Knowledge Graph and then generates pseudo-queries through a three-stage process including style mimicking, query template generation, and parameter filling. The generated queries can be used for offline index augmentation, online query expansion, and retriever training. Four benchmarks (TheoremQA, LogicBench, ToolQA, and CHAMP) are used to evaluate Skill2Query with large-scale skill candidate pools across multiple downstream applications, including skill retrieval, retriever training, and end-to-end agent execution. Using nearly 30K skills across diverse domains, we generate 700K category-diverse pseudo-queries. Skill2Query consistently improves sparse, dense, and skill-routing retrieval, with an average Recall@1 gain of 6.70 percentage points across retrieval settings. Skill2Query-generated training data also achieves the best Recall@1 and nDCG@1 among the evaluated generation baselines. Further evaluations with multiple LLM backends demonstrate that improved skill retrieval translates into higher agent task success rates. Code and resources are available at this https URL.
45. 【2608.16068】CAPO: Constraint-Aware Prompt Optimization for LLM Agents
链接：https://arxiv.org/abs/2608.16068
作者：Victor Ye Dong,Reid Pryzant,Yi Liu,Jian Jiao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, increasingly deployed, Large, Dynamically Trained CAPO
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly deployed as agents that rely on system prompts to use tools and complete tasks. Such deployments impose distinct operational requirements, including appropriate tool use, concise prompts and solution paths, and compliance with safety and formatting policies. For many practitioners, however, assembling domain-specific supervised data to post-train models to meet these requirements is infeasible. We introduce CAPO (Constraint-Aware Prompt Optimization), a primal-dual method that combines pool-based rewrites with adaptive constraint weighting to optimize system prompts under explicit operational constraints. Across agentic benchmarks, CAPO more reliably reaches empirically feasible operating points while improving task performance. CAPO also generalizes beyond agentic settings, achieving strong results on assistant-style evaluations with output-format and safety/privacy constraints. We further introduce DCAPO (Dynamically Trained CAPO), which trains a feedback- and dual-conditioned rewriter with pool-based GRPO while keeping the task agent frozen. Across task agents of different sizes, DCAPO produces a feasible prompt in every evaluated domain and matches or improves the task accuracy achieved by the evaluated baselines. A surrogate analysis characterizes how finite-pool and discrete-rewrite errors enter the inexact primal-dual procedure.
46. 【2608.16053】DuplexGen: Decoupling Content, Timing, and Acoustics for Synthetic Dialogue Speech
链接：https://arxiv.org/abs/2608.16053
作者：Pengcheng Wang,Sheng Li,Jiyi Li,Takahiro Shinozaki
类目：Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：Synthetic conversational speech, Synthetic conversational, important resource, resource for developing, developing and evaluating
备注：
点击查看摘要
Abstract:Synthetic conversational speech has become an important resource for developing and evaluating conversational speech systems. However, existing dialogue synthesis pipelines typically generate dialogue content first and then insert interruptions, overlap, and backchannels using handcrafted markers or timing rules, making conversational timing prescribed rather than interaction-driven. We present DuplexGen, a dialogue synthesis framework that explicitly decouples content, timing, and acoustics. An LLM first generates the dialogue script, and then two full-duplex conversational models perform the script while listening to each other in real time. This allows conversational timing to emerge naturally while preserving the scripted content. Finally, a high-fidelity text-to-speech model re-renders the interaction without altering its timing. As a demonstration of the proposed framework, we construct a patient--clinician conversational speech corpus with construction-time annotations, including word timestamps, speaker activity, overlap regions, and interaction events. Experimental results show that the proposed framework produces conversational dynamics closer to real dialogue than conventional stitching-based synthesis.
47. 【2608.16044】Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrieval
链接：https://arxiv.org/abs/2608.16044
作者：Prashant Kumar Pathak,Tarun Kumar Sharma
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, question by retrieving, retrieving passages, vector store, store and trusting
备注： 10 pages, 9 figures. Preprint; under submission
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) answers a question by retrieving passages from a vector store and trusting them as context, so anyone who can add documents can try to steer the answer. A recent, appealing defense filters poisoning at ingestion, rejecting any document that behaves like a hub. We show it -- and every ingestion-time filter -- is defeated by a coordinated adversary that injects a handful of individually unremarkable documents which together surround one target query and seize its top-k (on BGE-large / BEIR, m=10 documents take 10/10; 9.9/10 on a live HNSW index). The attack is not theoretical. Realized as ordinary fluent text and run end-to-end through a BGE-large + HNSW + Qwen2.5-7B pipeline, it makes the generator emit the attacker's planted claim in 88% of targets, versus 0% without the injection. And no admission-time defense stops it: at ingestion an attack cone is geometrically identical to a legitimate niche upload, so -- measuring this directly -- the strongest trained classifier, given every feature and thousands of examples, separates the two no better than chance, catching 4.2% of attacks at a 1% false-positive rate. We prove this limit for the entire class of ingestion-time statistics (any decision from documents and reference queries alone), and it reproduces -- and worsens -- across two corpora and five encoders. The one signal that separates an attack from legitimate niche ingestion -- a query's demand -- is invisible before retrieval, which is also the escape: a retrieval-time detector that observes demand catches 100% of the attacks at the same 1% false-positive rate. Coverage of the query space by an admission gate is not containment of coordinated poisoning; robust defense must move past the front door, to demand.
48. 【2608.16033】$R^3$-Bench: LLMs Struggle with Resource-Rational Reasoning under Shared Budgets
链接：https://arxiv.org/abs/2608.16033
作者：Peisong Wang,Zhiwei Ma,Bowen Liu,Feixue Liu,Aochuan Chen,Chenyi Zi,Hongchuan Zeng,Yuhan Li,Jia Li
类目：Computation and Language (cs.CL)
关键词：allocate limited computation, cognitive science, resource rationality, computation to maximize, maximize expected
备注： Code is available at [this https URL](https://github.com/NineAbyss/R-3-Bench) . The dataset is available at [this https URL](https://huggingface.co/datasets/R-3-Bench/R-3-Bench)
点击查看摘要
Abstract:In cognitive science, resource rationality asks how an agent should allocate limited computation to maximize expected value. Most reasoning and agent benchmarks use independent per-task budgets; existing shared-budget studies do not calibrate suite performance against the same model's demonstrated single-problem competence. We introduce $R^3$-Bench, which evaluates six-problem suites under shared budgets across mathematics, competitive programming, and abstract reasoning in tool-free and agentic settings. Matched single-problem response curves define an offline empirical oracle over observed successes. Across 72 main-table cells for six models, the oracle mean matches or exceeds the contest mean in all cells and is strictly higher in 71. Under moderate tool-free pressure, equal-allocation replay also exceeds contest performance for four of six models. Trajectory diagnostics reveal limited strategy updating and pressure-dependent failure patterns. In a three-model diagnostic under strong agentic pressure, at least one fixed scheduler exceeds the contest mean in six of nine cells, but no policy dominates across domains. These results expose a persistent gap between demonstrated competence and shared-budget realization.
49. 【2608.16011】ReRef-3D: A Benchmark for Spatial Referring Expression-Guided 3D Scene Rearrangement
链接：https://arxiv.org/abs/2608.16011
作者：Mary Lynn Martin,Yifei Zhang,Martha Palmer,Maria Leonor Pacheco
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：benchmark for language-guided, language-guided placement, CLEVR-derived scenes, scenes, Abstract
备注： 18 pages, 4 figures. Submitted to ACL Rolling Review (ARR)
点击查看摘要
Abstract:We introduce ReRef-3D, a benchmark for language-guided placement in 3D scenes. It contains 33,826 instructions across 998 CLEVR-derived scenes, spanning 16 placement families and direct, one-hop, and two-hop references. Each instruction must be resolved into a valid new placement position. Given that an instruction defines a region of acceptable placements rather than one coordinate, our evaluation inserts a prediction into the scene, recomputes relations, and tests relation satisfaction and physical validity. Each instruction also includes a verified naturalized rewrite. After fine-tuning, LLaVA-3D, 3D-LLM, and PlaceIt3D produce valid placements for 68.3%, 31.6%, and 22.4% of instructions, respectively. Across models, relation satisfaction surpasses physical validity, relations such as nearest and between are the most difficult, and phrasing has minimal effect on performance.
50. 【2608.16003】Prior Audit-Repair Context Shifts LLM Verifier Thresholds Toward Leniency
链接：https://arxiv.org/abs/2608.16003
作者：Parsa Mazaheri,Kasra Mazaheri
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Automated checking pipelines, checking pipelines increasingly, pipelines increasingly place, Automated checking, lowers false alarms
备注： 12 pages, 2 figures, 4 tables. Code and analysis artefacts: [this https URL](https://github.com/parsa-mz/crtitxer)
点击查看摘要
Abstract:Automated checking pipelines increasingly place one language model as the checker and another (or the same one) as the fixer. We ask whether that wiring changes what the checker reports. Measuring false alarms on human-verified-correct ProcessBench traces with the present task held byte-identical, we find that a completed audit - repair episode already in the model's context lowers false alarms in 15 of 15 model x wording combinations, by 2.8 to 11.5 percentage points against a length-matched non-audit control, a 9 to 25% reduction relative to that control. The direction contradicts what the accumulated-message literature predicts: an episode whose audit reported an error lowers false alarms further still, at all five wordings on the model where that manipulation lands cleanly, though a negativity asymmetry predicts more flagging. Decomposing the episode finds repair content and audit verdict complementary: different components carry the effect on different model families. Signal-detection analysis locates the change in the threshold rather than in discrimination -- the criterion moves in 15 of 15 combinations and survives correction in 13 while d' survives in none, though the d' test is half as sensitive by construction -- and a hand audit of 50 false alarms finds 82% simply wrong, so at this operating point the shift need not be harmful. With reasoning enabled the effect keeps its relative size on both models tested, and the threshold reading holds there too.
51. 【2608.16002】From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents
链接：https://arxiv.org/abs/2608.16002
作者：Zhengzhao Ma. Boxi Cao,Yaojie Lu,Hongyu Lin,Xianpei Han,Le Sun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：deploying large language, complex interactive environments, large language model, essential for deploying, deploying large
备注：
点击查看摘要
Abstract:Reliable uncertainty quantification (UQ) is essential for deploying large language model (LLM) agents in complex interactive environments. Existing UQ methods largely rely on local signals, such as token probabilities, predictive entropy, or per-step confidence, and therefore overlook the long-range dependencies through which errors accumulate across an execution trajectory. As a result, they may fail to identify agent failures whose causes originate several reasoning or interaction steps before the final answer. We propose RUPA (Relational Uncertainty Propagation for Agents), a trajectory-level UQ framework for LLM agents. RUPA represents an execution history as a directed trajectory graph in which reasoning states, tool interactions, and environment feedback are nodes connected by temporal and semantic dependency edges. It then propagates uncertainty over this graph to capture how execution risk accumulates and transfers across interaction steps. The propagated signal is combined with trajectory-level behavioral features and goal-alignment information to produce a confidence estimate for the full agent trajectory. We evaluate RUPA on representative agent benchmarks, including $\tau$-2, Terminal-Bench-2, and GAIA, using 6 open-source LLMs spanning multiple model families. Experimental results show that RUPA consistently outperforms existing UQ methods by providing more accurate uncertainty estimates, enabling earlier failure detection, and improving uncertainty-guided agent execution across diverse agent tasks. These results demonstrate that explicitly modeling relational dependency is crucial to reliable UQ for long-horizon LLM agents, providing a practical foundation for trustworthy agent execution.
52. 【2608.15980】Whose Gold? Annotator-Pool Disagreement Is Large at the Item Level, and Hidden by Small Leaderboards
链接：https://arxiv.org/abs/2608.15980
作者：Anik Jha
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Preference benchmarks, built by hiring, implementation detail, Preference, hiring annotators
备注： Submitted to the HAIC workshop at NeurIPS 2026
点击查看摘要
Abstract:Preference benchmarks are built by hiring annotators, and the identity of those annotators is treated as an implementation detail. We measure what that detail buys. On the 2,885 MultiPref items where both pools are internally unanimous, so no tie-breaking convention is consulted at all, expert and crowd annotators assign a different majority label to 23.6% and name the opposite winner on 9.2%; on the 246 comparably unanimous MT-Bench cells, benchmark authors and recruited experts differ on 30.5% and reverse on 8.5%. Yet on both corpora the resulting model leaderboards are bit-identical: Kendall tau = 1.00 with zero of six models displaced. That invariance is far weaker evidence than it looks, and we quantify how weak. Switching pools moves a model's win rate by 1.9pp (SD), one adjacent pair in our own leaderboard sits 0.8pp apart and had a 38% chance of swapping, and an item-level bootstrap displaces at least one model in 28% of resamples. The observed zero is the common outcome, not a property of aggregation: on the same measured perturbation, a ten-model leaderboard is displaced with probability 0.86 and a twenty-model leaderboard with probability 0.9997. Reporting a six-model leaderboard is safe; the safety does not generalise, and everything that consumes labels per item is not safe at any size. We make the distinction precise, show that a widely used dataset's stated assumption of no intra-group annotator variability is false, and show that an LLM judge tracks the crowd pool over the expert pool on all three models we test, including one from a different vendor. All code, per-call outputs, and pre-registered decision rules will be released upon acceptance.
Comments:
Submitted to the HAIC workshop at NeurIPS 2026
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2608.15980 [cs.CL]
(or
arXiv:2608.15980v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.15980
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
53. 【2608.15975】A Scalable Pipeline for LLM-Teacher Distillation Labeling: Work-Stealing Job Scheduling and Memory-Aware GPU Concurrency
链接：https://arxiv.org/abs/2608.15975
作者：Ravi Satya Durga Prasad Yenugula
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Labeling large text, large text corpora, Labeling large, corpora with LLM, large text
备注： 8 pages, 1 figure, 3 tables. Code, tests, and all run artifacts: [this https URL](https://github.com/rsdpyenugula/hybrid-labeling-training)
点击查看摘要
Abstract:Labeling large text corpora with LLM teachers has become a practical route to training data at scale. At millions of items, hand-labeling every batch is not feasible, and two questions dominate: what label quality a teacher buys per dollar, and how to keep a fleet of GPU workers busy under skewed, failure-prone workloads. We present a simple, reproducible pipeline that addresses both. First, a work-stealing ring pool: each worker owns a queue, drains it first, and then steals from ring successors, with exactly-once task claims via atomic conditional writes and crash tolerance via stale-claim sweeping. The claim protocol requires only a compare-and-set primitive from its storage layer; we implement it on a single SQLite file, which makes the reference implementation dependency-free and the experiments reproducible on one machine. Second, a memory-aware concurrency rule that sizes per-node parallelism by how many model copies fit on the GPU, so the same code runs safely across device sizes. Third, a relabeling benchmark methodology in which the teacher relabels a public dataset that already has gold labels, so quality reduces to an agreement measurement and cost follows from measured throughput. Under skewed load the pool sustains up to 3.4 times the throughput of static sharding while matching it at zero skew, loses 0 of 2,000 tasks when half the workers are killed mid-run (static sharding loses 953), and yields measured quality and cost points for an instruction-tuned teacher on irony and sentiment tasks. All experiments run on public data and commodity hardware; code, tests, and run logs are released.
54. 【2608.15971】he Limits of Binding in Dual Encoders
链接：https://arxiv.org/abs/2608.15971
作者：Kin Ian Lo
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：computed unit vectors, independently computed unit, blue dog, red dog, red car
备注：
点击查看摘要
Abstract:Dual-encoder models such as CLIP score an image-caption pair by a single inner product of two independently computed unit vectors, and fail at binding, often scoring near chance when asked to distinguish "a red car and a blue dog" from "a blue car and a red dog". We give a mathematical account of when this failure is necessary and when it is contingent. Working within the ideal-encoder framework proposed by Kang et al., we first show the relevant axioms are satisfiable, so every impossibility must enter through an added, checkable hypothesis. We then prove three such obstructions. Depth: for recursive role-binding codes the swap margin obeys an exact law $m(D) = 2b^{-D}$ in the nesting depth D, with a finite-dimension version holding up to one explicitly flagged concentration estimate; the resolvable depth grows only logarithmically in the dimension and is single-digit at CLIP scale, the nesting depth of ordinary language. Objective: architecture-free throttle theorems showing that the contrastive objective's entire reward for binding is bounded by the rate at which training contrasts a caption against its own swap, a rate that vanishes at web scale, and that exactly reversed binding costs only that rate times the mean binding margin; both are verified in simulation. Geometry: a tight smoothness-binding frontier: the closer the two swap-related captions must embed to a shared paraphrase anchor, the smaller the binding margin can be, with an exact constant. Measuring its text-only diagnostic across 18 deployed text encoders, every model sits at roughly 25-35% of its ceiling, and the induced per-item ceiling tracks SugarCrepe's subset difficulty at r = 0.99. Binding failure in deployed dual encoders is thus not a dimension or smoothness limit today, but an incentive and code-structure limit, with a proved depth ceiling that remains once those are fixed.
55. 【2608.15964】LLMs Get Smarter from Targeted Synthetic Multilingual Data
链接：https://arxiv.org/abs/2608.15964
作者：Ishika Agarwal,Arkajyoti Charaborty,Tanner Sorensen,Neha Gupta,Andreas Stolcke
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Language-specific competency, worse depending, Language-specific, language model performing, Hardness Optimized Training
备注：
点击查看摘要
Abstract:Language-specific competency (LSC) is the phenomenon of a language model performing better or worse depending on the language of the prompt. In other words, a language model outputs different (and potentially incorrect) responses to the same semantic query when prompted in different languages. Prior work attributes this to an internal misalignment of semantic representation across languages. Currently, there are two main approaches to address LSC in the literature: (1) routing all queries through English, improving performance, but limiting language expressivity to English; or (2) training on language-balanced data, equalizing model performance across languages, but reducing overall performance. In this work, we take a data centric perspective and introduce HOTFIXR: Hardness Optimized Training data For Improving X-Lingual Reasoning. It is a data generation framework that uses models to probe and learn a student model's multilingual weaknesses, and generates data to mitigate them. HOTFIXR can generate multilingual synthetic training data that can improve multilingual performance. We evaluate on three in-distribution tasks, three out-of-distribution tasks, and four out-of-distribution languages. On average, HOTFIXR (1) improves in-distribution performance by 6.2%, (2) reduces catastrophic forgetting (induced by fine-tuning) on OOD tasks by 3.7%, and (3) on OOD languages by 7.1%. Overall, as many real-world applications requires multilingual LLMs, our work contributes to the efforts of making LLMs multilingually proficient. We will release code upon acceptance.
56. 【2608.15962】SEER: Long-Context Reasoning via Selective Visual-Text Compression
链接：https://arxiv.org/abs/2608.15962
作者：Jiawei Xu,Zhilin Zhai,Jinrui Fang,Ruohan Xu,Mingfei Lu,Yi Zhang,Guanchu Wang,Tianlong Chen,Ying Ding
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains computationally expensive, large language models, language models due, reasoning remains computationally, remains computationally
备注： COLM 2026, Third Conference on Language Modeling
点击查看摘要
Abstract:Long-context reasoning remains computationally expensive for large language models due to the quadratic complexity of attention over text tokens. Visual-text compression offers a promising alternative by rendering text into images and processing them with vision-language models, often reducing token usage. However, existing approaches apply uniform compression regardless of query relevance, potentially sacrificing precision where detailed extraction is required. We present SEER, a framework that learns to select query-relevant images through visual scanning and retrieve textual content only where needed, combining the efficiency of visual compression with the precision of text-based reasoning. Through supervised fine-tuning on tool-interaction trajectories, SEER learns adaptive tool invocation for selection and retrieval. Experiments on long-context benchmarks show that SEER improves extraction precision through selective text retrieval while retaining average prompt-token savings relative to full-text baselines. On LongBench, SEER achieves 51.11% average accuracy, outperforming the visual-text baseline Glyph-9B by 2.33 points and Qwen3-8B by 3.49 points. Code can be accessed at this https URL
57. 【2608.15949】Ask to Be Sure: Informative Interactions for Confident Multi-Turn LLM Recommendation
链接：https://arxiv.org/abs/2608.15949
作者：Cedar Site Bai,Duanshun Li,Zhenyu Liao,Sheikh Sarwar,Huiyuan Chen,Yuan Chen,Changhe Yuan,Haiyang Zhang,Qilin Qi
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, Recent advances, conversational recommender systems, demonstrating strong recommendation, strong recommendation accuracy
备注： CIKM 2026
点击查看摘要
Abstract:Recent advances in large language models (LLMs) have enabled their use as conversational recommender systems (CRS), demonstrating strong recommendation accuracy and natural dialogue. However, guiding multi-turn interactions to elicit user preferences effectively remains challenging. Existing approaches either use separate reinforcement learning agents with templated interactions or optimize for interactivity judged by another LLM, without measuring how much useful information is actually gained. We propose a new approach that quantifies the effectiveness of each interaction by the reduction in the assistant's uncertainty, measured via entropy over recommendations. We apply this entropy reduction as a reward---without relying on ground-truth recommendations, which are often unavailable in real-world scenarios---to fine-tune the LLM, enabling strategic interaction generation. Empirical results with supervised fine-tuning (SFT) and direct preference optimization (DPO) on the INSPIRED and ReDial datasets show that our method improves both recommendation quality and conversational efficiency.
58. 【2608.15940】he Null Token Knows: Reducing Message-Free Hallucination in ASR and NMT
链接：https://arxiv.org/abs/2608.15940
作者：Kirill Borodin,Vasiliy Kudryavtsev,Ivan Viakhirev
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Sound (cs.SD)
关键词：Modern encoder-decoder systems, produce fluent text, Modern encoder-decoder, recoverable message, encoder-decoder systems
备注： Submitted to the Thirty-Ninth AAAI Conference on Artificial Intelligence (AAAI-27)
点击查看摘要
Abstract:Modern encoder-decoder systems can produce fluent text even when their input contains no recoverable message. We study this failure in ASR and NMT through the models' reserved null tokens, asking whether the score for ending generation already carries a usable abstention signal. Across speech recognizers and translation models, we audit native null-token scores and scalar logit shifts. In Whisper, we additionally probe decoder states and compare supervised row edits with conventional external gates. The evaluated models often expose a useful abstention signal, but stock decoding does not reliably act on it. Raising the null-token score can sharply suppress fabrication, but aggressive intervention also deletes valid speech or shortens legitimate translations. These findings turn the null token into a diagnostic lens on hallucination and motivate evaluating abstention methods by both suppression and deletion costs, rather than by hallucination reduction alone.
59. 【2608.15939】Aborted but Not Forgotten: KV-Cache Retention Breaks Rollback Consistency in Language Agents
链接：https://arxiv.org/abs/2608.15939
作者：Guijia Zhang,Harry Yang
类目：Computation and Language (cs.CL)
关键词：Stateful language agents, language agents assume, Stateful language, language agents, agents assume
备注： 21 pages, 5 figures, 7 tables
点击查看摘要
Abstract:Stateful language agents assume a rejected branch can be taken back by clearing it from the application transcript. We show this breaks when the serving session retains key/value (KV) state across the logical abort: the model can continue attending to content the application believes it discarded. We formalize the missing guarantee as rollback consistency: a complete abort must restore the state the model attends, not just the transcript. The key failure is cross-layer: a correct logical rollback need not compose with retained inference state, and the gap can remain invisible to the application. To isolate cache effects from text effects, we introduce a same-token/different-cache audit that holds decision-step tokens identical while varying only whether the cached prefix is stale or rebuilt from committed state. Across seven open-weight families (3.8B-36B), retained KV alone flips a typed protected effect in 25 of 63 audited cells, while attacker tokens are absent from the served request in all 63; rebuilding the cache closes every cell. The channel reproduces in an end-to-end session application, on the default Hugging Face Transformers cache-reuse path, and under LangGraph time-travel, where verified logical rollback can still leave attended KV stale. Susceptibility varies across models, but the underlying attended-state integrity violation is structural. We rule out position and length confounds, generalize across protected effects, policy structures, and a cache-isolated Mixture-of-Experts model, and show that transaction-local cache restoration closes the channel without requiring a global cache flush. All headline results are deterministic and reproducible from released artifacts.
60. 【2608.15935】oken Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation
链接：https://arxiv.org/abs/2608.15935
作者：Ashima Sood,Bryan Gardiner,Joan Condell
类目：Computation and Language (cs.CL)
关键词：work leaves confounded, widely varying size, varying size raises, prior work leaves, domain-balanced training mixture
备注： Accepted at 19th International Natural Language Generation Conference (INLG 2026), Utrecht, Netherlands
点击查看摘要
Abstract:Jointly fine-tuning an LLM on meeting-summarisation corpora of widely varying size raises a question that prior work leaves confounded: when a domain-balanced training mixture helps, is the gain due to the distribution of tokens across domains, or merely to the volume of data seen? We disentangle these factors by constructing balanced and natural (native-proportional) token mixtures at matched token budgets (2-32M) over five English meeting corpora, fine-tuning Mistral-7B with QLoRA, and evaluating per domain. Balancing redistributes quality, improving the data-scarce minority domains at a low cost to the data-rich ones. The trade favours balancing whenever the minority domains matter: their share under proportional allocation is fixed at 1-2% regardless of budget, so matching balanced quality on those domains requires far more total data. We further find that pruning low-value transcript lines removes ~15% of tokens from the conversational corpora at no measurable cost, and that balancing by tokens is not the same as balancing by examples. A two-annotator study of 741 judge-labelled facts validates our fact-level evaluation. Together these results give practitioners a basis for deciding when to balance an imbalanced multi-domain mixture, and on what unit.
61. 【2608.15931】PLSQLBench: Benchmarking LLM Systems for Executable Procedural Database Programming
链接：https://arxiv.org/abs/2608.15931
作者：Marianne Menglin Liu,Leonid Boytsov,Daniel W. Peterson,Pramuditha Perera,Rongguang Wang,Sai Ashish Somayajula,Syed Hamza Rafique,Rohit Saini,Shubham Pathak,Sujeeth Bharadwaj,Tao Sheng,Graham Horwood,Fahad Shah,Ankan Bansal,Sujith Ravi,Dan Roth
类目：Computation and Language (cs.CL)
关键词：execution-based tests, SQL programs, write executable, correctness measured, measured through execution-based
备注：
点击查看摘要
Abstract:We present PLSQLBench, to our knowledge the first benchmark for evaluating whether LLMs can write executable PL/SQL programs, with correctness measured through execution-based tests. Existing LLM evaluations largely target general-purpose code generation or declarative text-to-SQL, leaving procedural database programming underexplored. PLSQLBench contains 2,865 instances: 2,594 single-turn tasks and 271 multi-turn conversations spanning 978 turns. The benchmark combines complex schema-grounded tasks over enterprise-style Spider 2 databases, simpler schema-grounded tasks derived from Spider, and MBPP-derived procedural problems, covering varying levels of database grounding and procedural complexity. Experiments with eight LLMs reveal recurring difficulties in schema grounding, PL/SQL dialect fidelity, procedural control flow, exception handling, and cross-turn consistency. Tool-augmented LLM agents improve performance on several schema-grounded evaluations, although substantial gaps remain. These results highlight procedural database programming capabilities not directly assessed by conventional code generation or text-to-SQL benchmarks. Our code is available at this https URL.
62. 【2608.15909】Large language model-assisted discovery of cohorts from scientific literature
链接：https://arxiv.org/abs/2608.15909
作者：Moritz Sturm,Lisa M. Berg,Inken Berg,Harishny Sarma,Jasmin Hartmann,Denissa Girschik,Gemma Roig,Christine M. Freitag,Andreas G. Chiocchetti
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Planning multi-study analyses, multi-study analyses requires, analyses requires identifying, Planning multi-study, requires identifying cohorts
备注：
点击查看摘要
Abstract:Background: Planning multi-study analyses requires identifying cohorts with the relevant participants, phenotypes, and data modalities. This process commonly relies on prior knowledge, cohort catalogues, and manual literature searches. We developed a complementary question-driven framework that searches relevant scientific literature and extracts explicit cohort names. Methods: The framework first generates multiple PubMed queries from configurable vocabularies and templates and retrieves the resulting scientific literature automatically through the PubMed API. A large language model then screens the retrieved titles and abstracts and extracts explicit cohort names using a prompt tailored to the research question. The extracted names are deduplicated with human review. Configurable code, prompts, and example outputs are available at this https URL. Evaluation: As a use case, we applied the framework to youth aggression genetics. From 5,400 generated PubMed queries, the framework retrieved 5,254 unique records and identified 188 candidate cohorts. Manual screening using predefined criteria, including participant age and genetic-data availability, retained 44 eligible cohorts. Automated LLM-based name extraction was within the agreement range of human annotators. We also searched four established cohort catalogues using the same research question. Their combined results contained 27 of the 44 eligible cohorts, while 17 were not returned by any cohort catalogue search. Conclusion: The framework converts research-question-specific vocabulary into screenable cohort inventories via a large, automated literature search. It can be adapted across populations, phenotypes, data modalities, and study designs, and provides a literature-based complement to curated cohort catalogues.
63. 【2608.15879】When Less Is Enough: Context Selection and Prompting Strategies for Bengali News Headline Generation
链接：https://arxiv.org/abs/2608.15879
作者：Muhammad Ashad Kabir,Kawsar Ahmed,Md. Osama
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, generation remains sensitive, headline generation, text generation tasks
备注： 11 pages
点击查看摘要
Abstract:Large language models (LLMs) have shown strong performance in text generation tasks, yet their effectiveness on headline generation remains sensitive to how input context is selected and presented. In this work, we investigate Bengali news headline generation as a document-level generation task that requires effective selection and presentation of salient contextual information from long-form articles. Using Gemini-2.0-Flash, Llama-3.3-70B, and GPT-4o, we systematically study the effects of context selection, prompting strategies, and in-context learning (i.e., few-shot) on the quality of headline generation. Our experiments show that providing the full article does not necessarily improve performance; instead, using selected lead paragraphs of the article can maintain, and in some cases improve, headline generation quality. We further compare Bengali Native Prompting (BNaP) and Cross-Lingual Prompting (XLP), and examine how each interacts with context-enriched prompt templates incorporating auxiliary contextual cues. Results demonstrate that prompting strategies substantially influence generation quality: XLP often yields stronger performance, particularly when combined with contextual enrichment, but its benefits are model-dependent. Additionally, few-shot prompting substantially improves Gemini, with most of the gain obtained from a single demonstration, whereas Llama shows limited benefit from additional examples. Overall, our findings highlight that effective Bengali news headline generation depends more on context relevance and prompt design than on increasing input length, offering practical insights for multilingual and low-resource LLM applications.
64. 【2608.15871】Large Language Models as Implicit Sociological Models: Reconstructing Voting Behaviour from Sociodemographic Profiles
链接：https://arxiv.org/abs/2608.15871
作者：Roman Neruda,Martin Bakoš,Josef Šlerka,Vít Tuček,Petra Vidnerová,Gabriela Kadlecová
类目：Computers and Society (cs.CY); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, large-scale internet corpora, internet corpora encode, corpora encode extensive, encode extensive statistical
备注：
点击查看摘要
Abstract:Large language models (LLMs) trained on large-scale internet corpora encode extensive statistical regularities about social identities, attitudes, and political behaviour. This paper introduces and evaluates a methodological framework that leverages these latent representations to reconstruct aggregate voting behaviour from individual-level sociodemographic profiles. We operationalize LLMs as implicit sociological models by conditioning them on demographic descriptions, eliciting probabilistic turnout and party preferences, and aggregating individual outputs via a soft voting procedure. Using the 2021 Czech parliamentary election as a validation case, we demonstrate that contemporary LLMs reproduce official election outcomes with low mean absolute error, recover known political bloc structures, and align with independently established sociodemographic gradients. The contribution of this work is methodological rather than predictive: we show how LLMs can be systematically interrogated as compressed representations of social reality, offering a novel exploratory instrument for computational social science while clearly delineating its epistemic and ethical limits.
65. 【2608.15869】Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning
链接：https://arxiv.org/abs/2608.15869
作者：Xiaoyu Zhu,Xinke Deng,Suresh Taddewadikar,Arnab Kumar Mondal,Zhongyu Jiang,Ian Fasel,Joerg Liebelt
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：Multimodal large language, large language models, language models increasingly, reason about spatial, embodied environments
备注：
点击查看摘要
Abstract:Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments. By generating intermediate reasoning images, Visual CoT provides an intuitive mechanism for visual foresight but introduces substantial inference overhead, which is particularly problematic for proactive video reasoning. We ask whether models can learn to think visually during training while reasoning directly at inference. We introduce Internalized Visual Thinking (IVT), a post-training framework that jointly optimizes textual prediction and next-embedding prediction over unlabeled videos. Given a partially observed video, IVT predicts latent representations of future frames together with the target textual answer, encouraging the model to capture motion, object transitions, interactions, and latent intent. At inference, IVT generates the answer directly without synthesizing or re-encoding future frames. We conduct controlled studies across target representations, decoder designs, prediction horizons, data mixtures, training curricula, and predictive objectives. IVT improves over direct-answer fine-tuning on all six evaluation settings while retaining the same inference pathway. Compared with explicit Visual CoT, IVT achieves comparable or better performance and reduces average end-to-end latency by more than 5x. Together, our findings suggest that explicit pixel-space generation at inference time, as used in visual chain-of-thought, may not be necessary for effective proactive video reasoning. Predictive world modeling can be internalized during training to produce multimodal reasoners that are both more accurate and substantially more efficient.
66. 【2608.15863】Scaling Manual-Grounded Appliance Manipulation with Data Synthesis and Unified Planning
链接：https://arxiv.org/abs/2608.15863
作者：Yuxing Long,Lei Kang,Ziyan Yu,Yuzheng Gao,Bin Cheng,Jiyao Zhang,Xiaoqi Li,Haolin Yang,Dongjiang Li,Hui Shen,Hao Dong
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Operating household appliances, task-oriented dataset exists, Hierarchical Appliance Graph, models fall short, appliances requires long-horizon
备注： Accepted by ACM MM 26
点击查看摘要
Abstract:Operating household appliances requires long-horizon planning that is state-dependent and robust to disturbances, yet existing large models fall short, as no sufficiently diverse, task-oriented dataset exists to support such planning. To bridge this gap, we propose MAGE, a scalable data synthesis pipeline that introduces a novel Hierarchical Appliance Graph (HAG) to automatically generate part grounding, long-horizon planning, and closed-loop recovery data from appliance manuals. With MAGE, we build UseAppliance, the first large-scale dataset for manual-grounded appliance manipulation planning, spanning 22 appliance categories with 89K+ part annotations, 53K+ manipulation tasks, and 33K+ closed-loop adjustment steps. Built on UseAppliance, we develop AppliancePlan, an end-to-end model for manual-grounded appliance manipulation planning. On RealAppliance-Bench, AppliancePlan with only 7B parameters achieves over 10x the best baseline on open-loop planning and consistently outperforms state-of-the-art models across all tasks. Real-robot experiments on six household appliances further confirm effective sim-to-real transfer, marking an important step toward general-purpose household robotics.
67. 【2608.15851】Dense Expands, Sparse Anchors: Channel-Asymmetric Query Expansion for Hybrid Retrieval
链接：https://arxiv.org/abs/2608.15851
作者：Chunran Zhang
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：generating document-like passages, generating document-like, LLM-based query expansion, retrieval, LLM-based query
备注： 13 pages, 4 figures. Code and artifacts: [this https URL](https://github.com/ln-one/dense-expands-sparse-anchors)
点击查看摘要
Abstract:LLM-based query expansion improves retrieval by generating document-like passages. In hybrid retrieval, however, most evaluations fuse fixed top-$L$ dense and sparse rankings. Because the cutoff controls both which cross-channel contributions enter fusion and how much of each ranking is accessed, gains measured at one $L$ can change or reverse at another. We separate these effects by evaluating retrieval effectiveness under complete-list fusion and recording the policy-specific per-channel replay stopping depths at which its ordered top-$K$ is certified. We then introduce DESA (Dense Expansion and Sparse Anchoring), a channel-asymmetric query expansion method. An LLM generates complementary reference passages; orthogonal residual expansion adds their new semantic directions to the dense query, while score-product anchoring incorporates their lexical cues into sparse retrieval without broadening the original query's lexical support. Across seven BEIR datasets, DESA improves nDCG@10 and Recall@20 over the unexpanded query by 3.82% and 2.38%, while reducing dense and sparse access depths by 36.90% and 36.56%. With equal dataset weighting, 63.31% of queries become shallower in both channels. However, both depths increase with Contriever on Touché-2020. These results support channel-specific integration of generated passages and joint evaluation of retrieval effectiveness and access depth.
68. 【2608.15844】MicroVerse: An Instrument for Measuring Self-Authored Identity Drift in Long-Horizon Multi-Agent Language-Model Simulations
链接：https://arxiv.org/abs/2608.15844
作者：Sky Ng,Brihi Joshi,Ishan Gupta,Shirley Huang,Zonglin Di,Yun Shen,Qianfeng Wen,Yifan Simon Liu,Ruoqi Gao,Yilan(Eliza)Fan,Zhiwei Zhang,Muhammad Ahmed Mohsin,Yucheng Lu,Xiaoyi Liu,Heming Liu,Qianyu Zhu,Hanwen Xing,Zhengyang Shan,My Chiffon Nguyen,Guanghui Min,Jianheng(Jaden)Hou,Yunze(Lorenzo)Xiao,Keyang Xuan,Hannah Collison,Jintao Huang,Jiatong Li,Sankalp Jajee,Yunhan Zhao,Bing Hu,Xupeng Chen,Binghang Lu,Weihang Xiao,Aravind Mohan,Bolun Sun,Yunshu Wu,Yuanda Xu,Runyu Zhang,Zheyuan Deng,Xinchen(Cara)Tan,Dianzhuo Wang,Yijun Wang,Yixuan He,Koutian Wu,Cheng Cheng,Xiaomin Li,Yuexing Hao
类目：Computation and Language (cs.CL)
关键词：persona-conditioned agents maintain, multi-agent language model, maintain identity fidelity, studying social behavior, multi-agent language
备注：
点击查看摘要
Abstract:Long-horizon, multi-agent language model (LM) simulations are widely proposed for studying social behavior, yet instruments to measure whether persona-conditioned agents maintain identity fidelity under sustained pressure are lacking. We present MicroVerse, a behavioral-science instrument that measures identity drift in generative agents. Agents carry an immutable "soul file" (core values, moral boundaries, personality, goals) and inhabit a resource-scarce 50 x 50 environment where water is a non-respawning survival constraint. Scarcity is operationalized via a per-tick existence-cost gradient. The eight-verb action space maps directly to moral boundaries (trade, talk, attack, scavenge). Using a three-layer memory architecture, agents periodically revise a mutable current identity against their immutable original soul via importance-triggered reflection. To mitigate survivor bias, MicroVerse decouples measurement from behavior using uniform longitudinal engine snapshots every N ticks alongside a forced-end snapshot of all living and dead agents. Identity drift is scored offline using a paraphrase-aware, value-anchored, multi-register diff rather than raw cosine similarity. We evaluate the instrument via a controlled seed run (n = 25) and a reflection-threshold sweep (thresholds {40, 80, 150}) to determine if drift dynamics are gate artifacts or threshold-robust properties. We report two primary findings: (1) Anti-self-deception emerges unprompted as the single largest semantic category of identity modification (27 of 111 added boundaries, 24%). (2) The system is threshold-robust; lower gates accelerate and increase revision frequency but preserve drift direction. All empirical results are strictly preliminary existence proofs and effect shapes (one model, one seed per arm, n = 25) rather than statistical significance claims.
69. 【2608.15834】Schema-Agnostic Graph Reasoning Agent for Hybrid Knowledge Graphs
链接：https://arxiv.org/abs/2608.15834
作者：Marius Dragic,Ruben Ifrah,Alexandre Rio
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)
关键词：Tool-calling LLM agents, Tool-calling LLM, LLM agents navigate, navigate unfamiliar codebases, agents navigate unfamiliar
备注：
点击查看摘要
Abstract:Tool-calling LLM agents navigate unfamiliar codebases with a handful of generic primitives for listing, reading and searching files (ls, cat, grep). A knowledge graph admits the same interface: listing neighbours, reading node content and searching descriptions are the same operations on a different substrate. Building on this correspondence, we present GRA, a Graph Reasoning Agent that explores hybrid knowledge graphs, whose nodes are either textual concepts or relational tables, with seven generic tools, discovering everything domain-specific at run time. On UFK-M (Unified Factory Knowledge Model), an industrial benchmark of 258 analytical questions whose gold answers are produced by executing validated SQL programs, GRA beats a full-context agent by 5.1 pp (88.4% vs. 83.3%), while reading under a third of its input tokens. A graph-free control shows the gain comes chiefly from selective agentic access rather than graph topology, and that the effect depends on a model able to drive tools reliably. Seeing less, the agent answers better: selective navigation over a structured substrate beats exhaustive context.
70. 【2608.15828】A Cognitively Motivated Multidimensional Framework for Evaluating Metaphor Explanations
链接：https://arxiv.org/abs/2608.15828
作者：Ana Naveriani,Jakob Suchan,Stefano Zoia,Mehul Bhatt,Antonio Lieto,Gian Luca Pozzato
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：metaphor explanations relies, agree and diverge, Current evaluation, explanation quality, metaphor explanation quality
备注： Preprint of paper accepted at INLG 2026
点击查看摘要
Abstract:Current evaluation of metaphor explanations relies mainly on holistic quality ratings, revealing little about how explanation quality is structured or where human judgments agree and diverge. We introduce a cognitively motivated framework that decomposes metaphor explanation quality into six theoretically grounded dimensions. In a dense annotation study (11,200 ratings), we find that: {\bfseries(i)} explanation quality is genuinely multidimensional; {\bfseries(ii)} annotator disagreement is systematic rather than random; and {\bfseries(iii)} the six dimensions collapse into a shared cluster and two independent axes of judgment. An exploratory feasibility study further shows that a standard automatic evaluation pipeline can recover parts of this structure, predicting the most discriminative dimensions well while its errors correlate human (dis)agreement. Together, these results suggest that multidimensional evaluation offers richer diagnostic insight than holistic ratings, and that automatic evaluators for open-ended generation tasks should be judged on how well they preserve the structure of human judgment.
71. 【2608.15820】QuantumPhaseNet: A Gauge-Covariant Geometric and Quantum-Spectral Theory of Semantic Concept Hierarchies with Prototype Validation of a Classical Quantum-Inspired Model
链接：https://arxiv.org/abs/2608.15820
作者：Kiyotaka Kasubuchi,Kazuo Fukiya
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Transformer representations, extension of Transformer, present QuantumPhaseNet, gauge-covariant geometric, geometric and quantum-spectral
备注： [PAGES] pages, 8 figures, 4 tables. Extends [arXiv:2602.14419](https://arxiv.org/abs/2602.14419) (WavePhaseNet). Includes prototype validation with an offline Validation Studio; RQ5 reports a negative result for quantum advantage
点击查看摘要
Abstract:We present QuantumPhaseNet, a gauge-covariant geometric and quantum-spectral extension of Transformer representations. Context-dependent semantic states are modeled as complex amplitudes; a covariant phase rate induces a semantic wavelength used as a proxy for conceptual scale; and low-frequency graph modes define a document-level discourse direction. The theoretical part establishes local gauge invariance, unitarity of the quantum block, boundedness and conditional stability of WavePhase Attention, and a calibratable hallucination-risk formulation. We also implemented a fully offline Validation Studio for the classical quantum-inspired pipeline in Section 14.1 and evaluated the five research questions in Section 16.1 on its built-in synthetic setting (n=240, observation noise 0.22, circuit noise 0.08, five seeds). RQ1 yielded a wavelength-hierarchy Spearman correlation of 0.852 versus 0.707 for the baseline, 87.3% direction accuracy, and AUC 0.953. RQ2 achieved discourse alignment 0.933 versus 0.589 and 41.2 versus 16.2 paragraphs before drift. RQ3 achieved AUROC 0.881 versus cosine 0.765 and phase-shuffle 0.536. RQ4 achieved error-detection AUROC 0.854 versus entropy 0.634, with Brier 0.150 and ECE 0.098. RQ5 did not show quantum advantage: target probability and end-to-end cost efficiency were 25.5% and 0.107, compared with 70.7% and 0.707 for the Chebyshev classical approximation. These results provide initial synthetic evidence for the classical quantum-inspired components, but not external validity or unconditional quantum speedup.
72. 【2608.15804】Hallucination Span Detection with Input-Side Evidence Alignment
链接：https://arxiv.org/abs/2608.15804
作者：Miyu Yamada,Yuki Arase
类目：Computation and Language (cs.CL)
关键词：conditional text generation, large language models, remain a major, major obstacle, large language
备注：
点击查看摘要
Abstract:Hallucinations remain a major obstacle to the reliable use of large language models (LLMs) in conditional text generation. Existing methods primarily assess the factuality of an entire generated text, providing limited insight into which output spans are hallucinated or how they relate to the input. We introduce the task of hallucination span detection with input-side evidence alignment, which jointly identifies hallucinated spans and aligns output tokens with the corresponding input evidence. Our approach is based on the observation that faithful output tokens are predictable from the input, whereas hallucinated tokens are not. We therefore train an encoder-based model to predict masked output tokens from the input representation, using prediction confidence for hallucination detection while naturally producing alignments to the input. Experiments show that the proposed method effectively detects hallucinated spans and identifies meaningful input-side evidence. Human evaluation confirms the quality of the predicted alignments.
73. 【2608.15799】Using the Mimi codec for metalinguistic representations
链接：https://arxiv.org/abs/2608.15799
作者：Artem Saloev,Erin Pacquetet,Nicolas Ballier
类目：Computation and Language (cs.CL)
关键词：Moshi language model, Mimi semantic token, Moshi language, semantic token codebook, language model
备注： 11 pages, accepted for the Proceedings of the Third Workshop on the Bridges and Gaps between Formal and Computational Linguistics (BriGap-3), Paris 2026
点击查看摘要
Abstract:In this paper, we focus on the dictionary of 2048 tokens used in Mimi semantic token codebook, the neural codec of the Moshi language model. We show that the ABX experiment carried out with Mimi fails to capture the mapping of the semantic tokens to phone realisations. By realigning Mimi representations to the TIMIT corpus transcriptions, we show that the 2048 tokens IDs of the semantic codebook map to quadphone, triphone, biphone, phone and subphone realisations.
74. 【2608.15797】KV-Rescue: Recovering Reasoning Language Model KV Eviction Loss via Stepwise Interleaving
链接：https://arxiv.org/abs/2608.15797
作者：Minsoo Cheong,Woosang Lim,Vincent-Daniel Yun,Sungjoo Yoo
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：KV-cache eviction caps, long reasoning traces, caps the memory, memory cost, cost of long
备注：
点击查看摘要
Abstract:KV-cache eviction caps the memory cost of long reasoning traces but is inherently lossy because the model decodes from a partial view of its history. Under aggressive budgets, this not only lowers accuracy but can also cause runaway degeneration, where the model produces incoherent or repetitive tokens until reaching the length limit. We characterize much of this loss as an information gapf caused by missing context, rather than a capability gap caused by limited model capacity. An evicted 7B model and a full-context 1.5B model make complementary errors, and an oracle choice between their answers recovers 79% of the accuracy gap to the full-KV 7B model. Based on this observation, we propose KV-Rescue, a training-free inference framework that bridges the information gap introduced by KV eviction using a lightweight full-context helper. KV-Rescue interleaves reasoning steps from the two models into a shared trajectory. An online detector uses entropy and compressibility to terminate the generation of incoherent or repetitive base-model candidates early. Across five math benchmarks with Qwen2.5-Math 7B and 72B, KV-Rescue recovers an average of 87% of the accuracy lost to eviction at eviction budget B=64. A decode-cost analysis further shows that preventing runaway degeneration cuts base-model token generation by 43% on average.
75. 【2608.15787】Routing Divergence Is Not Evidence of Behavioral Influence in Same-Weight MoE Self-Distillation
链接：https://arxiv.org/abs/2608.15787
作者：Cedric Caruzzo,Donggeun Yoo,Tae Soo Kim
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：forward passes, routing term, term, exposure, content term
备注： 15 pages, 4 figures
点击查看摘要
Abstract:Two Mixture-of-Experts (MoE) forward passes can share every weight yet route the same token through different experts. This creates a possible blind spot in same-weight self-distillation, where a demonstration-conditioned teacher supervises a query-only student. We study this mismatch in its single-step form, with frozen weights rather than as a proxy for a full training trajectory. An exact blockwise decomposition separates a routing term, which changes gates at fixed content, from a dense-like content term. Across seven open-weight checkpoints and two domains, the routing term spans only $1.6\times$ as a fraction of block output, while its residual-stream exposure spans $3.2\times$. Exposure is ordered by the routed block's share of the residual. Scaling the always-on backbone in two confirmatory models moves exposure monotonically; common-mode controls support a mass-and-coherence mechanism rather than denominator dilution alone. Preregistered PubMedQA patches on three models show that the full routing term moves outputs by less than half the natural context effect and is largely reproduced by matched-norm noise, whereas the content term is strongly direction-specific. Scale and merged-expert probes show that the narrow block-level range is not universal, although exposure remains small at the tested boundaries. Router movement alone is therefore not evidence of behavioral influence: measure exposure first, and use a behavioral intervention when the decision matters.
76. 【2608.15763】aoLive Digital Avatar Agent Technical Report: Training Agents to Evolve with Their Harness
链接：https://arxiv.org/abs/2608.15763
作者：TaoLive AIGC LLM Team:Yuhan Sun,Wenhao Lin,Yongdong Luo,Yibo Hu,Meiguang Jin,Junfeng Ma,Weihang Pan,Jiaxin Zhao,Zulong Chen
类目：Computation and Language (cs.CL)
关键词：AI-powered digital-avatar streamers, answer product questions, execute changing business, changing business strategies, engage viewers
备注：
点击查看摘要
Abstract:AI-powered digital-avatar streamers in live e-commerce must answer product questions, engage viewers, and execute changing business strategies in real time. This requires low latency, factual and effective replies, and rapid adaptation to updated campaign, compliance, and style requirements. We develop an evolvable Harness that decouples Skills, Hooks, system prompts, and tools from model weights, allowing runtime behavior to change without retraining. However, Harness evolution creates a moving execution environment: compact models fine-tuned on one configuration may memorize names, schemas, and prompt templates rather than follow the Harness currently provided, while stronger zero-shot models are too slow for real-time use. We address this tension with Harness-Aware Training (HAT), which makes Harness states part of the training distribution. HAT applies task-preserving Harness-State Augmentation (HSA) to Skills, tool schemas, prompt structures, and interaction constraints, and comprises three stages: HSA-based supervised fine-tuning, general on-policy distillation to recover general capabilities, and HSA-based agentic reinforcement learning in a production-informed live-room simulator. Across four evaluation sets with more than 4,500 cases, our compact 35B model scores 94.8 on real-world Live-Stream QA, versus 80.3 for the base model and 93.0 for the strongest evaluated general LLM, while scoring 94.6 on Harness-Variant QA and retaining 83.5 on IFEval. By contrast, fixed-Harness SFT reduces IFEval by 7.7 points. In a controlled complete-agent replay on one NVIDIA H20 GPU with MTP enabled, the system achieves 3.407 s P50 and 8.114 s P95 latency. These results show that HAT produces a latency-feasible compact agent that remains effective under evaluated Harness changes without sacrificing general instruction following.
77. 【2608.15746】Propaganda Forensics: Recovering the Generation Pipeline of an AI-Driven Influence Campaign
链接：https://arxiv.org/abs/2608.15746
作者：Benjamin Icard,Elouan Vuichard,Louis Lefebvre,Lila Sainero,Thomas Girault,Alice Breton,Tanguy Launay,Gauvain Bourgne,Morgane Casanova,Guillaume Gadek,Victor Klötzer,Michel Le Nouy,Guillaume Gravier,Jean-Gabriel Ganascia,Paul Égré
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：recent AI-driven influence, AI-driven influence campaign, present a forensic, generation pipeline, recent AI-driven
备注： To appear in the Proceedings of the 10th Workshop on Online Abuse and Harms (WOAH), EMNLP 2026
点击查看摘要
Abstract:We present a forensic analysis of the generation pipeline behind a recent AI-driven influence campaign. We introduce PROPAGIA, a corpus of 2,646 propagandist French articles from the Storm-1516/CopyCop campaign disclosed by VIGINUM and INSIKT GROUP in 2025. For comparison, we rely on SIPA, a corpus of human-written French mainstream press from the same period. Using topic modeling, vagueness and sentiment analysis, we first isolate persuasion techniques characteristic of propaganda, with PROPAGIA far exceeding SIPA in vagueness, subjectivity and negativity, and citing fewer sources. We then find prompt instruction leaks on 50 of the 84 PROPAGIA websites, including a verbatim ten-point editorial specification accounting for several of these differences, together with high cross-article redundancy. Finally, we show that rewriting-based detection supports INSIKT GROUP's attribution to the Llama 3 family, but also suggests the involvement of Mistral-family models.
78. 【2608.15710】Beyond Single Object: Learning 3D Relations with Large Language Models
链接：https://arxiv.org/abs/2608.15710
作者：Kohsuke Ide,Ryousuke Yamada,Yue Qiu,Xianzheng Ma,Yoshihiro Fukuhara,Hirokatsu Kataoka,Yutaka Satoh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：existing models focus, scene description, inter-object comparison, address a fundamental, fundamental gap
备注： Accepted to CVPR 2026
点击查看摘要
Abstract:We address a fundamental gap in 3D-LLMs: existing models focus on single-object/scene description, struggling with detailed, inter-object comparison. We propose a framework for detailed object-level reasoning across multiple objects with three components: (1) MO3D (Multi-Object in 3D), an instruction dataset requiring fine-grained multi-object comparison; (2) Multi-3DLLM, using a minimal Patch-Interaction Transformer (PIT) that models inter-/intra-object relationships while preserving local geometry; (3) Mini-apps, two application-driven benchmarks (Shape Mating, Change Captioning) that probe geometric understanding for practical use. Recent 3D-LLMs and 2D-VLMs perform poorly on these tasks, lacking both comparison-centric design and geometric awareness. In contrast, Multi-3DLLM trained on our mixture data learns geometric reasoning, surpasses all baselines on MO3D, and provides positive transfer to single-object classification.
79. 【2608.15691】BERTopic-Virality Prioritisation: A Scalable Framework for Thematic and Comparative Analysis of COVID-19 and Monkeypox Misinformation on Twitter
链接：https://arxiv.org/abs/2608.15691
作者：Mkululi Sikosana,Sean Maudsley-Barton,Oluwaseun Ajao
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Social and Information Networks (cs.SI)
关键词：public health guidance, Health misinformation circulating, gain traction rapidly, health guidance, creating harmful narratives
备注： 21 pages, 3 figures, 12 tables. Preprint
点击查看摘要
Abstract:Health misinformation circulating during pandemics can gain traction rapidly, creating harmful narratives that compete with public health guidance. Most topic-modelling pipelines treat engagement as an external outcome, limiting their ability to prioritise semantically coherent topics that are also rapidly diffusing. We introduce BERTopic-VP, a virality-prioritised topic-modelling framework that combines contextual embedding-based clustering (BERTopic) with a post hoc Virality Prioritisation (VP) layer. The pipeline is complemented by a two-stage hybrid misinformation detection module that fuses a supervised content-based classifier with an external verification signal derived from public-health knowledge bases. Applied to three benchmark datasets, COVID-19_FNIR, Monkeypox, and Constraint, the framework achieves strong classification performance, with F1 up to 0.950 and ROC-AUC up to 0.989, while identifying high-impact clusters under top 1%, 5%, and 10% VP thresholds. For datasets without native engagement metadata, prioritisation is based on a logistic propensity-to-spread score, used as an ordinal proxy for diffusion potential rather than a direct measure of engagement. The results show that integrating semantic structure, virality-aware ranking, and affective-linguistic profiling enables scalable and interpretable comparative analysis of misinformation across pandemics. The proposed framework supports monitoring-oriented early warning by surfacing low-volume but high-risk narratives for analyst review.
80. 【2608.15689】Integrating Persuasion Theory into the Epidemiological Modelling of Health Misinformation Spread on Social Media
链接：https://arxiv.org/abs/2608.15689
作者：Mkululi Sikosana,Sean Maudsley-Barton,Oluwaseun Ajao
类目：ocial and Information Networks (cs.SI); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：incorporating Misinformed Susceptible, Misinformed Infected, Misinformed Recovered, social media, misinformation
备注： 14 pages, 3 figures, 8 tables. Preprint
点击查看摘要
Abstract:This study presents a hybrid epidemiological and behavioural framework to simulate the spread of health misinformation on social media. We extend the classical Susceptible--Infected--Recovered (SIR) model to a six-compartment structure (SIRMMM), incorporating Misinformed Susceptible (MS), Misinformed Infected (MI), and Misinformed Recovered (MR) compartments to better reflect the dynamics of the misinformation lifecycle. To account for individual-level behavioural variation, we extend the SIRMMM model by integrating psychological signals from the Elaboration Likelihood Model (ELM), including sentiment polarity, engagement metrics, and cognitive effort, which dynamically modulate the misinformation transmission rate, yielding the ELM-SIRMMM framework. Model parameters were estimated using the FibVID dataset, which captures COVID-19 misinformation on Twitter. Generalisability was tested on two additional datasets: MC-Fake (emotional misinformation) and Monant (general health misinformation). Results show that the ELM-SIRMMM model enhances both predictive accuracy and dynamic realism. On FibVID, it decreases RMSE by 5.5%, delays the misinformation peak from day 150 to day 160, and increases its peak prevalence from 6% to 7%. On MC-Fake, it accurately reproduces a flash-rumour pattern, infecting 38% of users by day 45 and achieving 97% misinformation recovery, all while maintaining model accuracy. In contrast, minimal behavioural signal variability in the Monant dataset leads to marginal benefit, with only a 3% peak and 57% of users remaining susceptible. These findings suggest that structural elaboration alone is insufficient. Functional realism in modelling misinformation spread requires dynamic psychological inputs that vary meaningfully across time and contexts.
81. 【2608.15654】When Stories Evolve: Benchmarking LLM Storytelling Across Agent Architectures in Open-Ended World Simulations
链接：https://arxiv.org/abs/2608.15654
作者：Yuqi Chen,Sixuan Li,Yunfeng Cai,Xueai Li,Ka Man Yan,Ying Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, Large language, open-ended storytelling requires, write fluent stories, local fluency
备注：
点击查看摘要
Abstract:Large language models can write fluent stories, but open-ended storytelling requires more than local fluency. In evolving world simulations and AI-native games, models must preserve facts, relationships, causal dependencies, and character states as the world changes. We introduce WSE-bench, a process benchmark that separately evaluates sustained generation, canonical coherence, and meaningful development in dynamic LLM storytelling. Generation Coverage records the proportion of planned narrative steps produced; Consistency tracks when canon breaks; and Richness measures how meaningfully branching, player-shaped trajectories develop. Across frontier models, Consistency and Richness do not form a smooth trade-off: their empirical Pareto frontier is non-concave, with several non-dominated intermediate configurations that no positive linear weighting can select. Added structure can enrich trajectories, but it does not uniformly improve coherence and may shorten them. Model scale chiefly improves sustained generation, without producing reliable gains in canonical coherence or meaningful development. These results show that sustained generation, canonical coherence, and meaningful development are distinct and sometimes competing capacities. WSE-bench makes those dynamics visible by extending narrative evaluation from finished stories to the processes that create them.
82. 【2608.15641】Wiktionary as a Crowdsourced Lexicon for English Dialects
链接：https://arxiv.org/abs/2608.15641
作者：Sidney Wong
类目：Computation and Language (cs.CL)
关键词：ethically crowdsourced lexicon, Oxford English Dictionary, paper evaluates Wiktionary, crowdsourced dialect lexicon, crowdsourced lexicon
备注： Submitted to the 13th Web-as-Corpus Workshop
点击查看摘要
Abstract:This paper evaluates Wiktionary as an ethically crowdsourced lexicon for English dialects. We took a two-phase approach, providing an in-depth descriptive analysis of the crowdsourced lexicon for 12 national varieties of English before applying the lexicon to geo-referenced, country-level social media language data to examine the real-world performance of this crowdsourced dialect lexicon. We demonstrate that Wiktionary matches or exceeds the coverage of traditional dictionaries, such as the Oxford English Dictionary (OED), for regional and Outer-Circle varieties. Our dialect-specific case study on New Zealand English found high alignment between Wiktionary and the OED based on word-formation patterns (R = 0.883). Similarly, we observed high alignment between the dialect lexicon and geo-referenced social media language. While this paper found that Wiktionary has broad coverage of lexical properties, it also highlighted some of the macro-challenges involved in evaluating dialect-responsive language resources and tools, such as the role of language contact in dialects and register effects in web-based corpora.
83. 【2608.15630】Do Assessment Instruments Measure the Same Thing for Humans and LLMs? A Latent Structure Analysis
链接：https://arxiv.org/abs/2608.15630
作者：Alona Strugatski,Licol Zeinfeld,Giora Alexandron
类目：Human-Computer Interaction (cs.HC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, language models, rapid development, development and growing, growing deployment
备注：
点击查看摘要
Abstract:The rapid development and growing deployment of large language models (LLMs) have made it increasingly important to understand their capabilities. A common approach is to evaluate LLMs using assessment instruments originally designed to measure skills and competencies in humans, such as standardized exams, and to use performance on these instruments as evidence for generalizable claims about LLMs' underlying abilities on the same skills the assessments are intended to measure in humans. However, from a validity perspective, such inferences require that the relationship between observed performance and underlying constructs established for humans also holds for LLMs. In particular, a necessary condition for transferring score interpretations is similarity in the latent structure of responses to the assessment. In this study, we examine whether this condition holds in two educational contexts: high-school chemistry and a quantitative reasoning section of a university entrance exam. Using a case study design, we compare human response data with responses generated by six multimodal LLMs. Our analytical approach combines exploratory factor analysis, factor congruence, and resampling to assess latent structure similarity across human learners and LLMs. Across both instruments, we find systematic differences between human and LLM factor structures, showing evidence that the analyzed assessments may not measure the same constructs for humans and LLMs. These findings call into question the validity of evaluation practices that use educational assessments to make claims about AI capabilities.
84. 【2608.15547】BengaliMCQ: Automatic Generation and Answer Prediction of Academic Multiple-Choice Questions in a Low-Resource Language
链接：https://arxiv.org/abs/2608.15547
作者：Abu Tarabin Surzo,A.K.M. Nihalul Kabir,Sm Azmain Faysal,Ariana Haque Ami,Lawrence Amlan Gomes,Farig Sadeque
类目：Computation and Language (cs.CL)
关键词：Traditional retrieval-augmented generation, Traditional retrieval-augmented, frameworks process documents, leading to poor, poor performance
备注：
点击查看摘要
Abstract:Traditional retrieval-augmented generation (RAG) frameworks process documents without attending to their hierarchical structure, leading to poor performance, especially in low-resource languages such as Bengali. To address this, we propose a structure-aware RAG framework that models Bengali textbooks as hierarchical graphs and uses a contrastively trained graph neural network to retrieve a small set of relevant passages. These passages provide focused context for a large language model, enabling topic-specific multiple-choice question (MCQ) generation and in-domain answer prediction. Experimental results demonstrate that our framework outperforms strong dense retrieval baselines across retrieval metrics, produces more relevant MCQs, and achieves superior answer prediction accuracy.
85. 【2608.15535】L3Cube-IndicQuest v2: A Large-Scale Multilingual Benchmark for Evaluating Factual Knowledge of Large Language Models Across Indic Languages
链接：https://arxiv.org/abs/2608.15535
作者：Rinit Jain,Tirthraj Mahajan,Advait Joshi,Raviraj Joshi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：India-specific factual knowledge, evaluating the India-specific, India-specific factual, knowledge of Large, large-scale gold-standard multilingual
备注：
点击查看摘要
Abstract:We present L3Cube-IndicQuest v2, a large-scale gold-standard multilingual question-answering benchmark for evaluating the India-specific factual knowledge of Large Language Models (LLMs). The benchmark comprises 3,471 curriculum-grounded English question--answer pairs spanning nine domains, curated from educational curricula, competitive examination materials, and domain-specific reference books. We introduce a practical hybrid construction strategy that combines context-grounded LLM-based question generation and validation with semantic deduplication and human verification, enabling scalable creation of benchmark data while preserving annotation quality. The benchmark is translated into 19 Indic languages, yielding a publicly released multilingual dataset of 69,420 question--answer pairs across 20 languages. We evaluate six LLMs under three protocols: LLM-as-a-judge and two deterministic lexical criteria, exact-substring and word-overlap matching. All three produce almost the same model ranking, showing that the results do not depend on the choice of judge. The frontier commercial model leads by a wide margin, and among open-weight models Gemma4 31B outperforms the Indic-specialised Sarvam 30B in every evaluated Indic language.
86. 【2608.15530】Why Summaries Turn Neutral: Policy Attribution for Sentiment Drift in Reinforcement Learning from Human Feedback
链接：https://arxiv.org/abs/2608.15530
作者：Mikhail Krasitskii,Alexander Gelbukh,Olga Kolesnikova,Grigori Sidorov
类目：Computation and Language (cs.CL)
关键词：improving summarization fluency, Reinforcement learning, overly neutral summaries, neutral summaries stripped, human feedback
备注：
点击查看摘要
Abstract:Reinforcement learning with human feedback (RLHF) aligns LLMs with human preferences, improving summarization fluency and safety, but causes sentiment drift: overly neutral summaries stripped of emotional nuance. We diagnose why RL acts as a sentiment neutralizer and present Policy Attribution, a framework using gradient and logit decomposition to trace drift to reward model (RM) signals and KL (Kullback-Leibler) penalty. Sentiment drift reflects a strategic bias toward "low-risk" tokens maximizing expected rewards under preference uncertainty (Stiennon et al., 2020; Gao, Schulman, and Hilton, 2023). On Reddit TL;DR and CNN/DailyMail, RLHF summaries get higher rewards but show 30-40% lower sentiment variance. Cross-lingual analysis across eight languages shows language-independent drift, with morphologically richer languages more suppressed (Krasitskii et al., 2026). We propose and validate a sentiment-aware regularization technique reducing drift by 18-22% without harming summary quality. The code and toolkit will be public.
87. 【2608.15507】Do Language Models Consistently Encode the Current Year?
链接：https://arxiv.org/abs/2608.15507
作者：Suze van Adrichem,Aditi Bhaskar,Diyi Yang,Christopher Potts,Jing Huang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：current time, current year, current, year, time is important
备注： Accepted at the Conference on Language Modeling (COLM) 2026
点击查看摘要
Abstract:A consistent concept of the current time is important for temporal reasoning, yet how language models represent the current time is not well understood. We contribute two tasks that probe the current year in conceptually distinct ways: an associative task, which infers the current year from verb tense, and a declarative task, which directly queries for the current year. Both tasks estimate current years within one year of the post-training data cutoff of instruction-tuned language models. For base models, predictions on the associative task serve as a strong proxy for the pre-training data cutoff, with an average error of only 10 months across 13 models. However, their internal mechanisms diverge: the associative task uses mechanisms similar to factual recall, while the declarative task lacks consistent causal pathways. This divergence poses a challenge for updating the current year in language models. None of prompting, SFT, or weight editing succeed in shifting the associative and declarative years simultaneously. Prompting updates the declarative year (94.6% success across 351 target years) but leaves the associative year nearly unchanged (1.7% success). Year-shifted SFT also fails to shift the associative year, matching the target year in only one of eight models. Weight editing, while effective for both tasks individually, does not generalize across both. Overall, our results show that the current year is not consistently encoded in language models: The associative notion, deeply ingrained in linguistic structures learned in pre-training, uses different causal mechanisms and resists the same modifications that easily shift the declarative notion learned in post-training.
88. 【2608.15448】Language models suffer from a curse of ambiguity
链接：https://arxiv.org/abs/2608.15448
作者：Nicolas Zucchet,Hyun Dong Lee,Scott Linderman
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
关键词：models increasingly rely, Large language models, making the fidelity, language models increasingly, Large language
备注：
点击查看摘要
Abstract:Large language models increasingly rely on sampling as a driver of their own improvement, making the fidelity of their learned distributions more critical than ever. Yet, not all distributions are equally easy to learn. In this work, we identify a curse of ambiguity: in large language models, and more broadly in all neural networks that produce discrete probability distributions, the more ambiguous a next-token distribution is, the harder it is to learn accurately. Through an extensive theoretical analysis, we trace this curse to architectural and learning roots. More ambiguous distributions require more capacity to be stored, larger embeddings to be represented, more steps to be fitted, and amplify token-sampling noise. We validate these findings on synthetic tasks with controlled ground truth and observe the same signatures in language models trained on real data. Our results provide a new perspective on the statistical capabilities of large language models and a practical framework for when to trust their output distribution.
89. 【2608.15443】Semantic Space of Parts of Speech
链接：https://arxiv.org/abs/2608.15443
作者：Jiří Milička,Ivan Kraus,Arnold Stanovský,Anna Vysloužilová,Barbora Štěpánková,Lenka Fárová,Vojtěch Cink,Šárka Dohnalová
类目：Computation and Language (cs.CL)
关键词：European linguistic tradition, European linguistic, Parts of speech, linguistic tradition, corpus linguistics
备注：
点击查看摘要
Abstract:Parts of speech categorization is understood in the European linguistic tradition as crisp categorization, which is also reflected in corpus linguistics, where each disambiguated token is assigned exactly one POS. However, the assigned categories are largely determined by arbitrary decisions distilled into annotation manuals. Since some words stand between parts of speech in their semantics or typical syntax, and some parts of speech are closer to each other than others, POS categorization seems inherently fuzzy. We analyze this fuzziness using word2vec embeddings, training a neural network to reduce their high dimensionality to three dimensions relevant for determining parts of speech. This creates a three-dimensional space onto which we map several thousand words, revealing which are prototypical and which lie on the boundaries, and visualizing relationships between parts of speech. The study uses Universal Dependencies POS tags for French, Czech, Finnish, Russian, and English.
90. 【2608.15428】Gated Against One Model, Open to the Next: Option-Only Solvability in Legal Multiple-Choice Benchmarks
链接：https://arxiv.org/abs/2608.15428
作者：Volodymyr Ovcharov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Multiple-choice benchmarks, Ukraine Higher Qualification, Higher Qualification Commission, benchmarks are graded, items
备注： 21 pages, 4 figures. Dataset, model predictions and code at [this https URL](https://huggingface.co/datasets/overthelex/ua-judge-exam)
点击查看摘要
Abstract:Multiple-choice benchmarks are graded on whether a model picks the right option, not on whether it needed the question. Measuring that gap takes care: a model answering A to most items scores above chance wherever the key sits at A, and reads as recognition when it is not. We measure it on UA-JudgeExam: 11,990 four-option items with official keys, published by Ukraine's Higher Qualification Commission of Judges. Shown the options and no question, Claude Haiku 4.5 scores 0.383 against chance, and the leak is concentrated: 11.8% of items are answered blind on all eight option orders, against 0.2 items expected by chance. It is not quotation: search over 280,059 editions of Ukrainian legislation recovers 0.128. Gating those out retains 8,128 items, on which the gating model itself now scores 0.204, and GPT-5.6, which took no part in the selection, still answers 0.515 of them with the question hidden. Scoring twelve held-out models on the whole set and subtracting each one's answer-position habit, only two keep an excess: GPT-5.6 at +0.265, Sonnet 4.6 at +0.081. Without it the ranking misleads: Llama 3.1 8B scores 0.292 blind, above every model but those two, purely by answering A to 92% of items. The gate does select something real: on the items it rejected, eleven of twelve models score 0.518-0.789, every interval clear of what the same model scores on the items it kept. But that signal is one model's, and filtering on it does not transfer upward. Neither is visible on a 400-item sample, where nine models read as "statistically at chance". Rewriting distractors instead overshoots to 0.168, below chance and as exploitable. The same probe on LEXam returns chance: every option there points into the stem, none longer than 33 characters. Item format decides whether the problem can arise; capability decides how much is extracted. We release the corpus, the predictions and the harness.
Comments:
21 pages, 4 figures. Dataset, model predictions and code at this https URL
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
Cite as:
arXiv:2608.15428 [cs.CL]
(or
arXiv:2608.15428v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.15428
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
91. 【2608.15396】Large Language Model Assisted Operational Monitoring for Battery Energy Storage System Integrated Power Distribution Networks
链接：https://arxiv.org/abs/2608.15396
作者：Azmeer Akhtar,Md Fazley Rafy,Anurag K. Srivastava
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Systems and Control (eess.SY)
关键词：Battery energy storage, Battery energy, energy storage systems, energy storage, increases the volume
备注：
点击查看摘要
Abstract:Battery energy storage systems (BESS) are increasingly used in distribution networks for voltage regulation and demand response, which increases the volume and complexity of operational telemetry available to grid operators. This paper presents an AI-enabled monitoring framework that connects a large language model (LLM) interface with a structured telemetry database for BESS-integrated distribution system analysis. Operator questions are submitted in natural language and translated into validated SQL queries using predefined database schema information and approved KPI views. Retrieved measurements, including bus voltages, state of charge, active power, and reactive power, are evaluated against engineering constraints for voltage limits, BESS operation, and demand response tracking. The framework is validated using hardware-in-the-loop co-simulation data from a BESS-equipped distribution feeder operating under reactive power-based voltage control and price-driven demand response. Case studies show that the framework generates valid database queries, identifies repeated voltage violations, detects reactive power overshoot, and evaluates active-power tracking performance. The results show that LLM-assisted monitoring can connect structured grid telemetry with automated engineering assessment for BESS operation analysis.
92. 【2608.15394】he Machine's Internal Clock: Do LLMs Share Human Temporal Illusions?
链接：https://arxiv.org/abs/2608.15394
作者：Catherine Bao,Vivek Srikumar
类目：Computation and Language (cs.CL)
关键词：illusions, temporal, tracking elapsed time, Human, time is subjective
备注： 25 pages, 24 figures
点击查看摘要
Abstract:Human perception of time is subjective. Well-documented temporal illusions show that the brain relies on context and relational cues for judging duration instead of tracking elapsed time directly. Prior studies established these effects with visual and auditory stimuli. Existing LLM evaluations of temporal perception focus on estimating event durations or multi-step temporal reasoning. In this work, we investigate whether written narratives alone can evoke human temporal illusions, using a new benchmark of 6,684 narrative pairs spanning five illusions. We find that human readers (60 participants) prefer expected scenarios in only two of the five illusions, those where the manipulation is directly visible in text rather than requiring readers to internally simulate duration. We evaluate 14 LLMs on the same benchmark. Surprisingly, we find that models pick the literature-predicted scenario across four of the five illusions, diverging from human behavior. Reasoning traces show that ~70% of responses explicitly evoke psychology research, suggesting that this alignment is consistent with retrieval of published findings rather than human-like temporal biases.
93. 【2608.15338】When AI Rewrites, Classifiers Relax: Uncertainty-Aware Sentiment Analysis on Sarcastic and AI-Paraphrased Social Text
链接：https://arxiv.org/abs/2608.15338
作者：Shresth Shroff
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：standard evaluations offer, offer little guidance, increasingly applied, regimes where standard, standard evaluations
备注：
点击查看摘要
Abstract:Sentiment classifiers are increasingly applied to social media content that is either sarcastic or AI-generated --- two distributional regimes where standard evaluations offer little guidance. We present a three-part empirical study of sentiment classifier behaviour under these conditions. First, we find that confidence scores on sarcastic text are significantly lower than on non-sarcastic text (Mann--Whitney $p = 2 \times 10^{-6}$), confirming that classifiers sense their own uncertainty on ironic content even without explicit uncertainty modelling. Second, and counterintuitively, we show that sentiment classifiers achieve higher accuracy on AI-paraphrased reviews than on the original human-authored text (RoBERTa: $+5.8$ pp for Qwen3.5-4B paraphrases, $+3.7$ pp for Gemma4-E4B), revealing a cross-domain stylistic alignment effect: AI paraphrases remove distributional noise that confounds Twitter-trained classifiers, producing cleaner, more prototypical sentiment text. Third, we demonstrate that a lightweight abstention wrapper --- flagging the $14\%$ of inputs with confidence below $0.6$ --- improves accuracy from 82.2\% to 88.9\% ($+6.7$ pp) on the retained set. We further compare Semantic Entropy and MC-Dropout-style disagreement as uncertainty signals and find near-identical AUROC ($0.650$ vs.\ $0.646$) on sarcastic text, suggesting that for short social media inputs, both methods are interchangeable. Our results motivate a shift from confident single-label prediction to uncertainty-aware abstention in high-stakes sentiment applications such as mental health flagging and content moderation.
94. 【2608.15325】Logical Embeddings for Argument Analysis
链接：https://arxiv.org/abs/2608.15325
作者：Leander Heldring,Santiago Torres
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：logical embeddings, embeddings, logical, contextualized word embeddings, Kernel Hilbert Spaces
备注：
点击查看摘要
Abstract:We propose a new framework for machine-learning-oriented argument analysis tasks. Our proposal involves replacing traditional contextualized word embeddings used in most NLP tasks with logical embeddings, an alternative encoding that directly exploits argumentation structures. In essence, logical embeddings encapsulate the logical semantics of an argument, allowing for a better representation of its meaning. Supporting these embeddings is a mathematical logic-based similarity measure that offers a transparent notion of proximity and is guaranteed to satisfy several desirable theoretical properties that current cosine similarity-based contextualized word embeddings cannot assure. This similarity measure induces a positive semi-definite kernel on the set of arguments, enabling us to uniquely define logical embeddings using the theory of Reproducing Kernel Hilbert Spaces (RKHS). Moreover, we prove that this encoding is optimal, in the sense that no logical information is lost in the process. As with other RKHS applications, logical embeddings can be used in numerous supervised and unsupervised tasks. We provide an implementation of the method and aim to test it against literature benchmarks. Additionally, we demonstrate that logical embeddings outperform most standard embedding methods on a classification task.
95. 【2608.15323】When Do Concepts Become Functionally Sufficient During Language-Model Training?
链接：https://arxiv.org/abs/2608.15323
作者：Raphael Bernas,Paul G. Chevalier,Fanny Jourdan,Céline Hudelot
类目：Computation and Language (cs.CL)
关键词：depth requires identifying, final state, learning mechanisms, mechanisms in depth, depth requires
备注：
点击查看摘要
Abstract:Understanding a model and its learning mechanisms in depth requires identifying when its internal structures become useful, rather than simply looking at the final state. We study this through concept dynamics: at each layer and checkpoint, we decompose activations, select sparse soft masks, and inject masked reconstructions into the model. Concept analysis is therefore tested functionally: a mask is useful only insofar as it preserves a target under intervention. We compare sufficiency for activation reconstruction, linear decodability, true downstream preservation, and checkpoint transfer under learned alignment. The framework treats decomposition assumptions as hypotheses rather than interpretability guarantees, monitoring functional sufficiency across checkpoints and source-to-final reconstructability under learned alignment. At the shared fixed-penalty operating point across seven models, downstream masks retain substantially less soft mass than reconstruction masks; predictive-distribution shifts remain small.
96. 【2608.15284】VTInstructor: Visual Trajectory Prompting for Navigation Instruction Generation in Continuous Environments
链接：https://arxiv.org/abs/2608.15284
作者：Haolin Yang,Yuxing Long,Zihan Yang,Hao Dong
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：scalable dataset construction, ego-centric RGB video, continuous environments, dataset construction, human-robot interaction
备注： accepted by ACM MM 2026
点击查看摘要
Abstract:Navigation instruction generation from ego-centric RGB video in continuous environments is an important yet challenging task for human-robot interaction and scalable dataset construction. Prior instruction generators assume discrete viewpoint graphs with panoramic observations, where trajectory structure is explicit; in continuous environments, however, the agent receives only a dense RGB stream, making trajectory cues difficult to recover. We propose VTInstructor, the first VLN instruction generation framework for continuous environments. Our key idea is to convert implicit trajectory geometry into explicit visual trajectory prompts: EDTC condenses long RGB trajectories into navigation-critical keyframes, VTP overlays path, turn, and goal cues onto these anchors, VTMod injects the resulting trajectory signals into the visual encoder, and VT-GRPO further calibrates this spatial injection during training, all without requiring a navigation graph, pre-built map, or scene reconstruction. On the challenging R2R-CE and RxR-CE Val Unseen benchmarks, VTInstructor sets a new state of the art across all standard NLG metrics, surpassing the strongest baseline by +0.357 CIDEr and +0.109 CIDEr, respectively. Beyond automatic metrics, VTInstructor-generated instructions raise a frozen follower's success rate to 63.3%, a +14.7 percentage-point gain over the best competing instruction source, and provide consistent data augmentation gains of +3 SR points on downstream navigation tasks.
97. 【2608.15270】me as Structure: Temporal Dependency Graphs for Verifiable Deadline Computation over Legal Documents
链接：https://arxiv.org/abs/2608.15270
作者：Maryia Zhyrko,Lifeng Han,Suzan Verberne
类目：Computation and Language (cs.CL)
关键词：Miss a filing, filing deadline, Employment Appeal Tribunal, Miss, mandatory conciliation window
备注： 13 pages, 2 figures, 5 tables. Preprint
点击查看摘要
Abstract:Miss a filing deadline by one day and the claim is barred, however strong the case. Computing that deadline is rarely simple: the period runs from a triggering event, is counted by a statutory convention, and may be suspended by a mandatory conciliation window. We ask whether a language model should answer such questions directly, or read the document and leave the arithmetic to code. We extract dated facts and their dependencies into a temporal dependency graph and compute deadlines from it with a calendar-correct engine. On UK Employment Appeal Tribunal judgments the engine reproduces six of seven timeliness rulings, and matches the judges' own dates to the day. The strongest of four language models, asked the same cases, gets the arithmetic right and the answer wrong: in six of twenty-one responses its stated verdict contradicts its own thinking, and every contradiction runs the same way, calling a late claim timely. To test the systems at scale we move the dismissal date across the statutory boundary, generating 427 cases whose answers are computed rather than annotated. On the cases both systems answer, the pipeline is right 90.2% of the time against 61.2% for direct answering. The limit is extraction: on contracts the errors are almost never in the arithmetic, but in choosing which event the period starts from.
98. 【2608.15254】Demographic Injection in Medical Language Models under Diversity, Equity, and Inclusion Prompts
链接：https://arxiv.org/abs/2608.15254
作者：Diego Mardian,Frank Liu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：prompting language models, increasingly recommends prompting, recommends prompting language, Clinical-AI guidance increasingly, attention to diversity
备注：
点击查看摘要
Abstract:Clinical-AI guidance increasingly recommends prompting language models to reason with attention to diversity, equity, and inclusion (DEI). We measure a side effect that misrepresents patients: a one-sentence DEI prompt appended to a medical question leads models to add patient demographic attributes (race, socioeconomic status, sex) the question never stated, in effect rewriting who the patient is. We call this demographic injection. Across 47 models, four medical benchmarks, and 376,000 responses scored by a validated model-judge pipeline, a single DEI prompt raises the injection rate from 0.7% to 33.1% (47x) in all 47 of 47 models, attributable to the equity content rather than to added length (18x above a length-matched control; p=1.4x10^-14). Most added content is a general population statement that leaves the answer unchanged, but a smaller subset attaches an attribute to the specific patient or changes the selected option (0.25-2.4% of responses, 99.8% toward the incorrect option), where the invented demographic changes the answer the model recommends. Phrasing scales the effect from 14% to 56%. DEI prompts are just one example of a more general mechanism. Any instruction that nudges how a model reasons can make it add unrequested details, including details about the patient. Flagged outputs are treated as model errors under study, not clinical guidance.
99. 【2608.15223】RACE-BN: Transferring Bangla-English Tutoring Behavior to a Sub-1B Offline Language Model
链接：https://arxiv.org/abs/2608.15223
作者：Khan Raiyan Ibne Reza,Sanjana Aktar Maria,Mohammad Tushar Abdullah,Asfee Bhuiyan Leen,Sumaiya Tabassum Nimi
类目：Computation and Language (cs.CL)
关键词：Bangla-English tutoring requires, producing a correct, Bangla grammar explanations, correct translation, Bangla-English tutoring
备注：
点击查看摘要
Abstract:Bangla-English tutoring requires more than producing a correct translation: learners also need explanations of grammar differences, awareness of their likely errors, and targeted practice. We present TRACE-BN, a curriculum-guided dataset of structured tutoring traces for Bangla-speaking learners of English at the CEFR A1-A2 level. Each trace combines word-level glosses, literal and natural translations, Bangla grammar explanations, a plausible learner error, and a targeted practice question with its answer. The traces are generated by Gemini 3.5 Flash Lite as the teacher model from NCTB Classes 9-10 English curriculum units, then filtered for structural validity, script integrity, and semantic duplication. We transfer the resulting structured tutoring behavior to Qwen3-0.6B using LoRA with 4-bit quantization for resource-constrained offline deployment. On held-out inputs, schema validity increases from 85.4% to 95.8%, while, against teacher-model references, chrF++ improves from 15.28 to 34.77 and BLEU from 4.52 to 21.03. Field-level evaluation by two independent judges shows improvements across translation, grammar explanation, learner-error diagnosis, and practice alignment, while a human audit supports the quality of the supervision data. The results show that curriculum-guided structured supervision can transfer multi-component tutoring behavior to a sub-1B model under these resource constraints. The dataset, model checkpoints, and code are publicly available at this https URL
100. 【2608.15129】Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models
链接：https://arxiv.org/abs/2608.15129
作者：Varvara Arzt,Allan Hanbury,Terra Blevins
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：typologically diverse natural, systematically compare word, word order, compare word order, diverse natural languages
备注： paper under revision
点击查看摘要
Abstract:We systematically compare word order preferences in decoder-only language models across 192 artificial languages and typologically diverse natural languages. On artificial languages, models exhibit a left-branching preference that aligns with neither natural language universals nor human word order learning biases. On natural languages, monolingual models show no clear base word order bias at small scales, but as data grows, a preference for right-branching subject-verb-object (SVO) languages emerges while SOV falls behind despite being the most frequent order cross-linguistically. This SVO advantage extends to multilingual models and correlates with language resource level and data quality rather than word order. Thus, the same architecture exhibits opposite preferences on artificial and natural languages, establishing that word order biases observed in practice are data-driven. Since highly-resourced languages are overwhelmingly SVO, these biases risk gradually reducing word order diversity, particularly in languages that productively use multiple word orders, with the widespread adoption of LLMs.
101. 【2608.15102】A Declarative-Procedural Perspective on Expert Routing in Bilingual Mixture-of-Experts Language Models
链接：https://arxiv.org/abs/2608.15102
作者：Amrit Gopinath(1),Raghul(1),Durairaj Thenmozhi(2) ((1) Sri Sivasubramaniya Nadar College of Engineering, Chennai, India, (2) Shiv Nadar University Chennai, India)
类目：Computation and Language (cs.CL)
关键词：develop linguistically structured, linguistically structured expert, models develop linguistically, structured expert routing, develop linguistically
备注： 15 pages, 6 figures, 12 tables (including appendix)
点击查看摘要
Abstract:We investigate whether Mixture-of-Experts (MoE) language models develop linguistically structured expert routing during bilingual language acquisition. Inspired by the Declarative-Procedural framework, we analyze lexical, grammatical, and syntactic processing in a decoder-only English-German MoE Transformer trained under sequential language exposure. We construct a probe-based validation set and extract token-level routing distributions to quantify category-dependent specialisation using mutual information, routing entropy, and Jensen-Shannon distance. The curriculum-trained model exhibits a peak mutual information of 0.1148 at layer 5, indicating category-dependent differences in routing distributions across linguistic categories. Surprisingly, a no-curriculum baseline trained on mixed English-German data shows stronger aggregate specialisation, reaching a peak mutual information of 0.2599 at the same layer. These results suggest that interpretable linguistic organization emerges within MoE routing patterns even without sequential language exposure. A replication at a second training seed shows that the no-curriculum condition's specialisation concentrates on a single language whose identity is seed-dependent, whereas the curriculum consistently yields a stable, language-balanced routing profile; rather than uniformly increasing specialisation, staged bilingual exposure reduces single-language dominance. The official Github repository: this https URL
102. 【2608.15085】Why Vision Fails as a Universal Bridge: Rectifying Modality Asynchrony in Multilingual MLLMs
链接：https://arxiv.org/abs/2608.15085
作者：Yihang Du,Juhao Liang,Zhengzhao Lai,Siyu Li,Yan Hu
类目：Computation and Language (cs.CL)
关键词：exhibit substantial performance, substantial performance degradation, strong multilingual competence, Multimodal large language, exhibit substantial
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) exhibit substantial performance degradation in non-English visual reasoning, despite the strong multilingual competence of their text-only backbones. While mechanistic evidence from text-only models suggests that non-English inputs are routed through an English-centric latent space, the multimodal implications of this phenomenon remain unexplored. Through rigorous mechanistic analysis, we identify the \textbf{Ghost Anchor} phenomenon: a temporal modality asynchrony where linguistic translation to the English semantic manifold completes in early layers, while visual semanticization remains immature. Consequently, visual signals are physically present yet functionally invisible during the early alignment window. To rectify this, we propose \textbf{ANCHOR}, a training framework employing Proactive Visual Anchoring (PVA) to accelerate early visual semantic emergence, ensuring visual representations proactively guide linguistic translation. Mechanistic interventions confirm that ANCHOR successfully restores the causal influence of visual signals during early translation. Furthermore, extensive experiments on XMMMU, MaXM, and CVQA demonstrate that ANCHOR consistently outperforms standard baselines, achieving robust visual reasoning across both fine-tuned and zero-shot languages.
103. 【2608.15080】A Pilot Study of Autocompleting Tokenizers
链接：https://arxiv.org/abs/2608.15080
作者：Samuel Wexler,Mark Hopkins
类目：Computation and Language (cs.CL)
关键词：Modern input methods, methods routinely rely, Modern input, routinely rely, rely on autocomplete
备注：
点击查看摘要
Abstract:Modern input methods routinely rely on autocomplete to omit information that can be recovered from local context. Inspired by these autocomplete-assisted writing systems, we investigate whether Transformer inputs can be compressed in a similar manner. Byte-level tokenization offers a simple and language-independent alternative to subword tokenization, but its longer input sequences typically result in increased computational cost and reduced model quality. We propose a compression scheme that employs a lightweight autoregressive byte language model to identify and remove bytes that are easily predictable from their surrounding context before Transformer processing. The resulting compressed representation is then provided as input to a standard encoder--decoder Transformer. Experiments on machine translation show that a substantial fraction of source-language bytes can be omitted without degrading translation quality. On English--French, our best method preserves translation performance while reducing source sequence length by nearly one-third. Additional experiments on Finnish--English, Russian--English, and Chinese--English demonstrate that the approach generalizes across diverse writing systems and morphological typologies, yielding comparable or improved translation quality at compression ratios between 0.47 and 0.67. These findings suggest that many input bytes are predictable enough to be represented implicitly rather than explicitly, providing a simple mechanism for reducing the sequence-length overhead associated with byte-level models.
104. 【2608.15071】Evo-Harness: Context-to-Harness Skill Compilation for Self-Evolving Agents
链接：https://arxiv.org/abs/2608.15071
作者：Tianxin Wei,Zhan Shi,Minhua Lin,Bing He,Zewen Liu,Yisi Sang,Yuanchen Bei,Xuying Ning,Jiaru Zou,Ting-Wei Li,Xiao Lin,Yanjun Zhao,Chi Wang,Benoit Dumoulin,Dakuo Wang,Jingrui He,Hanqing Lu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language model, self-improving large language, developing capable, self-improving large, language model
备注：
点击查看摘要
Abstract:Learning from experience is critical for developing capable, self-improving large language model (LLM) agents. Existing methods typically extract knowledge from accumulated trajectories via reflection, memory, rules, or skills. However, agents in realistic environments continuously encounter novel tasks, often offering only a one-shot opportunity to improve. These executions yield rich but highly noisy contexts, entangling broadly useful lessons with task-specific artifacts. Critically, prior works rarely validate their effectiveness on complex real-world tasks or isolate the underlying drivers of improvement. To address these gaps, we formulate online harness learning, where a frozen agent improves by continually updating a structured harness across sequential tasks. This formulation enables a systematic study of key self-improvement factors through our proposed Evo-Harness. At its core, context-to-harness skill compilation distills noisy, single-shot executions into reusable skill harnesses for cross-domain and topic-level adaptation. To demonstrate the efficacy of one-shot skill compilation, we evaluate across five realistic benchmarks (TerminalBench2, SWE-bench, CL-Bench, -bench, WebArena-Infinity). Our extensive analysis demonstrates the effectiveness of Evo-Harness and provides a principled understanding of how LLM agents can effectively learn on the fly. Our code is available at this https URL.
105. 【2608.15062】RecurrentGPT: Expressive Depth through Recurrent Modulation in Transformers
链接：https://arxiv.org/abs/2608.15062
作者：Amr Hegazy,Amr Alanwar,Mostafa Elhoushi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Scaling transformer language, language models creates, Scaling transformer, creates an inherent, inherent tension
备注：
点击查看摘要
Abstract:Scaling transformer language models creates an inherent tension between expressivity and memory efficiency. While unique weights across layers preserve functional specialization---from input-grounding to abstract refinement---they incur a substantial memory footprint. Conversely, standard depth-sharing enforces uniform transformations that collapse representational diversity and degrade modeling quality. We introduce RecurrentGPT, a recurrent depth transformer where fixed-depth prelude and coda blocks bracket a single shared core iterated R times. Inspired by gated recurrent neural networks, we employ a lightweight projection and an elementwise update gate---conditioned on the hidden state, the fixed prelude output, and noise resampled at every step---to modulate the recurrent update. This allows the model to specialize the input to the same few layers across recurrences, rather than requiring many unique layers to achieve functional diversity. Under an isoFLOPS constraint, a 3-layer RecurrentGPT matches the accuracy of a 12-layer GPT-2 Small baseline with similar training and inference FLOPs, and leads MoR and heavy-tail depth sampling in all nine scale-by-budget cells; at medium and large scale it approaches dense quality at the standard token budget and overtakes it at medium scale once that budget is doubled. Under an isoPARAMS constraint, deeper recurrence achieves a 2.76 validation loss versus 2.84 for a non-recurrent counterpart at matched parameter and data budget. Our results demonstrate that adaptive depth reuse is a principled strategy for trading parameters for quality: at large scale, 63% fewer parameters and 59% less peak decoding memory for a 10% increase in compiled generation latency.
106. 【2608.15032】Handoff-H1: An Orchestrated Vision-Agent System for Material Quantity Takeoff from Construction Blueprints
链接：https://arxiv.org/abs/2608.15032
作者：Bruno Chicelli,Henrique Alves,Rodrigo Anselmo,Joshua Weinberg,Felipe Lemos,Jan Baryla
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：requires visual perception, takeoff requires visual, quantity takeoff requires, Construction Blueprint Takeoff, drawing sheets
备注： 15 pages, 7 figures. Evaluation harness available on [this https URL](https://github.com/handoffai/residential-takeoff-benchmark/) . Request data via e-mail to research@handoff.ai
点击查看摘要
Abstract:Converting a set of architectural blueprints into a complete material quantity takeoff requires visual perception across drawing sheets, dimensional and multi-hop reasoning, and grounding in construction conventions that the drawings never state. We present Handoff-H1, a takeoff system built from three layers: purpose-built computer-vision models that extract primitives; tool-using agents equipped with image operations and in-house visual-task tools, including CV-model-backed counting, detection and plan decomposition; and a persistent, hierarchically structured project foundation, grounded in a curated construction knowledge base. We evaluate on the Construction Blueprint Takeoff Benchmark: 10 real residential blueprint sets paired with consensus-validated expert takeoffs - 2,009 verified line items, restricted for scoring to the 1,348 primary-tier materials that drive an estimate - scored per trade by an LLM judge on material coverage and quantity Precision@25% (P@.25) and combined into a weighted composite. Under identical scoring from the raw PDF, seven frontier and open-weight models span composites of 35-61, and independent professional estimators - scored against the same reconciled gold standard - post 77.6% (65.5% coverage, 87.9% P@.25). Handoff-H1, working end-to-end from the raw PDF, reaches 81.6% (86.1% coverage, 78.8% P@.25): roughly 20 points above the strongest frontier agent, and above the independent estimators by pairing near-human quantity precision with coverage they do not reach. The evaluation harness is public for the open harbor framework; the blueprint sets and ground truth are available upon request for research use.
107. 【2608.15022】Gathered, Not Admitted: How Attention Brings a Latent Variable into Verbalizable Form
链接：https://arxiv.org/abs/2608.15022
作者：Parsa Mazaheri
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Language models hold, hold latent quantities, task requires reusing, models hold latent, Language models
备注： 26 pages, 9 figures, 6 tables. Code and data: [this https URL](https://github.com/parsa-mz/innerj)
点击查看摘要
Abstract:Language models hold latent quantities in a form they can report on, and more of a quantity is present in that form when the task requires reusing it flexibly. What causes a representation to enter that form is open, and the word workspace invites an admission story: a gate that decides what gets in. Testing it on open-weight models with Jacobian lenses, over a benchmark whose five arms share an identical context, we find no gate where it predicts one. Demand raises a concept's lens visibility beyond what applying an operator to a supplied value produces: +0.050 [+0.045, +0.057] in percentile rank on our primary checkpoint, positive on all four we measure, though that arm answers at ceiling and the accuracymatched contrast is stronger under that readout. At the same time one shared linear map decodes the variable from every arm, the control included, at 6.4-9.0x its selection-corrected floor. What produces the later readable form at the queried position is attention-mediated gathering inside a mid-depth window: separating patch depth from readout depth puts transport there at least 17x above anywhere shallower under non-saturating readouts, with no tested MLP output contributing positively inside it. Under the saturating percentile rank the same grid does not localise the window, which is a fact about that measure. An arm that needs the variable for nothing concentrates sevenfold less, so the window is demand-specific. That window has two measured edges, a survival failure below and destruction above, and it falls at the same fractional depth in a 64-layer hybrid and a 62-layer dense model from another family. We localise where the variable is installed and read, not the route from the passage, which transports nothing. But the readout is not a calibrated measure of use: three components move it to within 12% of one another and differ 7.4x in what they do to the answer.
108. 【2608.15008】Harness the Memory: A Holistic Evaluation of Memory Substrates in Memory Agents
链接：https://arxiv.org/abs/2608.15008
作者：Wei-Chieh Huang,Weizhi Zhang,Yuchen Wu,Yankai Chen,Eric Hanchen Jiang,Wooseong Yang,Yiwei Yang,Henry Peng Zou,Hanrong Zhang,Ying Nian Wu,Haolun Wu,Kai-Wei Chang,Philip S. Yu,Xue Liu,Aylin Caliskan
类目：Computation and Language (cs.CL)
关键词：existing evaluations offer, evaluations offer limited, long-horizon LLM agents, offer limited guidance, represented and stored
备注：
点击查看摘要
Abstract:Memory is becoming core infrastructure for long-horizon LLM agents, yet existing evaluations offer limited guidance on which memory substrate, namely the underlying medium in which memory is represented and stored, should be used under different operating regimes. We present a controlled harness evaluation of memory substrates for memory-augmented agents, covering dense and sparse indices, text records, structural stores, hierarchical stores, refinement-based memories, parametric updates, and activation-compatible context mechanisms. Across three backbone models and four benchmark suites spanning user-centric question answering and agent-centric decision-making, we instrument 26 performance and efficiency metrics under a unified harness. Our results show that no single substrate consistently dominates: broad retrieval benefits long-context factual QA, while excessive retrieval can harm sequential decision-making by shifting attention away from action-critical context. Scalability introduces a further routing axis, as substrates that perform well at moderate history lengths can become costly or brittle at longer horizons. These findings motivate substrate routing as a necessary component of adaptive agent memory systems and provide empirical guidance for designing efficient, reliable, and regime-aware long-term memory for LLM agents. Code will be made available upon acceptance.
109. 【2608.14999】RamseyGadgets: A Graph Construction Dataset for LLMs
链接：https://arxiv.org/abs/2608.14999
作者：Zohair Raza Hassan,Deepak Pandita
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Constructing special graphs, Constructing special, computer science, theory and computer, Constructing
备注：
点击查看摘要
Abstract:Constructing special graphs is an important task within graph theory and computer science. Many popular graph constructions are the result of a comprehensive exploration of relevant graphs and human ingenuity. Given the rise of generative AI usage in mathematics, it is natural to test whether LLMs are able to construct graphs with specified properties using their reasoning capabilities. Unfortunately, many natural graph construction problems, such as finding extremal Ramsey-good graphs (i.e., avoiding specific monochromatic subgraphs), have been explored extensively in the literature, making it difficult to ascertain whether a construction is the product of an LLM's reasoning capabilities or its recollection from training data. In this work, we introduce \textbf{RamseyGadgets}, a novel dataset of 70 underexplored graph construction problems that require finding Ramsey-good graphs with special properties (e.g., containing an edge with a fixed color). These problems have reasonably sized solutions (at most 10 vertices) that can be verified by SAT solvers, making them suitable for automatic evaluation. Our dataset is easily expandable, as one can simply change the monochromatic subgraphs being avoided to obtain a new set of problems. We evaluate the performance of five open-source LLMs on our dataset and report the results. Our findings show that LLMs achieve only 37.70% accuracy on the hard-tier problems in our dataset, with Gemma-4-31B achieving the highest performance out of the five. We also showcase how our dataset allows us to ascertain what kind of hints help LLMs perform better at this task.
110. 【2608.14992】Does a Tool Result Carry More Authority Than Plain Text? Three Prospective Studies of False-Claim Adoption in a Synthetic Assignment Task with Claude Opus 5
链接：https://arxiv.org/abs/2608.14992
作者：Justin Bronder
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Language-model systems increasingly, systems increasingly read, Language-model systems, return looking retrieved, systems increasingly
备注： 20 pages, 2 figures. Includes two document-preregistered studies, exact prompts, and complete program disclosure
点击查看摘要
Abstract:Language-model systems increasingly read from stores they also write to, so a claim that was merely written earlier can return looking retrieved. We tested whether the message package carrying an unsupported assignment changes which answer a model gives in a synthetic lookup task. Claude Opus 5 selected a color code for a named item or abstained. In an exploratory four-arm study, false-code adoption was 0/24 with no target claim, 0/22 scorable trials when a prior assistant assertion named the target, 14/24 when a tool-result record named it, and 15/24 when that result used a ten-field metadata wrapper that marked it unchecked. The tool-result arm selected the record's code in 11/12 supported trials and 14/24 unsupported trials, ruling out a fixed output-token bias while leaving substantial planted-token heterogeneity. A document-preregistered replication reproduced the tool-result versus assistant-assertion gap, 7/24 against 0/24, one-sided Fisher exact p = 0.0047. The tool-result rate nevertheless fell from 14/24 to 7/24 across runs made four days apart. A second preregistered study gave the earlier comparison a live text control: both records were announced in advance and placed in the same final user turn, then target binding was swapped between the linked tool result and later inline JSON. Inline text was sufficient for false-code adoption in 60/60 trials; the tool-result condition produced 57/60, so the registered result-first superiority criterion failed, p = 1. The result does not show that tool results have no effect. It shows that native tool-result placement was not necessary and that this experiment did not find greater behavioral weight for the result package than for announced inline text. The findings concern a single model on one synthetic task template, accessed through one API.
111. 【2608.14953】-LLM Compiler: Trusted LLM-based Code Optimization and Verification Framework
链接：https://arxiv.org/abs/2608.14953
作者：Zahra Fazel,Sunanda Gamage,Shayan Shirahmad Gale Bagi,Amir H. Ashouri,Tomasz S. Czajkowski,Bryan Chan,Reza Azimi,Yaoqing Gao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Performance (cs.PF); Programming Languages (cs.PL)
关键词：Large Language Models, Language Models, Large Language, apply wide-ranging code, Recent advances
备注：
点击查看摘要
Abstract:Recent advances in Large Language Models (LLMs) have opened opportunities to apply high-level code transformations to the field of code optimization, and it has since emerged as one of the most fundamental tasks for LLMs to perform; however, at present, LLMs struggle to apply wide-ranging code optimization tasks due to both the complexity of the code and the inability to independently verify the correctness of the transformations. In this paper, we present the Trusted LLM (T-LLM) Compiler, which proposes an advancement in compiler technology through a collaborative effort involving high-level LLM code transformations, traditional compilers, and verification tools. Experimental results reveal that it can significantly improve code correctness when tested on a set of PolyBench/C benchmarks. Our approach facilitates iterative code optimization efforts with verification strategies that enable corrective actions. Through this approach, T-LLM Compiler achieves code optimization accuracy of up to 83.3% and a speedup of up to 16.1\% on the PolyBench/C benchmarks, with the transformed code reaching an average of 26.7% speedup wrt standard baselines. Additionally, we release the project's source code to the open-source community.
112. 【2608.14950】DA-RAC: Distance-Aware Calibration of LLM Judges for Trustworthy AI Auditing
链接：https://arxiv.org/abs/2608.14950
作者：Cheng Wu,Vishal Anand,Jaya Krishna Mandivarapu,Xiya Liu,Rui Zhuang
类目：Computation and Language (cs.CL)
关键词：increasingly producing real-world, Generative AI systems, producing real-world artifacts, context-free LLM-scoring, systems are increasingly
备注：
点击查看摘要
Abstract:Generative AI systems are increasingly producing real-world artifacts, however their efficacy and validity are often evaluated via context-free LLM-scoring. These judges can be miscalibrated by irrelevant in-context reference examples, creating false confidence and allowing low-quality or harmful outputs to pass evaluation. We study this failure mode as context-induced miscalibration and introduce DA-RAC, a distance-aware reference-anchored calibration method for LLM judges. DA-RAC retrieves semantically and structurally similar labeled anchors for each judgement scenario, weights them by distance, and exposes neighborhood difficulty as a calibration and triage signal. On multi-run LLM-judge evaluation benchmarks, it improves calibration and reduces false-pass risk relative to zero-shot, chain-of-thought evaluation, and static-anchor baselines. Mechanistic analysis shows that judge scores vary systematically with anchor distance, while static references can induce misleading decision boundaries. Thus LLM-judgement requires not only better models, but also calibrated, auditable reference selection, especially when automated evaluation is used to support high-impact AI generated artifacts. Judgments should be grounded in relevant, inspectable, and contestable interpretive artifacts.
113. 【2608.14945】rust Is Not Enough: Influence Calibration for On-Policy Self-Distillation in Agentic RL
链接：https://arxiv.org/abs/2608.14945
作者：Qizhen Lan,Xi Xiao,Xiangchen Guan,Mengchen Fan,Moule Lin,Jung Im Choi,Lijing Zhu
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：language agents dense, agents dense token-level, dense token-level supervision, On-policy self-distillation, Relative Policy Optimization
备注：
点击查看摘要
Abstract:On-policy self-distillation (OPSD) gives language agents dense token-level supervision from a privileged self-teacher on the policy's own trajectories. Existing methods allocate this supervision mainly by teacher trust, but trust does not reveal whether emphasizing a token supports the current policy objective. We call this the trust-utility mismatch and introduce Influence Calibration for Self-Distillation (ICSD). For each supervised token, ICSD measures the first-order response of its importance-weighted RL surrogate contribution to a teacher-directed output perturbation. Batch-adaptive calibration converts this non-stationary signal into a bounded allocation weight while preserving the original auxiliary-loss mass within each action turn. These detached weights affect only the distillation loss and require no additional model pass. Across ALFWorld, WebShop, and Search-QA, ICSD improves all matched aggregate metrics over trust-only allocation under Group Relative Policy Optimization (GRPO) and Group-in-Group Policy Optimization (GiGPO), across two model families spanning 1.5B to 7B. At 7B, it reaches 96.1% ALFWorld success and a WebShop score of 93.1. Frozen-batch analyses show that ICSD reduces teacher-supported mass assigned to objective-opposed tokens from 60.1% to 37.8% and raises cosine compatibility with the RL gradient by 0.192. A companion repository is avail- able at this https URL.
114. 【2608.14944】SkillComposer: Learning Reusable Skills for Natural-Language Robot Programming
链接：https://arxiv.org/abs/2608.14944
作者：John Woods,Hasti Seifi
类目：Robotics (cs.RO); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：request complex tasks, users request complex, existing systems struggle, interfaces can lower, lower the barrier
备注： 8 pages, 6 figures. Submitted to IEEE Humanoids 2026
点击查看摘要
Abstract:Natural-language interfaces can lower the barrier to programming robots, but existing systems struggle when users request complex tasks. While large language models (LLMs) perform well with simple commands, they often struggle to generate code for multi-step tasks, decompose high-level instructions, or reuse prior solutions. We present SkillComposer, an interactive natural-language robot programming system for simulation environments that continually learns reusable program abstractions. SkillComposer uses a generate-test architecture in which an LLM iteratively generates and revises robot programs before execution. Successful programs are stored and processed by an online library-learning algorithm that compresses recurring function sequences into reusable macro skills for future tasks. We evaluate SkillComposer through ablation experiments and a user study with 12 participants to determine its effectiveness on manipulation and robot caregiving tasks. The results show that evaluator-guided generation and learned abstractions improve success rates and usability while reducing user effort in natural-language robot programming.
115. 【2608.14929】raining Leaves Traces: Centered Residual Signatures for Language Model Lineage Verification
链接：https://arxiv.org/abs/2608.14929
作者：Aman Singh Thakur,Rayan Khoury
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Open-weight language models, model checkpoints share, white-box lineage verification, cs.CL, checkpoints
备注： Preprint
点击查看摘要
Abstract:Open-weight language models are fine-tuned, quantized, pruned, and merged, yet their provenance is often undocumented. We study data-free white-box lineage verification: can weights alone reveal whether two compatible model checkpoints share ancestry? Residual training produces a shared identity-aligned component in branch products, so this structure alone cannot establish ancestry. We remove it and compare checkpoint-specific structure across residual blocks, yielding a symmetric lineage score calibrated against independent checkpoints. On residual-MLP and GPT-2 benchmarks, the score separates fine-tuned, LoRA-merged, pruned, and quantized descendants from independent and distilled models (AUROC=1.0), distinguishing weight ancestry from behavioral similarity. Under function-preserving checkpoint laundering experiments, weight-space baselines lose margin or fail; our score remains unchanged and runs 76x faster than the nearest robust baseline on GPT-2. The projection-pairing signal appears across six language-model families and beyond, and a case study correctly identifies 3 related and 7 unrelated LLaMA-2 public checkpoints. Collectively, these results establish a passive, data-free provenance signal for compatible open-weight language-model checkpoints
Comments:
Preprint
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2608.14929 [cs.CL]
(or
arXiv:2608.14929v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.14929
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
116. 【2608.14927】LLMs Can Predict Failure Risk, But Struggle to Predict Which Collaboration Protocol Pays Off: Cost-Aware Protocol Routing Across Reasoning Tasks
链接：https://arxiv.org/abs/2608.14927
作者：Chih-Hsuan Yang,Jingyan Jiang,Cheng-Hau Yang,Vikram Vasudevan,Huihuo Zheng,Venkatram Vishwanath,Rajeev Thakur
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language model, deployment requires deciding, Multi-agent large language, language model, systems can improve
备注： 23 pages, 6 figures; includes appendices and ancillary aggregate-result CSV files
点击查看摘要
Abstract:Multi-agent large language model (LLM) systems can improve reasoning by spending more computation, but deployment requires deciding when extra collaboration is worth its cost. We isolate this decision by running every problem under four protocols while holding the solver fixed within each setting: direct solving (Baseline), iterative self-correction (Single), planner-executor-reviewer collaboration (PER), and multi-agent deliberation (Broadcast). The primary benchmark comprises 4,181 competition-level math problems; paired robustness checks cover four benchmarks spanning competition math, biology, and broader science with two solver families. Across fixed policies, trained routers, and frozen LLM routers, conservative policies under-escalate, whereas higher-solve frozen routers often over-escalate. A post-answer, pre-collaboration gpt-oss-120b probe ranks Baseline failures with 0.8847 AUROC (4,151 parseable cases; 95% CI [0.8732, 0.8955]). The same score remains informative for predicting whether any collaboration helps (0.7683 AUPRC), but is much weaker for identifying PER- or Broadcast-specific value (0.1674 and 0.1041 AUPRC). Separately, the pre-answer self-confidence gate reaches 78.0% solve at 45K tokens, compared with 73.8% at 71.3K for a frozen gpt-oss-120b router and 92.4% for a retrospective fixed-order oracle. Across 10 paired model-condition settings, the oracle adds 23.2-58.3 points of retrospective coverage over Baseline, but protocol profiles vary by task. In the six settings with held-out router evaluations, oracle gaps remain 18.5-28.9 points. Confidence can therefore support initial escalation, while protocol-specific cost-aware routing remains unresolved.
117. 【2608.14905】How Do Agents Fail on AutoResearch: End-to-End Diagnostic Evaluation on 100 Real-World Frontier Research Tasks
链接：https://arxiv.org/abs/2608.14905
作者：Yanlin Fei,Nazhou Liu,Xinmiao Yu,Shaolong Chen,Lei Li,Rahul Thapa,Madalina Ciobanu,Qingqing Mao,Ritankar Das
类目：Computation and Language (cs.CL)
关键词：final published paper, carry whole-stage research, long assisted scientific, reshaping the landscape, long assisted
备注： *Equal Contribution (alphabetical order by last name)
点击查看摘要
Abstract:AI has long assisted scientific research, but the rapid advance of LLMs and agentic scaffolds is reshaping the landscape; a single system can now carry whole-stage research from an initial hypothesis all the way to final published paper, which is a paradigm now referred to as AutoResearch. Existing evaluations reveal little about how these agents operate or where they break down. Tasks are narrowly-scoped, evaluation measures performance but not process, and failure diagnoses lack systematic coverage or artifact-level visibility. To address this gap, we introduce AutoResearchEval, featuring 100 tasks grounded in published frontier science across 7 scientific domains and the full research lifecycle, including ideation, retrieval, execution, analysis, writing, and review. Evaluating 8 harness-model combinations yields 800 autoresearch agent trajectories, with process-level annotation. We organize these insights into AutoResearch Failure Taxonomy or ARFT, a framework of 45 empirically-grounded failure patterns. To enable scalable fine-grained attribution, we leverage a human-calibrated agent-as-a-judge pipeline to inspect complete trajectories and intermediate artifacts. Failure patterns converge on a single overarching limitation, namely that current agents lack a metacognitive loop, which entails the ability to check what they produced against what they found, revise when it does not hold up, and question whether the path they took was sound. The same patterns recur across all 8 harness-model combinations, including the strongest models tested, locating the deficit at the model level rather than in any particular scaffold; whether orchestration-level interventions can close it is an open question this work does not test. We publicly release AutoResearchEval and ARFT to facilitate continued research and development in autonomous scientific discovery.
118. 【2608.14896】Interpretable Cross-Lingual Alignment in Small Language Models: Probing Cultural and Pragmatic Reasoning in Japanese-English Bilingual LLMs
链接：https://arxiv.org/abs/2608.14896
作者：Florian Braun
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, English and behave, language models work, Large language, behave in poorly
备注： 15 pages, no figures. Introduces the J-PragEval-v0 minimal-pair benchmark
点击查看摘要
Abstract:Large language models work well on English and behave in poorly understood ways on languages typologically far from it. Japanese is a clean example, where evaluation still leans on translation quality and JGLUE-style benchmarks, which roll lexical, syntactic and pragmatic competence into a single score. The phenomena on which general-purpose models fail Japanese users are pragmatic: honorifics, in-group and out-group reference, context-sensitive politeness, zero anaphora. I introduce J-PragEval-v0, a minimal-pair benchmark isolating four such phenomena from surface fluency, and combine it with linear probes and teacher-forced log-probability evaluation to ask where inside TinySwallow-1.5B (28 layers, hidden size 1536) the corresponding contrasts live. The four features split three ways. Honorific register sits cleanly in the residual stream: 0.96 balanced accuracy at layer 15, and the model flips its preferred continuation with the scenario on 93 percent of items. Implicit subject and in-group reference are not linearly decodable at the final prompt token (0.48 and 0.38), yet flip rates are 0.77 and 0.79, so the contrast is worked out during generation rather than stored at the prompt. Indirect refusal is the negative case: 0.95 probe accuracy collapsing to a 0.43 flip rate under length-normalised teacher forcing, because the current minimal pairs conflate politeness with continuation length. I also specify Pragmatic Representation Steering, a parameter-free inference-time method that edits residual-stream activations along the class-mean-difference directions probing identifies. Feasibility is argued indirectly rather than demonstrated: the contrastive activation addition baseline, the same geometry the method would inject, recovers probe accuracy within one to two points of logistic regression wherever a linear signal exists. Scaling to Llama-3.1-Swallow-8B is the next step.
Comments:
15 pages, no figures. Introduces the J-PragEval-v0 minimal-pair benchmark
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
ACMclasses:
I.2.7; I.2.6
Cite as:
arXiv:2608.14896 [cs.CL]
(or
arXiv:2608.14896v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.14896
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
119. 【2608.14886】Where Does Retrieval Fail? Evaluating RAG Architectures for Agricultural Advisory
链接：https://arxiv.org/abs/2608.14886
作者：Khan Raiyan Ibne Reza,Sanjana Aktar Maria,Sumaiya Tabassum Nimi
类目：Computation and Language (cs.CL)
关键词：hide large differences, systems is commonly, hide large, large differences, queries
备注：
点击查看摘要
Abstract:Retrieval quality in RAG systems is commonly reported as a single aggregate score, which can hide large differences across query types and language conditions. We study this problem in Bengali agricultural advisory, where farmer queries are often colloquial while official advisory documents use formal scientific terminology. We construct a test collection of 1,000 queries and 2,882 knowledge nodes extracted from 284 official Bangladeshi agricultural publications, and use it to evaluate five retrieval architectures and six embedding models under three controlled language conditions. The results show that no single retrieval method is consistently best. For native Bengali queries, BM25 is the strongest single retriever (R@10 = 0.506) while Hybrid RRF reaches the highest overall R@10 of 0.539. However, dense retrieval performance varies sharply by query type: R@10 is 0.093 on colloquial farmer queries and 0.970 on formal safety queries. Across language conditions, BM25 R@10 drops from 0.506 on Bengali queries to 0.004 when English queries are matched against the Bengali corpus, while dense retrieval falls only from 0.464 to 0.425. We also find that embedding task configuration and passage length can each change reported R@10 by a factor of seven, independent of architecture. These results show why low-resource RAG evaluation should report performance by language condition and query type rather than relying on aggregate scores alone. The dataset and evaluation scripts are available at this https URL.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.14886 [cs.CL]
(or
arXiv:2608.14886v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.14886
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
120. 【2608.14881】Personalized Auto-Research: Towards a True AI Co-Scientist
链接：https://arxiv.org/abs/2608.14881
作者：Bo Ni,Franck Dernoncourt,Hongjie Chen,Yu Wang,Nesreen K. Ahmed,Zhengzhong Tu,Tyler Derr,Ryan A. Rossi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：retrieve related work, draft full papers, design experiments, execute code, generate hypotheses
备注：
点击查看摘要
Abstract:AI co-scientists that generate hypotheses, retrieve related work, design experiments, execute code, and draft full papers are beginning to change how research is carried out. Despite this rapid progress, state-of-the-art systems remain researcher-agnostic: given a research goal, they optimize novelty, validity, or reviewer score while ignoring the individual scientist who will use the output. This overlooks a fundamental fact about research, namely, that what counts as novel, valuable, or feasible depends on the researcher, including their prior work, methodological repertoire, and the collaborators and communities in which they are embedded. In this work, we introduce the problem of personalized auto-research, which conditions every stage of the research process on a representation of the individual researcher. We argue that personalization is not a convenience layer, but rather the fundamental property that allows an AI system to serve as a genuine co-scientist rather than a generic instrument. To address this problem, we propose a general and flexible framework that threads a graph-grounded researcher context through retrieval, hypothesis search, experimentation, writing, and review. The framework consists of three fundamental components: (i) graph-grounded researcher representations, (ii) personalization across the full research pipeline, and (iii) evaluation grounded in the individual. Notably, we highlight a one-size-fits-all failure mode where distinct researchers issuing the same goal receive essentially the same research, erasing the tacit knowledge through which novel ideas arise. Finally, we discuss fundamental open problems and challenges.
121. 【2608.14876】Workspace Topology as an Attack Vector in Agentic Coding Assistants
链接：https://arxiv.org/abs/2608.14876
作者：Alexandre G.R. Day,Pradeep Yadlapalli,Sriram Venkatapathy,Thomas Paniagua,Nick Raines,Sahil Wadhwa,Himanshu Kumar,Andy Luo,Sudeep Panyam,Rikhiya Ghosh,Pranab Mohanty,Giri Iyengar
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Agentic coding assistants, leveraging third-party code, Agentic coding, attack success rate, quickly ingesting
备注： 15 pages, 10 figures. Preprint of a paper accepted at the Conference on Applied Machine Learning in Information Security (CAMLIS 2026)
点击查看摘要
Abstract:Agentic coding assistants are finding widespread use, not just in new code development but in quickly ingesting and leveraging third-party code. This opens up a risk of malicious code being ingested as these coding tools operate with broad filesystem access inside developer workspaces. In this paper, we extensively study the impact of different dimensions of a novel attack surface we term workspace topology -- defined via directory depth, codebase modularity, in-file injection position and context framing -- on the attack success rate of adversarial prompt injection attempts. We perform an empirical study of indirect prompt injection (IPI) across a diverse set of open-source repositories spanning 10 languages and 6 engineering domains, evaluating three IPI entry points against open-weight models operating open source code harnesses. We find that workspace topology measurably affects IPI success. Specifically, changes in codebase modularity can significantly alter the Attack Success Rate (ASR), with highly modular environments demonstrating significantly lower attack success rates. Furthermore, context framing and introduction of security-cues in the workspace can also alter the ASR. Our findings offer practical value for the evaluation and security testing of coding agents across diverse settings, while underscoring the importance of an uncontaminated testing environment to obtain reliable results and conclusions.
Comments:
15 pages, 10 figures. Preprint of a paper accepted at the Conference on Applied Machine Learning in Information Security (CAMLIS 2026)
Subjects:
Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2608.14876 [cs.CR]
(or
arXiv:2608.14876v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2608.14876
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
122. 【2608.14855】What to Forget in Unlearning? Forget Set Curation for Language Models
链接：https://arxiv.org/abs/2608.14855
作者：Animesh Jha,Arpandeep Khatua,Youssef Allouah,Sanmi Koyejo
类目：Computation and Language (cs.CL)
关键词：Machine unlearning aims, remove targeted data, retraining from scratch, Machine unlearning, aims to remove
备注： Presented at MemFM @ ICML 2026 and FoGen @ ICML 2026
点击查看摘要
Abstract:Machine unlearning aims to remove targeted data or behaviors from a trained model without retraining from scratch. Yet most evaluations assume that the examples to forget are already known. In realistic language-model deployments, a requester may ask a model to stop reproducing a song or book without knowing which spans, documents, quotations, or near-duplicates in a trillion-token corpus support that behavior. We study this missing upstream problem, forget set curation: mapping a suppression request to the data passed to an unlearning algorithm. We introduce CleanSlate, a benchmark for verbatim output suppression over songs and books, with model-specific extraction profiles, content-grounded QA, and capability-retention evaluations. CleanSlate exposes two failure modes. Natural lexical and exact-substring curators often yield forget sets that lead to weak suppression. An evaluation-aware curator suppresses requested continuations almost completely, but causes collateral regression on non-requested content and model-dependent capability loss. These results show that practical unlearning is not only an optimization problem once a forget set is given: the data chosen for forgetting determines both what can be unlearnt and what else is damaged.
123. 【2608.14843】Writing Style Similarity Reflects Academic Genealogy
链接：https://arxiv.org/abs/2608.14843
作者：Cameron Manzo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：increasingly deployed, deployed to detect, detect ghostwritten, ghostwritten and AI-generated, support accusations
备注：
点击查看摘要
Abstract:As authorship attribution systems are increasingly deployed to detect ghostwritten and AI-generated papers, their errors can support accusations against legitimate authors. These systems assume each author's style is their own. Researchers, however, study under advisors, and inherit their stylistic quirks. We build a corpus of arXiv authors with $\geq 2$ solo papers from the Mathematics Genealogy Project graph, giving $5{,}803$ total authors and $2{,}501$ ground-truth advisor-student pairings. Using embeddings from a fine-tuned model, advisors sit $39.9\%$ closer in cosine distance to their students than a random same-field author does. Two open encoders reproduce the effect at $12.6\%$ and $14.5\%$. \emph{Academic siblings}, two students of one advisor who may never have met, sit $30.4\%$ closer across $8{,}360$ pairs, even when they studied at different institutions. Pairs who share only an institution and a field show negligible similarity. Given a closed-set attribution task over the same corpus, the system's errors occur on the true author's advisors and academic siblings $11$ times more often than chance.
124. 【2608.14838】he Recall Trap: A Recall-Maximizing Retriever Configuration Reduces Issue Resolution in Fixed-Budget Code Context
链接：https://arxiv.org/abs/2608.14838
作者：Alexander Adkins,Teimuraz Trapaidze
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：downstream task success, Retrieval components, assumed to follow, success is assumed, retrieval metrics
备注： 24 pages, 2 figures. Reproducibility artifact: Zenodo DOI [https://doi.org/10.5281/zenodo.21879550](https://doi.org/10.5281/zenodo.21879550)
点击查看摘要
Abstract:Retrieval components for code assistants are tuned against retrieval metrics: a configuration that raises recall@k is adopted, and downstream task success is assumed to follow. We report a controlled case study in code repair, not a new phenomenon but a deployed-flag, execution-graded instance of the known relevance-diversity and objective-mismatch tradeoff (Levy et al., 2025). On SWE-bench Verified we inject a retriever's hits as a fixed 12-slot context pack with no search tools and toggle one flag (one-chunk-per-file deduplication) on an otherwise identical stack. The flag is the higher-recall configuration (gold file present in 0.878 of served packs against 0.806 disabled), yet disabling it, trading file breadth for within-file depth, raises the single-shot resolve rate: gpt-5.6-sol +7.6pp (39.2% to 46.8%, n=500, McNemar exact p=0.0003), and a pre-registered open-weights replication any reviewer can re-run (Qwen3.6-27B, +3.6pp, n=499, p=0.0133); both survive repository-clustered inference. The gain tracks within-file anchor dose, and a random-chunk control refutes an argmax-selection artifact. We map where it holds: it reverses on a lexical BM25 retriever (-3.2pp, significant cross-paradigm interaction), is not detected under unrestricted-Read agents (a powered null), and across four languages (SWE-PolyBench, N=617) is positive but not significant (+2.6pp, p=0.056), a mapped boundary rather than a confirmed extension. Operationally, at a tight fixed budget: do not hard-deduplicate by file, and A/B packing policies against the task, not the metric the flag was tuned to.
125. 【2608.14828】MINT: Min-Selection Preference Distillation for Balanced Multi-Objective Alignment
链接：https://arxiv.org/abs/2608.14828
作者：Tony Tu,Sayan Chakraborty,Ruomeng Xu,Tony Qin,Austin Tian
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：persistent failure mode, Aligning a language, support agent learns, preference-based training, combined additively
备注：
点击查看摘要
Abstract:Aligning a language agent to several objectives at once is a persistent failure mode of preference-based training: when objectives are combined additively, optimization collapses onto whichever is cheapest to improve and sacrifices the rest, so a support agent learns to sound warm while giving no real help. The root issue is that an additive reward has no notion of balance. We introduce Mint (MIN-selection preference disTillation), a one-line change to preference distillation: rather than ranking sampled candidates by a weighted sum of rewards, we rank them by their weakest objective, distilling the best-balanced candidate over the most lopsided one with an unchanged DPO objective. This is the p - negative infinity limit of a generalized-mean family spanning additive to worst-case selection. Across cooperative emotional support and adversarial negotiation, min-selection lifts both objectives while sharply cutting their imbalance; on emotional support it raises the weaker axis from 0.37 to 0.64 (p 10^-40), surpassing human experts and persisting across full multi-turn rollouts. A turn-by-turn analysis yields our central finding: min-selection corrects imbalance in proportion to how imbalanced the reference policy is, and its benefit endures over an interaction precisely as long as that imbalance does.
126. 【2608.14813】Beyond the pale: Assessing prevalence and contents of extremist speech in LLM training data
链接：https://arxiv.org/abs/2608.14813
作者：Dmitry Nikolaev,Ashley A. Mattheis
类目：Computation and Language (cs.CL)
关键词：large language models, encounter in pre, drawn much attention, strong interest, topic of trustworthy
备注： Accepted to the CPSS workshop @ KONVENS 2026
点击查看摘要
Abstract:Despite a strong interest on the part of the research community in the topic of trustworthy and safe AI, the composition of the text corpora that large language models (LLMs) encounter in pre- and post-training has not yet drawn much attention. In this work, we address the question of whether LLMs are exposed to unfiltered, uncontextualised extremist speech. Using several definitions of extremist speech, stemming from official documents and research literature, and an extraction pipeline combining automated text processing with expert verification, we provide a lower bound on the prevalence of extremist documents in Dolma, an open training corpus underpinning the OLMo series of models. We show that Dolma is likely to include hundreds of thousands of documents containing extremist content and hate speech of several types, including direct calls for violence, and discuss the implications of this for data curation and model pre-training.
127. 【2608.14808】Do LLMs Know What to Ask and When? Evaluating Multi-Turn Information Seeking
链接：https://arxiv.org/abs/2608.14808
作者：Yepeng Huang,Jiawen Zhang,Michelle Dai,Xiaorui Su,Shanghua Gao,Zi Wang,Marinka Zitnik
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：information, question is underspecified, context is insufficient, missing information, user question
备注：
点击查看摘要
Abstract:When a user question is underspecified, a capable model should recognize that its context is insufficient, identify the missing information, ask for it, and respond only once that information determines a unique answer. We formalize multi-turn information seeking as solving a k-underspecified constraint satisfaction problem, where k is the number of variables jointly required to determine the target and therefore measures the degree of missing information. We instantiate the formulation in MT-InfoSeek, a controlled evaluation suite of 5,251 problems and 9,006 task instances spanning mathematics, logic, biology, medicine, and general knowledge. We evaluate models along three axes: what they ask, when they ask it, and how the acquired information affects the final answer. Performance degrades across models and domains as underspecification increases. Models recognize that additional information is needed but underestimate how much, and in logical problems at k = 2 they under-predict the degree of missing information about four times as often as they over-predict it. They also fail to identify a minimal sufficient set of queries, improve only marginally when given the true k, and often stop before acquiring sufficient information. In tasks with ordered dependencies, an incorrect query order reduces final accuracy even when the model eventually acquires all necessary information. We measure information seeking directly through final sufficiency, which records whether the acquired information determines the target independent of answer generation. This separation shows differences between models that final accuracy alone does not capture, and indicates that the ability to seek information over multiple turns is distinct from the ability to generate answers and is not measured by current LLM evaluations.
128. 【2608.14797】Beyond Tokens: A Survey on Decoding Methods for Large Language and Vision-Language Models
链接：https://arxiv.org/abs/2608.14797
作者：Haoran Wang,Xiongxiao Xu,Philip S. Yu,Kai Shu
类目：Computation and Language (cs.CL)
关键词：impressive generative capabilities, demonstrated impressive generative, Large language models, large vision-language models, Large language
备注： ACM SIGKDD Explorations Newsletter, Volume 28, Issue 1
点击查看摘要
Abstract:Large language models (LLMs) and large vision-language models (LVLMs) have demonstrated impressive generative capabilities, yet ensuring their outputs align with user intent is still challenging. While most existing approaches address this issue at the training stage, inference-time approaches like decoding methods offer a more efficient and scalable solution. Decoding methods control model generation by guiding token-level selection, performing sequence-level generation, or generating tokens in parallel to accelerate the process. In this survey, we identify three emerging paradigms from recent works on decoding methods for LLMs and LVLMs, provide a systematic review of these methods, highlight ongoing challenges, and discuss potential future research directions. Our goal is to underscore the efficiency and effectiveness of decoding methods and offer a practical view of their applications. Paper lists and more resources on decoding methods for LLMs and LVLMs can be found at this https URL.
129. 【2608.14792】Prompting is not enough: supervised baselines and leakage control for measuring shared decision-making with LLMs in pediatric encounters
链接：https://arxiv.org/abs/2608.14792
作者：Bernardo Modenesi,Jody Lin,Kimberly Kaphingst,Angela Zhu,Maya Wheeler,Peilu Zhang,Angela Fagerlin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：detect shared decision-making, real clinical encounters, shared decision-making, detect shared, real clinical
备注：
点击查看摘要
Abstract:Objectives: To determine whether zero-shot prompting of a large language model (LLM) is sufficient to detect shared decision-making (SDM) behaviors in real clinical encounters, and whether supervised learning adds value under patient-grouped, nested evaluation. Methods: We analyzed 21 audio-recorded outpatient surgical decision encounters (19 unique patients; 7,566 utterance segments; ~6.1 hours) between families of children with multiple long-term conditions and their surgical providers. Trained coders labeled segments for 12 SDM behaviors (human-human macro Cohen's kappa = 0.695). We compared a zero-shot local LLM (Qwen 2.5 32B), a supervised classifier over frozen sentence embeddings, and their logistic stack, under patient-grouped outer folds with inner cross-fitted thresholds and patient-resampled confidence intervals. Results: The zero-shot LLM reached macro kappa = 0.139 (95% CI 0.111-0.164). The supervised classifier reached kappa = 0.227 (0.186-0.262), a paired improvement of 0.088 (0.051-0.119). A logistic stack of the two reached kappa = 0.242 (0.198-0.284). We identified multiple corpus-specific leakage paths, including grouping sibling recordings separately and allowing labels from an outer held-out patient to enter few-shot exemplars used while fitting downstream models. Conclusion: Zero-shot prompting alone is not sufficient to measure SDM behavior as reliably as a small supervised model, and patient-level grouping alone does not prevent leakage when labeled prompt exemplars are precomputed outside the outer evaluation loop. Reported performance is sensitive to the unit of data splitting and to where labeled exemplars enter the pipeline. External validation is needed before these findings generalize beyond this population, model, prompt, and codebook.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2608.14792 [cs.CL]
(or
arXiv:2608.14792v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.14792
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Bernardo Modenesi [view email] [v1]
Fri, 14 Aug 2026 18:02:08 UTC (28 KB)
130. 【2608.14787】From Positionwise Confidence to Prefix Scheduling: Verifier Skipping in Speculative Decoding
链接：https://arxiv.org/abs/2608.14787
作者：Haoxuan Luo,Jameson Sandler,Ferdinando Fioretto
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：larger target model, Speculative diffusion decoding, leading technique, technique to reduce, reduce the cost
备注： 14 pages, 6 figures
点击查看摘要
Abstract:Speculative decoding is a leading technique to reduce the cost of autoregressive generation by using a small drafter to propose several tokens, which are then verified in parallel by a larger target model. Speculative diffusion decoding (SDD) further removes sequential drafting by generating every position in a draft block in parallel with a discrete diffusion model. However, SDD still invokes the target on every block, leaving verification as a potential bottleneck. This paper recognizes that this creates a new control handle: whether to invoke the verifier at all. Thus, we study verifier skipping, a lossy policy that commits a selected draft prefix directly, and ask which confidence signal should schedule it. Interestingly, our study finds that better token predictors need not yield better schedulers: skips require contiguous high-confidence prefixes, while short skips can induce additional drafting rounds. To study this mismatch, we compare raw confidence with learned marginal and conditional survival scores under the same policy, using Strict SDD, lenience, and top-$k$ acceptance as baselines. On HumanEval with DiffuCoder-7B-Instruct and Qwen3-32B, all three confidence signals save $9.6\%$ to $13.5\%$ of verifier calls at the same observed pass@1 as Strict SDD. Surprisingly, raw confidence saves the most; marginal survival has higher positionwise AUROC than raw confidence at most positions, yet neither learned signal dominates online. Our analysis shows that verifier skipping is a useful new lossy axis and, surprisingly, its key challenge is prefix scheduling rather than token prediction alone.
131. 【2608.14771】From Errors to Proofs: Minimal-Core-Guided Repair for Neuro-Symbolic Constraint Solving
链接：https://arxiv.org/abs/2608.14771
作者：Dipankar Sarkar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Logic in Computer Science (cs.LO); Programming Languages (cs.PL); Symbolic Computation (cs.SC); Optimization and Control (math.OC)
关键词：Making language models, Making language, language models solve, constraint problems reliably, solver faithfully solve
备注： 7 pages, 2 figures. Accepted at the IJCAI-ECAI 2026 Workshop on Logic and Symbolic Reasoning (LogiSymb), poster
点击查看摘要
Abstract:Making language models solve constraint problems reliably often means having them translate the problem into a formal specification and delegating the search to a sound solver. But the translation is itself a language-model task, and an unfaithful translation makes the solver faithfully solve the wrong problem. Existing pipelines repair only translations that crash, returning the solver's error message and falling silent when the program runs but is wrong. We replace the error message with a proof: when the generated program is unsatisfiable, we extract a minimal unsatisfiable core over the model's own constraints and hand it back the exact set that cannot hold together, a leakage-free signal that localizes the fault. On a new benchmark of 77 problems with an exact oracle, translation to Answer Set Programming is faithful on six of seven domains and fails only on aggregate coverage scheduling, which concentrates the translation tax in one diagnosable pattern. A minimal core, rather than a bare error, is what stops a weaker model from fabricating solutions to infeasible problems, cutting fabrication from 79% to 7%. A strong chain-of-thought baseline meanwhile matches the symbolic route on accuracy, so the route's value is not accuracy but certificates and its refusal to fabricate.
132. 【2608.14767】NARRATE: A Multimodal Real-World Australian Driving Dataset for Human-Centred Explanations in Automated Driving
链接：https://arxiv.org/abs/2608.14767
作者：Ashkan Yousefi Zadeh,Zishuo Zhu,Xiaomeng Li,Andry Rakotonirainy,Sebastien Glaser,Ronald Schroeter,Patricia Delhomme,Zahra Mehraban
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：passengers can understand, vehicles must explain, explain their decisions, Australian driving dataset, Automated vehicles
备注： Accepted at The 19th European Conference on Computer Vision (ECCV 2026) DriveX Workshop (Foundation Models for Autonomous Driving)
点击查看摘要
Abstract:Automated vehicles must explain their decisions in ways that passengers can understand, monitor, and trust. Existing language-annotated driving datasets are mostly observer-written, post-hoc, simulation-based, or generated from sensor inputs, rather than elicited from the driver performing the action. We introduce NARRATE, a multimodal real-world Australian driving dataset comprising 2,050 annotated events from 35 experienced drivers and driving instructors on public roads. Each event is grounded in synchronised visual, localisation, motion, and LiDAR streams and paired with in-vehicle and/or post-drive free-text explanations. NARRATE provides action labels, scenario-context labels spanning six high-level and 32 fine-grained categories, and span-level Situational Awareness (SA) annotations over driver explanations for Perception, Comprehension and Projection. Four benchmark tasks (SA, scenario-context, driver-action classification, and explanation generation) show that this structure is learnable from driver language, while fine-grained context recognition and explanation generation remain challenging. NARRATE paves a path towards more human-centred and domain-aware explanation models for automated driving.
133. 【2608.14737】Class Imbalance and Batch Effects in LLM-Based Screening for Systematic Reviews
链接：https://arxiv.org/abs/2608.14737
作者：Gilberto Sussumu Hida,Danilo Monteiro Ribeiro,Clayton Suguio Hida
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：imbalanced binary classification, study analyses LLMs, binary classification, application domain, study screening
备注： 12 pages, 4 figures. Accepted at ENIAC 2026 (National Meeting on Artificial and Computational Intelligence), part of BRACIS 2026
点击查看摘要
Abstract:This study analyses LLMs in imbalanced binary classification, using study screening in systematic reviews as the application domain. An experiment was conducted in five reviews, comparing individual and batch processing, with and without prevalence metadata. The results indicate a limited influence of the prevalence metadata, with no evidence that it improves performance. In contrast, batch processing produced larger behavioral changes that varied according to the prevalence of the class. The aggregate and item-level analyses did not always coincide. Therefore, batch processing should be evaluated not only in terms of cost, but also in relation to its effects on decision-making behavior.
134. 【2608.14718】VideoGAIA: A Benchmark for General AI Assistants on Agentic Video Understanding
链接：https://arxiv.org/abs/2608.14718
作者：Fan Zhang,Guangming Yao,Jinyang Wu,Hao Wu,Zheng Lian,Xinyu Geng,Jingdong Chen,Yi Yuan,Pheng-Ann Heng
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Video understanding, multimodal large language, large language models, Video, large language
备注：
点击查看摘要
Abstract:Video understanding is a fundamental task for evaluating the capabilities of multimodal large language models (MLLMs). However, existing leading models have already achieved approximately 90% accuracy on the Video-MME leaderboard, suggesting that conventional single-turn video understanding tasks are becoming increasingly saturated and insufficient for assessing the intelligence of advanced MLLMs. Towards this end, we introduce VideoGAIA, an agentic video understanding benchmark for general artificial intelligence (AI) assistants. Moving beyond one-shot video question answering, VideoGAIA formulates video understanding as a multi-turn, tool-augmented interaction process, where models must iteratively perceive videos, invoke external tools, gather complementary information, and integrate multimodal evidence across turns. VideoGAIA contains 271 model-human co-designed tasks covering diverse and complex real-world scenarios. Each video-question-answer instance is independently verified by three human experts to ensure both correctness and appropriate difficulty. All evaluated MLLMs, including frontier models such as GPT-5.5 and Kimi-K3, achieve less than 60% accuracy on VideoGAIA, highlighting its value as a high-quality and timely benchmark for evaluating next-generation MLLMs. We hope that VideoGAIA will facilitate the transition from conventional video understanding toward agentic video understanding.
135. 【2608.14712】Which Question Is Your Attention Metric Answering? Attention Rows as Compositional Data
链接：https://arxiv.org/abs/2608.14712
作者：Marios Papamichalis,Regina Ruane
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Statistics Theory (math.ST)
关键词：probability distribution, probability lands, transformer attention matrix, comparing attention rows, attention matrix
备注： Preprint under submission
点击查看摘要
Abstract:Each row of a transformer's attention matrix is a probability distribution over tokens, and in trained models most of that probability lands on a single \emph{sink} token, usually the first. Standard tools for comparing attention rows (cosine similarity, Jensen--Shannon divergence, Shannon entropy) therefore hinge on a choice papers rarely report: keep the sink, or drop it and renormalize. This choice can reverse conclusions. On ten pretrained models from five families, 17--47% of verdicts about which of two heads is more similar flip with the convention, and the most prominent structure in a standard BERT head-clustering pipeline is an artifact of it. The reason is that one-number summaries mix two questions: how much attention the sink takes, and how the rest is divided among the content tokens. Treating rows as compositional data separates them exactly: the Aitchison distance splits orthogonally into a sink term and a content term, entropy splits by an exact identity, and the content distance is characterized by invariances the transformer itself possesses. The separation matters in practice: most measured entropy collapse during training is the sink growing, not attention sharpening (30% of the drop at 70M parameters, 95% at 1B, 79% at 1.4B), and pruning heads with the wrong channel can inflate perplexity more than a hundredfold. We map where each convention is safe, test a frozen out-of-sample predictor (one confirmation, one abstention, one failure), and release code regenerating every number.
136. 【2608.14710】Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomics
链接：https://arxiv.org/abs/2608.14710
作者：Ruochen Liu,Wei Lou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Predicting spatial gene, stained images offers, Predicting spatial, spatial gene expression, hematoxylin and eosin
备注：
点击查看摘要
Abstract:Predicting spatial gene expression from hematoxylin and eosin (H\E)-stained images offers a cost-effective alternative to spatial transcriptomics (ST). However, existing methods treat H\E images as generic visual inputs and ignore their intrinsic biological hierarchy, where spatially organized cell types collectively form functional tissue microenvironments that govern local gene expression programs. To bridge this gap, we formulate H\E-to-ST prediction as a cross-modal semantic translation task and propose Path2ST, a hierarchically grounded autoregressive framework featuring three key components: (i) a Hierarchical Cell-Tissue Conditioning mechanism that fuses explicit and implicit cellular features with tissue-level semantic representations to construct hierarchical conditioning signals; (ii) a Scale-Adaptive Autoregressive Generation process over a hierarchical semantic vocabulary, enabling coarse-to-fine, biologically consistent expression synthesis; and (iii) SpectraLoss, a full-spectrum objective that jointly enforces ordinal fidelity, models transcriptional bursts, and aligns semantic structures with cell types. Extensive experiments on three datasets demonstrate state-of-the-art performance, validating that Path2ST generates highly accurate and spatially coherent transcriptomic profiles. The related code is released at this https URL.
137. 【2608.14693】Domain Agnostic Text Redaction from Natural Language Rules using Instruction Tuning
链接：https://arxiv.org/abs/2608.14693
作者：Aravindhan Arunagiri,Ayaan Khan,Udayaadithya Avadhanam,SaiBarath Sundar
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Personal Identifiable Information, compliance frameworks, Personal Identifiable, increasing digitization, crucial component
备注：
点击查看摘要
Abstract:With the increasing digitization of personal and corporate communication, the automatic sanitization of textual data has become a crucial component of data privacy and compliance frameworks. Traditional text sanitization solutions are majorly suitable for obscuring sensitive data with standard structure such as Personal Identifiable Information (PII). These solutions do not provide transparent justification for their redaction, which makes it difficult to audit them. This paper introduces an explainable, domain-agnostic text redaction solution that uses natural language rules of redaction, applied via an instruction-tuned language model, to identify and redact sensitive information in unstructured documents. Unlike traditional text sanitization, this method enables a user to conveniently define any sensitive information; which may be structured (e.g.\ PII) or unstructured (e.g.\ legal terms and conditions) in natural language. A general-purpose LLM generates or augments these natural language rules of redaction from the user's definition, which are then used to instruction-fine-tune a smaller language model that reasons the rules step-by-step over any given document to identify and redact the corresponding sensitive content, while providing transparent justifications for each redaction and highlighting the specific rule that triggered the decision. This explanation is generated in natural language to support human reviewers and auditors in understanding why specific content was redacted. A reconstruction-based metric is used to estimate the probability of recovering redacted information from the sanitized document, quantifying redaction coverage. The solution shows high reconstruction error and high redaction precision, making it suitable for automated text sanitization in critical applications such as legal discovery, medical documentation, and corporate information governance.
138. 【2608.14681】Automatic or Controlled? Repetition Priming Reveals Divergent Processing in Base LLMs, Instruct LLMs, and Humans
链接：https://arxiv.org/abs/2608.14681
作者：Jinglei Ren,Yuyue Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Words recur constantly, repeated words afresh, re-evaluate repeated words, words afresh, reactivate prior representations
备注：
点击查看摘要
Abstract:Words recur constantly in natural language use, yet it remains unclear whether language models reactivate prior representations or re-evaluate repeated words afresh, and whether post-training changes this default behavior. We apply repetition priming (Shiffrin and Schneider, 1977) to 15 models across five model families (1.5B-14B parameters) in two tasks, semantic categorization and cloze completion, with matched human experiments using identical stimuli. We find that base models exhibit automatic processing: they show immediate facilitation that remains stable across lags, partially survives context removal, and correlates with attention to prior occurrences. Instruct models exhibit controlled processing: their facilitation decays with lag, collapses without expected context, and reverses to interference at larger scales. Within the Qwen 2.5 family, this dissociation increases monotonically with model scale, suggesting that post-training progressively alters repetition processing. Humans show a hybrid profile, with lag-sensitive facilitation resembling instruct models but without interference, suggesting that neither model type fully captures human cognition. Our findings reveal a qualitative shift in how language models process repeated information after post-training and provide mechanistic evidence for the divergence between model behaviors.
139. 【2608.14658】pico-type: A 1.5M-Parameter Byte-Level Multi-Head Content Classifier
链接：https://arxiv.org/abs/2608.14658
作者：Gautam Kishore
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：single forward pass, byte-level multi-head content, multi-head content classifier, classifier with approximately, million parameters
备注： 14 pages, 1 figure, 8 tables
点击查看摘要
Abstract:We introduce pico-type, a byte-level multi-head content classifier with approximately 1.5 million parameters that simultaneously predicts seven content properties from raw UTF-8 bytes in a single forward pass. Operating directly at the byte level -- no tokenizer, no subword vocabulary, no pretrained embeddings -- pico-type classifies coarse type (12 classes), modality (8), subtype (24), code language (62), text language (30), file MIME type (90), and risk flags (6-label multi-label: API keys, JWTs, passwords, emails, phone numbers, SSH keys). The architecture combines a learned byte embedding, three convolutional blocks with growing receptive fields, two bidirectional attention layers with rotary position encodings, and a statistical pooling layer feeding seven Matryoshka-style classification heads. Four tiered variants (tiny/small/base/pro) share the same trunk with sliced representations from 16 to 576 dimensions, yielding ONNX exports under 210 KB and CPU inference under 10 ms. Trained on a mixture of synthetic templates and real-world data (8709 GitHub code samples, 5000 Wikipedia articles), pico-type achieves 60.3 percent code language accuracy on The Heap benchmark (24 languages) and 98.2 percent text language accuracy on Wikipedia (30 languages) -- improvements of +57 and +79 percentage points respectively over the synthetic-only baseline. Format-based heads (coarse, modality, subtype, file_mime, risk) maintain 100 percent accuracy on synthetic benchmarks. The model, code, and pretrained weights are released under Apache 2.0.
140. 【2608.14644】DUET: Dual-Teacher On-Policy Distillation via Same-Weight Disagreement for Prohibition Compliance
链接：https://arxiv.org/abs/2608.14644
作者：Zihan Li,Feifei Li,Wenhui Que
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Real-world LLM deployments, LLM deployments increasingly, Real-world LLM, deployments increasingly rely, PII redlines
备注：
点击查看摘要
Abstract:Real-world LLM deployments increasingly rely on runtime-injected prohibitions--enterprise policies, PII redlines, tool boundaries--that vary per request and per tenant. Conventional post-training is structurally ill-suited: SFT hides the violation signal in compliant labels, and DPO's sequence-level preferences mismatch token-localized violations. We propose DUET, a token-selective on-policy distillation method for prohibition compliance. DUET pairs a teacher that sees the prohibition (positive) with an identical-weight teacher that does not (negative). Because the two teachers differ only in prohibition visibility, their per-token disagreement isolates the prohibition's causal effect--yielding a clean supervision signal uncontaminated by model capacity or mismatch. This disagreement drives two complementary mechanisms: signal cleaning, which discards agreement tokens as redundant or prefix-corrupted, and preference-directed learning, which pushes the student away from the negative teacher and toward the positive one at token granularity, embedding DPO-style optimization directly into OPD without offline preference data. We construct an industrial Prohibition-Compliance benchmark spanning five task families covering explicit-refusal, paraphrase robustness, and over-refusal. Across 1.5B-8B Qwen variants, DUET achieves 72.3-85.2% violation compliance while preserving 88-93% normal utility, dramatically outperforming teacher model and other distillation baselines. External evaluation on SysBench confirms improved safety alignment with minimal degradation on GSM8K and MATH-500.
141. 【2608.14639】Valid Per-Field Selective Risk Control for Document Extraction: Three Failure Modes, a Validity Ladder, and When Conditioning Pays
链接：https://arxiv.org/abs/2608.14639
作者：Bhaskar Gurram
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：trust contract document-extraction, contract document-extraction systems, Per-field accept, natural procedure silently, procedure silently violates
备注： 14 pages. Seed-pinned, regression-gated harness (Apache-2.0): [this https URL](https://github.com/bhaskargurram-ai/verifydoc) . Companion benchmark paper: VerifyDocBench
点击查看摘要
Abstract:Per-field accept/review with selective risk at most alpha -- accept a field only if the error rate among accepted fields is controlled -- is the trust contract document-extraction systems need, and the natural procedure silently violates it on real documents. On 13,859 genuine claude-sonnet-5 fields from 800 CORD receipts (49.0% correct) we diagnose three failure modes: document clustering (design effect 1.84-2.45), score-refit leakage (coverage 0.416 at risk 0.127, violating alpha=0.10 in 95% of splits), and a tie-mass pathology (a degenerate score collapses the threshold grid, 0.030 to 0.001). We organize the fixes as a validity ladder, guarantee form stated per tier. A fit/val split protocol restores expected-selective-risk control for a learned fusion: coverage 0.318 at risk 0.096 at nominal alpha=0.10, no tolerance band (production variant 0.326) -- an on-average point whose realized risk exceeds alpha in 47.5% of resplits, not a certificate. Mondrian Learn-then-Test with exact binomial tails yields per-group PAC certificates: field-iid 0.171 at risk 0.068, cluster-corrected 0.140, doc-iid 0.060 -- the only tier matching documents, honestly near-vacuous today. Support-bin, the pre-specified provenance taxonomy, wins every rigor tier on the sonnet CORD capture (p1e-4, Bonferroni-corrected) -- a win that does not replicate on the same documents under haiku or qwen -- while on higher-accuracy corpora pooled thresholds win: conditioning helps exactly where pooled cannot certify, subsumed by a learned score elsewhere. A frozen-configuration confirmation on selection-untouched claude-haiku-4-5 held at both risk levels, and a blind three-annotator human-gold audit verifies the practical tier's accepted-set risk at 1.3% against its 10% budget (Fleiss' kappa=0.83; labels err one-sidedly pessimistic). Released Apache-2.0 with seed-pinned, regression-gated procedures.
142. 【2608.14632】DeMTS: Denoising Trajectories as Multivariate Time Series for Hallucination Detection in Diffusion Language Models
链接：https://arxiv.org/abs/2608.14632
作者：Xin Zhang,Yili Wang,Yue Tan,Xin He,Yanyu Qian,Yixin Liu,Yi Chang,Shirui Pan,Xin Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Diffusion large language, large language models, Diffusion large, language models, text generation
备注：
点击查看摘要
Abstract:Diffusion large language models (D-LLMs) have emerged as a promising paradigm for text generation. However, similar to autoregressive LLMs, D-LLMs remain vulnerable to hallucinations, where fluent outputs may contain factually incorrect or unsupported content. Although existing hallucination detection methods for D-LLMs attempt to leverage uncertainty trajectories of the denoising process to better identify hallucination signals, they typically compress the trajectories along either the temporal or token dimension, overlooking the useful information encoded in the complete two-dimensional token-step structure. Consequently, they may fail to capture hallucination-relevant patterns, such as inconsistent convergence and cross-token fault propagation, leading to suboptimal detection performance. To bridge this gap, we propose a D-LLM hallucination detection framework that formulates the Denoising trajectories as Multivariate Time Series over learnable latent variables (DeMTS for short). DeMTS employs a trajectory-preserving token-to-variable assignment module to convert token signals into stable latent variables. Based on these variables, we propose dynamic multivariate temporal modeling to progressively integrate inter-variable dependency modeling with temporal encoding for hallucination prediction. Extensive experiments on two D-LLMs backbones and three benchmarks demonstrate that DeMTS outperforms existing hallucination detection methods while maintaining strong robustness, efficiency, and cross-task transferability.
143. 【2608.14630】Characterizing Rhetorical Misalignment in Decision-Making with Language Models
链接：https://arxiv.org/abs/2608.14630
作者：Zirui Cheng,Joey Chan,Simo Du,Chenhao Tan,Yue Guo,Hao Peng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：well-documented cognitive biases, range of well-documented, Medical Licensing Examination, United States Medical, States Medical Licensing
备注：
点击查看摘要
Abstract:Human decision-making is often shaped by a range of well-documented cognitive biases. As large language models (LLMs) become increasingly integrated into high-stakes human-AI decision-making, it is important to understand whether their outputs can amplify potential biases, how this influences human decisions, and crucially, whether it can lead to harmful consequences. In this work, we develop a decision-theoretic framework to study rhetorical misalignment, a failure mode where an LLM uses rhetorically inappropriate forms of presentation for a given decision context, thereby inducing suboptimal human decisions. We empirically investigate this phenomenon through a human-subject experiment in realistic clinical decision-making using a dataset curated from the United States Medical Licensing Examination. By measuring how LLM-generated information affects decisions, we observe that LLMs induce an average 2.81% rate of harmful decision flips across different models, where clinician participants change from a correct to an incorrect answer. Rationales reported by participants provide evidence that these revisions are closely related to the language used by LLMs that may induce different types of cognitive biases, including anchoring, authority bias, and loss aversion. To enable scalable evaluation, we instantiate our theoretical framework using decision-makers simulated by LLMs to computationally measure rhetorical misalignment. Our findings reveal a safety concern previously unrecognized in high-stakes domains: a model can be factually aligned yet still induce harm through its rhetorical presentation.
144. 【2608.14629】Inference-Time Mitigation of Adversarial Political Bias in Large Language Models
链接：https://arxiv.org/abs/2608.14629
作者：Tejaswi V. Panchagnula,Bruce Coburn,Bryce J. Dietrich,Robert X. Browning,Edward J. Delp,Fengqing Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：trustworthy Artificial Intelligence, Large Language Models, Artificial Intelligence, Large Language, trustworthy Artificial
备注：
点击查看摘要
Abstract:As Large Language Models (LLMs) become the mainstay for information retrieval and summarization tasks, ensuring that they are always non-partisan and invulnerable to political bias is a critical step towards safer and more trustworthy Artificial Intelligence (AI). Current model alignment paradigms, such as reinforcement learning from human feedback (RLHF), make LLMs follow overarching safety instructions. However, this instruction tuning can be exploited via adversarial prompt injection and be used to generate unsafe content. In particular, political bias has not been specifically targeted by modern alignment techniques as harmful and biased content. To address this vulnerability of LLMs, we propose mitigation strategies using Chain of Thought (CoT) prompting and Direct Preference Optimization (DPO). Using a public dataset of legislative videos, we generate summaries using LLMs, inject bias via adversarial prompting and evaluate their performance on a four axis scale designed for political summarization. In this paper, we present different methods to shield LLMs against the injection of political bias. Our results demonstrate that the proposed Recursive Self-Correction approach raises model performance from a Political Neutrality Likert scale baseline of 2.14 to 4.56, averaged across all models, demonstrating effective inference-time mitigation of political bias in LLM-generated summaries.
145. 【2608.14626】LLM Safety Alignment in Low-Resource Languages: A Systematic Literature Review
链接：https://arxiv.org/abs/2608.14626
作者：Valdini Douglace Lemofouet,Blessing Ngozi Uzor,Paula Chikaodinaka Anyanwu,Danielle Blanche Kapsa,Sukairaj Hafiz Imam,P Sam Sahil,Abigail Oppong,Tassallah Abdullahi,Clemencia Siro,Idris Abdulmumin,Seid Muhie Yimam,Shamsuddeen Hassan Muhammad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：guarantees remain significantly, remain significantly weaker, Large Language Models, Large Language, safety guarantees remain
备注： The paper was accepted at LM4UC workshop organize by IJCAI. I added a screenshot of the decision (Open Review)
点击查看摘要
Abstract:Large Language Models (LLMs) have achieved substantial progress in safety alignment, yet their safety guarantees remain significantly weaker in low-resource and multilingual settings than in high-resource languages. In this paper, we conduct a Systematic Literature Review (SLR) of LLM safety alignment in low-resource languages by adopting the PRISMA 2020 methodology. Out of roughly 1,500 papers identified from Semantic Scholar, arXiv, and OpenAlex, 50 relevant studies have been selected and analyzed. Our review is organized around four themes: safety alignment methods, multilingual safety risks, evaluation benchmarks, and cross-lingual transferability. We further propose a taxonomy of safety alignment approaches based on three adaptation mechanisms: data adaptation, objective optimization, and mechanistic alignment. Across literature, translated English benchmarks fail to sufficiently represent culturally rooted harms, and multilingual models are more vulnerable to cross-lingual jailbreaks, code-switching attacks, and safety degradation in underrepresented languages. These failures are driven by several key factors, including uneven multilingual pre-training coverage, insufficient native-language preference data, poor transfer of safety representations, and a lack of culturally aware evaluation frameworks. The review also notes that many low-resource languages, especially African languages, have fewer safety benchmarks available than other multilingual regions. Overall, the results reveal a persistent multilingual safety gap, and suggest that future progress will require culturally grounded benchmarks, participatory data collection, balanced multilingual pre-training, and scalable multilingual alignment methods.
146. 【2608.14621】AutoMem: A Text-Gradient Recursive Self-Improvement Framework for Automated Memory Architectures Search
链接：https://arxiv.org/abs/2608.14621
作者：Lin Du,Jie Zhou,Yuxuan Cai,Kai Chen,Qin Chen,Xin Li,Bo Zhang,Wei Li,Liang He
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：coupled architecture problem, memory design remains, highly coupled architecture, Long-term memory, increasingly central
备注：
点击查看摘要
Abstract:Long-term memory is increasingly central to LLM agents, yet memory design remains a highly coupled architecture problem: what to encode, how to store it, how to retrieve it, and how to manage it can vary substantially across tasks and backbone models. We construct a discrete search space with 5 encoders, 5 stores, 6 retrievers, and 4 managers, and show that no single memory architecture consistently dominates: different tasks favor different module combinations, leading to substantial performance gaps. Motivated by this, we propose \textsc{AutoMem}, a text-gradient recursive self-improvement framework for task-adaptive memory architecture search. \textsc{AutoMem} optimizes over the factored space through two components: Experience-Guided Architecture Search, which proposes candidate architectures from historical search trajectories and accumulated reflections, and Failure-Guided Module Diagnosis, which localizes memory-related failures to specific modules and converts them into targeted textual feedback. Experiments on GAIA, WebWalkerQA, and xBench-DeepSearch across two LLM backbones show that \textsc{AutoMem} consistently discovers task-adaptive memory architectures that outperform the strongest human-designed memory baselines, improving accuracy by $2.8$ points on average across six benchmark-backbone settings. Further analysis shows that \textsc{AutoMem} achieves a favorable accuracy-efficiency trade-off, reducing token cost by $14.3\%$ over the strongest accuracy baselines under Qwen3.5-122B-A10B, while also finding stronger architectures than substantially larger random searches within only a few guided iterations.
147. 【2608.14617】Calibrated Trust, Not Sharper Prediction: An Empirical Test of Uncertainty Fusion
链接：https://arxiv.org/abs/2608.14617
作者：Surya Saka
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：sequential Bayesian odds, Bayesian odds updating, fusing uncertainty tools, sequential Bayesian, Bayesian odds
备注： 12 pages, 10 figures
点击查看摘要
Abstract:A recurring proposal in legal AI is to improve case-outcome prediction by fusing uncertainty tools (evidence graphs with belief propagation, sequential Bayesian odds updating, Dempster-Shafer combination, and conformal prediction) into one pipeline. We test this on 1,000 real European Court of Human Rights cases from LexGLUE and FairLex, predicting whether the Court found a Convention violation from the case's fact paragraphs. We compare three families across two frontier LLMs (Claude Opus 4.8 and GPT-5.5) as per-fact evidence estimators: (A) the raw LLM, (B) the LLM routed through the fusion pipeline, and (C) a term-frequency baseline through the same pipeline. Across roughly 4,750 tests we find: (1) on discrimination (AUROC around 0.83) the pipeline yields no improvement over either the raw LLM or the baseline; a frontier LLM used directly is the strongest single discriminator. (2) Naively composing an LLM with Bayesian-odds and Dempster-Shafer fusion more than doubles calibration error (ECE from about 0.16 to 0.46) via a prior-mismatch mechanism that replicates across both models. (3) Dempster-Shafer fusion is actively unsafe on long chains, committing confidently to wrong labels at below-chance accuracy; we recommend removing it. (4) The pipeline's genuine value is operational: routed through a conformal selective-prediction layer, the system decides which cases to automate and which to escalate. After removing Dempster-Shafer, recalibrating, and applying class-conditional risk control on the full 1,000-case set, the tuned engine auto-clears at 96.8 percent accuracy with 0.5 percent errors escaping and 96.3 percent caught for review, versus 85.9 / 3.8 / 72.1 for an untuned baseline. The contribution of such pipelines in law is calibrated trust, not sharper prediction.
148. 【2608.14606】Plausible but Not Valid: A Psychometric Audit of LLMs as Synthetic Survey Respondents
链接：https://arxiv.org/abs/2608.14606
作者：Mantas Lukauskas,Viktorija Šarkauskaitė
类目：Computers and Society (cs.CY); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Applications (stat.AP)
关键词：Large language models, Large language, synthetic survey respondents, individual level, human survey data
备注： 50 pages, 9 figures. Under review. Code and data will be released upon publication
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used as synthetic survey respondents, but existing evaluations ask whether answers look plausible at the individual level. We argue the right question is psychometric: do LLMs preserve the joint distribution, latent structure, reliability, mediation pathways, and demographic effects of real human survey data? We introduce a Lithuanian organisational-psychology dataset (n=263 employees; Dunham Attitudes Toward Change, UWES-17, Koopmans IWPQ; 68 items, 12 subscales) and condition a 37-model lineup spanning OpenAI, Anthropic, Google, and twelve open-weight families on real respondent profiles under a five-level persona-disclosure ladder, presentation and reasoning-effort ablations, counterfactual demographic swaps (gender, role, education), a cross-language check, and a verbatim-recall memorization probe. The resulting Psychometric Similarity Score (PSS) is anchored against five non-LLM statistical baselines and a held-out human-vs-human ceiling, with respondent-bootstrap confidence intervals and an item-permutation null for Tucker's phi. LLMs reproduce the qualitative direction of human psychometric relationships, but a Gaussian-copula baseline beats every LLM on the sample-driven PSS components; the LLM "crowd" is more similar to itself (mean inter-LLM PSS 0.73) than to humans; and memorization does not drive the leaderboard (recall-PSS rank correlation 0.00). Counterfactual swaps reveal education-driven effects (mean |d|=0.56) that dwarf gender (0.12) and role (0.18); Tucker's phi on UWES falls inside the permutation null for 8 of 37 models. Downstream, every LLM shows a strong acquiescence shift (+0.84 SD), synthetic-trained regressors lose predictive validity on held-out humans (mean R^2 -0.18 vs 0.28), and models fabricate indirect effects on 3 of 10 placebo mediation paths. LLM samples are not a drop-in replacement for human survey data.
149. 【2608.14604】Wiola 13M, a Gated Spiral Attention Architecture for Parameter Efficient Small Language Models
链接：https://arxiv.org/abs/2608.14604
作者：Aryuemaan Kumar Chowdhury,Praveen Oosa,Vineesha Reddy
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：small scale regime, controlled scientific study, Small language models, hundred million parameter, small scale
备注： 6
点击查看摘要
Abstract:Small language models in the ten to one hundred million parameter range are attractive for on device inference, rapid experimentation, and controlled scientific study, yet most of them reuse the standard transformer block without adaptation to the small scale regime. We present Wiola, a decoder only language model whose novelty is concentrated in three drop in components of every layer. First, Spiral Rotary Positional Encoding perturbs the standard rotary frequencies by a slowly growing per dimension factor so that phase trajectories fan outward, improving long range discrimination while adding no parameters. Second, Gated Spiral Attention introduces a per head, content adaptive scalar gate derived from a causal cumulative statistic of the query stream, providing an implicit and differentiable form of soft head selection at negligible cost. Third, the Butterfly feed forward block replaces the conventional expansion layer with a multiplicative interaction and an intra block bypass path, matching the parameter count of a four times gated linear unit block while improving gradient flow in shallow stacks. We formalize each component, derive exact parameter and computation budgets, and prove that the gated attention admits an exact and numerically verified equivalence between full sequence training and cached autoregressive decoding, so that no approximation is introduced at inference time. We also describe a fully reproducible training and evaluation protocol on a standard tiny story corpus. The reference implementation is released as an open source package with weights ready publishing support.
150. 【2608.14588】he Hallucination Snowball: Modeling Error Propagation as State Transitions in Multi-Agent LLM Pipelines
链接：https://arxiv.org/abs/2608.14588
作者：Prabhjot Singh,Bhushan Pawar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Sequential multi-agent LLM, multi-agent LLM pipelines, LLM pipelines chain, Sequential multi-agent, multi-agent LLM
备注： 10 pages, 3 figures; accepted at the FAGEN Workshop (Failure Modes in Agentic AI), ICML 2026
点击查看摘要
Abstract:Sequential multi-agent LLM pipelines chain specialized agents without verification at handoffs, creating a structural flaw with measurable and severe consequences. We show that hallucinations injected at Stage 1 do not merely persist; they transform: raw numerical facts become derived computations, then narrative prose, then editorially approved conclusions. At each transformation, detectability degrades near-irreversibly. We formalize this as the hallucination snowball effect, a first-order Markov process over four states (Raw Fact $\to$ Derived $\to$ Narrative $\to$ Invisible) with empirically measured per-boundary escape probabilities of 24.6%, 48.3%, and 89.3%. Across 346 automatically injected hallucinations in a 4-agent financial analysis pipeline on FinanceBench, gpt-4o detection drops from 72.0% at Stage 1 to 50.9% at Stage 4, and 23.7% of hallucinations survive completely undetected in the final output. Even the strongest model tested (Qwen3.5-397B-A17B, 87.0% at Stage 1) faces a structural ceiling; projected Stage 4 detection is only ${\sim}$60--65%. Critically, boundary gates using identical RAG verification tools reduce hallucination survival from 58.4% to 16.2% versus end-of-pipeline checking (Cohen's $h = -0.911$, $p 0.000001$), while end-checking alone achieves merely 2.3 pp improvement over no verification. When you verify matters more than whether you verify. Our model predicts survival for $n$-agent linear pipelines and prescribes optimal verification resource allocation: invest at $S_1{\to}S_2$ first, where 75.4% of hallucinations are still catchable, not at $S_3{\to}S_4$ where 89.3% have already escaped.
151. 【2608.14584】Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework
链接：https://arxiv.org/abs/2608.14584
作者：Hailong Yang,Jianqi Wang,Guanjin Wang,Zhaohong Deng
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：integrate heterogeneous information, perform complex semantic, decision making, required to jointly, jointly encode
备注： 13 pages, 8 figures
点击查看摘要
Abstract:In Multimodal Question Answering (MQA), models are required to jointly encode and integrate heterogeneous information from multiple modalities, including text, images, and speech, to perform complex semantic reasoning and decision making. Despite recent advances, existing approaches, including traditional deep learning models and Large Models (LMs) or prompt-based frameworks, continue to face several critical challenges. First, modality bias arises from discrepancies in feature distributions across different modalities, which limits effective cross modal collaborative understanding. Second, many questions require knowledge drawn from multiple domains, introducing significant uncertainty. Third, current methods often rely on shallow semantic matching, resulting in limited reasoning depth an reduced interpretability. To address these issues, inspired by the traditional fuzzy system (FS) framework, we propose a fuzzy-inference-guided multimodal generative architecture termed the Multi-Modal Generative Fuzzy System (MMGFS). The main contributions of MMGFS are two folds. First, it alleviates modality bias through a multimodal collaborative rumination mechanism. Second, it introduces fuzzy rules and a multi-hop inference mechanism to support cross-domain knowledge fusion and hierarchical reasoning, thereby strengthening uncertainty modelling and deepening semantic understanding. We conduct comprehensive evaluations on open-domain question answering datasets, including MultimodalQA and WebQA, as well as domain-specific benchmarks, including BioMol-VQA and EHRxQA. Experimental results demonstrate that MMGFS consistently outperforms existing methods across multiple datasets. It effectively mitigates modality bias and question uncertainty while achieving superior performance in answer accuracy, consistency, and generalization.
152. 【2608.14577】HarmProfile: Characterizing Harmful Distributions in Frontier LLMs
链接：https://arxiv.org/abs/2608.14577
作者：Zhouyuan Ma,Yutao Wu,Hanxun Huang,Xiang Zheng,Xiao Liu,Yixin Cao,Zuxuan Wu,Xingjun Ma,Yu-Gang Jiang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Frontier large language, largely treated harmful, treated harmful generation, large language models, object of analysis
备注：
点击查看摘要
Abstract:Frontier large language models (LLMs) safety evaluation has largely treated harmful generation as an attack outcome rather than as an object of analysis. Consequently, little is known about the harmful outputs produced during model misbehavior, partly because large-scale, high-quality collections of frontier-LLM misbehavior are difficult to obtain. To address this gap, we introduce HarmProfile, a content-centric benchmark dataset that collects model misbehavior across diverse harm categories and model families, and defines the resulting harmful-output distribution as a model-level risk profile. The premise is that, just as linguistic behavior can be characterized from an utterance corpus, model risk can be characterized from the content, severity, and variation of its safety failures. HarmProfile contains over 80,000 validated artifacts from 23 frontier LLMs across 13 model families, organized into 15 harm categories and 57 subcategories. Using this corpus, we find that frontier LLMs reliably produce harmful content at scale, yet exhibit distinct risk profiles; both harmfulness and diversity grow with model capability, suggesting that frontier LLMs may appear safe yet harbor increasingly dangerous knowledge beneath the alignment surface. Our source code is available at this https URL .
153. 【2608.14551】Auxiliary uncertainty signals for LLM-assisted systematic review screening: a benchmark across eight Cohen drug-class reviews
链接：https://arxiv.org/abs/2608.14551
作者：Arya Rahgozar,Pouria Mortezaagha
类目：Computation and Language (cs.CL); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：lack calibrated uncertainty, Large language models, decisions lack calibrated, Large language, systematic reviews
备注： 27 pages, 7 figures, 10 tables. Code, prompts, and cached LLM responses at [this https URL](https://github.com/rahgoar/LR-Spectral-BERTGCN-Topological-Undecidability-in-Clinical-AI)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for title-abstract screening in systematic reviews, but their decisions lack calibrated uncertainty. We show that an auxiliary BERT+GCN classifier supplies a structured uncertainty signal that improves LLM screening efficiency, and we identify the prompt-delivery strategy that maximises the benefit-to-cost ratio. We evaluate five LLM prompt-delivery conditions on eight drug-class datasets from the Cohen (2006) benchmark using 3 seeds x 5-fold stratified cross-validation (600 fold-level results). A BERT+GCN model trained per fold classifies each test paper as INCLUDE, EXCLUDE, or MAYBE via two spectral tests (algebraic radical and categorical paradox). Conditions vary information content (none / label / full scores), selectivity (all papers vs. MAYBE only), and timing (proactive vs. reactive two-pass). A cross-model pilot against gpt-4.1-mini on three datasets tests cross-generation transfer. Three findings: (i) Full-context delivery yields significant gains in F1 (+0.011, paired Wilcoxon p=0.008) and WSS@95 (+0.050, p=0.039) at a 1.28x token-cost premium, while preserving recall. (ii) MAYBE-only routing is Pareto-optimal: highest mean recall (0.92) and AUC-ROC (0.54) at only 1.05x baseline cost -- one sixth of full-context overhead. (iii) The two-pass design escalates 22.2% +/- 8.8% of records yet never revises its decision (0% flip rate across all datasets and folds), giving decisive evidence that current instruction-tuned LLMs cannot self-triage. The cross-model pilot shows an identical +0.8% recall uplift for both LLM generations. A per-paper ablation across 20,796 observations shows the dual paradox test reduces empirically to a one-line logit-gap criterion. We release the full pipeline; the 600-run experiment replays in under one hour from cached LLM responses.
Comments:
27 pages, 7 figures, 10 tables. Code, prompts, and cached LLM responses at this https URL
Subjects:
Computation and Language (cs.CL); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
MSC classes:
68T50, 68T07, 62P10
Cite as:
arXiv:2608.14551 [cs.CL]
(or
arXiv:2608.14551v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.14551
Focus to learn more
arXiv-issued DOI via DataCite</p>
154. 【2507.15502】FollowUpBot: An LLM-Based Conversational Robot for Automatic Postoperative Follow-up
链接：https://arxiv.org/abs/2507.15502
作者：Chen Chen,Jianing Yin,Jiannong Cao,Zhiyuan Wen,Mingjin Zhang,Weixun Gao,Xiang Wang,Haihua Shu
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：identifying complications, plays a crucial, crucial role, recovery and identifying, Postoperative follow-up plays
备注：
点击查看摘要
Abstract:Postoperative follow-up plays a crucial role in monitoring recovery and identifying complications. However, traditional approaches, typically involving bedside interviews and manual documentation, are time-consuming and labor-intensive. Although existing digital solutions, such as web questionnaires and intelligent automated calls, can alleviate the workload of nurses to a certain extent, they either deliver an inflexible scripted interaction or face private information leakage issues. To address these limitations, this paper introduces FollowUpBot, an LLM-powered edge-deployed robot for postoperative care and monitoring. It allows dynamic planning of optimal routes and uses edge-deployed LLMs to conduct adaptive and face-to-face conversations with patients through multiple interaction modes, ensuring data privacy. Moreover, FollowUpBot is capable of automatically generating structured postoperative follow-up reports for healthcare institutions by analyzing patient interactions during follow-up. Experimental results demonstrate that our robot achieves high coverage and satisfaction in follow-up interactions, as well as high report generation accuracy across diverse field types. The demonstration video is available at this https URL.
155. 【2608.15910】Iterative Self-Learning for Expressive Text-to-Speech Synthesis
链接：https://arxiv.org/abs/2608.15910
作者：Nicholas Sanders,Gustav Eje Henter,Simon King,Korin Richmond
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
关键词：explicit conditioning labels, conditioning labels provide, labels provide direct, prompting-based approaches, explicit conditioning
备注：
点击查看摘要
Abstract:Expressive text-to-speech (TTS) systems that use explicit conditioning labels provide direct and interpretable control over expressive attributes, in contrast to reference-based or prompting-based approaches, but require labeled data. Obtaining these labels at scale is costly and time-consuming, yet no prior semi-supervised framework addresses this specific bottleneck. Existing semi-supervised TTS methods instead target scarcity of paired speech-text data or transcriptions. To address the scarcity of expressive labels, we propose an Iterative Self-Learning (ISL) framework for expressive TTS, built on Invert-Classify, a classifier-free method that recovers discrete expressive labels by inverting a frozen generative model. The framework iteratively pseudo-labels unlabeled speech using the current model, retrains on the combined labeled and pseudo-labeled data, and repeats, progressively refining label quality and synthesis. We validate on two expressive tasks, word-level prominence and utterance-level emotion, across multiple low-resource data splits. We find that iterative refinement can improve pseudo-label accuracy over single-pass baselines. Furthermore, we observe that these improvements in pseudo-labeling of expressivity translate to gains in expressive label adherence and synthesis quality, confirmed by objective metrics and human listening tests. In the most data-scarce conditions, ISL-trained models outperform single-pass pseudo-labeling and further approach fully supervised performance, demonstrating that gradient-based ISL is an effective solution to expressive label scarcity in low-resource TTS.
156. 【2608.14906】Optimal Watermark Localization in Mixed-Source Large Language Model Texts
链接：https://arxiv.org/abs/2608.14906
作者：Jose H. Blanchet,T. Tony Cai,Xiang Li,Hao Liu,Qi Long,Weijie J. Su
类目：Methodology (stat.ME); Computation and Language (cs.CL); Machine Learning (cs.LG); Machine Learning (stat.ML)
关键词：large language models, authenticate text generated, language models, generated by large, large language
备注： 66 pages, 13 figures
点击查看摘要
Abstract:Watermarking provides a principled way to authenticate text generated by large language models (LLMs). In practice, however, the final text may be mixed-source, with watermark evidence surviving at only a subset of token positions after rewriting, insertion, deletion, or paraphrasing. Although prior work has studied global detection of watermark signals, when such signals can be localized remains unclear. We formulate watermark localization as a token-level multiple-testing problem based on pivotal statistics, with a latent indicator recording whether watermark dependence survives at each position. Under an asymptotic regime indexed by exponents for signal sparsity, next-token concentration, and effective-vocabulary growth, we derive a sharp boundary for global detection and phase transitions for discovery and classification within the class of coordinatewise pivot-based localization rules. We show that discovery is strictly harder than detection and that consistent classification is impossible across the parameter regime within this class. We then develop an adaptive thresholding method that does not require knowledge of the exponents or time-varying next-token distributions, but uses a data-driven estimate of the surviving watermark fraction. The method attains the optimal discovery boundary and near-optimal discovery power relative to homogeneous pivot-based rules. Simulations support the theoretical phase transitions, while experiments on model-generated texts demonstrate practical localization performance under common edit mechanisms.
信息检索
1. 【2608.16872】Impression Share Prediction: An Offline Evaluation Task for Ranking Systems
链接：https://arxiv.org/abs/2608.16872
作者：Mohsen Malmir,Houssam Nassif,Danish Nasir Shaikh,Taher Rahgooy,Murat Ali Bayir
类目：Information Retrieval (cs.IR)
关键词：major gateway, online evaluation, Offline evaluation, downstream utility, Offline
备注：
点击查看摘要
Abstract:Offline evaluation is a major gateway before online evaluation of ranking models in A/B testing. Standard offline metrics measure predictive accuracy, but are only a surrogate for downstream utility: a model can improve them while redistributing impressions across objective buckets in ways that degrade downstream utility. No offline method surfaces these impression share shifts before online evaluation. We propose \emph{impression share prediction} as an offline evaluation task: given a candidate ranking model, predict the distribution of impressions it would produce across objective buckets - impressions grouped by optimization goal (e.g., click, video view). The task is inherently counterfactual, since the candidate has never served live traffic. We propose a structural causal model of how model predictions and delivery capacity jointly determine impression allocation, and show the counterfactual effect is identified from observational data. Building on this, we develop a statistical learning framework that predicts impression shares from a candidate's early-interaction confidence signals and current system state, trained on historical data. On data from multiple ranking model families, a Random Forest reduces L1 error by 49\% over a constant baseline for models seen during training. For held-out models, evaluated by time since first appearance, the first hour is the closest analog to true online evaluation and the hardest: the Random Forest falls below the baseline because the capacity state still reflects the prior model. An encoder-conditioned architecture that simulates a 2-hour rollout over recent auction dynamics recovers $+$22\% L1 in this regime.
2. 【2608.16824】GEO-Flag: Detecting and Measuring GEO-Optimized Web Content
链接：https://arxiv.org/abs/2608.16824
作者：Junjie Chu,Ye Leng,Mingjie Li,Yun Shen,Xinyue Shen,Yang Zhang
类目：Machine Learning (cs.LG); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：Generative Engine Optimization, Engine Optimization, modifies web content, generative search engines, Generative Engine
备注： 21 pages, 3 figures, 21 tables
点击查看摘要
Abstract:Generative Engine Optimization (GEO) modifies web content to increase its likelihood of being selected and cited by generative search engines. This can give strategically optimized pages visibility disproportionate to their authority or relevance and even make weak or false information appear well supported. Unlike conventional search, generative search synthesizes information into direct answers rather than presenting competing sources, which can further amplify these risks, as assessing source provenance and authority requires additional user interaction. Despite these concerns, systematic methods for detecting GEO-optimized webpages remain underexplored. We introduce \texttt{GEOFlagBench}, a benchmark of 3,200 webpages spanning 400 queries, four domains, and eight GEO optimizer families, and use it to systematically evaluate existing GEO detection methods. Although the strongest baseline achieves an aggregate F1 of 0.880, method-level and authorship-conditioned evaluations reveal substantial weaknesses and potential reliance on authorship-related shortcuts. We therefore propose \emph{Intervention-Paired Training} (IPT), which supervises detector responses to GEO interventions and non-GEO AI polishing; on ModernBERT, IPT improves F1 from 0.862 to 0.944 and worst-group accuracy from 0.725 to 0.883. We develop a GEO-gated Agent system for auditing the Source Tier and verifiability of Citation URLs in detected GEO pages. Finally, we deploy the complete pipeline on released Google Search and Gemini-grounded retrieval results for 1,000 real-user queries. Across 10,095 available pages, we estimate an overall GEO prevalence of 8.90\%, reaching 16.36\% among pages modified in 2026. Our results establish a foundation for systematically detecting, auditing, and measuring GEO in real-world search ecosystems.
3. 【2608.16797】UniDot: A Unified Network for Sequence Modeling and Feature Interaction in Large-scale Recommendation
链接：https://arxiv.org/abs/2608.16797
作者：Rongcheng Lin,Yan Sun,Jamey Zhang,Guanglei Xiong,Ivan Ji,Xianjie Chen,Shujian Bu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：evolved largely independently, Industrial recommenders rely, feature-interaction models, model families, sequential models
备注：
点击查看摘要
Abstract:Industrial recommenders rely on two model families that have evolved largely independently: feature-interaction models over multi-field user/item features, and sequential models over user-behavior histories. Production systems couple them only loosely. To unify the two, we present UniDot, a novel architecture for post-click conversion prediction built from the factorization-machine (FM) point of view: the embedding inner product---which powers collaborative filtering and lets a recommender generalize to unseen user--item pairs---is the same primitive as attention's query dot key scoring, so a single dot-product of tokens can underlie both feature interaction and sequence modeling. UniDot tokenizes non-sequential fields and multi-domain behavioral sequences into one shared token space and stacks a single macro-block in which a token-mixing bus and a sequence-retrieval bus (item tokens cross-attending the histories) run in parallel and exchange state each layer through an MLP-Mixer fusion, while an FM Highway carries explicit per-layer dot-product interactions around the residual stack directly to the classifier. The sequence side is embedded once per forward pass and shared by all consumers, bounding inference latency. Trained with a dual sparse/dense (Adagrad + Muon) optimizer, an auxiliary conversion-delay head, and multi-path mutual learning, UniDot finished as the runner-up on the Industrial track of the TAAC KDD Cup 2026.
4. 【2608.16704】Unbiased Recommender Systems with Implicit Feedback
链接：https://arxiv.org/abs/2608.16704
作者：Md Aminul Islam
类目：Information Retrieval (cs.IR)
关键词：popularity bias, position bias, systems typically rely, bias, implicit feedback
备注：
点击查看摘要
Abstract:Recommender systems typically rely on implicit feedback (e.g., clicks) to infer user preferences. However, such data is inherently prone to various biases, including position bias and popularity bias. Position bias occurs when higher-ranked items receive more interactions regardless of true relevance. Popularity bias reinforces frequent exposure of popular items while under-recommending relevant, yet less popular ones. Directly learning from such data fails to capture true user preferences, leading to suboptimal recommendations. This research focuses on mitigating position bias and popularity bias in recommender systems. Specifically, I address position bias in learning-to-rank (LTR) systems and popularity bias in collaborative filtering (CF) models and social recommender systems based on graph neural networks. My work develops methods that overcome the limitations of existing approaches to mitigating position bias and popularity bias, enabling more relevant and personalized recommendations that align with users' preferences.
5. 【2608.16621】Cost Scales with Change, Not Corpus Size: Incrementally Maintaining an Evolving Semantic Substrate
链接：https://arxiv.org/abs/2608.16621
作者：Yusuke Takahashi,Kyle Wild,Asako Uraki
类目：Artificial Intelligence (cs.AI); Databases (cs.DB); Information Retrieval (cs.IR)
关键词：agentic question-answering systems, question-answering systems increasingly, systems increasingly re-derive, Retrieval-augmented and agentic, agentic question-answering
备注： 5 pages, 5 figures, 1 table. Accepted and presented at the 2026 International Electronics Symposium (IES), Yogyakarta, Indonesia, August 1-3, 2026 (IEEE technically co-sponsored). Authors' accepted version
点击查看摘要
Abstract:Retrieval-augmented and agentic question-answering systems increasingly re-derive the meaning of a corpus at query time. Put plainly, instead of re-deriving what a corpus means on every question, the work is done once when a document arrives and is thereafter merely consulted -- a compiler, not an interpreter, of meaning. An alternative is to compile that meaning once, at ingest time, into a compact, queryable semantic substrate and maintain it as the corpus evolves. The central objection is maintenance cost: rebuilding a truncated singular value decomposition (SVD) on every change appears prohibitive, and a change of embedding model seems to force a full re-embedding. We argue and show empirically that maintenance cost scales with the amount of change, not corpus size. On a controlled synthetic pilot (dimension 256, rank 32, a corpus grown from 3,000 to 9,000 documents over 50 update events), incremental low-rank updates were 33.7 times cheaper per update than full re-SVD and 23.8 times cheaper cumulatively, while the incremental subspace tracked the full recomputation to within floating-point precision (maximum principal-angle drift below 1e-11 degrees; recall@10 = 1.0). An orthogonal Procrustes virtual axis update recovered 0.95 mean cosine to truly re-embedded vectors by re-embedding only about 10 percent of the corpus. The results support maintaining, rather than repeatedly reconstructing, a semantic substrate.
6. 【2608.16587】SAHC-NS: Structure-Aware and Hardness-Calibrated Negative Sampling for Implicit Collaborative Filtering
链接：https://arxiv.org/abs/2608.16587
作者：Jiayi Wu,Zhengyu Wu,Xunkai Li,Hongchao Qin,Rong-Hua Li,Guoren Wang
类目：Information Retrieval (cs.IR)
关键词：implicit collaborative filtering, learn user preferences, effectively learn user, Negative sampling, negative sampling methods
备注：
点击查看摘要
Abstract:Negative sampling is a key component of implicit collaborative filtering (CF), as it enables recommenders to effectively learn user preferences. Existing negative sampling methods mostly follow a two-stage paradigm: they first construct a candidate negative pool for each user and then select negative samples from the pool according to predefined sampling rules. However, these methods usually overlook the hardness variation of candidate negative pools across users, making it difficult to adaptively adjust the hardness and informativeness of negative samples according to candidate-pool conditions. In addition, most existing samplers evaluate candidate negatives mainly through a matching score computed from the final aggregated user and item embeddings, while ignoring the structural differences captured by multi-hop neighborhood aggregation. As a result, the training value of negatives may be insufficiently characterized. To address these issues, we propose SAHC-NS, a Structure-Aware and Hardness-Calibrated Negative Sampling method. Specifically, SAHC-NS uses the mean and standard deviation of layer-wise matching scores to capture the overall matching strength and cross-layer structural discrepancy of candidate negatives, respectively. This enables SAHC-NS to select informative negatives by taking cross-layer structural discrepancy into account, rather than relying solely on final matching scores. Moreover, SAHC-NS introduces a candidate-pool-aware hardness calibration module to dynamically adjust negative augmentation strength according to candidate-pool hardness, producing hardness-controllable negatives. Extensive experiments demonstrate the superiority of SAHC-NS over existing negative sampling methods.
7. 【2608.16586】When Is Complex Chunking Worth It? A Multi-Objective Evaluation of Chunking Methods at Scale
链接：https://arxiv.org/abs/2608.16586
作者：Laura Caspari,Kanishka Ghosh Dastidar,Michael Dinzinger,Jelena Mitrović,Michael Granitzer
类目：Information Retrieval (cs.IR)
关键词：index long documents, real-world retrieval systems, Dense retrieval, long documents, commonly evaluated
备注：
点击查看摘要
Abstract:Dense retrieval is commonly evaluated on benchmarks that represent each document with a single embedding, even though real-world retrieval systems often index long documents that require chunking. In these settings, the chosen chunking method not only affects retrieval quality, but also indexing throughput, query latency, and memory usage. Prior comparisons of chunking strategies have mainly focused on retrieval performance, leaving operational trade-offs underexplored. To address these issues, we evaluate eight representative chunking strategies across two scalable corpora, three embedding models, and multiple corpus sizes, measuring both retrieval effectiveness and system-level costs. Our results show that computationally expensive methods rarely provide consistent gains over simpler chunking. Instead, the best performing strategy depends on the embedding model, dataset, corpus size, and target retrieval metric. Methods with similar performance can also differ substantially in operational cost, showing that chunking should be seen as a multi-objective design decision.
8. 【2608.16502】When Tool-Backed Skill Retrieval Fails: Source-Style Collapse in Executable Capability Retrieval
链接：https://arxiv.org/abs/2608.16502
作者：Yiqi Liu,Joseph James,Yang Wang,Chenghao Xiao,Chenghua Lin
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Large-scale agents increasingly, access external capabilities, agents increasingly rely, Large-scale agents, external capabilities
备注：
点击查看摘要
Abstract:Large-scale agents increasingly rely on retrieval to access external capabilities. We study this retrieval gate in structured tools and APIs, a measurable class of tool-backed executable skills that must be surfaced before an agent can plan, incorporate, or act. In this setting the retrieval layer can silently fail even when the capability corpus is fixed: on ToolRet, a retriever fine-tuned on one source-specific slice collapses on another source-specific slice of the same benchmark, with FT-1100 despite its higher lexical overlap with the gold tools. We call this failure mode source-style collapse. Query-side TF-IDF fingerprints flag source styles on which the fine-tuned retriever is likely to fail better than semantic or length-based proxies, giving a cheap signal for mismatch over a fixed tool corpus. We propose ToolScout, a source-aware routing method that uses this signal as a routing guard: on the mixed 4,996-query stream, TF-IDF-based routing raises coverage from 22.3% to 86.1%, and across five collapsed sources 20 matched examples raise the coverage-weighted global top-1 proxy from 1.3% to 53.9%. The same failure and routing behaviors persist when tools are rerendered as executable skill cards, which rules out raw API-schema format as the sole cause.
9. 【2608.16491】FROG: Efficient Range-Filtering Approximate Nearest Neighbor Search on GPUs
链接：https://arxiv.org/abs/2608.16491
作者：Xiaokun Cui,Pengbo Liu,Jiadong Xie,Yingfan Liu,Hui Li,Jeffrey Xu Yu,Jiangtao Cui
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：Range-filtering approximate nearest, modern vector databases, Range-filtering approximate, approximate nearest neighbor, approximate nearest neighbors
备注：
点击查看摘要
Abstract:Range-filtering approximate nearest neighbor search (RFANNS) is a fundamental operation in modern vector databases. Given a query vector $q$ and a numerical range predicate, RFANNS returns the $k$-approximate nearest neighbors ($k$-ANN) of the query $q$ among the objects whose attributes satisfy the range predicate. However, existing RFANNS methods are not well suited to high-throughput GPU execution. CPU indexes offer limited parallel scalability, generic GPU filtering is highly selectivity-dependent, and GPU indexes built from locally optimized subgraphs can incur long search trajectories and redundant distance computations. To address these limitations, we present FROG, a GPU-oriented RFANNS index that replaces multiple locally optimal substructure building with a globally aware, vertex-centric design. It organizes diverse expansion neighbor candidates for each vertex in a GPU-friendly structure and rapidly identifies the expansion neighbors used for computation at query time. Moreover, GPU-oriented algorithms and implementations are developed for both index construction and query processing. Experiments on six datasets show that FROG improves mixed-selectivity query throughput by 14.7--37.7$\times$ over 44-core CPU baselines and 4.5--7.6$\times$ over the strongest GPU baseline. It also accelerates index construction by 2.4--14.8$\times$ over the GPU baseline.
10. 【2608.16488】Efficient Privacy-Preserving Range Filtered Approximate Nearest Neighbor Search
链接：https://arxiv.org/abs/2608.16488
作者：Haoyu Wang,Yandi Zhang,Jiadong Xie,Yingfan Liu,Hui Li,Jeffrey Xu Yu,Jiangtao Cui
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：Range-filtered approximate nearest, RFANNS indexes expose, nearest neighbor search, numerical range predicate, indexes expose vectors
备注： According to the best of our knowledge, this work is the first attempt to study privacy-preserving range-filterd ANN search problem. This is the early version of the work that is still in progress
点击查看摘要
Abstract:Range-filtered approximate nearest neighbor search (RFANNS) is an important primitive for vector databases; it retrieves vectors that are similar to a query and satisfy a numerical range predicate, but existing RFANNS indexes expose vectors, attributes, and queries in plaintext. This assumption is unsuitable for outsourced vector databases, where sensitive data and queries must be protected from an honest-but-curious cloud server. To the best of our knowledge, this is the first study that systematically formulates and evaluates privacy-preserving RFANNS over outsourced encrypted vector databases. Our approach separates range localization from encrypted vector search: an authorized user maps the query range to a compact set of nodes in a local N-ary attribute tree, and the server searches only the corresponding proximity graph sub-indices over encrypted vectors. To reduce expensive encrypted comparisons, we use a filter-and-refine pipeline that first retrieves coarse candidates with approximate distance-comparison-preserving encryption and then reranks a small candidate set with exact distance-comparison encryption. We then analyze the computation, storage, communication, and leakage of the protocol. Experiments on four widely used vector datasets show that our method improves the QPS-Recall trade-off over representative secure adaptations of existing RFANNS approaches, scaling effectively to large datasets.
11. 【2608.16455】Graph-Based Discovery of Mathematical Software Communities and Publication-to-Community Prediction
链接：https://arxiv.org/abs/2608.16455
作者：Maxence Azzouz-Thuderoz,Yuni Susanti,Moritz Schubotz
类目：Information Retrieval (cs.IR)
关键词：traditional disciplinary boundaries, remains largely unexplored, span traditional disciplinary, software forms distinct, communities remains largely
备注：
点击查看摘要
Abstract:Research software forms distinct co-usage communities that span traditional disciplinary boundaries, yet the structure of these communities remains largely unexplored. We present a graph-based framework for discovering mathematical software communities and predicting their association with research publications. We construct a software co-usage network from publication-software relationships using a curated swMATH dataset and subsequently apply community detection method, revealing a heterogeneous landscape of mathematical software communities. We formulate publication-to-community mapping as a multi-label classification task and further investigate whether community membership can be predicted from lightweight scholarly metadata. Specifically, we compare two feature representations of scientific publications: Mathematics Subject Classification (MSC) and title-based embeddings. Across a range of models, structured MSC representation consistently provides a stronger precision-recall trade-off, demonstrating that structured domain metadata captures software-community structure more effectively than compressed title-only semantics in this setting. This work highlights the continuing value of structured scholarly metadata for large-scale research software discovery, classification and recommendation.
12. 【2608.16407】POI Recommendation with LLM-Augmented Multi-Graph Learning and Contrastive Alignment
链接：https://arxiv.org/abs/2608.16407
作者：Burak Tamer,Wolfram Höpken,Zehui Wang
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：networks achieve strong, neural networks achieve, recommendation models based, achieve strong performance, user-item interactions
备注：
点击查看摘要
Abstract:Point-of-interest (POI) recommendation models based on graph neural networks achieve strong performance by propagating collaborative signals over user-item interactions, yet they struggle with the cold-start problem, where items with few or no interactions are not represented. In this paper, we propose LLM-augmented Multi-Graph Contrastive Learning (LLM-MGCL), a multi-graph neural network that uses semantic and spatial information about items to extend the LightGCN backbone with two auxiliary item-item graphs: a semantic graph constructed from sentence embeddings of LLM-generated photo summaries and keywords, and a geographic graph derived from Haversine distances between business locations. Item embeddings are propagated over all three graphs in parallel, fused additively, and aligned across views through a bidirectional InfoNCE contrastive objective that connects behavioral, semantic, and spatial representations of the same items. Experiments on the Yelp Multimodal Recommendation Dataset show that LLM-MGCL outperforms classical collaborative filtering, matrix factorization, and interaction-only graph neural network baselines. It improves Recall@20 by 52.0% and NDCG@20 by 64.8% over LightGCN while performing on par with the strongest contrastive baseline, Self-supervised Graph Learning (SGL), which is also affected by the cold-start problem. An ablation study reveals that the cross-view contrastive alignment (CA) is the primary driver of these gains, with the best performance achieved when all three graphs are combined. Our results suggest that externally grounded, LLM-derived item knowledge can effectively compensate for missing collaborative signal and mitigate the item cold-start problem in POI recommendation.
13. 【2608.16394】hink Inside the Chunk: RegulaRAG for Regulation-Compliant Scenario Generation using LLMs: A Case Study of UN Regulation No. 152
链接：https://arxiv.org/abs/2608.16394
作者：Vahid Zolfaghari,Nenad Petrovic,AndrÉ Schamschurko,Alois Knoll
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large Language Models, Language Models, Large Language, Generating regulation-compliant test, validating safety-critical automotive
备注：
点击查看摘要
Abstract:Generating regulation-compliant test scenarios is essential for validating safety-critical automotive systems, yet Large Language Models (LLMs) struggle to ground outputs in long, hierarchical standards. We present RegulaRAG, a Retrieval-Augmented Generation (RAG) pipeline that couples SmartChunking, reference-aware enrichment of paragraphs and tables via graph traversal, with Smart Retrieve Rerank over these enriched units. To test our system, we evaluate on a manually curated dataset covering all scenarios in UN Regulation No. 152 (AEBS). Our study comprises: (i) a three-step progressive search that identifies near-optimal retrieval parameters without exhaustive grid search; (ii) head-to-head comparisons against five baseline RAG systems; and (iii) a robustness stress test that scales the source corpus with distractor content. Outputs are evaluated using a customized penalized scoring metric. Across all experiments, RegulaRAG achieves the highest average Meta-Score (82.99), outperforming the next-best system by 43% (NoRAG: 57.94), while operating at 14k-25k tokens per query versus up to 500k for graphcentric baselines. It maintains strong performance, remaining stable even as the number of regulatory sources grows, whereas competing RAG systems degrade sharply in both quality and robustness.
14. 【2608.16309】Static Pruning Across Sparse Retrieval Regimes: What Transfers, What Breaks, and What Still Helps
链接：https://arxiv.org/abs/2608.16309
作者：Zirui Song,Yuye Zhu,Yang Yang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：single custom pipeline, accelerate sparse neural, pruning, Natural Questions, leaving it unclear
备注：
点击查看摘要
Abstract:Static pruning is widely used to accelerate sparse neural retrieval, yet existing studies each validate their conclusions within a single custom pipeline, leaving it unclear which findings transfer to modern engines with different index organizations and dynamic pruning mechanisms. We present the first cross-engine pruning portability study, evaluating static pruning strategies across three engines - a controlled C++ pipeline (exhaustive inverted index), BMP (block-max pruning), and SEISMIC (clustered inverted indexes) - on two benchmarks (MS MARCO, Natural Questions) with two encoders spanning opposite query-density regimes (SPLADE: 44 avg. query terms; V3-GTE: 7 avg. query terms), totaling 1,140 experimental configurations, with an additional deep-judgment validation on TREC DL 2019/2020. We find that index-side pruning (document and posting-list) is portable: it consistently reduces latency (1.2-6.6$\times$) and index size (18-82%) across all engines because sparse retrieval is memory-bound - a conclusion we support with cache-miss, TLB, and IPC profiling. In contrast, query pruning is already internalized by modern engines: it yields 4-11$\times$ speedup on the exhaustive pipeline but is subsumed by BMP's $\beta$ and SEISMIC's query_cut. Static pruning complements dynamic pruning: on BMP, combining document and query reduction yields 2.5$\times$ speedup with NDCG@10 within 0.003 of the exact baseline. Finally, NDCG@10 saturates while Recall@10 is still in the ${\sim}$85-95% range across all three engines, providing a portable stopping criterion: practitioners can push pruning to this knee without visible ranking degradation. Together, these findings answer what transfers (index-side pruning), what breaks (query pruning), and what still helps (static atop dynamic pruning).
15. 【2608.16274】Decoupled Temporal Encoding for Generative Recommendation
链接：https://arxiv.org/abs/2608.16274
作者：Pengfei Jia,Jingjian Wang,Jingmao Li,Ge Zhang,Feng Shi
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：component of Transformer-based, Transformer-based generative recommendation, Positional encoding, positional encoding methods, Transformer-based generative
备注： accepted by CIKM '26
点击查看摘要
Abstract:Positional encoding is a fundamental component of Transformer-based generative recommendation models, where user histories are modeled as autoregressive item sequences. Most positional encoding methods are inherited from natural language processing and mainly represent discrete item order. However, recommendation sequences go beyond ordered lists, as timestamps and temporal effects also shape item relations. Our work is motivated by a real-world food delivery and instant retail recommendation system, where user behavior exhibits multi-level temporal regularities, including recency effects, meal-time peaks, weekday-weekend shifts, and promotion-driven traffic bursts. Existing methods partially address this issue through timestamp features, interval embeddings, decay functions, or attention biases, but they usually inject heterogeneous temporal signals through a unified representation or a single modeling pathway, making it difficult to distinguish broad temporal dynamics from local order cues. To address this limitation, we propose Decoupled Temporal Encoding, a lightweight framework for generative recommendation. DTE separates temporal dynamics from order information through two complementary modules: a personalized macro-temporal module that injects compact temporal primitives into item embeddings, and a time-gated micro-sequential module that introduces relative-order bias only when interactions are temporally dense. DTE is also parameter-efficient and deployment-friendly, allowing easy integration into existing systems.
16. 【2608.16161】Domain-Specific Text Embedding Models for Entity Resolution
链接：https://arxiv.org/abs/2608.16161
作者：Khajesh Sapram,Srivardhani Raju,Kishore Konda
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：capture semantic similarity, designed to capture, capture semantic, optimised for distinguishing, distinguishing entity records
备注：
点击查看摘要
Abstract:General-purpose text embedding models are designed to capture semantic similarity but are not optimised for distinguishing entity records that represent the same real-world business or person. This limitation affects applications such as entity resolution and duplicate record retrieval, where small textual differences may either preserve or change identity. This paper investigates whether domain-specific triplet fine-tuning can adapt pretrained embedding models for identity-sensitive retrieval. A synthetic dataset of business and person records was created with identity-preserving variations and challenging non-matching examples. Two widely used embedding models were evaluated before and after fine-tuning using a margin-based similarity evaluation. The results show substantial improvements in separating true matches from highly similar non-matches, demonstrating that domain-specific triplet training can effectively reshape general-purpose embedding spaces for entity retrieval. These findings suggest that targeted fine-tuning provides a practical approach for improving embedding models in data quality management and information retrieval applications.
17. 【2608.16096】he Commercial Tax: Rent-vs-Own Blind Spots in Multi-Hop Retrieval Benchmarks
链接：https://arxiv.org/abs/2608.16096
作者：Luis M. Sanchez,Kosrow Dehnad
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Enterprises connect language, Enterprises connect, connect language models, connect language, retrieval systems leave
备注： 23 pages, 4 figures. Replication artifacts (harness, per-question recall vectors, cost model, bootstrap code): [this https URL](https://doi.org/10.5281/zenodo.21972866) ; embedding matrices: [this https URL](https://huggingface.co/datasets/toryx-ai/commercial-tax-musique-embeddings)
点击查看摘要
Abstract:Enterprises connect language models to their own data through retrieval. The benchmarks that rank multi-hop retrieval systems leave out two facts a buyer needs before a published number can be used: whether the retrieval backbone may be deployed commercially, and what it costs to build. On licensing: the field's dense-retrieval anchor, NV-Embed-v2, is licensed cc-by-nc-4.0. Of the four leading MuSiQue systems we audit (HippoRAG-2, PropRAG, SAG, KET-RAG), three depend on it for their best numbers and none says so. On performance: we measure thirteen embedders from eight makers on one identical MuSiQue harness with bootstrap confidence intervals throughout. Until mid-2026 there was a real commercial tax: the best commercially-licensed embedder trailed the anchor by 2.31 Recall@5 points (95% CI [0.91, 3.71], p=0.001). NVIDIA's Nemotron-3-Embed-8B, released 2026-07-16, has closed it: +0.24 at Recall@5 (95% CI [-0.94, +1.43], p=0.69), -0.58 at Recall@10 (p=0.28). It matches the anchor, does not beat it, and is the only entrant that is commercially licensed, free to self-host, and indistinguishable from the anchor; every other entrant meeting the first two conditions sits 5.2 to 14.6 points below. The durable finding is the paid-versus-free divide: API embedders charge per token on every re-index, self-hosted ones charge nothing. On cost: three of five audited systems (adding Microsoft's GraphRAG) do not disclose indexing cost, and the only published GraphRAG dollar figures span 11x inside one third-party paper (USD 2.30 vs USD 24.94 to index a 5.64 MB corpus once); extrapolated to 1 TB that undisclosed choice separates roughly USD 428K from $4.6M. Our cost model keeps one-time embedding apart from recurring answering: at 1 TB, embedding sits 7.5x-900x below graph construction, and a year of answering at 10,000 queries/day sits 350x or more below it.
18. 【2608.16075】RACER: Balancing Stability-Plasticity-Cognitivity Trilemma for LLM Enhanced Continual Recommendation
链接：https://arxiv.org/abs/2608.16075
作者：WooJoo Kim,HyunSik Yoo,JunYoung Kim,JaeHyung Lim,SeongKu Kang,HwanJo Yu
类目：Information Retrieval (cs.IR)
关键词：capture evolving user, Continual recommendation aims, struggles with sparsity, aims to capture, streaming data
备注： Accepted to CIKM 2026 full research paper
点击查看摘要
Abstract:Continual recommendation aims to capture evolving user interests from streaming data but struggles with sparsity. LLM enhancers mitigate this with semantic knowledge, but naive integration creates a new conflict. We identify this as the Stability-Plasticity-Cognitivity (SPC) Trilemma, where generalized LLM semantic priors (Cognitivity) conflict with retaining personalized historical preferences (Stability) and adapting to individual interest shifts (Plasticity). To address this, we propose Trilemma-Responsive Adaptive Continual Enhancement for Recommendation (TRACER). TRACER synergistically combines three specialized modules, each targeting stability, plasticity, or cognitivity, while preventing any single lemma from dominating. This holistic design enables semantic knowledge to support history retention and adaptation to evolving interests without disrupting continual learning. Across five real-world datasets, TRACER effectively harmonizes the SPC trilemma and outperforms state-of-the-art baselines by up to 14.38%. Our code is available at this https URL.
19. 【2608.16073】GOD: Enhancing Generalization via Deep Grafting for Sequential Recommendation
链接：https://arxiv.org/abs/2608.16073
作者：WooJoo Kim,JunYoung Kim,JaeHyung Lim,HwanJo Yu
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Sequential recommenders, unseen interactions, recommenders often struggle, GOD, Sequential
备注： Accepted to CIKM 2026 full research paper
点击查看摘要
Abstract:Sequential recommenders often struggle with sparse and noisy histories, limiting generalization to unseen interactions. Knowledge distillation mitigates this by transferring dense supervision from a teacher to a student. However, most distillation methods run teacher and student independently, then match student outputs or representations to the teacher. Such supervision entangles student-component effects, blurring whether weak generalization stems from unreliable embeddings, overfitted encoding, or co-adaptation to sparse histories. In this paper, we propose Graft-Oriented Distillation (GOD), a component-level distillation framework for improved generalization through grafting. Grafting denotes replacing selected frozen-teacher components with trainable student counterparts to build hybrid source models. GOD uses these hybrid models to evaluate student embeddings with the teacher encoder and the student encoder with teacher embeddings, providing component-level feedback. At inference, GOD uses only the student, incurring no additional cost. Across three real-world datasets, GOD outperforms state-of-the-art baselines by up to 13.92%.
20. 【2608.16071】Skill2Query: Exploiting Skill Structure to Generate Pseudo-Queries for Agent Skill Retrieval
链接：https://arxiv.org/abs/2608.16071
作者：Lihui Ding,Zihan Guo,Bingwei Lu,Chenyu Zhou,Yuanjian Zhou,Weinan Zhang,Jianghao Lin,Dongdong Ge
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：existing document-level approaches, document-level approaches typically, approaches typically leave, rich internal relations, Pseudo-query generation
备注：
点击查看摘要
Abstract:Pseudo-query generation can alleviate the supervision bottleneck for agent skill retrieval, but existing document-level approaches typically leave the rich internal relations among capabilities, parameters, and usage examples implicit. As a result, generated queries may be topically relevant to a skill while lacking capability grounding and parameter consistency, raising the question of whether explicitly exploiting a skill document's internal structure can produce more effective retrieval signals. We therefore propose Skill2Query, a framework that first parses a skill document into a Skill Knowledge Graph and then generates pseudo-queries through a three-stage process including style mimicking, query template generation, and parameter filling. The generated queries can be used for offline index augmentation, online query expansion, and retriever training. Four benchmarks (TheoremQA, LogicBench, ToolQA, and CHAMP) are used to evaluate Skill2Query with large-scale skill candidate pools across multiple downstream applications, including skill retrieval, retriever training, and end-to-end agent execution. Using nearly 30K skills across diverse domains, we generate 700K category-diverse pseudo-queries. Skill2Query consistently improves sparse, dense, and skill-routing retrieval, with an average Recall@1 gain of 6.70 percentage points across retrieval settings. Skill2Query-generated training data also achieves the best Recall@1 and nDCG@1 among the evaluated generation baselines. Further evaluations with multiple LLM backends demonstrate that improved skill retrieval translates into higher agent task success rates. Code and resources are available at this https URL.
21. 【2608.16050】Structured Prediction for Scalable Spreadsheet Table Understanding: From Cell Types to Table Ranges (Extended Version)
链接：https://arxiv.org/abs/2608.16050
作者：Antoine Gauquier,Ioana Manolescu,Pierre Senellart
类目：Information Retrieval (cs.IR); Databases (cs.DB); Machine Learning (cs.LG)
关键词：inconsistent organizational conventions, automatically extracting structured, extracting structured content, publishing tabular data, remains difficult due
备注： Extended version of a paper published at CIKM 2026
点击查看摘要
Abstract:Spreadsheets are a primary medium for publishing tabular data, yet automatically extracting structured content from them remains difficult due to heterogeneous layouts, diverse file formats, and inconsistent organizational conventions. We address two core tasks in spreadsheet understanding: Cell-Type Classification (CTC), which assigns roles to cells, and Table Detection (TD), which identifies table bounding boxes within sheets. We propose an efficient two-stage pipeline in which a learned CTC model feeds a deterministic TD algorithm. For CTC, we use a LightGBM classifier over 65 structured features together with a pairwise CRF enforcing spatial consistency across the cell grid. Our TD method extracts table ranges from predicted cell types by a deterministic five-stage procedure. For evaluation, we built and share StatSheets, a multilingual benchmark of 737 manually annotated sheets from 14 public data providers across multiple countries and file formats. Under 5-fold cross-validation, our CRF-LightGBM system achieves a Mean File-Macro F1 score of 0.937 on CTC, within 0.6 percentage points of the GPU-based TUTA Transformer, while requiring substantially fewer computational resources. For TD, our deterministic approach outperforms region-based baselines and remains competitive with recent LLM-based systems such as SpreadsheetLLM. These results demonstrate that combining non-linear structured prediction with deterministic range extraction provides a competitive, scalable, and computationally efficient approach to spreadsheet table understanding.
22. 【2608.16044】Coverage Is Not Containment: A Fundamental Limit of Admission-Time Defenses Against Coordinated Poisoning of Vector Retrieval
链接：https://arxiv.org/abs/2608.16044
作者：Prashant Kumar Pathak,Tarun Kumar Sharma
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, question by retrieving, retrieving passages, vector store, store and trusting
备注： 10 pages, 9 figures. Preprint; under submission
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) answers a question by retrieving passages from a vector store and trusting them as context, so anyone who can add documents can try to steer the answer. A recent, appealing defense filters poisoning at ingestion, rejecting any document that behaves like a hub. We show it -- and every ingestion-time filter -- is defeated by a coordinated adversary that injects a handful of individually unremarkable documents which together surround one target query and seize its top-k (on BGE-large / BEIR, m=10 documents take 10/10; 9.9/10 on a live HNSW index). The attack is not theoretical. Realized as ordinary fluent text and run end-to-end through a BGE-large + HNSW + Qwen2.5-7B pipeline, it makes the generator emit the attacker's planted claim in 88% of targets, versus 0% without the injection. And no admission-time defense stops it: at ingestion an attack cone is geometrically identical to a legitimate niche upload, so -- measuring this directly -- the strongest trained classifier, given every feature and thousands of examples, separates the two no better than chance, catching 4.2% of attacks at a 1% false-positive rate. We prove this limit for the entire class of ingestion-time statistics (any decision from documents and reference queries alone), and it reproduces -- and worsens -- across two corpora and five encoders. The one signal that separates an attack from legitimate niche ingestion -- a query's demand -- is invisible before retrieval, which is also the escape: a retrieval-time detector that observes demand catches 100% of the attacks at the same 1% false-positive rate. Coverage of the query space by an admission gate is not containment of coordinated poisoning; robust defense must move past the front door, to demand.
23. 【2608.16043】Coverage Is Not Redundancy: Maintenance Cost and Exposure of Query-Aware Admission Indexes in Vector Databases Under Workload Drift
链接：https://arxiv.org/abs/2608.16043
作者：Prashant Kumar Pathak
类目：Databases (cs.DB); Information Retrieval (cs.IR)
关键词：vector database serving, database serving production-scale, anomalously large share, single inserted document, serving production-scale retrieval
备注： 8 figures. Preprint; under submission
点击查看摘要
Abstract:In a vector database serving production-scale retrieval, a single inserted document can be retrieved for an anomalously large share of the query workload -- a retrieval hub -- and dominate the evidence returned for an entire topic. An emerging defense guards against this at ingest with an admission check: it maintains a set of sentinel queries and admits a document only if its reverse-kNN count against them stays below a threshold tau. Under workload drift this sentinel set is a query-aware auxiliary index that must be maintained online, and we study the cost that maintenance imposes on the ingest path. We identify a structural limit -- coverage is not redundancy: a monitor stops promoting sentinels once a region is covered, but the predicate rejects a hub only once tau sentinels witness it, so exposure has an observation-limited floor that no reduction in update or enforcement latency can close. On real HNSW, IVF-Flat, and IVF-PQ indexes over an 8.8M-vector MS MARCO corpus this floor is only a best case: as index recall falls, exposure and churn rise above it, and below recall ~0.5 the gate stops containing altogether -- worst on the memory-compressed IVF-PQ used at billion scale -- while a recall-aware witness probe restores containment at a fixed O(|S|d) admission cost, under 0.1% of the ANN insert. We validate the law under real (COVID-19) workload drift, implement the gate in PostgreSQL/pgvector at a 0.33% ingest tax, and turn the bound into a provisioning rule that sizes the sentinel budget per emerging region. A count test contains the hub where retrieval-time score normalizers (NNN, QB-Norm) do not, and a pre-registered causal suite isolates the missing-coverage mechanism from retrieval fragmentation across two embedding families (BGE-1024, E5-768).
24. 【2608.16004】LineageRAG: Harnessing GraphRAG by Constructing Evidence Lineages with Source Grounding
链接：https://arxiv.org/abs/2608.16004
作者：Linyao Zheng,Xuhang Shi,Zhifang Mao,Sai Zhou,Shuaixian An,Xiuquan Hou,Jinze Li
类目：Information Retrieval (cs.IR)
关键词：Graph-based Retrieval-Augmented Generation, Graph-based Retrieval-Augmented, Retrieval-Augmented Generation, structured cor, multi-hop questions
备注：
点击查看摘要
Abstract:Graph-based Retrieval-Augmented Generation (GraphRAG) retrieves evidence for multi-hop questions over structured cor- pus graphs. Existing GraphRAG methods leave the connection between evidence discovery and source grounding implicit. We propose LineageRAG, which constructs one evidence lin- eage for each query-derived evidence demand and completes it with a verbatim source span when the selected evidence supports that demand. LineageRAG first initializes the evi- dence demands. It then expands each lineage through demand- conditioned retrieval over the corpus graph while retaining the demand associated with every candidate. Lineage completion uses this provenance to select complementary passages and grounds supported demands in verbatim source text. Experi- ments on HotpotQA, 2WikiMultiHopQA, and MuSiQue show that LineageRAG improves R@5, EM, and F1 by 3.51, 5.96, and 5.22 points on average over leading GraphRAG baselines.
25. 【2608.15949】Ask to Be Sure: Informative Interactions for Confident Multi-Turn LLM Recommendation
链接：https://arxiv.org/abs/2608.15949
作者：Cedar Site Bai,Duanshun Li,Zhenyu Liao,Sheikh Sarwar,Huiyuan Chen,Yuan Chen,Changhe Yuan,Haiyang Zhang,Qilin Qi
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, Recent advances, conversational recommender systems, demonstrating strong recommendation, strong recommendation accuracy
备注： CIKM 2026
点击查看摘要
Abstract:Recent advances in large language models (LLMs) have enabled their use as conversational recommender systems (CRS), demonstrating strong recommendation accuracy and natural dialogue. However, guiding multi-turn interactions to elicit user preferences effectively remains challenging. Existing approaches either use separate reinforcement learning agents with templated interactions or optimize for interactivity judged by another LLM, without measuring how much useful information is actually gained. We propose a new approach that quantifies the effectiveness of each interaction by the reduction in the assistant's uncertainty, measured via entropy over recommendations. We apply this entropy reduction as a reward---without relying on ground-truth recommendations, which are often unavailable in real-world scenarios---to fine-tune the LLM, enabling strategic interaction generation. Empirical results with supervised fine-tuning (SFT) and direct preference optimization (DPO) on the INSPIRED and ReDial datasets show that our method improves both recommendation quality and conversational efficiency.
26. 【2608.15919】Noesis: Bidirectional Graph-RAG with Adaptive Parallelism and Cross-Knowledge-Base Semantic Discovery
链接：https://arxiv.org/abs/2608.15919
作者：Nicola Cogotti
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：grounding large language, Retrieval-Augmented Generation, large language models, domain-specific corpora, AIMD Concurrency Controller
备注： 14 pages, 6 figures, 4 tables. Patent pending
点击查看摘要
Abstract:Retrieval-Augmented Generation over knowledge graphs (Graph-RAG) has emerged as a powerful paradigm for grounding large language models in domain-specific corpora. However, existing systems face persistent limitations: (1) static chunking fragments long documents, losing cross-section semantic connections; (2) ingestion pipelines do not scale adaptively; and (3) multi-domain deployments require either a monolithic knowledge base that dilutes retrieval precision or manual user routing. We present Noesis, a decoupled Graph-RAG architecture addressing these limitations through four algorithms: (a) Bidirectional Graph Traversal with a Graph-Feedback Context Resolver simulating human reading with degrading memory; (b) an AIMD Concurrency Controller adapted from TCP congestion control, achieving 23x speedup with zero OOM events; (c) Moesis, domain-aware selective quantization for MoE models achieving 6.3x speedup on 12 GB consumer GPUs; and (d) Mesh, cross-KB semantic routing with runtime structural discovery enabling small on-premises models to perform multi-hop cross-domain reasoning. On HotpotQA (1,000 questions), Noesis achieves 59.5 EM / 74.7 F1, surpassing GraphRAG by +27.8 EM while using a 35B on-premises model for graph construction rather than GPT-4o. Source text verification on a 193-page document confirms 90% precision on long-range causal edges inaccessible to chunk-independent extraction.
27. 【2608.15909】Large language model-assisted discovery of cohorts from scientific literature
链接：https://arxiv.org/abs/2608.15909
作者：Moritz Sturm,Lisa M. Berg,Inken Berg,Harishny Sarma,Jasmin Hartmann,Denissa Girschik,Gemma Roig,Christine M. Freitag,Andreas G. Chiocchetti
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Planning multi-study analyses, multi-study analyses requires, analyses requires identifying, Planning multi-study, requires identifying cohorts
备注：
点击查看摘要
Abstract:Background: Planning multi-study analyses requires identifying cohorts with the relevant participants, phenotypes, and data modalities. This process commonly relies on prior knowledge, cohort catalogues, and manual literature searches. We developed a complementary question-driven framework that searches relevant scientific literature and extracts explicit cohort names. Methods: The framework first generates multiple PubMed queries from configurable vocabularies and templates and retrieves the resulting scientific literature automatically through the PubMed API. A large language model then screens the retrieved titles and abstracts and extracts explicit cohort names using a prompt tailored to the research question. The extracted names are deduplicated with human review. Configurable code, prompts, and example outputs are available at this https URL. Evaluation: As a use case, we applied the framework to youth aggression genetics. From 5,400 generated PubMed queries, the framework retrieved 5,254 unique records and identified 188 candidate cohorts. Manual screening using predefined criteria, including participant age and genetic-data availability, retained 44 eligible cohorts. Automated LLM-based name extraction was within the agreement range of human annotators. We also searched four established cohort catalogues using the same research question. Their combined results contained 27 of the 44 eligible cohorts, while 17 were not returned by any cohort catalogue search. Conclusion: The framework converts research-question-specific vocabulary into screenable cohort inventories via a large, automated literature search. It can be adapted across populations, phenotypes, data modalities, and study designs, and provides a literature-based complement to curated cohort catalogues.
28. 【2608.15896】When Search Eats the Web: A Model of Corpus Erosion under Generative Extraction
链接：https://arxiv.org/abs/2608.15896
作者：Sylvain Peyronnet
类目：Computer Science and Game Theory (cs.GT); Information Retrieval (cs.IR)
关键词：Generative search engines, crawled web content, Generative search, user queries directly, queries directly
备注： 19 pages including a 1 page appendix
点击查看摘要
Abstract:Generative search engines (GSEs) answer user queries directly from crawled web content. The capture of value from the corpus without a visit returned to the source (we call this capture extraction) diverts the traffic that finances content production. In response, publishers may restrict crawler access to their websites. In this paper, we model the crawlable corpus as a common-pool resource: the crawlable commons. It is described by three quantities: volume, average quality, and lifetime. Under two types of responses of publishers we prove that extraction degrades all three at once: publishers opt out, renewal loses its funding, and content becomes more perishable. After a given erosion threshold, the corpus goes extinct. A myopic GSE can cross this threshold, a long-run oriented GSE stays below it. We extend our model to several competing engines and prove, under a concavity condition on the steady-state value of the commons, that the symmetric equilibrium extraction rate is nondecreasing in their number and converges to the threshold. Adding users who strictly prefer direct answers, the assumption most favorable to extraction, we prove that the socially optimal extraction rate lies strictly below the erosion threshold, and no higher than the single engine's sustainable optimum. Finally, we discuss seven survival mechanisms.
29. 【2608.15851】Dense Expands, Sparse Anchors: Channel-Asymmetric Query Expansion for Hybrid Retrieval
链接：https://arxiv.org/abs/2608.15851
作者：Chunran Zhang
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：generating document-like passages, generating document-like, LLM-based query expansion, retrieval, LLM-based query
备注： 13 pages, 4 figures. Code and artifacts: [this https URL](https://github.com/ln-one/dense-expands-sparse-anchors)
点击查看摘要
Abstract:LLM-based query expansion improves retrieval by generating document-like passages. In hybrid retrieval, however, most evaluations fuse fixed top-$L$ dense and sparse rankings. Because the cutoff controls both which cross-channel contributions enter fusion and how much of each ranking is accessed, gains measured at one $L$ can change or reverse at another. We separate these effects by evaluating retrieval effectiveness under complete-list fusion and recording the policy-specific per-channel replay stopping depths at which its ordered top-$K$ is certified. We then introduce DESA (Dense Expansion and Sparse Anchoring), a channel-asymmetric query expansion method. An LLM generates complementary reference passages; orthogonal residual expansion adds their new semantic directions to the dense query, while score-product anchoring incorporates their lexical cues into sparse retrieval without broadening the original query's lexical support. Across seven BEIR datasets, DESA improves nDCG@10 and Recall@20 over the unexpanded query by 3.82% and 2.38%, while reducing dense and sparse access depths by 36.90% and 36.56%. With equal dataset weighting, 63.31% of queries become shallower in both channels. However, both depths increase with Contriever on Touché-2020. These results support channel-specific integration of generated passages and joint evaluation of retrieval effectiveness and access depth.
30. 【2608.15780】Decomposing Staleness in Recommender Systems: A Dual-Filter Framework for Supersession and Decay
链接：https://arxiv.org/abs/2608.15780
作者：Di Bai,Feng Han,Zhenwei Tang,Jintao Liu,Luoshu Wang,Jialu Liu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：large-scale content platforms, pervasive challenge, leading source, complaints on large-scale, Stale
备注： CIKM Applied Research Track 2026
点击查看摘要
Abstract:Stale recommendations are a pervasive challenge and a leading source of user complaints on large-scale content platforms. Items lose relevance through two primary mechanisms: supersession, where emerging updates render prior coverage stale, and relevance decay, where an item's informational value naturally diminishes over its lifecycle. Traditional countermeasures serve as crude proxies: age cutoffs poorly reflect actual relevance loss, while engagement heuristics rely on lagging signals, broadly exposing users to stale content before the system adapts. We present SDF (Supersession-Decay Filtering), a staleness filtering system fully deployed in Google Discover, a personalized recommendation feed with hundreds of millions of daily and billions of monthly active users. SDF targets both mechanisms with complementary filters, each powered by a learned model: a relational staleness model that detects supersession between item pairs, and a predicted traffic ratio (PTR) model that forecasts relevance decay from the item's content, trained on lifetime visit traffic. Applied via disjunction upstream of the ranking stage, SDF prunes stale candidates, measurably reducing downstream serving costs. Online experiments demonstrate that these filters significantly reduce the prevalence of stale content while improving user engagement. Over a two-year production deployment, user-filed staleness reports (in-product user feedback) declined by 54.9% relative to the pre-deployment baseline, establishing SDF as a robust and scalable paradigm for resolving content staleness at industrial scale.
Comments:
CIKM Applied Research Track 2026
Subjects:
Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.15780 [cs.IR]
(or
arXiv:2608.15780v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.15780
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1145/3799682.3840082
Focus to learn more
DOI(s) linking to related resources</p>
31. 【2608.15719】PLeDO: Pain Level Detection for Osteoarthritis from EMR Data
链接：https://arxiv.org/abs/2608.15719
作者：Yuhao Chen,Jiahao Cai,Nafiz Sadman,Farhana Zulkernine,John Queenan,David Barber
类目：Artificial Intelligence (cs.AI); Emerging Technologies (cs.ET); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：progressive chronic joint, chronic joint disease, joint disease resulting, damaged joint tissues, Electronic Medical Records
备注： Published in Intelligent Data Analysis, 2026
点击查看摘要
Abstract:Osteoarthritis (OA) is a progressive chronic joint disease resulting in a breakdown of articular cartilage and bone when damaged joint tissues are not able to normally repair themselves. The aim of this pilot research study is to understand the pain severity for OA from patients' primary care Electronic Medical Records (EMR), both from the structured medical data and the unstructured chart note data using information extraction, natural language processing and machine learning techniques. We propose SPaDe, a Synonym-based Pain level Detection tool to categorize patients into having mild or moderate-to-severe pain to understand diagnosis and treatment methods based on only the pain related expressions in the unstructured chart note. Expressions are subjective, objective, and influenced by cultural background and demography which poses a difficult challenge. Therefore, we improve the model by incorporating the medication information from the structured EMR data and pain scale related information from the chart note to propose an integrated pain level detection tool for OA called PLeDO. With the help of human labeled gold standard data, we demonstrate that both SPaDe and PLeDO can detect mild and moderate-to-severe pain from the EMR data to analyze and potentially improve the quality of care in primary care setting.
32. 【2608.15702】he EMN Country Factsheets Structured Dataset
链接：https://arxiv.org/abs/2608.15702
作者：David Alonso del Barrio,Daniel Gatica-Perez
类目：Information Retrieval (cs.IR)
关键词：EMN Member States, European Migration Network, EMN Member, Member States, States and observer
备注：
点击查看摘要
Abstract:Each year, the European Migration Network (EMN) country factsheets deliver an overview of key migration and international protection developments within all EMN Member States and observer countries. The factsheets include both a textual component and a visual component. In this paper, we introduce a curated dataset of the textual component of these reports over 35 countries and 13 years (2012-2024.) The dataset was created to facilitate European-level research on migration policies and developments, and promote the use of reliable sources about migration in data science and media research, particularly at a time when the spread of online misinformation about migration constitutes a serious issue. The dataset transforms the original document texts into a tabular format, with columns corresponding to country, year, section, subsection, content, and harmonized title section. We illustrate the value of the dataset with concrete analyses and propose envisioned applications and uses of the dataset. The dataset is accessible through a DOI link.
33. 【2608.15698】ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval
链接：https://arxiv.org/abs/2608.15698
作者：Peng Chunyi,Xu Zhipeng,Yan Yukun,Liu Zhenghao,Yu Shi,Mei Sen,Sun Yubo,Zhang Yongheng,Zhou Jie,Gu Yu,Yu Ge,Sun Maosong
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：multimodal retrieval-augmented generation, identify query-relevant pages, Visual, Visual document retrieval, retrieval-augmented generation
备注：
点击查看摘要
Abstract:Visual document retrieval is a critical component of multimodal retrieval-augmented generation, aiming to identify query-relevant pages from document collections where evidence is distributed across text, layout, charts, and visual structures. Recent efforts toward finer-grained supervision primarily rely on textual descriptions or localized visual regions as evidence proxies. However, such supervision signals may either overlook complex visual structures or provide incomplete and inaccurate representations of the underlying evidence. To address these limitations, we propose ConceptFormer, a latent concept representation learning framework for visual document retrieval. ConceptFormer models query-relevant evidence as continuous, query-conditioned latent concepts that explicitly bridge localized visual evidence and semantic relevance, without requiring either textual intermediate representations or direct reliance on raw visual annotations. During training, ConceptFormer employs a strong vision-language model to dynamically determine the number of latent concept tokens and uses these concepts as an intermediate representation to bridge the semantic gap between queries and documents, thereby guiding the learning of the embedding space. Experiments on diverse visual document retrieval benchmarks demonstrate that ConceptFormer achieves 16.7\% and 22.1\% relative improvements in average NDCG@10 over the strongest visual retrieval baseline and the strongest OCR-based text retrieval baseline, respectively. Further analysis reveals that latent concepts effectively connect localized visual evidence with semantic relevance, enabling the retriever to capture both fine-grained textual cues and complex document-level visual structures while preserving strong retrieval alignment. Codes and data are available at this https URL.
34. 【2608.15624】Can Retrievers Find the Same Paper from Different Aspects? A Multi-Aspect Full-Paper Scientific Retrieval Benchmark
链接：https://arxiv.org/abs/2608.15624
作者：Yiyang Wei,Fang Guo,Qiji Zhou,Zhizhang Fu,Mengru Ding,Kai Yang,Yue Zhang
类目：Information Retrieval (cs.IR)
关键词：multiple searchable facets, multiple searchable, queries, searchable facets, paper
备注：
点击查看摘要
Abstract:Scientific papers contain multiple searchable facets such as background, methods. However, many paper retrieval benchmarks merely evaluate individual query-paper relevance, while overlooking other facets of the same paper. To bridge this gap, we introduce MAPLE, an expert-validated benchmark for multi-aspect, full-paper retrieval that evaluates whether retrievers can consistently recover the same paper from queries targeting its motivation, method, and experimental findings. MAPLE contains 2,095 queries about recent ML and NLP papers, grounded in both textual and multimodal content. We further propose MAPLE-Synth, a retrieval-based in-context learning pipeline that leverages OpenReview discussions and human-written query exemplars to generate realistic queries reflecting researchers' interests in different aspects of a paper. Our expert validation shows that these queries are comparable in realism to human-written queries and highly relevant to the target papers. Experiments across lexical, scientific-domain, general-purpose text, and multimodal retrievers reveal a substantial gap between retrieving a paper from any one aspect and retrieving it from all aspects: the strongest model achieves 98.1% AnyAspect@20 but only 15.7% AllAspect@20. Experiment/result queries and table-referenced queries are particularly difficult across retrievers. Although multi-chunk aggregation improves multi-aspect paper retrieval, considerable failures persist. MAPLE provides a testbed for evaluating and developing retrievers that represent scientific papers more comprehensively.
35. 【2608.15438】NeuRoute: Logit-Guided Neural Routing for Billion-Scale Vector Search with Sub-Hour Index Construction
链接：https://arxiv.org/abs/2608.15438
作者：Xingqiao Wang,Zi Wang,Xiaowei Xu
类目：Databases (cs.DB); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Building approximate nearest, approximate nearest neighbor, first-order systems concern, Building approximate, expensive global clustering
备注： 34 pages, 9 figures
点击查看摘要
Abstract:Building approximate nearest neighbor (ANN) indexes at billion scale is often dominated by expensive global clustering or graph construction, making time-to-index a first-order systems concern. We present NeuRoute, a learned hashing index that turns short binary codes into an effective routing primitive for large-scale vector search. NeuRoute trains a lightweight neural network encoder with a selective similarity-preserving objective to produce well-balanced binary addresses. During construction, NeuRoute organizes vectors into buckets by their codes and performs bucket-local clustering in the encoder's low-dimensional space to form centroids. At query time, NeuRoute exploits the encoder logits as an uncertainty signal: it uses deviation-to-threshold scores to prioritize uncertain-bit perturbations for query-adaptive multi-bucket probing, scores bucket-local centroids by their distances to the query to form a compact candidate cluster set, and applies centroid-stage gating with heap-quality-driven early stopping to prune low-value clusters before exact refinement. On billion-scale benchmarks, NeuRoute achieves strong accuracy-throughput trade-offs with fast index construction: on BigANN-1B it reaches $90.3\%$ Recall@10 at 2,414 QPS and is $1.7\times$ faster than OPQ+IVF-PQ (refine) at comparable accuracy, while completing end-to-end training+construction in under an hour on both BigANN-1B and Deep1B-1B. These results show that logit-guided neural routing can make hashing competitive as a lightweight ANN indexing framework at billion scale. Source code and artifacts are available at this https URL.
36. 【2608.15429】SAGA: Structure-Attended Generative Action Embedding Model that encodes Multi-Surface User Action Sequences
链接：https://arxiv.org/abs/2608.15429
作者：Tsz Fung Pang,Po Jen Chen,Nimish Ronghe,Farhad Farahani,Bo Zhang
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：distinct behavioral domains, capture cross-surface behavioral, cross-surface behavioral signals, behavioral signals spanning, spanning distinct behavioral
备注： 9 pages, 3 figures. Accepted to ACM RecSys 2026 Context-Aware Recommender Systems (CARS) workshop
点击查看摘要
Abstract:Prior embedding models for sequential recommendation typically operate within a homogeneous action space, limiting their ability to capture cross-surface behavioral signals spanning distinct behavioral domains. We present SAGA, a generative action embedding model that encodes multi-surface user interaction sequences across a Financial Service organization's ecosystems, from checkout, peer-to-peer (P2P) transactions, in-app engagement, email to account actions, into a unified user representation for downstream recommendation tasks. Central to SAGA is a per-field tokenization schema that decomposes each action event into multiple field-level tokens (e.g. product, interaction, surface), enabling field-level attention and per-field training objectives that fused single-token approaches cannot support. Through an offline ablation study on loss formulation, tokenization granularity and training data scope, we isolate the contribution of each design choice. A downstream model integrated with SAGA-generated user embeddings delivers the strongest overall click and conversion lift across diverse downstream touchpoints, compared to all ablated and alternative architectures.
37. 【2608.15382】Grounding Healthcare LLMs in a Causal Knowledge Graph: Framework, Metrics, and a Cardiovascular Pilot
链接：https://arxiv.org/abs/2608.15382
作者：Ummara Mumtaz,Aimen Noor,Awais Ahmed
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Large language models, healthcare decision support, Large language, reward single-answer accuracy, decision support
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly proposed for healthcare decision support, but their evaluations still reward single-answer accuracy rather than reasoning about interventions, mechanisms, harms, evidence, and uncertainty. We propose a reproducible, graph-centered evaluation framework for intervention-oriented LLM behavior in healthcare and stress-test it in a cardiovascular pilot. The framework has four components: (i) a domain causal knowledge graph in which assertions are first-class, provenance-preserving nodes with stable identifiers; (ii) a scenario-conditioned subgraph extraction step that, given any clinical scenario, retrieves the relevant reified-assertion subgraph; (iii) four controlled grounding conditions that vary how the retrieved subgraph is composed into the model's context (ungrounded C1, knowledge-graph C2, causal-graph C3, integrated C4); and (iv) an automated scoring pipeline, anchored on assertion identifiers, that computes intervention accuracy, and other evaluation measures on a single pass. To test the framework, we built a category-balanced scenario generator across eight reasoning failure modes and instantiated it on a cardiovascular graph. The metric panel discriminates conditions along interpretable, non-redundant axes: C4 obtains the strongest causal edge F1 (0.838), adverse-effect F1 (0.833), evidence accuracy (0.738), and unsupported claim rate (0.114), while C1 obtains the highest raw intervention accuracy (0.948) with no measurable causal or evidential grounding.
38. 【2608.15213】DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting
链接：https://arxiv.org/abs/2608.15213
作者：Hao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：recover reliable local, Crowd counting, variations in perspective, background clutter, recover reliable
备注：
点击查看摘要
Abstract:Crowd counting must recover reliable local density under severe variations in perspective, head scale, occlusion, and background clutter. Although modern counting objectives provide strong spatial supervision, many multi-level decoders still use spatially invariant feature fusion and apply one receptive-field pattern to every location. We propose DCA-MoE, a framework that makes both decisions content dependent while retaining a frozen DINOv3 encoder. Spatially Adaptive Layer Fusion (SALF) predicts position-wise weights over four aligned backbone features, and Density-Routed Multi-Receptive-Field Experts (DR-MoE) assigns each location a soft mixture of local, mid-range, and large-context residual experts. An EBC-style head reconstructs block density, while DMCount supervision and an auxiliary routing-balance term train the decoder without updating the backbone. On the NWPU-Crowd validation split, the strongest paired configuration, based on DINOv3 ViT-L/16, obtains 31.7 MAE and 72.2 RMSE; the matched ViT-B/16 full model obtains a paired 32.2/75.9. Cross-dataset results remain mixed, and several component baselines currently report independently selected minima from a single seed. The evidence therefore supports the feasibility of spatially adaptive fusion and routing, while broader paired and multi-seed evaluation remains necessary for causal attribution.
39. 【2608.15191】When Deep Research Agents Stagnate: Enhancing Reasoning with Retrieval-Aware Agent Control
链接：https://arxiv.org/abs/2608.15191
作者：Heydar Soudani,Elizabeth Lingg,Faegheh Hasibi,Navid Rekabsaz
类目：Information Retrieval (cs.IR)
关键词：agents lack awareness, Retrieval-Aware Agent Controller, show that existing, improvement to final, lack awareness
备注：
点击查看摘要
Abstract:In this paper, we analyze the reasoning trajectories of a variety of DRAs and show that existing agents often suffer from reasoning stagnation: the majority of iterations contribute little or no improvement to final performance, while agents lack awareness of their trajectories and are therefore ineffective at adapting their search strategies or determining when to terminate. To address this issue, we introduce a set of unsupervised signals and a Retrieval-Aware Agent Controller (RAAC), which assists the agent in selecting optimal actions at each stage of the research process. RAAC incorporates key information retrieval principles, namely search novelty and information coverage, resulting in more effective reasoning trajectories that improve overall performance while reducing unnecessary iterations, and consequently cost and latency. Specifically on BrowseComp-Plus and across a large set of DRAs, adding RAAC reduces the number of search calls by an average of 14, significantly improves the best-performing DRA on recall and accuracy, and achieves an accuracy gain of up to 10% (3% on average).
40. 【2608.14838】he Recall Trap: A Recall-Maximizing Retriever Configuration Reduces Issue Resolution in Fixed-Budget Code Context
链接：https://arxiv.org/abs/2608.14838
作者：Alexander Adkins,Teimuraz Trapaidze
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：downstream task success, Retrieval components, assumed to follow, success is assumed, retrieval metrics
备注： 24 pages, 2 figures. Reproducibility artifact: Zenodo DOI [https://doi.org/10.5281/zenodo.21879550](https://doi.org/10.5281/zenodo.21879550)
点击查看摘要
Abstract:Retrieval components for code assistants are tuned against retrieval metrics: a configuration that raises recall@k is adopted, and downstream task success is assumed to follow. We report a controlled case study in code repair, not a new phenomenon but a deployed-flag, execution-graded instance of the known relevance-diversity and objective-mismatch tradeoff (Levy et al., 2025). On SWE-bench Verified we inject a retriever's hits as a fixed 12-slot context pack with no search tools and toggle one flag (one-chunk-per-file deduplication) on an otherwise identical stack. The flag is the higher-recall configuration (gold file present in 0.878 of served packs against 0.806 disabled), yet disabling it, trading file breadth for within-file depth, raises the single-shot resolve rate: gpt-5.6-sol +7.6pp (39.2% to 46.8%, n=500, McNemar exact p=0.0003), and a pre-registered open-weights replication any reviewer can re-run (Qwen3.6-27B, +3.6pp, n=499, p=0.0133); both survive repository-clustered inference. The gain tracks within-file anchor dose, and a random-chunk control refutes an argmax-selection artifact. We map where it holds: it reverses on a lexical BM25 retriever (-3.2pp, significant cross-paradigm interaction), is not detected under unrestricted-Read agents (a powered null), and across four languages (SWE-PolyBench, N=617) is positive but not significant (+2.6pp, p=0.056), a mapped boundary rather than a confirmed extension. Operationally, at a tight fixed budget: do not hard-deduplicate by file, and A/B packing policies against the task, not the metric the flag was tuned to.
41. 【2608.14776】NRCD: An Open Database of Collegiate Running with Unified Performance Standardization
链接：https://arxiv.org/abs/2608.14776
作者：Jonathan A. Karr Jr.,Ryan M. Fryer,Ben Darden,Nicholas Pell,Kayla Ambrose,Evan Hall,Ramzi K. Bualuan,Nitesh V. Chawla
类目：Machine Learning (cs.LG); Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：United States generates, States generates thousands, United States, States generates, race results annually
备注： Accepted to CIKM'26 Resources Paper - Main Conference
点击查看摘要
Abstract:Collegiate running in the United States generates thousands of race results annually in cross country and track and field, yet no large-scale dataset has been publicly available for research. Existing websites such as this http URL, MileSplit, and TFRRS host results but do not support bulk download, restricting prior analyses to ~500 performances, often skewing studies toward male athletes. We introduce the National Running Club Database (NRCD), the first openly available collegiate running dataset at scale: 128,963 approved performances from 28,913 athletes across 1,336 meets in four sports (cross country (XC), indoor and outdoor track, and road races), 36.3% women, spanning 2004 through 2026. Within that single export, meets from August 2023 onward carry comprehensive course distance, elevation gain and loss, weather at race time, and track venue metadata (97.7% of XC rows with weather fields); earlier seasons back to 2004 are included with sparser metadata. NRCD is community-governed through open submission and expert approval and is maintained as a live database whose meet volume has grown yearly. We release a unified performance standardization framework that operationalizes established distance, elevation, and heat adjustments in one pipeline. Furthermore, we recommend gender-stratified modeling. On XC, full standardization lowers median within-athlete cross-meet variability by 51.0% (women) and 34.4% (men) versus raw times. We release the dataset and pipeline with a python package `nrcd' under FAIR principles, supporting longitudinal athlete modeling, environmental-confounder studies, and gender-equity research in collegiate sport.
42. 【2608.14658】pico-type: A 1.5M-Parameter Byte-Level Multi-Head Content Classifier
链接：https://arxiv.org/abs/2608.14658
作者：Gautam Kishore
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：single forward pass, byte-level multi-head content, multi-head content classifier, classifier with approximately, million parameters
备注： 14 pages, 1 figure, 8 tables
点击查看摘要
Abstract:We introduce pico-type, a byte-level multi-head content classifier with approximately 1.5 million parameters that simultaneously predicts seven content properties from raw UTF-8 bytes in a single forward pass. Operating directly at the byte level -- no tokenizer, no subword vocabulary, no pretrained embeddings -- pico-type classifies coarse type (12 classes), modality (8), subtype (24), code language (62), text language (30), file MIME type (90), and risk flags (6-label multi-label: API keys, JWTs, passwords, emails, phone numbers, SSH keys). The architecture combines a learned byte embedding, three convolutional blocks with growing receptive fields, two bidirectional attention layers with rotary position encodings, and a statistical pooling layer feeding seven Matryoshka-style classification heads. Four tiered variants (tiny/small/base/pro) share the same trunk with sliced representations from 16 to 576 dimensions, yielding ONNX exports under 210 KB and CPU inference under 10 ms. Trained on a mixture of synthetic templates and real-world data (8709 GitHub code samples, 5000 Wikipedia articles), pico-type achieves 60.3 percent code language accuracy on The Heap benchmark (24 languages) and 98.2 percent text language accuracy on Wikipedia (30 languages) -- improvements of +57 and +79 percentage points respectively over the synthetic-only baseline. Format-based heads (coarse, modality, subtype, file_mime, risk) maintain 100 percent accuracy on synthetic benchmarks. The model, code, and pretrained weights are released under Apache 2.0.
43. 【2608.14602】Recommended Selves: Authenticity and Algorithmic Filtering
链接：https://arxiv.org/abs/2608.14602
作者：Etienne Brown
类目：Computers and Society (cs.CY); Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：pieces of content, digital platform, allocating their attention, attention to pieces, shapes the daily
备注： 21 pages. Published in the Journal of the American Philosophical Association 12(1): 15-34 (2026). DOI: [https://doi.org/10.1017/apa.2025.10009](https://doi.org/10.1017/apa.2025.10009)
点击查看摘要
Abstract:By allocating their attention to pieces of content, algorithmic filtering shapes the daily behavior of billions of users when they interact with a digital platform. Beyond conditioning what we do, can recommendation algorithms influence who we are? This article suggests that they do. Specifically, I contend that recommender systems affect users' capacity to be their authentic selves in both positive and negative ways. I start by offering an account of authenticity that builds on two central concepts: volitional alignment and self-understanding. I then explain how algorithmic filtering works and impacts authenticity. While recommender systems frustrate users' second-order desires by relying on uninformative behavioral signals, they also facilitate self-understanding by inciting users to question their identity. I end by discussing how controllable and explainable recommenders would best enable users to be authentic.
44. 【2608.14580】OGX: An Open-Source, Vendor-Neutral Generative AI Application Server
链接：https://arxiv.org/abs/2608.14580
作者：Francisco Javier Arceo,Sébastien Han,Matthew Farrellee,Charlie Doern,Yuan Tang,Derek Higgins,Varsha Prasad Narsing,Gordon Sim,Sumanth Kamenani,Ben Browning,Raghotham Murthy
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：major frontier labs, Open GenAI Stack, Python library, Anthropic Messages API, pluggable backend providers
备注：
点击查看摘要
Abstract:OGX (Open GenAI Stack) is an open-source AI application server and Python library that implements the APIs of major frontier labs (OpenAI, Anthropic, Google) with pluggable backend providers. Developers building agentic AI applications--such as retrieval-augmented generation pipelines, multi-turn agents, and tool-calling workflows--can develop against a single API surface and deploy with any combination of inference engine, vector database, and safety backend, without changing application code. OGX's primary focus is the Responses API for server-side agentic orchestration, conforming to the Open Responses specification. The server also supports the Anthropic Messages API and Google GenAI Interactions API, decoupling SDK choice from model and deployment decisions. With over 20 inference providers, 13 vector store backends, and a companion Kubernetes Operator for production deployment, OGX serves as the self-hosted, model-agnostic backend for AI-powered developer tools including Claude Code, Codex CLI, OpenCode, and OpenHands. The project has over 8,400 GitHub stars, 242 contributors, and 4,000 commits across nearly two years of public development.
45. 【2608.14551】Auxiliary uncertainty signals for LLM-assisted systematic review screening: a benchmark across eight Cohen drug-class reviews
链接：https://arxiv.org/abs/2608.14551
作者：Arya Rahgozar,Pouria Mortezaagha
类目：Computation and Language (cs.CL); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：lack calibrated uncertainty, Large language models, decisions lack calibrated, Large language, systematic reviews
备注： 27 pages, 7 figures, 10 tables. Code, prompts, and cached LLM responses at [this https URL](https://github.com/rahgoar/LR-Spectral-BERTGCN-Topological-Undecidability-in-Clinical-AI)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used for title-abstract screening in systematic reviews, but their decisions lack calibrated uncertainty. We show that an auxiliary BERT+GCN classifier supplies a structured uncertainty signal that improves LLM screening efficiency, and we identify the prompt-delivery strategy that maximises the benefit-to-cost ratio. We evaluate five LLM prompt-delivery conditions on eight drug-class datasets from the Cohen (2006) benchmark using 3 seeds x 5-fold stratified cross-validation (600 fold-level results). A BERT+GCN model trained per fold classifies each test paper as INCLUDE, EXCLUDE, or MAYBE via two spectral tests (algebraic radical and categorical paradox). Conditions vary information content (none / label / full scores), selectivity (all papers vs. MAYBE only), and timing (proactive vs. reactive two-pass). A cross-model pilot against gpt-4.1-mini on three datasets tests cross-generation transfer. Three findings: (i) Full-context delivery yields significant gains in F1 (+0.011, paired Wilcoxon p=0.008) and WSS@95 (+0.050, p=0.039) at a 1.28x token-cost premium, while preserving recall. (ii) MAYBE-only routing is Pareto-optimal: highest mean recall (0.92) and AUC-ROC (0.54) at only 1.05x baseline cost -- one sixth of full-context overhead. (iii) The two-pass design escalates 22.2% +/- 8.8% of records yet never revises its decision (0% flip rate across all datasets and folds), giving decisive evidence that current instruction-tuned LLMs cannot self-triage. The cross-model pilot shows an identical +0.8% recall uplift for both LLM generations. A per-paper ablation across 20,796 observations shows the dual paradox test reduces empirically to a one-line logit-gap criterion. We release the full pipeline; the 600-run experiment replays in under one hour from cached LLM responses.
Comments:
27 pages, 7 figures, 10 tables. Code, prompts, and cached LLM responses at this https URL
Subjects:
Computation and Language (cs.CL); Digital Libraries (cs.DL); Information Retrieval (cs.IR); Machine Learning (cs.LG)
MSC classes:
68T50, 68T07, 62P10
Cite as:
arXiv:2608.14551 [cs.CL]
(or
arXiv:2608.14551v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.14551
Focus to learn more
arXiv-issued DOI via DataCite</p>
计算机视觉
1. 【2608.16889】Don't Drop the BATON: Long-Horizon Robot Manipulation via Agentic Subtask Exploration and Transition-aware Memory
链接：https://arxiv.org/abs/2608.16889
作者：Bingxin Xu,Yuzhang Shang,Emilio Ferrara
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：robot manipulation chains, Long-horizon robot manipulation, robot manipulation, VLA, manipulation chains
备注：
点击查看摘要
Abstract:Long-horizon robot manipulation chains many contact-rich skills into one multi-stage task. Vision-language-action (VLA) models increasingly master the individual skills, yet the chain still fails: errors compound beyond the policy's ability to correct, and one subtask silently constrains the next. A promising recipe freezes the VLA and puts an LLM agent in charge: it plans in language, moves in free space with analytic primitives, invokes the VLA only for contact-rich segments, and writes adaptation into language memory. Applied to long horizons, it breaks twice. (1) Competence comes from whole-task exploration at test time, whose cost is multiplicative in stages: if one stage needs T episodes, a K-stage task needs about T^K, and a failure does not reveal which stage caused it. (2) It has no representation of transitions: the VLA primitive carries an exit but no entry condition, so a subtask can succeed in a form its successor cannot use. We present BATON. Against (1), BATON makes the subtask the unit of exploration: each is explored in the cheap short-horizon regime and its solution stored in memory; a long-horizon trajectory is then composed from these solutions rather than discovered whole. Cost becomes additive (T*K) and every failure is attributed to a single stage. Against (2), BATON equips exploration with a transition-aware memory. Within a subtask, a verifier agent governs the invocation transition: the VLA is called only after the wrist view confirms the scene is ready. Across subtasks, a handoff transition restores an entry state disturbed by the predecessor's residue, and a lookahead transition selects the strategy whose outcome the successor can inherit. No parameters are updated. On the long-horizon benchmark RoboMemArena, BATON improves task success by 11.6% and cumulative success by 14.9% over the SoTA.
2. 【2608.16887】An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Models
链接：https://arxiv.org/abs/2608.16887
作者：Dengyang Jiang,Ruoyi Du,Zhennan Chen,Dongyang Liu,Zanyi Wang,Mingzhe Zheng,Xiangpeng Yang,Huanqia Cai,Aiming Hao,Yuming Jiang,Peng Gao,Harry Yang,Steven Hoi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：increasingly important topic, increasingly important, important topic, pixel-space diffusion models, generative modeling
备注： Z-Image-Pixel Empirical Insight of Training Pixel-Space Diffusion Models
点击查看摘要
Abstract:This paper investigates an increasingly important topic in generative modeling: pixel-space diffusion models. Although numerous studies have explored this topic, most focus on small-scale or class-conditional settings. Consequently, a practical recipe for training pixel-space models that rival or exceed well-established latent-space counterparts remains elusive. Through a comprehensive empirical study, we first observe that direct large-scale pre-training in pixel space converges substantially more slowly than in latent space. This observation motivates a latent-to-pixel strategy that acquires generative priors efficiently in latent space and transitions to pixel space during post-training. We then systematically investigate the key design choices governing this transition, including weight initialization, data composition, prediction target, decoder architecture, and noise schedule, and identify a practical recipe that makes the resulting pixel-space models match or outperform their latent-space counterparts while delivering 3.18 to 4.75 times end-to-end inference speedups. We hope that our findings provide useful empirical insights and practical guidelines for future research on pixel-space generation.
3. 【2608.16863】SplatGuide: Geometric Priors from 3D Gaussians for Pose-Free Novel View Synthesis
链接：https://arxiv.org/abs/2608.16863
作者：Yejun Zhang,Zihan Wang,Xu Ji,Yihao Wang,Yuxin Hou,Junyuan Fang,Juho-Matti Kilpeläinen,Arno Solin,Hamed Rezazadegan Tavakoli,Esa Rahtu,Juho Kannala
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：synthesize unseen content, Generating photorealistic, unseen content, unposed images requires, ability to synthesize
备注：
点击查看摘要
Abstract:Generating photorealistic novel views from unposed images requires both 3D geometric understanding and the ability to synthesize unseen content. A natural strategy combines feed-forward 3DGS reconstruction with multi-view diffusion. Yet prior pipelines extract at most one signal from the reconstruction, either pixel rendering or learned features, while none exploits per-Gaussian visibility for occlusion-aware reference selection. This *information disconnect* leaves renderable geometry, visibility cues, and learned features unused. SplatGuide closes this disconnect by reusing a single 3DGS scene across three complementary roles. Rendered images provide pixel-aligned geometric conditioning. Per-Gaussian source-view indices are rendered into a target-view voting map for occlusion-aware reference selection. Reconstruction tokens supply feature-level guidance via cross-attention. All three signals derive from the same reconstruction forward pass. Across RealEstate10K, DL3DV, Tanks-and-Temples, and Mip-NeRF 360, SplatGuide achieves state-of-the-art pose-free novel view synthesis. On RealEstate10K, with a moderate number of input views, it surpasses the ground-truth-pose baseline.
4. 【2608.16859】HarnessEval-W: Agentifying the Evaluation of Visual Worlds
链接：https://arxiv.org/abs/2608.16859
作者：Weiliang Chen,Haowen Sun,Jun Gao,Jiawei Chi,Hanyang Wang,Qiyu Dai,Yihao Li,Hao Li,Jingnan Gao,Yi-Hsin Hung,Xingzhuo Guo,Shangchen Miao,Zhiyuan Shi,Xiang Li,Fengrui Tian,Weihua Du,Ziqi Huang,Shenyuan Gao,Siqiao Huang,Mingyu Liu,Yifei Li,Shizun Wang,Xi Wang,Tianqi Zhang,Xue Luo,Xiyin Ren,Jinshan Ren,Xiaoyang Shen,Xiaobo Hu,Zhiyang Dou,Mingyu Ding,Yichao Yan,Xinchao Wang,Yizhou Wang,Shilong Liu,Wenzhao Zheng,Yueqi Duan,Yuan Gong,Ziwei Liu,Ming-Yu Liu,Jialong Wu,Jiangran Lyu,Fangfu Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scalar score, score, evaluation, world models, world
备注： Project Page: [this https URL](https://mirros-lab.github.io/HarnessEval-W)
点击查看摘要
Abstract:A benchmark should deliver more than a scalar score: what makes an evaluation trustworthy is the reasoning that justifies the score. This is especially critical for world models, where judging a rollout requires understanding whether physics, causality, and world state evolve correctly. Humans spot such violations naturally, yet no existing benchmark automates this capability: metrics are computed brute-force, leaving no reasoning chain that can be examined or verified. We introduce HarnessEval-W, an agentified evaluation pipeline that brings the harness paradigm from the LLM ecosystem to world model benchmarking. Rather than applying a fixed rubric, HarnessEval-W interprets the context of each evaluation case, decomposes the evaluation question into measurable subproblems, and spawns specialized sub-agents, each equipped with tailored context and diagnostic tools to reason over its own subproblem. The parent agent then validates the gathered evidence and summarizes it into the final verdict. This hierarchical workflow turns every evaluation into a transparent evidence tree whose complete reasoning chain justifies the result. We apply HarnessEval-W to 18 representative world models over 330 evaluation cases. Its judgments closely align with human preferences while providing verifiable, fine-grained diagnoses of every generated rollout. We open-source the full pipeline as a live benchmark and invite the broad community to contribute to grow new skills and evaluation cases as world models evolve.
5. 【2608.16855】Can Unsupervised Methods Outperform Supervised Deep Learning When Ground Truth Is Sparse? A Case Study of Bronchovascular Bundle Segmentation in Low-Dose CT
链接：https://arxiv.org/abs/2608.16855
作者：Anna Mrukwa(1),Marek Socha(1),Aleksandra Suwalska(1),Agata Durawa(2),Malgorzata Jelitto(3),Katarzyna Dziadziuszko(3),Edyta Szurowska(3),Pawel Bozek(4),Michal Marczyk(1 and 5),Witold Rzyman(2),Rafal Dziadziuszko(6),Joanna Polanska(1) ((1) Department of Data Science and Engineering, Silesian University of Technology, Gliwice, Poland, (2) Department of Thoracic Surgery, Medical University of Gdansk, Gdansk, Poland, (3) 2nd Division of Radiology, Medical University of Gdansk, Gdansk, Poland, (4) Department of Radiology and Radiodiagnostics, Medical University of Silesia, Katowice, Poland, (5) Department of Breast Medical Oncology, Yale School of Medicine, New Haven, CT, USA, (6) Department of Oncology and Radiotherapy, Medical University of Gdansk, Gdansk, Poland)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Background Lung cancer, lung cancer screening, Lung cancer, deadliest cancer worldwide, Lung cancer remains
备注： 17 pages, 4 figures. Part of this research was submitted to the international conference European Molecular Imaging Meeting 2026
点击查看摘要
Abstract:Background Lung cancer remains the deadliest cancer worldwide because it is often diagnosed too late. Effective treatment depends on detection at an early screening stage. However, the growing number of patients and the limited number of radiologists lead to prolonged diagnostic waiting times. In very early stage lung cancer, nodule visibility is further reduced by adjacent blood vessels and airway walls, because nodules are often connected to or supplied by these structures. Task-specific analysis of the bronchovascular bundle is therefore important for efficient nodule detection, and its removal can increase the diagnostic potential of lung cancer screening. Materials and Methods To assess the efficacy of the proposed method, we used series from widely utilized LDCT datasets, including the Duke Lung Cancer Screening (DLCS) dataset and the Pilot Pomeranian Lung Cancer Screening Program. The proposed bronchovascular bundle segmentation pipeline, RONALD, operates on computed tomography images and returns binary masks of vessels and bronchi located in the lung parenchyma. The method includes a preprocessing stage with lung, lobe, and mediastinum segmentation, followed by separate vessel and bronchial tree segmentation. Results The proposed pipeline segmented the bronchovascular bundle in low-dose computed tomography scans while improving nodule retention compared with other segmentation methods: from 93.98% and 90.36% to 100% in DLCS, and from 83.16% and 62.36% to 99.92% in the Pomeranian dataset. Conclusion The resulting segmentations can improve lung nodule detection in the very early stages of lung cancer.
Comments:
17 pages, 4 figures. Part of this research was submitted to the international conference European Molecular Imaging Meeting 2026
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.16855 [cs.CV]
(or
arXiv:2608.16855v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.16855
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Joanna Polanska [view email] [v1]
Mon, 17 Aug 2026 17:38:22 UTC (11,946 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Can Unsupervised Methods Outperform Supervised Deep Learning When Ground Truth Is Sparse? A Case Study of Bronchovascular Bundle Segmentation in Low-Dose CT, by Anna Mrukwa (1) and 35 other authorsView PDF
view license
Current browse context:
cs.CV
prev
|
next
new
|
recent
| 2026-08
Change to browse by:
cs
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
6. 【2608.16812】Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision
链接：https://arxiv.org/abs/2608.16812
作者：Long Cui,Xiaoqian Liu,Qi Qin,Yi Xin,Tao Lin,Jianguo Li,Linfeng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Existing image editing, frameworks predominantly follow, Existing image, predominantly follow, editing frameworks predominantly
备注：
点击查看摘要
Abstract:Existing image editing frameworks predominantly follow the training paradigm of text-to-image diffusion models. However, extending this paradigm to image editing highlights two inherent discrepancies, specifically, the insufficient attention to edit concept granularity and the training inefficiency caused by sparse supervision signals. To address these issues, we establish a comprehensive hierarchical taxonomy featuring over 1,000 fine-grained edit concepts and build ConceptEdit-12M, a massive dataset of 12 million high-quality editing pairs via an improved synthesis framework. This library-driven approach effectively rectifies the distribution collapse of generated data while ensuring high data fidelity. Furthermore, we propose a dense supervision training strategy that synthesizes multiple non-interfering concepts into single image pairs. By providing richer learning signals, this strategy significantly enhances both training efficiency and overall model performance. Training results validate our strategy, significantly outperforming prior works. Finally, we present ConceptEdit-Bench, a granular evaluation suite designed to diagnose model capabilities across a vast array of real-world scenarios.
7. 【2608.16810】Unsupervised Learning of Cell Instances with Generative Routing Pyramids
链接：https://arxiv.org/abs/2608.16810
作者：Ziwen Liu,Martin Weigert
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM)
关键词：Identifying and representing, representing object instances, microscopy image analysis, representing object, common task
备注： 15 pages, 4 figures; ECCV 2026 Workshop BIC
点击查看摘要
Abstract:Identifying and representing object instances such as cells or nuclei is a common task in microscopy image analysis. Established machine learning workflows typically use supervised detection or segmentation followed by feature extraction or classification, which requires manual annotations and treats instance segmentation and cell representation as separate stages. We describe a new unsupervised method for cell instance segmentation and phenotypic classification from unlabeled microscopy images. Our method is based on reconstructing each image using a coarse-to-fine routing pyramid that associates pixels with spatially sparse latent sources. The resulting pixel-to-latent associations yield instance masks, while the source latents encode cell morphology. We demonstrate competitive performance in instance segmentation across diverse cell morphologies and imaging modalities, as well as generative modeling of cellular phenotypes under perturbations. Source code and checkpoints are available at this https URL.
8. 【2608.16805】Diagnosing Dense Same-Class Attribute Misbinding in Large Vision-Language Models
链接：https://arxiv.org/abs/2608.16805
作者：Yuanzhi Xu,Qian Gao,Jun Fan,Guohui Ding,Zhenyu Yang,Yuteng Xiao,Sixue Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large vision-language models, Large vision-language, crowded scene, scene yet assign, recognize the objects
备注：
点击查看摘要
Abstract:Large vision-language models can recognize the objects and attributes in a crowded scene yet assign an attribute to the wrong same-class instance. Generic visual-question-answering accuracy marks the response as wrong, while object-hallucination metrics may regard both the object and attribute as image-supported; neither reveals the transfer. This study formalizes this blind spot as Dense Same-Class Attribute Misbinding (DSCAM) and presents InstaBind-Lite, a controlled benchmark that makes it directly measurable. Its 524 images contain 529 curated groups of 3-6 same-class entities, 1773 boxed instances, ordered neighbors, distinguishable color-like attributes, and four complementary question levels, yielding 9580 deterministically evaluated questions. Unlike existing protocols, source-instance annotations separate unsupported generation and recognition failure from an attribute copied from another visible entity. Binding-specific metrics further quantify transfer frequency, adjacency, ordinal distance, and intervention effects. Across five open-source and two commercial/API models, the open-source systems average 19.84% Misbinding Rate and the API systems 7.55%; these errors are hidden by aggregate accuracy. Among identifiable transfers, 80.70% and 81.51%, respectively, originate from adjacent instances. Localization and instance-first interventions help selected models but are not universal remedies. InstaBind-Lite therefore turns previously undifferentiated wrong answers into source-identifiable failure categories and tests a reliability dimension that conventional benchmarks cannot determine: whether a model knows not only what is visible, but which instance owns each attribute.
9. 【2608.16793】PixRestore: Unified Image Restoration via Pixel Diffusion Transformer
链接：https://arxiv.org/abs/2608.16793
作者：Lingchen Sun,Rongyuan Wu,Xiangtao Kong,Jixin Zhao,Qiaosi Yi,Yujing Sun,Shuaizheng Liu,Zhengqiang Zhang,Lei Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unified image restoration, Unified image, image restoration, content from low-quality, aims to recover
备注：
点击查看摘要
Abstract:Unified image restoration (UIR) aims to recover high-quality (HQ) content from low-quality (LQ) images with different degradations using a single model. Most recent methods adapt large pretrained text-to-image (T2I) latent diffusion models for their strong capacity and generative priors. However, the variational autoencoder (VAE) in latent T2I models may discard restoration-sensitive details, while the open-ended synthesis prior can introduce content-inconsistent artifacts. We present PixRestore, a VAE-free pixel-space Diffusion Transformer (DiT) for UIR, where the diffusion backbone is trained entirely from scratch, without relying on T2I pretraining. PixRestore performs flow matching directly on patchified pixels, preserving fine-grained details while keeping the token sequence tractable. To adapt to different degradations, PixRestore learns to predict the reliability of layer features using LQ--HQ DINO feature similarity. Features from more reliable layers are fused as dense conditioning, while less reliable layers receive stronger HQ-feature supervision to encourage degradation removal. We train PixRestore on a large-scale corpus of diverse scenes and degradations, and further finetune it into a one-step generator using DINO-based adversarial objectives for efficient inference. Experiments on public benchmarks and real-world test sets show that, with only about 50M parameters and single-step inference, PixRestore achieves the best overall fidelity, perceptual quality, and robustness to degradations among competing UIR models while being far more efficient. Larger PixRestore variants can further boost performance, demonstrating the scalability of our pixel-space design. Code and the curated benchmark can be found at this https URL.
10. 【2608.16791】Steering the Flow: Inverting Face Recognition Models via Gradient-Guided Flow Matching
链接：https://arxiv.org/abs/2608.16791
作者：Ye Lu,Shen Wang,Zhaoyang Zhang,Yihan Yan,Li Liu,Runze Liu,Fanghui Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Cryptography and Security (cs.CR); Multimedia (cs.MM)
关键词：exposing critical security, critical security vulnerabilities, reconstruct representative training, representative training samples, Model Inversion
备注：
点击查看摘要
Abstract:Model Inversion Attacks (MIAs) aim to reconstruct representative training samples of target identities from face recognition models, exposing critical security vulnerabilities. Existing methods typically rely on indirect guidance or highly stochastic guidance, making it difficult to stably optimize generation trajectories toward target facial images. In this paper, we propose Steering Flow Model Inversion (SFMI), a novel two-stage white-box model inversion method that reformulates inversion as a trajectory-steering task. Specifically, Step I, Learning a Generic Flow Matching Prior, pre-trains a generic unconditional Flow Matching model to encode the manifold of human faces as a robust prior. Step II, Attacking with Progressive Guidance Scheduler (PGS), injects time-dependent target-specific gradients during sampling. By backpropagating through the target model to obtain gradients from intermediate generated states, PGS progressively injects adaptive guidance signals into the vector field. This process effectively steers the current generative flow from random noise toward the high-density regions of the target class. Under an identity-disjoint cross-evaluation setting using the CelebA dataset, SFMI achieves an ACC of 0.9248, an FID of 22.61, and an LPIPS of 0.3874 on the ArcFace target. Extensive experiments on multiple target models demonstrate that SFMI achieves competitive state-of-the-art performance in attack success and visual fidelity under the evaluated white-box protocol.
11. 【2608.16786】Revisiting Classifier-Free Guidance Methods in Latent Diffusion Models
链接：https://arxiv.org/abs/2608.16786
作者：Artem Sergievskii,Artyom Turevich,Sergey Kastryulin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Inference-time quality-enhancement methods, Inference-time quality-enhancement, improving diffusion models, expensive retraining, effective and widely
备注：
点击查看摘要
Abstract:Inference-time quality-enhancement methods are an effective and widely adopted means of improving diffusion models without expensive retraining. We study a family of training-free techniques conceptually rooted in Classifier-Free Guidance (CFG), most of which were originally proposed on older U-Net diffusion models and validated using metrics that assess image quality in isolation, without accounting for compositional alignment or semantic correspondence between the generated image and its associated text prompt. We re-evaluate eight such methods on two open-weight rectified-flow transformers under a fixed per-model protocol and three compositional-alignment benchmarks. No method consistently improves on CFG across the measured criteria. APG obtains several nominal best scores, but the corresponding gains often remain within the estimated evaluation uncertainty. Attention-perturbation methods provide isolated gains on SD3.5 Medium and more frequent degradations on FLUX.2 [klein] 4B Base, while CFG remains a competitive lower-cost baseline.
12. 【2608.16785】Calibration-Free Vehicle Speed Estimation: A Monocular Keypoint-Template Approach
链接：https://arxiv.org/abs/2608.16785
作者：Gaofeng Su,Keya Li,Raja Sengupta,Kara M. Kockelman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：effectively estimating vehicle, estimating vehicle speeds, framework estimates vehicle, camera calibration, reference objects
备注： 19 pages, 7 figures
点击查看摘要
Abstract:This paper proposes a calibration-free framework for reliably and effectively estimating vehicle speeds from monocular videos, without relying on roadway features, camera calibration, or roadway-feature-based reference objects. The proposed framework estimates vehicle speeds using a 36-keypoint vehicle template and a homography matrix updated at each frame. A YOLO-based keypoint detection module is trained on diverse datasets, and two estimation strategies are compared: keypoint-only tracking and warped optical flow with dense spatial aggregation. Speed is estimated by projecting displacements into metric space using the homography, with validation conducted on over 400 video clips from roadside and overhead datasets, covering speeds from 30 to 100 mph. The method achieves reliable speed estimation on the VS13 and BrnoCompSpeed datasets, with the warped optical flow method delivering MAEs of 15.0% and 9.7%, respectively, and 77.9% and 93.1% of estimates falling within +/-20% error. After applying a 10% trim to remove edge-of-frame outliers, performance improves to MAEs of 11.7% and 7.6%, with within-+/-20% accuracy increasing to 85.3% and 95.4%. This work addresses key limitations of existing vision-based approaches and enables low-cost and efficient speed enforcement using portable devices such as dashcams and smartphones, thereby supporting citizen-based enforcement programs for traffic safety.
13. 【2608.16765】RACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation
链接：https://arxiv.org/abs/2608.16765
作者：Haoran Wang,Chaofan Ma,Ran Yi,Lizhuang Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：existing benchmarks remain, benchmarks remain organized, predefined task types, unified multimodal models, multi-reference image generation
备注： Accepted to ACM Multimedia 2026 (ACM MM 2026)
点击查看摘要
Abstract:Despite recent advances in unified multimodal models for multi-reference image generation, existing benchmarks remain organized around predefined task types (e.g., "subject composition"), which are ill-suited to this combinatorial setting and lead to fragmented coverage, uncontrolled complexity, and little diagnostic value. Recognizing that diverse multi-reference tasks share a common set of atomic operations, we adopt a capability-oriented perspective and formalize four operators: Anchor ($f$), Disentangle ($g$), Apply ($\oplus$), and Compose ($C$). Any multi-reference prompt can then be represented as a compositional formula over these operators, whose structural complexity is quantified by the number of operator slots. Building on this formulation, we construct TRACE-Bench, comprising approximately 1,600 evaluation cases across slot counts 1--8, built from 631 formula templates and around 4,000 reference images spanning diverse artistic styles and real-world subjects. The formula structure directly drives an operator-aligned evaluation protocol for per-capability scoring and a diagnostic tree analysis for recursive failure localization. Evaluating 9 leading models reveals insights invisible to holistic scoring: the primary bottleneck lies in disentanglement ($g$) and attribute binding ($\oplus$) rather than scene-level composition ($C$), with even the best model scoring only 0.74 on attribute fidelity. Project page: this https URL
14. 【2608.16756】Binarized High-Efficiency RAW Video Restoration and Beyond
链接：https://arxiv.org/abs/2608.16756
作者：Tianyu Zhu,Ying Fu,Hesong Li,Gengchen Zhang,Xin Yuan,Yulun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-quality low-level perception, RAW video restoration, RAW video, binarized RAW video, fundamental to high-quality
备注： Accepted by TPAMI2026
点击查看摘要
Abstract:RAW video restoration is fundamental to high-quality low-level perception and serves as the basis for a wide range of downstream vision applications. While binary neural networks (BNNs) enable efficient lightweight deployment for image enhancement, their deficiencies in modeling temporal coherence and activation value distributions hinder their effectiveness when applied to video scenarios. In this paper, we propose BinRVR, a binarized RAW video restoration framework that reduces computation and parameters by approximately 96% while incurring only about 4% performance degradation. Specifically, we present a Binarized Information Interaction Module (BIIM) to jointly model spatial and temporal information in an efficient and unified manner. Moreover, we develop a Distribution-Aware Binarized Convolution (DAB-Conv) that leverages the statistics of full-precision activations to mitigate quantization errors. The proposed framework further supports multi-bit quantization, enabling flexible accuracy-efficiency trade-offs across different hardware constraints. Extensive experiments demonstrate that our BinRVR achieves competitive performance compared with state-of-the-art binarized methods on RAW video restoration tasks, including low-light enhancement, denoising, deblurring, and super-resolution. We further explore the potential of our method on downstream video applications, including object detection and monocular depth estimation.
15. 【2608.16748】Beyond Uncertainty: Generalizable Failure Monitoring for Surgical Segmentation under Acquisition Degradation
链接：https://arxiv.org/abs/2608.16748
作者：Hieu D. Pham,Dang P. M. Cao,Thanh Trung Huynh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：predicted masks, Temporal Conformal Surgical, Surgical segmentation networks, Surgical Risk Monitor, Conformal Surgical Risk
备注： Accepted at MICCAI'2026 @UNSURE Workshop
点击查看摘要
Abstract:Surgical segmentation networks can fail silently under acquisition degradation: predicted masks may be wrong even when model confidence remains high. Existing deployment-time monitors rely primarily on uncertainty estimates and can therefore miss confident failures. We present TCSR-Monitor (Temporal Conformal Surgical Risk Monitor), a post-hoc failure-monitoring framework that combines confidence with observable shape, temporal-consistency, and image-quality cues. TCSR-Monitor wraps a frozen segmentation model, requires no model internals, and operates without ground truth at deployment. We also introduce a validation protocol to assess whether alarms remain credible under distribution shift. On EndoVis 2017, leave-one-corruption-out evaluation shows that TCSR-Monitor generalizes to unseen acquisition degradations and substantially outperforms confidence-based baselines. A circularity control confirms that it predicts segmentation failure rather than simply detecting corrupted images. Mondrian conformal calibration balances miss-rates across degradation severities, but a single global threshold still produces false alarms on up to 40% of correctly segmented frames at moderate corruption. Zero-shot transfer to SAM2 demonstrates feature portability, although entropy outperforms the transferred monitor at both evaluated thresholds. Overall, reliable monitoring under acquisition degradation benefits from complementary observable signals beyond confidence alone, but substantial false-alarm and transfer limitations remain.
16. 【2608.16745】VicEdit: Learning to Edit Videos from Visual In-Context Examples
链接：https://arxiv.org/abs/2608.16745
作者：Yuji Wang,Teng Hu,Yuheng Chen,Ran Yi,Han Feng,Weijian Cao,Chengjie Wang,Lizhuang Ma,Jiangning Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：convey fine-grained textures, instructions inherently struggle, Visual In-context Editing, video editing, Visual In-context
备注：
点击查看摘要
Abstract:Despite progress in instruction-based video editing, unimodal textual instructions inherently struggle to convey fine-grained textures and complex dynamics. To bridge this perceptual gap, we propose Visual In-context Editing, a new paradigm elevating video editing from textual instructions to multi-modal visual guidance encompassing single image, image pair, and video pair. To facilitate this paradigm, we curate VicEdit-400K, the first large-scale dataset for visual in-context video editing. We develop an automated pipeline to generate 400K high-quality samples across ten task types, ensuring superior visual fidelity and semantic consistency through multi-dimensional filtering. Leveraging this foundation, we introduce VicEdit, a unified framework to bridge visual and textual contexts. To adaptively extract editing semantics from heterogeneous references, we design Modality-Adaptive Semantic Distillation, which produces modality-specific semantic tokens from visual references. These tokens are then synergistically integrated with textual instructions through Dual-Context Injection, enabling the generation process to benefit from both visual and textual signals. Extensive evaluations on VicEditBench demonstrate that VicEdit achieves state-of-the-art performance across both basic instruction editing and visual in-context editing tasks, establishing visual in-context learning as a powerful and controllable paradigm for video editing.
17. 【2608.16725】Unsupervised Anomaly Detection for Image Dataset Quality Assurance in Multi-Center Breast MRI
链接：https://arxiv.org/abs/2608.16725
作者：Chiara Tappermann,Steffen Renisch,Lars Ole Schwen,Hans Meine,Horst K. Hahn,Eike Petersen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：anomalous data silently, data silently threatens, silently threatens, threatens the safety, safety and reliability
备注：
点击查看摘要
Abstract:Corrupted, inconsistent, or anomalous data silently threatens the safety and reliability of medical AI. Despite growing regulatory recognition of dataset quality assurance (QA) for high-risk medical AI, scalable automated detection remains underdeveloped. We employ unsupervised anomaly detection (AD) and out-of-distribution (OOD) detection as an automated dataset QA mechanism for multi-center dynamic contrast-enhanced breast MRI. We build a controlled AD benchmark of 17 realistic QA-relevant anomaly types from six public datasets (protocol violations, processing errors, incorrect anatomical regions) and propose a taxonomy of radiological image anomalies based on human visual perception, enabling fine-grained analysis of AD failure modes. The benchmark includes near-, medium-far-, far-OOD samples, as well as in-distribution and external normal data. Four methods are evaluated: a projection-based method extended with a domain-specific feature extractor and a novel positional encoding, a reconstruction-based approach extended to full 3D volumes with an augmented training objective, and two unmodified hybrid OOD detection methods. Medium-far- and far-OOD samples are detected reliably, whereas near-OOD samples and external normal data from unseen institutions expose method-specific differences. The 3D reconstruction-based approach best balances detection performance (AUROC: 0.936) and generalization to unseen institutions. The projection-based method with positional encoding achieves the highest overall detection performance (AUROC: 0.954). Both hybrid methods exhibit critical failure modes, confirming that methods validated for one modality or anatomy may not generalize without domain-specific adaptation. Implants and mastectomies remain an open challenge for all methods. Our results establish a foundation and practical guidance on scalable unsupervised QA in medical AI pipelines.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.16725 [cs.CV]
(or
arXiv:2608.16725v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.16725
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
18. 【2608.16721】GenRouter: Unified Workflow Routing for Agentic Image Generation
链接：https://arxiv.org/abs/2608.16721
作者：Harold Haodong Chen,Zhiyu Hou,Wen-Jie Shu,Weilin Ruan,Yingjie Xu,Litao Guo,Ying-Cong Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：raw pixel synthesis, intricate user requests, fulfilling increasingly intricate, increasingly intricate user, pixel synthesis
备注： Code: [this https URL](https://github.com/EnVision-Research/GenRouter)
点击查看摘要
Abstract:The rapid evolution of text-to-image (T2I) generation models has effectively solved the foundational challenge of raw pixel synthesis, shifting the community's focus toward fulfilling increasingly intricate user requests. While recent agentic image generation workflows enhance static inference with advanced capabilities like external knowledge retrieval and iterative reasoning, they mostly operate in isolated silos with fixed ``one-size-fits-all" topologies. This inevitably leads to severe compute-mismatch, where simple queries are forced through computationally heavy pipelines. To bridge this gap, we present GenRouter, the first unified workflow routing framework for agentic image generation. We first formulate GenCanvas, standardizing diverse agentic pipelines into a universal set of foundational primitives and executable templates. Operating over this unified space, GenRouter adaptively routes heterogeneous prompts to their optimal workflows via (i) demand profiling, (ii) experience matching, and (iii) Pareto filtering. Extensive experiments across diverse benchmarks demonstrate that GenRouter achieves superior visual alignment while reducing execution costs by over 95% and latency by 65% compared to heavyweight static pipelines. Furthermore, the system continuously self-evolves via accumulated experience, enabling robust zero-shot generalization that boosts performance and halves computational overhead.
19. 【2608.16718】CytoFormer: A Molecularly Supervised Cell Foundation Model for Histopathology Cell Classification
链接：https://arxiv.org/abs/2608.16718
作者：Jialu Yao,Songhao Li,Alina Yu,Zhi Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Identifying cell types, manual pathologist annotations, Identifying cell, enable single-cell analysis, cell types
备注： 20 pages, 5 figures, 2 extended data figures
点击查看摘要
Abstract:Identifying cell types directly from routine haematoxylin and eosin (HE) histology would enable single-cell analysis at scale, but training such models has relied on manual pathologist annotations, which are slow, expensive and unreliable for many cell types. We instead supervise morphology with molecules. Imaging-based spatial transcriptomics profiles individual cells in situ on a section that can afterwards be stained with HE, so that molecular identity and morphology are observed for the same physical cell. We assembled 81 such paired Xenium sections spanning 16 organs, derived per-cell labels by clustering, marker-gene annotation, organ-wise human review and quality control, and mapped them onto the cell types commonly reported in each organ. This yielded 15.4 million cells, each with a paired HE image patch and one of 23 cell types, on which we trained CytoFormer, a cell foundation model with a multi-task, per-organ classification head. On spatially held-out tissue CytoFormer reached an accuracy of 0.85 and a macro-F1 of 0.78 across all 16 organs, and its predictions reproduced the tissue architecture of an entire held-out section. The representation also transfers: with the encoder frozen, a linear head on CytoFormer features performed better than six pathology foundation models on four expert-annotated benchmarks, including on organs and cell types that were not part of pretraining. Finally, in an interactive active-learning setting, CytoFormer's embeddings are markedly more label-efficient than existing pathology foundation models, detecting normal epithelium amid look-alike tumour with an F1 of 0.82 from only a few annotations and leading the strongest baseline by 0.13 in F1. CytoFormer turns paired HE and spatial transcriptomics into a reusable, label-efficient representation for cell-level analysis of routine histology.
20. 【2608.16717】PersonaShot: Benchmarking Person-Centric Narrative Continuity in Multi-Shot Video Generation
链接：https://arxiv.org/abs/2608.16717
作者：Yuji Wang,Yuheng Chen,Teng Hu,Ran Yi,Yijia Hong,Han Feng,Weijian Cao,Chengjie Wang,Lizhuang Ma,Jiangning Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：core narrative anchor, rapidly evolving, evolving from single-shot, single-shot clips, human character serves
备注：
点击查看摘要
Abstract:Video generation is rapidly evolving from single-shot clips to multi-shot narratives, where the human character serves as the core narrative anchor. However, existing benchmarks mainly assess character appearance or individual-shot quality, without measuring whether physical and emotional states remain coherent across cuts. They also rarely provide criterion-specific evaluation methods, although physical continuity, facial dynamics, and cinematic relations require different visual, temporal, and relational evidence. To address these limitations, we introduce PersonaShot, the first person-centric benchmark for narrative continuity in multi-shot video generation. PersonaShot contains approximately 1,000 multi-shot segments and 16 metrics spanning physical continuity, affective dynamics, and cinematic grammar. \textbf{\textit{1)} Narrative Continuity Benchmark:} We evaluate character coherence across three temporal levels: within-shot states, cross-shot transitions, and sequence-level trajectories. \textbf{\textit{2)} Human-Aligned Specialist Evaluators:} We distill reasoning from a large multimodal teacher into lightweight criterion-specific evaluators, each grounded in the visual, temporal, or relational evidence required by its metric, and align them with expert human judgments. \textbf{\textit{3)} Systematic Evaluation and Insights:} Our evaluation reveals distinct capability profiles across state-of-the-art models and a clear gap between perceptual quality and cross-shot narrative continuity. Even visually compelling videos frequently exhibit physical-state resets, abrupt affective shifts, and broken cinematic relations across shots. Human studies further demonstrate strong agreement between our evaluators and expert judgments.
21. 【2608.16709】MIRROR: Multimodal Intelligent Radiology Reasoning and Observation Reporter
链接：https://arxiv.org/abs/2608.16709
作者：Vignesh Nagarajan,Sriram Venkatapathy
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：model output faces, faces two problems, radiologist reading, output faces, model output
备注： 8 pages, 5 figures, 5 tables, 24 references
点击查看摘要
Abstract:A radiologist reading a model's output faces two problems. The model returns a number and no reason, and any system that turns that number into readable prose can quietly add claims the model never made. MIRROR is a research prototype built to separate those failures. It chains a multi-label classifier, a Grad-CAM localizer that turns each positive finding into a named anatomical region, and a report writer that receives the labels, probabilities, and regions but never the image. Because the language layer cannot see pixels, it cannot assert a finding the classifier did not make. We are precise about what that buys: a MIRROR report's findings are auditable against the probability vector, while the sentences framing them are ordinary generated text, and we show one stating a cardiothoracic ratio the system never measured. One registry holds the taxonomy, anatomy, and phrasing for chest X-ray, brain MRI, and head CT, so adding a modality is a data change; all three are routed and tested, one is trained. On ChestMNIST that classifier reaches macro AUROC 0.729 and ranks better than chance on all 14 labels, at 1.6 to 6.8 times the precision a random ranker would get. Yet at the default 0.5 threshold it emits no positive prediction at all for 11 of them, and its excellent-looking Brier score of 0.045 sits beside the 0.047 earned by a predictor that ignores the image. The discrimination is real; the decisions are not. Under the class imbalance normal in radiology, aggregate metrics flatter models that do nothing, and should be reported against that floor.
22. 【2608.16690】AnchorScore: A CLIP-Based Diagnostic of MLLM Annotation Difficulty
链接：https://arxiv.org/abs/2608.16690
作者：Yan Ma,Lizhuo Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, large language models, Multimodal large, accuracy varies widely, validation images
备注： 37 pages, 7 figures, 12 tables
点击查看摘要
Abstract:Multimodal large language models (MLLMs) are widely used for automated annotation, yet their per-class accuracy varies widely (e.g., 12%-98% across the 13 classes of three classroom sub-datasets) and is expensive to measure: evaluating one 27B MLLM on 5,416 validation images takes roughly 14 hours, whereas a frozen-CLIP pass over the same images completes in about 3 minutes. A low-cost signal for ranking classes by expected MLLM annotation difficulty a priori remains underexplored. Building on the AnchorProxy construct (per-class zero-shot CLIP accuracy) introduced in the companion study, this paper systematically evaluates its full-frame formulation, termed AnchorScore here, as an a priori diagnostic that flags the classes MLLMs are least likely to annotate reliably. On classroom behavior data (SCB5, 13 classes, 6 MLLMs), AnchorScore correlates with per-class MLLM accuracy (Spearman rho = 0.769, p = 0.002, n = 13). None of the alternative difficulty predictors (DINOv2, ResNet-50, SigLIP, or MLLM self-verbalized uncertainty) showed a significant class-level correlation at n = 13. A cross-model consensus control suggests AnchorScore primarily captures a shared class-difficulty factor rather than a CLIP-specific signal. An independent replication on Stanford40 Actions yields a nearly identical effect (rho = 0.817, p 0.001); the association is strongest on activity-recognition data and attenuates on medical and satellite imagery. Three practical applications follow: a deployable hybrid CLIP/MLLM routing strategy (predicted-class routing: up to +23 pp over CLIP-only at roughly 44% MLLM cost savings), prompt disambiguation on hard classes (exploratory), and review-priority prediction for human verification. AnchorScore does not estimate exact MLLM accuracy; it provides a low-cost ranking signal that directs expensive MLLM evaluation to the classes where it is most informative.
Comments:
37 pages, 7 figures, 12 tables
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
MSC classes:
68T45
Cite as:
arXiv:2608.16690 [cs.CV]
(or
arXiv:2608.16690v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.16690
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
23. 【2608.16681】Bridging the Gap between Labeled and Unlabeled Data via Unified Flow with Feature Memory Bank
链接：https://arxiv.org/abs/2608.16681
作者：Shanwen Wang,Xin Sun,Danfeng Hong,Junyu Dong,Patrick Le Callet
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：semi-supervised semantic segmentation, manual labeling burdens, utilizes abundant unlabeled, degrades pseudo-label quality, severely degrades pseudo-label
备注：
点击查看摘要
Abstract:Although semi-supervised semantic segmentation ($\text{S}^4$) utilizes abundant unlabeled data to reduce manual labeling burdens, independent training of labeled and unlabeled data causes the former to dominate, which severely degrades pseudo-label quality. To address this challenges, we propose a novel remote sensing (RS) $\text{S}^4$ method via unified flow with feature memory bank (UFFM). Specifically, UFFM comprises two key innovations: unified flow (UF) and feature memory bank (FMB). The UF is a new training flow that generates less biased pseudo-labels by combining an external visual foundation model (VFM) with an RS domain teacher, and jointly optimizes labeled and pseudo-labeled data under a unified training objective. The FMB is a novel memory module for $\text{S}^4$ that dynamically updates class-specific features during training and reduces the feature discrepancy between labeled and unlabeled data through class-feature alignment. To verify the effectiveness of our model, we conduct extensive experiments on RS datasets. The experimental results show the superiority of our method over SOTA $\text{S}^4$ methods. Moreover, the results demonstrate the effectiveness of our contributions in bridging the optimization and feature representation gap between labeled and unlabeled data. Our code is released at \href{this https URL}{this https URL}.
24. 【2608.16673】How Sampling Strategy Affects Imbalance Mitigation in LiDAR Segmentation: A Study of Structured vs. Random Point-Based Architectures
链接：https://arxiv.org/abs/2608.16673
作者：Antonis Savva,Christos Kyrkou,Theocharis Theocharides
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：point clouds poses, clouds poses challenges, LiDAR point clouds, urban mapping, Class imbalance
备注： 9 pages, 6 figures, IEEE International Conference on Image Processing (ICIP) 2026
点击查看摘要
Abstract:Class imbalance in LiDAR point clouds poses challenges for semantic segmentation in autonomous navigation and urban mapping. While 2D vision has numerous mitigation techniques, their effectiveness in 3D remains unclear. We benchmark six reweighting schemes and five imbalance-aware losses across three datasets (DALES, S3DIS, STPLS3D) using two architectures (KPConv, RandLA-Net). Inverse-frequency weighting degrades performance by up to 12% compared to uniform weighting, with catastrophic failures in minority classes. Uniform weighting performs within 2% of complex losses for structured sampling (KPConv) but benefits less for random sampling (RandLA-Net, up to 4.6% gap). Loss landscape analysis reveals a complex interplay: for structured sampling, imbalance ratio determines landscape geometry on real LiDAR data but decouples from it on synthetic data; for random sampling, landscapes show high sensitivity to dataset geometry regardless of imbalance ratio. For the two evaluated point-based architectures, these results suggest that the interaction between sampling strategy (structured vs. random), imbalance severity, and data acquisition characteristics shapes which mitigation approaches are effective.
25. 【2608.16669】Concept-based explanation of gene expression prediction from HE images
链接：https://arxiv.org/abs/2608.16669
作者：Amos Muench,Jonathan Thielmann,Reduan Achtibat,Maximilian Dreyer,Philip Bischoff,Caroline Forsythe,Hamidreza Parand,Thomas Walter,David Horst,Sebastian Lapuschkin,Wojciech Samek,Teresa Gabriela Krieger
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, enabled accurate prediction, enabled accurate, pathology foundation models, TCGA COAD
备注：
点击查看摘要
Abstract:Recent advances in pathology foundation models have enabled accurate prediction of spatial transcriptomics (ST) from routine HE images. However, existing explainability methods for vision transformer (ViT)-based models are largely limited to local heatmaps and do not reveal how morphological concepts contribute to ST predictions. Here, we introduce an explainable framework that combines relevance propagation and concept discovery to link transcriptional programs to tissue morphology. We developed a ViT-based framework for virtual ST from HE images that combines ViT-aware layer-wise relevance propagation with relaxed archetypal TopK sparse autoencoder-based concept discovery. This approach provides both local explanations and global insights into the morphological patterns associated with transcriptional programs. We applied the framework to colorectal cancer ST data from the HEST-1k cohort and evaluated its generalizability in TCGA COAD. Our architecture accurately predicts clinically relevant ST signatures and accompanying molecular phenotypes. Measured and predicted gene expression profiles reveal substantial spatial heterogeneity of the colorectal cancer subtypes iCMS2 and iCMS3 across a large number of samples. Spatially resolved and aggregated iCMS classification achieve weighted F1 scores of 0.872 and 0.819 (0.770 in TCGA COAD), respectively, and both stratify patient outcome. Beyond prediction, our framework establishes a relevance-based concept atlas linking molecular phenotypes to histopathological representations. Comparison of activation- with relevance-derived concepts demonstrates that relevances provide a more direct link between tissue morphology and downstream predictions. We establish a general strategy for concept-based explanation of spatial prediction, and our framework is readily applicable to a broad range of ViT-based pathology models.
26. 【2608.16661】urning spectra into images improves plant trait retrieval with 2D-CNNs
链接：https://arxiv.org/abs/2608.16661
作者：Javier Lopatin,Teja Kattenborn,Eya Cherif,Sebastián Moreno
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Hyperspectral reflectance spectroscopy, long-range inter-band dependencies, reflectance spectroscopy enables, spectroscopy enables non-destructive, enables non-destructive estimation
备注： 38 pages, 14 figures, 11 tables. Supplementary material appended after the references. v2: adds a per-image vs global scaling ablation, expands the methods, and corrects several figures and captions
点击查看摘要
Abstract:Hyperspectral reflectance spectroscopy enables non-destructive estimation of plant functional traits, yet current deep learning approaches process spectra as one-dimensional sequences, which limits how they capture long-range inter-band dependencies. We asked whether transforming 1D spectra into 2D image representations improves multi-trait prediction with convolutional neural networks (CNN). We compared nine transformations using EfficientNet-B0 on the GreenHyperSpectra dataset (7,897 labeled spectra, eight traits, 400-2450 nm), benchmarked against published 1D CNN results on the same split. Trained from scratch, the simplest transformation, a direct Reshape of the spectrum into a 2D grid, performed best ($R^2 = 0.684 \pm 0.001$) and improved on the state-of-the-art 1D baseline ($R^2 = 0.587$, $+0.097$). We then pretrained a 2D masked autoencoder (MAE-2D) on 139,000 unlabeled spectral images. Linear probing, which freezes the encoder and trains only a multilayer perceptron head, reached $R^2 = 0.646$ and exceeded every 1D self-supervised counterpart, including the fine-tuned MAE-1D ($R^2 = 0.641$). Under cross-dataset evaluation all models lost most of their accuracy and none beat the 1D baseline significantly. To identify which wavelengths drive each prediction, we applied Integrated Gradients and Grad-CAM and unfolded band importance back to the spectral axis. Protein ($r = 0.45$) and leaf water ($r = 0.33$) agreed with sensitivities simulated by the PROSAIL radiative-transfer model, while carotenoids ($r = 0.06$) and leaf area index ($r = -0.11$) did not, showing that the model reads established leaf chemistry for traits with sharp absorption features. The representational advantage of 2D spectral images, rather than architectural complexity or ImageNet pretraining, drives the gain over 1D approaches.
27. 【2608.16658】X$^2$Localizer: Cross-grained Alignment for Progressive Cross-view Video Geo-localization
链接：https://arxiv.org/abs/2608.16658
作者：Zichao Zeng,Weijia Fan,Yufan Chen,June Moh Goo,Junwei Zheng,Ruiping Liu,Kunyu Peng,Jiaming Zhang,Rainer Stiefelhagen,Jan Boehm
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：Cross-view Video Geo-localization, geo-tagged aerial images, localize ground-view videos, Video Geo-localization, Progressive Cross-view Video
备注： Accepted to The 37th British Machine Vision Conference (BMVC 2026)
点击查看摘要
Abstract:Cross-view Video Geo-localization (CVG) aims to localize ground-view videos by retrieving their corresponding geo-tagged aerial images. However, CVG approaches rely on fixed-length inputs and post-hoc refinement, hindering online-oriented localization under partial or dynamic observations. In this work, we formulate Progressive Cross-view Video Geo-localization (PCVG) as a deployment-oriented extension and evaluation protocol of CVG, enabling localization under varying temporal budgets, prefix-based inference, random-start evaluation, and long-range localization with interruptions. To explore PCVG, we introduce X$^2$Localizer, a cross-grained alignment framework that jointly supervises global prefix-to-aerial retrieval and token-aggregated frame--aerial-tile matching with a budget-dependent asymmetric objective. Furthermore, we introduce a Sliding-Window Re-Localization (SWRL) strategy that dynamically refreshes candidate regions for failure recovery and long-range deployment without full-sequence reprocessing. Extensive experiments show that X$^2$Localizer preserves conventional full-video performance, with marginal gains of +0.1 Recall@1 and +0.3 Recall@10, while substantially improving early localization. In the challenging single-frame setting, X$^2$Localizer improves coarse retrieval by +4.7 Recall@1 and +11.5 Recall@10 over the previous state-of-the-art method. With SWRL, our approach further enables robust progressive localization under random-start and long-distance scenarios, narrowing the gap between benchmark evaluation and real-world deployment.
28. 【2608.16646】raining-Free Reconstruction-Based AI-Generated Image Detectors Are Inherently Vulnerable to Adversarial Examples
链接：https://arxiv.org/abs/2608.16646
作者：Roman Demchenko,Jonas Ricker,Asja Fischer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：impressive visual quality, AI-generated images call, impressive visual, visual quality, quality and ubiquity
备注： Accepted at AI4MFDD (AI for Multimedia Forensics Disinformation Detection) Workshop, ECCV 2026
点击查看摘要
Abstract:The impressive visual quality and ubiquity of AI-generated images call for reliable and robust detection methods. Reconstruction-based detectors have emerged as a promising direction for transparent and training-free identification of synthetic images. However, due to their fundamentally different mode of operation (compared to standard, classifier-based methods), little is known about their adversarial robustness. In this work, we propose two novel attack methods targeted at detectors that leverage autoencoder reconstruction error. We find that by constructing imperceptible adversarial examples, the distance between original and reconstruction can be artificially increased, causing fake images to be wrongly classified as real. Our evaluation including images from three state-of-the-art generators and three detectors demonstrates that detection performance is significantly decreased, even if attacked images additionally undergo real-world degradations. Critically, our adversarial examples naturally transfer across detectors, as they all share the same principle, pointing towards an inherent vulnerability of reconstruction-based detectors.
29. 【2608.16632】DRAFE: Domain-Robust Asymmetric Fusion of Heterogeneous Detection Transformers for Cross-City Fine-Grained Traffic Object Detection
链接：https://arxiv.org/abs/2608.16632
作者：Divine Yao Agbobli,Geoffery Eyram Agorku,Israel Afriyie,Kwadwo Amankwah-Nkyi,Marvin Osei-Kuffour,Richmond Owusu Duah,Bright Seglah,Kelvin Asamoah Terkper,Kwabena Amoako Adjei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning-based object, intelligent transportation systems, enabling traffic monitoring, Deep learning-based, transportation systems
备注： 17 pages, 2 figures, 6 tables. Code available at: [this https URL](https://github.com/dyagbobli/VisionOps-Trainer)
点击查看摘要
Abstract:Deep learning-based object detectors are fundamental to intelligent transportation systems, enabling traffic monitoring, vehicle analytics, and infrastructure management. However, achieving both fine-grained vehicle recognition and robust cross-city domain generalization remains challenging. We present the Domain-Robust Asymmetric Fusion Ensemble (DRAFE), which combines independently trained LW-DETR and RF-DETR detectors for cross-city fine-grained traffic object detection. DRAFE employs a two-stage training strategy that first pretrains complementary detectors on diverse public traffic datasets using pseudo-label expansion and human-in-the-loop annotation refinement, producing a curated corpus of 6,049 images and 203,619 annotations, before challenge-compliant fine-tuning on the Project Hafnia Track 6 dataset. At inference, DRAFE applies anchor-conditioned class-consistent matching, reliability-weighted coordinate fusion, agreement-aware confidence recalibration, and complementary hypothesis recovery. On AI City Challenge 2026 Track 6, DRAFE achieves 0.4022 mAP, ranks sixth among 25 participating teams, and improves by 0.0553 mAP over a preliminary ensemble evaluated under identical benchmark conditions.
30. 【2608.16622】HarmTrace: Anchor-Calibrated Decoupled Optimization for Fine-Grained Target Identification in Harmful Memes
链接：https://arxiv.org/abs/2608.16622
作者：Yujia Li,Yiqun Zhang,Zihan Cheng,Yijie Huang,Tenglong Ye,Zihan Wang,Xiaocui Yang,Shi Feng,Yifei Zhang,Daling Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：text harmfulness classification, formulated as image, harmful meme detection, typically formulated, harmful
备注：
点击查看摘要
Abstract:Multimodal harmful meme detection is typically formulated as image--text harmfulness classification. A model may correctly predict harmfulness while misidentifying the attacked target or its supporting evidence. We therefore extend harmful meme detection with fine-grained target identification, asking what type of target is attacked, who is targeted, and where the target appears in the meme. The model predicts harmfulness for every meme and, for harmful memes, outputs the target category, target entity, textual mention, and visual region. To support this task, we introduce Meme3W, which unifies multiple public harmful meme datasets and provides human-verified annotations for harmful instances. We further introduce Joint Record Accuracy (JRA), a strict record-level metric requiring the harmfulness label and all target-identification fields to be jointly correct. Experiments with representative multimodal large language models reveal a substantial gap between harmfulness accuracy and JRA. To narrow this gap, we propose HarmTrace, an anchor-calibrated decoupled optimization framework. HarmTrace strengthens target-entity supervision through entity-aware supervised fine-tuning. It then applies Conditional Target-identification Policy Optimization (CTPO) to decouple harmfulness and target-identification advantages, restricting target-identification optimization to label-correct responses for harmful examples. CTPO uses a Virtual Positive Anchor (VPA) as a fully correct reference for target-identification advantage normalization. HarmTrace improves both JRA and harmfulness accuracy across the evaluated backbones, with JRA on the Qwen3-VL-8B backbone increasing from 17.58\% to 52.51\%. Our code is publicly available at this https URL.
31. 【2608.16614】Beyond Accuracy: Assessing Calibration of Geospatial Foundation Models and Their Sensitivity to Distribution Shifts
链接：https://arxiv.org/abs/2608.16614
作者：Nils Lehmann,Jakob Gawlikowski,Burak Ekim,Isaac Corley,Xiao Xiang Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Geospatial Foundation Models, Geospatial Foundation, Foundation Models, averaged ranks, ranked and selected
备注：
点击查看摘要
Abstract:Geospatial Foundation Models (GeoFMs) are most commonly ranked and selected by accuracy on standard benchmark conditions via averaged ranks. We show that this protocol is too narrow: the promised deployment in critical EO tasks requires further angles of analysis, mainly calibration, the agreement between a model's confidence and its correctness. Across 16 frozen encoders, four classification and five segmentation datasets, and two orthogonal stress axes, every encoder degrades as corruption intensifies, and the ranking changes as well. Across the four classification benchmarks, EO-pretrained and ImageNet-pretrained encoders are indistinguishable on clean accuracy and clean calibration, and EO pretraining provides no more stability under shift than ImageNet pretraining. Under shift the GeoFMs drift further into overconfidence than the ImageNet-pretrained encoders, at every grade and in every corruption family. A centered kernel alignment (CKA) analysis ties this to representational rigidity: EO-pretrained embeddings move less under corruption while losing just as much task information and remaining overconfident. We apply three commonly explored uncertainty quantification methods and find that temperature scaling and deep ensembles cannot counteract the degradation, while a Gaussian-process probe roughly halves ECE under severe cloud only by tripling it on clean data. In selective prediction experiments, we find that confidence-based abstention cannot defer around confidently wrong predictions, and advocate that benchmark rankings and evaluations should therefore operate across a multitude of conditions and metrics to more holistically evaluate model development progress and close the gap to real world deployment scenarios.
32. 【2608.16607】Interactive Whole Slide Images for RL-based Tumour Segmentation
链接：https://arxiv.org/abs/2608.16607
作者：Mohamad Mohamad,Francesco Ponzio,Maxime Gassier,Nicolas Pote,Xavier Descombes
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：analysis remains computationally, remains computationally challenging, computationally challenging due, extremely large spatial, large spatial resolution
备注：
点击查看摘要
Abstract:Whole-slide image (WSI) analysis remains computationally challenging due to the extremely large spatial resolution of slides and the sparse distribution of tumour regions. We propose an end-to-end reinforcement learning framework for sequential tumour segmentation directly on WSIs. Instead of treating the slide as a predefined collection of candidate patches, we formulate the WSI itself as a hierarchical multi-resolution environment through which an agent navigates using movement, zooming, and tumour selection actions. The agent jointly processes local observations and a global thumbnail representation within an actor-critic architecture trained using proximal policy optimization (PPO). Experiments on pulmonary adenocarcinoma WSIs demonstrate the feasibility of direct sequential tumour segmentation on full slides, achieving comparable coarse segmentation quality relative to patch-based approaches operating at similar magnification levels, while reducing inference time to a few seconds per slide. We further analyse the impact of environment design and action-space granularity. Our results suggest that modelling WSIs as interactive environments provides a promising direction for RL-based computational pathology
33. 【2608.16600】GeoPose: Patient-agnostic CTA-to-DSA registration through projection-space calibration
链接：https://arxiv.org/abs/2608.16600
作者：Rudolf L. M. van Herten,Robert Graf,Paula Feldman,Johannes C. Paetzold
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：digital subtraction angiography, computed tomography angiography, pre-procedural computed tomography, Aligning intraoperative biplanar, Aligning intraoperative
备注：
点击查看摘要
Abstract:Aligning intraoperative biplanar digital subtraction angiography (DSA) to pre-procedural computed tomography angiography (CTA) requires rapid and accurate 3D-to-2D registration. Optimization-based methods are sensitive to initialization and may require hundreds of iterations, whereas learning-based approaches commonly rely on patient-specific training. We propose GeoPose, a population-trained framework that estimates the C-arm pose in a learned canonical frame and transfers it to the native frame of an unseen CTA through projection-space calibration and transform composition. A population-trained residual network refines the pose, followed optionally by low-budget image-driven optimization. GeoPose requires neither patient-specific adaptation nor explicit inter-volume preregistration. On 80 DSA observations from 20 held-out patients, optimization-free GeoPose achieved a carotid mean projected centerline distance (mPCD) of 5.8 mm and a clDice of 0.45, compared with 14.5 mm and 0.28 for the best-performing baseline, while requiring only 0.15 s. After 25 optimization iterations, GeoPose reached an mPCD of 4.6 mm and a clDice of 0.58 in approximately two seconds. Under the same budget, native-initialized optimization achieved 14.6 mm and 0.15, respectively. GeoPose thus provides rapid native-frame registration with fixed population-level weights and the geometric correspondence required for downstream biplanar 3D vascular reconstruction.
34. 【2608.16591】owards Zero-Shot Domain Generalization for ID Cards Presentation Attack Detection
链接：https://arxiv.org/abs/2608.16591
作者：Mario Nieto-Hidalgo,Juan M. Espin,Juan E. Tapia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Presentation-Attack Detection, making it difficult, generalize across countries, Equal Error Rate, lack of publicly
备注： Preprint accepted DAS 2026 at ICDAR 2026
点击查看摘要
Abstract:Presentation-Attack Detection (PAD) for national ID cards is limited by the lack of publicly available genuine samples, making it difficult for systems to generalize across countries. This paper introduces two main innovations: (1) a Prototypical Network head using an EfficientNet-V2-b0 backbone that requires only four genuine samples per class to create reliable prototypes; and (2) an episodic training regime that keeps PAD classes fixed while varying the card domain, allowing the network to learn universal attack cues. Evaluated on a large multi-country dataset and the public DLC-2021 benchmark, this method achieves an average Equal Error Rate of around 9\%, outperforming conventional softmax and CLIP zero-shot baselines even with data from a single source country. This approach provides accurate, privacy-preserving PAD while minimizing data collection, facilitating scalable cross-jurisdictional remote onboarding.
Comments:
Preprint accepted DAS 2026 at ICDAR 2026
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.16591 [cs.CV]
(or
arXiv:2608.16591v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.16591
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
35. 【2608.16589】Ultra: Unsupervised Cross-Task Optimization for Reliable Restoration Segmentation Collaboration under Adverse Weather
链接：https://arxiv.org/abs/2608.16589
作者：Shiqin Wang,Zhiqian Li,Haoyuan Du,Junming Chen,Jiayuan Li,Tianrun Xu,Haoyang Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unsupervised Domain Adaptation, Adverse Weather Semantic, unlabeled adverse environments, Domain Adaptation, Adverse Weather
备注：
点击查看摘要
Abstract:Unsupervised Domain Adaptation for Adverse Weather Semantic Segmentation (UDA-ASS) aims to transfer semantic knowledge from labeled normal-weather images to unlabeled adverse environments. Existing approaches implicitly assume that restoration and segmentation provide mutually beneficial guidance. However, under severe degradation and without target-domain supervision, the validity of cross-task optimization directions becomes fundamentally unidentifiable, leading to hallucination-driven error propagation. In this work, we propose a novel Unsupervised Restoration-Segmentation Collaborative Learning Framework (Ultra), which reframes cross-task interaction as direction selection under uncertainty and causal effect estimation, enabling reliable collaboration through candidate direction generation and intervention-based filtering. In detail, we propose CTDN and CMIL. The former exploits complementary visual structures and semantic information to generate candidate optimization directions and performs cooperative direction selection between restoration and segmentation. The latter reformulates cross-task information transfer from correlation-based propagation into causal effect assessment, suppressing hallucination propagation. Extensive experiments on three widely used UDA-ASS benchmarks demonstrate state-of-the-art segmentation performance. Beyond segmentation, our framework achieves better unsupervised restoration results than existing UDA-ASS restoration methods and generalizes to unsupervised restoration and object detection collaboration tasks. Code and models will be available at this https URL.
36. 【2608.16585】SQuad: Sub-Quadratic Attention Distillation for Efficient Video Generation
链接：https://arxiv.org/abs/2608.16585
作者：Animesh Karnewar,Denis Korzhenkov,Amirhossein Habibian,Mohsen Ghafoorian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Video Diffusion Transformers, cost grows quadratically, Diffusion Transformers, Video Diffusion, grows quadratically
备注：
点击查看摘要
Abstract:Video Diffusion Transformers (DiTs) spend most of their compute inside the Self-Attention operation, whose cost grows quadratically, $\mathcal{O}(n^2)$, with the number of latent tokens $n$. For the task of video generation, the token count is large, so this term dominates runtime and memory, and thereby caps the resolution and duration we can generate. Linear $\mathcal{O}(n)$ and low-rank $\mathcal{O}(nk)$ surrogates of Self-Attention trade the full softmax $QK^T$ for cheaper kernels, but rarely recover the original's expressivity, leaving a stubborn quality gap. Motivated by this, we propose SQuad, a Sub-Quadratic Attention Distillation framework that achieves a complexity of $\mathcal{O}(n\sqrt{n})$ in the resulting distilled Attention, naturally balancing the efficiency v/s expressivity trade-off. Instead of training our own Video DiT from scratch, which is prohibitively expensive, we fit a pretrained full softmax Self-Attention DiT into our proposed SQuad-Attention one by distilling the former in two stages: Flow-Matching Supervised Fine-Tuning (SFT), followed by improved Distribution Matching Distillation (DMD2) which additionally makes the sampling more efficient. On the Wan~2.2 5B text-to-video model, SQuAD matches the quadratic teacher on VBench ($83.20$ v/s $83.08$) while cutting the per-step per-block attention FLOPs by $\sim$$67\times$ and attention latency by $\sim$$11\times$, and end-to-end DiT latency by 2$\times$, all while also generating a video in only $6$ Neural Functional Evaluations (NFEs) instead of the default $100$.
37. 【2608.16546】Supervising the Path to Fine Scales: GalerkinFlow for Scientific-Field and Image Super-Resolution
链接：https://arxiv.org/abs/2608.16546
作者：Zikang Zhan
类目：Computer Vision and Pattern Recognition (cs.CV); Computational Engineering, Finance, and Science (cs.CE); Machine Learning (cs.LG)
关键词：final high-resolution output, super-resolution models learn, high-resolution output, learn from paired, paired data
备注： 8 pages, 2 figures
点击查看摘要
Abstract:Most super-resolution models learn from paired data by supervising only the final high-resolution output. This provides little control over how the prediction should evolve between the downsampled observation and its fine target. We introduce GalerkinFlow, an equation-agnostic framework that turns each coarse--fine pair into supervision along an entire reconstruction path. At a random sample of intermediate states on the reconstruction path, the model predicts the coarse-to-fine residual velocity and uses coarse-anchor point to define a pseudo-endpoint. We show that the reconstruction loss of this pseudo-endpoint is exactly related to the intermediate velocity loss through a known time-dependent weight. Consequently, every intermediate state contributes supervision toward the same fine target, rather than serving only as an internal step toward an endpoint loss. Because intermediate states already reveal part of the missing fine-scale structure, we additionally supervise the coarse endpoint used during one-step inference. A finite-difference objective further constrains local spatial variation. GalerkinFlow combines convolutional features with scale-conditioned Galerkin operator mixing and requires no governing equation or physical metadata. It achieves the lowest raw-space errors among the evaluated equation-agnostic baselines on Navier--Stokes and Darcy Flow, while remaining competitive on DIV2K.
38. 【2608.16535】Automatic Cephalometric Landmark Localization on CBCT-Derived Digitally Reconstructed Radiographs for Skeletal Malocclusion Classification
链接：https://arxiv.org/abs/2608.16535
作者：Benjamin Hou,Konstantinia Almpani,Janice S. Lee,Zhiyong Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Manual cephalometric landmark, Manual cephalometric, Vision Transformer-based model, difficult to scale, cephalometric landmark annotation
备注： Accepted for presentation at the ODIN 2026 Workshop, held in conjunction with MICCAI 2026
点击查看摘要
Abstract:Manual cephalometric landmark annotation is important for craniofacial assessment but is labor-intensive and difficult to scale. We introduce CephViT, a Vision Transformer-based model for automated 2D lateral cephalometric landmark localization, and evaluate its use in downstream skeletal malocclusion classification. CephViT was trained and benchmarked on a public lateral cephalogram dataset, achieving a mean radial error of 1.28 +/- 1.42 mm and a successful detection rate of 92.0% at 3.0 mm. Because the private evaluation cohort consisted of 3D CBCT scans, lateral cephalogram-like digitally reconstructed radiographs (DRRs) were generated from each volume and used as 2D inputs to the landmark localization model. Landmark coordinates were normalized into a common coordinate frame, and skeletal malocclusion classification was performed using landmarks shared between the reference and DRR-based pipelines. Classification performance using DRR-localized landmarks was comparable to that obtained using manually annotated reference landmarks, with accuracies of 70.0% and 68.3%, respectively. These results support the feasibility of automated cephalometric analysis on CBCT-derived DRRs for skeletal malocclusion assessment.
39. 【2608.16523】FLEET: Token-Based Feature Extraction for Event Camera-based Reinforcement Learning
链接：https://arxiv.org/abs/2608.16523
作者：Tristan Gottwald,Maximilian Schier,Melanie Schaller,Bodo Rosenhahn
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：http URL principle, http URL, http URL-based methods, offering spatially sparse, cameras generate asynchronous
备注：
点击查看摘要
Abstract:Event cameras generate asynchronous, high-frequency data streams offering spatially sparse information at lower latency than traditional this http URL principle, these properties should be ideal for the design of control this http URL, reinforcement learning research in this field remains limited as existing approaches fail to fully exploit the sensor's this http URL-based methods negate the sensors benefits by aggregating events into sparse grids. This couples compute cost to sensor resolution and blurs the temporal information. Meanwhile, existing generative baselines rely on the availability of trajectory data to pretrain the model. We propose FLEET (Feature Learning from Events via Efficient Tokenization), a feature extractor that processes event sequences directly. Leveraging random Fourier features and cross-attention, our architecture compresses variable streams into fixed-size latent representations. This decouples inference cost of the feature extractor's backbone from the sensor's resolution, enabling end-to-end learning without auxiliary losses. We validate FLEET on a new, high-throughput benchmark. The results demonstrate that our sequence-based approach surpasses SOTA performance and exhibits superior robustness to variations in observation frequencies.
40. 【2608.16514】Matched Outcomes, Divergent Gaze: How Foveated MLLMs Search Compared to Humans
链接：https://arxiv.org/abs/2608.16514
作者：Mohamed Amine Kerkouri,Marouane Tliba,Aladine Chetouani,Ulas Bagci,Alessandro Bruno
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multimedia (cs.MM)
关键词：Human visual search, fovea must land, candidate to confirm, landings form, visual search
备注： Paper accepted at 3rd HCV workshop at ECCV 2026. 12 pages main text, 16 pages supp
点击查看摘要
Abstract:Human visual search is serial: the fovea must land on a candidate to confirm it, and those landings form a scanpath. Whether multimodal large language models (MLLMs), given the same foveated input, search as humans do bears on their use as models of human vision and on attention-alignment scores. We compare three general-purpose MLLMs with human eye-movement scanpaths on goal-directed search (COCO-Search18), driving each model fixation by fixation through an identical, human-matched foveated view and assessing it along three axes: the decision of target presence, the efficiency of reaching the target, and the gaze process itself. The axes dissociate. On the decision and on target acquisition the models match or exceed humans, detecting present targets near ceiling and reaching them on the first saccade more often than people do. The gaze process is not human. Under the human-matched condition, all three share one signature: low-entropy, large-amplitude, self-consistent scanpaths that agree with themselves far more closely than two humans agree with each other. That is consistent with a single-pass, non-serial architecture rather than a limit of acuity. Matched retinal input reproduces where humans look but not how the looking unfolds in time, and no degradation regime recovers human-like search at human-like success. The gap sits on a process axis that answer-alignment and saliency metrics do not measure. Because they miss it, such metrics cannot certify human-like vision, and zero-shot models suit outcome and spatial questions but not temporal, process-level ones.
41. 【2608.16513】MLLM-Guided Semantic Correction for Text-to-Video Generation
链接：https://arxiv.org/abs/2608.16513
作者：Junhao Chen,Zheqi Lv,Keting Yin,Shengyu Zhang,Zhou Zhao,Feiyang Chen,Xinyu Duan,Baoxing Huai,Fei Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Recent advances, Transformer architectures, architectures have led, led to significant, significant progress
备注：
点击查看摘要
Abstract:Recent advances in diffusion models and Transformer architectures have led to significant progress in text-to-video generation. However, these models often suffer from semantic errors such as missing objects, incorrect attributes, or mismatched actions. Although some semantic correction methods perform optimization before sampling or refinement after sampling, how to detect and correct semantic deviations during the video generation process remains underexplored. In this paper, we introduce a training-free, interpretable mid-generation correction framework that integrates multimodal large language model (MLLM) feedback directly into the diffusion sampling loop. Our framework achieves diffusion trajectory correction by injecting semantic evaluation signals during video synthesis, enabling the model to optimize the generated content through continuous self-reflection. We propose two key modules: a Semantic Assessment Supervisor that generates intermediate preview frames for semantic evaluations and deviation diagnostics, and a Semantic Modification Assistant that corrects semantic drift during inference via a controllable latent trajectory intervention. Our method improves semantic alignment, visual fidelity, and temporal consistency without modifying model parameters. We validate the effectiveness of our approach through extensive experiments across multiple benchmarks.
42. 【2608.16499】OccamView: Object-Conditioned View Selection for Frame-Budgeted Active 3D Gaussian Reconstruction
链接：https://arxiv.org/abs/2608.16499
作者：Hongbo Gao,Wei Zhang,Zeyu Ni,Dihao Zhu,Ruifeng Li,Yunke Wang,Chang Xu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：selecting informative next-best, Gaussian reconstruction fundamentally, reconstruction fundamentally relies, Gaussian reconstruction, informative next-best views
备注： 7 pages, 5 figures. Preprint
点击查看摘要
Abstract:Active 3D Gaussian reconstruction fundamentally relies on selecting informative next-best views under limited sensing budgets. Existing active 3DGS methods primarily plan viewpoints according to geometric information gain, treating object-induced hidden regions in the same manner as general unexplored space. Under tight frame budgets, such geometry-driven strategies may prioritize global scene coverage while leaving partially observed objects incompletely reconstructed. To address this limitation, we propose OccamView, an object-conditioned view-selection framework for frame-budgeted active 3D Gaussian reconstruction. Rather than predicting unseen object geometry or performing shape completion, OccamView maintains an online object memory from open-vocabulary detections grounded in measured RGB-D observations and represents unresolved local occupancy around detected objects as conservative hidden-region proxies. Candidate viewpoints are then evaluated using an occlusion-aware proxy-coverage score. Furthermore, we introduce a Geo-Floor mechanism that restricts object-conditioned re-ranking to geometrically competitive candidates, allowing object-conditioned cues to guide complementary observations while preserving the geometry-driven exploration behavior of the underlying planner. Experiments on Replica and Matterport3D under a unified frame-budgeted protocol show that OccamView consistently reduces Completion and improves Completion Ratio across five frame budgets, with particularly pronounced gains under limited frame budgets. These results demonstrate that lightweight object-conditioned cues effectively complement geometry-driven active view planning.
43. 【2608.16490】owards Real-Time and Adaptable LiDAR Scene Completion
链接：https://arxiv.org/abs/2608.16490
作者：Azhar Hussian,Martin Vossiek,Vasileios Belagiannis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：LiDAR scene completion, scene, perception in autonomous, autonomous driving, downstream tasks
备注： Accepted at ECCVW 2026, 14 pages, 4 figures. Code is available at [this https URL](https://github.com/AzharSindhi/RapidLiDAR)
点击查看摘要
Abstract:LiDAR scene completion is a key component of 3D perception in autonomous driving, where the scene must be completed in real time to be usable in downstream tasks. Existing approaches typically follow an initialize-and-refine paradigm, in which a coarse initialization of the scene is first constructed, then refined into complete 3D geometry. Generative models are slower because they iteratively refine random Gaussian noise into the scene, while non-generative methods perturb the partial scene with a fixed noise scale, which limits coverage of large gaps and occluded regions and requires manual recalibration for each new sensor configuration. We present RapidLiDAR, a LiDAR scene completion method that treats the initialization itself as a learned, data-driven component. We propose an adaptive initialization module that predicts a spatially varying displacement for each partial input point, expanding the partial observations into a coarse scene initialization adapted to the local geometry, without requiring manual noise tuning. To refine this coarse initialization into a complete and coherent scene, we additionally propose a multi-scale reconstruction module that further refines point positions by querying multi-scale 3D voxel and 2D BEV feature maps constructed from the input scan. By replacing point-neighborhood operators such as farthest point sampling and $k$-nearest neighbor search with voxel- and BEV-based feature extraction, our architecture is faster and can handle different input resolutions by design. Experiments on SemanticKITTI and KITTI-360 show that our method achieves completion performance on par with the state of the art while completing a full scene in 0.1 seconds, which is 2.3 times faster than the fastest prior method. This matches the 10 Hz acquisition rate of typical automotive LiDAR sensors, taking a step toward real-time LiDAR scene completion.
44. 【2608.16485】HiFi-BRep: High-Fidelity Latent Representation for Robust B-Rep Generation
链接：https://arxiv.org/abs/2608.16485
作者：Junhao Hou,Chenqi Luo,Pufan Wang,Jiaying Lu,Yusheng Liu,Feiwei Qin,Meie Fang,Kun Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：structurally valid B-Reps, valid B-Reps remains, Boundary representation, major challenge, fundamental task
备注： Accepted to CVPR 2026
点击查看摘要
Abstract:Boundary representation (B-Rep) generation is a fundamental task in computer-aided design, yet the direct synthesis of high-fidelity and structurally valid B-Reps remains a major challenge. Existing deep generative methods suffer from two forms of brittleness: representation brittleness, caused by padding noise and feature contamination in the latent space, and generation brittleness, stemming from sequential error propagation and a train-inference mismatch due to non-differentiable validity enforcement. We propose HiFi-BRep, a novel framework that addresses these limitations through two synergistic contributions. First, a topology-aware encoder constructs a high-fidelity latent representation by eliminating padding via learnable queries and preventing feature contamination with topology-guided attention. Second, a single-stage decoder jointly predicts geometry and topology in parallel, embedding core manifold constraints as a differentiable learning objective. This design ensures mutual guidance between geometry and topology while avoiding cascaded errors. Extensive experiments show that HiFi-BRep significantly outperforms state-of-the-art methods in both structural validity and geometric fidelity, providing a robust solution for high-quality B-Rep synthesis. Code and models are publicly available at this https URL.
45. 【2608.16484】Remote-Sensing City Layout Extraction with MLLM
链接：https://arxiv.org/abs/2608.16484
作者：Zigan Zhou,Kai Li,Yupeng Deng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：describe urban content, detection boxes, vector boundaries, systems usually describe, describe urban
备注： 4 pages, 2 figures, 4 tables. Accepted to IEEE APGARSS 2026
点击查看摘要
Abstract:Remote-sensing systems usually describe urban content with detection boxes, semantic masks, or vector boundaries. Such outputs locate classes and support image-plane scoring, yet they do not by themselves constitute an executable layout that retains object identities, typed relations, topology, and regeneration rules. Code-as-City instead casts urban-layout extraction from a single top-down image as constrained code generation with a multimodal large language model (MLLM). An image model first produces an aligned five-class semantic layout prior. Three ordered MLLM passes use the image and this prior to recover roads, land-cover regions and relations, and buildings. Deterministic normalization converts the accumulated records into a city graph and a restricted layout program. Executing the program creates a renderable 3D city layout and an orthographic semantic projection over shared geometry. The projection admits pixel-level comparison with remote-sensing masks, while named objects, relations, and editing operations remain available for synchronized regeneration of both views. Evaluated on the 100 scenes of CityLayout-100, the complete framework obtains 41.1% mean intersection-over-union and 48.3% global intersection-over-union. This result provides quantitative evidence that visual observations can be translated into inspectable, editable city code with coupled planar and 3D outputs.
46. 【2608.16480】RISE: Roadside Infrastructure Sequence Understanding across 3D Tracking and Structured Vision-Language Reasoning
链接：https://arxiv.org/abs/2608.16480
作者：Yanbo Jiang,Haotian Zheng,Jiahao Wang,Hanxiao Ren,Yitao Xu,Yining Xing,Zehong Ke,Hao Cheng,Yiqian Tu,Jinhao Li,Zhiyuan Xuan,Fang Zhang,Jianqiang Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Infrastructure Sequence Understanding, Roadside Infrastructure Sequence, Infrastructure Sequence, Sequence Understanding, present RISE
备注：
点击查看摘要
Abstract:We present RISE (Roadside Infrastructure Sequence Understanding and Evaluation), a framework spanning metric 3D tracking and structured vision-language reasoning in roadside sequences. For metric tracking, our image-only method combines SAM3 video identities with calibration-guided mask agreement for multi-view identity association, recovering persistent 3D tracks without LiDAR or task-specific 3D training. Its calibration-conditioned geometry allows the procedure to be instantiated at different calibrated multi-camera intersections without layout-specific retraining. On 20 human-reviewed clips from six intersections, the generated tracks achieve 66.9 MOTA within the defined multi-view evaluation scope. For structured vision-language reasoning, a human-reviewed MLLM pipeline mines high-value clips and uses a constrained full-context Oracle to construct bbox-grounded predictive QA without exposing future evidence to evaluated models. The resulting RISE-VQA dataset contains 33,910 QA pairs from 557 clips across 16 intersections and 61 roadside views. Its intersection-held-out RISE-Bench evaluates semantic choices, coordinates, future boxes, and interaction sets with deterministic task-specific metrics. Experiments show consistent benefits from domain adaptation and generally from temporal context, while revealing persistent challenges in spatial grounding, future localization, and interaction reasoning.
47. 【2608.16469】Sterilizable Scene Graph Generation for Operating Rooms
链接：https://arxiv.org/abs/2608.16469
作者：Nick Lemke,Ssharvien Kumar Sivakumar,Antoine P. Sanner,John Kalkhof,Henry John Krumb,Ghazal Ghazaei,Anirban Mukhopadhyay
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scene graph generation, Scene graph, graph generation, semantic relationships, enables a holistic
备注：
点击查看摘要
Abstract:Scene graph generation from surgical video enables a holistic and structured understanding of surgical scenes by modeling objects and their semantic relationships. Despite recent advances, state-of-the-art approaches rely on large, parameter-heavy deep learning models that are impractical for deployment in the operating room (OR) due to hardware footprint, hygiene constraints, latency, and data privacy concerns. To the best of our knowledge, this is the first scene graph generation method built on NCAs and the first NCA framework capable of learning structured representations. We introduce SG-NCA, a lightweight scene graph generation framework based on Neural Cellular Automata (NCA), designed for inference in fanless devices critical for OR hygiene protocols. SG-NCA is the first scene graph generation combining NCA-based multiclass segmentation for efficient object detection and feature extraction with a lightweight relation predictor. We evaluate SG-NCA on videos of cataract surgery and cholecystectomy, demonstrating performance comparable to established baselines while requiring 55x fewer parameters. We showcase deployment on fanless edge devices better suited for the OR and demonstrate downstream applications such as surgical video captioning, highlighting SG-NCA's potential for affordable, privacy-preserving, and OR-ready intraoperative scene understanding.
48. 【2608.16463】Shared-Structure 4D Spectral Gaussian Representation for Sparse-View Spectral CT Reconstruction
链接：https://arxiv.org/abs/2608.16463
作者：Jiancheng Fang,Shaoyu Wang,Wenjun Xia,Yang Chen,Qiegen Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requiring simultaneous handling, spectral computed tomography, reconstructs energy-resolved attenuation, Density Curve Network, energy-resolved attenuation volumes
备注：
点击查看摘要
Abstract:Sparse-view spectral computed tomography (CT) reconstructs energy-resolved attenuation volumes from limited projection views, requiring simultaneous handling of angular undersampling and spectral coupling. We propose a SharedStructure 4D Spectral Gaussian Representation (4D-SG) that learns shared Gaussian geometry from full spectrum structural projections and uses a Gaussian-wise Spectral Density Curve Network (GSC-Net) to predict Gaussian raw density transformations. This factorization separates shared spatial structure from spectral attenuation variation, avoids independent channel geometry optimization, and establishes a continuous 4D-SG representation from discrete spectral measurements for unobserved spectral channel queries. Experiments on six synthesized, simulated projection, and real projection datasets with 50 views demonstrate the best average performance. Compared with the strongest Gaussian baseline, 4D-SG improves PSNR from 35.56 dB to 36.61 dB, increases SSIM from 0.909 to 0.914, and reduces LPIPS from 0.208 to 0.194, demonstrating its effectiveness for sparse-view spectral CT reconstruction.
49. 【2608.16457】Contrastive Energy Fields for Inference-Time Procedure Planning in Instructional Videos
链接：https://arxiv.org/abs/2608.16457
作者：Mohamed Afham,Christoph Reich,Oliver Hahn,Daniel Cremers,Stefan Roth
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：observed initial state, Procedure planning, initial state, goal state, seeks to estimate
备注： To appear at GCPR 2026 (oral paper). Project page: [this https URL](https://visinf.github.io/cefito)
点击查看摘要
Abstract:Procedure planning seeks to estimate a sequence of actions to transition from an observed initial state to a given goal state. Current procedure planning approaches directly predict action sequences from latent representations using feed-forward neural networks or diffusion-based inference. These paradigms treat every action as plausible, lacking the ability to enforce task-specific logical constraints that render certain actions irrelevant or not plausible. We propose CEFITO, a procedure planning approach that learns a predictor to express an action-conditioned representation space. Based on this representation space, we formulate procedure planning as a task-constrained optimization problem. Unlike prior methods, CEFITO explicitly reasons over the action space by omitting irrelevant actions during inference-time planning. This reformulation enables effective procedure planning and achieves state-of-the-art accuracy on two established procedure planning benchmarks.
50. 【2608.16424】Joint Flow Matching Enables Continuous Dose-Conditioned Cell Morphing
链接：https://arxiv.org/abs/2608.16424
作者：Lea Bogensperger,Manuela Merlo,Martin Baumgartner,Michael Krauthammer,Bernard Ciraulo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：shown increasing promise, Generative modeling, predicting cellular perturbation, cellular perturbation effects, chemical compound treatments
备注：
点击查看摘要
Abstract:Generative modeling has shown increasing promise for predicting cellular perturbation effects under chemical compound treatments. Existing approaches either model perturbation as a distribution-to-distribution mapping without explicit concentration handling, or treat concentration as a discrete class label, precluding continuous dose control. We introduce a joint flow matching approach that simultaneously models cell latents and drug concentration via a dual-timestep formulation, enabling dose-conditioned single-cell morphing through the invertibility of flow matching. The joint formulation induces a monotonic dose-response geometry in latent space and additionally supports concentration estimation from cell morphology. As proof of concept, we further demonstrate generalization to an unseen dose held out during training. Empirically, our method achieves competitive or improved per-concentration metrics on two compounds compared with representative baselines, while enabling capabilities structurally unavailable to discrete-class methods.
51. 【2608.16384】Self-Routed Tensor Adapters for Parameter-Efficient Universal Visual Adaptation
链接：https://arxiv.org/abs/2608.16384
作者：Suraj Yadav
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：require adaptation mechanisms, domain-specific modules, fragmenting knowledge, knowledge into domain-specific, SRTA
备注： Accepted at ECCV Workshop 2026 (Archival Track)
点击查看摘要
Abstract:Universal visual representations require adaptation mechanisms that adapt across heterogeneous domains without fragmenting knowledge into domain-specific modules. Parameter-efficient fine-tuning adapts frozen visual foundation models efficiently, but standard low-rank adapters use a fixed subspace for all inputs, which can be restrictive when domains differ in style, background, and semantic context. MoE-based adapters improve specialization through multiple expert pathways, but often rely on external routers and large expert banks, adding parameters and separating routing from adaptation. We propose \textbf{Self-Routed Tensor Adapters}, a compact framework for multi-domain visual adaptation. SRTA projects each input into a low-rank space, computes routing weights from this representation using a learnable domain matrix, and uses these weights to blend slices of a shared Tucker core. This produces a sample-specific adaptation matrix without an external gating network, allowing shared visual factors to be reused while supporting domain-aware specialization. To strengthen pathway learning, we introduce a progressive depth-weighted routing objective that supervises routing decisions across adapter layers. Across five heterogeneous multi-domain visual classification benchmarks, SRTA achieves competitive or slightly stronger average accuracy than MoE-style PEFT baselines while using substantially fewer trainable parameters. At rank 64, SRTA uses 2.77M parameters in the 4-domain setting compared with 9.52M for MoLoRA, and 3.00M in the 6-domain setting compared with 14.31M. Overall, SRTA offers an effective accuracy-parameter trade-off for adapting visual foundation models toward universal multi-domain representations. \href{this https URL}{GitHub}
52. 【2608.16380】Synthetic Data Augmentation for Satellite-Based Analysis of Battle-Damaged Agricultural Fields in Ukraine
链接：https://arxiv.org/abs/2608.16380
作者：Marta Sumyk,Oleksandr Kosovan,Iryna Voitsitska
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Monitoring war-induced damage, Monitoring war-induced, land in Ukraine, Ukraine is important, environmental stability
备注：
点击查看摘要
Abstract:Monitoring war-induced damage to agricultural land in Ukraine is important for understanding threats to food security, environmental stability, and post-war recovery. However, the development of computer-vision systems for satellite-based damage analysis is limited by the scarcity of labeled imagery, especially for damaged agricultural fields. This work investigates synthetic data augmentation as a method for improving classification under limited and imbalanced training data. We train class-conditional Generative Adversarial Network (GAN) and Denoising Diffusion Probabilistic Model (DDPM) architectures on real satellite images and use them to generate additional bombed and not-bombed agricultural-field samples. The generated images are used only for training augmentation, while all downstream evaluation is performed on an exclusively real test set. A Vision Transformer classifier is trained under multiple real and synthetic data configurations to measure the practical utility of each generative approach. The best configuration, based on balanced DDPM augmentation, improves accuracy from 84\% to 88\%, balanced accuracy from 67\% to 81\%, macro F1 from 65\% to 78\%, and recall for the underrepresented not-bombed class from 41\% to 69\%. These results demonstrate the potential of synthetic satellite imagery for data-scarce geospatial applications in war-affected regions.
53. 【2608.16377】Adaptive Post-Processing Drives Instance-Level Detection in Stroke Lesion Segmentation
链接：https://arxiv.org/abs/2608.16377
作者：Qinghui Liu,Jon André Ottesen,Atle Bjørnerud,Kyrre Eeg Emblem
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：standard voxel-level overlap, increasingly larger focal, larger focal point, Instance-level lesion detection, medical image segmentation
备注： 8 papges, 4 figs, 2 tables, MICCAI ISLES'26
点击查看摘要
Abstract:Instance-level lesion detection has been an increasingly larger focal point in medical image segmentation besides the more standard voxel-level overlap. Still, most pipelines are trained and post-processed for voxel overlap alone. In particular, the mismatch is most pronounced for small lesions, where a near-miss prediction---substantial overlap that falls just short of the instance-matching threshold---scores the same as a complete miss. In our ISLES'26 submission, we found that closing this gap mattered far more in post-processing than in architecture design. Our Volume-Conditioned Adaptive Post-Processing (VCAP) scheme adjusts component-size thresholds to each case's predicted lesion burden, improving Lesion-F1 by 0.032 (unbiased cross-fold estimate)---approximately 6 times larger than any architectural change we tested. A resolution-aware attention architecture (Viola2Plus), designed for small-lesion segmentation, shows why the distinction matters: it left small-lesion Dice unchanged but raised small-lesion detection rate by 3.7\%, a real effect voxel-overlap metrics alone would have missed. Under 5-fold cross-validation on the 1,453-case training set, our post-processed two-architecture ensemble achieves Dice 0.651 and Lesion-F1 0.614, versus 0.644 and 0.573 for the unprocessed single-model baseline.
54. 【2608.16373】OceanDepths: A Global Dataset of Paired Subsurface and Surface Ocean Observations
链接：https://arxiv.org/abs/2608.16373
作者：Simon Donike,Ruben Cartuyvels,Antonino Ian Ferola,Elisa Carli,Diego Fernandez Prieto,Marie-Helene Rio
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：critically underobserved compared, critically underobserved, underobserved compared, sea surface, surface
备注：
点击查看摘要
Abstract:Despite comprising over 70% of its surface, the world's oceans are critically underobserved compared to the land surface or the atmosphere. Understanding the global ocean requires jointly observing its surface and subsurface structure, yet no standardized, high-resolution dataset couples satellite surface fields to co-located in situ depth profiles in an AI-ready format. Existing resources either consist of model-reconstructed gridded products rather than observations, cover only a single variable or basin, or operate at resolutions too coarse for mesoscale dynamics. We introduce OceanDepths, the first open, global, regridded AI-ready dataset that pairs satellite-derived sea surface temperature (SST), sea surface salinity (SSS), and sea surface height (SSH) L4 products with co-located EN4 subsurface temperature and salinity profiles, complemented by matched GLORYS12 ocean reanalysis data to support comparisons or multi-stage learning. The dataset spans 2000-2024 at 0.1 degrees x 0.1 degrees spatial resolution and at weekly temporal resolution, covering the entire globe's sea surface and with over 9.5 million paired profiles interpolated to 50 standardized depth levels. We provide a configurable system to split the globe in equally sized spatial patches. The 4D multivariate structure, high resolution, long temporal extent, and extreme sparsity of subsurface observations (approximately 0.01% per depth level) make OceanDepths a challenging testbed for novel AI methods. We demonstrate subsurface state reconstruction as an example task with simple baseline models, but also envision OceanDepths to support the development of observation-based forecast methods and other related tasks. Available at: this https URL.
55. 【2608.16367】Depth-Dominant Skeleton Detection for Natural Scenes
链接：https://arxiv.org/abs/2608.16367
作者：Chengkun Rao,Yixuan Deng,Min Li,Yangjun Ou,Ye Li,Ziwei Luo,Zhaojing Wang,Junwei Tang,Bangchao Wang,Xiaoyun Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：suffer significant performance, significant performance degradation, natural scene skeleton, scene skeleton detection, skeleton detection
备注： 11 pages, 3 figures, 4 tables
点击查看摘要
Abstract:To date, all natural scene skeleton detection follows the paradigm of taking RGB images as the sole input; despite notable progress, methods under this paradigm suffer significant performance degradation on complex-content images. We observe that depth images are inherently insensitive to color and texture, and can provide clear regional contours and inter-region spatial relationships, which naturally alleviates the difficulty of skeleton detection in complex scenarios. Motivated by this observation, this paper proposes for the first time a novel skeleton detection paradigm where depth images serve as the dominant modality and RGB images act as the auxiliary, and accordingly presents a model DDSkel (short for Depth-Dominant Skeleton Detection) under this paradigm. DDSkel employs an asymmetric encoder design to fuse RGB information into depth features, with the RGB modality branch having only 12% the parameters of the depth modality branch. DDSkel has a simple structure without intricate designs. Nevertheless, with only 36% of the trainable parameters of the current best method, DDSkel outperforms all state-of-the-art approaches on SymPASCAL, the most challenging dataset with a large volume of complex images.
56. 【2608.16354】DriveCache: Action-Aware Caching for Driving World Model Inference
链接：https://arxiv.org/abs/2608.16354
作者：Jianchun Yang,Jian Liang,Xianda Guo,Pinhan Fu,Yanlun Peng,Conglang Zhang,Wenke Huang,Mang Ye
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：models support autonomous-driving, support autonomous-driving development, predicting controllable future, video generation models, generation models support
备注： 9 pages, 7 figures, 4 tables
点击查看摘要
Abstract:Driving video generation models support autonomous-driving development by predicting controllable future scenes for simulation, planning evaluation, and offline data generation. Diffusion-based driving generators repeatedly evaluate large backbones across denoising steps, which limits generation throughput. Existing diffusion acceleration methods reduce this cost, but general-purpose designs omit driving signals available before generation, such as ego speed and planned trajectories. Experiments across driving motions show that cache tolerance varies with ego translation and rotation, denoising progress, and consecutive reuse length. We propose DriveCache, a training-free, action-aware controller that uses planned motion to allocate reuse across scenes and dynamic programming to place it across denoising steps under a calibrated response budget. A causal drift check refreshes features and replans the remaining schedule when generation departs from calibration. Across three generator configurations, DriveCache improves the overall fidelity-efficiency trade-off over evaluated cache methods. Our code will be publicly available.
57. 【2608.16338】SIGMA-Lane: Scale-pyramId Gated MAmba for Temporally Consistent Video Lane Detection
链接：https://arxiv.org/abs/2608.16338
作者：Tiancheng Zhang,Mengmeng Wang,Yan Gao,Xiangjie Kong,Guojiang Shen,Jiaxin Du
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Video lane detection, detection requires predictions, break temporal cues, lane detection requires, severe vehicle occlusions
备注： accepted by ECCV 2026
点击查看摘要
Abstract:Video lane detection requires predictions that remain stable across frames, yet severe vehicle occlusions can break temporal cues. In streaming recurrent models, corrupted observations may enter the hidden state and produce errors that persist into later frames. Existing occlusion-aware refinements usually provide obstacle masks as auxiliary inputs, so the state-update path is only indirectly protected. We propose SIGMA-Lane, which treats this failure mode as state contamination in State Space Model (SSM)-based temporal modeling. SIGMA-Lane places occlusion-aware gates on the SSM write and residual-fusion paths, controlling how current observations enter temporal memory and are fused back after temporal propagation. After coordinate-consistent affine alignment, the model combines two complementary paths: SSM-consistent dual-gating for temporal filtering and Structural Spatial Retrieval (SSR) for recovering missing lane structure from aligned historical priors. Experiments on VIL-100 and OpenLane-V show improved temporal stability under heavy occlusion, with competitive F1 and mIoU scores.
58. 【2608.16332】Unlocking Motion in Expressions: Temporal Calibration for Referring Video Object Segmentation
链接：https://arxiv.org/abs/2608.16332
作者：Yiwen Jiang,Zhengtong Zhu,Ruixin Zhang,Jiaqing Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Referring Video Object, Video Object Segmentation, segment referred objects, video sequences based, Referring Video
备注： Accept by ACM MM2026
点击查看摘要
Abstract:Referring Video Object Segmentation (RVOS) aims to segment referred objects at the pixel level in video sequences based on natural language descriptions. Existing methods typically introduce motion information within a unified cross-modal temporal modeling framework, where language cues are used for target localization and segmentation. However, the dependency of expressions on motion semantics is not explicitly modeled, making it difficult to adaptively adjust the use of motion information according to different semantic requirements. To address these issues, we propose an Expression-driven Motion Calibration (EMC) framework for RVOS that explicitly unlocks and leverages the motion semantics within expressions. The proposed method extracts interpretable motion control signals from expressions via a Motion Signal Processing (MSP) module, and employs a Motion Influence Calibration (MIC) module to adjust the contribution of motion cues during temporal decision making. In addition, a Semantic Temporal Stage Construction (STSC) module is introduced to build expression-relevant temporal stages, providing a compact temporal candidate space for motion calibration. Through extensive evaluation on six standard benchmarks, including Ref-YouTubeVOS, Ref-DAVIS17, MeViS (valid/valid$^u$), A2D-Sentences, and JHMDB-Sentences, the superiority of our method is validated. We will release the code on this https URL.
59. 【2608.16328】GRNEdit: Efficient General Video Editing from a New Binary-Evidence Perspective in Generative Refinement Networks
链接：https://arxiv.org/abs/2608.16328
作者：Feng Xie,Jiagao Hu,Fuhao Li,Zepeng Wang,Yuxuan Chen,Dahua Gao,Fei Wang,Daiguo Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Instruction-based general video, Instruction-based general, video editing seeks, diverse editing operations, general video editing
备注：
点击查看摘要
Abstract:Instruction-based general video editing seeks to unify diverse editing operations within a single, intuitive interface. Existing approaches often rely on resource-intensive conditioning, using either heavyweight branches or costly source concatenation. Is there any efficient way to model editing intent? Thus, we introduce GRNEdit, a lightweight two-stage framework. GRN inspires our approach by encoding visual semantics through combinations of bits. Through task-specific fine-tuning, we take this representation further and recast editing semantics as local retain-or-flip decisions over individual bits. Source information is consequently modeled as coordinate-wise evidence supporting the observed binary states, while the GRN backbone remains responsible for resolving their global composition into coherent generative semantics. In Stage I, a compact encoder translates discrete source codes into continuous evidence signals, which GRN assimilates throughout binary refinement. Inspired by null-prompt training for classifier-free guidance, we further assign the null condition an editing-specific meaning: an empty instruction denotes no edit and is supervised through source reconstruction. This identity pathway not only implicitly strengthens evidence utilization and content preservation in Stage I, but also produces a source-preserving state in the same representation space as the edited state. Stage II can therefore directly compare each edited state with its source-preserving counterpart and use their discrepancy to revise unresolved target-bit decisions. Trained on only 0.6M pairs with less than 3\% conditioning parameters, GRNEdit-2B and GRNEdit-8B achieve scores of 4.03 and 4.18 on OpenVE-Bench. The 2B model outperforms multiple 14B open-source editors, while the 8B model performs on par with leading open-source editors.
60. 【2608.16324】LaGSplat: Inferring Physics-Governed Interactive Simulation from Monocular Video Using Latent Lagrangian Gaussian Splatting
链接：https://arxiv.org/abs/2608.16324
作者：Louen Pottier
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Lagrangian Gaussian Splatting, Latent Lagrangian Gaussian, Gaussian Splatting decoder, Gaussian Splatting, physics-governed dynamics
备注： 25 pages, 11 figures, 4 tables. Project page with interactive demo: [this https URL](https://louenpottier.github.io/lagsplat.html)
点击查看摘要
Abstract:We present LaGSplat (Latent Lagrangian Gaussian Splatting), a framework that infers interactive, physics-governed dynamics from one or a few monocular videos. At inference it lets a user push on the filmed object, rigid or deformable, with an external force that was never measured, annotated, or seen during training. This is possible because a low-dimensional latent state $\mathbf{q} \in \mathbb{R}^d$ plays two roles at once: it is the generalised coordinate of a learned dissipative Lagrangian and the conditioning variable of a Gaussian Splatting decoder. The inductive bias of this decoder, whose primitives are explicit points $\mu_i(\mathbf{q})$ that move with the object, is what lets a force $f$ applied in the image pull back into a latent generalised force $J(\mathbf{q})^\top f$ and enter the equations of motion, which pixel-space (CNN) or neural-field (NeRF) decoders cannot do. We validate LaGSplat on test cases of increasing difficulty, from rigid to deformable and from autonomous to forced real systems, combining monocular video and sensor measurements. We further demonstrate interactive use: forces of arbitrary magnitude and direction can be applied to the reconstructed object at any time, its response rendered in real time, in 2D or 3D. Assuming a dissipative Euler-Lagrange equation over a few generalised coordinates trades generality for a bounded, plausible response to unseen forces, where an unconstrained predictor diverges.
61. 【2608.16320】StreamOPD: A Post-Training Recipe with Spatio-Temporal Cue Gating for Streaming Video Understanding
链接：https://arxiv.org/abs/2608.16320
作者：Keming Wu,Baoyi Wang,Kaichen Zhang,Xiang An,Zuhao Yang,Sudong Wang,Haowei Zhu,Tingxuan Huang,Hongcheng Gao,Bin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Streaming video understanding, video understanding demands, understanding demands direct, causally observed prefix, Streaming video
备注： Project page: [this https URL](https://unix-ai-lab.github.io/StreamOPD)
点击查看摘要
Abstract:Streaming video understanding demands direct responses from the causally observed prefix of an unfolding video. Existing systems add inference-time memory, retrieval, and compression, yet a training-free sliding-window baseline already matches them. We therefore fix a memory-free recent-window protocol and ask how far post-training alone can go. Reinforcement learning with verifiable rewards fits this regime poorly, encouraging long ``think-then-answer'' generations, while on-policy distillation (OPD) supplies dense token-level teacher supervision on student trajectories but is stable only when both models train in thinking mode. These observations lead to \textsc{StreamOPD}, a recipe combining verifiable streaming-video data, thinking-mode OPD, and instruct-mode deployment. It raises StreamingBench from $77.9\%$ to $83.9\%$---within $0.3$ points of the 9B teacher---and improves OVO-Bench excluding its hallucination-detection subtask (HLD) by $9.1$ points under unchanged inference. As a teacher-privilege extension, \emph{Spatio-Temporal CueGate (ST-CueGate)} aggregates cue-versus-no-cue teacher likelihood ratios into a group-relative response score that reweights OPD. It reaches $71.9\%$ on OVO-Bench (excluding HLD) and $64.9\%$ on Video-MME, and is the only variant that stays above the base model on all four benchmarks. Replacing the teacher with a frozen copy of the student's initial policy---on-policy self-distillation---retains most of these gains and lifts HLD to $57.0\%$, above both the untrained student and the 9B teacher, so abstention loss is not intrinsic to the recipe. We provide a transparent and reproducible reference for open-source streaming-video research.
62. 【2608.16316】Deep Thought Alignment: Trajectory-Level Latent Distillation for Video Reasoning
链接：https://arxiv.org/abs/2608.16316
作者：Ao Shen,Yongheng Zhang,Yinghui Li,Manning Wang,Di Yin,Xing Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Multimodal Models, high computational cost, processing vast amounts, Large Multimodal, Multimodal Models
备注：
点击查看摘要
Abstract:Large Multimodal Models (LMMs) for video reasoning have long been hindered by the high computational cost of processing vast amounts of visual information. This dilemma motivates the transfer of the reasoning capabilities of large models to smaller, more efficient ones. On-Policy Distillation (OPD) offers a promising solution by matching output-token distributions along student-generated trajectories. However, video reasoning often depends on evidence accumulated across multiple frames. In this context, output-level supervision only captures information expressed through token predictions and does not directly constrain the latent representations formed during reasoning. To address this limitation, we propose Latent-OPD, which augments OPD with trajectory-level latent distillation. Specifically, our method focuses on the position at the end of each trajectory, where hidden states effectively summarize the accumulated visual evidence and reasoning context. Furthermore, we introduce a progressive teacher-lookahead strategy, which aligns middle-to-late student layers with increasingly deeper teacher layers. Experiments on six video reasoning benchmarks show that Latent-OPD consistently outperforms output-only OPD. Notably, the improvements are particularly pronounced in scenarios with limited frames, long videos, or tasks requiring complex evidence aggregation. These results establish Latent-OPD as a highly effective approach to frame-efficient video reasoning.
63. 【2608.16310】Cross-View Urban Sensing: Mapping Subjective Streetscape Perception via AlphaEarth Embeddings and Urban Context
链接：https://arxiv.org/abs/2608.16310
作者：Peilin Li,Pengfei Chen,Jingyu Wang,Zhifeng Yang,Tiansheng Chen,Mengjie Gong,Xiao Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：active mobility, public health, social wellbeing, Residents' perception, important factor
备注：
点击查看摘要
Abstract:Residents' perception of the urban streetscape is an important factor in public health, active mobility, and social wellbeing. Street view imagery (SVI) has emerged as a widely used data source for assessing these perceptual qualities, yet its uneven coverage and irregular updating limit large-scale measurement. Here, we present CVLNet, a Cross-View Learning Network that predicts street-level perception from AlphaEarth embeddings and multi-source urban contextual data without requiring SVI at inference. CVLNet applies per-task adaptive gating to jointly model five perceptual dimensions, using labels from the pretrained SVI-Percept model as ground truth. The proposed method is evaluated across four Southeast Asian cities: Singapore, Kuala Lumpur, Jakarta, and Manila. CVLNet achieves a median road-segment-level Adjusted $R^{2}$ of 0.76 and consistently outperforms the baseline models, with gains ranging from 5.9--11.3% across the five perceptual dimensions. Ablation experiments show that AlphaEarth features and urban contextual features contribute complementary information. We further produce citywide road-level streetscape perception maps for five subjective perceptual dimensions across all four cities, extending perception estimation from the 13--31% of the road network directly covered by available SVI to the complete road network of each city. Integrating these maps with WorldPop gridded population data, we quantify exposure inequality across population-density, demographic, and land-use groups using the Deficit Palma Ratio. These results demonstrate that remote sensing can serve as a scalable alternative to SVI for citywide streetscape perception mapping, enabling a more comprehensive assessment of urban environmental inequality.
64. 【2608.16289】PosterText: Towards Unified Visual Text Generation and Editing for E-commerce Poster
链接：https://arxiv.org/abs/2608.16289
作者：Xiaoan Liu,Lichen Ma,Zipeng Guo,Yu He,Xiaoyan Su,Shaojie Guo,Jingling Fu,Xiaolong Fu,Hao Yang,Tongxuan Liu,Yu Guo,Fei Wang,Xinyi Liu,Yongjun Zhang,Junshi Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automated e-commerce poster, high-quality poster generation, poster design requires, Automated e-commerce, poster generation
备注：
点击查看摘要
Abstract:Automated e-commerce poster design requires both high-quality poster generation and flexible editing of existing designs. However, most existing methods either target end-to-end poster generation or follow multi-stage design pipelines, with limited capability for flexible and precise editing of existing posters. To enable unified generation and editing of e-commerce posters, we introduce Text Patch Generation and Editing, a unified task formulation that treats text patches as atomic units and covers four operations: poster generation, patch addition, patch deletion, and patch modification, with optional reference-guided style control. Based on this, we propose PosterText, a unified model trained with a four-stage curriculum, including text rendering pretraining, instruction-following training, reinforcement learning for preference alignment, and spatial guidance self-distillation for execution refinement. We further construct a large-scale dataset with patch-level annotations and a comprehensive benchmark for evaluation. Extensive experiments demonstrate that PosterText achieves competitive performance against existing generation and editing approaches, validating the effectiveness of the proposed framework.
65. 【2608.16285】Audio-Visual Segmentation via Depth-Guided Collaborative Modeling
链接：https://arxiv.org/abs/2608.16285
作者：Zhaojin Fu,Yuyang Hong,Qi Yang,Zili Wang,Kun Ding,Shiming Xiang,Bin Fan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：performs pixel-level segmentation, pixel-level segmentation, fundamental task, task in multimodal, performs pixel-level
备注：
点击查看摘要
Abstract:Audio-Visual Segmentation (AVS) is a fundamental task in multimodal perception that performs pixel-level segmentation of sounding objects in videos by leveraging both visual and audio cues. It has broad applications in video understanding, human-computer interaction, and autonomous driving. However, most existing AVS methods do not explicitly model geometric cues such as relative distance and occlusion, thereby limiting the robustness of cross-modal alignment. In human perception, spatial structure is naturally integrated with audio-visual evidence to accurately localize sounding objects. Motivated by this, we incorporate estimated depth as a spatial structural cue for AVS and propose DGCM-AVS, a tri-modal framework that jointly models audio, visual, and depth information. Specifically, we design a Depth-Aware Dynamic Modulator to improve the separation of adjacent objects while preserving intra-object feature consistency. Furthermore, we propose Depth-Guided Progressive Fusion, which uses depth as an intermediate bridge to progressively align audio cues with visual features. Compared to state-of-the-art methods, DGCM-AVS achieves relative improvements of 10.2 percent in M_J and 8.7 percent in M_F on the AVSS dataset. We believe our study highlights depth as a promising yet underexplored modality for AVS and may encourage further research in this direction.
66. 【2608.16284】ransAnyText: Translating Arbitrary Text in E-commerce Images via Structured Visual Generation
链接：https://arxiv.org/abs/2608.16284
作者：Xiaoan Liu,Lichen Ma,Zipeng Guo,Yu He,Xiaoyan Su,Shaojie Guo,Hao Yang,Jingling Fu,Xiaolong Fu,Zhen Chen,Yu Guo,Fei Wang,Xinyi Liu,Yongjun Zhang,Ke Zhang,Junshi Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：e-commerce image translation, global retail, Cross-border e-commerce image, essential for global, detail pages
备注：
点击查看摘要
Abstract:Cross-border e-commerce image translation is essential for global retail, where product images, banners, and detail pages need to be produced in different languages. Existing methods struggle to achieve accurate translation, faithful visual identity preservation, and easy-to-edit outputs, simultaneously. To address these challenges, we introduce TransAnyText, a structured visual code framework that reformulates image text translation as generating renderable HTML patches from source images and target languages. Our framework decouples semantic generation from pixel rendering: a vision-language model (VLM) handles visual understanding, cross-lingual translation, and structured visual generation, while a diffusion model performs background inpainting and pixel-level refinement, followed by deterministic rendering to synthesize the final image. Based on this formulation, we develop a three-stage post-training framework, where supervised fine-tuning (SFT) establishes the image-to-code mapping, privilege-gap weighted self-distillation (PWSD) improves the learning of style and layout tokens, and reinforcement learning with verifiable rewards (RLVR) further optimizes task-level performance. We further introduce TransAnyDataset and TransAnyBench, a multilingual dataset and benchmark for e-commerce image translation. Extensive experiments demonstrate competitive performance against cascaded pipelines, open-source end-to-end models, and closed-source image editing systems, providing an effective, controllable, and editable solution for cross-border e-commerce image translation.
67. 【2608.16268】CoM$^3$eT: A foundation model for medical image analysis through federated, multidimensional context integration
链接：https://arxiv.org/abs/2608.16268
作者：J. Raphael Schäfer,Kai Geissler,Till Nicke,Chiara Tappermann,Karoline Heber,Eike Petersen,Habib Mergan,Lars Ole Schwen,Nick Weiss,Annika Gerken,Jan Hendrik Moltz,Tom Bisson,Isil Dogan O,Tim-Rasmus Kiehl,Norman Zerbe,Sefer Elezkurtaj,Robin S. Mayer,Nadine Flinner,Peter Wild,Isabel Dahm,Felix Peisen,Heinrich von Busch,Robert Grimm,Sebastian Arndt,Lisa Siegler,Matthias Stefan May,Antje Prasse,Natalia Artysh,Fabian Kiessling,Johannes Lotz
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：limited labeled data, Medical foundation models, Multitask Medical Transformer, models improve generalization, Co-representation Multidimensional Multitask
备注：
点击查看摘要
Abstract:Medical foundation models improve generalization when training AI models with limited labeled data, but remain confined to a single specialty, such as pathology or radiology, and to either sparse or dense outputs, such as classification or segmentation. Here, we present CoM$^3$eT (Co-representation Multidimensional Multitask Medical Transformer), a medical vision foundation model that unifies pathology and radiology, sparse and dense predictions, and two- and higher-dimensional inputs by modeling multidimensional context with attention. CoM$^3$eT outperformed other medical foundation models in an open competition spanning five tomographic, four whole-specimen, and three two-dimensional datasets, covering sparse and dense prediction tasks as well as report generation. When adapted across diverse clinical applications, training fewer than 2.5% of parameters achieved performance comparable to full fine-tuning, enabling research without access to high-performance GPU clusters. Applied to federated learning across hospitals, this approach achieved performance comparable to pooled-data training over internet connections and with consumer-grade hardware.
68. 【2608.16263】Seeing Before Answering: Training-Free Visual Layer Profiling for Vision-Language Models
链接：https://arxiv.org/abs/2608.16263
作者：Ruchen Liu,Yi Yang,Yiming Xu,Michael Ying Yang,Monika Sester,Bodo Rosenhahn
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pass visual tokens, LLaVA-style Vision-Language Models, fixed late layer, LLaVA-style Vision-Language, typically the penultimate
备注： ECCVW'26 eXCV
点击查看摘要
Abstract:LLaVA-style Vision-Language Models (VLMs) pass visual tokens from a fixed late layer of the vision backbone, typically the penultimate one, to the language model. We first show that this hidden convention is fragile: across 2 VLMs and 7 image and video benchmarks, the default layer is sub-optimal in 13 of 14 model-task pairs, and the best layer shifts with both task and visual backbone. Finding that layer by exhaustive layer-wise inference is prohibitively expensive, and no better fixed default exists. We therefore ask whether layer usefulness can instead be predicted from representation geometry. We study matrix-based entropy, introduced for unimodal layer analysis, which we compute over sample-level visual embeddings as Visual Dataset Entropy (VDE); and Gromov-Wasserstein (GW) distance, introduced for encoder-level VLM model selection, which we repurpose as a layer-wise visual--language alignment signal. Transferring these to LLaVA-based models is not obvious a priori: the vision tower is frozen while the multimodal projector is trained, so we profile both sides of the projector. We find that VDE transfers, and GW does not. Computed from 100 unlabeled task samples without downstream inference, pre-projector VDE tracks layer-wise accuracy and its top-ranked layers cover the oracle best layer on every task for the SigLIP-based LLaVA-Video, while giving region-level guidance for the CLIP-based Video-LLaVA. Post-projector profiles show that the projector reshapes visual geometry but does not erase the performance-relevant trend, leaving $\mathrm{VDE}_{\mathrm{pre}}$ the stronger signal. GW instead flattens after projection and is best read as an alignment diagnostic rather than a selector. VDE thus offers an interpretable, training-free policy that narrows the visual-layer search to a handful of candidates for limited downstream verification.
69. 【2608.16259】Defake-o3: From Speculative Rationales to Verifiable Evidence for Explainable AIGI Detection
链接：https://arxiv.org/abs/2608.16259
作者：Bowen Deng,Jiahui Zhan,Yikun Ji,Haozhen Yan,Jianfu Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：generation models calls, explainable AIGI detector, rapid progress, calls for AI-generated, image generation models
备注： Accepted by ACMMM 2026
点击查看摘要
Abstract:The rapid progress of image generation models calls for AI-generated image (AIGI) detectors that are not only accurate but also explainable and reliable. While MLLM-based detectors can provide natural language explanations, existing methods often generate speculative rationales: they rely on vague or hallucinated artifacts, miss subtle localized flaws from the latest generators, and fail to provide evidence that can be visually verified. We present Defake-o3, an explainable AIGI detector that moves from speculative rationales to verifiable evidence. It combines interactive visual search with verifier-guided evidence alignment: the model iteratively zooms into suspicious regions to inspect fine-grained details, while an Evidence Verifier, trained from human verification annotations, provides reinforcement learning rewards that favor grounded evidence and penalize baseless claims. To support this objective, we construct GroundFake, a dataset designed for grounded explainable detection, with localized bounding-box evidence, human verification based on visual grounding and artifact specificity, corrected reasoning trajectories, and valid/invalid evidence supervision. We further introduce FakeFrontier, an out-of-distribution benchmark built from real images and outputs of 10 recent generators, together with an MLLM-based protocol for evaluating evidence quality and persuasiveness. Experiments on GroundFake, FakeFrontier, and additional out-of-distribution benchmarks show that Defake-o3 improves both detection accuracy and explanation quality, producing more localized, verifiable, and persuasive evidence.
70. 【2608.16251】SCOUT: Semantic Concept Discovery for Open-Vocabulary Editing of face Recognition Templates
链接：https://arxiv.org/abs/2608.16251
作者：Leon Todorov,Peter Rot,Peter Peer,Vitomir Štruc,Klemen Grm
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Face recognition, Face recognition templates, rich semantic information, encode rich semantic, facial appearance
备注：
点击查看摘要
Abstract:Face recognition templates are compact identity representations, yet they also encode rich semantic information about facial appearance. Prior work has shown that templates can be inverted to images or indirectly manipulated through image-editing pipelines, but direct semantic editing in template space remains largely unexplored. Existing interpretability methods for face recognition often rely on manual neuron inspection or predefined attribute labels, limiting scalability and semantic flexibility. To address this gap, we propose SCOUT (Semantic Concept Discovery for Open-VocabUlary Editing of Face Recognition Templates), an end-to-end framework for discovering and directly manipulating semantic concepts in face recognition templates using mechanistic interpretability. SCOUT learns sparse template representations, generates semantic hypotheses for latent features from natural-language descriptions, and validates their stability. The resulting features act as controllable semantic directions for direct editing, avoiding costly edit--re-encode pipelines. Experiments with face recognition models using CNN, ViT, and Swin backbones show that SCOUT discovers interpretable concepts beyond standard attribute labels and enables controllable, identity-aware template manipulation with negligible impact on identity matching. We further show that edited templates can subsequently be decoded with independent inversion models for visualization and evaluation.
71. 【2608.16241】Convolution-Free Holistic Multivariance Decomposition Layer for Efficient Hyperspectral Image Classification Tensor Networks
链接：https://arxiv.org/abs/2608.16241
作者：Süha Tuna,Ülker Başar
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Optimization and Control (math.OC)
关键词：complex spatio-spectral interdependencies, capture complex spatio-spectral, heavily parameterized convolutional, parameterized convolutional neural, convolutional neural networks
备注：
点击查看摘要
Abstract:Feature extraction for hyperspectral image classification is conventionally addressed using rigid tensor decompositions that fail to capture complex spatio-spectral interdependencies, or heavily parameterized convolutional neural networks that are computationally expensive. To overcome these limitations, this work introduces the Holistic Multivariance Decomposition (HMD) framework as a novel, end-to-end differentiable neural network layer. By explicitly separating independent single mode variations from cooperative higher dimensional interactions via learnable, matrix valued supports, the proposed HMD-0, HMD-1 and HMD-2 approximants are optimized jointly with a downstream classifier via backpropagation. Comprehensive evaluations across three benchmark HS datasets demonstrate that the higher level HMD layers achieve superior classification accuracy compared to classical learnable tensor baselines, including Tucker, Canonical Polyadic, and Tensor Train decompositions. Furthermore, HMD-1 and HMD-2 achieve a generalization capacity and training stability comparable to standard 2D and 3D-CNNs while requiring significantly fewer feature extractor parameters. These results demonstrate that the HMD framework provides a structurally robust substitute for traditional convolution in multidimensional HS image classification, offering high parameter efficiency and stability throughout the optimization process.
72. 【2608.16234】GaussianDWM++: Language-Grounded 3D Gaussian Driving World Model for Unified Scene Understanding, Editing, and Multi-Modal Generation
链接：https://arxiv.org/abs/2608.16234
作者：Tianchen Deng,Xuefeng Chen,Shuang Wu,Qu Chen,Jiajun Zhu,Bo Dai,Jianfei Yang,Hesheng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recently advanced rapidly, Gaussian, Driving World Models, driving world model, lack explicit
备注：
点击查看摘要
Abstract:Driving World Models (DWMs) have recently advanced rapidly with generative models, yet most existing methods mainly focus on conditional scene generation and lack explicit 3D scene understanding, language-grounded reasoning, and controllable 4D editing capabilities. Moreover, commonly used point cloud, occupancy, or BEV representations make it difficult to achieve fine-grained alignment between textual information and the underlying 3D scene structure. To address these limitations, we propose a foundation-feature Gaussian driving world model that unifies scene understanding, language-grounded reasoning, controllable 4D editing, and multi-modal generation within a single framework. Specifically, we introduce a foundation-feature Gaussian tokenizer that directly distills Qwen/SigLIP visual-language features into 3D Gaussian primitives, building a compact open-vocabulary Gaussian semantic field. We further design a geometry-aware Gaussian adapter that combines importance-aware hierarchical selection with text-conditioned Perceiver-style cross-attention to aggregate dense Gaussian primitives into compact world tokens. To improve representation compatibility, we introduce a KL-based Gaussian--image distribution alignment objective that aligns Gaussian world tokens with foundation image tokens. Based on the aligned Gaussian representation, our framework further supports instruction-controllable scene editing, including weather-conditioned generation and dynamic vehicle manipulation. Extensive experiments on broader driving benchmarks demonstrate that our method achieves state-of-the-art performance across scene understanding, visual grounding, planning-oriented reasoning, and controllable 4D generation tasks. We will release the code and datasets publicly on Github.
73. 【2608.16225】PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds
链接：https://arxiv.org/abs/2608.16225
作者：Dejun Zhang,Yanzi Bai,Yiqi Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dense prediction tasks, weak prior assumptions, cloud object classification, Standard Transformers, dense prediction
备注：
点击查看摘要
Abstract:Standard Transformers have proven effective in point cloud object classification, but their performance in dense prediction tasks within complex scenes is often hindered by weak prior assumptions. To address this challenge, we propose PCT-Prompt, a novel framework that enhances standard Transformers by introducing a prompt-guided feature branch to improve performance in dense prediction tasks. The standard Transformer branch leverages pre-trained models for global feature extraction from point cloud data, serving as the backbone for processing high-level features. Meanwhile, the prompt-guided feature branch consists of two key components: a fine-grained feature extraction block that captures multi-scale geometric features using geometry-sensitive abstraction layer, along with the PnP-3D layer to integrate local context with global regularization. The second component, the prompt-refined feature learning block generates prompt tokens, which are subsequently refined through cross-attention mechanisms. Additionally, we introduce a prompt drop mechanism that progressively removes prompt information across Transformer layers, balancing local details and global consistency. Experimental results on the ShapeNetPart, S3DIS, and DALES datasets demonstrate that PCT-Prompt significantly improves the adaptability of standard Transformers to dense prediction tasks, achieving strong performance in real-world scenarios.
74. 【2608.16220】SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioning
链接：https://arxiv.org/abs/2608.16220
作者：Tao Feng,Xu Li,Xiangyang Luo,Ming Wen,Huadai Liu,Chen Zhang,Wei Xue
类目：ound (cs.SD); Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating personalized dance, Generating personalized, track requires music-conditioned, audio track requires, text prompt
备注： 9 pages, 5 figures
点击查看摘要
Abstract:Generating personalized dance videos from a reference image, text prompt, and audio track requires music-conditioned body motion. Singing-and-dancing adds a second requirement: the visible subject must also articulate the vocals. Existing music-conditioned methods focus primarily on choreography, while speech-driven models generally assume that the visible subject produces the input voice, leaving this combined setting largely underexplored. We introduce SingDance, a unified video diffusion framework that formulates controllable vocal articulation as a semantic role: the visible subject is either the source, who produces the vocal signal, or the listener, who receives it from an off-screen performer. Hard-compact routing selects task-relevant speech, music, and role conditions, which are composed through frame-wise joint audio injection; source and listener retain the same speech pathway. Training uses asymmetric supervision: on-screen speaking and curated off-screen conversational-response videos establish role control, while instrumental and song-based dancing-only videos establish music-conditioned body motion. The target Song/Source configuration is never observed during training. At inference, assigning the source role to a song composes separately learned articulation and song-conditioned dance capabilities, enabling compositional zero-shot singing-and-dancing. Experiments demonstrate strong motion--beat alignment and visual fidelity, reliable paired switching of vocal articulation while preserving music-aligned body motion, and highly competitive lip synchronization with substantially fewer generation-time parameters than the strongest speech-driven baseline evaluated.
75. 【2608.16198】Picking the Right Image to Classify: Reliable-Input Selection in Teledermatology
链接：https://arxiv.org/abs/2608.16198
作者：Fabian Gröger,Marco Weishaupt,Philippe Gottfrois,Simone Lionetti,Linda Wermelinger,Nipun Ranasekara,Ludovic Amruthalingam,Alexander A. Navarini,Marc Pouly
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：face distribution shifts, submitted images differ, models face distribution, Dermatology models face, teledermatology settings
备注：
点击查看摘要
Abstract:Dermatology models face distribution shifts in teledermatology settings, where submitted images differ from the training data in lighting, angle, distance, focus, and framing. These test-time images are ordinary clinical photographs, but some fall outside the model's training conditions, leading the model to often misclassify them due to shifts in acquisition between training and deployment. When multiple images of the same case exist (several photos of one patient or lesion), a natural way to improve accuracy is therefore to select the image the model is most likely to classify correctly. We call this task reliable-input selection. An oracle that, for each case, selects a correctly classified image when one exists raises weighted F1 by about 20 percentage points on average across six dermatology datasets and nine frozen backbones. This oracle is an upper bound that sees the labels, whereas a selector must choose blindly. Capturing this gain in practice is hard. A selector that needs no pretraining data applies to any frozen model, including those whose data is not public. It must judge reliability from quantities the model exposes at inference: its embeddings, their norms, and its confidence. We benchmark four such training-data-free selectors: the embedding norm, the neighborhood consensus among a case's images, the stability of the prediction under small perturbations, and the model's own confidence. No training-data-free selector substantially narrows this oracle gap. The best of them is the model's own confidence, but it recovers only a small part of the gap on the clinical datasets. A small labeled reference set does not help either: the best selector overall, a fusion of confidence and Mahalanobis distance, still leaves most of the gap. To our knowledge, this is the first study to introduce and benchmark reliable input selection, a clinically important, unsolved task.
76. 【2608.16191】Beyond Clear Skies: Synthetic Seasonal and Weather Variations for Real-World Drone Detection
链接：https://arxiv.org/abs/2608.16191
作者：Tamara R. Lenhard,Andreas Weinmann,Tobias Koch
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：full operational design, deployment conditions requires, conditions requires training, requires training data, Reliable drone detection
备注：
点击查看摘要
Abstract:Reliable drone detection under real-world deployment conditions requires training data that spans the full operational design domain, including adverse weather and seasonal appearance variation. However, acquiring and annotating such data at scale remains highly resource-intensive, as adverse-weather conditions are inherently difficult to control, reproduce, and sample systematically. Existing datasets therefore typically provide only limited coverage of such conditions. Conversely, synthetic data offers a scalable alternative: environmental variation becomes controllable, while modern game-engine-based pipelines provide realistic rendering and automatic annotations. Leveraging this potential, we introduce SynDroneVision-Weather (SDV-W), an systematic extension of SynDroneVision (SDV) targeting adverse-weather and seasonal domain shifts in urban drone detection. SDV-W comprises 55,187 annotated high-resolution images from three urban environments, rendered across three seasonal configurations and diverse weather conditions, including rain, snow, and fog at multiple severity levels. By preserving SDV's scene and trajectory configuration, SDV-W enables matched clean-adverse comparisons and quantification of condition-specific detector degradation. Across representative YOLO models and real-world datasets, we show that SDV-W improves detector reliability under adverse appearance shifts, reduces missed detections and false alarms, and is most effective as a complement to general-purpose synthetic drone-detection data. SDV-W will be publicly released upon paper acceptance.
77. 【2608.16154】KeyID: Decoupled Drafting and Keyframe Editing for Identity-Preserving Video Generation
链接：https://arxiv.org/abs/2608.16154
作者：Jianjie Luo,Yiming Zhong,Haoming Shen,Yupeng Xiao,Zhenguo Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Multimedia (cs.MM)
关键词：Identity-preserving video generation, requires synthesizing videos, Identity-preserving video, requires synthesizing, subjects and text
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:Identity-preserving video generation (IPVG) requires synthesizing videos that are faithful to both reference subjects and text prompts. Existing methods are often hindered by high tuning costs or limited input-level enhancements, struggling to maintain rigid identity consistency during complex, long-sequence actions. To address these limitations, we propose KeyID, a training-free IPVG framework that decouples the synthesis of video dynamics from the injection of identity. Specifically, KeyID comprises two components: (1) Reference-Aware Video Generation, which produces an identity-agnostic video draft aligned with multiple references, and (2) Identity-Preserved Keyframe Editing, which integrates the target identity via sparse keyframe correction and subsequent motion interpolation. By shifting from dense frame-level supervision to sparse keyframe-level refinement, KeyID effectively resolves the capacity conflict between prompt adherence and identity fidelity. Crucially, our modular design allows seamless extension to multi-subject references and complex sequential action generation without additional training. KeyID outperforms prior works and is validated by automatic and human evaluations on the official challenge benchmark, ultimately securing the runner-up position in the Track 2 (Sequential Action) of the ACM Multimedia 2026 IPVG Grand Challenge. Source code is available at this https URL.
78. 【2608.16146】he Right Prior for the Right Deformation: Rethinking Continuous Deformable Image Registration
链接：https://arxiv.org/abs/2608.16146
作者：Hengjie Liu,Chushu Shen,Dan Ruan,Ke Sheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deformable image registration, models implicitly encode, implicitly encode deformation, Deformable image, implicitly encode
备注：
点击查看摘要
Abstract:Deformable image registration models implicitly encode deformation priors through their parametrization and optimization. In this work, we conduct a validation study on continuous registration methods to examine how these implicit priors affect performance across different registration tasks. Classic B-Spline transformations impose locality, smoothness, and scale through their control-point structure, whereas recent INR-based methods impose different priors through neural parameterization and optimization. We compare INR-Dense (IDIR), which directly models a dense displacement field using a SIREN-based INR; INR-BSCP (SINR), which predicts B-Spline control points with an INR; D-BSCP, which directly optimizes single-scale B-Spline control points; and MR-D-BSCP, which adds a multiresolution coarse-to-fine scheme. Experiments on inter-subject brain MR registration (OASIS) and intra-subject exhale-to-inhale lung CT registration (DIR-LAB 4DCT) reveal different behavior across deformation regimes. On OASIS, where deformations are moderate but locally complex, D-BSCP matches or slightly outperforms INR-BSCP, suggesting that the B-Spline parameterization accounts for much of INR-BSCP's effectiveness. On DIR-LAB 4DCT, where respiratory motion is larger and more coherent, single-scale B-Spline methods (D-BSCP and INR-BSCP) are less suitable, while INR-Dense and MR-D-BSCP are more effective. Across both tasks, MR-D-BSCP achieves the best performance among the tested continuous parameterizations. These findings highlight that registration accuracy depends strongly on matching the induced deformation prior to the target motion pattern, and support prior-deformation matching as a practical design principle for medical image registration. Our code will be available at this https URL.
79. 【2608.16143】AnyTalk: Speech Animation for Arbitrary Characters Leveraging a Video Generation Model
链接：https://arxiv.org/abs/2608.16143
作者：Kwan Yun,Serin Yoon,Sunjin Jung,Jung Eun Yoo,Inyup Lee,Junyong Noh
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Sound (cs.SD)
关键词：video diffusion model, video diffusion, video, diffusion model, speech animation
备注： accepted to TVCG, Project page at [this https URL](https://serin-yoon.github.io/projects/anytalk/)
点击查看摘要
Abstract:We present AnyTalk, a novel method for generating 3D speech animations for arbitrary characters without requiring any animation data. While existing audio-driven 3D speech animation methods rely on character-specific training data or laborious rigging/re-meshing, AnyTalk circumvents these limitations by leveraging recent video diffusion models trained on extensive video datasets. We first adapt a pre-trained video diffusion model to a target character through our Character-specific Fine-tuning (\textit{CsF}) technique. By fine-tuning on rendered images of the 3D character paired with zeroed-out audio embeddings (representing "no motion"), we eliminate the need for animation data while preserving the motion prior of large-scale video diffusion model. We then uplift the resulting talking-head video into a 3D speech animation by estimating blendshape parameters through a proposed optimization process. AnyTalk enables lip-synced animations across diverse face meshes and blendshape configurations, significantly reducing manual effort and data requirements. We further enhance usability by distilling AnyTalk into a streamlined network, $\text{AnyTalk}_{RT}$, thereby enabling real-time performance. By leveraging talking-head video generation, our method broadens access to audio-driven speech animation technology for arbitrary characters. The code is publicly available at this https URL.
80. 【2608.16142】Graph Neural Assisted Actor-Critic for Latency-Efficient Edge Vision System
链接：https://arxiv.org/abs/2608.16142
作者：Alam Noor,Luis Almeida,Kai Li,Jiyan Wu,Miguel Gutiérrez Gaitán,Eduardo Tovar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：UAV on-board vision, including monitoring, no-fly zones, monitoring in no-fly, on-board vision systems
备注：
点击查看摘要
Abstract:UAV on-board vision systems are widely used for different activities, including monitoring in no-fly zones. In this case, the vision-equipped UAV streams a video to a ground server where an operator assists its activities. The latency of video transmission has a profound impact on the effectiveness of the operator assistance. However, most techniques available for video transmission still incur significant latency costs. In this paper, we propose a graph convolutional neural network-assisted (GCN-Assisted A2C) deep reinforcement learning (DRL) system model to find the optimal pixel-correlated area of a suspicious object. We combine the Lagrangian dual form with gradient descent to prevent lack of convergence and over- and under-penalization constraint violation during latency optimization. The proposed system model sends a sub-group pixel-correlated area of the frame from the UAV to the server rather than the transmission of the whole video frame. The proposed framework utilizes the GCN model to explore hidden representations of feature-correlated groups of pixels. Moreover, the GCN supervises the A2C model, which selects a subgroup to enhance transmission latency, thus supervising the training of UAV actions in A2C. Experimental results show that GCN-assisted A2C reduces video frame transmission latency together with false detection rate in UAV vision systems over other DRL and state-of-the-art models.
81. 【2608.16122】okenSTFormer: A Tokenized Spatial-temporal Attention Model for Holistic Motion Analysis in Adolescent Idiopathic Scoliosis Screening
链接：https://arxiv.org/abs/2608.16122
作者：Dong Chen,Kenneth M.C. Cheung
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Adolescent Idiopathic Scoliosis, severe health outcomes, prevalent spinal deformity, Adolescent Idiopathic, left untreated
备注：
点击查看摘要
Abstract:Adolescent Idiopathic Scoliosis (AIS) is a prevalent spinal deformity in adolescents that, if left untreated, can result in severe health outcomes. Traditional screening methods are limited by subjective interpretation, reliance on professional expertise and low scalability. To address these challenges, we present ScoliGait dataset, which comprises 1,516 gait video clips paired with corresponding X-ray records. We also introduce TokenSTFormer, a novel model that tokenizes spatial and temporal semantics to enhance feature representation and convergence. Our model achieves state-of-the-art performance, surpassing vanilla Vision Transformer encoder across key metrics, including accuracy of 0.79. This study highlights the potential of leveraging holistic motion features derived from gait video and attention-based models for scalable, cost-effective AIS screening, paving the way for future clinical applications in scoliosis detection.
82. 【2608.16110】SUGFW+: An Uncertainty-guided Feature Weighting Framework for Cold Start Active Adaptation of SAM in Medical Image Segmentation
链接：https://arxiv.org/abs/2608.16110
作者：Xiaochuan Ma,Ning Zhu,Jia Fu,Lanfeng Zhong,Hanyu Jiang,Bin Song,Kang Li,Guotai Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cold Start Active, Start Active Learning, Cold Start, Start Active, Active Learning
备注：
点击查看摘要
Abstract:Cold Start Active Learning (CSAL) is important in improving the performance of a medical image segmentation model with low annotation budget by querying a small subset for annotation from an unlabeled training set. Existing CSAL methods typically rely on inefficient dataset-specific Self-Supervised Learning (SSL) to map the unlabeled images into a feature space for sample selection. Recently, the advent of foundation models such as the Segment Anything Model (SAM) offer a promising alternative as the pre-trained model can provide strong generalizable feature embeddings, and allow high performance in downstream tasks after fine-tuning (adaptation). However, how to systematically exploit SAM's inherent embeddings for cold-start sample selection during adaptation with low annotation budget remains underexplored. To address this, we propose an extended SAM-based Uncertainty-guided Feature Weighting (SUGFW+) framework for CSAL and adaptation of SAM. Specifically, it leverages the SAM for Patch-level Feature and Uncertainty Calculation (PFUC), and introduces a Patch-based Global Distinct Representation (PGDR) module that aggregates patch-level embeddings into highly discriminative, uncertainty-aware image-level features. These features are then utilized by a Greedy Selection with Cluster and Uncertainty (GSCU) strategy to combine diversity and uncertainty during sample selection. Unlike prior CSAL methods that decouple sample selection from model training, SUGFW+ tightly integrates these two stages via an Uncertainty-Prompted Fine-Tuning (UPFT) process of SAM in model training. Extensive experiments on four public datasets demonstrate that SUGFW+ achieves state-of-the-art performance against existing CSAL methods. Code is available at this https URL.
83. 【2608.16104】Nexus: Structured Synergy for Efficient Text-to-Image Generation using Rectified Flow Model
链接：https://arxiv.org/abs/2608.16104
作者：Yizhao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：made significant progress, footprint hinder high-resolution, hinder high-resolution synthesis, large memory footprint, memory footprint hinder
备注： 12 pages, 4 figures
点击查看摘要
Abstract:Diffusion and flow matching models have made significant progress in text-to-image generation, yet high computation, quadratic complexity, and large memory footprint hinder high-resolution synthesis and edge deployment. We propose Nexus, which integrates sparse architecture, linear complexity, and low-bit quantization. It combines MoE feed-forward layers, gated DeltaNet attention, and per-expert low-bit training to reduce computation and memory. Their joint optimization allows Nexus to achieve generation quality comparable to mainstream models such as SDXL and SD3 while delivering markedly higher inference efficiency. Experiments on COCO and LAION validate its effectiveness.
84. 【2608.16103】Beyond Similarity Matching: Structured Reasoning for Open-Vocabulary Referring Segmentation in 3DGS
链接：https://arxiv.org/abs/2608.16103
作者：Yizhao Wang,Xinfa Wang,Jingbo Wang,Jingbo Wang,Guantao Zhang,Yafeng Han,Guohong Gao,Yuhe Xia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：free-form language expressions, Gaussian Splatting, select Gaussian primitives, model to select, free-form language
备注： 24 pages, 5 figures
点击查看摘要
Abstract:Open-vocabulary referring segmentation in 3D Gaussian Splatting (3DGS) requires a neural model to select Gaussian primitives according to free-form language expressions. Existing 3DGS-based methods usually rely on global text-region similarity, which is weak for queries involving attributes, reference objects, spatial relations, and fine-grained parts. This often causes target-reference confusion, granularity mismatch, part-whole leakage, and relation violations. We propose QAGaussian, a query-adaptive neural reasoning framework for language-guided Gaussian primitive selection. QAGaussian first learns query-conditioned multi-scale Gaussian slots as differentiable candidates whose receptive fields are shaped by the input expression. It then builds a relation-aware slot graph with language-conditioned edge weighting to propagate target-reference, attribute, part-whole, and contextual evidence. A granularity-adaptive router softly combines region-level, object-level, part-level, attribute-aware, and relation-aware mask branches, followed by relation-constrained refinement for spatial, part-whole, attribute, and geometric consistency. QAGaussian is pretrained only on Mosaic3D-5.6M for Gaussian-text alignment and evaluated on independent benchmarks without target-dataset fine-tuning. It achieves 47.2 Avg. mIoU and 63.2 Avg. F1, outperforming the strongest 3DGS referring baseline by 2.7 mIoU points and 2.9 F1 points. It also improves Part-mIoU from 38.6 to 43.4, Rel-mIoU from 44.4 to 50.8, and reduces target-reference confusion from 10.8 to 7.4. These results demonstrate that query-conditioned slot learning, relation-aware graph reasoning, and adaptive routing provide an effective neural modeling strategy for open-vocabulary referring segmentation in 3DGS. The code is available at this https URL.
85. 【2608.16100】ISC: A Text-Driven Image Semantic Communication System for Faithful Reconstruction
链接：https://arxiv.org/abs/2608.16100
作者：Feifan Zhang,Yuyang Du,Xiaoyan Liu,Soung Chang Liew
类目：Computer Vision and Pattern Recognition (cs.CV); Networking and Internet Architecture (cs.NI)
关键词：diffusion-based generative models, Generative image semantic, generative models, semantic, diffusion-based generative
备注：
点击查看摘要
Abstract:Generative image semantic communication converts an image into a text description and then performs text-to-image reconstruction at the receiver via diffusion-based generative models. This paradigm has attracted broad attention due to its extremely low bandwidth cost. However, existing methods still face two critical bottlenecks across image-to-text (I2T) semantic extraction at the transmitter and text-to-image (T2I) semantic reconstruction at the receiver: (i) semantic loss and distortion in I2T, where holistic image descriptions may omit fine-grained object attributes and spatial-position information, causing the generated text to deviate from the original image semantics; and (ii) insufficient semantic faithfulness in T2I, where even with the same semantically faithful text description, different initial noise settings may lead diffusion-based reconstruction to produce images with different levels of semantic consistency with the original image. These issues jointly limit the semantic faithfulness of image reconstruction. To address them, we propose TISC, a text-driven image semantic communication framework tailored for faithful reconstruction. TISC incorporates two key designs: (1) Tree-Structured Attribute Semantic Extraction (TSASE), which decomposes semantic extraction into global scene, background, and object-level attribute descriptions, covering spatial position, shape/pose, color, material, and other physical attributes for each detected object; and (2) an Initial Noise Optimization (INO) mechanism, which selects an initial noise seed at the transmitter according to a comprehensive similarity score that jointly considers visual and semantic consistency. Experiments on multiple datasets show that TSASE improves object-position recovery and semantic description faithfulness, while the INO parameter study supports the adopted configuration for noise selection.
86. 【2608.16087】Representation Is Not Enough: Body-Localized Thermal Evidence for Contactless Stress and Craving Sensing in Opioid Use Disorder
链接：https://arxiv.org/abs/2608.16087
作者：Sachin Deb,Harshit Sharma,Asif Salekin
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：stress response occurred, Removing wearables, removes their supervision, response occurred, physiological monitoring
备注：
点击查看摘要
Abstract:Removing wearables from physiological monitoring also removes their supervision: the signal indicating where and when a stress response occurred. Contactless stress sensing therefore becomes a weakly supervised evidence-localization problem, where a clip-level label must be traced to the body regions and moments that produced it. We address this with FABLE-Therm, a weakly supervised architecture that preserves localized evidence across body regions, time, and encoder-specific representations until the final decision. FABLE-Therm fuses frozen foundation-model encoders at the embedding level, with theory explaining why localized fusion can outperform feature concatenation and prediction averaging. We study this problem in opioid use disorder (OUD), where stress is a major relapse trigger and sustained wearable use can be difficult during early recovery. Using fixed thermal video, FABLE-Therm achieves 0.938 AUROC on held-out participants, and its learned representation transfers to self-reported craving, providing, to our knowledge, the first evidence that craving can be recovered from contactless thermal video. Localized evidence also enables participant-level analysis of deployment failure. We find that improving representation alone is insufficient for equitable deployment: additional data from the underserved group would recover only about half of the cohort gap, while the remainder reflects person-to-person heterogeneity. This modality-agnostic decomposition applies to models with identifiable subpopulations. Together with the first cohort-structured contactless thermal OUD benchmark, our results show that preserving localized evidence supports both accurate sensing and principled analysis of who a model fails and why.
87. 【2608.16081】SafeGesture: Evaluating Fine-Grained Hand Gesture Understanding in Vision-Language Models through Scenario-Conditioned Safety Interpretation
链接：https://arxiv.org/abs/2608.16081
作者：Taegang Kim,Saleh Afroogh,Junfeng Jiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：general image understanding, remains largely unexamined, contexts remains largely, Open-weight and frontier, interpret fine-grained hand
备注： 14 pages, 22 tables, 2 figures. Code and benchmark resources available at [this https URL](https://github.com/The-Responsible-AI-Initiative/SafeGesture)
点击查看摘要
Abstract:Open-weight and frontier vision-language models (VLMs) perform well on general image understanding, but their ability to interpret fine-grained hand gestures in safety-critical operational contexts remains largely unexamined. We introduce SafeGesture, a benchmark that evaluates whether a model can infer scenario-appropriate safety actions from hand gestures. It pairs six HaGRID gestures with eight operational scenarios for 4,800 items and evaluates Qwen2.5-VL-7B, LLaVA-NeXT-7B, InternVL2-8B, Phi-3.5-Vision, and GPT-4o. Results reveal a perception-reasoning decoupling: GPT-4o achieves 98.4% gesture accuracy but 53.3% safety accuracy, while Qwen2.5-VL reaches 84.9% and 39.5%, yielding gaps of 45.0 and 45.4 percentage points. Four of five models rarely or never use the uncertainty label, and failure directions differ substantially across models. Accuracy also obscures label bias: a scenario-majority policy with no visual input reaches 58.3%, above every evaluated model, while only GPT-4o exceeds this prior under macro-F1. Visual input improves safety accuracy by 11.2 to 30.2 percentage points, but providing the ground-truth gesture as text improves performance by only 0.4 to 3.2 points, and no model exceeds 56.2%. These results indicate that the main bottleneck is scenario-conditioned safety reasoning rather than gesture recognition.
88. 【2608.16074】US-VLA: An Ultrasound Vision-Language-Action Model for Embodied Abdomina
链接：https://arxiv.org/abs/2608.16074
作者：Cheng Zhang,Xingzheng Wu,Guihao Yan,Xifeng Hu,Zhi Liu,Mei Wu,Qing Cai
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Artificial intelligence-assisted ultrasound, reducing operator dependence, enhances diagnostic reliability, standardized image acquisition, Artificial intelligence-assisted
备注：
点击查看摘要
Abstract:Artificial intelligence-assisted ultrasound scanning enhances diagnostic reliability and efficiency by providing real-time guidance for standardized image acquisition and reducing operator dependence. However, existing reinforcement learning and learning-assisted ultrasound scanning methods typically rely on carefully designed reward functions or extensive interaction data, which limits their generalization ability and stability across different devices, patient populations, and complex clinical scenarios. To address these challenges, we propose an ultrasound vision-language-action model (US-VLA) for automated ultrasound scanning that explicitly encodes clinical semantic goals and generates sequential probe manipulation actions under real-time ultrasound feedback. In particular, we first design an ultrasound-aware expert fusion module to jointly integrate ultrasound observations with auxiliary contextual information, enabling semantic ultrasound feedback to effectively guide the scanning process. Then, we construct US-VLA-Data, a real-world dataset covering liver and kidney examinations, which includes five clinically defined standard planes and comprises 320 expert scanning trajectories with approximately 80,000 synchronized timesteps. Extensive experiments demonstrate that US-VLA achieves competitive performance in ultrasound probe manipulation tasks, indicating its effectiveness and promising generalization within the evaluated abdominal ultrasound setting. The source code is available at this https URL.
89. 【2608.16042】R-GS: High-Fidelity Sparse-View CT Volumetric Rendering via t-Distribution Gaussian Splatting and Ray-Confidence Modeling
链接：https://arxiv.org/abs/2608.16042
作者：Zedong Xiao,Yiren Wang,Zhou Liu,Xiaolin Liu,Zhangji Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：surgical planning, assessment and surgical, standard Gaussian primitives, High-fidelity, Gaussian primitives
备注：
点击查看摘要
Abstract:High-fidelity 3D medical visualization supports applications such as clinical assessment and surgical planning. Sparse-view computed tomography (CT) can reduce projection requirements and associated radiation exposure, but limited observations may introduce structural artifacts and reconstruction uncertainty. Although 3D Gaussian Splatting (3DGS) provides an efficient explicit representation for volumetric rendering, existing CT methods based on standard Gaussian primitives may be sensitive to unreliable observations under sparse-view acquisition. We present TR-GS, a Gaussian-splatting framework for sparse view CT volumetric rendering. TR-GS replaces standard Gaussian primitives with projectable Student's t-distribution primitives and introduces a ray-confidence model that regulates their degrees of freedom according to local ray observability. Confidence-guided 3D wavelet regularization is further used to balance high-frequency detail preservation and noise suppression. This work is licensed under a Creative Commons Attribution 4.0 International License. Experiments on synthetic and real-world datasets show that TR-GS improves over representative baselines in most evaluated settings and remains competitive in the remaining cases. The resulting volumetric representations may support downstream medical multimedia applications, including XR-based visualization and interactive clinical rendering.
90. 【2608.16031】AdROD: HyperNetwork-based Adversarially Robust Object Detection for Autonomous Driving
链接：https://arxiv.org/abs/2608.16031
作者：Yuting Wu,Dongfang Guo,Xiangzhong Luo,Qun Song,Rui Tan
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Camera-based object detectors, Camera-based object, physical adversarial attacks, vulnerable to physical, Camera-based
备注：
点击查看摘要
Abstract:Camera-based object detectors are vulnerable to physical adversarial attacks designed to suppress detections. While adversarial training and input purification offer some protection, they often overfit to specific attack distributions and fail on adaptive adversaries. This paper presents AdROD, an embedded, stochastic ensemble defense software designed for autonomous driving. AdROD employs {\em low-rank HyperNetworks}, which require only 1.6\% of the parameter footprint of standard HyperNetworks, to generate diverse detectors at a per-frame rate, making it impractical for attackers to obtain the deployed detectors in time. To further improve adversarial robustness, AdROD incorporates a novel \emph{functional diversity} mechanism, which couples stochastic weight updates with unique input-space transformations. We design two serving modes of AdROD that strike different trade-offs between robustness and runtime overhead: AdROD-I, a continuous protection mode for maximum resilience that leverages inter-detector disagreement to recover compromised detections, and AdROD-II, an on-demand mode triggered by kinematic discontinuities in object tracking. Through comprehensive evaluation with synthetic benchmarks, physically deployed adversarial patches, and end-to-end safety tests in the OpenCDA co-simulator, AdROD outperforms five baseline defenses and exhibits superior generalizability compared with the evaluated adversarial-training baselines, while maintaining real-time performance for safely stopping the vehicle at a stop sign instrumented with adversarial patches.
91. 【2608.16015】Multi-scale Decomposed Convolution Refinement Network for Visible-Infrared Person Re-Identification
链接：https://arxiv.org/abs/2608.16015
作者：Mingsheng Zheng,Zirui Jiang,Bo Liu,Yupeng Chen,Jun Zhang,Kai Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visible-infrared person re-identification, limited discriminative capabilities, Visible-infrared person, suboptimal recognition performance, Decomposed Convolution Refinement
备注： 15 pages, 4 figures. Accepted for publication in the LNCS proceedings of ICONIP 2026
点击查看摘要
Abstract:Visible-infrared person re-identification (VI-ReID) suffers from cross-modal discrepancies and limited discriminative capabilities, leading to suboptimal recognition performance. Current approaches exhibit limitations in semantic mining, cross-modal fusion and feature constraints. To tackle these challenges, we propose MDCRNet, a Multi-scale Decomposed Convolution Refinement Network that enhances cross-modal feature learning and discriminative metric learning. Specifically, we introduce a Hierarchical Learning Module (HLM) containing four Hierarchical Decomposed Convolution Attention (HDCA) modules, each equipped with lightweight channel attention and multi-scale spatial perception blocks to capture multi-scale spatial dependencies. Moreover, we develop a Joint Discriminative Metric Loss (JDML) incorporating a novel Granularity Discriminative Loss (GDL) that simultaneously optimizes intra-identity compactness and inter-identity separability across modalities. Extensive experiments on SYSU-MM01 and RegDB datasets demonstrate that MDCRNet achieves state-of-the-art performance on both benchmarks. Code is available at this https URL.
92. 【2608.16014】Depth-guided Multi-view Exposure Bracketing for HDR Robot Vision
链接：https://arxiv.org/abs/2608.16014
作者：Jinnyeong Kim,Juhyung Choi,Woohyeok Kim,Sunghyun Cho,Seung-Hwan Baek
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Achieving reliable single-shot, comprehensive benchmark exist, extreme illumination conditions, illumination conditions remains, Achieving reliable
备注： 14 pages, ECCV 2026 accepted
点击查看摘要
Abstract:Achieving reliable single-shot high dynamic range (HDR) imaging under extreme illumination conditions remains a long-standing challenge, yet no comprehensive benchmark exist for evaluating HDR perception in multi-sensor robotic systems. To fill this gap, we introduce a large-scale dataset collected via a custom robotic vision platform and an iPhone 13 Pro: 121 real-world scenes spanning modest and ultra-high dynamic range conditions, alongside 20 synthetic video sequences from the CARLA simulator. As a reference pipeline for this dataset, we propose Depth-guided Multi-view Exposure Bracketing (DMEB), a single-shot HDR method that distributes drastically different exposures across multi-view low-bit-depth cameras and fuses them via depth-guided confidence-aware fusion. Evaluations on our dataset show that DMEB establishes a strong reference point and highlight the promise of this sensor configuration for robust HDR perception in diverse multi-camera and depth sensor system.
93. 【2608.16011】ReRef-3D: A Benchmark for Spatial Referring Expression-Guided 3D Scene Rearrangement
链接：https://arxiv.org/abs/2608.16011
作者：Mary Lynn Martin,Yifei Zhang,Martha Palmer,Maria Leonor Pacheco
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：benchmark for language-guided, language-guided placement, CLEVR-derived scenes, scenes, Abstract
备注： 18 pages, 4 figures. Submitted to ACL Rolling Review (ARR)
点击查看摘要
Abstract:We introduce ReRef-3D, a benchmark for language-guided placement in 3D scenes. It contains 33,826 instructions across 998 CLEVR-derived scenes, spanning 16 placement families and direct, one-hop, and two-hop references. Each instruction must be resolved into a valid new placement position. Given that an instruction defines a region of acceptable placements rather than one coordinate, our evaluation inserts a prediction into the scene, recomputes relations, and tests relation satisfaction and physical validity. Each instruction also includes a verified naturalized rewrite. After fine-tuning, LLaVA-3D, 3D-LLM, and PlaceIt3D produce valid placements for 68.3%, 31.6%, and 22.4% of instructions, respectively. Across models, relation satisfaction surpasses physical validity, relations such as nearest and between are the most difficult, and phrasing has minimal effect on performance.
94. 【2608.16010】Breaking the Compression Barrier: Cross-Architecture Compression Boundary Learning via Reverse Regrowth
链接：https://arxiv.org/abs/2608.16010
作者：Zhaocen Liu,Satvik Praveen,Yi Sheng
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：resource-constrained edge devices, edge devices, deploying networks, networks on resource-constrained, resource-constrained edge
备注： 9 pages, 4 figures, 6 tables. Code available at [this https URL](https://github.com/EnumaCaliber/BRIDGE)
点击查看摘要
Abstract:Model compression is critical for deploying networks on resource-constrained edge devices. While pruning-based methods can significantly reduce model size, they often suffer from abrupt performance collapse beyond a sparsity thresh-old, making it difficult to identify the feasible compression limit of the model. To address this challenge, we propose a boundary-Learning reverse regrowth framework, BRIDGE, that reformulates compression as a constructive boundary-search problem. Unlike forward pruning, our method first drives the model to an extremely sparse state to expose the collapse region, and then selectively regenerates the critical structure to restore performance. The proposed framework employs a hierarchical regeneration strategy, including coarse-grained layer selection and fine-grained regeneration parameter selection, to accurately identify which parameters require recovery. Experiments show that our method can recover models from the brink of collapse on both CNNs and Transformer architectures, demonstrating its architecture in-dependence. BRIDGE achieves a performance improvement of up to 1.49% in unstructured pruning and up to 4.77% in structured pruning. These results demonstrate that reverse regeneration can effectively extend the compression limit while maintaining stable performance. The source code is available at this https URL.
95. 【2608.16008】Spatial Temporal Synergy: Balancing Change and Invariance in Text Driven 3D Human Motion Editing
链接：https://arxiv.org/abs/2608.16008
作者：Shaohui Lin,Zhenwu Shi,Jingyu Gong,Jiao Xie,Yu Zhou,Baochang Zhang,Lizhuang Ma,Chia-Wen Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-driven human motion, natural language instructions, Text-driven human, modify existing motion, existing motion sequences
备注：
点击查看摘要
Abstract:Text-driven human motion editing aims to modify existing motion sequences according to natural language instructions while maintaining the structural consistency of the original motion. Existing diffusion-based approaches struggle to balance text-responsive "change" and inertial "invariance". They often rely on coarse spatial constraints and rigid uniform time assumptions, leading to spatial motion distortions and the destruction of intrinsic physical rhythms during variable-length editing. To handle these challenges, we propose Change and Invariance Motion Editing (CIME), a unified framework that comprehensively decouples change and invariance into spatial pose and temporal rhythm dimensions. For spatial poses, our method integrates an omni-supervised positive-negative learning mechanism comprising hierarchical retrospective feature supervision, subtle motion preservation, and triplet-based semantic alignment. For temporal rhythms, we introduce the Riemannian Non-uniform Integral Manifold Mapping (RNIMM) module, which achieves high-fidelity reproduction of physical beats in the edited text via kinematics-aware non-uniform timestamps. Extensive experiments on the MotionFix and STANCE Adjustment datasets demonstrate that CIME achieves state-of-the-art performance in editing alignment and structural fidelity, validating the effectiveness of our unified architecture. Our source codes and models have been released at: this http URL
96. 【2608.15984】A Plug-and-Play 2D Motion Interface for Real-World Motion Language Models
链接：https://arxiv.org/abs/2608.15984
作者：Kaname Yokoyama,Norimichi Ukita
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Motion Language Models, typically understand human, Language Models, language model, understand human motions
备注： Accepted to HCMIW at ECCV 2026 (Oral Presentation). Code and demo: [this https URL](https://github.com/irajisamurai/2D-Motion-Interface)
点击查看摘要
Abstract:Motion Language Models (MoLMs) typically understand human motions by tokenizing 3D motion and processing the resulting tokens using a language model. However, obtaining accurate 3D motions from monocular videos is challenging, limiting their real-world applicability. To address this issue, we introduce a plug-and-play 2D Motion Interface that enables 3D-pretrained MoLMs to accept 2D motion inputs without modifying or fine-tuning the original models. Experiments on public datasets show that our method achieves performance comparable to 3D motion inputs across multiple MoLMs and outperforms training MoLMs from scratch on 2D motions. We further construct a monocular real-world video motion evaluation dataset and introduce a real-video adapter, demonstrating the usefulness of 2D motions over 3D motions under the evaluated monocular pose-estimation setting. These results suggest that 2D motion provides a practical interface for deploying MoLMs in real-world motion understanding settings. Code is available at this https URL.
Comments:
Accepted to HCMIW at ECCV 2026 (Oral Presentation). Code and demo: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.15984 [cs.CV]
(or
arXiv:2608.15984v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.15984
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
97. 【2608.15972】CM-MAE: A Physics-Guided Cross-Modal Self-Supervised Learning Framework for Vision-Wireless Applications
链接：https://arxiv.org/abs/2608.15972
作者：Yubo Zhang,Yiyao Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：wireless measurements observe, physical channels, measurements observe, Synchronized camera, wireless measurements
备注：
点击查看摘要
Abstract:Synchronized camera and wireless measurements observe the same scene through different physical channels. The central difficulty is that a representation learned in one deployment can fail when viewpoint, traffic, illumination, and propagation geometry change. This paper presents CM-MAE, a self-supervised vision--wireless pretraining framework for cross-scenario representation transfer. The evaluated real-data model uses only RGB frames and the measured 64-beam received-power vector available in DeepSense 6G; it does not use ray-traced paths, calibrated depth, or beam-index labels during pretraining. Its central pretraining term is a \emph{soft contrastive alignment loss}. Instead of making the synchronized image--wireless pair the only positive pair, this loss builds a target distribution from similarities between measured beam-power profiles, so nonidentical samples with similar directional responses are not forced apart as false negatives. A masked joint decoder provides the complementary local objective by reconstructing hidden visual patches and wireless angular clusters under modality dropout. After pretraining, a differential-rate fine-tuning rule lets a new fusion head adapt quickly while the encoders move slowly. Under a sequence-disjoint DeepSense 6G protocol, adding the soft alignment loss improves a matched linear-probe transfer average from 24.88\% to 29.49\%. Mild fusion fine-tuning reaches 77.38\% Top-1 accuracy on unseen Scenarios 6--8, and optional transductive normalization adaptation reaches 78.69\%. Since the fusion setting uses the contemporaneous 64-beam power vector at inference, these results should be read as representation-transfer diagnostics, not as proactive beam-prediction or reduced-sweeping claims.
98. 【2608.15971】he Limits of Binding in Dual Encoders
链接：https://arxiv.org/abs/2608.15971
作者：Kin Ian Lo
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：computed unit vectors, independently computed unit, blue dog, red dog, red car
备注：
点击查看摘要
Abstract:Dual-encoder models such as CLIP score an image-caption pair by a single inner product of two independently computed unit vectors, and fail at binding, often scoring near chance when asked to distinguish "a red car and a blue dog" from "a blue car and a red dog". We give a mathematical account of when this failure is necessary and when it is contingent. Working within the ideal-encoder framework proposed by Kang et al., we first show the relevant axioms are satisfiable, so every impossibility must enter through an added, checkable hypothesis. We then prove three such obstructions. Depth: for recursive role-binding codes the swap margin obeys an exact law $m(D) = 2b^{-D}$ in the nesting depth D, with a finite-dimension version holding up to one explicitly flagged concentration estimate; the resolvable depth grows only logarithmically in the dimension and is single-digit at CLIP scale, the nesting depth of ordinary language. Objective: architecture-free throttle theorems showing that the contrastive objective's entire reward for binding is bounded by the rate at which training contrasts a caption against its own swap, a rate that vanishes at web scale, and that exactly reversed binding costs only that rate times the mean binding margin; both are verified in simulation. Geometry: a tight smoothness-binding frontier: the closer the two swap-related captions must embed to a shared paraphrase anchor, the smaller the binding margin can be, with an exact constant. Measuring its text-only diagnostic across 18 deployed text encoders, every model sits at roughly 25-35% of its ceiling, and the induced per-item ceiling tracks SugarCrepe's subset difficulty at r = 0.99. Binding failure in deployed dual encoders is thus not a dimension or smoothness limit today, but an incentive and code-structure limit, with a proved depth ceiling that remains once those are fixed.
99. 【2608.15970】BagShift: Measuring How Patch Selection Changes the Evidence Seen by Whole-Slide MIL
链接：https://arxiv.org/abs/2608.15970
作者：Ruicheng Yuan,Zhenxuan Zhang,Liwei Hu,Anbang Wang,Haijie Xu,Jiawei Luo,Guang Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Whole-slide multiple-instance learning, Whole-slide multiple-instance, multiple-instance learning, Whole-slide, selector
备注： 18 pages include Supplementary Material. 8 figures
点击查看摘要
Abstract:Whole-slide multiple-instance learning (MIL) observes only the patches admitted by its selector. Deployment can alter this selector through compute limits, tissue masking, or regional workflows, even when the patch count is unchanged. We introduce BagShift, a paired protocol that changes the selector for the same case while holding its features and predictor fixed, thereby isolating selector response from case mix. With equal 128-patch budgets, sampling across the tissue or concentrating around one coordinate exposes markedly different evidence: on PANDA, the two views reduce quadratic weighted kappa by 1.57 and 17.96 points, respectively (QWK reported on the $\times100$ scale). On CAMELYON16, lesion annotations withheld from model development show that localized views retain tumor in only 10.0\% of micrometastatic observations, and matched exposure does not consistently recover the loss. The same fixed-count stressor produces a much smaller response on external lung subtyping, although differences in relative coverage make cross-task severity descriptive. When repeated localized observations are available, unioning their patches before one nonlinear MIL pass improves PANDA QWK by 7.87 points over averaging regional predictions. Patch count specifies computation, not observed evidence; deployment evaluations should report both what a selector preserves and how repeated observations are aggregated.
100. 【2608.15962】SEER: Long-Context Reasoning via Selective Visual-Text Compression
链接：https://arxiv.org/abs/2608.15962
作者：Jiawei Xu,Zhilin Zhai,Jinrui Fang,Ruohan Xu,Mingfei Lu,Yi Zhang,Guanchu Wang,Tianlong Chen,Ying Ding
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：remains computationally expensive, large language models, language models due, reasoning remains computationally, remains computationally
备注： COLM 2026, Third Conference on Language Modeling
点击查看摘要
Abstract:Long-context reasoning remains computationally expensive for large language models due to the quadratic complexity of attention over text tokens. Visual-text compression offers a promising alternative by rendering text into images and processing them with vision-language models, often reducing token usage. However, existing approaches apply uniform compression regardless of query relevance, potentially sacrificing precision where detailed extraction is required. We present SEER, a framework that learns to select query-relevant images through visual scanning and retrieve textual content only where needed, combining the efficiency of visual compression with the precision of text-based reasoning. Through supervised fine-tuning on tool-interaction trajectories, SEER learns adaptive tool invocation for selection and retrieval. Experiments on long-context benchmarks show that SEER improves extraction precision through selective text retrieval while retaining average prompt-token savings relative to full-text baselines. On LongBench, SEER achieves 51.11% average accuracy, outperforming the visual-text baseline Glyph-9B by 2.33 points and Qwen3-8B by 3.49 points. Code can be accessed at this https URL
101. 【2608.15930】UI-Mate: Advancing Open-Weight Foundation GUI Agents with In-Context Demonstrations
链接：https://arxiv.org/abs/2608.15930
作者：Zihan Ding,Longxu Dou,Qi Gao,Xiangwu Guo,Shengchao Hu,Zilong Huang,Zihang Jiang,Lei Ke,Mengcheng Lan,Weixian Lei,Hanxuan Li,Honglin Li,Xiyun Li,Zaitang Li,Leowei Liang,Xin Luo,Haozhe Ma,Jiayi Mao,Zhoujie Pan,Can Qin,Tianyuan Qu,Weiqi Wang,Wenkai Wang,Yonglin Wang,Yuxin Wang,Chenxu Wu,Yingchen Yu,Chenyu Zhang,Yuhao Zheng
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Foundation GUI agents, foundation GUI agent, automate complex digital, complex digital tasks, Foundation GUI
备注： UI-Mate Technical Report. Project page: [this https URL](https://ui-mate.github.io)
点击查看摘要
Abstract:Foundation GUI agents can automate complex digital tasks, but deployment is hindered by scarce and biased training data, ambiguous prompts, and unreliable execution. Routine workflows rely on user-specific tools and tacit conventions, so unstated instructions can produce arbitrary variations across runs. We present UI-Mate, a foundation GUI agent that integrates an environment-grounded training stack with in-context demonstration learning. UI-Mate makes three contributions: A Scalable Environment-Grounded Training Stack: A closed-loop data engine automates task generation, environment construction, rollout, filtering, capability balancing, SFT, and online RL across massively parallel environments via unified task-verifier bundles. In-Context Demonstration Learning: A mechanism that transforms multimodal demonstrations into flexible subtask-level workflows, follows relevant demonstrated steps, and re-plans from the live interface. OSWorkerBench Benchmark and Insights: A benchmark of 100 long-horizon office tasks across 41 applications that supports instruction-only and demonstration-guided evaluation. Its demonstration resources separate a 33-task self-demo setting, built from successful strong-agent rollouts of the same targets, from a 45-task variant-demo setting, built from human recordings of related but non-identical tasks. Experiments show that UI-Mate-27B sets a new open-weight state of the art on general computer-use benchmarks, scoring 77.0% on OSWorld-Verified and 66.2% on WindowsAgentArena. On OSWorkerBench, it reaches 41.0% strict success and 76.9% progress, outperforming its Qwen3.6-27B base by 17.7 and 24.5 points. On the 33-task self-demo subset, one demonstration raises strict success from 17.2% to 35.4% and progress from 67.9% to 81.1%, substantially improving long-horizon reliability. Project page: this https URL.
102. 【2608.15917】Pre-training Visual Dexterity in Simulation
链接：https://arxiv.org/abs/2608.15917
作者：Sarthak Kamat,Adam Rashid,Satvik Sharma,Aseem Doriwala,Chelsea Finn,Phillip Isola,C. Karen Liu
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：simple parallel-jaw grippers, made robot policy, fine-tuning increasingly data-efficient, robot policy fine-tuning, policy fine-tuning increasingly
备注： Project page: [this https URL](https://spd.bot)
点击查看摘要
Abstract:Large-scale pre-training has made robot policy fine-tuning increasingly data-efficient, but this progress has largely been driven by datasets and embodiments built around simple parallel-jaw grippers. Dexterous, multi-fingered hands remain comparatively data-starved because real teleoperation is costly to scale, while human hand video is off-embodiment and requires lossy pose estimation and retargeting. We introduce Simulation Pre-training for Dexterity (SPD), a pre-training framework for dexterous manipulation that uses data entirely collected in simulation. In SPD, humans manipulate virtual objects inside a VR headset, enabling on-embodiment trajectories and robot-free collection. With the help of five operators, we collect 75 hours of multi-task dexterous manipulation over one week, and use it to pre-train a causal transformer on a sequence modeling objective. We study the benefits of simulation pre-training on real-world tasks by fine-tuning on 1-2 hours of physical demonstrations on a 56-DoF bimanual dexterous setup. We find that our approach outperforms training behavior cloning policies from scratch, showing that simulation teleoperation is a viable pre-training source for real-world dexterous manipulation. We perform ablation studies, measuring the benefits of history conditioning and short action chunks for reactive control.
103. 【2608.15915】Comprehensive Benchmarking of Deep Learning Architectures for Lung Cancer Histopathology
链接：https://arxiv.org/abs/2608.15915
作者：Hadi Hasan,Safaa Salman,Lama Sleem,Ralph Mouawad,Ali Chehab
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：cancer-related mortality worldwide, manual slide examination, Lung cancer remains, mortality worldwide, slide examination
备注： 8 pages
点击查看摘要
Abstract:Lung cancer remains the leading cause of cancer-related mortality worldwide, while histopathological diagnosis is often affected by inter-observer variability and the substantial workload associated with manual slide examination. Although deep learning has shown considerable potential in computational pathology, comprehensive benchmarks that integrate tissue classification and region segmentation within a unified analytical framework remain limited. This study presents a two-stage deep learning framework for multi-class tissue classification and pixel-level histopathological region segmentation, accompanied by a systematic comparison of state-of-the-art architectures at each stage. For tissue classification, six models, a custom convolutional neural network, VGG16, DenseNet, MobileNetV3, a custom Vision Transformer, and YOLO11, are evaluated on a combined dataset of 39,000 images derived from LC25000 and LungHist700. The models distinguish between adenocarcinoma, squamous cell carcinoma, and normal lung tissue. YOLO11 achieves the best classification performance, with an accuracy of 98.38%, a five-fold cross-validation accuracy of 98.21 +/- 0.35%, and a macro F1-score of 0.98. For region segmentation, U-Net, ResNet-encoder U-Net, DeepLabV3+, and YOLO11-seg are evaluated using the GlaS gland segmentation benchmark. DeepLabV3+ obtains the highest Intersection over Union of 0.80 and a Dice score of 0.89, while YOLO11-seg achieves a comparable Intersection over Union of 0.79 using approximately 14x fewer parameters. The best-performing classification and segmentation models are subsequently integrated into an end-to-end framework, providing an accurate, computationally efficient, and reproducible baseline for automated histopathological image analysis.
104. 【2608.15905】CLARA: Clip-Level Multimodal Alignment with VLM-Derived Rationales for Hateful Video Detection
链接：https://arxiv.org/abs/2608.15905
作者：Yuchen Zhang,Shuang Dai,Zeyu Fu,Yunfei Long,Ravi Shekhar,Haralambos Mouratidis
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：social media platforms, video-centric social media, hate speech poses, Hateful video detection, social cohesion
备注：
点击查看摘要
Abstract:Hateful video detection has become increasingly important with the rapid growth of video-centric social media platforms, given the serious risks that hate speech poses to both individual well-being and social cohesion. Compared with text or static multimodal content, hateful video detection remains underexplored and significantly more challenging, as hateful meaning often arises from complex interactions among multimodal cues, including speech, audio, and visual content. Moreover, such signals are often brief, implicit, and temporally dependent, making them difficult to capture using conventional video-level representations. In this work, we propose CLARA, a clip-level multimodal framework for hateful video detection. Instead of treating a video as a single instance, CLARA models it as a sequence of fine-grained clips, enabling more precise capture of temporally localized hateful signals. We introduce a Mixture-of-Experts clip encoder for adaptive multimodal alignment, a local-global segment contrastive objective to jointly model short-term cues and long-range temporal dependencies, and VLM-derived rationales integrated via a gated Transformer to provide high-level semantic guidance. Extensive experiments on three hateful video datasets demonstrate that CLARA consistently outperforms state-of-the-art methods. Further ablation studies and parameter analyses validate the effectiveness of each component.
105. 【2608.15869】Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning
链接：https://arxiv.org/abs/2608.15869
作者：Xiaoyu Zhu,Xinke Deng,Suresh Taddewadikar,Arnab Kumar Mondal,Zhongyu Jiang,Ian Fasel,Joerg Liebelt
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：Multimodal large language, large language models, language models increasingly, reason about spatial, embodied environments
备注：
点击查看摘要
Abstract:Multimodal large language models increasingly use visual chain-of-thought (Visual CoT) to reason about spatial, temporal, and embodied environments. By generating intermediate reasoning images, Visual CoT provides an intuitive mechanism for visual foresight but introduces substantial inference overhead, which is particularly problematic for proactive video reasoning. We ask whether models can learn to think visually during training while reasoning directly at inference. We introduce Internalized Visual Thinking (IVT), a post-training framework that jointly optimizes textual prediction and next-embedding prediction over unlabeled videos. Given a partially observed video, IVT predicts latent representations of future frames together with the target textual answer, encouraging the model to capture motion, object transitions, interactions, and latent intent. At inference, IVT generates the answer directly without synthesizing or re-encoding future frames. We conduct controlled studies across target representations, decoder designs, prediction horizons, data mixtures, training curricula, and predictive objectives. IVT improves over direct-answer fine-tuning on all six evaluation settings while retaining the same inference pathway. Compared with explicit Visual CoT, IVT achieves comparable or better performance and reduces average end-to-end latency by more than 5x. Together, our findings suggest that explicit pixel-space generation at inference time, as used in visual chain-of-thought, may not be necessary for effective proactive video reasoning. Predictive world modeling can be internalized during training to produce multimodal reasoners that are both more accurate and substantially more efficient.
106. 【2608.15863】Scaling Manual-Grounded Appliance Manipulation with Data Synthesis and Unified Planning
链接：https://arxiv.org/abs/2608.15863
作者：Yuxing Long,Lei Kang,Ziyan Yu,Yuzheng Gao,Bin Cheng,Jiyao Zhang,Xiaoqi Li,Haolin Yang,Dongjiang Li,Hui Shen,Hao Dong
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Operating household appliances, task-oriented dataset exists, Hierarchical Appliance Graph, models fall short, appliances requires long-horizon
备注： Accepted by ACM MM 26
点击查看摘要
Abstract:Operating household appliances requires long-horizon planning that is state-dependent and robust to disturbances, yet existing large models fall short, as no sufficiently diverse, task-oriented dataset exists to support such planning. To bridge this gap, we propose MAGE, a scalable data synthesis pipeline that introduces a novel Hierarchical Appliance Graph (HAG) to automatically generate part grounding, long-horizon planning, and closed-loop recovery data from appliance manuals. With MAGE, we build UseAppliance, the first large-scale dataset for manual-grounded appliance manipulation planning, spanning 22 appliance categories with 89K+ part annotations, 53K+ manipulation tasks, and 33K+ closed-loop adjustment steps. Built on UseAppliance, we develop AppliancePlan, an end-to-end model for manual-grounded appliance manipulation planning. On RealAppliance-Bench, AppliancePlan with only 7B parameters achieves over 10x the best baseline on open-loop planning and consistently outperforms state-of-the-art models across all tasks. Real-robot experiments on six household appliances further confirm effective sim-to-real transfer, marking an important step toward general-purpose household robotics.
107. 【2608.15854】Geometry of Forgetting: Representation Flux in Continual Learning
链接：https://arxiv.org/abs/2608.15854
作者：Maksim A. Kazanskii
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：neural networks lose, networks lose previously, lose previously acquired, previously acquired knowledge, fundamental obstacle
备注：
点击查看摘要
Abstract:Catastrophic forgetting remains a fundamental obstacle to continual learning, where neural networks lose previously acquired knowledge while learning new tasks. Existing methods primarily mitigate forgetting through parameter regularization or experience replay, while the representation-space dynamics associated with forgetting remain less understood. We investigate latent representation evolution during sequential learning and introduce representation flux, a geometric measure of sample-level representation displacement across training. We show that representation flux is strongly associated with catastrophic forgetting across multiple benchmarks, with temporal analyses indicating that elevated flux can precede subsequent performance degradation. Representation displacement is also associated with confidence degradation, while complementary geometric properties provide additional information about sample-level forgetting. Motivated by these observations, we propose FlowLess-R, a representation-space regularization method that constrains replay representations relative to stored references while allowing continued learning. FlowLess-R is architecture-agnostic and integrates into replay-based methods through a representation-matching term. Experiments on SplitMNIST, SplitFashionMNIST, SplitCIFAR10, and SplitTinyImageNet show improved final average accuracy and reduced forgetting with ER, DER++, and ER-ACE. Our results identify representation flux as an informative geometric marker of forgetting and show that stabilizing latent representations provides a simple strategy for mitigating catastrophic forgetting.
108. 【2608.15831】CardiacMamba: Fair and Robust RGB-RF Fusion for Remote Heart Rate Estimation via State Space Modeling
链接：https://arxiv.org/abs/2608.15831
作者：Bo Zhao,Zheng Wu,Yiping Xie,Zitong YU
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：enables non-contact heart, non-contact heart rate, Remote photoplethysmography, enables non-contact, heart rate
备注：
点击查看摘要
Abstract:Remote photoplethysmography (rPPG) enables non-contact heart rate (HR) monitoring from facial videos, but RGB-only methods are vulnerable to illumination changes, motion artifacts, and skin-tone-dependent optical reflectance. We propose CardiacMamba, a fair and robust RGB-RF fusion framework that integrates optical facial cues and radio-frequency cardiac motion cues through state space modeling. CardiacMamba introduces a Temporal Difference Mamba Module (TDMM) to enhance subtle RF temporal variations, a bidirectional SSM-based interaction mechanism to align heterogeneous RGB-RF dynamics, and a Channel-wise Fast Fourier Transform (CFFT) module for channel-domain spectral refinement. On the EquiPleth dataset, CardiacMamba achieves state-of-the-art performance with 0.96 bpm MAE, 3.06 bpm RMSE, and 0.97 Pearson correlation, while reducing the observed light-dark skin-tone MAE gap to 0.26 bpm and maintaining robustness under RGB degradation and RF-missing conditions
109. 【2608.15830】MITE-Net: SWaP-Optimized 4K Video Tiny Target Perception for Embodied Edge SAR
链接：https://arxiv.org/abs/2608.15830
作者：Mingshuo Xu,Mu Hua,Jigen Peng,Qi Wang,Shigang Yue
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Real-time tiny target, Real-time tiny, critical for embodied, Region Proposal Network, tiny target
备注： Under double blind review
点击查看摘要
Abstract:Real-time tiny target perception in high-resolution imagery is critical for embodied Search-and-Rescue (SAR) missions. However, strict Size, Weight, and Power (SWaP) constraints on edge devices like UAVs create a bottleneck: traditional image downsampling causes severe feature loss, while slice-based processing incurs prohibitive latency. To address this gap, this paper introduces a comprehensive framework encompassing a novel architecture, specialized datasets, and hardware-level benchmarks. First, we propose MITE-Net, a SWaP-optimized cascaded architecture, which couples a bio-inspired, learning-free Tiny Target Motion-Based Region Proposal Network (TTM-RPN) with a sub-0.14M-parameter R-CNN-like head. Second, to standardize 4K tiny target evaluation, we construct the SAR-Tiny Datasets by relabeling two challenging UAV datasets: SeaDroneSee-Tiny (dynamic maritime scenes, tiny targets predominantly of 64-256 pixels ) and UAVID-Tiny (cluttered urban scenes, extremely tiny targets, less than 64 pixels). Third, we benchmark against state-of-the-art YOLO models on an edge device, NVIDIA Jetson AGX Xavier, where MITE-Net directly processes 4K maritime imagery, achieving a 100\% search success rate at 30.33 FPS. Consuming merely 3.19 W (9.51 FPS/W), MITE-Net vastly outperforms YOLO baselines in target recall and energy efficiency. Conversely, UAVID-Tiny evaluations expose a compound structural limitation: the learning-free bionic front-end struggles against urban backgrounds, while the ultra-lightweight head lacks representational capacity for complex features. Ultimately, this work delivers an efficient onboard perception paradigm and a rigorous baseline guiding future end-to-end SAR architectures.
110. 【2608.15818】FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams
链接：https://arxiv.org/abs/2608.15818
作者：Genying Li,Boda Lin,Jiachen Li,Zijian Jia,Haojie Zheng,Yiming Wang,Shuchen Weng,Si Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Music-driven dance video, dance video, Music-driven dance, aims to animate, dance video synthesis
备注：
点击查看摘要
Abstract:Music-driven dance video synthesis aims to animate a reference person according to a given music clip. The task is challenging because it requires a model to jointly learn music-to-motion correspondence, identity-preserving human animation, temporal coherence, and visually realistic video generation. We present FlowDance, a music-driven dance video generation framework that integrates explicit motion modeling with reference-preserving visual synthesis through parallel pose and RGB streams. We further introduce timestep-aware pose injection to adapt structural guidance across denoising steps and persistent identity injection to preserve the reference appearance over long video. To support this task, we further build a popularity-curated, high-resolution in-the-wild dance video dataset with synchronized music, RGB videos, 3D body motion, camera parameters, and projected 2D pose annotations. Extensive experiments show that FlowDance achieves strong performance in both dance motion generation and music-driven dance video synthesis.
111. 【2608.15812】From Generation to Matching: A Development Report on Personalized Chinese Handwriting
链接：https://arxiv.org/abs/2608.15812
作者：Yiwei Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：personalized Chinese handwriting, personalized Chinese, unique Chinese characters, frozen engineering project, paper documents
备注：
点击查看摘要
Abstract:This paper documents a frozen engineering project on personalized Chinese handwriting. The project started from approximately 200 real handwriting images from one user, covering 197 unique Chinese characters, and was initially formulated as few-shot generation of unseen characters. A sequence of canonical-centered personalization routes repeatedly exposed the same conflict: increasing structural pressure made outputs more canonical, while increasing personalization could damage identity-defining strokes. The project was therefore reset around real-human character equivalence classes. A multi-writer CASIA candidate pool showed that a USER-compatible realization often already existed among valid human samples. The task consequently changed from synthesis to character-wise matching, followed by cross-writer composition into a virtual writer. The frozen system uses real-ink features, character-specific human population percentiles, top-20 candidate pruning, and greedy hardest-first whole-row selection. On the covered target set, all 197 USER characters had real-human candidates, and the 100-character evaluation subset was covered 100/100. Knowncharacter held-out comparisons included a row judged visually almost indistinguishable from genuine USER handwriting. A 60- episode stability audit placed every episode in a predefined A-like machine-proxy region, but these were not independent human A-level judgments. The final evidence supports stable practical B-level quality, with many outputs approaching A-level under the USER-defined criterion. The report records why generation became unnecessary for this case without claiming unrestricted or universal handwriting synthesis.
112. 【2608.15802】PWLR: Pairwise Witness Local Rejection for Boundary-Aware Out-of-Distribution Detection
链接：https://arxiv.org/abs/2608.15802
作者：Chengyao Jia,Ruixuan Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：samples lie close, near-OOD samples lie, image classifiers, close to in-distribution, samples lie
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:Out-of-distribution (OOD) detection remains challenging for image classifiers, especially when near-OOD samples lie close to in-distribution (ID) class boundaries. Recent vision-language detectors improve OOD detection through class semantics, local prompting, or LLM-generated outlier concepts, but seldom use language as explicit boundary evidence between confusing ID classes. We propose Pairwise Witness Local Rejection (PWLR), which uses an MLLM offline to describe visible local cues that favor one ID class over a specific rival class. These cue phrases are then screened with ID-only data under a frozen vision-language backbone, so that only reliable local verifiers are kept. At inference, PWLR first retains a small set of globally plausible classes, then checks whether any of them is locally supported against its most relevant rivals, and finally combines this pairwise local evidence with the global class score through calibration. Experiments on ImageNet-100 far-OOD, cleaner/challenging OOD and near-OOD benchmarks show that PWLR consistently improves strong vision-language baselines across multiple backbones. Source code will be released.
113. 【2608.15796】Emergent 3D Instance Segmentation from Self-Supervised Point Transformers
链接：https://arxiv.org/abs/2608.15796
作者：Ted Lentsch,Santiago Montiel-Marín,Holger Caesar,Julian F. P. Kooij
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：outdoor LiDAR scans, handcrafted geometric priors, handcrafted geometric prior, motion cues, handcrafted geometric
备注： ECCV 2026 DriveX
点击查看摘要
Abstract:Unsupervised 3D instance segmentation of outdoor LiDAR scans has traditionally relied on handcrafted geometric priors such as density-based clustering, motion cues, or projected 2D detections. In this work, we investigate whether a frozen, self-supervised point transformer already contains the structural information required to isolate object instances without any handcrafted geometric prior. Using this transformer purely as a feature extractor, we probe its internal representations across the SemanticKITTI, nuScenes, and Waymo Perception datasets. Our analysis yields four core insights: (1) the instance signal concentrates in the attention queries and keys rather than in the values or final output features; (2) output features semantically collapse, merging adjacent same-class objects that the queries and keys keep distinct; (3) this instance signal is bimodal in depth, strongest at the shallowest and deepest encoder stages; and (4) this signal is driven predominantly by the rotary position encoding (RoPE), whose removal collapses its advantage. We put these findings into our method TokenGraph3D, a training-free segmenter that groups points via connected components on a key-similarity graph, using neither density-based clustering nor proximity priors. Under identical prior-free conditions, we substantially outperform output-feature baselines, making the emergent 3D instance structure visible.
114. 【2608.15788】ChainSpace: A Chained-Reasoning Paradigm for Spatial Intelligence
链接：https://arxiv.org/abs/2608.15788
作者：Xiaohan Zhang,Feng Gu,Xudong Rao,Xuhao Pan,Tao Wei,Zhou Pan,Kun Zhan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：maintain coherent spatial, coherent spatial state, intelligence requires foundation, requires foundation models, physical world
备注：
点击查看摘要
Abstract:Spatial intelligence requires foundation models to maintain coherent spatial state across interactions with the physical world. However, existing data-centric approaches typically treat spatial reasoning as independent question-answer instances, enabling shortcut-based answering and providing limited supervision for persistent spatial understanding. To address this, we introduce ChainSpace, a chained-reasoning paradigm that structures spatial reasoning as a state-preserving multi-round process. In this paradigm, spatial questions are organized into logically constrained and jointly consistent chains, where later questions depend on spatial constraints established in earlier rounds. Following this principle, we instantiate ChainSpace-Bench, a manually annotated real-world multi-round benchmark with a Chain-Aware Metric, and ChainSpace-Pipeline, a simulator-based chain-structured supervision generation framework for spatial intelligence training. Experiments show that ChainSpace-Bench exposes chain-level failures that are not captured by isolated question accuracy. Additionally, with a relatively small amount of simulator-generated chained data, models trained by ChainSpace-Pipeline achieve the best performance among open-source models on ChainSpace-Bench and transfer competitively to multiple external spatial intelligence benchmarks. These results establish ChainSpace as an effective paradigm for more faithful evaluation and more data-efficient learning of spatial intelligence.
115. 【2608.15785】RoofGS: Roofline-Guided End-to-End Acceleration of 3D Gaussian Splatting
链接：https://arxiv.org/abs/2608.15785
作者：Yang Luo,Yan Gong,Yongsheng Gao,Jie Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enables real-time novel-view, Gaussian Splatting, real-time novel-view synthesis, enables real-time, high resolutions
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) enables real-time novel-view synthesis but remains limited on GPUs at high resolutions. Through a stage-wise Roofline characterization, we identify two distinct hardware bottlenecks: global memory traffic dominates the front end, whereas instruction throughput limits rasterization. Guided by this analysis, we develop RoofGS, a rendering framework that applies bottleneck-specific optimizations rather than generic kernel acceleration. For the memory-bound front end, we design a resolution-adaptive quantized depth sorting key that compresses each key to 32 bits. For the compute-bound rasterizer, we introduce a range-aware bit-level fast exponential approximation tailored to the bounded exponent range after opacity culling, with a derived per-pixel error bound. These two core techniques are complemented by additional optimizations (kernel fusion, compact attribute storage, culling, dual-pixel evaluation) that additionally reduce memory traffic and improve instruction-level parallelism. Experiments show that RoofGS achieves a 10.1$\times$ end-to-end speedup over 3DGS at 4K on an RTX 4090, increasing throughput from 61 to 616 FPS, with only a 0.028 dB PSNR loss.
116. 【2608.15757】Beyond Independence: Learning Correlated Views for Variational Incomplete Multi-View Clustering
链接：https://arxiv.org/abs/2608.15757
作者：Zheming Xu,Aiyue Tang,Shidi Chen,Xuechao Zou,Congyan Lang,Rogelio A. Mancisidor,Michael Kampffmeyer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Incomplete multi-view clustering, uncover shared cluster, partially observed views, shared cluster structures, Incomplete multi-view
备注：
点击查看摘要
Abstract:Incomplete multi-view clustering (IMVC) aims to uncover shared cluster structures from data with partially observed views. Although recent imputation-free methods based on variational inference demonstrate robustness to missing views, they commonly rely on a conditional independence assumption across views in the posterior aggregation stage, which fails to capture the inherently structured and potentially correlated nature of multi-view data. In this paper, we propose a variational framework that explicitly goes beyond this assumption by introducing a learnable cross-view correlation structure. Specifically, we explicitly model and learn correlations between views by utilizing the covariance structure of posterior estimation errors during aggregation. To facilitate robust and efficient learning, the correlation matrix is parameterized through a normalized Cholesky decomposition, ensuring positive definiteness and enabling the entire model to be trained jointly through a unified variational objective. Extensive experiments on multiple IMVC benchmarks demonstrate that our method consistently outperforms state-of-the-art approaches across diverse missing-view settings while introducing only a negligible number of learnable parameters. These results highlight the effectiveness of adaptive correlation modeling in variational IMVC, demonstrating the need to go beyond the independence assumption in IMVC. The code is available at this https URL.
117. 【2608.15749】ES3D: Embedding Semantics into 3D Space for Component-Aware Editing
链接：https://arxiv.org/abs/2608.15749
作者：Xuancheng Jin,Rengan Xie,Jiayuan Lu,Wenting Zheng,Rui Wang,Yuchi Huo,Lincheng Li,Yingfeng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：made notable progress, progress in controllability, made notable, notable progress, remain limited
备注：
点击查看摘要
Abstract:Existing 3D editing methods have made notable progress in controllability, yet they remain limited in several important ways. Most approaches rely on text-driven editing, which struggles to express fine-grained visual changes intended by the user. Moreover, many methods require manually supplied 3D masks or introduce unintended changes to regions that should remain untouched. These limitations largely arise from the absence of fine-grained semantic understanding, making it difficult for existing models to retrieve or modify specific 3D components. We introduce ES3D, a framework that embeds semantics directly into 3D space, enabling component-aware retrieval and editing of a 3D asset conditioned on multiple local reference images and optional text queries. We first construct a 3D semantic embedding by projecting multi-view semantic features into the voxelized space of the asset. We then perform 3D component retrieval by computing feature similarity between the 3D semantic embedding and the semantic embeddings of image or text queries. For editing, we employ a pretrained 3D generative model with an inpainting mechanism to modify the retrieved components guided by user-provided images while preserving the rest of the asset. Overall, ES3D is a 3D editing framework that retrieves editable regions based on semantic cues and uses multiple images as conditions. Extensive experiments demonstrate that ES3D produces geometrically consistent and semantically coherent edits, enabling robust image-based and text-assisted control for 3D editing.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2608.15749 [cs.CV]
(or
arXiv:2608.15749v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.15749
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
118. 【2608.15731】Identifying Confusion Trends in Concept-based XAI for Multi-Label Classification
链接：https://arxiv.org/abs/2608.15731
作者：Haadia Amjad,Ronald Tetzlaff
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Deep Neural Networks, Deep Neural, Neural Networks, ensure user trust, deployed in high-risk
备注： Published at EXPLAINABILITY2025
点击查看摘要
Abstract:Deep Neural Networks (DNNs) deployed in high-risk domains, such as healthcare and autonomous driving, must be not only accurate but also understandable to ensure user trust. In real-world computer vision tasks, these models often operate on complex images containing background noise and are heavily annotated. To make such models explainable, Concept-based Explainable AI (CXAI) methods need to be assessed for their applicability and problem-solving capacity. In this work, we explore CXAI use cases in multi-label classification by training two DNNs, VGG16 and ResNet50, on the 20 most annotated labels in the MS-COCO dataset (Microsoft Common Objects in Context). We apply two CXAI methods, CRP (Concept Relevance Propagation) and CRAFT (Concept Recursive Activation FacTorization), to generate concept-level explanations and investigate the overall evaluations. Our analysis reveals three key findings: (1) CXAI highlights learning weaknesses in DNNs, (2) higher concept distinctiveness reduces label and concept confusion, and (3) environmental concepts expose dataset-induced biases. Our results demonstrate the potential of CXAI to enhance the understanding of model generalizability and to diagnose bias instigated by the dataset.
119. 【2608.15721】Anatomical and Physical Supervision for CT-less PET Attenuation Correction: BIC-MAC 2026 Challenge
链接：https://arxiv.org/abs/2608.15721
作者：Petros Chatzitoulousis,George K. Matsopoulos
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Big Cross-Modal Attenuation, multimodal pseudo-CT synthesis, PET attenuation correction, Big Cross-Modal, CT-less PET attenuation
备注： 6 pages, 1 table. Technical report for the BIC-MAC 2026 Challenge
点击查看摘要
Abstract:This report describes our submission to the Big Cross-Modal Attenuation Correction (BIC-MAC) 2026 Challenge for CT-less PET attenuation correction through multimodal pseudo-CT synthesis. We build upon a standard nnU-Net architecture and combine anatomical and physical supervision to improve both pseudo-CT quality and downstream PET reconstruction. Anatomical supervision is introduced through a frozen TotalSegmentator feature extractor, anatomy-guided structural constraints and patch sampling, while physical supervision is achieved using a differentiable attenuation correction factor projection loss based on multi-angle attenuation projections. Furthermore, the network is initialized with pretrained weights obtained from training on the SynthRAD Challenge MR-to-CT dataset. Minimal architectural modifications are applied, while performance improvements are pursued across the nnU-Net pipeline, including preprocessing, plans, and supervision design, among other components. Our final submission demonstrates the effectiveness of combining anatomical supervision, attenuation physics, and efficient nnU-Net scaling for CT-less PET attenuation correction.
120. 【2608.15713】YOLO26-RD: An End-to-End Road Damage Detection Network With Learnable Contrast Enhancement and Edge-Guided Downsampling
链接：https://arxiv.org/abs/2608.15713
作者：Sompote Youwai,Pawarotorn Chaipetch,Hathairat Samaikul,Theerayut Yonseng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Pavement distress detectors, replacing strided convolution, Pavement distress, typically by adding, distress detectors
备注：
点击查看摘要
Abstract:Pavement distress detectors are conventionally specialised for small objects, typically by adding a stride-4 detection head and replacing strided convolution with space-to-depth downsampling. This paper tests that premise against the annotation geometry of region level survey imagery and finds it fails: 1.28% of instances are small at 640 resolution while 70.37% are large, yet a stride-4 level would claim 75.3% of anchors, and complete misses rather than localisation errors dominate baseline failures. YOLO26-RD therefore reallocates the anchor budget, retaining the stride-4 branch as neck features but carrying no detection level there, and adds LearnableContrast, a 494 parameter per tile correction learned from the detection loss and active at inference, and EdgeSPD, a lossless space-to-depth downsampler gated by a fixed Sobel prior. Fifteen models were trained from scratch under one recipe, five scales each of YOLO26-RD and of matched YOLO26 and YOLOv12 families. Averaged over scales YOLO26-RD returns 0.790 mAP50 and 0.482 mAP50-95 against 0.776 and 0.471 for YOLO26 and 0.755 and 0.468 for YOLOv12; it exceeds both on mAP50 at every scale from s upward, and at m, l and x it leads on both metrics, twelve pairwise comparisons decided without exception. YOLO26-RD-l is the best of the fifteen at 0.809 mAP50 and 0.497 mAP50-95, improving on the YOLO26 reference by 0.031 and 0.030 and leading all six per class entries; every arm of a module ablation also exceeds that reference. The margin is thus a property of the architecture rather than of one tuned configuration, though three of the twelve margins lie inside the dataset 0.015 resolution limit and the held out split reproduces the ordering against YOLO26 but not YOLOv12 at scale x. As a TensorRT FP16 engine the released model sustains 98 frames per second on an entry level accelerator, against the 21 needed at 100 km/h.
121. 【2608.15710】Beyond Single Object: Learning 3D Relations with Large Language Models
链接：https://arxiv.org/abs/2608.15710
作者：Kohsuke Ide,Ryousuke Yamada,Yue Qiu,Xianzheng Ma,Yoshihiro Fukuhara,Hirokatsu Kataoka,Yutaka Satoh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：existing models focus, scene description, inter-object comparison, address a fundamental, fundamental gap
备注： Accepted to CVPR 2026
点击查看摘要
Abstract:We address a fundamental gap in 3D-LLMs: existing models focus on single-object/scene description, struggling with detailed, inter-object comparison. We propose a framework for detailed object-level reasoning across multiple objects with three components: (1) MO3D (Multi-Object in 3D), an instruction dataset requiring fine-grained multi-object comparison; (2) Multi-3DLLM, using a minimal Patch-Interaction Transformer (PIT) that models inter-/intra-object relationships while preserving local geometry; (3) Mini-apps, two application-driven benchmarks (Shape Mating, Change Captioning) that probe geometric understanding for practical use. Recent 3D-LLMs and 2D-VLMs perform poorly on these tasks, lacking both comparison-centric design and geometric awareness. In contrast, Multi-3DLLM trained on our mixture data learns geometric reasoning, surpasses all baselines on MO3D, and provides positive transfer to single-object classification.
122. 【2608.15708】What You Ask is What You Ground: Bridging Question Intent to Temporal Evidence for Grounded VideoQA
链接：https://arxiv.org/abs/2608.15708
作者：Jinhwan Seo,Kyubeom Han,Jumin Lee,Junhyug Noh,Sung-eui Yoon
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：overlooked failure mode, Video Question Answering, Question Answering, study a critical, critical yet overlooked
备注： Accepted at ECCV2026. Code: [this https URL](https://github.com/jinhseo/GroundFormer) . Project page: [this https URL](https://jinhseo.github.io/groundformer/groundformer.html)
点击查看摘要
Abstract:We study a critical yet overlooked failure mode in Grounded Video Question Answering: question-invariant grounding, where models predict nearly identical temporal segments for different questions about the same video. We trace this behavior to two structural limitations in prior common designs: (i) modality isolation that fixes video representations before they receive question semantics, and (ii) weak question injection inside the grounding module. To address this, we propose GroundFormer, which conditions video features on question intent before localization via learnable communication tokens that mediate directed visuo-lingual interaction. On top of the question-conditioned features, a factorized MIL cross-attention couples answer selection with temporal evidence under candidate-level supervision, while Gaussian smoothing converts peaked attention into temporally coherent segments. We further introduce a hierarchical multi-modal contrastive loss that aligns video, question, and answer embeddings across a two-pass training pipeline. GroundFormer achieves state-of-the-art grounded VideoQA performance on NExT-GQA and STAR, substantially improving question-discriminative temporal grounding.
123. 【2608.15705】PixelControl: Fine-Grained Condition Fidelity in Text-to-Image Diffusion
链接：https://arxiv.org/abs/2608.15705
作者：Xin Lin,Haodong Li,Zhifei Zhang,Yutong Yang,Haitian Zheng,Juanxi Tian,Zhe Lin,Truong Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：thin contours, small conditioned regions, violate fine-grained structures, diffusion models, violate fine-grained
备注： The project homepage can be found: [this https URL](https://linxin0.github.io/pixelcontrol_homepage/pixelcontrol-site/)
点击查看摘要
Abstract:Controllable text-to-image diffusion models can often follow the global layout of spatial conditions, yet still violate fine-grained structures such as object boundaries, thin contours, and medium/small conditioned regions. This limitation is especially problematic for VAE-based latent diffusion, where spatial compression can weaken high-frequency and low-area condition signals. We propose PixelControl, a pixel-space controllable diffusion framework for fine-grained condition fidelity. Built on a PixelDiT-style backbone, PixelControl avoids the latent bottleneck and introduces two complementary designs. First, Structure-Aware Control Injection derives a condition structure map and uses it to strengthen injected control residuals around spatially sensitive regions. Second, Multi-Scale Pyramid Cycle Loss verifies generated images against condition-derived structures across multiple resolutions, balancing global layout consistency with local boundary and detail accuracy. PixelControl supports depth, segmentation, edge, and their combinations through modality-specific control branches with lightweight gated fusion. Experiments across depth, segmentation, and edge control show that PixelControl improves structural fidelity and visual quality over existing controllable generation methods, with especially strong gains on boundaries and medium/small conditioned regions. The project page can be found at: this https URL
124. 【2608.15698】ConceptFormer: Learning Adaptive Latent Concepts for Query-Document Alignment in Visual Document Retrieval
链接：https://arxiv.org/abs/2608.15698
作者：Peng Chunyi,Xu Zhipeng,Yan Yukun,Liu Zhenghao,Yu Shi,Mei Sen,Sun Yubo,Zhang Yongheng,Zhou Jie,Gu Yu,Yu Ge,Sun Maosong
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：multimodal retrieval-augmented generation, identify query-relevant pages, Visual, Visual document retrieval, retrieval-augmented generation
备注：
点击查看摘要
Abstract:Visual document retrieval is a critical component of multimodal retrieval-augmented generation, aiming to identify query-relevant pages from document collections where evidence is distributed across text, layout, charts, and visual structures. Recent efforts toward finer-grained supervision primarily rely on textual descriptions or localized visual regions as evidence proxies. However, such supervision signals may either overlook complex visual structures or provide incomplete and inaccurate representations of the underlying evidence. To address these limitations, we propose ConceptFormer, a latent concept representation learning framework for visual document retrieval. ConceptFormer models query-relevant evidence as continuous, query-conditioned latent concepts that explicitly bridge localized visual evidence and semantic relevance, without requiring either textual intermediate representations or direct reliance on raw visual annotations. During training, ConceptFormer employs a strong vision-language model to dynamically determine the number of latent concept tokens and uses these concepts as an intermediate representation to bridge the semantic gap between queries and documents, thereby guiding the learning of the embedding space. Experiments on diverse visual document retrieval benchmarks demonstrate that ConceptFormer achieves 16.7\% and 22.1\% relative improvements in average NDCG@10 over the strongest visual retrieval baseline and the strongest OCR-based text retrieval baseline, respectively. Further analysis reveals that latent concepts effectively connect localized visual evidence with semantic relevance, enabling the retriever to capture both fine-grained textual cues and complex document-level visual structures while preserving strong retrieval alignment. Codes and data are available at this https URL.
125. 【2608.15695】Bitstream Action Recognition is Byte Modeling
链接：https://arxiv.org/abs/2608.15695
作者：Fangcheng Li,Chaoran Huang,Tianyi Liu,Wenyang Liu,Kejun Wu,Qiong Liu,You Yang,Zhengguo Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Conventional action recognition, recognition typically relies, action recognition typically, action recognition, Conventional action
备注： 10 pages; supplementary material included
点击查看摘要
Abstract:Conventional action recognition typically relies on successful pixel decoding of the bitstream. However, bitstream corruption during storage or transmission may cause severe visual artifacts or even decoding failure, posing a significant challenge to reliable action recognition. Bitstream Action Recognition (BAR) aims to overcome the dependency on decoding and the vulnerability to corruption. In this paper, we propose a novel BAR framework, Bitstream Recognition via Anchoring Corrupted Embeddings (BRACE). BRACE is a dual-branch byte-modeling architecture that treats a corrupted bitstream and its intact counterpart as two byte realizations of the same action. This guides the generation of rich and stable representations for robustness to corruption through Intact-Anchored Representation Alignment (IARA). The intact representation serves as a stable anchor, and the corrupted one is aligned to it at the embedding and decision levels under Unreliable-Anchor Suppression (UAS), entirely in representation space and without repairing the bitstream. To address the scarcity of corrupted bitstreams in practice, we introduce the Real-world Bitstream Corruption Simulator (RBCS), a four-parameter simulator that reproduces bit-flip and byte-loss errors arising in transmission and storage. Building on RBCS, we construct the first large-scale BAR dataset (BAR-D), which comprises the BAR-Stanford40 and BAR-PPMI subsets and spans diverse corruption types and severity levels. Finally, we build a large benchmark on BAR-D involving 14 action recognition methods from the pixel, compressed, and bitstream domains. Extensive experiments demonstrate that BRACE has superior robustness to bitstream corruption than all comparison methods. Ablation studies further validate the effectiveness of the proposed RBCS augmentation and IARA.
126. 【2608.15694】RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation
链接：https://arxiv.org/abs/2608.15694
作者：Kareem Hassani,Chaymaa Abbas,Hadi Al Mubasher,Mariette Awad
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：map input features, forward pass, pass and treat, opportunity to improve, Conditional
备注：
点击查看摘要
Abstract:Conditional image-to-image generators are single-shot: they map input features to an output in one forward pass and treat it as final, with no opportunity to improve on it. Although trained to produce the best possible result in one step, such a model leaves room for improvement if it can adaptively revise its own output over iterations. We propose Recursive Refinement via Feedback Conditioning (RRFC), a novel feedback-conditioning framework for iterative output refinement that teaches a model to adaptively revise its output by conditioning on a new signal, namely its most recent previous prediction, which is fed back as an auxiliary set of channels alongside the original input. This preserves the generator's core architecture while modifying its conditioning interface and, depending on the model family, its training or inference procedure, so RRFC can be attached to existing generators without redesign. We evaluate RRFC across six baselines spanning adversarial, equilibrium, and diffusion-based models and three paired image-to-image translation tasks. Across 18 architecture-task settings, RRFC yields seven Holm-corrected improvements, seven degradations, and four non-significant changes. The gains concentrate on reconstruction-fidelity and identity settings, while five of the seven degradations fall on the single semantic-layout task, where every model declines. These results indicate that feedback-based refinement helps when its objective overlaps with the evaluated property, and that its gains concentrate on the tasks where that overlap holds.
127. 【2608.15692】Automated Fetal Brain MRI Biometry in Healthy and Pathological Cases
链接：https://arxiv.org/abs/2608.15692
作者：Ema Masterl,Tina Vipotnik Vesnaver,Nejc Šubič,Žiga Špiclin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MRI enables reproducible, brain MRI enables, fetal brain MRI, Automated biometric analysis, observer-independent quantitative assessment
备注： Accepted at the PIPPI Workshop of MICCAI 2026
点击查看摘要
Abstract:Automated biometric analysis of fetal brain MRI enables reproducible, observer-independent quantitative assessment, yet existing methods are often restricted to few measurements or evaluated only on healthy cases. We assemble and evaluate an automated biometric analysis pipeline that localizes 22 anatomical landmarks on NeSVoR-reconstructed 3D volumes and derives 11 clinically relevant measurements spanning supratentorial, ventricular, cerebellar, and midline structures. We compare two landmark localization models, H3DE-Net and SCN, on a heterogeneous cohort of 122 acquisitions (both healthy controls and range pathologies). Localization accuracy was assessed with a linear mixed-effects model, agreement with normative growth trajectories with calibrated centile charts, and diagnostic utility with a decision tree classifying VM severity. H3DE-Net achieved significantly lower localization error than SCN across all landmarks (mean 1.36 mm vs. 3.58 mm in HC and 1.90 mm vs. 4.13 mm in PC; p 0.001), and outperformed a GA-based regression baseline in 7 of 11 measurements. H3DE-Net measurements yielded higher classification AUC in every diagnostic group, with the clearest advantage in separating healthy controls from VM. Decision tree thresholds for ventricular width fell near the clinical 10 mm and 15 mm cut-offs used to define and grade VM.
128. 【2608.15688】raining-Free Long-Term Multi-Object Tracking for Sports Video Analytics
链接：https://arxiv.org/abs/2608.15688
作者：Tomasz Stanczyk,Seongro Yoon,Francois Bremond
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-term multi-object tracking, repeated player reappearances, sports remains challenging, remains challenging due, Long-term multi-object
备注：
点击查看摘要
Abstract:Long-term multi-object tracking in sports remains challenging due to frequent occlusions, rapid camera motion, and repeated player reappearances. We introduce McByte++, a training-free tracking-by-detection framework that integrates lightweight mask propagation, conditional camera motion compensation, and online re-identification within a unified pipeline. Compared to its predecessor, McByte++ substantially improves runtime efficiency while enhancing identity preservation. On SoccerNet-tracking and SportsMOT benchmarks, McByte++ achieves up to +3.0 HOTA and +6.1 IDF1 improvements over the original McByte in the online setting, with further gains when combined with offline global association. Replacing heavy segmentation components and optimizing motion modeling yields up to an order-of-magnitude speed increase. All results are obtained without detector retraining or dataset-specific tuning. Code will be made available at this https URL.
129. 【2608.15685】Counterfactual Sensitivity Is Not Repairability: Auditing Replay Probes for Video Evidence
链接：https://arxiv.org/abs/2608.15685
作者：Rama AlHamidi,Rasul Khanbayov,Erchin Serpedin,Hasan Kurban
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Tool-using video agents, retrieve visual evidence, video agents retrieve, agents retrieve visual, Tool-using video
备注： 23 pages, 2 figures. Code: [this https URL](https://github.com/KurbanIntelligenceLab/CARVE)
点击查看摘要
Abstract:Tool-using video agents retrieve visual evidence before answering, but the final answer is not forced to depend on what was retrieved. The natural black box test is counterfactual: destroy the semantic content of the frames the agent retrieved and check whether the answer changes, against a matched sham that re-executes the identical pipeline on those same frames. We introduce CARVE, a black-box counterfactual probe that compares answer changes under matched SHAM and DESTROY replays. Across three independent k=3 runs on a frozen VideoExplorer-style agent, DESTROY changes the answer 29.3 percentage points more often than SHAM, yielding a large and reproducible aggregate effect. Question-level scores are less stable, and increasing the replay budget from k=3 to k=10 reduces ties but weakens the original zero-threshold routing policy. At k=3, CARVE selects 538 of 1,258 LVBench questions and improves accuracy by 3.26 points, with higher fallback yield than most matched random subsets. The score shows only a weak association with annotated temporal coverage, so CARVE is best understood as a routing signal rather than a direct grounding classifier. Our implementation is available at this https URL.
130. 【2608.15683】BASeg: Boundary-Aware Remote Sensing Segmentation with Structural Penalties
链接：https://arxiv.org/abs/2608.15683
作者：Yuexi Song,Kailai Sun,Zhuoyu Wang,Mingyi He,Paul Pu Liang,Shenhao Wang,Jinhua Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：core computer vision, computer vision task, ban development, water resources, accelerating advancements
备注：
点击查看摘要
Abstract:Semantic segmentation is a core computer vision task in the remote sensing field, accelerating advancements in ur- ban development, agriculture, ecology, water resources, and environmental monitoring. However, recent methods usually struggle to capture fine-grained object features and bound- ary details. Besides, current widely used datasets often lack city morphology diversity and segmentation on generative im- ages remains largely unexplored. To address these issues, we propose a Mahalanobis-Angle Boundary Loss (MABL) that explicitly enhances boundary and shape consistency. MABL jointly models structural importance and boundary orientation through Mahalanobis distance-based weighting and angle- aware penalty. It can be readily integrated into diverse seg- mentation architectures and consistently improves their accu- racy. Built upon MABL, we introduce BASeg, a boundary- aware remote sensing segmentation framework with Struc- tural Penalties. BASeg integrates a Global Visual State Space module (GSM) with a Cross-Feature Fusion module (CFM) to capture both long-range contextual dependencies and fine- grained local details. Additionally, we establish a global 10- city benchmark dataset (GCD-25k) to facilitate accurate build- ing and road segmentation. Extensive experiments on four remote-sensing benchmarks demonstrate that BASeg consis- tently outperforms existing methods, achieving up to a 2.8% improvement in mIoU while producing more accurate object boundary segmentation across diverse scenes. Moreover, integrating MABL into multiple existing segmentation archi- tectures consistently improves performance across datasets, demonstrating its robustness and broad applicability.
131. 【2608.15659】WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations
链接：https://arxiv.org/abs/2608.15659
作者：Xiaojie Xu,Zhengyuan Lin,Runyi Li,Yihao Liu,Kaipeng Zhang,Yongtao Ge
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：requires video paired, Learning to generate, worlds requires video, generate or reconstruct, requires video
备注：
点击查看摘要
Abstract:Learning to generate or reconstruct explorable worlds requires video paired with more than RGB: camera motion, scene geometry, temporal correspondence and, for interactive models, control signals. Real capture can provide some of these signals, but dense geometry and long-range correspondence usually rely on estimation or specialised instrumentation. Rendering provides these quantities directly, yet existing synthetic resources rarely combine them on the same frames while also supporting controlled changes of viewpoint and appearance. We introduce WorldRover, a data engine for generating richly annotated, long-range explorations of artist-built environments. At its core, WorldRover-Engine is an Unreal Engine pipeline that executes and offline-renders minute-scale routes while preserving their full trajectories and scene geometry. The same exploration can be replayed from first-person, third-person, and 360 panoramic cameras under different environmental states. Using WorldRover-Engine, we construct WorldRover-10M, whose sequences pair RGB with metric depth, camera trajectories, and trajectory-derived action signals throughout each exploration. Third-person subsets additionally provide dense optical flow, long-range 2D/3D point tracks with visibility, and a character trajectory distinct from the camera trajectory. The engine can render a traversal from first-person, third-person and 360 panoramic viewpoints, under different environmental states or with a neutral white material, while preserving the route and scene geometry. WorldRover therefore turns long-horizon world exploration into a scalable data-generation problem, providing supervision for models that must build, maintain, and revisit coherent representations of an explorable world.
132. 【2608.15652】Scalable Black-Box Model Attribution for Images
链接：https://arxiv.org/abs/2608.15652
作者：Asaf Livne,Amir Jevnisek,Shai Avidan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generative models raises, rapid proliferation, proliferation of generative, model attribution problem, attribution problem
备注： Project page: [this https URL](https://asaf-livne.github.io/RPA/)
点击查看摘要
Abstract:The rapid proliferation of generative models raises the model attribution problem: given only an image, can we determine which model produced it? Existing methods have grown as elaborate as the generators they target, on the as- sumption that a more sophisticated model demands a more sophisticated attributor. We show it does not. RPA (Raw- Patch Attribution) attributes images in the strictest black- box setting with a lightweight CNN. Despite its simplicity, it attributes more models at higher accuracy than prior work, reaching 98.0% on 25-class DRAGON and 92.9% on 27- class OpenFake; it is data-efficient and runs at a cost inde- pendent of the number of candidate models; and it stays ro- bust to the compression, blur, and resizing images undergo in the wild. Training for closed-set attribution yields a ver- satile feature extractor: the same representation recovers model lineage without supervision, flags and groups unseen generators, and admits new models through few-shot adap- tation rather than retraining.
133. 【2608.15651】Gaussian-JEPA: Joint-Embedding Predictive Learning for 3D Gaussian Splats
链接：https://arxiv.org/abs/2608.15651
作者：Bin Ren,Qi Ma,Yue Li,Zongyan Han,Yidi Li,Yuqian Fu,Rao Muhammad Anwer,Theo Gevers,Fahad Shahbaz Khan,Salman Khan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：jointly encode geometry, Gaussian Splatting, Gaussian, content with anisotropic, geometry and appearance
备注： Joint-embedding predictive representation learning for 3D Gaussian Splatting
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) represents 3D content with anisotropic primitives that jointly encode geometry and appearance. Fixed-budget encoders consume sampled observations of Gaussian assets, so the same object may be observed through different primitive realizations. Existing self-supervised methods mainly reconstruct masked Gaussian attributes, tying supervision to one sampled realization and requiring an input-space decoder. Latent prediction offers an alternative, but its application to Gaussian tokens requires targets that accommodate coupled attributes and heterogeneous spatial support. We introduce Gaussian-JEPA, which predicts representations of held-out Gaussian token blocks from visible context. An online encoder processes the context, while a shared exponential-moving-average encoder supplies stop-gradient features for multi-scale targets. Complementary target projections and feature-space grounding provide latent supervision without reconstructing Gaussian attributes. We evaluate the features under Gaussian resampling, partial observations, and renderable shape completion, together with transfer to part segmentation and object classification. Compared with matched reconstruction pretraining, Gaussian-JEPA is more consistent across resampled inputs, retains more instance information under partial observations, and provides stronger frozen features for Gaussian completion. These results support latent prediction as an effective objective for reusable 3D Gaussian representations. Code is on the project page (this https URL).
134. 【2608.15647】Hierarchical Adaptive Feature Refinement Network for VHR Remote Sensing Image Segmentation
链接：https://arxiv.org/abs/2608.15647
作者：Shuaishuai Cao,Meng Tang,Shuwei Peng,Xuan Liu,Min Huang,Jie Chen,Jiacheng Niu,Yong Chen,Edore Akpokodje,Hui Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：remote sensing imagery, sensing imagery increasingly, imagery increasingly benefits, representations remains difficult, multi-stage representations remains
备注： 17 pages, 11 figures, 11 tables. Submitted to IEEE Transactions on Geoscience and Remote Sensing (TGRS). Code and model weights are available at [this https URL](https://github.com/anticipate218/HAFRNet)
点击查看摘要
Abstract:Semantic segmentation of very-high-resolution (VHR) remote sensing imagery increasingly benefits from strong pretrained hierarchical encoders, yet exploiting their multi-stage representations remains difficult. Nearby regions demand different balances between fine detail and semantic context, aggressive task-specific transformations perturb useful pretrained features, and conventional semantic supervision provides limited structural guidance. We present HAFR-Net, a progressive refinement framework that adaptively organizes and conservatively refines hierarchical representations instead of replacing them with a monolithic decoder transformation. Heterogeneity-Guided Stage-Adaptive Fusion (HG-SAF) predicts dense stage weights conditioned on local feature variation. A Frequency-Residual Adapter (FRA) then injects frequency information through a bounded, zero-initialized residual branch that keeps the fused representation as its reference. A Confusion-Aware Tri-Prior Decoder (CATP) finally regularizes the prediction with boundary, objectness, and training-derived class-relation cues. Under a matched Swin-B training and single-scale inference protocol, HAFR-Net attains 84.12%, 87.86%, 55.17%, and 67.70% mIoU on ISPRS Vaihingen, ISPRS Potsdam, LoveDA, and OpenEarthMap, improving the matched UPerNet baseline by 0.55, 0.95, 1.55, and 1.84 percentage points, respectively. Controlled analyses further show consistent spatial reweighting beyond content-only routing, improved boundary and thin-structure accuracy over matched spatial and spectral alternatives, and reduced confusion on pre-declared class pairs.
135. 【2608.15614】EgoGazeLite: On-Device Egocentric Gaze Prediction for Token-Efficient Multimodal LLM Video Input
链接：https://arxiv.org/abs/2608.15614
作者：Matteo Stoiber,Niels Buus Lassen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：wearable devices, devices is constrained, egocentric video understanding, egocentric video, visual tokens
备注： 16 pages. Accepted at the WearableAI Workshop, ECCV 2026 (Archival Track)
点击查看摘要
Abstract:The use of multimodal LLMs (MLLMs) for egocentric video understanding with wearable devices is constrained by the token budget. Memory and compute cost scale with the number of visual tokens, and high-resolution video quickly becomes expensive to transmit and process at scale. Prior work (GazeLLM) addresses this by cropping the video around the camera wearer's gaze. This reduces the number of visual tokens by about tenfold while maintaining or improving the quality of full-resolution descriptions. However, this compression strategy depends on dedicated eye-tracking hardware, which is unavailable on consumer smart glasses. Building a software-only substitute poses a joint constraint: the predictor must be accurate enough to preserve downstream description quality, yet light enough to run on-device, within the power and compute budget of a smartphone. We address this with EgoGazeLite, a lightweight dual-process gaze predictor for egocentric video. Across two MLLMs, three automated metrics, and two LLM judges, predicted-gaze crops show no significant difference from ground-truth-gaze crops. Equivalence is confirmed in all ten cases. EgoGazeLite achieves this at 15.7M parameters, 6.71 GFLOPs, and runs the full gaze-and-crop pipeline end-to-end in real time (21.6 ms/frame) on consumer accelerator hardware. Together, these results remove the need for eye-tracking hardware for token-efficient, gaze-conditioned egocentric video understanding with MLLMs.
136. 【2608.15605】AlloEgo-VLM: Disambiguating Allocentric and Egocentric Reference Frames in Vision-Language Models
链接：https://arxiv.org/abs/2608.15605
作者：Kuan-Lin Chen,Tzu-Ti Wei,Chao-Chi Liao,Yu-Chee Tseng,Jen-Jee Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-Language Models, understanding spatial semantics, study investigates, investigates the challenge, faced by Vision-Language
备注： 28 pages, 9 figures. Project page and code available at [this https URL](https://github.com/CKL9001/AlloEgo-VLM)
点击查看摘要
Abstract:This study investigates the challenge of ambiguity faced by Vision-Language Models (VLMs) in understanding spatial semantics. Spatial cognition, shaped by cognitive psychology, spatial science, and cultural context, often assigns directionality to objects. However, natural language descriptions of spatial relations frequently omit explicit reference frames, leading to semantic ambiguity and potentially serious errors for embodied AI robots. Existing VLMs, due to insufficient training on reference frames and object orientations, often produce inconsistent responses. To address this issue, we construct a new dataset, AlloEgo-View, comprising (image, query, view-specific answer) triplets that capture key object relations from both allocentric and egocentric perspectives. The view-specific descriptions follow a structured spatial representation that annotate detailed scene descriptions, reference and target objects, their orientations, reference frames, and view types. Building on AlloEgo-View, we develop AlloEgo-VLM, a framework to disambiguate allocentric and egocentric reference frames, even under ambiguous queries, and to be easily integrated into existing VLMs via supervised fine-tuning. Furthermore, we deploy our framework onto an embodied robotic platform within NVIDIA Isaac Sim to validate its real-world feasibility in open-ended object searching tasks. Experiments highlight the limitations of current VLMs in handling view-specific queries and demonstrate the strong disambiguation ability of AlloEgo-VLM.
137. 【2608.15583】PoseAdapter: Dual-Stream 2.5D Controllable Image Generation for Complex Multi-Object Scenes
链接：https://arxiv.org/abs/2608.15583
作者：Yufeng Chi,Huimin Ma,Fan Gao,Zhice Niu,Keqin Li,Jianmin Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable success, diffusion models, remarkable success, persistent challenge, models have achieved
备注： 10 pages, 5 figures
点击查看摘要
Abstract:While Text-to-Image (T2I) diffusion models have achieved remarkable success, precise spatial and orientational control in multi-object scenes remains a persistent challenge. Existing methods either rely on computationally expensive dense 3D maps or suffer from severe attribute leakage and "cut-and-paste" artifacts. To address these limitations, we propose PoseAdapter, a lightweight framework for high-fidelity 2.5D controllable image generation. Instead of dense spatial maps, it establishes precise spatial-angular anchors using an efficient condition layout: individual object captions, 2D bounding boxes, and 3D angles. To resolve the generative trade-off between strict instance isolation and global coherence, we introduce a Context-Aware Dual-Stream Representation. By injecting local object tokens and relation-enriched scene tokens into the visual stream of modern MM-DiT architectures via parallel masked and unmasked pathways, PoseAdapter eliminates attribute leakage while preserving natural inter-object relationships and scene-level coherence. To support this paradigm, we construct OrientLayout, a high-quality dataset featuring standardized 2.5D annotations and instance-level decoupled semantics. Extensive experiments demonstrate that PoseAdapter outperforms state-of-the-art baselines in spatial accuracy, orientational precision, and multi-object visual fidelity. Code and dataset will be available at this https URL.
138. 【2608.15580】From Generalist to Specialist: A Context-Fusion Framework for Endoscopic Polyp Reporting with a Frozen VLM
链接：https://arxiv.org/abs/2608.15580
作者：Ruijie Yang,Yan Zhu,Peiyao Fu,Siyuan Li,Te Luo,Zhihua Wang,Quanlin Li,Pinghong Zhou,Xian Yang,Shuo Wang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：standardized Paris classification, quantitative lesion sizing, requires integrating quantitative, integrating quantitative lesion, clinically meaningful morphological
备注：
点击查看摘要
Abstract:Reliable endoscopic polyp reporting requires integrating quantitative lesion sizing, standardized Paris classification, and clinically meaningful morphological description within a single record. General-purpose vision-language models (VLMs) offer a unified interface for image understanding and report generation. Existing specialization strategies, however, typically rely on task-specific models or model-weight adaptation, leaving unresolved how to introduce reliable specialist knowledge while preserving both this unified interface and the VLM's pretrained capabilities. We introduce a context-fusion framework that specializes a frozen general-purpose VLM through both implicit instruction context and explicit transduction context without modifying its pretrained weights. Specifically, a self-supervised polyp encoder retrieves related image-report pairs as explicit, query-specific evidence, while learned continuous specialist tokens provide implicit instruction context shared across cases. Experiments were conducted on 2,056 expert-annotated public endoscopic images. We compared the framework with general-purpose VLMs, task-specific predictors, and weight-adaptation methods to assess specialist performance, unified reporting, and adaptation efficiency. Across numerical, categorical, and report-generation metrics, the proposed framework substantially improved direct frozen-VLM inference and achieved the strongest overall performance among the evaluated methods. It added trainable parameters equal to only 0.006% of the frozen VLM's parameter count. When the top-1 retrieved case carried the correct target category, our framework corrected 70.5% of the errors made by a weight-adaptation baseline. These findings support the context-fusion framework as a lightweight and effective strategy for specialist adaptation of a frozen VLM.
139. 【2608.15574】Catching Hallucinated Citations in Video-LLM Question Answering: A Self-Verification Pipeline and Verifier Ablation Study
链接：https://arxiv.org/abs/2608.15574
作者：Yogesh Kumar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：answering systems built, Video question answering, question answering systems, produce timestamped claims, Video question
备注：
点击查看摘要
Abstract:Video question answering systems built on vision-language models often produce timestamped claims with high confidence even when unsupported by the cited frame. This deceptive hallucination arises because timestamps imply grounding without ensuring correctness, increasing user trust but not accuracy. We introduce a pipeline that closes this loop. A retrieval-augmented language model drafts answers with per-claim timestamp citations, and each cited frame is independently re-examined before being shown to the user. We compare against a plain baseline and ablate three verification designs, evaluated on both Apple Silicon (MLX) and Google Colab (HF Transformers, CUDA). Directly asking the vision model whether a frame supports a claim fails completely (0% catch rate on 40 claims) due to sycophancy. Blind re-captioning plus a general LLM judge improves results but is unstable, oscillating between 0% and 100% flagged depending on prompt phrasing. Replacing that judge with a small natural language inference model yields a stable, interpretable verifier that catches 79% of fabricated claims on adversarial false-premise questions while leaving true claims untouched. We release the full pipeline, evaluation harness, and implementations for both Apple Silicon and Colab. Code is available at this https URL.
140. 【2608.15555】RigidBench: Evaluating Rigid-Body Physics in Video Generation Models
链接：https://arxiv.org/abs/2608.15555
作者：Swarnim Jain,Shangzhe Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：objects move correctly, predicted objects move, move correctly, metrics commonly, predicted objects
备注： 30 pages, including appendices. Code: [this https URL](https://github.com/swarnim-j/RigidBench) . Dataset: [this https URL](https://doi.org/10.5281/zenodo.21649156)
点击查看摘要
Abstract:Video models are increasingly used to predict what happens next in a scene, yet the metrics commonly used to compare their outputs say little about whether the predicted objects move correctly. Motion, geometry, identity, background stability, and visual similarity can fail independently, but whole-frame scores often mix these errors together. We introduce RigidBench, a simulator-grounded benchmark that compares a generated continuation with a reference rollout from the same initial frame and motion description. Its five rigid-body tasks vary objects, materials, viewpoints, and indoor and outdoor scenes, with per-frame masks, depth, 6-DoF trajectories, and contacts available for scoring. We evaluate eight models on the same 100 examples with ten measurements that keep these aspects separate. The resulting rankings depend strongly on what is measured: no model leads on all ten, and across model means, higher SSIM accompanies larger 3D trajectory error (r = 0.89). RigidBench also includes 5,000 training videos with exact simulator state, which we use to fine-tune and analyze Wan 2.2 TI2V-5B. Full fine-tuning reduces 3D trajectory error by about 20% with almost no change in SSIM, while teacher-forced probes and targeted interventions show that object position is represented throughout Wan's diffusion transformer and used by its denoising computation.
141. 【2608.15539】CrossView: Can Vision-Language Models Reason Across Cameras?
链接：https://arxiv.org/abs/2608.15539
作者：Sahil Shah,S P Sharan,Harsh Goel,Manvik Pasula,Adithya Hebbalae,Minkyu Choi,Sandeep P. Chinchali
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：modern multi-modal language, achieve strong performance, multi-modal language models, language models achieve, models achieve strong
备注： ECCV 2026
点击查看摘要
Abstract:Video understanding benchmarks have long centered on single-camera settings, where modern multi-modal language models achieve strong performance across image and video tasks. Yet, the real world runs on multi-camera networks: autonomous vehicles, security systems, and robots all gather data across many simultaneous views. We argue that this is not simply "more" of the single-camera problem; it is fundamentally different. Multi-camera reasoning requires handling context that scales with the number of views, resolving occlusions visible from only a subset of cameras, judging which views matter, and integrating evidence across perspectives that may overlap or diverge. Current models struggle with exactly these challenges, yet no benchmark systematically targets them. We introduce CrossView, a multi-camera video question-answering benchmark spanning autonomous driving, security surveillance, egocentric/exocentric video, and robotics. Evaluation of proprietary models, such as GPT-5.2, and open-source models, like Qwen3-VL, reveals consistently low accuracy, with open-source models trailing by a wide margin. Performance scales strongly with a model's ability to jointly process multiple viewpoints, positioning CrossView as a rigorous benchmark for multi-camera video. We open-source our code and dataset at this https URL.
142. 【2608.15537】EA-LiteUNet: An Edge-Adaptive and Resource-Efficient U-Net for Boundary-Sensitive Dermoscopic Image Segmentation
链接：https://arxiv.org/abs/2608.15537
作者：Wang Jiangtao,Nur Intan Raihana Ruhaiyem,Fu Panpan,Yang Yu,Huang Yan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：complex background artifacts, Accurate boundary delineation, blurred lesion margins, boundary delineation remains, heterogeneous textures
备注： 29 Pages,13 figures, 8 tables
点击查看摘要
Abstract:Accurate boundary delineation remains a persistent challenge in dermoscopic image segmentation because of blurred lesion margins, heterogeneous textures, and complex background artifacts. From a signal-processing perspective, lesion boundaries represent high-frequency components that are highly susceptible to aliasing, noise amplification, and information loss. Consequently, repeated downsampling and feature transformations in conventional convolutional architectures often lead to severely degraded boundary representations. To address these limitations, we propose EA-LiteUNet, an edge-adaptive and computationally efficient U-Net variant specifically designed for boundary-sensitive medical image segmentation. The architecture integrates three core mechanisms: (1) boundary-aware representation learning to suppress aliasing and preserve high-frequency structural details; (2) attention-guided feature modulation to selectively enhance boundary-relevant responses across multi-scale features; and (3) a resource-adaptive inference strategy to dynamically balance segmentation accuracy and computational efficiency. Extensive evaluations across three public dermoscopic datasets demonstrate that EA-LiteUNet consistently achieves superior boundary precision. Specifically, on the ISIC 2018 dataset, the method significantly reduces the 95% Hausdorff Distance (HD95) to 12.89 pixels while maintaining a robust Dice score of 92.08%. Notably, this strong performance is achieved with an ultralightweight configuration of merely 0.29M parameters and 1.17 GFLOPs. Ablation studies further validate the complementary effects of these components, confirming their contribution to enhanced boundary fidelity and stable optimization.
143. 【2608.15522】Efficient Audio-Visual Generation via Synchrony-Aware Cross-Modal Sparse Attention
链接：https://arxiv.org/abs/2608.15522
作者：Shengchuan Gao,Teng Hu,Bohao Feng,Luchen Li,Wenqiang Wang,Hongqian Deng,Ran Yi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：http URL present, http URL key, http URL explicitly, http URL, URL key observation
备注：
点击查看摘要
Abstract:Recent audio-visual generation models can synthesize synchronized video and sound in a unified diffusion process, but their inference cost remains high because long video token sequences require repeated attention computation across denoising steps.A variety of acceleration techniques have been developed for video generation models, including low-bit quantization, attention sparsification, and feature this http URL, since these methods are originally designed for video generation, directly applying them to audio-visual models overlooks the interactions between the audio and video branches and may therefore disrupt audio-video this http URL present a synchronization-aware acceleration framework for efficient audio-visual this http URL key observation is that bidirectional audio-video cross-attention reveals structured interactions between the two branches, with high responses often concentrated on a few sound-related visual and temporal this http URL by this interaction pattern, we introduce a protected sparse attention strategy that preserves high-fidelity computation for synchronization-critical tokens while sparsifying redundant attention this http URL explicitly accounting for cross-modal dependence during acceleration, our method improves inference efficiency while keeping video quality, audio quality, and audio-video synchronization.
144. 【2608.15517】GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning
链接：https://arxiv.org/abs/2608.15517
作者：Zesheng Yang,Lingling Zhang,Xinyu Zhang,Cheng Zhang,Pengyu Li,Heng Wang,Lin Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, large language models, substantially improved, improved the problem-solving, problem-solving capabilities
备注：
点击查看摘要
Abstract:Chain-of-thought reasoning has substantially improved the problem-solving capabilities of multimodal large language models. Fine-grained visual evidence, however, remains difficult to preserve and reuse across text-based reasoning steps. To address this limitation, tool-augmented thinking-with-images methods maintain visual access externally by revisiting or manipulating the image, but require predefined tools and additional inference-time processing. As an internal alternative, continuous visual latent reasoning retains intermediate computation in hidden states. However, its prevailing autoregressive construction makes each latent state depend on its predecessors, so later states may repeat information already present in the latent sequence rather than capture complementary visual details. We introduce GLaQ, a grounded latent-query framework that replaces sequential latent rollout with a fixed set of context-conditioned queries grounded in the original visual tokens. The grounded queries are reinjected for answer generation, providing direct and coordinated access to source visual evidence. We train GLaQ with localized-view supervision followed by reinforcement learning under task-level rewards. Across five benchmarks for fine-grained visual understanding and perception, GLaQ-7B gains 5.99--9.66\% over its base model and leads all compared visual latent methods, suggesting that direct query-to-image grounding can recover localized evidence from the full image without external visual operations or autoregressive latent rollouts.
145. 【2608.15471】Population Structure Analysis of an Inbred Population using Quantitative Shape Phenotyping from Stereo Retinal Photographs
链接：https://arxiv.org/abs/2608.15471
作者：Li Tang,Michael D Abramoff
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：retinal fundus photographs, Norfolk Island, stereo retinal fundus, people on Norfolk, original Mutineers
备注：
点击查看摘要
Abstract:The population structure of an inbred population of 781 people on Norfolk Island in the Pacific, 318 of which are descendants of the original Mutineers of the Bounty, is analyzed phenotypically using shape from stereo retinal fundus photographs. Three-dimensional optic nerve head (ONH) shape is reconstructed from stereo pairs by a multi-scale stereo matching algorithm. Using deep neural network, the shape of ONH, which is under genetic control, is decomposed into a set of hierarchical features through self-taught learning. Features captured at different levels are selected according to their discriminant power in identifying the two populations. The prediction accuracy is evaluated with stratified cross validation. Given the selected feature set, individuals are grouped into k hierarchical clusters and cluster membership fractions are determined for k=2,3,4,5,6,7. Population structure analysis on the basis of phenotypes through image analysis allows heritability and linkage analysis, including founder effects from English and Polynesian ancestors, potentially leading to new genetic risk factors for glaucoma and other ONH-related eye diseases.
146. 【2608.15456】AlignJEPA: Predictive Vision-Language Alignment for Remote Sensing Foundation Models
链接：https://arxiv.org/abs/2608.15456
作者：Md Aminur Hossain,Omkumar Vaghasiya,Rajeev Ranjan Dwivedi,Vinod Kurmi,Biplab Banerjee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remain weakly aligned, remote sensing foundation, limiting natural-language archive, natural-language archive search, Remote sensing
备注： 18 pages
点击查看摘要
Abstract:Remote sensing (RS) foundation models provide transferable Earth observation representations across sensors, resolutions, and geographies, yet most remain weakly aligned with natural language, limiting natural-language archive search, image-text retrieval, and question-conditioned analysis. We propose AlignJEPA, a JEPA-inspired predictive vision-language alignment framework for remote sensing foundation models. AlignJEPA uses a pretrained AnySat visual encoder and a RemoteCLIP text encoder while training only a lightweight predictive alignment network. Instead of relying on global image--text contrastive alignment alone, the framework predicts remote-sensing text embeddings from masked visual foundation-model tokens. Its mask-aware multi-scale predictive aligner aggregates visible tokens at fine, regional, and global scales, jointly models them with a cross-scale Transformer, and projects the resulting representation into the text space using learned query pooling. Training combines semantic prediction with bidirectional contrastive retrieval. We train and evaluate AlignJEPA on this http URL for natural-language Sentinel retrieval, evaluate cross-dataset adaptation on RSICD, and use RSVQA only as a closed-set representation probe. AlignJEPA provides a parameter-efficient route for aligning Earth observation foundation models with language.
147. 【2608.15452】Spatially-Grounded Flow Matching: Structured Source Distributions for Image Generation
链接：https://arxiv.org/abs/2608.15452
作者：Arman Zarei,Mahdi M. Kalayeh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Current flow matching, Current flow, Current, source, source distribution
备注：
点击查看摘要
Abstract:Current flow matching models learn to transport the source i.i.d. Gaussian noise into the target distribution of natural images, yet this source distribution carries no notion of spatial structure. Images however are fundamentally local since nearby pixels are strongly correlated. By sampling the noise independently, we hypothesize that models are implicitly encouraged to exploit less noisy neighbors as context during training, partially bypassing the need to properly learn the true local structure of images. The source distribution, in other words, works against the inductive bias of the image domain. To ameliorate this design discrepancy, we propose StructFlow which encodes spatial locality directly into the source by having the pixels within a small region share a common noise component. This structured source produces transport paths that are geometrically aligned with image regions - enabling properties that generic flow matching struggles to provide: fine-grained local editing that naturally respects boundaries, robust structure preservation, and smooth semantic interpolation between images. We show that these benefits also extend to large pre-trained models, demonstrating that StructFlow can even be incorporated through a lightweight post-training phase. Comprehensive experiments on multiple datasets, in unconditional, class and text-conditioned regimes, using different diffusion transformer architectures confirm that StructFlow not only offers competitive image generation quality, but also significantly improves localized controllable re-synthesis.
148. 【2608.15437】MM-BEV: Enhancing Timeliness by Computing Where and When it Matters
链接：https://arxiv.org/abs/2608.15437
作者：Liangkai Liu,Kang G. Shin
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC); Systems and Control (eess.SY)
关键词：high computational cost, real-time deployment challenging, conditions make real-time, make real-time deployment, dense camera semantics
备注： 12 pages, 20 figures
点击查看摘要
Abstract:Multimodal bird's-eye-view (BEV) perception combines LiDAR depth accuracy with dense camera semantics, but its high computational cost and imperfect sensing conditions make real-time deployment challenging. Existing methods largely compress individual detectors and overlook three opportunities: structured sparsity within camera and LiDAR inputs, timing misalignment between modalities, and the fact that many detected objects do not affect the planner's immediate action. We present MM-BEV, a real-time multimodal BEV system guided by a simple principle: compute where and when it matters. MM-BEV divides perception into mandatory work for safety-critical objects within braking distance of the ego vehicle and with short time-to-collision (TTC), and optional work for less urgent regions. It prioritizes mandatory work and reduces or sheds optional work under tight compute budgets. MM-BEV integrates four mechanisms: (1) a criticality-ranked temporal ROI selector based on motion-extrapolated detections from prior frames; (2) sparse, ROI-aware feature extraction using shared-shape camera crops at context-adaptive resolution and ROI-aware LiDAR voxelization; (3) a latency-aware coordinator that adapts LiDAR sweeps, image resolution, and keyframes according to scene dynamics and TTC; and (4) an asynchronous scheduler that decouples sensing from inference and skips stale frames. On nuScenes, MM-BEV reduces inference latency by 1.96x and end-to-end latency by 2.93x, with no loss in geometry-critical recall and only a 0.2 percentage-point drop in safety-critical recall. On a Clearpath Husky A300 equipped with an Ouster-128 LiDAR, BEV cameras, and a Jetson AGX Orin, MM-BEV further reduces mean latency by 2.11x, demonstrating its potential for real-world autonomous systems.
149. 【2608.15425】NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models
链接：https://arxiv.org/abs/2608.15425
作者：Yiming Fu,Fangjun Li,Xiujin Liu,Ruidong Ma,Hang Yu,Zhichen Lu,Kanwei He,Alessandro Di Nuovo,Angelo Cangelosi,Zhegong Shangguan,
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：high-level multimodal tasks, remains poorly understood, correlated visual factors, existing counting benchmarks, counting benchmarks entangle
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) achieve strong performance on high-level multimodal tasks, yet numerosity perception, a cognitive ability that emerges in human infants before language acquisition, remains poorly understood in current models, as existing counting benchmarks entangle numerosity with correlated visual factors. We introduce a cognitively inspired diagnostic benchmark, NumerosityVLM, comprising 10,800 synthetic images across six controlled conditions. The benchmark orthogonally manipulates object size, spatial arrangement, and numerosity, while progressively ablating texture, shape, and color. Evaluating seven VLMs in a zero-shot setting, multi-factor analysis reveals that model architecture explains the largest proportion of performance variance (partial $\omega^{2}=0.325$), far exceeding visual conditions. Layer-wise probing further shows that linearly separable numerosity signals consistently emerge at early stages of the vision encoder, while performance differences across evaluated models are primarily associated with the language model component. Code and data are publicly available at this https URL, and this https URL.
150. 【2608.15420】HistReNeRF: Historic Image Relocalisation within Contemporary Neural Radiance Field Reconstructions
链接：https://arxiv.org/abs/2608.15420
作者：Benjamin T. Hughes,Stuart James
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Relocalising archival photographs, Neural Radiance Field, Relocalising archival, visible objects, spatial layout
备注：
点击查看摘要
Abstract:Relocalising archival photographs within a contemporary scene model is challenging because historic and modern views can differ in photographic appearance, visible objects, and spatial layout. Therefore, we present HistReNeRF, a framework that estimates the 6-DoF pose of a historic photograph by matching adapted DINOv2 patch features to candidate rays sampled from a contemporary Neural Radiance Field (NeRF) reconstruction. The continuous representation of a NeRF provides a queryable scene interface from which candidate rays can be sampled and matched, enabling domain adaptation between historic photography and contemporary images directly in the feature representation used for localisation. We evaluate embedding-space-based domain adaptation against pixel-space methods on a new cross-temporal dataset comprising 10,545 contemporary street-level images and 230 archival photographs from three European landmarks. Embedding-space adaptation reduces translation and rotation errors by an average of 11% and 16%, respectively, across the three scenes. These results show that neural scene relocalisation provides a natural interface for feature-space adaptation, reducing cross-temporal appearance shift without modifying the query image. Code and dataset at this https URL.
151. 【2608.15419】ArtLang: Structured Language-to-Kinematics Grounding for Articulated 3D Actuation
链接：https://arxiv.org/abs/2608.15419
作者：Sylvia Yuan,Dan Wang,Ravi Ramamoorthi,Xinrui Cui
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover explicit geometry, Articulated-object reconstructions recover, remain semantically anonymous, numerical joint parameters, reconstructions recover explicit
备注：
点击查看摘要
Abstract:Articulated-object reconstructions recover explicit geometry and kinematics, but their parts often remain semantically anonymous and must be controlled through part indices and numerical joint parameters. We present ArtLang, a framework for open-vocabulary language control of persistent reconstructed articulated assets. ArtLang represents an asset as a semantic-kinematic articulation graph and augments its surface with language features and graph-constrained motion. Open-vocabulary proposals are bound to reconstructed parts while allowing uncertain parts to remain unnamed. A typed parser converts a command into a directive graph containing referring expressions, actions, magnitudes, reference frames, and relations. We then solve a global graph-to-graph grounding problem that jointly reasons about semantic, spatial, relational, and kinematic compatibility, with support for null assignments and abstention under ambiguity. Accepted directives are converted into continuous joint targets within the observed motion range and executed through forward kinematics. Experiments on synthetic reconstructions, mesh-based assets, and real captures demonstrate reliable language grounding and continuous articulated control across repeated parts, spatial references, relational commands, and ambiguous instructions.
152. 【2608.15410】FloodReasonBench: Benchmarking VLM Reasoning Segmentation for Embodied Flood Response at the Edge
链接：https://arxiv.org/abs/2608.15410
作者：Rajat Bhattacharjya,Yoomee Jung,Minwoo Kim,Sing-Yao Wu,Eli Bozorgzadeh,Nalini Venkatasubramanian,Nikil Dutt
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO); Systems and Control (eess.SY)
关键词：enables vision-language models, translate mission-relevant language, mission-relevant language requests, natural perception interface, pixel-level visual grounding
备注： Paper is currently under review. The code and dataset will be made public upon acceptance
点击查看摘要
Abstract:Reasoning segmentation enables vision-language models (VLMs) to translate mission-relevant language requests into pixel-level visual grounding, offering a natural perception interface for embodied agents. However, existing benchmarks largely focus on generic visual scenes and overlook the domain and resource constraints encountered in flood-response platforms. We present FloodReasonBench, a benchmark for VLM reasoning segmentation for embodied flood response at the edge. At its core, FloodReasonBench introduces FloodResponseSeg, a flood-specific reasoning-segmentation dataset constructed from real-world scenes and response-relevant targets. Beyond task accuracy, the benchmark characterizes reasoning-segmentation pipelines under lightweight visual encoding, hierarchical split inference, and compressed intermediate representations. We observe strong partition-dependent accuracy variation in the generic pre-adaptation setting, while the flood-adapted target-workload design space exhibits a substantially more compact accuracy range across partitions. Evaluation on an NVIDIA Jetson AGX Xavier further exposes the tradeoffs among reasoning-segmentation accuracy, edge-side latency, energy, and communication footprint, enabling quality-constrained selection of edge operating points. Together, these results provide a task- and system-level characterization of reasoning segmentation for resource-constrained embodied flood response at the edge.
153. 【2608.15404】CBX-Bench: A Human-Aligned MLLM Council for Benchmarking Concept Bottleneck Model Explanations
链接：https://arxiv.org/abs/2608.15404
作者：Yusuf Meric Karadag,Gulay Oklan,Seref Baris Cagliyan,Umut Ozdemir,Emre Akbas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Concept Bottleneck Models, make visual classification, visual classification interpretable, Concept Bottleneck, Bottleneck Models
备注：
点击查看摘要
Abstract:Concept Bottleneck Models (CBMs) are designed to make visual classification interpretable by expressing predictions through human-understandable concepts. Although interpretability is the central motivation for CBMs, they are still largely evaluated as predictive models by downstream classification accuracy, supplemented by isolated qualitative examples. This highlights a pressing need for quantitative measures, a challenge complicated by the infeasibility of ground-truth concept annotation at scale and the open nature of concept lists due to a lack of consensus. To fill this gap, we develop a multimodal large language model (MLLM) council that, given an image and its CBM explanation, produces an explanation quality score. To ground and validate the council, we first conduct a human study to establish a ground-truth reference for CBM explanation quality: for an image, annotators compare explanations from two of LF-CBM, VLG-CBM, and CBM-Suite and choose the more useful one, or mark them as equally good or equally bad, yielding 2700 judgments over 900 image-comparison items on CUB-200, ImageNet-100, and Places365. Against this human reference, our five-model council, consisting of open-weight MLLMs, recovers over 70% of strict human preference rankings, rising to 83% on items where human annotators unanimously agree. Building on this validated council, we introduce CBX-Bench, a public benchmark and leaderboard: authors of new CBMs can submit their model's explanations, and CBX-Bench scores them with the council and maintains dataset-level rankings of explanation quality. CBX-Bench thus provides a human-aligned, scalable evaluation of CBM explanations beyond accuracy and isolated qualitative examples. The benchmark is available at this https URL.
154. 【2608.15395】JoLT: Joint Latent Trajectories for Context-Guided High-Resolution Tiled Generation
链接：https://arxiv.org/abs/2608.15395
作者：Mathis Koroglu,Guillaume Jeanneret,Hugo Caselles-Dupré,Matthieu Cord,Arnaud Dapogny
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generative models produce, produce impressive results, models produce impressive, generative models, impressive results
备注： 25 pages, 10 figures, 7 tables. Accepted at the AI4VA Workshop at ECCV 2026. Project page: [this https URL](https://obvious-research.github.io/jolt/)
点击查看摘要
Abstract:Although text-to-image generative models produce impressive results, they struggle to generate densely detailed, high-resolution (HR) images. Current literature addresses this issue with a low-to-high-resolution approach. First, a low-resolution (LR) image is generated. Then, an upsampled version is generated using the LR image as an additional cue. In this paper, we present Joint Latent Trajectories (JoLT). To generate an image, JoLT uses two streams that jointly denoise LR and HR latent images at each sampling step. The LR latent controls the overall layout, while the HR latent controls the details. We interconnect both branches to jointly integrate their information. We extensively validate our method, demonstrating its advantages over competing baselines. The resulting images are not only richly detailed but also visually pleasing, opening new avenues for artistic creation.
155. 【2608.15363】A Multi-Annotator Study of Segmentation Noise and Uncertainty in Turbid Underwater Images
链接：https://arxiv.org/abs/2608.15363
作者：Galadrielle Humblot-Renaux,Vasiliki Ismiroglou,Malte Pedersen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generic image-recognition datasets, disagreement are common, field of computer, generic image-recognition, medical domain
备注： accepted at ECCVW'26 - 2nd Workshop on Marine Vision
点击查看摘要
Abstract:Label uncertainty and annotator disagreement are common challenges in the field of computer vision, yet their study has largely been confined to the medical domain or to generic image-recognition datasets. Underwater datasets are particularly susceptible to these issues due to the need for domain expertise, degraded visibility conditions, and the inherent difficulty of establishing reliable ground truth in inaccessible environments. Despite these challenges, annotation uncertainty in underwater imagery remains largely unexplored. In this work, we present the first systematic multi-annotator study of segmentation in real underwater scenes, with over 100 participants, and across varying, controlled levels of turbidity. We show that underwater datasets face many of the same annotation challenges as other vision tasks, while turbidity introduces additional systematic errors. We further investigate the main factors driving label noise and explore ways to improve annotation quality in turbid underwater environments, including privileged information, individual effort and annotator ensembles. All (meta-) data collected in this study will be available on the project page: this https URL
156. 【2608.15353】Decomposing Whole Slide Image Report Generation with Graph-Constrained Multiple Instance Learning Workflows
链接：https://arxiv.org/abs/2608.15353
作者：Antony Gitau,Martyna Borak,Bjørn-Jostein Singstad,Martin Paulson,Karl Thomas Hjelmervik,Ola Marius Lysaker,Veralia Gabriela Sanchez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires recognizing spatially, recognizing spatially distributed, spatially distributed pathological, distributed pathological features, generation requires recognizing
备注： Accepted at the MICCAI 2026 REG Challenge
点击查看摘要
Abstract:Whole-slide image (WSI) report generation requires recognizing spatially distributed pathological features and organizing them into a coherent diagnostic narrative. Although direct vision-to-text models can yield fluent reports, they obscure the contributions and failure modes of visual recognition, structured reasoning, and language generation. We propose a decomposed framework in which frozen Virchow2 tile embeddings are aggregated by multiple-instance learning (MIL) classification heads that answer organ-specific diagnostic questions. An organ-conditioned graph constrains the assembly of these answers into a structured reasoning chain, which a language model realizes as a pathology report. On the REG2026 held-out set of 2,028 slides, the proposed workflow achieved a chain-Jaccard score of 0.702. Performance fell to 0.420 without graph-based chain construction, 0.398 when the organ-specific graphs were replaced by a single organ-agnostic graph, and 0.371 when the language model constructed the chain freely from MIL predictions. Using the same report generator, graph-structured chains improved the report score from 0.330 to 0.495. On 350 external TCGA WSIs spanning the seven REG organs without fine-tuning, the expected organ graph was selected in 64.0% of cases and ranked among the top three in 86.6%. Providing the correct organ graph increased agreement with coarse TCGA primary-diagnosis labels from 61.8% to 92.6%, identifying organ routing as a main bottleneck under domain shift. Overall, organ-conditioned, graph-constrained chain assembly improves structured reasoning and report generation while enabling stage-specific error localization.
157. 【2608.15349】ENAF: A Multi-Exit Network with an Adaptive Patch Fusion for Large Image Super Resolution
链接：https://arxiv.org/abs/2608.15349
作者：Duong M. Nguyen,Tuan Nghia Nguyen,Xuan Truong Nguyen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Image and Video Processing (eess.IV)
关键词：recent approaches decompose, single image super-resolution, accelerate single image, accelerate single, recent approaches
备注： Accepted at WACV 2025
点击查看摘要
Abstract:To accelerate single image super-resolution (SISR) networks on large images (2K-8K), many recent approaches decompose an image into small patches and dynamically determine an execution path according to its difficulty (referred to as a dynamic network). To quantify the hardness of a patch, they mainly rely on a handcrafted assessment score, e.g., edge, which weakly associates a patch's texture with the computational complexity of a SISR model. To address the problem, we introduce ENAF - a dynamic network for SISR with an adaptive patch fusion. Built on top of a backbone, ENAF incorporates multiple early exits (EEs) to tackle the over-parameterized SISR model. More importantly, ENAF plugs a tiny network that estimates PSNR to associate data texture with a computation cost at an EE. Based on the scores, ENAF effectively assigns image patches to an exit, enhancing the quality-complexity trade-off. Extensive experiments on common datasets with popular SISR backbones demonstrate the effectiveness of ENAF in various settings. The source code is provided in this https URL
158. 【2608.15343】Feed-Forward Hierarchical Gaussian Diffusion for Extreme CT Reconstruction
链接：https://arxiv.org/abs/2608.15343
作者：Yuezhe Yang,Li Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reconstructing three-dimensional computed, three-dimensional computed tomography, Reconstructing three-dimensional, severely constrained projections, computed tomography
备注：
点击查看摘要
Abstract:Reconstructing three-dimensional computed tomography (CT) from severely constrained projections is highly ill-posed. Sparse angular sampling, restricted angular coverage, and low photon counts can occur individually or jointly, obscuring global anatomy and local tissue detail. Many learned CT reconstruction methods are tailored to a single dominant degradation. Existing diffusion and Gaussian approaches commonly recover global structure and local detail within a shared representation. We propose HiGDiff, a feed-forward hierarchical Gaussian diffusion framework that decomposes reconstruction both spatially and from structure to detail. Physics-conditioned anatomical anchors and a foreground capacity field allocate learnable Gaussian primitives to informative regions. A structure diffusion stage first recovers global attenuation geometry, and its learned representation conditions a detail diffusion stage for residual boundaries and tissue transitions. The resulting Gaussian banks are rendered as attenuation fields and further refined by a gradient-isolated residual module. Experiments on three distinct CT benchmark datasets demonstrate state-of-the-art reconstruction performance across isolated, paired, and joint degradation settings, including improvements of 5.81 dB in macro-average peak signal-to-noise ratio (PSNR) and 0.113 in structural similarity index measure (SSIM) on the Low Dose CT Image and Projection Data (LDCT-PD) collection. Code and experimental configurations are openly available at this https URL.
159. 【2608.15341】EA: Text Encoder Alignment for Robust Concept Erasure in Text-to-Image Models
链接：https://arxiv.org/abs/2608.15341
作者：Alireza Dehghanpour Farashah,Zhuan Shi,Negar Rostamzadeh,Golnoosh Farnadi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：built-in safety mechanisms, generate harmful content, bypass built-in safety, safety mechanisms, misused to generate
备注：
点击查看摘要
Abstract:Text-to-image diffusion models can be misused to generate harmful content through adversarial or paraphrased prompts that bypass built-in safety mechanisms. Existing concept erasure methods often suffer from limited robustness against adversarial prompts, degradation of benign generation quality, or reliance on inference-time interventions that introduce persistent computational overhead. To address these limitations, we formulate concept erasure as a domain alignment problem in the text representation space. We propose a lightweight Text Encoder Alignment framework (TEA) that fine-tunes only the text encoder while keeping the generative backbone fully frozen. Given concept--anchor prompt pairs, our method trains a discriminator to distinguish token-level representations of concept-containing prompts from those of safe anchor prompts, while updating the text encoder to make these representations indistinguishable. TEA introduces zero inference-time overhead and requires only a small number of fine-tuning steps, making it highly efficient to deploy at scale. Despite this efficiency, TEA achieves state-of-the-art erasure robustness against black-box and white-box adversarial attacks on Stable Diffusion v1.4, while preserving generation quality on benign prompts. Furthermore, TEA is model-agnostic and achieves the lowest attack success rate on Stable Diffusion v3.5, extending concept erasure to a Rectified Flow Transformer architecture with T5 conditioning where prior methods remain largely unexplored. Code is available at \href{this https URL}{this https URL}
160. 【2608.15336】SAGE-OR: Semi-supervised Adaptive Scene Graph Generation for Operating Rooms
链接：https://arxiv.org/abs/2608.15336
作者：Brandon Leblanc,Charalambos Poullis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：synchronized RGB-D sensors, making dataset construction, Current surgical scene, dataset construction expensive, synchronized RGB-D
备注： Accepted at BMVC 2026
点击查看摘要
Abstract:Current surgical scene graph generation methods depend on dense multi-modal supervision and specialized hardware (synchronized RGB-D sensors, calibration rigs), making dataset construction expensive and restricting all existing benchmarks to simulated environments. We propose SAGE-OR, a feature-centric framework that replaces the traditional detect-then-reason paradigm with a decoupled representation-reasoning paradigm in which localization is derived from frozen foundation models, encoded implicitly in pre-computed features, and used without any localization supervision, while a lightweight graph transformer performs relational reasoning over cached features. We employ a semi-supervised formulation with general-purpose segmentation prompts to eliminate localization supervision while enabling unsupervised context augmentation through additional prompt-driven entities, such as hands, which are absent from annotations. General-purpose prompts are used to induce near-perfect recall, while precision is delegated to downstream attention-based reasoning, enabling simple adaptation to new entities via prompt-level modification. This design enables a lightweight 15M-parameter graph transformer that trains in 1.4 hours and runs relational inference at $\sim$1ms per frame with peak memory under 2GB, suitable for edge hardware used in the operating room; feature extraction runs offline as a separate caching stage (4.27s per frame). On the 4D-OR benchmark, the core model achieves 76% F1, matching the fully supervised 4D-OR baseline while eliminating all localization annotations, and unsupervised hand augmentation raises this to 86%, within 4 points of state-of-the-art (SOTA) methods requiring dense multi-modal supervision, providing a practical pathway for adaptation to new surgical settings without annotation other than relationship and class labels.
161. 【2608.15317】LightLoc++: Sensor-Robust Representation Learning for Efficient Outdoor LiDAR Localization
链接：https://arxiv.org/abs/2608.15317
作者：Wen Li,Shangshu Yu,Dunqiang Liu,Qiming Xia,Sheng Ao,Siqi Shen,Chenglu Wen,Cheng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limiting practical deployment, limiting practical, practical deployment, SCR, LiDAR
备注： 19 pages, 10 figures
点击查看摘要
Abstract:Scene coordinate regression (SCR) achieves strong performance in outdoor LiDAR localization, but it usually requires scene-specific training that can take days, limiting practical deployment. Recent works improve training efficiency by decoupling SCR into a scene-agnostic backbone and scene-specific prediction heads, where the backbone is pretrained on source datasets and frozen for new scenes, and only lightweight heads are optimized. However, we find that this paradigm heavily depends on the pretrained backbone. Existing decoupled methods can match conventional SCR methods fully optimized for each new scene when LiDAR configurations are similar to those used during backbone pretraining, but their accuracy drops noticeably on datasets collected with different LiDAR sensors. This suggests that efficient LiDAR localization requires representations that capture stable scene geometry across LiDAR configurations. Motivated by this observation, we propose LightLoc++, a sensor-robust and efficient outdoor LiDAR localization framework. To support sensor-robust representation learning, we introduce SULID, a synchronized urban multi-LiDAR dataset with representative 32-, 64-, and 128-beam rotating LiDARs, extensive cross-sensor overlap, and diverse urban scenes. Using SULID, we pretrain a sensor-robust backbone through cross-sensor consistency learning. LightLoc++ further preserves efficient new-scene learning by incorporating sample classification guidance and redundant sample downsampling, which reduce regression ambiguity and computational redundancy in large-scale outdoor scenes. Extensive experiments on multiple outdoor LiDAR localization benchmarks demonstrate that LightLoc++ achieves state-of-the-art localization performance with the lowest new-scene training cost among compared methods. Code and dataset will be made available at this https URL.
162. 【2608.15313】Shape Operator PCA: Curvature-Aware Projections for Geometric Machine Learning
链接：https://arxiv.org/abs/2608.15313
作者：Alexandre L. M. Levada
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：Principal Component Analysis, Operator-based Principal Component, Shape Operator-based Principal, incorporates differential geometric, Component Analysis
备注： 23 pages, 4 figures, 4 tables
点击查看摘要
Abstract:In this paper, we propose SHOPCA (Shape Operator-based Principal Component Analysis), a novel method for unsupervised metric learning and dimensionality reduction that incorporates differential geometric information into the covariance structure of classical PCA. SHOPCA regularizes the global covariance matrix using the mean shape operator, defined as the average of the absolute local shape operators estimated from the data manifold, steering principal components toward directions of both maximum variance and informative curvature. A single trace-normalized mixing coefficient $\alpha$ controls the regularization, recovering standard PCA at $\alpha = 0$ and a curvature-driven embedding as $\alpha \to \infty$. We further introduce a fully unsupervised criterion for selecting $\alpha$ based on the spectral eigengap of the regularized covariance matrix, maximizing the relative separation between the top-$d$ and remaining eigenvalues without using class labels. We evaluate SHOPCA on more than 50 real-world benchmark datasets, comparing it with PCA, ISOMAP, and UMAP using Adjusted Rand Index (ARI), Normalized Mutual Information (NMI), Fowlkes-Mallows index (FM), and V-measure. Results show that SHOPCA consistently improves clustering quality over PCA across a broad range of datasets and surpasses UMAP on small-sample settings, where iterative neighborhood-based manifold estimation can degrade. SHOPCA is computationally tractable, parameter-efficient, and applicable to domains requiring fully unsupervised, geometry-aware dimensionality reduction.
163. 【2608.15298】Image Denoising via the Adaptive Rank-Cluster Filter
链接：https://arxiv.org/abs/2608.15298
作者：Dmitry Pozdnyakov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：baseline filtering algorithms, spatial-local image-denoising filter, anisotropic diffusion, filtering algorithms, spatial-local image-denoising
备注： 18 pages; 8 figures
点击查看摘要
Abstract:A spatial-local image-denoising filter is proposed, and its performance metrics are evaluated in comparison with baseline filtering algorithms, including the median, adaptive median, Gaussian, bilateral, Wiener, anisotropic diffusion, and non-local means. The developed filter is based on aligning the intensity value of the central pixel in a 3x3 window with the statistical majority intensity of one of the two clusters formed by optimal Otsu's partitioning of a pixel set sorted by intensity and trimmed to seven elements. This is followed by a fuzzy fusion of the calculated value with the median intensity of the pixels within the window. The proposed filter demonstrates the highest robustness to variations in image noise levels, particularly when processing mixed noise consisting of salt-and-pepper impulse noise and additive Gaussian noise in various proportions
164. 【2608.15297】nyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers
链接：https://arxiv.org/abs/2608.15297
作者：Paul Julius Kühn,Duc Anh Nguyen,Saptarshi Neil Sinha,Michael Weinmann,Arjan Kuijper
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：hardware remains challenging, resource-constrained hardware remains, pipelines typically rely, RANSAC stages, refinement pipelines typically
备注：
点击查看摘要
Abstract:Real-time 6DoF object pose estimation on resource-constrained hardware remains challenging, as accurate correspondence-based and refinement pipelines typically rely on non-differentiable PnP/RANSAC stages or costly iterative refinement, while recent foundation-model-based approaches incur inference costs that are prohibitive for edge deployment. We present TinyDETR-Pose, a lightweight, end-to-end, single-stage framework that jointly detects objects and regresses their full 6D pose in a single forward pass. Built on the efficient LW-DETR architecture, TinyDETR-Pose formulates detection and pose estimation as a set-prediction problem and attaches dedicated MLP heads for rotation, monocular depth, and projected object center regression to each decoder query, eliminating the need for PnP, NMS (non-maximum suppression), or iterative pose refinement. Object symmetries are handled through a ADD-S loss applied uniformly to all objects, without the need for object-specific loss schedules or separate geodesic/ADD supervision. In addition, predictions are assigned to ground truth using a symmetry-safe Hungarian matcher based on class and 2D spatial cues, yielding stable assignment under symmetry and depth ambiguity. On YCB-V, TinyDETR-Pose achieves a comparable ADD-S AUC of 85.9, while requiring up to 72.7% fewer parameters than other DETR-based single-stage pose-estimation approaches. Due to its compact design, TinyDETR-Pose runs in real time and achieves an inference latency of only ~4.5 ms per frame on an NVIDIA Jetson Nano using TensorRT, demonstrating that accurate end-to-end transformer-based 6D pose estimation can be made practical for edge deployment.
165. 【2608.15296】FMReward: Aligning and Evaluating Audio-Driven 3D Facial Animation with Human Preferences
链接：https://arxiv.org/abs/2608.15296
作者：Sijing Wu,Yunhao Li,Zhilin Gao,Huiyu Duan,Yucheng Zhu,Guangtao Zhai,Patrick Le Callet
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Facial Motion, Facial Motion Reward, facial animation, facial, human preferences
备注： Accepted for publication in IEEE TVCG, 2026
点击查看摘要
Abstract:Audio-driven 3D facial animation is essential for advancing immersion and interactivity in virtual experiences. Although recent advances have shown promising capabilities, the training and evaluation of existing methods typically rely on ground-truth-based errors, which fall short of aligning with human preferences. To address this, we present a comprehensive framework that learns an automatic perceptual model from human preference data and leverages it to improve and evaluate the perceptual quality of audio-driven 3D facial animation. To begin with, we construct FMPair (Facial Motion Pairwise preference), the first human preference dataset for audio-driven 3D facial animation, which is built through a systematic annotation pipeline and comprises 65,574 annotated 3D facial motion pairs from 8,834 distinct in-the-wild audio clips. Based on the pairwise comparison dataset, we propose a Facial Motion Reward model, termed FMReward, which takes audio and 3D facial motion as inputs and predicts a perceptual quality score aligned with human preferences. Building upon FMReward, we further introduce Facial Motion reward Feedback Learning (FMFL), a direct fine-tuning algorithm that leverages a pretrained reward model to optimize diffusion-based audio-driven 3D facial animation models for better alignment with human preferences. Extensive experiments demonstrate the superiority of FMReward over other metrics in aligning with human preferences and the effectiveness of FMFL in improving the perceptual quality of audio-driven 3D facial animation.
166. 【2608.15295】SOS! : A Streamlined Object-Conditional Transformer for Model-free Segmentation
链接：https://arxiv.org/abs/2608.15295
作者：Jiaqi Hu,Junwen Huang,Hongli Xu,Peter KT Yu,Nassir Navab,Benjamin Busam,Slobodan Ilic
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Foundation segmentation models, Foundation segmentation, generating high-quality, excel at generating, struggle to associate
备注： Accepted to BMVC 2026
点击查看摘要
Abstract:Foundation segmentation models excel at generating high-quality, class-agnostic masks, but they struggle to associate these proposals with specific target objects. This semantic gap severely hinders their deployment in downstream applications like robotic manipulation, which demand precise unseen objects segmentation. Existing approaches attempt to resolve this by relying on exhaustive 3D object model priors, inherently introducing prohibitive computational overhead and complex, multi-stage pipelines. To address these limitations, we propose SOS (Streamlined Object-conditional Transformer for model-free Segmentation). SOS completely eliminates the reliance on 3D models, requiring only a single reference image per target object. Central to our framework is a novel Object-Conditional Transformer that learns identity-anchored queries, unifying mask generation and target identification into a single feed-forward pass. This streamlined design drastically improves both structural and computational efficiency. Extensive evaluations across multiple benchmarks demonstrate that SOS establishes a new state-of-the-art for model-free unseen objects segmentation, delivering accurate and high-efficiency performance. The project page and code are available at this https URL.
167. 【2608.15284】VTInstructor: Visual Trajectory Prompting for Navigation Instruction Generation in Continuous Environments
链接：https://arxiv.org/abs/2608.15284
作者：Haolin Yang,Yuxing Long,Zihan Yang,Hao Dong
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：scalable dataset construction, ego-centric RGB video, continuous environments, dataset construction, human-robot interaction
备注： accepted by ACM MM 2026
点击查看摘要
Abstract:Navigation instruction generation from ego-centric RGB video in continuous environments is an important yet challenging task for human-robot interaction and scalable dataset construction. Prior instruction generators assume discrete viewpoint graphs with panoramic observations, where trajectory structure is explicit; in continuous environments, however, the agent receives only a dense RGB stream, making trajectory cues difficult to recover. We propose VTInstructor, the first VLN instruction generation framework for continuous environments. Our key idea is to convert implicit trajectory geometry into explicit visual trajectory prompts: EDTC condenses long RGB trajectories into navigation-critical keyframes, VTP overlays path, turn, and goal cues onto these anchors, VTMod injects the resulting trajectory signals into the visual encoder, and VT-GRPO further calibrates this spatial injection during training, all without requiring a navigation graph, pre-built map, or scene reconstruction. On the challenging R2R-CE and RxR-CE Val Unseen benchmarks, VTInstructor sets a new state of the art across all standard NLG metrics, surpassing the strongest baseline by +0.357 CIDEr and +0.109 CIDEr, respectively. Beyond automatic metrics, VTInstructor-generated instructions raise a frozen follower's success rate to 63.3%, a +14.7 percentage-point gain over the best competing instruction source, and provide consistent data augmentation gains of +3 SR points on downstream navigation tasks.
168. 【2608.15282】Earth Observation Foundation Models for Terrestrial Ecohydrology: From Representation Learning to Process Inference
链接：https://arxiv.org/abs/2608.15282
作者：Yi Yu,Jian Peng,Yucheng Lin,Trevor F. Keenan,Thomas F. A. Bishop
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Biological Physics (physics.bio-ph)
关键词：Earth observation foundation, reusable representation frameworks, observation foundation models, foundation models, data-driven retrieval
备注：
点击查看摘要
Abstract:Earth observation foundation models (EOFMs) are emerging as reusable representation frameworks for data-driven retrieval, prediction and process modelling within ecohydrology, which integrate EO, meteorological forcing and process models to characterise coupled water, energy and carbon dynamics in vegetation and soil across scales. However, there is yet to be an ecohydrology-specific synthesis assessing the EOFM relevance, application evidence or evaluation requirements under uncertain reference data, scale mismatch and temporal dependence. Here, we develop a framework for determining when EOFMs support interpretable inference and identify a mismatch between EOFMs and ecohydrological requirements. Firstly, an observation-to-inference hierarchy shows that relevance depends on target-specific sensing pathways, spatial-temporal support and traceable uncertainty. Secondly, a meta-analysis shows that pretraining is dominated by reflected optical and active-microwave data, with sparse thermal coverage and no passive-microwave-emission sources. Thirdly, our synthesis of ecohydrological applications finds strongest support for spatial context, label-efficient adaptation and hybrid workflows. Evidence declines with inference depth; independent validation of fluxes, coupled dynamics, event trajectories, calibrated uncertainty and decision benefits remains sparse. Fourthly, our benchmark audit finds stronger coverage of fair adaptation and reproducibility in general EOFM suites, and of process targets, direct reference evidence and distribution shifts in ecohydrological evaluations; physical consistency and uncertainty remain weakly assessed. These findings motivate a process-aware framework aligning EOFM design and evaluation with the target variable, observation pathway and process timescale, supporting trustworthy monitoring and interpretation of coupled water, energy and carbon dynamics.
169. 【2608.15279】Geometry-Aware Spatio-Temporal Context Modeling for 4D Occupancy Forecasting
链接：https://arxiv.org/abs/2608.15279
作者：Sitao Chen,Zhuangwei Zhuang,Hui Luo,Qingyao Wu,Mingkui Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous driving, corner-case simulation, crucial for autonomous, occupancy forecasting models, forecasting
备注：
点击查看摘要
Abstract:4D occupancy forecasting models the spatio-temporal evolution of 3D scenes and is crucial for autonomous driving, especially for corner-case simulation. Existing methods often rely on discrete tokenization followed by autoregressive prediction, yet struggle with geometric distortion in static structures and inconsistent temporal coherence over the forecasting horizon. In this work, we propose a Geometry-Aware Spatio-Temporal context modeling method (GAST) for 4D occupancy forecasting, built upon progressive explicit-implicit generation and dual-path spatio-temporal modeling. Specifically, the generation module produces per-frame occupancy with high geometric fidelity and semantic plausibility through pose-driven warping, motion-aware feature modulation, and attention-based feature refinement. Subsequently, the spatio-temporal module enhances spatial consistency through global context aggregation while capturing scene evolution through temporal dynamics extraction. This unified design enables joint optimization of historical reconstruction and future forecasting in an end-to-end manner. Extensive experiments on Occ3D-nuScenes demonstrate the superiority of our method, outperforming the state-of-the-art by 7.67% in mIoU and 6.44% in IoU with a 2.84x speedup, while maintaining strong performance in long-term forecasting.
170. 【2608.15277】Memory-Bounded Continuation of Greedy Sampling for Continual Anomaly Detection
链接：https://arxiv.org/abs/2608.15277
作者：Yoon Gyo Jung,Jaewoo Park,Kuan-Chuan Peng,Seongdeok Bang,Octavia Camps
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：reliable anomaly detection, anomaly detection, Greedy sampling produces, distance from normality, Greedy sampling
备注： Accepted by BMVC2026
点击查看摘要
Abstract:Greedy sampling produces a compact yet representative summary of normal data, which is essential for reliable anomaly detection that relies on measuring distance from normality. For continual anomaly detection where tasks arrive sequentially, extending greedy sampling is straightforward with unbounded memory through coreset accumulation. However, practical deployment requires fixed memory where the coreset size remains constant regardless of task count. We observe that continued greedy sampling, which iteratively applies greedy selection over previously greedy-sampled sets, effectively preserves representativeness under strict memory limits. Despite discarding data at each step to satisfy the memory constraint, coreset quality degrades gracefully rather than catastrophically, enabling reliable anomaly detection across the tasks. We provide theoretical justification by showing that resulting greedy-continued coreset approximates the oracle coreset within a bounded gap. We instantiate this principle in ContCore, which constructs a greedy-continued coreset through greedy expansion on new task features followed by greedy consolidation to enforce the memory budget. Unlike neural methods susceptible to catastrophic forgetting or naive coreset accumulation requiring unbounded memory, ContCore maintains fixed memory with theoretical guarantees. Empirically, ContCore achieves state-of-the-art performance across 11 task schedules on MVTecAD and VisA, and extends effectively to online continual AD settings where prior methods degrade significantly. Code: this https URL
171. 【2608.15267】On the Adversarial Robustness of Remote Sensing Semantic Change Detection
链接：https://arxiv.org/abs/2608.15267
作者：Weikang Yu,Yonghao Xu,Pedram Ghamisi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：jointly identifies changed, identifies changed regions, Semantic change detection, bitemporal dense-prediction task, binary change detection
备注：
点击查看摘要
Abstract:Semantic change detection (SCD) is a bitemporal dense-prediction task that jointly identifies changed regions and their semantic states before and after change. Unlike single-image segmentation or binary change detection, SCD couples two temporal inputs with timestamp-wise semantic prediction, change localization, and final semantic-change decoding, creating adversarial dependencies that are not captured by conventional robustness protocols. We present a task-specific evaluation framework that separates output-side attack objectives from input-side temporal perturbation access, enabling systematic analysis of component vulnerability and cross-temporal propagation. Experiments on four datasets and six representative CNN-, Transformer-, and state-space-based models evaluate component-level and temporal objectives, single- and dual-timestamp perturbations, multiple attack methods, and cross-architecture transferability. The results show that final semantic-change predictions can be severely corrupted even when binary change localization remains comparatively stable, and that perturbations or attack objectives associated with one timestamp can propagate to the prediction of the other. These behaviors occur across different architecture families, while direct cross-model transfer remains considerably weaker than white-box attacks. The study demonstrates that adversarial robustness in SCD depends on the complete bitemporal prediction pathway rather than on an individual branch or backbone family, and provides a structured protocol for evaluating robustness in coupled bitemporal image analysis. Code is available at this https URL.
172. 【2608.15261】Boundary-Aligned Contribution Routing for Robust Optical--SAR Object Detection
链接：https://arxiv.org/abs/2608.15261
作者：Haifa Zhang,Yijing Wang,Haoyu Wang,Zheng Li,Zhiqiang Zuo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：SAR fusion attractive, rich appearance cues, synthetic aperture radar, remote-sensing object detection, making optical
备注：
点击查看摘要
Abstract:Optical imagery provides rich appearance cues, whereas synthetic aperture radar (SAR) offers observations that are less sensitive to illumination and weather, making optical--SAR fusion attractive for remote-sensing object detection. However, the presence of multiple modalities does not guarantee beneficial fusion: imperfect spatial, temporal, and semantic correspondence can make an otherwise intact stream conditionally harmful and induce negative cross-modal transfer. We handle this issue through a model-specific task-utility perspective and learn task-conditioned contribution routing using detection supervision alone. The proposed fusion-boundary-aligned routing regulates each modality's contribution before the first learned cross-modal feature-value mixing operation. For architectures with frequent shallow interaction, a Feature Router performs cross-conditioned, group-addressable modulation near the input; for dual-backbone architectures, a Dual-Statistic Semantic Router predicts stream-level contribution weights from modality-specific average and maximum statistics before late semantic fusion. The routers require no explicit utility supervision, quality labels, reconstruction, or distillation. Experiments on M4-SAR and SpaceNet6-OTD cover nominal full inputs, controlled correspondence shifts, missing modalities, and four nonzero modality-corruption scenarios. Across the reported clean-training controls, routing improves full-input $\text{mAP}_{50}$ by 0.5--5.9 points. Relative to the corresponding modality-dropout baselines, it raises missing-modality $\text{mAP}_{50}$ by 7.6--41.6 points and reduces the negative-transfer rate by up to 12.7 percentage points. Spearman correlations between the learned routing weights and model-specific leave-one-modality-out utility range from 0.45 to 0.66, supporting the task-utility interpretation of the routing coefficients.
173. 【2608.15260】VGGT-Align: Bridging Local Reconstruction and Global Consistency for Long-Sequence 3D Reconstruction
链接：https://arxiv.org/abs/2608.15260
作者：Wei Zhang,Yihang Wu,Songhua Li,Qi Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：critical failure mode, Maintaining global geometric, Maintaining global, failure mode, central challenge
备注： 10 pages, 6 figures, 6 tables. ACM Multimedia 2026 (MM '26). Code: [this https URL](https://github.com/WZ-CS/VGGT-Align)
点击查看摘要
Abstract:Maintaining global geometric consistency is a central challenge in long-sequence 3D reconstruction, with scale drift being the most critical failure mode. In chunk-based inference pipelines, the scale degree of freedom in sequential Sim(3) alignment is left unconstrained, causing estimation errors to compound multiplicatively and distort global trajectories and point cloud geometry. We present a scale-consistency enhancement framework built on a key insight: in structured environments such as driving scenes, geometric quantities arising from environmental regularity remain inherently invariant across temporal segments, and discrepancies in their per-chunk measurements directly expose inter-chunk scale drift. We propose Scene Geometric Invariant Anchoring (SGIA), which extracts dominant geometric invariants from each chunk's predicted point cloud via coarse-to-fine robust estimation and exploits their cross-chunk consistency to establish scale constraints independent of point cloud registration, explicitly degenerating 7-DoF Sim(3) alignment into 6-DoF rigid-body transformation and severing chain-wise scale error propagation at its source. We further introduce a lightweight test-time adaptation strategy that fine-tunes only normalization-layer parameters via multi-objective self-supervision, progressively improving intra-chunk predictions along the sequence. Both modules are plug-and-play and require no offline retraining. Experiments on multiple long-sequence benchmarks demonstrate state-of-the-art performance, reducing absolute trajectory error by up to 32% with significant gains in trajectory stability and reconstruction quality. Code: this https URL
174. 【2608.15259】UAV Video Deblurring via Motion-Aware Diffusion: A Path to Robust Target Detection
链接：https://arxiv.org/abs/2608.15259
作者：Zhiqiang Hu,Shouren Huang,Masatoshi Ishikawa
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：Unmanned Aerial Vehicles, Unmanned Aerial, Aerial Vehicles, play a crucial, traffic surveillance
备注： 8 pages, 8 figures. Published in the 2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2025)
点击查看摘要
Abstract:Unmanned Aerial Vehicles (UAVs) play a crucial role in various scenarios ranging from disaster response to traffic surveillance. However, aerial video footage often suffers from severe motion blur due to rapid flight maneuvers, vibrations, and camera panning, which can significantly degrade downstream tasks such as target detection. Our goal is to explore a computationally-efficient and effective video deblurring approach to enhance UAV target detection performance. To reduce computational cost, we first propose an Adaptive Latent Scale Selector that dynamically adjusts the latent space resolution according to the intensity of UAV motion, thus balancing detail preservation with inference efficiency. To ensure temporal consistency, we introduce a Multi-Frame Alignment and Learnable Gating module to warp and gate the preceding frames, allowing the model to fuse only relevant temporal information and suppress misaligned or uninformative features. Our method can effectively recover sharp details from the UAV video stream. Extensive experiments on real UAV benchmarks demonstrate that our method not only yields superior deblurring performance but also significantly boosts target detection accuracy, making it highly applicable to robust aerial vision tasks.
175. 【2608.15251】Robust structure from motion for aerial-ground images via detector-free feature matching and multi-view track refinement
链接：https://arxiv.org/abs/2608.15251
作者：San Jiang,Hui Wang,Xing Zhang,Zhongwen Hu,Zhijun Wang,Ruisheng Wang,Wanshou Jiang,Qingquan Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generating high-precision urban, rotation make robust, matching highly challenging, make robust feature, high-precision urban
备注：
点击查看摘要
Abstract:Integrated 3D reconstruction from aerial-ground images is essential for generating high-precision urban 3D models, yet severe variations in viewpoint, scale, and rotation make robust feature matching highly challenging. To address these limitations, this study introduces a rotation-robust detector-free matching network coupled with multi-view track refinement for incremental Structure from Motion (ISfM). The proposed workflow features four key modules. First, rotation-aware feature extraction replaces traditional convolutions with an Omnidirectional State Space Block (OSS Block) that selectively scans across eight symmetrical directions to model long-range spatial dependencies and synthesize rotation-invariant feature maps. Second, multi-scale attention transformation utilizes quadtree attention to build a hierarchical token pyramid that isolates high-association token regions and discards irrelevant areas, capturing long-range context with linear computational complexity. Third, bi-directional feature matching executes a symmetric coarse-to-fine matching scheme where coarse alignment computes dual-direction Softmax confidence matrices under mutual nearest neighbor constraints, and fine alignment uses a multi-layer perceptron to regress sub-pixel coordinate offsets. Finally, multi-view track refinement employs an integrated indexing structure to evaluate localized spatial proximity and link disjoint sub-tracks to the highest-confidence anchor point, ensuring stable feature repeatability across the ISfM pipeline. By using real aerial-ground datasets, experimental results demonstrate that the proposed method improves AUC at 5° pose error by 93.9% compared with LoFTR and achieves the highest precision in ISfM reconstruction, with the improved accuracy ranging from 27.6% to 32.7%. The proposed method provides a reliable solution for integrated 3D reconstruction of aerial-ground images.
176. 【2608.15246】CG-GLORE: A Conjugate Gradient-Based Global-Local Regularization Network for Sparse-View CT Reconstruction
链接：https://arxiv.org/abs/2608.15246
作者：Tran Xuan Hieu Le,Doanh C. Bui,Vu Trung Duong Le,Hoai Luan Pham,Khang Nguyen,Mai K. Nguyen,Tu Bao Ho,Yasuhiko Nakashima
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：reduces radiation dose, fewer projection views, severe streak artifacts, acquiring fewer projection, resulting inverse problem
备注： Accepted for presentation at BMVC2026
点击查看摘要
Abstract:Sparse-view computed tomography (CT) reduces radiation dose by acquiring fewer projection views, but the resulting inverse problem is highly ill-posed and often produces severe streak artifacts. Existing deep reconstruction methods have achieved promising performance, yet many rely on first-order updates or large regularization networks, which can be less effective in ill-conditioned settings. We propose \textbf{CG-GLORE}, a compact deep unrolling framework inspired by second-order optimization for sparse-view CT reconstruction. Each unrolled stage uses a CG-solved linear system based on a structured Hessian surrogate: it retains the physics-induced curvature of the data-fidelity term while using an identity approximation for the learned regularization term. Thus, the method is second-order-inspired rather than an exact Newton method for the full learned objective. To model image priors, we design a Global-Local Regularization Network (GLORE), which combines convolutional local feature extraction with a Long-Range Dependency Representation module based on sparse patchification and Nyström attention. This design captures anatomical details and non-local dependencies while maintaining practical complexity. Experiments on AAPM and DeepLesion under multiple sparse-view and noise settings show that CG-GLORE achieves strong quantitative performance, stable convergence, lower noise power, and improved visual fidelity compared with representative reconstruction methods.
177. 【2608.15238】UC-VLM: Consistency-Driven Learning for AI-Generated Image Detection with Vision-Language Large Models
链接：https://arxiv.org/abs/2608.15238
作者：Lei Tan,Shuwei Li,Mohan Kankanhalli,Robby T. Tan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision-Language Large Models, Large Models, Vision-Language Large, AI-generated image, promising for AI-generated
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Vision-Language Large Models (VLLMs) are promising for AI-generated image (AIGI) detection because they can produce both a prediction and a natural-language output. However, most existing VLLM-based detectors primarily fine-tune the language side while giving limited attention to low-level visual forensic cues. They also often depend on manually crafted prompts or human-annotated rationales, which limits this http URL present UC-VLM, a unified multi-stage framework for AIGI detection that relies solely on binary supervision. UC-VLM first identifies effective instruction variants automatically. It then reuses the same binary label within a multi-stage training framework: (i) a visual discrimination objective that strengthens sensitivity to non-semantic forensic cues, and (ii) a label-conditioned generation objective that uses the binary label to supervise textual outputs. This design turns weak binary supervision into a shared supervision signal for both the visual pathway and the language output. Our key novelty is a unified multi-stage binary-supervised framework that consistently reuses the same authenticity labels for visual adaptation and label-conditioned text generation, while leveraging automatically optimized instructions to reduce prompt sensitivity without requiring human-written rationales or hand-crafted this http URL show that UC-VLM achieves 96.1% average accuracy on GenImage, exceeding the strongest prior result by 4.6%, and obtains 69.6% / 77.9% accuracy on Chameleon under ProGAN / SDV1.4 training, surpassing the best baseline by 11.2% / 15.3%, respectively.
178. 【2608.15230】PersonaDrive: Controllable Trajectory Prediction with Multi-Dimensional Driving Personas
链接：https://arxiv.org/abs/2608.15230
作者：Chan Lee,Kimin Yun,Yuseok Bae,Seong Tae Kim,Jung Uk Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：lack meaningful controllability, recent trajectory prediction, autonomous driving methods, methods improve robustness, urban environments
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Although recent trajectory prediction and end-to-end autonomous driving methods improve robustness in urban environments, they still lack meaningful controllability. Existing benchmarks either provide no persona-conditioned annotations or support only a single urgency spectrum (i.e., emergency, normal, relaxed), which cannot distinguish personas that share the same urgency level but require different driving dynamics. To address this, we propose (i) the Persona-Conditioned Trajectory (PCT) dataset, which decomposes driving personas along two axes, Temporal Urgency and Ride Comfort, and combines three levels of each to form a grid of nine personas, each paired with natural-language descriptions and trajectories, and (ii) PersonaDrive, a framework that can learn driving personas from language and can generate persona-specific trajectories. PersonaDrive incorporates Persona-Conditioned Anchor Transform (PCAT), which hierarchically reshapes anchors along both axes, and Persona-Conditioned Multi-Modal Fusion (PCMF) for BEV-level persona fusion. Training is supervised by a Hierarchical Guide Loss enforcing axis-aligned physical orderings and an Axis-Decomposed Diversity Loss preventing diagonal mode collapse. Experimental results show that PersonaDrive consistently improves over the compared baselines across multi-dimensional scenarios. The code and PCT dataset are available at this https URL
179. 【2608.15217】Self-Supervised Topologically Invariant Manifold Learning for Railway Image Quality Assessment
链接：https://arxiv.org/abs/2608.15217
作者：Tingqiong Cui,Yibu Yang,Yang Li,Jiahao Fu,Xiaoliu Luo,Xu Wang,Mengzhu Wang,Siyuan Liu,Guanghui Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：methods typically rely, Existing blind image, Existing blind, image quality assessment, methods typically
备注： 13pages,14 tables, 5 figures
点击查看摘要
Abstract:Existing blind image quality assessment (BIQA) methods typically rely on synthetic distortions and subjective annotations, limiting generalization in real-world domains. To address this, we propose a fully self-supervised BIQA framework based on topologically invariant manifold learning under boundary constraints, which constructs a stable quality reference without manual labels. The framework generates progressive background dilution scales via repeated random cropping around each target; exploiting the monotonic degradation of target information density across these scales, it establishes a self-constrained quality manifold. A linearized spatial moment projection eliminates geometric distortions from random cropping; then a monotonicity divergence filter prunes background-sensitive evaluators, isolating an elite pool \(\mathcal{M}_{\text{elite}}\). A robust M-estimator with a principal component stabilizer fuses the metrics into an asymptotically efficient pseudo-ground truth \(q_{\text{PGT}}\), contracting variance toward the Cramér-Rao lower bound. Extensive evaluations demonstrate that the elite evaluator pool, distilled from 11 baseline metrics, secures superior zero-shot transferability across standard synthetic and wild benchmarks (CSIQ, LIVEC, LIVE-2). Concurrently, deployments on the CQU Railway Rolling Stock Surveillance Dataset (2,797 images) yield a manifold cosine similarity \(0.999\) and a 100.0\% survival rate under industrial extreme stresses, robustly validating its cross-paradigm decoupling and topological resilience.
180. 【2608.15213】DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting
链接：https://arxiv.org/abs/2608.15213
作者：Hao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：recover reliable local, Crowd counting, variations in perspective, background clutter, recover reliable
备注：
点击查看摘要
Abstract:Crowd counting must recover reliable local density under severe variations in perspective, head scale, occlusion, and background clutter. Although modern counting objectives provide strong spatial supervision, many multi-level decoders still use spatially invariant feature fusion and apply one receptive-field pattern to every location. We propose DCA-MoE, a framework that makes both decisions content dependent while retaining a frozen DINOv3 encoder. Spatially Adaptive Layer Fusion (SALF) predicts position-wise weights over four aligned backbone features, and Density-Routed Multi-Receptive-Field Experts (DR-MoE) assigns each location a soft mixture of local, mid-range, and large-context residual experts. An EBC-style head reconstructs block density, while DMCount supervision and an auxiliary routing-balance term train the decoder without updating the backbone. On the NWPU-Crowd validation split, the strongest paired configuration, based on DINOv3 ViT-L/16, obtains 31.7 MAE and 72.2 RMSE; the matched ViT-B/16 full model obtains a paired 32.2/75.9. Cross-dataset results remain mixed, and several component baselines currently report independently selected minima from a single seed. The evidence therefore supports the feasibility of spatially adaptive fusion and routing, while broader paired and multi-seed evaluation remains necessary for causal attribution.
181. 【2608.15211】ERRA: A Hierarchical Parallel Training and Memory Orchestration Framework for High-Resolution AI-based Earth Modeling
链接：https://arxiv.org/abs/2608.15211
作者：Ruohan Wu,Ziqi Zhu,Yang Zhao,Jiarui Tang,Yingzhe Cui,Junshi Chen,Zhao Jing,Jun Shi,Hong An
类目：Computer Vision and Pattern Recognition (cs.CV); Distributed, Parallel, and Cluster Computing (cs.DC)
关键词：high-resolution AI-based Earth, AI-based Earth forecasting, Training high-resolution AI-based, Window-based Swin Transformers, Earth forecasting models
备注： 15 pages, 16 figures, 6 tables, and 2 algorithms. Submitted to IEEE Transactions on Parallel and Distributed Systems (TPDS). Code is available at [this https URL](https://github.com/ruohan12345/TERRA)
点击查看摘要
Abstract:Training high-resolution AI-based Earth forecasting models is memory-intensive. Window-based Swin Transformers reduce the quadratic cost of global attention, but existing distributed systems such as AERIS primarily target pixel-level models and do not jointly support convolutional sampling modules and shifted-window execution. Long-lead rollout finetuning further increases activation memory. To address these challenges, we present TERRA, a hierarchical parallel training framework for high-resolution Earth forecasting. TERRA introduces Sampling-Aware Window, Sequence, and Tensor Parallelism (SAWSTP), which preserves spatially contiguous layouts for sampling modules and routes tokens into topology-aware ragged window layouts for Transformer execution. For long-lead finetuning, Memory Orchestration (MO) provides rollout-aware checkpoint planning and combines input buffering with budget-constrained activation offloading. Experiments on the $1/12^\circ$ GLORYS-based Wenhai workload show that TERRA supports models with up to 11.4B parameters on 96 H200 GPUs and sustains up to $39.76$ PFLOPS, achieving $65.0\%$ strong-scaling and $94.1\%$ weak-scaling efficiency. Compared with checkpoint-only policies, MO further reduces peak allocated GPU memory by $32.2\%$--$51.8\%$ with at most $20.0\%$ step-time overhead, which makes finetuning with smaller patch sizes and longer rollouts feasible for improved forecasting accuracy.
182. 【2608.15196】Anchor-Regularized Adaptation for Generalizable AI-Generated Image Detection with DINOv3
链接：https://arxiv.org/abs/2608.15196
作者：Hyeongjun Choi,Juhun Lee,Davide Cozzolino,Luisa Verdoliva,Simon S. Woo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：removing spurious correlations, Recent works, spurious correlations, works in AI-generated, shown that careful
备注：
点击查看摘要
Abstract:Recent works in AI-generated image detection have shown that careful training data alignment can improve generalization by removing spurious correlations. However, linear probes on frozen DINOv3 representations achieve remarkably strong performance even when trained on misaligned datasets. Motivated by this result, we analyze the underlying rationale and the limits of this generalization. We find that frozen DINOv3 performs well because its decisions rely on features that faithfully represent the space of authentic images. At the same time, its final layer is less effective at capturing the subtle pixel-artifact cues that can be emphasized by aligned training data. We further observe that naively mixing aligned and misaligned data during adaptation improves sensitivity to such cues but at the cost of distorting the pre-trained representation, limiting generalization. To address this issue, we propose Anchor-Regularized Adaptation (ARA). We apply Low-Rank Adaptation to capture pixel-level artifacts while leveraging a frozen anchor classifier to avoid deviations from the original representation structure. This allows the model to exploit pixel-artifact cues without sacrificing generalization. Our method achieves state-of-the-art performance on nine diverse and challenging benchmarks, indicating that ARA enables complementary supervision from misaligned and aligned data for more effective detection.
183. 【2608.15195】Beyond Natural-Image Foundation Models: Benchmarking Satellite Pretraining for Ophthalmic Image Analysis
链接：https://arxiv.org/abs/2608.15195
作者：Lovre Antonio Budimir,Mingya Alexa Gong,Alyssa Foong Quinney,Ivana Matovinović,Yukun Zhou,Pearse A. Keane,Sven Lončarić,Marinko V. Šarunić
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Foundation Models, Vision Foundation, producing broadly applicable, broadly applicable systems, Foundation Models
备注： Accepted at the ECCV 2026 Workshop on Medical Foundation Models and Benchmarks (MEDFMB)
点击查看摘要
Abstract:Vision Foundation Models (VFMs) have emerged as a promising approach in medical imaging, producing broadly applicable systems that can be efficiently adapted across diverse imaging modalities, anatomical regions, and clinical tasks. However, VFMs require extensive training data, and their progress in medical image analysis is constrained by limited data availability, privacy concerns, and high development costs. To alleviate these constraints, medical VFMs (MedVFMs) are often built upon weights from generalist models pretrained on vast amounts of publicly available natural images, introducing a substantial distribution shift for medical task adaptation. To address this, we propose satellite imagery as a novel pretraining domain for MedVFM development and benchmarking, motivated by its closer visual alignment with medical data and its freedom from the privacy constraints that limit medical datasets. Across multiple ophthalmic imaging modalities, we compare DINOv3-SAT493m pretrained on 493 million satellite images against DINOv3-LVD1689m pretrained on 1.7 billion natural images, together with two medical specialist baselines: DINOv3-RETFound and MAE-RETFound. Our experiments show that satellite imagery is a stronger pretraining source than natural images for ophthalmic tasks, particularly on en face vascular-rich modalities. On several tasks, satellite pretraining matches or exceeds the medical specialists on high-resolution en face inputs, despite using no medical data.
184. 【2608.15163】From "What-If" to "What-Is": Counterfactual Thinking-Inspired Semantic Alignment for Visual Brain Decoding
链接：https://arxiv.org/abs/2608.15163
作者：Kaitao Yan,Chi Liu,Congcong Zhu,Huajie Chen,Gengshen Wu,Minghao Wang,Xiaotong Han,Tianqing Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：providing a computational, reconstructs visual content, visual content perceived, person from neural, neural measurements
备注： Under Review
点击查看摘要
Abstract:Visual brain decoding reconstructs visual content perceived by a person from neural measurements such as fMRI, providing a computational approach to studying how visual information is represented in the brain. Recent multimodal representations and diffusion priors have improved reconstruction realism. However, visually plausible reconstructions may contain incorrect objects, attributes, or relations because a strong generative prior can complete content not sufficiently specified by the decoded representation. Conventional reconstruction metrics mainly assess the final image and may therefore obscure such semantic errors. We propose ConceptAlign, a counterfactual semantic alignment framework for visual brain decoding. ConceptAlign pools decoded visual tokens and projects them into a frozen text-embedding space, aligning the representation with the ground-truth caption while separating it from scene-preserving near-miss alternatives. Generated offline by an LLM, these alternatives modify one critical object, attribute, or relation while retaining the scene. A margin-based objective learns fine-grained semantic boundaries between the observed stimulus and plausible but incorrect interpretations without requiring LLM calls during inference. We introduce a systematic three-level semantic evaluation framework covering foundational discriminability, counterfactual description discrimination, and representational geometry. Experiments on the Natural Scenes Dataset show that ConceptAlign improves reconstruction measures, counterfactual semantic discrimination, and representational alignment over the MindEye2 backbone. Matched negative-source ablations, independent LLM and human-written alternatives, and human evaluation support the effectiveness and robustness of the supervision, with favorable patterns in fine-grained conflicts, limited-data decoding, and cross-subject structure.
185. 【2608.15160】A Unified Backbone--Expert Framework with Relation-Token and Residual--Classifier Interfaces for Automatic Modulation Recognition
链接：https://arxiv.org/abs/2608.15160
作者：Zhixiang Deng,Houbiao Li,Zongyong Cui
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Automatic modulation recognition, varying observation lengths, faces distinct representation, distinct representation bottlenecks, Automatic modulation
备注： 31 pages, 6 figures, 10 Tables
点击查看摘要
Abstract:Automatic modulation recognition (AMR) faces distinct representation bottlenecks under varying observation lengths, where a single model architecture often fails to excel. To address this, we propose a unified backbone-expert framework with a common convolutional state-space backbone and two specialized interfaces. For short sequences, we inject explicit lag-aware complex-plane descriptors as relation tokens before encoding to compensate for information loss. For long sequences, we design a gated multi-scale residual refinement module to correct the feature map, combined with a fixed-averaging classifier collaboration to harness complementary evidence. Our framework achieves overall average accuracies of 67.28 \pm 0.14% on RML2016.10b and 87.19 \pm 0.77% on HisarMod2019 (mean \pm sample standard deviation over three runs), respectively. The framework's efficacy is further validated through three-seed ablations, native-length cross-configuration tests, and controlled window studies, confirming the benefit of expert-interface decoupling over one-size-fits-all architectures.
186. 【2608.15141】HOIMask: Towards Generative Masked Modeling for Human Object Interaction Generation
链接：https://arxiv.org/abs/2608.15141
作者：Yihong Ji,Jinsong Zhang,He Hu,Hongbo Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：critical contact fusions, enable critical contact, diffusion process, HOI Vector Quantization, enable critical
备注： ECCV 2026
点击查看摘要
Abstract:Diffusion-based methods have dominated the HOI generation, as they enable critical contact fusions or signals to guide the diffusion process. However, they often result in high artifacts and unstable interaction quality due to error accumulation during iterative denoising. In this work, we propose HOIMask, the first generative masked framework for modeling HOI motion in discrete space. HOIMask first encodes both motion sequences and contact-aware signals into discrete 2D human and object token maps via HOI Vector Quantization (VQ), preserving fine-grained spatial-temporal structure beyond conventional 1D representations. On this basis, a generative masked modeling framework is employed to jointly capture human-object interaction dynamics, leveraging a transformer architecture designed to model complex spatial-temporal and interaction dependencies. To generate more coherent and physically plausible motions, we further introduce a novel contact-aware reconstruction guidance in discrete space during inference, which fuses contact signals to optimize HOI tokens that forces the generated motion with higher spatio-temporal consistency. With craftily designed motion interaction tokens, dedicated architecture and guidance strategy, HOIMask outperforms state-of-the-art diffusion-based methods, generating more realistic and semantically aligned HOI motions. Please refer to this https URL for more results.
187. 【2608.15115】Perspective-Invariant Attack with Enhanced Transferability of Adversarial Examples
链接：https://arxiv.org/abs/2608.15115
作者：Kaisheng Liang,Yiming Cao,Bin Xiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deep neural network, surrogate deep neural, neural network, black-box DNN models, deep neural
备注：
点击查看摘要
Abstract:Adversarial examples generated on a surrogate deep neural network (DNN) can often successfully fool other black-box DNN models. This cross-model transferability poses serious security threats to DNNs in practical applications. Input transformation techniques are widely used to enhance adversarial transferability by increasing the diversity of input images. However, existing methods primarily rely on local operations with limited degrees of freedom (DOF), such as block-wise shuffling and resizing, overlooking global perspective transformations that naturally arise from viewpoint changes. In this work, we propose a Perspective-Invariant Attack (PIA), which introduces a multi-DOF vertex sampling strategy that systematically covers the perspective transformation hierarchy from 2-DOF translation to 8-DOF projective mapping. By generating geometrically diverse input variations, PIA effectively reduces overfitting of adversarial perturbations to the surrogate model, thereby improving adversarial transferability. We further propose PIA-Mix, a generic extension that maintains a complementary transformation pool and efficiently combines our perspective transformation with auxiliary methods for improved transferability. Extensive experiments involving various DNN architectures, advanced defense mechanisms, and multimodal large language models (LLMs) demonstrate that PIA and PIA-Mix outperform state-of-the-art transfer-based attacks.
188. 【2608.15113】Fast Test-Time Refinement for Robust Learned Image Compression
链接：https://arxiv.org/abs/2608.15113
作者：Jiaming Liang,Chi-Man Pun,Weisi Lin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Learned image compression, demonstrated remarkable rate-distortion, Learned image, image compression, remarkable rate-distortion
备注：
点击查看摘要
Abstract:Learned image compression (LIC) has demonstrated remarkable rate-distortion (RD) performance in benign settings. However, the high representational capacity endowed by deep neural networks (DNNs) comes at the expense of increased adversarial vulnerability. This hinders their adoption as trusted standardized codecs. Recent work has sketched test-time refinement (TTR) as a defense in gray-box scenarios, despite its original purpose of improving benign RD performance. Unfortunately, extensive iterations of TTR incur prohibitive overhead, while the robustness mechanism lacks theoretical understanding. Moreover, TTR has not been evaluated in white-box settings or against attacks beyond $\ell_2$-bounded rate and untargeted distortion objectives. To bridge these gaps, we present a systematic study. Our study reveals an Asymmetric Adversarial Trajectory (AAT) property in LIC systems: transitioning from adversarial to benign regions is significantly easier than the reverse process, where adversarial examples can often be roughly recovered within only 1-2 steps. We provide a two-dimensional Tube Model to explain this phenomenon. Based on AAT, we propose a Fast Test-Time Refinement (FTTR) framework for practical and robust LIC systems. We establish that the robustness arises from the contraction of adversarial regions induced by the Input-as-Label property of LIC systems, rather than from obfuscated gradients. Extensive evaluations with diverse strong adaptive attacks across multiple LIC systems demonstrate the promise of the proposed FTTR framework. The code is available at this https URL.
189. 【2608.15110】CETalk: Continuous Valence-Arousal Control for Audio-Driven 3D Talking Head Generation
链接：https://arxiv.org/abs/2608.15110
作者：Peng Jia,Li Dai,Zhen Xiao,Xueliang Liu,Jia Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：talking head generation, accurate lip synchronization, head generation aims, synthesize expressive facial, talking head
备注： 14 pages, 6 figures, 3 tables
点击查看摘要
Abstract:Emotional 3D talking head generation aims to synthesize expressive facial animations with accurate lip synchronization. However, existing methods often rely on discrete emotion categories, which fail to capture the continuous evolution of affect. They also overlook the temporal frequency mismatch between audio articulation and emotional expression. In this paper, we propose CETalk, an audio-driven 3D facial animation framework conditioned on continuous Valence--Arousal (VA) representations for fine-grained emotion control. CETalk predicts a sequence of FLAME parameters through three key components: a Dynamic Emotion Modulation Module that adaptively scales emotional intensity using audio-derived cues; a Multi-Scale Temporal Modeling mechanism that employs parallel branches to decouple high-frequency articulatory movements from low-frequency emotional dynamics; and a Dynamic Fusion Mechanism that integrates these multi-scale features via an adaptive gating network. To support training and evaluation, we construct 3D-VA-MEAD, a large-scale dataset with automatically estimated VA annotations and reconstructed 3D facial motions. Extensive experiments demonstrate that CETalk outperforms state-of-the-art methods in both lip-sync accuracy and emotional expressiveness, while enabling smooth and controllable emotion transitions.
190. 【2608.15105】EMASAM: a Computationally Efficient Sharpness-Aware Minimization via EMA-Guided Perturbations
链接：https://arxiv.org/abs/2608.15105
作者：Tanapat Ratchatorn,Masayuki Tanaka
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent progress, progress in optimization, optimization research, research has highlighted, highlighted the sharpness
备注： Accepted in ICPR2026. The project page can be accessed at [this https URL](https://www.vip.sc.eng.isct.ac.jp/proj/EMASAM)
点击查看摘要
Abstract:Recent progress in optimization research has highlighted the sharpness of the loss landscape as a key factor in narrowing the generalization gap. Motivated by this insight, Sharpness-Aware Minimization (SAM) was proposed as a training strategy that enhances generalization. Despite the promising performance, SAM suffers from its twice computational cost due to its core algorithm requiring an extra gradient computation during the perturbation step. To overcome this limitation, we introduce Exponential Moving Average Sharpness-Aware Minimization (EMASAM), a computationally efficient variant of SAM. EMASAM does not require the loss gradient in the perturbation step. Instead, EMASAM defines the perturbation direction based on the discrepancy between the main model and the EMA shadow model. This perturbation travels away from the stable average position toward the less stable area, acting as a softer yet cheaper alternative to SAM's worst-case scenario perturbation. Moreover, since EMASAM's perturbation does not rely on noisy mini-batch gradients, it mitigates the gradient-induced instability inherent in SAM. Hence, EMASAM eliminates the need for an extra backpropagation while also preserving the generalization ability of the SAM-style training. Several experiments have been performed and confirm the efficiency and robustness of our method.
191. 【2608.15104】ProjFormer: Point Cloud Completion via Geometric-Projective Transformer and Cross-Modal Semantic Constraints
链接：https://arxiv.org/abs/2608.15104
作者：Sheng Liu,Meng Wang,Ruihui Li,Huilong Pi,Zhuo Tang,Kenli Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inherently ill-posed due, Point cloud completion, partial observations, cloud completion, completion is inherently
备注： Accepted by ACM Multimedia 2026. 10 pages, 6 figures, 5 tables
点击查看摘要
Abstract:Point cloud completion is inherently ill-posed due to severe sparsity and ambiguity in partial observations. Existing multi-view methods alleviate this by incorporating 2D semantics, but often rely on learned attention and fixed fusion, which lack geometric consistency and adaptability. We propose ProjFormer, a cross-modal framework that enforces geometry-consistent 2D-3D interaction through explicit projection and adaptive feature routing. A Projective Guided View Attention module aligns 3D points with multi-view features via deterministic projection, enabling efficient and geometrically consistent aggregation. Building on this, a geometry-aware routing network performs point-wise adaptive fusion of structural and observation-driven features for progressive refinement. Experiments show that, under a lightweight design, ProjFormer delivers competitive performance with improved structural completeness.
192. 【2608.15096】MODAL: Multi-Modal Object Re-ID via Model-Driven Sparse Decoupling and Text-Image Differential Filtering
链接：https://arxiv.org/abs/2608.15096
作者：Chengbo Huang,Jun-Jie Huang,Long Lan,Tianrui Liu,Xueqiong Li,Yuanxi Peng,Xinwang Liu,Meng Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：facilitate cross-camera object, cross-camera object retrieval, leveraging complementary information, Multi-modal object re-identification, aims to facilitate
备注：
点击查看摘要
Abstract:Multi-modal object re-identification (Re-ID) aims to facilitate cross-camera object retrieval in complex environments by leveraging complementary information from visual (e.g., RGB, NIR, TIR) and textual modalities. However, existing approaches often lack principled feature disentanglement and coherent multi-modal integration, leading to entangled representations that introduce cross-modal conflicts, obscure discriminative cues, and suffer distribution shift under modality-missing conditions. To tackle these challenges, we propose MODAL, a novel multi-modal object re-identification framework, grounded in coupled sparse coding theory and differential suppression principles. A core component of MODAL is a Multi-modal Feature Sparse Decoupling module, developed in a model-driven deep unrolling manner based on multi-modal coupled sparse coding. It explicitly decomposes multi-modal features into uni-modal specific, bi-modal and tri-modal shared representations, thereby achieving more transparent and effective feature disentanglement. Benefiting from the principled feature disentanglement, MODAL naturally mitigates performance degradation in incomplete-modality scenarios via a Modality-Aware Subspace Activation that selectively activates only the consistently shared subspaces. Moreover, we propose a Text-Image Differential Filtering module that leverages coarse-grained textual semantics to adaptively suppress task-irrelevant responses in the decoupled visual representations, thereby enhancing discriminative information. Extensive experiments on four datasets demonstrate that MODAL achieves state-of-the-art performance with superior transparency.
193. 【2608.15090】Distribution-free false-alarm calibration and chance-corrected spatial evaluation for industrial anomaly detection
链接：https://arxiv.org/abs/2608.15090
作者：Jie Deng
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：operating characteristic curve, industrial visual inspection, visual inspection commonly, inspection commonly report, receiver operating characteristic
备注： 15 pages, 3 figures, 9 tables
点击查看摘要
Abstract:Studies of industrial visual inspection commonly report the area under the receiver operating characteristic curve (AUROC) and the overlap between anomaly maps and defect masks. Neither measure specifies the false-alarm rate at a selected threshold, while recurrent defect locations and mask geometry can inflate overlap. We combine a distribution-free upper tolerance threshold with a paired-minus-crossed spatial test. This test compares each detector's score-contributing locations with the matched defect mask and with masks from other images; the difference in rates defines spatial-evidence lift relative to the empirical chance-overlap rate. We evaluate three detectors on 120 point-defect images from three ISP-AD modalities and three fixed data splits. Of 378 alarms, 230 overlap the matched mask. Paired and crossed rates are nevertheless similar in eight of nine detector--modality cells; only DINOv2--ASM has a positive 95\% bootstrap lower bound (lift 0.259, 95\% interval 0.159--0.347). On the independent Magnetic Tile Defect dataset, the same analysis gives lifts of 0.203 (0.169--0.236) for Wide ResNet-50 (WRN50) patch memory and 0.231 (0.202--0.262) for Vision Transformer B/16 (ViT-B/16) patch memory, with one-sided permutation $p=10^{-5}$ for both. When crossed masks are restricted to the same defect class, the lifts remain 0.185 and 0.210. Exact sample planning shows that, with 150 calibration normals, a 95\%-confidence distribution-free claim is supported only for target false-positive rates of 1.98\% or higher; a 1\% target requires at least 299 normals. The results support reporting operating-point performance and chance-corrected spatial evidence alongside AUROC and raw mask overlap.
194. 【2608.15075】SA-GEM: Scale-Adaptive and Geospatial Evidence-Modulated Token Pruning for Efficient Remote Sensing Large Vision-Language Models
链接：https://arxiv.org/abs/2608.15075
作者：Kexin Ma,Jing Xiao,Bowen Xing,Liang Liao,Chia-Wen Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Earth observation imagery, advanced multimodal understanding, counts grow quadratically, important visual evidence, visual token counts
备注：
点击查看摘要
Abstract:RS-LVLMs have advanced multimodal understanding of Earth observation imagery, yet their performance is fundamentally constrained by high-resolution processing, as visual token counts grow quadratically with linear input resolution while important visual evidence is inherently sparse and increasingly diluted across the expanded sequence. Existing token pruning methods largely rely on scale-agnostic resolution policies and isolated importance cues, limiting task-aligned granularity adaptation and holistic evidence preservation. To address this, we present Scale-Adaptive and Geospatial Evidence-Modulated Token Pruning (SA-GEM), a plug-and-play framework that unifies task-adaptive token granularity allocation with holistic geospatial token importance modulation. Specifically, a lightweight router selects the resolution based on query-dependent token granularity, while a token importance modulator jointly models task relevance, spatial structure, and local redundancy to preserve holistic geospatial evidence. We show that higher resolution is not universally beneficial and, once sufficient granularity is reached, token quality matters more than token quantity. Experiments across various benchmarks demonstrate that SA-GEM achieves consistent gains in both accuracy and efficiency over existing pruning methods. On XLRS-Bench, it surpasses GeoLLaVA-8K by 2.3% in accuracy with a 2.4 times total inference speedup.
195. 【2608.15061】Do Visual Grounding Decoders Need Feed-Forward Networks? A Controlled Study over Frozen Vision-Language Features
链接：https://arxiv.org/abs/2608.15061
作者：Tarun Tomar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：add essential computation, pretrained vision-language model, decoders add essential, feed-forward networks, language context
备注： 14 pages, 8 figures, 5 tables. Code and project page: [this https URL](https://github.com/TarunTomar122/attention-is-all-you-need-for-vlms)
点击查看摘要
Abstract:Do feed-forward networks (FFNs) in visual grounding decoders add essential computation once a pretrained vision-language model has already encoded image and language context? We compare a four-block attention-only decoder (A4), a matched four-block attention-plus-FFN decoder (S4), and an eight-block attention-only parameter control (A8) over frozen VLM features. A4 matches or slightly exceeds S4 on RefCOCOg and Ref-Adv-s. FineCops-Ref reveals a small A4 deficit of 0.52 percentage points at IoU@0.5 (95% CI [0.12, 0.95] in favor of S4), but A8 recovers it and finishes 0.26 points above S4. Official FineCops levels do not show a monotonic increase in the gap. A4 reduces trainable decoder parameters by 44.4% and cached-decoder latency by 10.1%, although end-to-end latency remains backbone-dominated. These results concern the trainable grounding decoder, not a complete attention-only VLM.
196. 【2608.15060】EgoTac: In-the-wild Tactile Prediction from Egocentric Vision
链接：https://arxiv.org/abs/2608.15060
作者：Wenkang Zhang,Chengbo Yuan,Zicheng Zhang,Zhengxue Cheng,Yang Gao
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：dexterous manipulation, fundamental to dexterous, egocentric human, human data increasingly, tactile
备注：
点击查看摘要
Abstract:Touch is fundamental to dexterous manipulation, yet most egocentric human data increasingly used for robot learning lacks tactile information. Directly collecting large-scale tactile data is challenging due to sensor limitations, while human video data is abundant, contact-rich, and easily scalable. This motivates a natural question: can tactile signals be inferred purely from vision? To address this, we introduce EgoTac, a generalizable model that predicts rich tactile information directly from egocentric human videos. EgoTac is trained on a unified corpus of over 5.7M image-tactile pairs, covering both continuous force measurements and binary contacts. By learning from this diverse dataset, EgoTac captures nuanced touch dynamics across varied interactions. Experiments demonstrate strong performance: in-domain prediction achieves an average force error below 0.06N. On out-of-domain contact prediction benchmarks, EgoTac consistently outperforms the state-of-the-art contact estimator. It also captures the rise and fall patterns of real tactile data and enables zero-shot predictions on unconstrained real-world videos. Scaling analyses further reveal that both data diversity and volume improve performance steadily. Overall, EgoTac provides a scalable pathway to extract tactile priors from egocentric human videos, enabling broadly applicable tactile-aware robot learning.
197. 【2608.15058】MEDR: Query-Independent Frame Selection via Multi-Signal Event Modeling and Dynamic Rescoring
链接：https://arxiv.org/abs/2608.15058
作者：Xinlei Pu,Weijie Shi,Wen Yang,Yi Cao,Hao Chen,Yuanjun Liu,Wenwei Ding,Jia Zhu,Jiajie Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, enabling long videos, large language models, Frame selection, enabling long
备注： 9 pages, 2 figures, 3 tables
点击查看摘要
Abstract:Frame selection is a fundamental component of multimodal large language models, enabling long videos to be processed under limited visual-token and computational budgets. Uniform sampling preserves temporal coverage but may miss informative content that appears only briefly. To alleviate this limitation, query-dependent methods can retrieve question-relevant frames. However, because the selected frames depend on the current question, the same visual input cannot be directly shared across different questions, and frame selection must be repeated in multi-turn video dialogue. This motivates us to seek a query-independent frame selection method that preserves the reusability of a fixed visual input while improving the coverage of informative events beyond uniform sampling. We propose Multi-Signal Event Modeling and Dynamic Rescoring (MEDR), a training-free and query-independent frame selection method. Multi-Signal Event Modeling organizes complementary visual, motion, and text signals into signal-specific temporal events. Dynamic Rescoring then iteratively reevaluates each candidate relative to the current selected set, updating its score according to frame-level signal strength, additional event coverage, and temporal proximity. The resulting fixed frame set is constructed without observing the query and can be reused across different questions. On the standard benchmark evaluations, MEDR improves model accuracy by 0.63%-0.89% on Video-MME. On the long-video subset of LongVideoBench, it improves accuracy by up to 1.23% with Qwen3-VL-8B. MEDR further improves overall accuracy by 0.53%, while reusing exactly the same frame set for every question about a video.
198. 【2608.15054】Frequency and Edge-Guided Segment Anything Model for Remote Sensing Image Semantic Segmentation
链接：https://arxiv.org/abs/2608.15054
作者：Feng Gao,Zizhe Pan,Haoting Wang,Ruzhuang Hua,Jingchao Cao,Junyu Dong,Qian Du
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing image, attracted significant attention, significant attention due, Remote sensing, land cover types
备注： Accepted for publication in IEEE TGRS 2026
点击查看摘要
Abstract:Remote sensing image semantic segmentation (RSISS) has attracted significant attention due to the growing demand for fine-grained land cover information. The Segment Anything Model (SAM), proposed as a foundation vision model, offers strong segmentation performance and generalization capabilities for RSISS tasks. However, existing SAM-based approaches face two limitations: (1) Insufficient adaptation of SAM's features to the diverse characteristics of land cover types. (2) Semantic ambiguity at object boundaries, which hinders accurate delineation. To address these limitations, we propose Frequency and Edge-guided SAM (FE-SAM), a scalable and efficient framework for RSISS. Specifically, we introduce a Frequency-Modulated Adapter (FMA) that adaptively decomposes and modulates frequency-domain features based on the input data. It selectively enhances informative high- and low-frequency components corresponding to different land cover types. Furthermore, to improve SAM's ability to capture fine-grained details, we design EGRefiner, which integrates multi-scale edge-enhanced information extracted from the input image. Extensive experiments on three benchmark datasets demonstrate that FE-SAM outperforms state-of-the-art methods. The source codes are available at: this https URL.
199. 【2608.15045】MOSS-VL Technical Report
链接：https://arxiv.org/abs/2608.15045
作者：Pengyu Wang,Chenkun Tan,Shaojun Zhou,Qirui Zhou,Yanxin Chen,Xingyang He,Huazheng Zeng,Jijun Cheng,Chenghao Wang,Xiaomeng Qian,Pengfei Wang,Zhan Huang,Shanqing Gao,Wei Huang,Longjun Cao,Wu Ran,Jie Liu,Changtai Zhu,Hongkai Wang,Yixian Tian,Chenghao Liu,Zhen Ye,Xinghao Wang,Botian Jiang,Guoguo Feng,Zhaoye Fei,Ruixiao Li,Mingshu Chen,Yang Gao,Qinyuan Cheng,Shimin Li,Xipeng Qiu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：open vision-language model, vision-language model family, treats real-time interaction, first-class capability, open vision-language
备注： 22 pages. Project page: [this https URL](https://openmoss.ai/MOSS-VL/)
点击查看摘要
Abstract:We present MOSS-VL, an open vision-language model family that treats real-time interaction -- perceiving while it speaks -- as a first-class capability. It is co-designed across the stack: the language decoder attends to vision only through gated cross-attention, so the model can naturally see incoming frames while generating; a synthesized interaction corpus supervises when to speak, when to stay silent, and when to revise; and a staged curriculum concentrates all real-time-specific training in one light final stage over a strong offline foundation. Offline, MOSS-VL-Instruct is competitive at comparable scale and leads temporal-reasoning video sets. Across four streaming benchmarks, MOSS-VL-Realtime posts the best average on three (second on the fourth) among open-source streaming models, sweeping the three subsets that squarely test proactive behavior -- 66.0 vs. 37.5 for the best baseline on OmniMMI Proactive Alerting. With 11.3B parameters but visual tokens outside the decoded sequence, MOSS-VL widens its time-to-first-token advantage over same-backbone Qwen3-VL-8B from 2.8x to 5.1x as visual context grows. We release all five checkpoints, the training curriculum, and the real-time inference code at this https URL.
200. 【2608.15032】Handoff-H1: An Orchestrated Vision-Agent System for Material Quantity Takeoff from Construction Blueprints
链接：https://arxiv.org/abs/2608.15032
作者：Bruno Chicelli,Henrique Alves,Rodrigo Anselmo,Joshua Weinberg,Felipe Lemos,Jan Baryla
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：requires visual perception, takeoff requires visual, quantity takeoff requires, Construction Blueprint Takeoff, drawing sheets
备注： 15 pages, 7 figures. Evaluation harness available on [this https URL](https://github.com/handoffai/residential-takeoff-benchmark/) . Request data via e-mail to research@handoff.ai
点击查看摘要
Abstract:Converting a set of architectural blueprints into a complete material quantity takeoff requires visual perception across drawing sheets, dimensional and multi-hop reasoning, and grounding in construction conventions that the drawings never state. We present Handoff-H1, a takeoff system built from three layers: purpose-built computer-vision models that extract primitives; tool-using agents equipped with image operations and in-house visual-task tools, including CV-model-backed counting, detection and plan decomposition; and a persistent, hierarchically structured project foundation, grounded in a curated construction knowledge base. We evaluate on the Construction Blueprint Takeoff Benchmark: 10 real residential blueprint sets paired with consensus-validated expert takeoffs - 2,009 verified line items, restricted for scoring to the 1,348 primary-tier materials that drive an estimate - scored per trade by an LLM judge on material coverage and quantity Precision@25% (P@.25) and combined into a weighted composite. Under identical scoring from the raw PDF, seven frontier and open-weight models span composites of 35-61, and independent professional estimators - scored against the same reconciled gold standard - post 77.6% (65.5% coverage, 87.9% P@.25). Handoff-H1, working end-to-end from the raw PDF, reaches 81.6% (86.1% coverage, 78.8% P@.25): roughly 20 points above the strongest frontier agent, and above the independent estimators by pairing near-human quantity precision with coverage they do not reach. The evaluation harness is public for the open harbor framework; the blueprint sets and ground truth are available upon request for research use.
201. 【2608.15029】Generation of Synthetic Fingerphotos with GANs
链接：https://arxiv.org/abs/2608.15029
作者：Conor Miller-Lynch,Sandip Purnapatra,Syed Konain Abbas,Lambert Igene,Faraz Hussain,Soumyabrata Dey,Stephanie Schuckers
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Contactless fingerprinting, contactless fingerprinting systems, evaluate contactless fingerprinting, touching a scanner, contactless fingerprint data
备注：
点击查看摘要
Abstract:Contactless fingerprinting is an emerging approach to biometric authentication that allows users to scan their fingerprints without touching a scanner. Due to the limited amount of contactless fingerprint data available and the security risks associated with sharing real individuals' fingerprints, it is valuable to explore methods of generating synthetic data that can be used in place of - or in conjunction with - real data to develop and evaluate contactless fingerprinting systems. In this paper, we present and evaluate synthetic fingerphotos generated using StyleGAN2-ADA and StyleGAN3, existing image generation architectures. We evaluate the realism, privacy preservation, and variety of the synthetic fingerphotos by comparing their biometric feature statistics to those of real fingerphotos, computing match scores between real and synthetic fingerphotos, and computing match scores between different synthetic fingerphotos. This paper provides a quantitative comparison point for future evaluations of synthetic fingerphotos. The evaluation code is made available at this https URL.
202. 【2608.15028】Geometry-Calibrated Closed-Form Shrinkage for SAR Despeckling
链接：https://arxiv.org/abs/2608.15028
作者：Xuran Hu,Mingzhe Zhu,Djordje Stanković,Yujie Zhu,Zhenpeng Feng,Yifang Ban,Ljubiša Stanković
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：erasing scattering structures, Synthetic aperture radar, multiplicative non-Gaussian noise, aperture radar, scattering structures
备注： 16 pages, 13 figures
点击查看摘要
Abstract:Synthetic aperture radar (SAR) despeckling is an inverse-recovery problem in which multiplicative non-Gaussian noise must be suppressed without erasing scattering structures. We revisit a nonlocal sparse estimator that applies a log--Yeo--Johnson transformation, stacks similar patches into groups, codes each group on its own left singular basis, and shrinks the resulting coefficients. Three quantities usually treated as tunable are shown to be fixed by this construction. First, the group dictionary is orthonormal, so the weighted Lasso admits an exact coefficient-wise soft-threshold solution: the iterative inner solver is unnecessary, and the two apparent weighting matrices are the numerator and denominator of a single threshold field rather than independent modules. Second, because the dictionary is estimated from the noisy group itself, its retained subspace absorbs speckle in proportion to the group aspect ratio $\gamma=p^2/K$; a random-matrix argument converts the corresponding regularization constant into a geometry-calibrated correction and collapses patch size, group size, and shrinkage scale into one analytically determined degree of freedom. Third, singular projection makes the coefficient noise nearly Gaussian at every tested look number, which locates the point at which an exact speckle likelihood ceases to be informative. The resulting estimator is deterministic, training-free, and applies one set of analytically determined settings to every image and sensor. It ranks first in 18 of 24 PSNR/SSIM comparisons against twelve published methods on three synthetic benchmarks, and attains the lowest mean deviation of the ratio image from the theoretical speckle model over six real-SAR configurations from five sensors. Code is available \href{this https URL}{here}.
203. 【2608.15024】MotionGS-SLAM: Event-Modulated Gaussian Splatting for Motion-Blur Robust SLAM
链接：https://arxiv.org/abs/2608.15024
作者：Zhiqiang Hu,Shouren Huang,Masatoshi Ishikawa
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Current Vision-based SLAM, Vision-based SLAM systems, SLAM systems fail, Current Vision-based, Vision-based SLAM
备注： 8 pages, 5 figures. Published in the 2026 IEEE International Conference on Robotics and Automation
点击查看摘要
Abstract:Current Vision-based SLAM systems fail catastrophically when motion blur corrupts the visual input, as they attempt the ill-posed inverse problem of recovering sharp content from degraded observations. We present MotionGS-SLAM, which fundamentally reimagines motion blur handling through a paradigm shift: rather than removing blur artifacts, we reformulate the challenge as a well-constrained forward problem that generatively models blur formation within the rendering pipeline. By leveraging event cameras' microsecond temporal resolution and immunity to motion blur, we introduce a novel event-modulated Gaussian kernel that dynamically adapts each Gaussian's rasterization based on precise motion cues. Our dual-modulation mechanism transforms 2D Gaussian projections from isotropic dots into anisotropic, motion-aligned elliptical brush strokes (spatial modulation) while adaptively varying exposure integral sampling density based on local velocity (temporal modulation). This physics-based approach enables joint optimization of intra-exposure camera trajectories and 3D scene geometry through blur-aware photometric and event-based constraints. Extensive experiments demonstrate significant improvements over state-of-the-art methods in trajectory accuracy and map quality under severe high-motion conditions.
204. 【2608.15019】DualMiT-Net: Local-Global Transformer-Convolutional Fusion for Breast Mass Segmentation in Mammographic Regions of Interest
链接：https://arxiv.org/abs/2608.15019
作者：Alibek Kamiluly,Milana Muratova,Yash Patel,Fan Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：surrounding breast tissue, low contrast, important step, step in computer-aided, remains difficult
备注：
点击查看摘要
Abstract:Breast mass segmentation is an important step in computer-aided mammography, but it remains difficult because masses can have low contrast, irregular shapes, and boundaries that blend with surrounding breast tissue. To address this problem, we present DualMiT-Net, a dual-branch network that uses both a focused view of the mass and a wider view of the surrounding tissue. The local branch uses a Mix Transformer (MiT-B5) encoder to learn mass shape, texture, and boundary information, while the global branch uses an EfficientNet-B5 encoder to learn surrounding breast context. Features from the two branches are shared at the deeper encoder levels and are then progressively fused in a single decoder. A spatial gate controls how much global information is added during decoding. We also evaluated four input representations and selected a percentile-windowed mammogram combined with a Gabor texture response. The model was trained and evaluated on the mass subset of the Curated Breast Imaging Subset of the Digital Database for Screening Mammography (CBIS-DDSM) using a patient-level split. Across three training runs, DualMiT-Net with exponential moving average weights achieved a mean Dice coefficient of 0.9375 and a mean Intersection over Union of 0.8834. It also achieved better Dice and IoU scores than six standard encoder-decoder baselines trained using the same data and training settings. These results show that combining local mass information with wider breast context can provide accurate and consistent breast mass segmentation.
205. 【2608.15009】ForceU-VLA: A Force-Aware Vision-Language-Action Model for Embodied Ultrasound Scanning
链接：https://arxiv.org/abs/2608.15009
作者：Xingzheng Wu,Cheng Zhang,Guihao Yan,Xifeng Hu,Zhi Liu,Qing Cai
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Embodied intelligent ultrasound, ultrasound examination process, embodied ultrasound scanning, intelligent ultrasound scanning, integrating perception
备注：
点击查看摘要
Abstract:Embodied intelligent ultrasound scanning enables the automation and standardization of the ultrasound examination process by integrating perception, decision-making, and execution capabilities. However, existing methods suffer from loosely coupled modeling between force and ultrasound modalities and lack awareness of scanning stages, which limits their ability to capture dynamic probe-tissue interactions. To address these issues, we propose ForceU-VLA, a force-aware Vision-Language-Action model for autonomous embodied ultrasound scanning, which leverages force signals and ultrasound image feedback throughout the scanning process to enable accurate and high-quality ultrasound acquisition. Firstly, we propose a Force-Ultrasound Synergistic Fusion Module (FUSFM) that synergistically fuses ultrasound visual and force-feedback information to provide stable, reliable guidance for probe motion. Secondly, a Stage-Adaptive Modulation Mechanism (SAMM) is proposed to accommodate the task requirements across different scanning stages by adaptively modulating multimodal features to enhance their representation quality. Additionally, we introduce ForceU-VLA-Data, a real-world, force-aware embodied ultrasound dataset that integrates visual, force, and action signals, including data from two organs across five representative clinical scanning views, and comprising 450 expert-collected trajectories with approximately 100,000 synchronized multimodal frames. Extensive experimental results demonstrate that ForceU-VLA significantly improves contact stability and probe pressure regulation in embodied ultrasound scanning, thereby effectively enhancing task execution quality and overall system reliability. The source code is available at this https URL.
206. 【2608.15006】MetaReason: Precise Interleaved Multimodal Reasoning via Editing Meta Information for Solving Geometry Problems
链接：https://arxiv.org/abs/2608.15006
作者：Penghao Yin,Haomin Wang,Qihong Tang,Xiaoye Qu,Hongjie Zhang,Xiao-Ping Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：complex geometry tasks, solving complex geometry, vision-language models rely, models rely heavily, crucial for solving
备注：
点击查看摘要
Abstract:Although visual reasoning is crucial for solving complex geometry tasks, existing vision-language models rely heavily on text-only reasoning. Some recent methods introduce intermediate visual states to facilitate reasoning, but they are often hindered by inaccurate geometric representations and low rendering fidelity, ultimately leading to unreliable outputs. To address these limitations, we propose MetaReason, a framework for multimodal reasoning in plane geometry that leverages structured meta-information to enable accurate auxiliary-line construction. The framework first parses geometric images into meta-information, performs controllable edits with predefined tools to synthesize high-fidelity visual states, and then conducts reasoning based on these augmented views. To support this framework, we construct TutorGeo, a comprehensive dataset containing 17k image-to-meta conversion samples, 60k text-only reasoning traces, and 60k interleaved multimodal reasoning traces. Using this dataset, we combine supervised fine-tuning and reinforcement learning to develop robust multimodal reasoning capabilities. We also introduce ExamGeo, a benchmark derived from real-world examination problems that enables systematic evaluation across varying difficulty levels. Experimental results demonstrate that MetaReason significantly outperforms existing open-source models and achieves competitive performance against proprietary models.
207. 【2608.15004】FZ-VLM: A Two Stage Florence-Zephyr Vision Language Model Framework for Pulmonary Nodule Characterization and Clinical Decision Making
链接：https://arxiv.org/abs/2608.15004
作者：Pramit Dutta,Jenita Manokaran,Richa Mittal,Ryan Appleby,Eranga Ukwatta
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Computed Tomography, cancer-related mortality worldwide, primary imaging tool, Lung cancer remains, mortality worldwide
备注：
点击查看摘要
Abstract:Lung cancer remains one of the leading causes of cancer-related mortality worldwide, and Computed Tomography (CT) is a primary imaging tool for screening and followup assessment. After pulmonary nodule detection, radiologists manually assess anatomical location, diameter, margin characteristics, and attenuation type to support risk assessment and clinical decision-making. However, this post-detection workflow is time-consuming and can be affected by inter-observer variability. Existing Artificial Intelligence methods often focus on isolated tasks, limiting their use as a unified, clinically grounded interpretation framework. This study presents FZ-VLM, a two-stage Florence-Zephyr Vision Language Model framework for unified structured pulmonary nodule characterization in lung CT. The framework uses a fine-tuned Florence-2 model to extract radiological attributes from expert-annotated 2D axial CT slices, while a Zephyr-7B model uses these attributes to generate nodule descriptions, follow-up recommendations, and longitudinal analyses. Results showed that the Stage 1 model achieved 77.18\% accuracy for anatomical location, 67.96\% accuracy for margin characteristics, and 79.13\% accuracy for attenuation type, with a Mean Absolute Error of 2.58 mm for diameter estimation, outperforming evaluated GPT-4-based baselines as well as the human baseline. Expert radiologist evaluation of Stage 2 showed 93.9\% accuracy, 98.6\% completeness score, 76.1\% clinical relevance, and an overall score of 89.5\%. Safety analysis showed that most outputs were clinically safe, although some follow-up recommendations still required expert review. To the best of our knowledge, this study presents the first two-stage Vision-Language Model framework for structured nodule characterization and clinical decision-making.
208. 【2608.14994】Registration-Free Hyperspectral Reconstruction from RGB via a Permutation-Invariant Gram-Matrix Principle
链接：https://arxiv.org/abs/2608.14994
作者：Jiangsan Zhao,Masayuki Hirafuji,Seishi Ninomiya,Jakob Geipel,Wei Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-resolution RGB image, high-resolution hyperspectral image, spectrally high-resolution hyperspectral, RGB image, high-resolution RGB
备注： 11 pages, 10 figures, 8 tables. This work has been submitted to the IEEE for possible publication
点击查看摘要
Abstract:Reconstructing a spatially and spectrally high-resolution hyperspectral image (HR-HSI) from a low-resolution HSI (LR-HSI) and a high-resolution RGB image (HR-RGB) usually assumes precise registration and a known camera response function (CRF). Both assumptions are difficult to satisfy with different sensors. We remove both through a permutation-invariant supervision principle: the Gram matrix of an unmixed abundance map depends on shared material composition but not on pixel ordering. Matching abundance Gram matrices therefore allows RGB-to-HSI mapping to be learned without spatial correspondence and without a predefined CRF. Under a full random permutation of HR-RGB pixels, a state-of-the-art fusion method collapses, whereas our reconstruction is unchanged after inverse reindexing for evaluation. Building on this principle, a residual spectral super-resolution function maps HR-RGB directly to HR-HSI without registration, known CRF, or paired supervision. Across indoor, natural-scene, and remote-sensing benchmarks, the method achieves accuracy comparable to approaches that require these assumptions while remaining robust when they are violated. Loss ablations further show that reconstruction accuracy is largely insensitive to the specific discrepancy used to match the Gram matrices, indicating that performance arises primarily from the permutation-invariant principle rather than loss tuning.
209. 【2608.14991】Risk-Adaptive Edge--Cloud Visual Reasoning for Communication-Efficient Autonomous Driving
链接：https://arxiv.org/abs/2608.14991
作者：Meng Ma,Shuyang Li,Naigang Wang,Ruimin Ke
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cloud-hosted vision-language models, offer greater contextual, frequent visual uploads, visual uploads increase, uploads increase communication
备注： 7 pages, 4 figures, 5 tables
点击查看摘要
Abstract:Cloud-hosted vision-language models (VLMs) offer greater contextual reasoning capabilities than smaller onboard models, but frequent visual uploads increase communication overhead and add network and inference latency to tactical decisions. We present a risk-adaptive edge-cloud architecture in which onboard traffic assessment determines when cloud reasoning is requested. An onboard VLM and a lightweight detector capture temporal traffic conditions and path-relative hazards for conservative local response and selective cloud access. The cloud model provides tactical advice, while validation, vehicle control, and automatic emergency braking remain local. In CARLA experiments, our method matched the task success rate of periodic cloud access while reducing cloud requests by 54.1% and recording fewer automatic emergency braking (AEB) activations. In a delayed-roadwork ablation, semantic events triggered requests before the next scheduled audit. Across three emulated network profiles, the method continued to reduce cloud traffic, although lane changes took longer than with periodic access. Onboard traffic assessment therefore served as a practical trigger for selective VLM inference in these experiments.
210. 【2608.14976】Benchmarking Frontier Text-to-Image Models on Image-Description Prompts
链接：https://arxiv.org/abs/2608.14976
作者：Sajjad Abdoli,Ghassan Al-Sumaidaee,Ahmed Rashad
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：multi-object attribute binding, explicit spatial constraints, Black Forest Labs, Nano Banana Pro, legible embedded text
备注：
点击查看摘要
Abstract:Text-to-image models are typically reported on average-case prompts, which understates the gap between systems on compositionally demanding requests involving precise object counts, multi-object attribute binding, legible embedded text, and explicit spatial constraints. We evaluate four production text-to-image systems: Hunyuan 3.0, Gemini 3 Pro Image ("Nano Banana Pro"), Black Forest Labs FLUX.2, and Ideogram 3.0. The evaluation uses the 48 hardest prompts drawn from the this http URL Sample Dataset (DSD), selected through an automated complexity-scoring pass over the full corpus. Every generated image is graded using an independent-judge rubric. GPT-5.4-Pro authors an atomic, weighted, mutually exclusive and collectively exhaustive (MECE) evaluation rubric, while Gemini 3.1 Pro Preview independently determines whether each criterion is satisfied. Gemini 3 Pro Image ranks first with a score of 84.8/100, narrowly ahead of FLUX.2 at 82.3/100. Ideogram 3.0 and Hunyuan 3.0 score 65.7/100 and 63.3/100, respectively. Failure analysis shows that the leading systems primarily lose points through object miscounting and geometric artifacts, whereas the trailing systems more frequently produce garbled text. Ideogram 3.0 also frequently omits requested elements. Full per-sample rubrics, scores, and failure annotations are available from the authors upon request.
211. 【2608.14952】Evidence of Absence: Cross-Modal Abductive Risk Perception to Sustain World Models When Vision Fails
链接：https://arxiv.org/abs/2608.14952
作者：Cong Xu,Ravi Sankar
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：preserve prediction-critical content, primary visual modality, presumes observations, structured world-state, predictive cues
备注： 7 pages, 3 figures. Working draft prepared for journal submission
点击查看摘要
Abstract:A structured world-state (entities, relations, context, and predictive cues) is designed to preserve prediction-critical content when perception degrades, but it presumes observations to populate it; when the primary visual modality is occluded or degraded, those observations may be missing. We address how to sustain the world model from a complementary modality by treating the absence of expected co-evidence as evidence of a hidden cause. The abductive framework is modality-agnostic; this article instantiates it acoustically. A microphone-array front-end estimates the bearing of engine and tire sources and extracts approach-rate evidence (Doppler when a stable tone exists, a broadband looming readout otherwise); the event "signature present, visual co-evidence absent" then triggers abductive inference of a hidden road user, emitting a calibrated risk advisory rather than a control command. Recoverability of the hidden state is analyzed as an identifiability question separating shared from modality-unique information, and cueing is cast as Neyman-Pearson detection under an explicit false-alarm budget. On real occluded-approach recordings at blind junctions, the method warns a mean 1.7 seconds before line-of-sight entry, matches the sustained-window variant of the published acoustic baseline's detection rate with 42% fewer false alarms, localizes to 3.4 degrees median once in view, is well calibrated (expected calibration error 0.034), and keeps hazard awareness above 0.87 under staged vision degradation that collapses a vision-only channel to 0.03. We also measure the method's limits: calibration transfers to an unseen junction almost losslessly, the signature classifier does not, and moving-ego noise is the binding deployment constraint.
212. 【2608.14942】Looks Can be Deceiving: Annotator and Reviewer Performance Across Imagery Sources in Crowd-Sourced Aerial Damage Assessment
链接：https://arxiv.org/abs/2608.14942
作者：Thomas Manzini,Priyankari Perali,Raisa Karnik,Stephen Johnson,Robin R. Murphy
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：evaluating human labeling, multi-source remotely sensed, remotely sensed imagery, empirical investigation, remotely sensed
备注： Accepted ACM HCOMP'26. 13 pages, 6 figures
点击查看摘要
Abstract:This paper presents the first known empirical investigation of annotator and reviewer performance across multi-source remotely sensed imagery, evaluating human labeling across drone, crewed aviation, and satellite views. Because existing aerial imagery datasets rely predominantly on single-source imagery, there is no currently established state of practice for efficiently allocating human labor to curate large-scale, multi-source aerial datasets. This work addresses this limitation by analyzing annotator and reviewer performance within a post-disaster building damage assessment dataset of 9 disasters, where 20041 buildings in drone, 20695 buildings in crewed aviation, and 33392 buildings in satellite imagery were labeled. These labels, provided by 187 annotators, were then refined through two successive quality-control stages: a single-reviewer pass followed by a consensus-committee review. Our analysis reveals two findings that raise questions for standard crowd-sourcing practices. First, initial annotations were revised by the final committee at rates that rise steeply from higher- to lower-resolution sources (25.27% for crewed aviation and 36.95% for satellite), with the same ordering at every observed workflow stage. Second, a single individual review reduced but did not resolve this disagreement: after review, the committee still revised 6.85% of drone, 14.05% of crewed, and 20.86% of satellite labels. These observations suggest that, in workflows like this one, uniform review allocation leaves the most residual disagreement in lower-resolution imagery. Based on this evidence, and consistent with prior work on adaptive task assignment and budget-aware quality control, this paper offers three recommendations for multi-source dataset curation.
213. 【2608.14924】PaSTel: Anchoring Histology in Spatial Transcriptomics via Multi-Scale Hierarchical Bio-Prior Contrastive Pretraining
链接：https://arxiv.org/abs/2608.14924
作者：Azim Dehghani Amirabad,Junchao Zhu,Pushpak Pati,Walid Abdelmoula,Tommaso Mansi,Rui Liao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：align histology images, links tissue morphology, motivating multimodal pretraining, molecular programs, multimodal pretraining methods
备注： This paper was accepted to the 3rd ICML 2026 Workshop on Multi-modal Foundation Models and Large Language Models for Life Sciences
点击查看摘要
Abstract:Spatial transcriptomics (ST) links tissue morphology with molecular programs, motivating multimodal pretraining methods that align histology images with gene expression. However, existing approaches suffer from two key limitations: spatially informative gene selection is often dominated by ubiquitous housekeeping genes, leading to weakly discriminative representations, and independent spot-patch alignment fails to capture spatial dependencies that are critical for tissue organization. To address these challenges, we introduce PaSTel, a hierarchical multimodal pretraining framework that integrates biological priors at three levels. At the spot level, TF-IDF reweighting is used to identify spatially informative genes; at the functional level, curated KEGG pathways serve as anchors for encoding global biological semantics; and at the regional level, spatial clustering aggregates neighboring spots to model meso-scale tissue structure. Across multiple downstream tasks, PaSTel consistently outperforms existing vision and vision-omics encoders, demonstrating that incorporating multiscale biological priors yields more informative and transferable representations for spatial transcriptomics.
214. 【2608.14922】SpIn-ViT: Designing a Sparsity-Induced Vision Transformer That Is Mechanistically Interpretable
链接：https://arxiv.org/abs/2608.14922
作者：Philip H. Lee,Parth Padalkar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision Transformers, expanded to Vision, Sparse Autoencoders, decompose internal representations, Mechanistic interpretability
备注：
点击查看摘要
Abstract:Mechanistic interpretability has recently expanded to Vision Transformers (ViTs), with Sparse Autoencoders (SAEs) increasingly used as post-hoc tools to decompose internal representations into sparse and more interpretable features. However, because post-hoc SAEs are trained on frozen representations after the ViT has already been optimized, their latent features are not directly aligned with the downstream classification objective. We introduce SpIn-ViT, a framework that jointly trains a pretrained ViT and a modified SAE end-to-end, directly aligning sparse patch-level representations with image classification. SpIn-ViT learns semantically coherent neuron activations that localize meaningful image regions while maintaining competitive predictive performance. We evaluate SpIn-ViT across nine image-classification benchmarks using classification accuracy, quantitative interpretability metrics, AI-based and Human evaluations. Compared with the previous state-of-the-art post-hoc SAE method, SpIn-ViT achieves 8.84% higher average classification accuracy, an AI-based interpretability score nearly four times as high, and a human-evaluation score more than twice as high. We further extract interpretable rule-sets using the SAE neurons to create neurosymbolic models which achieve 5.97% higher average classification accuracy while requiring a 58.8\% smaller rule-set than the neurosymbolic models created from the SOTA post-hoc SAE method.
215. 【2608.14868】Beam-Wise Statistical Background Subtraction for Static Roadside LiDAR: A Cross-Sensor Benchmark Study
链接：https://arxiv.org/abs/2608.14868
作者：Alexander Baumann,Marcel Vosshans,Thao Dang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：enabling efficient isolation, key preprocessing step, infrastructure-based LiDAR perception, dynamic traffic participants, enabling efficient
备注： Accepted for publication at the 2026 IEEE 29th International Conference on Intelligent Transportation Systems (ITSC), Naples, Italy, September 15-18, 2026
点击查看摘要
Abstract:Background subtraction is a key preprocessing step for infrastructure-based LiDAR perception, enabling efficient isolation of dynamic traffic participants without semantic annotations. However, systematic cross-sensor evaluations and reproducible studies for static roadside LiDAR are missing. This paper presents a comparative benchmark of beam-wise statistical background subtraction for statically mounted LiDAR sensors. We formulate background estimation as a per-beam temporal modeling problem and investigate complementary statistical strategies that capture dominant as well as multi-modal background structures, combined with spatial filtering in the angular and 3D domain. To enable reproducible evaluation, we introduce HighwayScene, a new multi-LiDAR dataset recorded in a static roadside setup, and extend the public CoopScenes dataset with static/dynamic point-wise annotations. Across multiple scenes and heterogeneous sensing technologies, we demonstrate that beam-wise statistical modeling provides a robust and transferable solution. Combining lightweight per-beam models with spatial consistency filtering substantially improves precision while maintaining high recall and real-time capability. All datasets, annotations, and implementations are publicly released.
216. 【2608.14854】Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognition
链接：https://arxiv.org/abs/2608.14854
作者：Chengyan Wang,Hanliang Xie,Yueyi Yang,Haoyu Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Multimodal Large, tasks remains limited, motion-centric tasks remains
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:While Multimodal Large Language Models (MLLMs) excel in general video understanding, their capability in fine-grained and motion-centric tasks remains limited. This limitation is particularly critical in micro-gesture recognition (MGR), where micro-gestures (MGs) - subtle, short-duration, and spatially localized human movements - serve as key discriminative signals for implicit affective analysis, yet are easily neglected following common prompting practices. Although MGR has been intensively studied by many discriminative approaches, the use of MLLMs for MGR is underexplored, with notably poor performance. We hypothesize that the motion-sensitive representation ability of MLLMs is constrained by their inherent single-pass forward inference, which can be substantially enhanced through carefully designed test-time guidance. Motivated by this, building on our prior findings regarding temporal insensitivity in Video LLMs, we diagnose zero-shot MGR errors in the Negative Log-Likelihood (NLL) space. We observe that MLLMs suffer from two bottlenecks: 1) insufficient localized evidence and 2) severe score biases driven by language and motion-agnostic appearances. Thus, we propose a novel test-time evidence calibration framework that improves both reasoning details and prediction reliability. Specifically, we introduce a tree search mechanism to progressively acquire localized, fine-grained visual evidence, coupled with a test-time calibration module to mitigate score biases. The multi-cue fusion module then integrates evidence from multiple cues without relying on a single cue for final prediction. Our framework achieves mean-class accuracies of 26.84\% on iMiGUE and 22.10\% on MA-52, significantly outperforming the Qwen2.5-VL baseline, which produces 16.15\% and 10.20\%, respectively. The code will be available at this https URL.
217. 【2608.14835】OvDSGG: End-to-End Open-Vocabulary Dynamic Scene Graph Generation
链接：https://arxiv.org/abs/2608.14835
作者：John Helsby,Yi Yang,Bodo Rosenhahn,Michael Ying Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video question answering, capture spatio-temporal interactions, underpin downstream tasks, Dynamic scene graphs, dynamic scene graph
备注： ECCVW'26 CONTEXTUS
点击查看摘要
Abstract:Dynamic scene graphs (DSGs) capture spatio-temporal interactions across videos as $\langle$subject, predicate, object$\rangle$ triplets, and underpin downstream tasks such as video captioning, video question answering, and action analysis. However, end-to-end dynamic scene graph generation (DSGG) methods are closed-set: they recognize only objects and predicates from a fixed training vocabulary and struggle with the long-tailed distribution of rare concepts, severely limiting their real-world applicability. Existing open-vocabulary models typically inherit pretrained large language models, resulting in multi-stage training and inference with substantial cost. We introduce OvDSGG, the first end-to-end framework for open-vocabulary DSGG. OvDSGG builds on top of an open-vocabulary Spatial Backbone and a Temporal Backbone; we further propose a Triplet Feature Extraction Module that bridges them, and a Visual-Language Alignment Module that preserves open-vocabulary recognition by learning an adaptive decision boundary in the joint visual-language feature space, without expensive knowledge distillation in existing methods. We further introduce a rigorous open-vocabulary DSGG benchmark adapted from Action Genome, with disjoint Base/Novel splits for both objects and predicates. OvDSGG significantly outperforms open-vocabulary baselines across all metrics, with zero-shot Recall@$K$ scores 10.0--20.4 percentage point higher than the next-best baseline, while on closed-set DSGG remaining competitive with state-of-the-art models. Code and benchmark are publicly available at this https URL.
218. 【2608.14822】Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models
链接：https://arxiv.org/abs/2608.14822
作者：Yanyan Zhang,Disheng Liu,Kai Ye,Chaoda Song,Xinpeng Li,Mohsen Hariri,Vikash Singh,Yu Yin,Vipin Chaudhary
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：models have improved, robotic manipulation, online disruptions, improved the flexibility, flexibility and generality
备注：
点击查看摘要
Abstract:Vision-language-action (VLA) models have improved the flexibility and generality of robotic manipulation, yet they remain fragile to online disruptions, such as changes in task goal, scene configuration, or robot state. Existing recovery methods often require failure data, policy retraining, or external corrective agents, introducing additional data requirements and execution risks. We propose Counterfactual Realignment (CoRe), a training-free framework that recovers a frozen VLA at inference time without failure data. Upon detecting a deviation, CoRe imagines how the policy would continue toward the current goal from a recent viable state, using synthesized observations in place of physical execution, and then minimally realigns the robot and scene to rejoin this imagined continuation before returning control to the policy. Recovery is therefore planned without physical trial-and-error, preserves completed task progress, and handles both mid-episode instruction changes and physical perturbations in a unified manner. Extensive experiments across multiple simulators, VLA backbones, and real-world settings show that CoRe improves success rates by up to 85.0 percentage points to near-nominal levels while reducing physical restorations by 42.2%, without policy fine-tuning or failure-specific recovery training.
219. 【2608.14811】Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks
链接：https://arxiv.org/abs/2608.14811
作者：Rowan Hussein,Mohamed Ouf
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cycle-consistent adversarial networks, finer texture drifts, misses local artifacts, consistency preserves coarse, preserves coarse layout
备注： 6 pages, 5 figures
点击查看摘要
Abstract:Teams that adopt cycle-consistent adversarial networks for unpaired image-to-image translation meet the same obstacles: adversarial training oscillates or collapses, cycle consistency preserves coarse layout while finer texture drifts, and a single discriminator judging global realism misses local artifacts. Four enhancements address these failures, and they are usually compared on output quality alone. We show that they also divide sharply by where their cost falls, and that this division, which follows from the architecture and not from any particular run, yields an adoption order for teams under a compute or latency budget. A Wasserstein objective with gradient penalty, a VGG19 perceptual loss on the cycle reconstruction, and multi-scale discriminators change training only, so a team can adopt or drop them without altering what ships. Self-attention alone persists into the deployed generator, with memory growing as the square of the feature-map size, which makes it the one component a resource-constrained team should defer. We integrate all four onto a lightly tuned baseline for horse-to-zebra translation, introduced one at a time on a fixed control and then combined, and for each we give the failure mode it targets and how it integrates. We document the collapse and reconstruction-artifact modes the baseline produced, report what visual inspection of saved samples showed for each variant, and report Fréchet Inception Distance and Kernel Inception Distance for the combined model. We specify the protocol still needed, covering the individual variants, perceptual similarity, and downstream segmentation, to rank these enhancements on measured evidence.
220. 【2608.14800】Bit-Level Triangular Content-Aware Permutation for Fragile Image Watermarking: Zero False Positive Rate, Single-Bit Sensitivity, and Arbitrary Dimension Support
链接：https://arxiv.org/abs/2608.14800
作者：Zahra Ghoraeian,Mohammad-Reza Sadeghi,Samaneh Mashhadi
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Vector Quantization, protecting image integrity, protecting image, digital document exchange, image integrity
备注： 19 pages, 4 figures, 8 tables
点击查看摘要
Abstract:With the growth of digital document exchange, protecting image integrity against attacks such as Vector Quantization (VQ) and collage has become critical. Existing methods are vulnerable to these attacks and limited to fixed image dimensions. This paper presents a novel, dimension-agnostic, fragile watermarking algorithm that enhances security and tamper localization by replacing conventional hash functions with Triangular Content-Aware Permutation (TCA). The image is combined with key-based global noise and divided into blocks. The core innovation is applying content-dependent permutation with intrinsic avalanche effect (TCA) at the bit-plane level, generating a unique content-dependent watermark. For color images, a vertical sandwich transformation merges channels, preserving inter-channel dependency with only 1.62x time increase. The "remainder merging" strategy eliminates padding constraints. Experiments on 50 grayscale and 10 color images under 18 attacks show FPR=0% and FNR=0% for 17 attacks. Salt-and-pepper noise yields negligible FNR of 0.27% (grayscale) and 0.14% (color). Average PSNR is 51.14 dB (8-bit), 75.25 dB (12-bit), and 99.33 dB (16-bit). Embedding and extraction times are 1.61 s and 1.63 s, respectively. The algorithm achieves 100% accuracy against collage, VQ, copy-move, JPEG (quality 5-95), and geometric attacks, providing a secure solution for digital forensics, medical imaging, and legal document authentication.
Comments:
19 pages, 4 figures, 8 tables
Subjects:
Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
MSC classes:
68U10, 94A60
ACMclasses:
E.3; I.4.9; K.6.5
Cite as:
arXiv:2608.14800 [cs.CR]
(or
arXiv:2608.14800v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2608.14800
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Zahra Ghoraeian [view email] [v1]
Fri, 14 Aug 2026 18:12:52 UTC (4,565 KB)
221. 【2608.14796】Zero-Shot Adaptation of Medical Vision Foundation Models for High-Frequency Micro-Ultrasound Prostate Segmentation
链接：https://arxiv.org/abs/2608.14796
作者：Ayusha Abbas,Saram Abbas,Kabita Adhikari
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Prostate cancer claims, claims a life, PSA density calculation, cancer claims, prevent disease progression
备注：
点击查看摘要
Abstract:Prostate cancer claims a life every 80 seconds. Early detection is needed to prevent disease progression, and both PSA density calculation and biopsy decisions rely on knowing the exact boundary of the gland. Conventional ultrasound at 6-12 MHz blurs this boundary, missing one in three high-risk cancers. Micro-ultrasound (29 MHz) improves resolution threefold but introduces dense acoustic speckle that obscures the outer wall; given the same image, two clinicians draw outlines differing by over 10% in area. Supervised methods are costly and generalise poorly across scanners. Can a foundation model segment the prostate with no training data? We present the first zero-shot pipeline for this modality: MedSAM, pre-trained on over 1.5 million medical images, localises the prostate; we then apply CLAHE to sharpen the outer wall, binary dilation to recover missed pixels, and Fourier smoothing (4 modes, s=1.05) to refine the boundary. MedSAM requires a spatial prompt, so we evaluate bounding-box and point-click strategies across 75 patients of the Micro-Ultrasound Prostate Segmentation dataset (2,621 slices). On the 20-patient held-out test set, the pipeline reduces mean boundary-distance error by 45% (Dice 0.749+/-0.043 to 0.865+/-0.029; HD95 217.2+/-36.9 to 120.1+/-26.1 px), reaching Dice 0.859 across the cohort. Its mean overlap shows no significant difference from the three non-expert rater groups (p0.19), while segmenting 38-52% more consistently (lower inter-patient standard deviation). Point-click prompts fail regardless of placement (best Dice=0.350), because speckle gives no stable local contrast. Only an approximate bounding box is required, so any clinic can deploy it without data collection, annotation, or retraining.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2608.14796 [cs.CV]
(or
arXiv:2608.14796v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.14796
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
222. 【2608.14790】Qwen-Video-Edit: Instruction-Based Video Editing by Repurposing an Image Editing Model
链接：https://arxiv.org/abs/2608.14790
作者：Yunpeng Bai,Yossi Gandelsman,Michaël Gharbi,Qixing Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video-pretrained generative backbones, video diffusion transformer, Instruction-based video editing, instruction-based image editing, generative backbones
备注： Project Page: [this https URL](https://yunpeng1998.github.io/Qwen-Video-Edit-Page;) Code: [this https URL](https://github.com/yunpeng1998/Qwen-Video-Edit;) Model: [this https URL](https://huggingface.co/yunpeng1998/Qwen-Video-Edit)
点击查看摘要
Abstract:Instruction-based video editing is commonly built on video-pretrained generative backbones: a video diffusion transformer is adapted, at considerable cost, to condition on a source video and an editing instruction. In this report we explore a different route and show that a strong instruction-based image editing model can edit videos by operating directly on video-VAE latents. Starting from Qwen-Image-Edit, we arrange the latent frames of a Wan~2.1 video VAE as tiles of one large virtual image, reuse the editor's image positional encoding for every tile, and bridge the two latent spaces with a pair of lightweight input/output projections warm-started from the editor's own patchify and unpatchify layers, so that at initialization a (static) video is embedded exactly as an image the model already understands. The whole system is then fine-tuned on the public Ditto-1M editing triplets, and a few denoising steps of Wan~2.2 serve as an optional temporal enhancer. We motivate the design with a chain of zero-training observations: the stock image editor already edits a video presented as a contact sheet; it is indifferent to whether the sheet's tokens come from one joint encode or from per-frame encodes stitched in latent space; and it even edits genuine video latents zero-shot to a clearly recognizable degree, leaving fine-tuning only a fidelity gap to close. Our results suggest that, despite the large investment in training video latent spaces, per-frame video latents remain close enough to the image domain that mature image editing priors transfer with minimal adaptation. Project Page: this https URL Code: this https URL Model: this https URL.
223. 【2608.14783】MegaParts: Scaling Part-Aware 3D Object Generation to 300 Parts via Token-Efficient Autoregressive Modeling
链接：https://arxiv.org/abs/2608.14783
作者：Manwen Liao,Xinyu Lian,Jian Mao,Kaixu Chen,Li Luo,Jinghao Yan,Wanshui Gan,Qiao Yu,Weitian Zhang,Chunhua Shen,Guang Chen,Bo Dai,Xudong Xu,Zhaoyang Lyu
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：essential for graphics, graphics applications, represented as coherent, coherent assemblies, assemblies of semantic
备注： 12 pages, 6 pages appendix, 13 figures, technical report
点击查看摘要
Abstract:Part-aware 3D object generation is essential for graphics applications such as controllable modeling, editing, and articulation, where objects are represented as coherent assemblies of semantic parts. However, existing part-aware generation methods, do not scale well to highly complex objects. As the number of parts increases, generating detailed geometry becomes prohibitively expensive in token length and memory. We introduce MegaParts, a scalable autoregressive 3D generation framework to address this challenge by combining structured sequence modeling with a token-efficient vector-quantized shape tokenizer. Our tokenizer learns discrete latent representations for part-level geometry by minimizing token usage subject to high-fidelity reconstruction, enabling adaptive-length tokenization based on geometric complexity. On top of this compact representation, we train a large language model to generate object bounding boxes, part bounding boxes, and part shape tokens within a unified structured sequence. Combined with efficient long-context training strategy, our token-efficient formulation scales to objects with up to 300 parts and sequence lengths up to 256k tokens. This substantially extends the scale of part-aware 3D generation while preserving compositional structure and enabling fine-grained part-level control. Our method achieves higher mesh quality than baseline autoregressive and diffusion models, showing that compressed discrete part tokens improve not only scalability but also the achievable fidelity of generated geometry. These results suggest that LLM native token-efficient autoregressive modeling is a compelling alternative to diffusion for large-scale part-aware 3D generation. The project page is available at this https URL.
224. 【2608.14778】AMPLIFAI: A Multiphase CT Dataset for Benchmarking Clinical Reasoning in LI-RADS Assessment of Liver Lesions
链接：https://arxiv.org/abs/2608.14778
作者：Pranav Kulkarni,Nikhil Shah,Amritansh Suryavanshi,Jana Delfino,James Tonascia,Jade Wong-You-Cheong,Barton Lane,Joseph Chirico,Jeffrey D. Hirsch,Ang Li,Heng Huang,Florence X. Doo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：cancer-related mortality worldwide, early detection improving, detection improving survival, Hepatocellular carcinoma, mortality worldwide
备注：
点击查看摘要
Abstract:Hepatocellular carcinoma (HCC) is the third leading cause of cancer-related mortality worldwide, with early detection improving survival from 20\% to 70\%. The standardized LI-RADS criteria establish a biopsy-free, fully imaging-based framework that can serve as a foundation for automating HCC diagnosis with artificial intelligence (AI). However, the lack of large, publicly available datasets with high-quality labels has limited the development of AI models for LI-RADS characterization. We introduce the \textbf{AMPLIFAI} dataset, the first public dataset of multiphase abdominal CT scans annotated with LI-RADS categories and segmented for three major LI-RADS features: arterial phase hyperenhancement, washout, and enhancing capsule. Following the \emph{Datasheets for Datasets} format, this paper details the dataset's composition, curation process, and annotation pipeline to facilitate transparent, reproducible research.
225. 【2608.14770】Artificial Intelligence as a Tool for Combating Child Labour: A Real-Time Edge Vision Pipeline for Child Detection and Age Estimation
链接：https://arxiv.org/abs/2608.14770
作者：Mark Nowak(Conflux Laboratory)
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：periodic household visits, child labour worldwide, Child Labour Monitoring, million children remain, giving Child Labour
备注： 39 pages, 1 figure, 13 tables
点击查看摘要
Abstract:An estimated 138 million children remain in child labour worldwide, and the monitoring systems used by affected sectors, built on periodic household visits and interviews, systematically under-detect them. We present a real-time computer-vision pipeline, built and operated solely as a research prototype, that studies the feasibility of giving Child Labour Monitoring and Remediation Systems (CLMRS) a continuous, presence-based evidence channel. The pipeline combines a multi-task person and face detector (YOLO26x backbone in the CerberusDet framework), cascaded age estimation pairing MiVOLO v2 with a child-specialist model for ages 0-12, ByteTrack tracking, ArcFace and DINOv2 re-identification, and track-level fusion producing reviewable per-person records. The detector raises person mAP@0.5 from 0.390 to 0.683 over the previous-generation baseline; the child specialist reaches 1.944 years MAE on children-only validation, where widely used open-source stacks err by 18-23 years. FP8 TensorRT compilation yields a 1.77x speedup at +0.002 years MAE, bringing the pipeline above twice real-time on embedded hardware. On 26.8 hours of proxy video the system finds 634 unique child candidates versus 285 for its predecessor. We further report a seventeen-day unattended field pilot on a farm in Zimbabwe (38.7 million frames, six cameras) evaluated against a daily attendance register: software tuning improved detection yield 36-fold, and identity consolidation under a simultaneity veto cut over-reporting from 9.1x to 1.8-3.9x with zero proven-false merges. We document training and quantisation failures alongside successes, and the data-protection and human-in-the-loop safeguards such a system requires.
226. 【2608.14768】Uncertainty Identifies Difficult Samples Across Methods: A Multi-Task Study on a Heterogeneous Skin Lesion Dataset
链接：https://arxiv.org/abs/2608.14768
作者：Leon Koole,Jiapan Guo,Matias Valdenegro-Toro
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Skin lesion classifiers, Skin lesion, lesion classifiers, confidently wrong, trusted is clinically
备注： 12 pages, 9 figures, UNSURE 2026 @ MICCAI camera ready
点击查看摘要
Abstract:Skin lesion classifiers can be confidently wrong on the cases that matter most, so knowing when a prediction should not be trusted is clinically as useful as the prediction. We study uncertainty quantification on a dataset pooled from many ISIC sources, with a shared backbone and two jointly learned heads: a binary malignant versus non-malignant head and a five-class diagnostic head. Five UQ methods (MC Dropout, DropConnect, Flipout, Deep Ensembles, DUQ) are compared on accuracy, calibration, uncertainty decomposition, and risk-coverage. Difficulty is largely method-agnostic: even methods with narrow entropy distributions rank the same samples as hard (per-sample entropy correlations of $0.54$ to $0.91$). The choice of method matters more for calibration and uncertainty decomposition, where Deep Ensembles is the clear winner, than for finding difficult cases. The ranking is also good enough that deferring the most uncertain cases removes a disproportionate share of errors, supporting uncertainty-based selective referral, evaluated here in-distribution only.
227. 【2608.14767】NARRATE: A Multimodal Real-World Australian Driving Dataset for Human-Centred Explanations in Automated Driving
链接：https://arxiv.org/abs/2608.14767
作者：Ashkan Yousefi Zadeh,Zishuo Zhu,Xiaomeng Li,Andry Rakotonirainy,Sebastien Glaser,Ronald Schroeter,Patricia Delhomme,Zahra Mehraban
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：passengers can understand, vehicles must explain, explain their decisions, Australian driving dataset, Automated vehicles
备注： Accepted at The 19th European Conference on Computer Vision (ECCV 2026) DriveX Workshop (Foundation Models for Autonomous Driving)
点击查看摘要
Abstract:Automated vehicles must explain their decisions in ways that passengers can understand, monitor, and trust. Existing language-annotated driving datasets are mostly observer-written, post-hoc, simulation-based, or generated from sensor inputs, rather than elicited from the driver performing the action. We introduce NARRATE, a multimodal real-world Australian driving dataset comprising 2,050 annotated events from 35 experienced drivers and driving instructors on public roads. Each event is grounded in synchronised visual, localisation, motion, and LiDAR streams and paired with in-vehicle and/or post-drive free-text explanations. NARRATE provides action labels, scenario-context labels spanning six high-level and 32 fine-grained categories, and span-level Situational Awareness (SA) annotations over driver explanations for Perception, Comprehension and Projection. Four benchmark tasks (SA, scenario-context, driver-action classification, and explanation generation) show that this structure is learnable from driver language, while fine-grained context recognition and explanation generation remain challenging. NARRATE paves a path towards more human-centred and domain-aware explanation models for automated driving.
228. 【2608.14766】Beyond Boundary Noise: Aggregated Aleatoric Uncertainty Fails to Capture Presence Ambiguity in 3D Lung Nodule Segmentation
链接：https://arxiv.org/abs/2608.14766
作者：Simon Baur,Arne Schernich,Ekin Böke,Wojciech Samek,Jackie Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：uncertainty theoretically designed, capture irreducible data, irreducible data ambiguity, medical image segmentation, safe clinical deployment
备注：
点击查看摘要
Abstract:Uncertainty estimation is critical for the safe clinical deployment of deep learning in medical image segmentation, with aleatoric uncertainty theoretically designed to capture irreducible data ambiguity. However, whether entropy-based measures reflect clinically meaningful ambiguity, i.e. case-level disagreement about whether a pathology is present at all, remains poorly understood. Contrary to most prior work, which focused on pixel-wise boundary disagreement, we systematically evaluate how well aleatoric uncertainty captures presence ambiguity. Our evaluation spans 3D lung nodule segmentation across four architectures with Monte Carlo dropout and deep ensembles, on LIDC-IDRI and an external validation cohort (LNDb). We find that entropy-based uncertainty maps align with boundary noise and minor drawing variation but carry insufficient discriminative signal for presence ambiguity. In contrast, a lightweight supervised ambiguity head trained on frozen segmentation features substantially outperforms all entropy-aggregation-based baselines across architectures, metrics, and both cohorts, and matches or exceeds methods that explicitly model ambiguity under disagreement supervision (Probabilistic U-Net, Annotator-Confusion 3D-UNet). A qualitative feature-space analysis shows that presence ambiguity is already encoded in the frozen encoder features of pixel-wise-trained networks, only to be discarded by the segmentation output and its entropy aggregation. Our findings expose a fundamental mismatch between the theoretical promise of aleatoric uncertainty and its practical behavior, and suggest that practitioners should not rely on entropy-based uncertainty as a proxy for clinical ambiguity in safety-critical applications.
229. 【2608.14741】PolyComp: A Polycube-based Benchmark for Compositional 3D Spatial Reasoning in Multimodal Models
链接：https://arxiv.org/abs/2608.14741
作者：Siddharth Patel
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：compositional spatial reasoning, stresses visual recognition, introduce PolyComp, spatial reasoning, procedurally generated
备注：
点击查看摘要
Abstract:We introduce PolyComp, a procedurally generated and verified benchmark that stresses visual recognition and compositional spatial reasoning. In each problem, a model must identify which of four options shows a pair of polycube components that can be combined to form a target solid. The benchmark contains 120 problems across four geometry families, and each problem has three different presentation formats using either a single image or multiple images. The random guessing baseline is 25%. Across the three presentations (360 presented problems per model), GPT-5.6 Sol with max effort attains 50.0% accuracy (95% problem-cluster CI 43.3-56.7%) at a mean cost of \$0.951 per presented problem, Claude Fable 5 with max effort attains 39.4% (33.1-46.1%) at \$0.701, and Gemini 3.1 Pro Preview with thinking level high attains 27.5% (22.8-32.5%), near the 25% random guessing baseline, at \$0.350. The observed accuracy spread across geometry families is larger than across presentation formats. We present a problem development and evaluation protocol, cost and token accounting, and release the 120 problems.
230. 【2608.14740】From Dense Prediction to Visual Editing: Structured Supervision for Unified Image and Video Creation
链接：https://arxiv.org/abs/2608.14740
作者：Zhefan Rao,Bin Zou,Haoxuan Che,Xuanhua He,Chong Hou Choi,Yanheng Li,Rui Liu,Qifeng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：follow diverse instructions, video creation requires, preserving identity, image and video, requires a model
备注：
点击查看摘要
Abstract:Unified image and video creation requires a model to follow diverse instructions while preserving identity, geometry, and temporal structure from visual context. However, semantic-only conditioning and creation-only training do not explicitly supervise the local structure needed for precise, temporally consistent editing. We therefore formulate depth and surface-normal prediction as image-form denoising targets, using these dense tasks as structured visual supervision within the same creation interface. Our framework decouples semantic interpretation from spatially aligned visual injection while sharing one multimodal diffusion transformer (MMDiT) backbone across all tasks. Mutual Context Attention (MCA), a paired-video data-construction procedure, and a progressive training curriculum then connect the learned structural cues to temporally localized editing and reference-conditioned creation. A single checkpoint obtains the highest overall score in the reported comparison of unified systems (4.15); adding dense supervision improves OpenVE Overall from 3.98 to 4.06 and Local Add from 3.92 to 4.18. These results support a deliberately bounded conclusion: perception-oriented dense supervision transfers useful structural knowledge to downstream creation, especially editing locality and preservation; we do not claim superiority as a standalone dense predictor.
231. 【2608.14731】Emergence of Transfer Learning towards Specific Identification of Alzheimer's Disease A Prospective Approach
链接：https://arxiv.org/abs/2608.14731
作者：Soumik Podder,Chandramouli Haldar
类目：Computer Vision and Pattern Recognition (cs.CV); Digital Libraries (cs.DL)
关键词：Alzheimer disease abbreviated, suffering from Alzheimer, millions of senior, versed form, form of dementia
备注：
点击查看摘要
Abstract:Worldwide, millions of senior citizens are suffering from Alzheimer disease abbreviated as AD, a well- versed form of dementia. AD is featured by amnesia, intellectual disability, and difficulty with consciousness. DL and ML models are undoubtedly explored to identify AD related patterns on large dimensional neuroimaging data but they need global optimization and are suffering from overfitting issue that might yield dissatisfactory result in testing data set. DL overcomes the issue by convolution of input image with kernel but any sudden change in the MRI image or human manipulation, limited pre- processing of the images can mislead CNN in achieving highly accurate detection. Transfer Learning (TL) has proved itself in AD diagnosis by utilizing pre-trained models on large data sets to guide novice model in a new neuroimaging dataset. This review provides an inclusive glimpse of TL implication in classification, identification including the conversion of AD. Keeping in view, we have assessed the strengths and limitations of TL in improvising diagnostic accuracy even with limited data. The uniqueness of the present review is the incorporation of explainable AI in TL based AD diagnosis system. Finally, it can be claimed that the review will guide the new re-searchers in the area of TL induced neurodegenerative disease detection.
232. 【2608.14730】IP Protection in the Era of Visual Generative AI: A Survey
链接：https://arxiv.org/abs/2608.14730
作者：Zhuan Shi,Shunchang Liu,Alireza Dehghanpour Farashah,Qian Yang,Han Yu,Cao Yang,Chaochao Chen,Yuping Yan,Yaochu Jin,Golnoosh Farnadi,Lingjuan Lyu
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：intellectual property risks, spanning the unauthorized, unauthorized learning, rapid evolution, introduced a wide
备注： 35 pages, 2 figures, 3 tables
点击查看摘要
Abstract:The rapid evolution of visual generative AI has introduced a wide range of intellectual property risks, spanning the unauthorized learning, reproduction, extraction, misuse, and redistribution of protected data and model assets. To address these risks, a growing body of technical defenses has been proposed. However, existing surveys typically organize this literature by lifecycle stage or technical mechanism, which can obscure the protective intent of different methods. This survey presents a two-dimensional taxonomy for IP protection in visual generative models. The primary axis is a Control Logic View, which classifies methods into Information Exposure Control, Generative Behavior Constraint, and Attribution Accountability according to the risk variable they regulate. The secondary axis distinguishes Data IP from Model IP as cross-cutting asset dimensions. Under this framework, we systematically review protection methods, align evaluation protocols with protection objectives, and discuss open challenges including proactive model-level safeguards, standardized evaluation, robustness against adaptive attacks, and explainable evidence. This survey aims to offer a principled, systematic, and easy-to-follow overview for both new and experienced researchers in visual generative AI IP protection.
233. 【2608.14729】Do CNNs Internally Represent Real and Fake Images Differently? A Hidden-Layer Analysis
链接：https://arxiv.org/abs/2608.14729
作者：Moumita Sen Sarma,Pascal Hitzler,Eugene Y. Vasserman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Convolutional Neural Networks, Neural Networks, Convolutional Neural, unclear whether Convolutional, fake images
备注：
点击查看摘要
Abstract:Fake/synthetic images are increasingly prevalent, but it remains unclear whether Convolutional Neural Networks (CNNs) process real and fake images in the same internal manner. This work examines the hypothesis that CNNs represent real and fake images differently, such that fake images induce different hidden-layer activation patterns even when semantic content is preserved. The hypothesis is evaluated in scene recognition settings using trained CNN models. Dense-layer activations are extracted, and neurosymbolic methods assign semantic labels to selected neurons. For each real test image, corresponding fake images are generated with similar semantic content using object-label-guided text-to-image and image-to-image generation based on Stable Diffusion variants. Paired real-fake activation patterns are then compared statistically. Additional experiments with another dataset, CNN architecture, generative model, and JPEG/blur degradation analysis assess robustness. Results suggest that fake images evoke different hidden-neuron activations, and these differences are not explained only by simple image degradation. Overall, the findings indicate that real and fake images differ in CNN hidden-layer activation behavior at least in some settings, which opens the door for follow-up work on making use of this different behavior to improve fake image detection.
234. 【2608.14727】Low Cost Two-Stage Fabric Defect Detection at the Edge
链接：https://arxiv.org/abs/2608.14727
作者：Rasel Hossen,Diptajoy Mistry,Mosaddek Hossain Kamal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains largely manual, low-income economies remains, economies remains largely, Fabric inspection, commercial vision systems
备注： 14 pages, 10 figures, 8 tables. Deployment study on NVIDIA Jetson Nano with TensorRT FP16. Includes a decomposition showing the measured 1.36x end-to-end speedup is dominated by data-path overlap rather than by the cascade. Dataset available on Roboflow Universe
点击查看摘要
Abstract:Fabric inspection in the garment industries of low-income economies remains largely manual, and commercial vision systems are priced beyond most small and medium mills. Because defects are sparse under controlled production, a natural response is a cascade: screen every frame with a cheap anomaly detector and invoke a full detector only on suspicious frames. We build such a cascade for four knit-fabric defect classes and deploy it end-to-end on an NVIDIA Jetson Nano with TensorRT FP16. Stage 1 is a compact convolutional autoencoder with decoder attention gates, an edge-weighted reconstruction loss, and feature-level distillation from a frozen YOLOv5n teacher; Stage 2 is YOLOv5n, invoked only on flagged frames. On a 249-image benchmark disjoint from detector training (20 defective, 229 non-defective), Stage 1 at a recall-prioritised threshold flags all 20 defective images (95% CI 0.83-1.00) at a false-positive rate of 49.3% (113/229), reducing false positives by 19.3% relative to a plain autoencoder (p=0.011). The parallel pipeline reaches 13.45 FPS against 9.86 FPS for a sequential YOLO-only loop. Our central finding comes from decomposing that 1.36x: 91% of it is attributable to overlapping JPEG decode with inference rather than to the cascade, which contributes only a 5.1% inference reduction at the measured forwarding rate p = 0.534. We further show that forwarding here is false-positive-limited rather than prevalence-limited - 85% of forwarded frames are false alarms - and quantify the 29-45% inference reduction attainable under tighter calibration. We report this as a caution for cascade speedups measured without controlling the data path, and position the system as AI-assisted triage rather than autonomous acceptance.
235. 【2608.14725】Spatial Attention Noise Masking for Causally Sufficient Interpretability
链接：https://arxiv.org/abs/2608.14725
作者：Benjamin Formby,Kuang-Ching Wang,D Hudson Smith
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer vision models, computer vision, interpretability, causal, interpretability methods
备注：
点击查看摘要
Abstract:We present a novel causal approach to interpretability for computer vision models that dynamically masks the input image prior to classification. The interpretability of deep learning predictions is critical in high-stakes fields such as medical imaging, security, and autonomous driving. Most interpretability methods are applied passively to already trained models, which typically result in correlational rather than causal explanations. Existing causal interpretability methods are limited to post hoc analysis, weakening the causal claims. Additionally, existing active methods generally lack explanations that explicitly assign responsibility to input features. This work proposes a spatial attention noise masking framework that provides causal explanations about the features sufficient for the prediction. The proposed framework consists of: 1) a UNet-style mask generator, and 2) a Resnet18 encoder and linear classifier that classifies both masked and unmasked versions of an input image. The generated masks are regularized to be sparse and spatially smooth, while masked image embeddings are constrained to remain consistent with embeddings from the corresponding unmasked images. The resulting masks can be interpreted as feature attribution maps that are competitive with related interpretability methods while additionally providing strong causal explanations of model predictions. Quantitative evaluations demonstrate mask faithfulness, near-baseline classification performance across five classification tasks despite substantial masking of image information, and robustness to distribution shifts such as background swapping and natural adversarial examples. Qualitative comparisons further demonstrate mask behavior and competitive interpretability relative to state-of-the-art feature attribution methods.
236. 【2608.14724】Privacy-Preserving Dataset Curation for Kuala Lumpur Urban Traffic: Grounded Vision-Language Detection with Spatial Vehicle-Context Filtering
链接：https://arxiv.org/abs/2608.14724
作者：Mohammed Abdul Al Arafat Tanzin,Rudzidatul Akmam Dziyauddin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：intelligent transportation systems, autonomous driving relies, Personally Identifiable Information, multi-modal urban traffic, Kuala Lumpur Road
备注：
点击查看摘要
Abstract:The rapid advancement of intelligent transportation systems and autonomous driving relies heavily on multi-modal urban traffic datasets. However, curating high-fidelity video imagery in complex tropical urban environments---specifically Kuala Lumpur, Malaysia---presents severe challenges for Personally Identifiable Information (PII) anonymization due to high motorcycle density, dark acrylic license plates, dynamic camera tilt, and extreme tropical glare. We propose an automated anonymization framework tailored for the Kuala Lumpur Road Dataset, captured via a mobile cycling platform at 2 FPS. We document how legacy Haar cascades and YOLOv8 fail under these conditions---generating false positives on background elements while missing rotated or occluded targets. Our architecture resolves this by integrating Grounding DINO---a zero-shot open-set vision-language transformer---with a novel Spatial Vehicle Region of Interest (ROI) Containment Engine. By requiring license plate centroids to reside within validated vehicle boundaries, the pipeline suppresses environmental false positives while automatically obfuscating faces, heads, and license plates. An initial evaluation on 1,266 frames demonstrates a $\sim$95\% success rate, with remaining failures restricted to small, heavily occluded, oblique, or ambiguous targets. Coupled with temporal persistence mechanisms and an automated quality-control auditor, the framework minimizes privacy-related false negatives while preserving scene context for downstream vision tasks. While formal legal compliance depends on broader governance procedures, this publicly available pipeline and demonstration notebook provide an auditable preprocessing stage for privacy-aware dataset curation.
237. 【2608.14723】A Vision Transformer for ECG-Based Detection of Left Ventricular Systolic Dysfunction Across Multiple Clinical Sites
链接：https://arxiv.org/abs/2608.14723
作者：Burcu Ozek,Aruna Mohan,David Vorchheimer,Daniel Weiss,Eyal Kedar,Tamar Sobol,Or Zilbershot,Fatemeh Afghah
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：heart failure develops, advanced heart failure, Reduced left ventricular, left ventricular ejection, failure develops
备注： 19 pages, 5 figures, 5 tables; includes supplementary material with 3 additional figures
点击查看摘要
Abstract:Reduced left ventricular ejection fraction (LVEF) is frequently asymptomatic and often detected only after advanced heart failure develops. Electrocardiograms are recorded routinely yet underused for this condition, because reduced LVEF has no single diagnostic waveform. We trained an ensemble of vision transformers from scratch to detect reduced LVEF ($\leq$40%) from 12-lead ECGs, analyzing each heartbeat individually, using 10,142 patients across seven sites in three US health systems. In a held-out external cohort of 4,092 patients from three geographically independent US clinical sites at a real-world reduced-LVEF prevalence of 8.72%, the model achieved an AUROC of 0.88 (95% CI 0.86-0.89), sensitivity 81.2%, specificity 81.0%, and negative predictive value 97.8%. Sensitivity remained high across sex, race, ethnicity, and comorbidity subgroups, while specificity was lower in older patients and those with atrial fibrillation or cardiomyopathy. Beat-level attention maps provided interpretability into the model's predictions, showing consistent focus on the QRS complex rather than the P wave. These findings support the potential of routine ECGs as a scalable first-pass triage step to identify patients who should undergo echocardiography for reduced ejection fraction across diverse patient populations.
238. 【2608.14722】Braided Vision Transformer for Stroke Detection in Multi-view Retinal Fundus Imaging
链接：https://arxiv.org/abs/2608.14722
作者：Aysen Degerli,Mika Hilvo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Retinal fundus imaging, fundus imaging, Retinal fundus, morbidity worldwide, emphasizing the importance
备注：
点击查看摘要
Abstract:Stroke remains a leading cause of mortality and morbidity worldwide, emphasizing the importance of its accurate and immediate assessment. Retinal fundus imaging has emerged as a promising modality for stroke assessment, as the retina reflects cerebrovascular and neurological risk factors. Contrary to conventional neuroimaging techniques, retinal fundus imaging offers a non-invasive, cost-effective, and portable alternative for rapid screening. This paper explores the feasibility of retinal fundus imaging for stroke and transient ischemic attack (TIA) detection using macula-centric and optic nerve head-centric views captured from both eyes. Our study introduces, to the best of our knowledge, the first vision transformer model for retinal fundus imaging in stroke assessment, offering a novel approach for capturing retinal patterns. Thereby, we propose the Braided Vision Transformer (BViT) model, which extracts representative features from the given multi-view images while simultaneously capturing inter-view relationships across both eyes, enabling a more informative understanding of retinal biomarkers associated with cerebrovascular events. Experiments conducted on our collected Stroke-Data dataset demonstrate that BViT achieves an AUC score of 0.75 for stroke detection, outperforming regular vision transformers.
239. 【2608.14721】AeroGround: A Comprehensive Benchmark for Aerial-Ground Collaborative Reasoning
链接：https://arxiv.org/abs/2608.14721
作者：Shenghong Yi,Lin Zhang,Muzian Li,Jiakang Yuan,Haoyu Zhang,Peng Ye,Jiayuan Fan,Huafeng Qin,Tao Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unmanned aerial vehicles, aerial vehicles, aerial-ground collaborative reasoning, Vision-language models, widely employed
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) have been widely employed in understanding and reasoning tasks for unmanned aerial vehicles (UAVs). Existing UAV benchmarks primarily focus on aerial-view scenarios. However, whether current VLMs can perform well on understanding and reasoning tasks in aerial-ground collaborative scenarios which are practical in real-world applications like rescue and infrastructure inspection remains underexplored. To address this gap, we introduce AeroGround, a comprehensive benchmark for evaluating VLMs in aerial-ground collaborative reasoning. AeroGround is built upon a simulated aerial-ground dataset containing approximately 29,000 multimodal observation groups from diverse open environments, and provides 2,250 high-quality question-answering instances covering cross-view correspondence, spatial understanding, and reasoning. Experiments on 16 pretrained VLMs, together with two domain-adapted variants, reveal a substantial gap between current models and human performance: the best model achieves an average accuracy of 54.4%, whereas humans reach 93.3%. By systematically revealing the strengths and limitations of existing models in aerial-ground collaborative reasoning, AeroGround provides a foundation for developing more capable aerial-ground collaborative embodied intelligence systems.
240. 【2608.14719】DeCo-MIL: Debiased Counterfactual Reasoning for Long-Tailed Whole Slide Image Analysis
链接：https://arxiv.org/abs/2608.14719
作者：Xiaoxiao Li,Xitong Ling,Jiawen Li,Weiming Chen,Zhenyang Cai,Xidong Wang,Tian Guan,Benyou Wang,Yonghong He
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multiple instance learning, Multiple instance, WSI analysis, MIL-based WSI analysis, weakly supervised
备注：
点击查看摘要
Abstract:Multiple instance learning (MIL) is widely used for weakly supervised whole slide image (WSI) analysis. However, under long-tailed distributions, MIL-based WSI analysis faces a nested dual long-tail: an inter-slide class long tail and an intra-slide long tail of instance-level discriminative evidence. The two long tails are coupled: tail classes have few training slides, while their limited diagnostic evidence is concentrated in a few patches and obscured by abundant within-bag redundancy. This coupling biases models toward head classes and degrades rare-class recognition. To address this, we propose DeCo-MIL for long-tailed WSI analysis, which jointly alleviates the nested dual long-tail through frequency-debiased counterfactual reasoning. For the inner long tail, DeCo-MIL clusters patches into tissue-morphology anchors, replaces each anchor with its matched normal prototype to perform a counterfactual intervention, and estimates its counterfactual contribution to the ground-truth class using class-frequency-corrected predictions. These contributions guide redundancy masking to preserve scarce discriminative instances. For the outer long tail, DeCo-MIL constructs anchor-stratified pseudo-bags from redundancy-reduced bags and combines tail-aware oversampling with consistency regularization, increasing effective supervision for tail classes while preserving tissue-morphology composition. Extensive experiments on three long-tailed WSI benchmarks demonstrate that DeCo-MIL achieves state-of-the-art performance in both tail-class recognition and overall classification.
241. 【2608.14718】VideoGAIA: A Benchmark for General AI Assistants on Agentic Video Understanding
链接：https://arxiv.org/abs/2608.14718
作者：Fan Zhang,Guangming Yao,Jinyang Wu,Hao Wu,Zheng Lian,Xinyu Geng,Jingdong Chen,Yi Yuan,Pheng-Ann Heng
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Video understanding, multimodal large language, large language models, Video, large language
备注：
点击查看摘要
Abstract:Video understanding is a fundamental task for evaluating the capabilities of multimodal large language models (MLLMs). However, existing leading models have already achieved approximately 90% accuracy on the Video-MME leaderboard, suggesting that conventional single-turn video understanding tasks are becoming increasingly saturated and insufficient for assessing the intelligence of advanced MLLMs. Towards this end, we introduce VideoGAIA, an agentic video understanding benchmark for general artificial intelligence (AI) assistants. Moving beyond one-shot video question answering, VideoGAIA formulates video understanding as a multi-turn, tool-augmented interaction process, where models must iteratively perceive videos, invoke external tools, gather complementary information, and integrate multimodal evidence across turns. VideoGAIA contains 271 model-human co-designed tasks covering diverse and complex real-world scenarios. Each video-question-answer instance is independently verified by three human experts to ensure both correctness and appropriate difficulty. All evaluated MLLMs, including frontier models such as GPT-5.5 and Kimi-K3, achieve less than 60% accuracy on VideoGAIA, highlighting its value as a high-quality and timely benchmark for evaluating next-generation MLLMs. We hope that VideoGAIA will facilitate the transition from conventional video understanding toward agentic video understanding.
242. 【2608.14717】Local Gains and Fixed-Assignment Set Losses in Shared Set Decoders
链接：https://arxiv.org/abs/2608.14717
作者：Ze Zhang,Yang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：improve the edited, edited slot, slot while reducing, reducing the utility, query-relation deletion
备注： 13 pages, 4 figures, 2 tables. An ancillary analysis-ready package supports exact aggregate reproduction without model inference. Code and reproduction package: [this https URL](https://github.com/yqjyzzz/query-interaction-reproduction)
点击查看摘要
Abstract:A query-relation deletion can improve the edited slot while reducing the utility of the prediction set that contains it. We study this tension in two related ResNet-50 DETR-family checkpoints using recorded, selection-conditional evidence from 710 paired image-relation units per checkpoint. The primary comparison subtracts a matched active control, which deletes the same leader source at a different recorded recipient, from the selected target deletion. It is therefore a composite contrast rather than a same-recipient placebo. The target-minus-control contrast is locally positive and fixed-assignment negative in both checkpoints. The opposite-sign pattern occurs within 302/710 DETR units and 460/710 DINO units. After rematching, the corresponding counts are 285/710 and 433/710. Rematching and native selection absorb enough of the mean loss for DETR intervals to cross zero, whereas DINO intervals remain negative, so persistence across readouts differs by checkpoint. A fixed-map comparison between hard deletion and a mass-preserving edit also differs before rematching. That comparison is conditional on the outcome-blind map and does not establish same-dose transport. Local intervention success therefore does not determine the consequence for a jointly decoded set. The supported conclusion is selection-conditional deletion sensitivity whose persistence depends on the readout and intervention operator. We do not identify an intervention-invariant edge mechanism, detector-level degradation, population prevalence, or the value of a training-time regularizer.
Comments:
13 pages, 4 figures, 2 tables. An ancillary analysis-ready package supports exact aggregate reproduction without model inference. Code and reproduction package: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2608.14717 [cs.CV]
(or
arXiv:2608.14717v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.14717
Focus to learn more
arXiv-issued DOI via DataCite</p>
243. 【2608.14713】SpotlessGS: Relightable 3D Gaussian Splatting under Dynamic Illumination for Robotic Perception
链接：https://arxiv.org/abs/2608.14713
作者：Liang Hong,Jiaxin Wei,Simon Schaefer,Stefan Leutenegger,Jaehyung Jung
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：poorly lit environments, lit environments rely, Robots operating, produce uneven illumination, Dark Gaussian Splatting
备注： Accepted to the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2026)
点击查看摘要
Abstract:Robots operating in dark or poorly lit environments rely on onboard lights, which often produce uneven illumination that degrades downstream perception tasks. Prior approaches based on 2D image enhancement lack reliable supervision and fail to preserve multi-view geometric consistency. To address these limitations, we extend Dark Gaussian Splatting (DarkGS) toward a more accurate and flexible relightable 3D reconstruction framework. First, we eliminate the need for explicit light parameter calibration by jointly optimizing lighting parameters within the Gaussian Splatting framework. Second, we introduce a low-frequency illumination model based on spherical harmonics (SH) to capture spatially varying residual and ambient lighting effects. Third, we incorporate an MLP-based Bidirectional Reflectance Distribution Function (BRDF) to model non-Lambertian reflectance. Experiments on synthetic and real-world datasets demonstrate that our method effectively mitigates illumination artifacts while improving rendering quality and quantitative performance over prior approaches. We further validate its benefits for robotic perception through a downstream task.
244. 【2608.14710】Path2ST: Hierarchical Cell-Tissue Grounded Cross-Modal Translation for Spatial Transcriptomics
链接：https://arxiv.org/abs/2608.14710
作者：Ruochen Liu,Wei Lou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Predicting spatial gene, stained images offers, Predicting spatial, spatial gene expression, hematoxylin and eosin
备注：
点击查看摘要
Abstract:Predicting spatial gene expression from hematoxylin and eosin (H\E)-stained images offers a cost-effective alternative to spatial transcriptomics (ST). However, existing methods treat H\E images as generic visual inputs and ignore their intrinsic biological hierarchy, where spatially organized cell types collectively form functional tissue microenvironments that govern local gene expression programs. To bridge this gap, we formulate H\E-to-ST prediction as a cross-modal semantic translation task and propose Path2ST, a hierarchically grounded autoregressive framework featuring three key components: (i) a Hierarchical Cell-Tissue Conditioning mechanism that fuses explicit and implicit cellular features with tissue-level semantic representations to construct hierarchical conditioning signals; (ii) a Scale-Adaptive Autoregressive Generation process over a hierarchical semantic vocabulary, enabling coarse-to-fine, biologically consistent expression synthesis; and (iii) SpectraLoss, a full-spectrum objective that jointly enforces ordinal fidelity, models transcriptional bursts, and aligns semantic structures with cell types. Extensive experiments on three datasets demonstrate state-of-the-art performance, validating that Path2ST generates highly accurate and spatially coherent transcriptomic profiles. The related code is released at this https URL.
245. 【2608.14708】PE-CSNet: An equivariant network architecture with learnable patch-based sparse representation
链接：https://arxiv.org/abs/2608.14708
作者：Kai Li,Haitao Long,Bo Zhang,Haiwen Zhang,Zhi Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Compressive sensing, enables accurate signal, accurate signal reconstruction, remote sensing, image compression
备注： 35 pages, 10 figures. Under review
点击查看摘要
Abstract:Compressive sensing (CS) enables accurate signal reconstruction from sparse measurements and is widely applied in medical imaging, remote sensing, and image compression. However, designing an effective, task-specific sparse transform and the corresponding optimization procedure for high-quality CS remains challenging. This process typically requires expert domain knowledge and laborious parameter tuning. To address this issue, we present a Patch-based Equivariant deep unrolling architecture, termed PE-CSNet, for accurate CS recovery. While traditional CS methods generally use predefined patch-based transform sparsity, we generalize this idea by incorporating learnable transform sparsity that adapts to the specific CS task through an optimization-driven process. Specifically, we first establish a generalized patch-based CS model, which we solve via a block coordinate descent (BCD) algorithm. The BCD solver is then unrolled into a deep neural network, where all parameters of both the CS model and solver are learned through end-to-end training. To improve data efficiency, we introduce a stochastic equivariant training strategy that exploits the patch-wise structure of the network, enabling PE-CSNet to learn effectively even from limited data. We further provide a simpler, parameter-shared version of PE-CSNet and briefly discuss its convergence as an iterative solver. For practical applications, the network uses stage-specific (non-shared) parameters to enhance its expressive power and thereby improve its performance. On the tasks of CS magnetic resonance imaging (CS-MRI) and CS coded diffraction patterns (CS-CDP), PE-CSNet achieves state-of-the-art accuracy with fast computational speed, outperforming traditional methods and existing deep unrolling methods.
246. 【2608.14706】Equilibrium Forcing: Adaptive Video Generation Without Noise Conditioning
链接：https://arxiv.org/abs/2608.14706
作者：Hansen Jin Lillemark,Alex Rojas,Zachary Novack,Runqian Wang,Yilun Du,Yian Ma,Taylor Berg-Kirkpatrick,Rose Yu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Flow Matching rely, Diffusion and Flow, Flow Matching, based on Diffusion, Matching rely
备注： Project page: [this https URL](https://equilibriumforcing.github.io/)
点击查看摘要
Abstract:Standard autoregressive video generation algorithms based on Diffusion and Flow Matching rely on rigid training objectives and static sampling schedules, limiting inference procedures from adapting to the data. We introduce Equilibrium Forcing (EqF), a simplified framework for video denoising generative models without noise level conditioning. EqF pioneers modular training- and inference-time designs for noise-unconditional generation that decouple learning the denoising field from sampling. This flexibility allows for inference-time algorithms that operate in a closed loop by adapting to feedback from the sample, improving video quality and consistency on challenging autoregressive video generation benchmarks. Extensive analysis elucidates exactly how removing the noise level conditioning enables EqF's data-dependent inference properties to surpass the performance of standard noise level-conditional denoising video methods.
247. 【2608.14705】On Cross-Validation for Hyperparameter Optimization of Deep Learning Image Classifiers
链接：https://arxiv.org/abs/2608.14705
作者：Ljubomir Buturovic(East Palo Alto, United States)
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Hyperparameter optimization, materially affect, empirical guidance, signal that drives, common in fields
备注：
点击查看摘要
Abstract:Hyperparameter optimization (HPO) can materially affect the performance of deep learning (DL) image classifiers, but there is little empirical guidance on how to derive the validation signal that drives it, especially for the small sample sizes common in fields such as medical imaging. We compared three HPO protocols in terms of {\em absolute performance-estimation error} (AEE; the absolute difference between the winning configuration's validation AUROC and its test AUROC): fixed holdout (F), reshuffled holdout (R), and 5-fold cross-validation (C). The search space, sampler, training procedure, architecture, and test set were held identical across protocols. We evaluated the protocols on three public datasets spanning two regimes: binary medical imaging (RSNA pneumonia radiographs and binarized HAM10000 skin lesions) and 200-class natural imaging (Tiny ImageNet), across a range of development set sizes $n$ and two backbones (ResNet-18 on all datasets, Vision Transformer (ViT-S/16) on RSNA). On the medical datasets, every point estimate favored cross-validation over both holdout protocols, with reductions in AEE largest at small sample sizes and diminishing as $n$ increased. This pattern remained robust under conservative family-wise adjustment. On Tiny ImageNet, AEE was negligible under all three protocols. Test AUROC was generally similar among protocols. Fixed holdout had lower mean AEE than reshuffled holdout in 11 of 12 medical conditions, although this secondary finding was less uniformly supported. For small-sample medical image classification, we recommend cross-validation-based HPO when computational resources permit because it trades additional computation for a more reliable development-time estimate of subsequent test performance.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2608.14705 [cs.CV]
(or
arXiv:2608.14705v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.14705
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
248. 【2608.14702】Deep Analog: Open-Set Film Emulation with Reference-Conditioned 3D LUTs
链接：https://arxiv.org/abs/2608.14702
作者：Yitong Mu
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：Film emulation reproduces, digital photograph, emulation reproduces, Film emulation, analog film stock
备注： Master's thesis, Rochester Institute of Technology, 2026. 24 pages, 13 figures, 6 tables. Code and demo: [this https URL](https://github.com/EtonMu/deep-analog)
点击查看摘要
Abstract:Film emulation reproduces the look of an analog film stock on a new digital photograph. We target its open-set form -- matching any reference film frame from a single example -- with a 3D lookup table (LUT) predicted from that reference. Real-time image enhancement predicts per-image weights over a fixed bank of 3D LUTs and blends them. We show this is a gated mixture of experts and inherits its failure: trained end-to-end against reconstruction, the gate collapses onto a single expert, so a bank of K LUTs delivers the capacity of one. An entropy term, the enhancement-setting analogue of mixture-of-experts load balancing, restores utilization and recovers about 1 dB PSNR. The deeper constraint survives: a fixed LUT basis is closed-set, freezing the achievable looks at training time. We therefore discard the basis and predict a single 3D LUT as a residual from a reference image (StyleLUTNet), trained by self-supervision on procedurally generated color transforms. The conditional design removes the gate and generalizes open-set to unseen film stocks without paired data or retraining. Around this color backbone we build Deep Analog, a film-emulation pipeline that adds histogram-based tone matching and a physics-informed optical renderer -- multi-scale grain and per-channel halation driven by parameters an inverse network regresses from the reference. On 350 self-supervised pairs the color stage reaches 22.05 dB PSNR / 0.925 SSIM and the full pipeline 21.72 dB / 0.923; the color path runs in 5.2 ms at 1080p (192 FPS) and exports a portable .cube LUT for standard editing tools. A second degeneracy in conditional LUT training -- residual-scale collapse -- shares the root cause and yields a general principle: auxiliary regularization must stay subordinate to reconstruction.
249. 【2608.14701】Periocular Soft Biometrics: A Survey and Applications to Multimedia Forensics and Disinformation Detection
链接：https://arxiv.org/abs/2608.14701
作者：Fernando Alonso-Fernandez,Kevin Hernandez-Diaz,Josef Bigun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：full identity recognition, valuable ancillary evidence, provide valuable ancillary, ethnicity provide valuable, full identity
备注： Accepted for publication at ECCV 2026 Workshop on AI for Multimedia Forensics Disinformation Detection (AI4MFDD2026)
点击查看摘要
Abstract:Soft-biometric attributes such as gender, age, and ethnicity provide valuable ancillary evidence when full identity recognition is not feasible, supporting applications in forensic investigation, identity verification, surveillance, or detection of synthetic and manipulated media. Among biometric modalities, the periocular region is a robust source of soft-biometric cues, as it often remains visible when other parts of the face are occluded, a frequent condition in forensic evidence and surveillance footage, and can be captured across a wide range of acquisition conditions. In this paper, we provide a survey of demographic attribute estimation from periocular images, covering publicly available datasets, methodological trends from handcrafted descriptors to deep learning architectures, and the state of the art in gender, age, and ethnicity prediction. We discuss use cases relevant to multimedia forensics and disinformation-detection applications, including demographic filtering in surveillance footage, age verification, and the detection of demographic inconsistencies in synthetic data. We also highlight open challenges, including dataset bias, cross-domain generalisation, fairness, ethical aspects, and the lack of forensic-oriented benchmarks.
250. 【2608.14700】Xemo-Talker: Unlock Emotions Explicitly for Audio-Driven Talking Portrait Synthesis
链接：https://arxiv.org/abs/2608.14700
作者：Chaolong Yang,Yinuo Guo,Kai Yao,Yuyao Yan,Jie Sun,Guangliang Cheng,Shibin Wu,Bin Dong,Kaizhu Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：audio-driven talking heads, talking heads remains, Precise emotion control, implicit emotion regulation, existing systems
备注：
点击查看摘要
Abstract:Precise emotion control in audio-driven talking heads remains a challenge due to the reliance on implicit emotion regulation in existing systems, which often leads to indirect and insufficient control. Additionally, training with explicit emotion-related losses across the entire motion space poses significant difficulties due to the inherent trade-off between accurate lip synchronization and fine-grained emotion control. In this paper, we reveal a key finding: although emotional cues are distributed throughout the motion space, concentrating discriminative supervision on less-principal components achieves a better emotion-lip synchronization balance, as principal components mainly encode high-energy articulation and pose variations. Building on this insight, we propose Xemo-Talker, which first learns a neutral speech-to-motion mapping for stable articulation and lip synchronization, and then introduces a lightweight emotion branch guided by less-principal subspace supervision. To enhance emotion control, we design a Tri-Loss consisting of inter-class separation, intra-class compactness, and less-principal contrastive learning. Given an audio input, a reference image, and an emotion label, Xemo-Talker achieves state-of-the-art emotion classification accuracy while maintaining competitive lip synchronization and high inference efficiency, with performance approaching that measured on real this http URL source code is publicly available at this https URL.
251. 【2608.14670】ARGUS: Attention-Guided Transformers for Scalable Person Identification Using Wi-Fi Telemetry
链接：https://arxiv.org/abs/2608.14670
作者：Nayan Sanjay Bhatia,Pranay Kocheta,Yuhan Li,Katia Obraczka
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：existing wireless approaches, wireless approaches rely, approaches rely largely, Channel State Information, device-free person identification
备注：
点击查看摘要
Abstract:Passive, device-free person identification offers an alternative to camera- and wearable-based biometrics, yet existing wireless approaches rely largely on gait or activity cues and are rarely evaluated at scale. In this paper, we present \emph{Argus}, a passive Wi-Fi sensing system that identifies people from commodity Channel State Information (CSI) without requiring an attached device or a prescribed motion. Argus converts short CSI spans into compact \emph{statgrams}: statistical maps built from the channel views available on a given device. A lightweight decoder-only Transformer then reads coarse statgram patches as tokens, and segment-level logit aggregation combines evidence over time. On a 154-subject CSI dataset evaluated with a strict physical-segment split, Argus reaches $78.88\% \pm 1.62\%$ Top-1 accuracy on 6-second windows and $84.85\% \pm 1.31\%$ after aggregating 19 overlapping windows over a 60-second segment; Top-3 and Top-5 reach $98.61\%$ and $99.26\%$. For a 60-second statgram, Argus improves over a raw-CSI Transformer baseline by 7.75 points while using $4.4\times$ fewer FLOPs per window. Attention-guided compression preserves full single-window accuracy with only half of the EHealth patches. On WiMANS, a multi-user benchmark across three rooms and two Wi-Fi bands, Argus remains within 1.23 percentage points of the strongest per-configuration baselines on average while using $27\times$ fewer inference FLOPs. These results show that compact CSI statistics can scale passive identification while also exposing deployment limits in open-set rejection and cross-room transfer.
252. 【2608.14657】LUNG-KGMM: Knowledge-Guided Multimodal Learning for Lung Cancer Incidence Prediction
链接：https://arxiv.org/abs/2608.14657
作者：Chunlei Yang,Shuyan Li,Zhong Cao
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Early identification, existing prediction models, lung cancer risk, single data modalities, leverage structured clinical
备注： 22 pages, 4 figures, 7 tables, accepted by PRCV Oral
点击查看摘要
Abstract:Early identification of lung cancer risk is critical for timely intervention, yet existing prediction models are limited by their reliance on single data modalities and their inability to leverage structured clinical knowledge. We propose LUNG-KGMM, a knowledge-guided multimodal framework that integrates longitudinal electronic health records, radiology reports, chest radiograph representations, and guideline-derived knowledge for 1-to-6-year incident lung cancer prediction. To address modality heterogeneity and potential data leakage, we develop a leakage-sanitized report processing pipeline and a horizon-masked cumulative training objective that handles incomplete follow-up. We further introduce a knowledge-graph representation of clinical guidance that encodes report-triggered finding-attribute-action relations as an auditable knowledge stream. We build a multimodal development cohort from the publicly available MIMIC databases and construct a real-world validation cohort from the Xiamen Medical Big Data Platform. Extensive experiments on the MIMIC cohort demonstrate that LUNG-KGMM achieves superior performance over state-of-the-art methods, and validation on the Xiamen cohort further characterizes its cross-cohort portability and the need for local adaptation. The MIMIC development cohort is publicly accessible; the Xiamen cohort is governed by local data privacy regulations.
253. 【2608.14655】Diagnosing and Mitigating Perception-Decision Misalignment in Omni-LLMs via Modality Subspace Activation
链接：https://arxiv.org/abs/2608.14655
作者：Hongbo Jiang,Jie Li,Yunhang Shen,Tianyu Xie,Pingyang Dai
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：World Action Models, Omni-Large Language Models, World Action, Action Models, power complex multi-modal
备注：
点击查看摘要
Abstract:Omni-Large Language Models (Omni-LLMs) power complex multi-modal reasoning in applications like World Action Models and autonomous agents. However, their strong performance often masks a profound Perceptual-Decision Misalignment (PDM), where decisions remain unfaithful to multi-modal perceptions. To diagnose this, we formalize Causal Modality Sensitivity (CMS), operationalized via a dual-lens framework: Answer Retention Rate (ARR) at the macro behavioral level, and Logit Angular Discrepancy (LAD) to track microscopic distribution shifts. We also curate CausalMSBench, a diagnostic dataset isolating language priors. Benchmarking reveals that popular Omni-LLMs exhibit critically low CMS, showing negligible distribution shifts even when key modalities are removed. To rectify this, we propose Modality Subspace Activation (MSA), a training-free inference-time framework that uses Singular Value Decomposition (SVD) to estimate modal activation strengths. MSA dynamically balances modal projections in the last hidden state, effectively restoring CMS across benchmarks.
254. 【2608.14652】Pushing the Limits of High-Resolution Weather Forecasting through Data Scaling
链接：https://arxiv.org/abs/2608.14652
作者：Yang Zhao,Peisong Niu,Tian Zhou,Ziqing Ma,Guanlong Ma,Rong Jin,Huiling Yuan,Liang Sun
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：circ, global weather forecasting, global weather, machine learning, based on machine
备注： Accepted by ECCV2026
点击查看摘要
Abstract:The development of 0.1$^{\circ}$ global weather forecasting models based on machine learning (ML) is constrained by the limited availability of high-resolution data, as decades of reanalysis are only available at 0.25$^{\circ}$ resolution. While existing approaches fine-tune 0.25$^{\circ}$ forecast models on limited 0.1$^{\circ}$ samples, we show that this transfer is hindered by the irreversible information loss inherent in coarse-resolution forecasting. Therefore, we propose BaguanHR, a framework that shifts the focus from transferring models to transferring data. We first show that super-resolution (SR) has lower conditional entropy and input amplification than forecasting, making it a more robust vehicle for resolution transfer. By leveraging this advantage through variable-wise SR, we synthesize extensive 0.1$^{\circ}$ data from ERA5. BaguanHR's performance on the synthetic-plus-real dataset exceeds both ML-based methods and IFS-HRES, achieving superior performance across over 85% of the lead times within 72 hours. Furthermore, our findings highlight a power-law scaling effect, as a twofold increase in data reduces RMSE by 4.6% for 72-hour forecasting and 4.9% for 120-hour forecasting. Our results demonstrate that scaling high resolution ML-based forecasting is primarily a data bottleneck, and that variable-wise super-resolution provides a simple yet general solution to unlock long coarse-resolution reanalyses for high-resolution training.
255. 【2608.14603】Extend the Safety Horizon for Intelligent Transportation Systems through Semantic-Aware Cooperative Perception
链接：https://arxiv.org/abs/2608.14603
作者：Chun-Yeow Yeoh,Chee Keong Tan,Joanne Mun-Yee Lim,Heng-Siong Lim
类目：Networking and Internet Architecture (cs.NI); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)
关键词：extending sensing coverage, mitigating blind spots, exchange sensor data, perception enables vehicles, Cooperative perception enables
备注： 16 pages, 7 figures, 6 tables, Submitted to IEEE Transactions on Intelligent Transportation Systems (T-ITS)
点击查看摘要
Abstract:Cooperative perception enables vehicles and infrastructure to exchange sensor data via Vehicle-to-Everything (V2X) communication, extending sensing coverage beyond occlusions and mitigating blind spots. While critical for autonomous driving and safety, practical deployments often rely on bandwidth-efficient late fusion. Recently, intermediate fusion has emerged as a promising approach for an optimal bandwidth-accuracy trade-off. However, in dense urban environments, cumulative bandwidth demands can overwhelm network capacity, potentially compromising safety-critical Cooperative Intelligent Transport Systems (C-ITS) functions. To alleviate these problems, this paper proposes Hierarchical Multi-Scale Semantic-Aware Cooperative Perception (HMS-SCP), a robust noise-resilient and bandwidth-efficient framework for task-oriented semantic communication in cooperative perception. HMS-SCP employs a spatial importance predictor to identify task-relevant grid elements at each scale, which are then directly mapped into complex-valued symbols for Joint Source-Channel Coding (JSCC). Unlike prior methods that rely on high-dimensional symbol projections for robustness, HMS-SCP exploits structural semantic redundancy across multiple scales to enhance resilience against channel noise, while maintaining an ultra-low symbol rate. This design significantly reduces bandwidth consumption and mitigates network congestion in high-density vehicular environments. Extensive evaluations on the simulated OPV2V and real-world DAIR-V2X datasets demonstrate that HMS-SCP effectively prevents performance collapse under severe Rayleigh fading and extreme compression ratio, maintaining high-confidence far-field detection with a real-time latency of below 16~ms, well within the safety-critical thresholds for dynamic V2X environments.
256. 【2608.14558】he Unwritten Benchmark: A New Challenge for Multimodal Machine Learning in Abstract Perceptual Reasoning
链接：https://arxiv.org/abs/2608.14558
作者：Garima Arya Yadav,Nilay Yilmaz,Yezhou Yang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated remarkable proficiency, recognizing static visual, Current multimodal models, Current multimodal, auditory content
备注： To be published in CVPR Findings 2026
点击查看摘要
Abstract:Current multimodal models have demonstrated remarkable proficiency in recognizing static visual and auditory content. However, their capacity for abstract perceptual reasoning, inferring unseen information from dynamic, generative processes, remains a critical and underexplored frontier. In this paper, we introduce The Unwritten Benchmark, a new challenge designed to probe this abstract perceptual and cognitive ability. We define the core task as acousto-kinematic word inference: models must decipher words, across 3 different writing styles, being written solely from the audio of pen scratches and the video of hand movements, without any visible ink trace. Our evaluation results reveal a profound gap between human and machine performance: while human participants achieve high ordered letter accuracy (over 80%), leading Multimodal Machine Learning Models, including GPT-4o and Gemini 2.5-Pro, struggle significantly, failing to surpass 10%. Furthermore, we identify a paradoxical fusion effect in the models, where providing both modalities often degrades performance rather than improving it. This finding indicates a fundamental breakdown in their ability to synthesize complementary perceptual cues for this cognitive task. These findings highlight significant limitations in both cross-modal causal reasoning and the understanding of the micro-kinematics essential for such cognitive and intuitive perceptual reasoning.
257. 【2608.16233】A cross-modal generative model for incomplete and degraded prostate MRI with multicentre clinical validation
链接：https://arxiv.org/abs/2608.16233
作者：Siyuan Ma,Liang He,Mengying Zhu,Yi Chai,Mengyao Lyu,Haowei Wang,Qizhen Lan,HaoBo Sun,Qixin Zhang,Jingli Chen,Xiaobing Wei,Jiaming Liu,Guiqin Liu,Qianwen Zhang,Yang Liu,Dacheng Tao,Guangyu Wu
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：limit prostate multiparametric, sequences can limit, prostate multiparametric MRI, Missing or degraded, multiparametric MRI
备注：
点击查看摘要
Abstract:Missing or degraded sequences can limit prostate multiparametric MRI. We developed MSCNet, a sequence-conditioned cross-modal generative framework for reconstructing unavailable contrasts and restoring degraded acquisitions. Across ten completion tasks, task-specific MSCNet achieved mean structural similarity of 0.818 versus 0.798 for the strongest task-matched comparators; matched-capacity analyses showed larger differences in lesion fidelity and boundary preservation. In a blinded 1,000-case reader study, overall image quality met the prespecified non-inferiority criterion for DWI, ADC and T2W completion, but not T1W. In a separate 200-case diagnostic assessment, AUCs for clinically significant cancer were 0.860 with acquired images, 0.841 with MSCNet and 0.797 with baseline-generated images. A locked 186-case three-hospital cohort supported multicentre transportability. These retrospective results support quality-controlled cross-modal reconstruction as an adjunct to acquired prostate MRI.
258. 【2608.16039】Decoupling Parcellation from Classification: Systematic Benchmark of Fast Brain Segmentation Methods for Alzheimer's Disease Detection
链接：https://arxiv.org/abs/2608.16039
作者：Jiadao Zou,Hongyu Guo,Wei Xi
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：detection performance depends, Brain parcellation, evaluated in isolation, typically evaluated, downstream AD detection
备注：
点击查看摘要
Abstract:Brain parcellation and classification are typically evaluated in isolation, yet downstream AD detection performance depends on their interaction. We decouple these components and systematically benchmark fast deep learning parcellation methods (SynthSeg+, OpenMAP-T1) against the FreeSurfer (FS-HV) clinical baseline through down- stream AD classification on OASIS-1. Our factorial design evaluates three parcellation methods, two volumetry strategies (hard vs. soft), and four classifier paradigms (clinical thresholds, supervised feedforward networks, ensemble methods, and foundation models with zero/few-shot prompting), with all results quantified using BCa Bootstrap 95% confidence intervals.
259. 【2608.15598】Underwater Color Restoration with Vanishing Uncertainty
链接：https://arxiv.org/abs/2608.15598
作者：Grigory Solomatov,Derya Akkaynak
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Underwater color restoration, scientific confidence remains, color restoration promises, Underwater color, aquatic sciences
备注：
点击查看摘要
Abstract:Underwater color restoration promises to unlock color as a reliable signal for aquatic sciences, but achieving this with scientific confidence remains out of reach. Current methods are validated almost exclusively on an empirical basis, which provides confidence only to the extent that the vast diversity of possible visibility conditions is covered with end-to-end testing using a known ground truth. This is exacerbated by color restoration being a fatally ill-posed problem when considered in full mathematical generality, requiring additional constraints to narrow the solution to a finite uncertainty interval. The gap between which constraints suffice in theory and which constraints are satisfied by real-world data is poorly understood, making it unclear whether existing methods are solving a problem that is actually solvable. In this article, we investigate the theoretical side of this gap, identifying idealized conditions which guarantee bounded uncertainty that converges to zero as the spatial resolution of the camera increases.
260. 【2608.15423】Dual-Branch State-Displacement Network for Sea Surface Temperature Super-Resolution
链接：https://arxiv.org/abs/2608.15423
作者：Wankun Chen,Feng Gao,Yanhai Gan,Chuanzheng Gong,Xun Gong,Junyu Dong,Qian Du
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Sea surface temperature, global climate change, coarse spatial resolution, satellite-derived SST imagery, fine-scale thermal structures
备注： Accepted for publication in IEEE JSTARS
点击查看摘要
Abstract:Sea surface temperature (SST) is a critical indicator of global climate change, yet satellite-derived SST imagery often suffers from coarse spatial resolution, limiting the ability to capture fine-scale thermal structures such as ocean fronts. To address this, we propose a Dual-Branch State-Displacement Network (DBSD-Net) for SST super-resolution. DBSD-Net adopts a dual-branch architecture: a wavelet frequency branch that explicitly separates low and high-frequency components via discrete wavelet transform for targeted processing, and a VGGUNet branch that extracts multi-scale semantic features from a frozen pre-trained VGG backbone. Within the wavelet branch, we introduce a Structural State Space Module (SSSM) with a Gated Structure Refinement (GSR) unit to efficiently capture long-range dependencies and enhance structural integrity, and a Displacement Gate Module (DGM) that learns a displacement field for geometry-aware modulation of high-frequency details, thereby mitigating spatially varying degradation. Experiments on multiple public SST datasets demonstrate that DBSD-Net outperforms existing state-of-the-art methods.
261. 【2608.15234】Multi-Channel Feature Fusion and Monte Carlo Dropout for Uncertainty-Aware Diabetic Retinopathy Grading
链接：https://arxiv.org/abs/2608.15234
作者：Saksham Kumar
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
关键词：Automated five-stage diabetic, five-stage diabetic retinopathy, Automated five-stage, diabetic retinopathy, five-stage diabetic
备注：
点击查看摘要
Abstract:Automated five-stage diabetic retinopathy (DR) grading requires more than high accuracy alone. Medical-grade deployment calls for lesion-aware preprocessing, ordinal predictions, calibrated uncertainty, and explainability to support reliable diagnostic systems. We present a unified pipeline that addresses these requirements using a Ben-Graham-green-channel CLAHE feature representation, an EfficientNetV2-L ordinal regressor, and Monte Carlo dropout for uncertainty-driven referral. Grad-CAM provides visual explanations aligned with clinically relevant lesions. The proposed method achieves a QWK of 91.31% on the APTOS-2019 official test split, placing it within the near-perfect agreement band (80%). At a 20% referral rate, 293 of 366 images are automatically graded with a QWK of 90.40%. More complex cases are referred for specialist assessment, demonstrating a practical trade-off among grading quality, automation, and patient safety in robust, reliable, and deployment-ready medical diagnostic systems.
Subjects:
Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Signal Processing (eess.SP)
Cite as:
arXiv:2608.15234 [eess.IV]
(or
arXiv:2608.15234v1 [eess.IV] for this version)
https://doi.org/10.48550/arXiv.2608.15234
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
262. 【2608.14829】Modality-Invariant Coarse-to-Fine Retinal Image Registration
链接：https://arxiv.org/abs/2608.14829
作者：Bo Wen,Nehal Nailesh Mehta,Melanie Tran,Dirk-Uwe Bartsch,William Freeman,Truong Nguyen
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：longitudinal disease monitoring, retinal image analysis, ophthalmic diagnosis, longitudinal disease, disease monitoring
备注： This paper is a submission to IEEE Transactions on Image Processing (TIP-40498-2026)
点击查看摘要
Abstract:Retinal image registration is essential for ophthalmic diagnosis, longitudinal disease monitoring, and multimodal retinal image analysis. Existing retinal registration methods are typically modality-dependent: they are designed or optimized either for a single imaging modality in mono-modal registration or for a fixed pair of modalities in cross-modal registration. This limits their flexibility and applicability in practical scenarios involving diverse retinal imaging modalities and different combinations of them. In this work, we propose a generalizable two-stage, modality-invariant framework for retinal image registration. First, we introduce a sparse feature-matching model driven by a universal retinal vessel segmentation to achieve robust coarse global alignment across modalities. Second, we develop a modality-invariant optical flow estimation network, termed MI-RAFT, to refine the alignment through dense local registration. Extensive experiments demonstrate that the proposed method can handle diverse combinations of commonly used retinal imaging modalities, exhibiting strong modality invariance while outperforming state-of-the-art modality-dependent registration methods.
263. 【2608.14763】Cross-Modal Ultrasound-MRI Learning for Fetal Brain Ventricular Volumetry and Abnormality Screening
链接：https://arxiv.org/abs/2608.14763
作者：Yuhao Huang,Yuanji Zhang,Yuhuan Lu,Dong Ni,P. Ellen Grant,Davood Karimi
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：fetal brain, ventricular atrial width, ultrasound relies primarily, fetal brain abnormalities, fetal brain ultrasound
备注： 17 pages, 11 figures, 6 tables
点击查看摘要
Abstract:Assessment of ventriculomegaly (VM) on fetal brain ultrasound relies primarily on measuring lateral ventricular atrial width on standard planes, which is operator-dependent and may not fully reflect the overall ventricular enlargement. Fetal brain MRI provides more reliable volumetric information but is costly and less accessible for routine use. To address these limitations, we propose VIFBA, an ultrasound video-based framework for fetal brain assessment that predicts MRI-derived lateral ventricular volume, classifies VM severity, and identifies potential non-VM fetal brain abnormalities. Our contribution is three-fold. First, we introduce a joint-embedding predictive architecture (JEPA)-inspired tube latent prediction objective that leverages spatio-temporal coherence in ultrasound videos to enhance representation learning. Second, we develop a contrastive cross-modal alignment strategy that transfers structural information from MRI to ultrasound during training, while requiring ultrasound alone at inference. Third, we augment VIFBA with a training-free vision-language model and retrieval augmentation to verify uncertain predictions and identify potential non-VM fetal brain abnormalities. We validated VIFBA on a large dataset comprising 857 cases (3,196 videos) with paired fetal brain ultrasound and MRI examinations. On held-out test data, VIFBA achieved an MAE of 0.5909 mL and Pearson correlation coefficient of 0.9907 for ventricular volume regression, 0.9400 accuracy for VM severity classification, and an F1 score of 0.7764 for multi-abnormality classification, substantially outperforming single-task baselines, video-based strong competitors, and state-of-the-art foundation models. By enabling MRI-informed volumetric assessment from routine ultrasound alone, VIFBA offers a practical and potentially broadly deployable pathway toward accurate and affordable prenatal brain screening.
264. 【2608.14759】st-Time Instance Selection for Improved Whole Slide Image Analysis
链接：https://arxiv.org/abs/2608.14759
作者：Quoc Anh Nguyen,Sunhong Park,Jin Tae Kwak
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：Slide Image, cancer diagnosis, widely studied, studied for cancer, Multiple Instance Learning
备注： Accepted at The 2nd MICCAI Workshop on Efficient Medical AI (EMA4MICCAI 2026)
点击查看摘要
Abstract:Whole Slide Image (WSI) analysis has been widely studied for cancer diagnosis. Conventionally, a gigapixel WSI is divided into small patches and processed by Multiple Instance Learning (MIL) models. However, existing MIL models typically process all patches, many of which contain redundant or non-informative tissue patterns. Although recent approaches have focused on instance selection to identify discriminative patches and reduce redundancy, these selection modules still require additional training. In this work, we propose Test-Time Instance Selection (TTIS), a training-free, plug-and-play framework that selects compact yet representative patches during inference. TTIS further incorporates a multi-view ensemble strategy to integrate distinct facets of tissue morphology, enhancing robustness. Importantly, TTIS can be seamlessly integrated into existing MIL models without retraining or architectural changes, enabling flexible deployment. Extensive evaluations across multiple benchmarks demonstrate that our approach improves or matches baseline MIL performance across a range of classification and subtyping tasks. Our implementation code is available at this https URL
265. 【2608.14758】Synthesizing Post-Acetazolamide Cerebral Blood Flow Maps from Baseline MRI in Moyamoya Using 3D Generative AI
链接：https://arxiv.org/abs/2608.14758
作者：Julia Huang,Camila Gonzalez,Rydham Goyal,Aja Zou,Sasha Alexander,Michael Moseley,Moss Y. Zhao,Gary K. Steinberg
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：impaired cerebrovascular reserve, Moyamoya disease, important hemodynamic criterion, bypass surgery, impaired cerebrovascular
备注： 25 pages. Accepted at Machine Learning for Healthcare (MLHC 2026). To appear in Proceedings of Machine Learning Research (PMLR), volume 340
点击查看摘要
Abstract:For patients with Moyamoya disease, impaired cerebrovascular reserve (CVR) is an important hemodynamic criterion for recommending extracranial-to-intracranial bypass surgery. Standard CVR assessment in this cohort uses paired arterial spin labeling (ASL) perfusion MRI acquired before and after acetazolamide (ACZ). When ACZ is contraindicated or avoided, the post-ACZ cerebral blood flow (CBF) map needed for hemodynamic assessment is unavailable. We propose CAE3D, a deterministic 3D conditional autoencoder that synthesizes post-ACZ CBF maps directly from pre-ACZ ASL input. We evaluated CAE3D against ten comparators, including deterministic and diffusion-style 3D baselines, a 2D contextual baseline, and frozen-encoder foundation-model adapters. CAE3D achieved the lowest held-out MAE (0.066), with SSIM 0.80 and PSNR 24.0 dB, and near-zero full-brain mean bias. Its MAE advantage was statistically significant over seven of eight trained-from-scratch baselines, excluding the 2D CAE_2D comparator; its SSIM and PSNR advantages were significant over all eight. Regional delta-CBF predictions compressed the dynamic range in high-response territories. These results establish the retrospective feasibility of post-ACZ CBF synthesis in patients who completed the standard two-scan protocol. Extension to ACZ-contraindicated patients, who were not represented in this cohort, requires external and prospective validation.
266. 【2608.14757】KHiM-Mamba: Injecting Pathology Knowledge into Mamba via Hidden-State Modulation for Whole Slide Image Analysis
链接：https://arxiv.org/abs/2608.14757
作者：Qixiang Zhang,Yi Li,Tianqi Xiang,Haonan Wang,Mengjiao Wei,Bo Xu,Xiaomeng Li
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Quantitative Methods (q-bio.QM)
关键词：multiple instance learning, slide image analysis, instance learning, multiple instance, image analysis
备注：
点击查看摘要
Abstract:Whole slide image analysis is commonly formulated as multiple instance learning (MIL), where instance features are contextually updated and aggregated into a slide representation, a process we term slide encoding dynamics. Recently, selective state-space models (SSM) have emerged as promising MIL architectures due to their long-sequence modeling capability and linear complexity. However, existing SSM-based MIL methods rely solely on visual features during MIL. Meanwhile, in large-scale WSIs, where sparse diagnostically decisive regions are surrounded by abundant irrelevant information, such purely vision-driven selective dynamics can misallocate state updates and readouts, causing the evolving SSM state to accumulate task-irrelevant evidence and dilute critical diagnostic cues over long scan trajectories. In this work, we propose the Knowledge-Aware Hidden-State Modulation architecture (KHiM-Mamba), which innovatively regulates Mamba's core selective state-space mechanism with explicit knowledge priors, steering slide encoding dynamics toward diagnostically meaningful evidence accumulation. Specifically, we redesign the original SSM layer to perform knowledge modulation operations during the evolution of hidden states, thereby guiding what visual evidence is accumulated and retrieved from the hidden state at each encoding step. Furthermore, we additionally introduce a local-adaptive vocabulary retrieval module that uses large language models to assign each patch fine-grained, tissue-specific semantic descriptions, enabling precise modulation across diverse tasks. Experiments on 11 public benchmarks across 4 tasks show that KHiM-Mamba consistently achieves state-of-the-art performance.
267. 【2608.14750】A Unified DINOv2-Based Framework for LVEF Estimation, GLS Dysfunction Classification, and Early Cardiotoxicity Prediction
链接：https://arxiv.org/abs/2608.14750
作者：Xiaotong Zhang,Mingyue Cui,Qing Cao,Jingming Xia
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Left ventricular ejection, global longitu-dinal strain, based dysfunction classification, provide complementary information, ventricular ejection fraction
备注： Accepted as an oral at the EchoRisk Challenge Workshop, MICCAI 2026
点击查看摘要
Abstract:Left ventricular ejection fraction (LVEF) estimation (Task 1), global longitu-dinal strain (GLS)-based dysfunction classification (Task 2), and early cardi-otoxicity prediction (Task 3) provide complementary information for cardio-oncology assessment. LVEF reflects macroscopic ventricular volume chang-es as the clinical standard, whereas GLS captures subtle myocardial defor-mation, indicating subclinical cardiotoxicity before overt LVEF decline. Fur-thermore, predicting cardiotoxicity from baseline echocardiography prior to treatment enables preventive interventions at an early stage. To address these three tasks, we employ a DINOv2-based framework with task-specific adap-tation and prediction heads. Built upon a frozen foundation encoder, the framework incorporates parameter-efficient Low-Rank Adaptation (LoRA) and temporal aggregation to learn task-specialized representations, ensuring robust generalization. Crucially, during inference, it operates in a fully cycle-detection-free and phase-free manner, requiring neither cardiac cycle seg-mentation nor explicit End-Diastolic/End-Systolic (ED/ES) annotations. Ad-ditionally, we introduce an ED/ES-guided 2D/3D hybrid multi-view regres-sion model specifically to optimize Task 1. On a patient-level split containing 1,203 training videos from 237 patients and 300 validation videos from 59 independent patients, the DINOv2-based framework achieved a mean abso-lute error (MAE) of 5.03% for Task 1, an AUC-ROC of 76.48% for Task 2, and an AUC-ROC of 70.26% for Task 3. For Task 1, the specialized ED/ES-guided model further improves performance, achieving an MAE of 4.64%. This framework demonstrates the effectiveness of foundation model repre-sentations across diverse cardio-oncology tasks and the additional benefit of physiology-guided modeling for accurate LVEF estimation.
268. 【2608.14749】Incision trajectory tracing for electrosurgical navigation by CNN-based knife contacting frames extraction method
链接：https://arxiv.org/abs/2608.14749
作者：Yu Chun Wang,Kaixu Chen,Naoto Ienaga,Yoshihiro Kuroda
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Image-guided surgical navigation, Background and Objective, identifying subsurface targets, preoperative three-dimensional model, three-dimensional model dynamically
备注：
点击查看摘要
Abstract:Background and Objective: Image-guided surgical navigation has been actively studied because of its advantage of identifying subsurface targets and critical structures, whereas it requires incision trajectories to update the preoperative three-dimensional model dynamically during the surgery. The novelty of this study is the thermal feature distinguishment of whether the electric tools contacting the tissue by Convolutional Neural Network (CNN), and the extraction of the knife contacting frames, to form incision trajectories which can meet with the requirement during the surgery. Methods: This study firstly verified that CNN can classify the thermal images of electric knife and ultrasonic cutter operations separately, and can raise the accuracy of the incision trajectories derived from the connection of the thermal intensity centroid of the frames predicted by CNN as contacting. Results: Our results obtained by employing the electric knife not only reveal a remarkably high accuracy 97.2 % in CNNs identification, but also can achieve an error reduction as high as more than 2.5 times of the incision trajectory prediction as compared to those proceeded in the conventional method. Besides electric knife, the results obtained by employing another electric tool, ultrasonic cutter, reveal a high accuracy up to 93.7 %. Conclusion: In this study, we ensured the possibility of CNN in distinguishing electric tools contacting with the tissue, and confirmed that the proposed method has not only overcome the problem of missing trajectories which usually occurs in the convolutional long-short term memory method but also achieved a remarkable improvement of the accuracy with less limitation.
269. 【2608.14709】Hardware-in-the-Loop Phase-Aware CNN for Real-Time 5G Channel Estimation
链接：https://arxiv.org/abs/2608.14709
作者：Javad Zolfaghari-Bengar,Rakibul Rony,Elisa Gomez-de-Lope,Alejandro Villena-Rodriguez,Abhinav Mahadevan,Nicolas Kourtellis
类目：ignal Processing (eess.SP); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT); Machine Learning (cs.LG)
关键词：AI-based uplink channel-estimation, O-RAN Radio Unit, presents real-time AI-based, real-time AI-based uplink, uplink channel-estimation inference
备注： This demo paper has been accepted at IEEE CSCN 2026
点击查看摘要
Abstract:This demo presents real-time AI-based uplink channel-estimation inference using data collected from a hardware-in-the-loop 5G platform. The data-collection setup integrates commercial RF signal generation, programmable channel emulation, an O-RAN Radio Unit, DU emulation, and a lightweight phase-aware convolutional neural network (CNN) that estimates the channel response directly from received DMRS signals. Unlike simulation-only evaluations, the hardware-derived dataset exposes the estimator to practical RF and system-level impairments, including calibration mismatches, synchronization imperfections, quantization effects, phase noise, and implementation-specific nonlinearities. During the demo, attendees will observe real-time CNN inference and channel reconstruction using captured hardware-generated DMRS observations and compare the proposed CNN against Least Squares (LS) and frequency-domain LMMSE baselines. The objective is to showcase a practical AI-native physical-layer inference pipeline that combines hardware-derived 5G data with real-time neural channel estimation for future 5G-Advanced and 6G systems.
