本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新626篇论文，其中：
- 自然语言处理112篇
- 信息检索15篇
- 计算机视觉109篇
自然语言处理
1. 【2607.21574】Surprisal Theory is Tautological (without Rational Grounding)
链接：https://arxiv.org/abs/2607.21574
作者：Ryan Cotterell
类目：Computation and Language (cs.CL)
关键词：language model, Surprisal theory holds, affine function, relevant language model, Surprisal theory
备注： Under "Review" at ARR
点击查看摘要
Abstract:Surprisal theory holds that the human processing difficulty of a linguistic unit in context is an affine function of its surprisal under some language model. I argue this claim is a tautology without further constraint: for any non-negative difficulty measure over units in context, there exists a language model whose surprisal is an affine function of it under mild technical conditions. Therefore, because any pattern of difficulty is consistent with some language model, without an additional constraint on the language model, surprisal theory makes no falsifiable predictions. The tautology was long obscured by an assumption implicit in two decades of psycholinguistic work---that the relevant language model is the distribution that generated the training corpus, so that improving corpus fit improves predictions of human behavior. Recent empirical work has undermined this assumption, demonstrating that better corpus models can be worse predictors of processing difficulty. I conclude that breaking the tautology requires a rationalist intervention, i.e., the relevant language model must be derived from a non-empirically motivated model of the comprehender, which could be based on, for instance, memory constraints or processing goals, and that, thus, does not depend on the behavioral data surprisal theory is meant to explain.
2. 【2607.21570】MedGame: Storytelling Gamification Empowered by Large Language Models for Medical Education
链接：https://arxiv.org/abs/2607.21570
作者：Qian Wu,Xinrong Zhou,Zizhan Ma,Kai Chen,Zheyao Gao,Xun Lin,Hongqiu Wu,Longfei Gou,Yixiao Liu,Ann Sin Nga Lau,Qi Dou
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Large Language Models, Large Language, decision-centered learning trajectory, existing systems focus, entire clinical case
备注： Work in Progress; an explorational design and study on AI+Education+Game
点击查看摘要
Abstract:Large Language Models (LLMs) show promise for medical education, but most existing systems focus on localized interactions such as question answering or single-turn feedback, rather than organizing an entire clinical case into a decision-centered learning trajectory. We introduce \textit{MedGame}, a framework that transforms static clinical cases into structured, executable storytelling games. MedGame uses a dual-engine design: a Medical Narrative Designer synthesizes case-grounded clinical storylines with states and decision nodes, while a Story Director converts them into dependency-aware multimodal orchestration plans rendered by our released interactive platform. We construct MedGame Bench, a 5,000-case benchmark and evaluation protocol for Medical Narrative Generation and Story Direction. Experiments show that task-specific fine-tuning substantially improves open-source LLMs on MedGame Bench and narrows the gap with commercial models. A pilot student study further shows that learners perceive MedGame as more engaging and useful than text-only alternatives.
3. 【2607.21557】OpenForgeRL: Train Harness-native Agents in Any Environment
链接：https://arxiv.org/abs/2607.21557
作者：Xiao Yu,Baolin Peng,Ruize Xu,Hao Zou,Qianhui Wu,Hao Cheng,Wenlin Yao,Nikhil Singh,Zhou Yu,Jianfeng Gao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Claude Code, drive multi-turn reasoning, elaborate inference harnesses, multi-turn reasoning, external systems
备注：
点击查看摘要
Abstract:Modern AI agents rely on elaborate inference harnesses such as Claude Code, Codex, and OpenClaw to drive multi-turn reasoning, tool use, and access to external systems. While powerful, these complex harnesses also make agents hard to train end-to-end with open infrastructure, whose SFT/RL stacks cannot natively express stateful, multi-process harness inference. To address this, we present OpenForgeRL, an open-source framework for training harness-based agents end-to-end in diverse environments. OpenForgeRL achieves this with a lightweight proxy that serves the harness's model calls while recording them as training data for a standard RL codebase (e.g., veRL), and a Kubernetes orchestrator that runs each rollout in its own remote container, together enabling training on any harness in any environment at scale. By decoupling training and inference, OpenForgeRL allows researchers to easily train, study, and improve agents directly in the real harnesses and environments they are deployed with. We validate our framework across diverse, complex harnesses and environments, spanning tool/claw-based agents and multimodal GUI browser- and computer-use agents. Using only hundreds to a few thousand tasks, OpenForgeClaw reaches 31.7 pass^3 and 55.9 pass@3 on ClawEval and 33.7 on QwenClawBench. OpenForgeGUI reaches 37.7 on OSWorld-Verified, 63.0 on Online-Mind2Web, and 72.3 on WebVoyager. Both outperform open baselines of similar size on nearly all benchmarks, and in the GUI setting match or surpass models several times larger. Beyond benchmarks, we analyze how harness choice (e.g., ZeroClaw, OpenClaw, Codex) and RL shape agent behavior. We find that some harnesses are substantially harder to learn than others, and that RL improves agentic reliability, such as self-verification, tool coverage, and completing multi-step plans, though critical abilities such as error recovery remain weak.
4. 【2607.21547】he Boundaries of Automation: A Theory of Persistent Human Participation
链接：https://arxiv.org/abs/2607.21547
作者：Fares Fourati,Hinrich Schütze,Eyke Hüllermeier,Iryna Gurevych
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Emerging Technologies (cs.ET); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：rapid progress, intensified the long-standing, replacing human participation, long-standing pursuit, human
备注：
点击查看摘要
Abstract:The rapid progress of AI has intensified the long-standing pursuit of automation: replacing human participation with algorithms wherever possible. Implicit in this pursuit is the assumption that humans remain in the loop only because current AI systems are not yet sufficiently capable. This paper challenges that assumption. Rather than asking how far automation can extend, we ask where its conceptual limits lie and argue that human participation may persist even with highly capable AI systems for three distinct reasons. Technical or complementarity grounds arise when humans contribute capabilities or perspectives unavailable to AI. Normative or developmental grounds arise when participation itself is valuable for human agency or learning. Most importantly, emergence grounds arise from target emergence: in some activities, the target is not fully specified in advance but instead emerges through the interaction itself. In these cases, human participation is not merely a means of improving execution but is constitutive of the target being produced. Human--AI co-construction, understood as the joint production of outcomes by humans and AI systems, is therefore not simply a temporary response to imperfect AI, but a persistent feature of activities whose objectives emerge through participation. This perspective has important implications for the limits of automation and for the design, evaluation, and ethics of future AI systems.
5. 【2607.21540】DONDO: Open w2v-BERT Speech-Recognition Base Models for African Languages
链接：https://arxiv.org/abs/2607.21540
作者：Paul Azunre
类目：Computation and Language (cs.CL)
关键词：permissively licensed automatic, self-supervised speech encoder, automatic speech recognition, licensed automatic speech, present DONDO
备注：
点击查看摘要
Abstract:We present DONDO, a family of open, permissively licensed automatic speech recognition (ASR) base models for African languages, built on the w2v-BERT 2.0 self-supervised speech encoder. DONDO comprises twenty-one monolingual models and five multilingual models spanning twenty-seven language varieties across Ghana, Sierra Leone, Nigeria, Senegal, Kenya and Zimbabwe. Models are fine-tuned primarily on read speech drawn from religious texts, which offer broad, license-clear and orthographically consistent coverage for languages that otherwise lack transcribed audio. We describe a two-step (and, for one family, three-step) learning-rate-annealed fine-tuning procedure that first adapts a shared multilingual model at a high learning rate and then anneals it to recover, and in several cases surpass, strong monolingual baselines. We further describe a lightweight language-conditioning mechanism that injects a one-hot language identity as a sequence of prefix frames prepended to the acoustic features, allowing a single multilingual checkpoint to be steered to a target language at inference. Across the five multilingual families the annealed models reach average word error rates (WER) of 10-13%, closing most of the gap to monolingual models while covering many languages in a single checkpoint. All models are released on the Hugging Face KhayaAI organisation under the Apache-2.0 license (attribution only) so that others may fine-tune them freely, including for commercial use. We provide a conservative estimate that the languages covered are spoken by on the order of one hundred million first-language speakers, and by substantially more when second-language use is included.
6. 【2607.21535】Windowed-MTP: Removing the Full-Context Draft-KV Tax at Million-Token Context
链接：https://arxiv.org/abs/2607.21535
作者：Alagappan Valliappan
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Performance (cs.PF)
关键词：Speculative decoding accelerates, decoding accelerates autoregressive, accelerates autoregressive generation, Speculative decoding, cheap draft propose
备注： 25 pages, 2 figures, 11 tables
点击查看摘要
Abstract:Speculative decoding accelerates autoregressive generation by having a cheap draft propose tokens that a target verifies in parallel. Frontier models increasingly ship a built-in Multi-Token-Prediction (MTP/NEXTN) draft head under the assumption that the draft is negligibly cheap. At million-token context this breaks: an MTP draft head typically runs full attention over the entire KV cache at every draft step, so its read grows linearly with context and comes to dominate the draft cost -- precisely where speculation is most valuable. The effect compounds with draft length (a deep native draft can turn net-negative, slower than no speculation) and sharpens under hybrid/linear-attention targets, where cheaper verification leaves the draft's full-attention read exposed. We apply a StreamingLLM-style sliding window plus attention sink to the draft's attention only (Windowed-MTP), leaving full-attention verification intact. It is training-free, drop-in, and lossless by construction: the full-attention target still decides every accepted token, so windowing changes only which tokens are proposed, never which are accepted. It bounds the draft's KV working set to a constant, dropping ~99% of KV entries at 1M. Across three architecture families (Qwen GDN-MoE 35B/122B and a Mamba2-hybrid NoPE 120B) at 1M context on a single GPU in SGLang, windowing cuts the per-decode-step cost over the shipping native MTP draft by +28% to +44%, an input-invariant margin that widens with context. Since per-token latency is this cost divided by acceptance length, at matched acceptance end-to-end decode latency improves by the same amount, and more where windowing also lifts acceptance, while preserving the target's verified output distribution. Finally, the unread draft KV -- 7.7-11% of total KV at 1M -- is reclaimed via a compact ring buffer at no acceptance or quality cost.
7. 【2607.21522】GS-Agent: Creating 4D Physical Worlds With Generative Simulation
链接：https://arxiv.org/abs/2607.21522
作者：Hongxin Zhang,Chunru Lin,Junyan Li,Zhou Xian,Tsun-Hsuan Wang,Chuang Gan
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Creating dynamic, fascinating and challenging, worlds, natural language, Creating
备注：
点击查看摘要
Abstract:Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging. Traditional computer graphics methods rely on manual creation, requiring extensive human effort to fine-tune materials, motions, and visual fidelity. Recent advances in generative foundation models have sparked interest in learning to generate such 4D worlds from large-scale data; however, existing methods still struggle to ensure physical plausibility and controllability. In this work, we take a different path by leveraging foundation models to construct an agentic system that emulates how humans traditionally create 4D worlds, yet automates the entire process. We present GS-Agent, an end-to-end multi-agent framework that integrates physics engines in the loop to generate realistic, dynamic, and controllable 4D physical worlds from natural language. Inspired by how humans build 4D worlds, GS-Agent decomposes the task into entity management, covering 3D asset curation, material tuning, placement, and motion control, and rendering configuration, including camera and lighting manipulation. Multiple agents with distinct expertise interact with the physics engine via code, seek multimodal feedback, and collaborate to iteratively construct 4D worlds that align with the given descriptions. Experimental results show that GS-Agent effectively converts natural language into diverse and physically plausible 4D worlds exhibiting rich interactions among liquids, deformable objects, and rigid bodies, while achieving cinematic camera and lighting control. We envision GS-Agent as a foundation for a new paradigm in 4D world generation, empowering creative content creation and physical AI. Project page at this https URL
8. 【2607.21498】Artificial Epanorthosis: Why large language models overuse a classical rhetorical figure, and how to mitigate it
链接：https://arxiv.org/abs/2607.21498
作者：Federico Boggia
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：years ago reappears, thousand years ago, Cicero and Quintilian, large language models, Quintilian catalogued
备注： 17 pages
点击查看摘要
Abstract:A rhetorical figure that Cicero and Quintilian catalogued two thousand years ago reappears, systematically, in the text of large language models: epanorthosis, the self-correction of the specimen «This is not a course. It is a journey of transformation». This essay argues that the overuse is a trained disposition, driven mainly by a training distribution rich in promotional prose and by preference tuning (RLHF) that rewards confident, emphatic phrasing; the left-to-right nature of generation is an amplifier rather than the root cause. Building on evidence that models diverge from human rhetorical style, and on Fontanier's classification of epanorthosis as a figure of thought, it sets out a programme that scores the figure against genre-specific human baselines through an Epanorthosis Index (density relative to the human rate). A first measurement, on three sizes of one instruction-tuned model family, finds mis-calibration by register in both directions: the models overshoot in oratory (about twofold, near threefold in Italian, concentrated in the larger tiers) and undershoot in informal question-and-answer writing, while matching humans in argument, journalism, and encyclopedic prose. Three constructive contributions follow: a survey of mitigation techniques centred on lightweight LoRA adapters; a demonstration, in Italian, that a one-line instruction cuts the figure by half to nearly three-quarters and that a supervised-fine-tuning adapter removes it almost entirely, with a scaling coefficient that dials the reduction back onto the human rate; and the argument that the target is calibration to the human rate for each genre, not elimination. It closes on the stakes: the real risk is that we begin to write like the machines.
9. 【2607.21491】What, Where, and How: Disentangling the Roles of Task, Language, and Model in Code Model Representations
链接：https://arxiv.org/abs/2607.21491
作者：Piotr Wilam
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：independently trained language, trained language models, independently trained, Python, Rust
备注： 16 pages, 11 figures, 6 tables. Code: [this https URL](https://github.com/piotrwilam/Atlas2x2) ; dataset: [this https URL](https://huggingface.co/datasets/piotrwilam/Atlas2x2)
点击查看摘要
Abstract:Do independently trained language models come to represent the same thing in the same way? We answer for code, extending a recently introduced concept-circuit extraction method to a 2x2 design -- Python and Rust crossed with Qwen2.5-Coder-7B and DeepSeek-Coder-V1-6.7B -- and measuring a complete inventory of grammatical concepts (58 Python, 57 Rust) identically in all four cells: the smallest design that separates what depends on the task, the language, and the model. The answer splits into three parts. What earns dedicated circuitry is set by the task: the models agree on which concepts receive circuits (Spearman $\rho$ = 0.638 for Python, 0.673 for Rust, both p $10^{-7}$). Where those circuits sit is set by the model: Qwen processes concepts in a late band (~L17-19), DeepSeek at L6-7, for both languages. How circuits grow across layers is also set by the model: Qwen gives its atomic concepts an early spike that DeepSeek does not. "Are circuits universal?" thus has no single answer: yes for What, no for Where and How -- universality is a property of representational content, not of computational organisation. None of this structure was fixed in advance. The agreement could have landed anywhere between independence and identity; it lands at $\rho \approx 0.65$. Rust constructs receive 2-3x more concept-specific circuitry than their Python equivalents, in both models. Both models share neurons between the languages (6/7 and 7/7 paired constructs), DeepSeek 1.94x more than Qwen -- a direction no prior result predicts. And Qwen binds nine keywords of Rust's type-and-trait machinery into one tight neuron cluster (Jaccard 0.535 vs null 0.112, p 0.001), a semantic dimension invisible in surface syntax. Ablation and linear probes confirm the circuits are functional. All claims are scoped to this 2x2; whether the per-model profile predicts a third model is the designed next test.
Comments:
16 pages, 11 figures, 6 tables. Code: this https URL ; dataset: this https URL
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2607.21491 [cs.CL]
(or
arXiv:2607.21491v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.21491
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Piotr Wilam [view email] [v1]
Thu, 23 Jul 2026 16:34:14 UTC (150 KB)
10. 【2607.21482】Agentic coding without the cloud: evaluating open-weight large language models on longitudinal data preparation tasks
链接：https://arxiv.org/abs/2607.21482
作者：Mack Nixon,Liam Wright,Yevgeniya Kovalchuk,Alison Fang-Wei Wu,Martin Danka,Andy Boyd,David Bann
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, third-party cloud-based models, widely used tools, third-party cloud-based
备注：
点击查看摘要
Abstract:Large language models (LLMs) and agents are now widely used tools in code development, with data typically sent to third-party cloud-based models. Their adoption in research using personal data is constrained by governance requirements that typically prohibit data transmission to external services. Locally deployable open-weight models offer an alternative since sensitive data never leave the local environment. We introduce an open-source framework for evaluating the efficacy of AI agents powered by open-weight LLMs on one of the most persistent bottlenecks in research on longitudinal population studies: data preparation. The framework comprises: a curated ground-truth dataset (cleaning scripts preparing six sweeps of data from a British cohort study), task definitions encompassing tasks such as category harmonization and multi-wave merging, and automated routines for evaluating the LLM-produced R code and outputted data. We benchmark LLMs across the (consumer grade) deployment spectrum to assess their efficacy in 20 data preparation tasks (creation of 102 variables). Current state-of-the-art, 31-35B parameter models almost saturated our benchmark ("average task completion" up to 87.9%). The performance of open-weight LLMs running on consumer-grade hardware shows promise of a viable path toward AI-assisted data preparation in governance-restricted research settings. Our framework is publicly available at: this https URL.
11. 【2607.21475】Error Certificates for KV-Cache Eviction via Randomized Design
链接：https://arxiv.org/abs/2607.21475
作者：Peng Xie
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Deterministic KV-cache eviction, Deterministic KV-cache, deletes the rest, importance score, score and deletes
备注：
点击查看摘要
Abstract:Deterministic KV-cache eviction keeps the top-$k$ tokens under an importance score and deletes the rest. We prove that this design cannot know what it destroyed: evicted values can be altered so that everything the serving system retains is unchanged while the true attention-output error grows arbitrarily, so no serving-time estimator of that error is consistent. Randomized eviction restores identifiability. With a Poisson-sampled tail at known inclusion probabilities, one logit offset performs the Hájek correction inside the softmax, and a survey-sampling variance estimator over the retained set becomes a per-step error certificate with 0.97 empirical coverage at no accuracy cost. On real workloads we pre-registered seven claims and lost three: question-aware eviction at 25--50\% budgets is nearly free; output log-probability predicts failure better than the certificate; certificate-gated budget escalation adds nothing. What survives is attribution: the certificate separates cache-induced from inherent failures (AUC 0.73--0.75, against 0.47--0.54 for output confidence) and schedules recomputation better than random or confidence gating. Randomization buys attribution, not prediction.
12. 【2607.21447】RUMBA: Russian User Memory Benchmark
链接：https://arxiv.org/abs/2607.21447
作者：Elizaveta Shevtsova,Inna Glebkina,Mark Baushenko,Pavel Gulyaev,Alena Fenogenova
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：
备注：
点击查看摘要
None
13. 【2607.21445】When Trivia Is Not Trivial: Everyday Knowledge Failures in Multilingual LLMs
链接：https://arxiv.org/abs/2607.21445
作者：Anna Mosolova,Djamé Seddah
类目：Computation and Language (cs.CL)
关键词：quiz shows challenge, shows challenge human, Quiz rooms, quiz shows, challenge human knowledge
备注： submitted to the ARR
点击查看摘要
Abstract:Quiz rooms, trivia nights, and quiz shows challenge human knowledge across a wide range of topics, from canonical facts to everyday culture. In this paper, we examine whether large language models (LLMs) can perform competitively in such settings, using quiz-style questions to test them on both common and niche topics. We introduce TriviaRoomQA, a multilingual benchmark designed to evaluate everyday, culturally grounded, and long-tail knowledge across 288 topics. The benchmark contains 3,300 parallel multiple-choice questions in six European languages and additional 5,340 French-only questions for a more fine-grained case study. We evaluate 30 open-weight LLMs from European, Asian, and North American providers, covering models from 7 to 70B parameters. We find that models are strong on knowledge-intensive topics such as history, geography, and mathematics, but substantially weaker on everyday popular-culture topics such as celebrities, music, movies, and news. Moreover, model performance varies across languages even for the same underlying questions, suggesting that access to factual knowledge is not always language-independent. In sum, our dataset and experiments demonstrate an important knowledge gap which is not captured by existing academic-based saturated benchmarks.
14. 【2607.21433】oken Budget Saturation and Mechanistic Early Detection of Reasoning Non-Convergence in Chain-of-Thought Models
链接：https://arxiv.org/abs/2607.21433
作者：Renuka Oladri,Niveda Jawahar,Abdirisak Mohamed
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：bimodal convergence pattern, exhibit a bimodal, reaching a conclusion, convergence pattern, reasoning models
备注：
点击查看摘要
Abstract:Chain-of-thought reasoning models such as DeepSeek-R1-Distill-Qwen-7B exhibit a bimodal convergence pattern: generations either terminate within a token budget (converged) or exhaust it without reaching a conclusion (non-converged). We characterize this phenomenon empirically, showing that converged generations achieve 90.3% accuracy on AIME 1983-2024 while non-converged ones achieve only 6.6%, with an overall convergence rate of 62.0%. We then ask whether this outcome is detectable early in the thinking chain using internal model representations. Training linear probes on hidden-state activations at token positions 50-300, we find that layer-20 activations at token 150 achieve AUC 0.608 (+-0.080, 5-fold CV), reliably above chance even at token 50. Activation probes consistently outperform behavioral baselines derived from token entropy and repetition statistics. A sweep-level permutation test yields p=0.063 (100,000 permutations), consistent with a modest signal that our sample size cannot confirm at conventional thresholds. These findings suggest that convergence fate is partially encoded in intermediate representations well before the generation ends, opening a path toward early-exit inference and adaptive compute allocation.
15. 【2607.21424】An Evaluation Framework for Structured Audio Captions Validated by Controlled Perturbations
链接：https://arxiv.org/abs/2607.21424
作者：Liang-Yuan Wu,Sripathi Sridhar,Mark Cartwright,Magdalena Fuentes
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：monolithic sentence generation, explicitly disentangle distinct, Recent advancements, automated audio captioning, disentangle distinct acoustic
备注： submitted to DCASE 2026
点击查看摘要
Abstract:Recent advancements in automated audio captioning (AAC) have shifted from monolithic sentence generation toward structured formats that explicitly disentangle distinct acoustic and semantic properties. However, evaluating this heterogeneous data remains a significant challenge. Existing caption metrics focus on flat textual outputs and fail to reliably assess multimodal attributes. To bridge this gap, we propose a multi-axis evaluation framework tailored for structured audio descriptions. Building on the AudioCards dataset, we evaluate outputs across five orthogonal axes: tag-sets, descriptions, logical reasoning, numeric measurements, and spectral profiles. Our approach combines Large Language Model (LLM) judges to capture semantic nuance with deterministic computational metrics to precisely measure acoustic deviations. To rigorously validate the reliability of this framework, we introduce a controlled perturbation testing protocol that injects typed, graded errors into groundtruth annotations. Our results demonstrate that this framework successfully distinguishes meaning-preserving paraphrases from genuine semantic and acoustic corruptions.
16. 【2607.21412】Euclid-MCP: A Model Context Protocol Server for Deterministic Logical Reasoning via Prolog
链接：https://arxiv.org/abs/2607.21412
作者：Bartolomeo Bogliolo
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Large Language Models, natural language understanding, Large Language, natural language, language understanding
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) excel at natural language understanding and generation but remain unreliable for multi-step logical reasoning, especially in safety-critical or compliance-sensitive domains. Recent neuro-symbolic approaches address this gap by coupling neural models with external symbolic engines, yet most integrations are bespoke and lack a standardized interface for tool-augmented agents. This paper presents Euclid-MCP, an open-source MCP server that provides deterministic logical reasoning via SWI-Prolog. Euclid-MCP introduces Euclid-IR, an engine-agnostic intermediate representation for Horn-clause logic that is human-readable, easy for LLMs to generate, and straightforward to compile into Prolog or alternative backends. The server exposes a compact tool interface that supports a translate-run-inspect-repair loop, enabling LLM clients to delegate inference while retaining full access to proof traces and derivation logs. We evaluate Euclid-MCP on a realistic IT security and compliance use case. Results show that while LLMs alone are sufficient on small knowledge bases, they hallucinate systematically on larger problems, whereas Euclid-MCP delivers exact answers with lower latency and more compact outputs. We argue that semantic RAG is fundamentally unsuited for rule enforcement, and that Euclid-MCP can serve as a stable, shared reasoning substrate for both RAG-based assistants and agentic systems.
17. 【2607.21405】Anti-Periodic Positional Encoding: Möbius Boundary Conditions Make In-Context Retrieval Reliable
链接：https://arxiv.org/abs/2607.21405
作者：Ji Ho Bae
类目：Computation and Language (cs.CL)
关键词：rotary positional encoding, positional encoding built, rotation plane advances, positional encoding, closed-form Dirichlet
备注： 30 pages, 12 figures
点击查看摘要
Abstract:Möbius RoPE is a rotary positional encoding built on the anti-periodic frequency ladder $\theta_i=\pi(2i+1)/N$: every rotation plane advances by an odd multiple of $\pi$ across the training context, so the positional holonomy is $-1$ and the two ends of the sequence are deterministically coupled through a closed-form Dirichlet "dipole"; to our knowledge this is the first anti-periodic boundary condition in positional encoding. We verify the theory numerically to $\sim 10^{-6}$ and pretrain 48 models spanning six 160M-class and three 410M-class arms (2B FineWeb-Edu tokens each; the hybrid arm puts Möbius frequencies on 25% of heads). Hybrid perplexity is unchanged (29.66 vs. 29.72), but needle-in-a-haystack retrieval becomes reliable: $90.3\pm5.7\%$ versus $63.3\pm31.4\%$ at context 512 ($n=6$ seeds), observed worst seed 86% versus 14%, robust variance tests $p=0.013$-$0.029$ (unadjusted), recurring at 410M (Levene $p=0.040$). Matched controls isolate the mechanism: an aperiodic ladder in the same frequency band reproduces none of the effect, and a periodic (holonomy $+1$) ladder only a fraction. Swapping trained models' frequency table back to standard RoPE (weights frozen) collapses retrieval, with damage concentrated on far needles: trained models depend on this long-range geometry. A NoPE arm is even more reliable at short context but pays a 13% perplexity tax and extrapolates worst; only the anti-periodic hybrid pairs baseline perplexity with a high reliability floor. The effect is scoped to single-needle retrieval within the training window; a one-line frequency swap thus provides zero-cost insurance against the retrieval seed lottery.
18. 【2607.21404】MemTools: A Unified Research Framework for Interoperable Agent Memory
链接：https://arxiv.org/abs/2607.21404
作者：Chengfeng Zhao,Jinhui Chen,Sirui Liang,Shizhu He,Yequan Wang,Jun Zhao,Kang Liu
类目：Computation and Language (cs.CL)
关键词：pervasive architectural fragmentation, architectural fragmentation restricts, fragmentation restricts systematic, pervasive architectural, architectural fragmentation
备注： Work in progress
点击查看摘要
Abstract:While memory systems are essential for agent architectures, pervasive architectural fragmentation restricts systematic research. Existing implementations typically couple different stages of the memory lifecycle, entangle evaluation logic with specific datasets, and provide limited support for the management of heterogeneous memory types. We introduce MemTools, an interoperability research framework that decouples memory system components from their underlying deployment environments. MemTools standardizes the memory lifecycle through declarative data contracts, enabling the interchangeable assembly of components across different systems. It orthogonally separates benchmark datasets from execution protocols to facilitate controlled assessments. Furthermore, MemTools provides a unified computational interface for coordinating symbolic, neural, and multimodal memory representations within a shared runtime. Empirical evaluations on cross-system component integration, evaluation protocol reconfiguration, and heterogeneous memory coordination demonstrate that MemTools enables systematic isolation and analysis of memory design variables. These findings suggest that MemTools provides a practical and extensible infrastructure for advancing principled research on agent memory.
19. 【2607.21391】Word meaning co-determines vowel-inherent spectral change. A corpus-based investigation of conversational Mandarin
链接：https://arxiv.org/abs/2607.21391
作者：Xiaoyun Jin,Mirjam Ernestus,R. Harald Baayen
类目：Computation and Language (cs.CL)
关键词：spontaneous conversational Mandarin, vowel-inherent spectral change, study investigates vowel-inherent, investigates vowel-inherent spectral, conversational Mandarin
备注：
点击查看摘要
Abstract:This study investigates vowel-inherent spectral change (VISC) in spontaneous conversational Mandarin. Using the generalized additive model and word embeddings from distributional semantics, we show that, when controlling for variables such as vowel duration, gender, speaker identity, co-articulation, vowel identity, and utterance position, vowel formant trajectory dynamics have word-specific components that are tied to their meaning in context: The F1 and F2 trajectories of words can be predicted from their contextualized embeddings with an accuracy that substantially exceeds a permutation baseline. Challenging modular cognitive models of speech production, these results indicate that, words' semantics co-determine the fine details of their articulation.
20. 【2607.21340】Capital Markets LLM Reliability Score (CM-LRS): From Plausible to Bankable
链接：https://arxiv.org/abs/2607.21340
作者：Prerit Ahuja
类目：Computation and Language (cs.CL)
关键词：LLM Reliability Score, Markets LLM Reliability, Capital Markets LLM, Toggle, fluent draft
备注： 23 pages. Resubmission of submit/7557765, which expired due to an arXiv system bug (confirmed in support ticket AH-199019); the overfull-box correction requested by moderators has been applied. Original submission held in moderation since 14 May 2026. Therefore, request priority review/approval
点击查看摘要
Abstract:In capital-markets workflows the question is rarely whether a large language model can produce a fluent draft, but whether the draft is bankable: defensible in front of a counter-party or a regulator, with the documents in hand. Existing methods address parts of that gap: open-domain QA benchmarks reward surface accuracy, and finance benchmarks (FinanceBench, FinQA, ConvFinQA) advance document-grounded and numerical QA but evaluate at the question-answer layer rather than the workflow outputs practitioners defend. We introduce CM-LRS, a Capital Markets LLM Reliability Score, evaluating outputs at the workflow-output layer across seven dimensions: factual accuracy, evidence traceability, numerical consistency, workflow completeness, source discipline, decision usefulness, and reviewability/auditability. Each is scored 0-5 against a rubric anchored on signals reviewers in regulated settings use; the aggregate is tunable to the workflow. We demonstrate CM-LRS on five workflows (DCM transaction-terms extraction, precedent retrieval, issuer profile synthesis, MA transaction-comparable reasoning, ECM transaction-terms extraction) over public SEC EDGAR filings, a public UK takeover release, and fictional synthetic supplements, scoring four models against four independent LLM judges spanning three model families. Three findings. First, the frontier closed-source models cluster within 0.22 points on four-judge averaged CM-LRS (Sonnet 4.6 = 4.31, Opus 4.7 = 4.30, GPT-5.5 = 4.09); all four judges place the open-weights baseline (Llama 3.3 70B = 3.15) last. Second, that gap concentrates on retrieval (2.23) and synthesis (2.15), not extraction (0.84). Third, Decision Usefulness shows the widest cross-model dispersion of any dimension (4.0 points on issuer profiling) and top-tier inter-judge agreement (mean r = 0.52). Plausibility is cheap. Bankability is the bar.
Comments:
23 pages. Resubmission of submit/7557765, which expired due to an arXiv system bug (confirmed in support ticket AH-199019); the overfull-box correction requested by moderators has been applied. Original submission held in moderation since 14 May 2026. Therefore, request priority review/approval
Subjects:
Computation and Language (cs.CL)
ACMclasses:
I.2.7; J.1
Cite as:
arXiv:2607.21340 [cs.CL]
(or
arXiv:2607.21340v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.21340
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Prerit Ahuja [view email] [v1]
Thu, 23 Jul 2026 14:10:58 UTC (30 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Capital Markets LLM Reliability Score (CM-LRS): From Plausible to Bankable, by Prerit AhujaView PDFHTML (experimental)TeX Source
view license
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-07
Change to browse by:
cs
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
21. 【2607.21332】Phonetic forced alignment for low-resource language varieties: Model training and evaluation on Chengdu Mandarin
链接：https://arxiv.org/abs/2607.21332
作者：Zhiheng Qian,Aini Li,Hai Hu,Liang Zhao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：systems lack specialized, Phonetic forced alignment, lack specialized models, existing alignment systems, alignment systems lack
备注： 5 pages, 1 figure
点击查看摘要
Abstract:Phonetic forced alignment is a key technique in phonetic research, yet existing alignment systems lack specialized models for low-resource language varieties. We address this by training text-dependent and text-independent aligners for Chengdu Mandarin using a 17-hour corpus and a custom G2P dictionary. We trained a text-dependent GMM-HMM model (Chengdu-MFA) and fine-tuned a pretrained audio encoder on frame classification with Chengdu-MFA's pseudo label for text-independent alignment (Chengdu-FC). Evaluation on an expert-annotated test set show that both methods significantly outperform Standard Mandarin baselines. Chengdu-MFA reduced average phone boundary differences by 31.8%, while Chengdu-FC achieved a 61.2% reduction. This work establishes a practical bootstrapping pipeline for developing accurate aligners for under-resourced varieties without labor- and time-intensive manual annotation.
22. 【2607.21324】GRADRAG: Cross-Component Prompt Adaptation for Coordinated Multi-Agent RAG
链接：https://arxiv.org/abs/2607.21324
作者：Paolo Pedinotti,Enrico Santus
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：employ multiple LLM, multiple LLM agents, systems increasingly employ, increasingly employ multiple, Retrieval-Augmented Generation
备注： 8 pages
点击查看摘要
Abstract:Retrieval-Augmented Generation (RAG) systems increasingly employ multiple LLM agents. Yet, most prior work optimizes components in isolation rather than coordinating improvements across the pipeline. We introduce GRADRAG, a framework for cross-component prompt adaptation that models the RAG pipeline as a computational graph and propagates structured evaluation feedback to update upstream agents. An Evaluator critiques downstream answers and supporting evidence, producing actionable feedback that a Prompt Optimizer uses to iteratively update adaptive agents, such as retrievers, graph constructors, and answerers. The Evaluator also triggers early stopping when the output is deemed satisfactory. We evaluate GRADRAG on the SQUALITY and QMSUM benchmarks under two retrieval paradigms: flat chunk-based retrieval using IRCoT-style query refinement (Trivedi et al., 2023), and graph-based retrieval that constructs and iteratively enriches an entity-relation graph from the document. Across both settings, GRADRAG consistently outperforms one-step refinement baselines that update only the final generator, achieving a 12-15 percentage point net preference margin in LLM-judged pairwise comparisons, with most gains realized within two refinement iterations.
23. 【2607.21306】AI Assistants Overassist
链接：https://arxiv.org/abs/2607.21306
作者：Verona Teo,Raghav Jain,Tobias Gerstenberg,Max Kleiman-Weiner
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：Large language models, helping users reason, Large language, language models, thought partners
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used as tutors and thought partners, helping users reason through problems. While guidance from AI assistants can scaffold thinking and foster learning, such benefits depend on how they help--for instance, intervening too early or too frequently may hinder true learning and cognitive engagement. Yet how AI systems navigate intervention decisions during problem-solving remains poorly understood. Here, we introduce Int-Bench, a simulation-based benchmark for evaluating LLM interventions during learning. Int-Bench simulates a "student" solving a problem while a "teacher" monitors the student's reasoning and decides whether, when, and how to intervene. Across three domains--code debugging, mathematics, and brain teasers--we evaluate LLM teachers on the frequency and timing of interventions, as well as their impact on both immediate task success and generalization to new problems. We also compare LLMs to humans, finding that LLMs intervene more frequently and earlier than humans. Moreover, in contrast to humans, they tend to provide complete solutions rather than targeted hints. These findings suggest that current LLM assistants often optimize for short-term success rather than supporting the reasoning processes needed for deeper learning and long-term success.
24. 【2607.21291】Adaptive Depth Sparse Framework: Similarity-Driven Resource Allocation for Pre-Trained LLMs
链接：https://arxiv.org/abs/2607.21291
作者：Yidu Wu,Xiang Wang,Kejie Zhao,Zhangchi Wang,Qinghai Guo,Xiaoying Tang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Transformer architecture incurs, architecture incurs high, Transformer architecture, achieve strong generation, Large language models
备注： Accepted by ICIC 2026. 12 pages, 2 figures, 4 tables
点击查看摘要
Abstract:Large language models (LLMs) achieve strong generation and reasoning performance, but the Transformer architecture incurs high inference cost. Existing acceleration methods often rely on task-specific fine-tuning or training from scratch, increasing adaptation cost and limiting cross-task usability. We present an Adaptive Depth Sparse Framework (AdaDSF) that converts off-the-shelf pre-trained LLMs into depth-sparse models without full retraining. Our key insight is that layers contribute unequally to representation transformation, characterized by the cosine similarity between layer input and output hidden states. Based on this, AdaDSF assigns layer-wise token retention ratios from similarity statistics, uses a lightweight router to select informative tokens at each layer, and introduces a feature-preserving alignment objective to match intermediate and final representations between sparse and dense models. On GPT-NeoX and Qwen2.5 over language modeling and commonsense reasoning, AdaDSF substantially reduces inference FLOPs while preserving performance close to dense counterparts. Under comparable sparsity, AdaDSF consistently yields smaller accuracy degradation than strong baselines including MoD, D-LLM, and DLO.
25. 【2607.21284】news-crawler-LM: A Small Long-Context Model For High-Quality News Crawling
链接：https://arxiv.org/abs/2607.21284
作者：Pascal Stolzenburg,Jonas Golde,Max Dallabetta,Alan Akbik
类目：Computation and Language (cs.CL)
关键词：Extracting structured content, pages remains challenging, remains challenging due, heterogeneous HTML layouts, inconsistent markup
备注： KONVENS 2026
点击查看摘要
Abstract:Extracting structured content from news pages remains challenging due to heterogeneous HTML layouts, inconsistent markup, and substantial boilerplate such as navigation elements and advertisements. Rule-based news crawlers can achieve high extraction accuracy by encoding site-specific structure, but require manual configuration in order to generalize to new publishers. Large language models provide a more flexible alternative by reducing the need for handcrafted rules, but their high computational cost limits practical deployment. In this paper, we introduce news-crawler-LM, a small long-context language model fine-tuned on high-quality, human-validated extractions from the Fundus news-crawling library. Our model converts raw HTML into plaintext and structured JSON, including fields such as headline, author, publication date, and article body. In our experiments, news-crawler-LM outperforms strong baselines in HTML-to-Markdown and HTML-to-JSON extraction, improving performance by +4.8 BLEU and +6.1 METEOR in the HTML-to-Markdown task, and by +2.2 BLEU and +4.1 METEOR in the HTML-to-JSON task. However, we also observe that our model only slightly better compared to other rule-based parsing libraries on the HTML-to-plaintext task in evaluations on previously unseen publishers. We release all models and artifacts to the research community.
26. 【2607.21279】A Unified Moral-Value Dataset for Instruction Tuning
链接：https://arxiv.org/abs/2607.21279
作者：Zhaohui Zeng,Florian Mai
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, language models, everyday life, instruction tuning
备注： Accepted at the 4th International Workshop on Value Engineering in AI (VALE 2026), co-located with IJCAI-ECAI 2026
点击查看摘要
Abstract:Large language models (LLMs) have developed rapidly and become valuable tools in everyday life. However, how to align LLMs to a particular set of human values is still an open problem. Recent studies show that instruction tuning has strong potential for zero-shot tasks and may serve as an effective approach to addressing value alignment. Nevertheless, although many datasets for instruction tuning already exist, they are not specifically designed around moral scenarios and behaviors. We construct a unified moral-value dataset that can be directly used for instruction tuning. This dataset is built upon existing moral-value datasets by merging them into a unified corpus and converting them into an instruction-response format. We show that training on a mixed dataset combining general task datasets with our dataset preserves general-task performance, and we report preliminary observations on how the mixing ratio affects value-oriented task performance. Our work provides a moral-value dataset for instruction tuning and offers a useful resource for further alignment research. The dataset is available at this https URL.
27. 【2607.21274】A Comparative Evaluation of Embeddings and LLMs in a Greek Book Publisher Setting - The CUP Dataset
链接：https://arxiv.org/abs/2607.21274
作者：Katerina Papantoniou,Panagiotis Papadakos,Theodore Patkos,Dimitris Garefalakis,Nikos Vardakis,Dimitris Plexousakis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：graded relevance judgments, book retrieval benchmark, retrieval benchmark consisting, catalog records, relevance judgments
备注： Preprint of a manuscript submitted to the 14th EETN Conference on Artificial Intelligence (SETN 2026)
点击查看摘要
Abstract:We present CUP, a Greek book retrieval benchmark consisting of 868 catalog records and 104 expert-annotated queries with graded relevance judgments. We evaluate sparse (BM25), dense (sentence-transformers), hybrid, and LLM-assisted retrieval methods in this book-search setting. Multilingual embeddings outperform Greek-specific models, while hybrid retrieval performs best overall. A query-level analysis shows that BM25 excels at named-entity queries, while dense and hybrid methods improve natural-language, noisy, cross-lingual, and concept queries. Field-aware prompting has model-specific effects, while LLM TOC summarization improves TOC-only retrieval and LLM post-filtering improves early-stage retrieval at a high cost. Overall, CUP enables real-world evaluation of Greek retrieval across lexical, semantic, noisy, and cross-lingual queries.
28. 【2607.21255】slang.gr as a Large-Scale Crowdsourced Resource for Non-Standard Greek
链接：https://arxiv.org/abs/2607.21255
作者：Panagiotis Papadakos,Katerina Papantoniou,Dimitris Plexousakis
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：non-standard nature makes, reflecting linguistic creativity, social identity, cultural change, model computationally
备注： Preprint of a paper accepted for publication in the Proceedings of the 14th EETN Conference on Artificial Intelligence (SETN 2026)
点击查看摘要
Abstract:Slang is a central component of everyday language, reflecting linguistic creativity, social identity, and cultural change, yet its dy- namic and non-standard nature makes it difficult to model computationally. We present the first large-scale computational study of this http URL, a crowdsourced lexicon of Greek non-standard language, combining lexical content, user-generated tags, and interaction data. To enable the systematic analysis, we map noisy folksonomic tags to a structured multi-layer taxonomy capturing both semantic categories and sociolinguistic metadata. Using this representation, we analyze the linguistic structure of Greek slang and the behavior of its contributor community. We find that slang is strongly centered on person-related and evaluative language, exhibits high morphological creativity, and is shaped by highly skewed participation with short user lifespans and overlapping communities. Building on these signals, we introduce a community-based confidence score for definitions that integrates user roles, interaction patterns, and moderation signals. Our results show that taxonomy-based representations improve interpretability while retaining meaningful aspects of behavioral structure, enabling a more structured and interpretable analysis of confidence signals. Overall, this work establishes this http URL as a computational resource for non-standard Greek and provides a foundation for sociolinguistic NLP, bias analysis, and the study of informal language in LLMs.
29. 【2607.21231】Progressive Cramming: Reliable Token Compression and What It Reveals
链接：https://arxiv.org/abs/2607.21231
作者：Dmitrii Tarasov,Timofei Lashukov,Elizaveta Goncharova,Andrey Kuznetsov
类目：Computation and Language (cs.CL)
关键词：residual errors reflect, Token cramming compresses, errors reflect optimization, reflect optimization failures, fixed token budgets
备注：
点击查看摘要
Abstract:Token cramming compresses sequences into learned embeddings with near-perfect reconstruction, but fixed token budgets and 99\% accuracy thresholds leave it unclear whether residual errors reflect optimization failures or fundamental limits. We introduce progressive cramming, which grows the target prefix token-by-token, stopping only when reconstruction is no longer achievable within a fixed optimization budget. Progressive trajectories occupy low-dimensional structure in embedding space. Prepending a crammed embedding causes a moderate but consistent accuracy drop on multiple-choice benchmarks even with the original prefix in context, and collapses capability almost entirely under generative evaluation. Causal attention-knockout interventions trace this degradation to the embedding's interactions in the model's early layers. These results position progressive cramming as a tool for studying compression limits and show that perfect reconstruction - achievable through brittle steering rather than transferable semantics - is insufficient for meaningful compression.
30. 【2607.21143】One More Turn, Less Regret: A Regret-Based Multi-Turn Benchmark for LLMs' Clarification Policies
链接：https://arxiv.org/abs/2607.21143
作者：Minh Ngoc Ta,My Anh Tran Nguyen,Duong D. Nguyen,Yuxia Wang,Preslav Nakov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：conversational LLM assistants, Ambiguous user requests, LLM assistants, conversational LLM, sequential decision problem
备注：
点击查看摘要
Abstract:Ambiguous user requests make clarification a sequential decision problem for conversational LLM assistants: they must decide whether to ask, what to ask, when to stop, and when to answer. We introduce RegretBench, a multi-turn benchmark that evaluates clarification as policy behavior rather than isolated question quality. RegretBench provides a hidden-intent formulation of ambiguity, supports free-form interaction grounded in semantic-state tracking, and introduces a regret-based objective that measures how much value a model loses relative to a reference clarification policy. Experiments on open-domain QA and product recommendation scenarios show that final success alone is insufficient, as models with similar accuracy can differ substantially in efficiency, robustness to user behaviors, and stopping decisions. By jointly measuring intent resolution, interaction cost, ineffective clarification, and regret, RegretBench reveals whether models clarify usefully and efficiently. Our results show that effective clarification requires more than plausible questions: models must ask the right question at the right time and stop once the user's intended meaning is clear.
31. 【2607.21090】raining Large Language Models for Self-Explanation Faithfulness
链接：https://arxiv.org/abs/2607.21090
作者：Yeoktatt Cheah,María Pérez-Ortiz,Noah Y. Siegel,Oana-Maria Camburu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Reinforcement Learning, internal decision-making process, propose a Reinforcement, directly optimize, decision-making process
备注： To appear at the ICLR 2026 Workshop on Representational Alignment (Re-Align), 10 pages (long paper)
点击查看摘要
Abstract:We propose a Reinforcement Learning (RL) method to directly optimize the faithfulness of self-explanations - the extent to which a model's generated reasoning accurately reflects its internal decision-making process. While existing work focuses on evaluating faithfulness or using inference-time prompting frameworks to improve an LLM's self-explanation's tractability, these approaches do not provide a mechanism to directly optimize a model's parameters to generate faithful self-explanations. We bridge this gap by modifying existing faithfulness metrics into an RL training objective. We investigate (1) if models can be trained to accurately detect factors that affect their decisions, and (2) whether RL can directly optimize for the disclosure of these factors thereby improving LLM self-explanations' faithfulness. We experiment with two intervention types: random-word insertions and user-bias insertions, using a per-sample reward derived from the Phi-CCT correlation metric. RL fine-tuned Llama3.1-8B and Qwen3-8B show substantial improvements on the Phi-CCT faithfulness metric, with in-distribution scores rising from near-zero to as high as 0.664, and out-of-distribution scores reaching up to 0.691 on held-out tasks such as StrategyQA. Cross-intervention generalization is weaker but more interesting: a priori we would not expect a model trained only on random word insertions to generalize to user-bias phrases, yet Llama3.1-8B shows non-zero transfer in this direction. The reverse direction and Qwen3-8B do not replicate this, indicating model-dependent and setup-dependent effects we cannot yet explain. Lastly we analyze model behavior to rule out reward gaming behaviors that often plague RL training. Ultimately, we show that models can be trained to implicitly identify influential factors and disclose them, offering a scalable path toward reducing unfaithful reasoning in LLMs.
32. 【2607.21075】VibeVoice-ASR-BitNet Technical Report
链接：https://arxiv.org/abs/2607.21075
作者：Songchen Xu,Ting Song,Shaohan Huang,Zhiliang Peng,Yan Xia,Yujie Tu,Xin Huang,Jianwei Yu,Li Dong,Furu Wei
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：compressed variant, variant of VibeVoice-ASR, VibeVoice-ASR optimized, VAE acoustic tokenizer, edge CPUs
备注： Technical Report
点击查看摘要
Abstract:We present VibeVoice-ASR-BitNet, a compressed variant of VibeVoice-ASR optimized for real-time inference on edge CPUs. We apply heterogeneous quantization tailored to the computational characteristics of each stage: the VAE acoustic tokenizer uses full-pipeline INT8 quantization (I8_S) with kernel fusion and SIMD optimization, while the autoregressive language model adopts BitNet-style ternary weights (I2_S). To preserve accuracy under aggressive compression, we employ a progressive quantization-aware training strategy. For inference, we implement custom SIMD kernels and fused operators within the ggml framework targeting both ARM and x86 platforms, achieving real-time recognition with RTF 1 using as few as 3 CPU threads. VibeVoice-ASR-BitNet is 1.6-2.3x faster than this http URL at comparable model sizes (~1.6 GB), with only modest accuracy degradation compared to the FP16 baseline.
33. 【2607.21067】PrefReward: Learning User Preference Matrix for Personalized Text Generation
链接：https://arxiv.org/abs/2607.21067
作者：Yue Wu,Chengbing Wang,Yimeng Bai,Xiaoyan Zhao,Yang Zhang,Fuli Feng
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, demonstrated remarkable ability, generating personalized content, leveraging user histories
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) have demonstrated remarkable ability in generating personalized content by leveraging user histories and contextual cues. However, most existing personalization approaches rely on implicit representations within model parameters, making it difficult to interpret user-specific preferences or effectively handle long-context dependencies. To address these challenges, we propose PrefReward, a novel preference-aware generative framework that explicitly models user styles through a structured preference matrix and integrates it into the decoding process as a reward signal. PrefReward consists of two stages: (1) extracting a user-specific preference matrix that summarizes individual stylistic tendencies, and (2) using the matrix to guide generation via a KL-divergence-based reward function. Experiments on the LongLaMP dataset show that PrefReward outperforms non-personalized and retrieval-based baselines in both generation quality and personalization interpretability.
34. 【2607.21063】QuantiBias: Benchmarking Quantization-Induced Bias in LLMs
链接：https://arxiv.org/abs/2607.21063
作者：Emilio Ferrara
类目：Computation and Language (cs.CL); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：trained in full, compressed for efficiency, broad audience, large language model, large language
备注： Benchmark protocol on Hugging Face: [this https URL](https://huggingface.co/datasets/emilioferrara/quantibias)
点击查看摘要
Abstract:Almost every large language model that reaches a broad audience is quantized: trained in full precision, then compressed for efficiency. This step is assumed harmless and its safety is rarely re-checked. We find its principal side effect is increased bias that standard safety evaluation misses. Holding the model, its training, and the prompts fixed, a quantized model still refuses harmful requests, still avoids over-refusing benign prompts, and still selects the unbiased multiple-choice answer. Yet asked an open-ended question, the same model volunteers stereotypes in all eight languages we probe, in roughly one in four open-ended answers under an independent judge (~24% to ~27% across the compression ladder): it passes every standard check and still reaches users measurably more biased. The selective gap is a robust finding; whether open-ended bias further increases with compression is less certain, sensitive to the judge that scores it. We address both with \textbf{QuantiBias}, a benchmark that pairs a generative, multilingual stereotype probe with the refusal and multiple-choice controls that isolate open-ended generation, contrasts each build with and without reasoning, and rates the content severity of what it generates. Across two backbone models (Qwen and Gemma), a five-family screen, and eight benchmarks, quantizers allocate their extra precision by capability data that carries no bias-prevention signal, and reasoning before answering roughly halves the effect on some families while doing nothing on others. A quantized build must be re-evaluated for open-ended bias, not only on the short-form safeguards it already passes.
35. 【2607.21051】Sample-Efficient Learning from Agent Experience
链接：https://arxiv.org/abs/2607.21051
作者：Chenhui Gou,Haoqin Tu,Yunhao Fang,Jianfei Cai,Hamid Rezatofighi
类目：Computation and Language (cs.CL)
关键词：obtaining human feedback, Real-world agent learning, Real-world agent, running time-consuming experiments, human feedback
备注：
点击查看摘要
Abstract:Real-world agent learning is often constrained by costly environment interactions, such as running time-consuming experiments or obtaining human feedback. In-context learning offers a highly sample-efficient way for agents to learn from their own interaction histories, but its gains disappear once that experience is removed from the context. Separately, context distillation provides a mechanism for internalizing contextual information into model weights. However, applying it to agents' interaction histories without sacrificing environment sample efficiency remains underexplored. We term this problem Experience Distillation and develop an implementation that requires no further environment interaction beyond the collected experience. Experiments on 749 curated software-engineering tasks and six text-adventure games show that it retains at least 64.8\% of the gains from in-context learning across both domains, whereas direct supervised fine-tuning on the collected experience recovers only 3.8\%. Compared with classical reinforcement-learning baselines, in-context learning from trial-and-error experience followed by Experience Distillation matches their performance with at least \(9.6\times\) fewer environment samples.
36. 【2607.21019】HiMe: Real-Time Self-Hosted Personal Agent Platform for Health Insights with Wearable Devices
链接：https://arxiv.org/abs/2607.21019
作者：Wei Liu,Siya Qi,Linhai Zhang,Lorainne Tudor Car,Yulan He
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA); Software Engineering (cs.SE)
关键词：rigid analytical frameworks, Traditional approaches, health signal analysis, Health Agentic Analysis, Personal Health Agentic
备注：
点击查看摘要
Abstract:Traditional approaches to wearable health signal analysis, such as smartwatches, are constrained by rigid analytical frameworks and limited personalisation. The emergence of LLM agents creates a new opportunity for Personal Health Agentic Analysis, where health insights can be generated adaptively and in context. However, currently there is no open-source locally deployable platform capable of processing personal health data in real time while preserving privacy. We present HiMe, a locally deployable, privacy-first agent platform that is fully compatible with real-time health data ecosystems across a wide range of wearable devices. HiMe is guided by three design principles. The database is treated as a first-class component. Effectiveness and efficiency are jointly optimised to achieve a low-cost Pareto-optimal balance. Data are processed in real time while the user is modelled over the long term. Together, these principles make it practical for individuals to harness Personal Health Agents for continuous, personalised health monitoring for better wellbeing.
37. 【2607.21016】CultureTalk-ID: A Multi-Task Dialogue Benchmark for Cultural Commonsense in Indonesian Local Languages
链接：https://arxiv.org/abs/2607.21016
作者：Muhammad Dehan Al Kautsar,Salsabila Pranida,Bilal Elbouardi,Fajri Koto
类目：Computation and Language (cs.CL)
关键词：Culture is lived, existing Indonesian cultural, commonsense benchmarks evaluate, Indonesian cultural commonsense, lived through conversation
备注： Under review
点击查看摘要
Abstract:Culture is lived through conversation, yet existing Indonesian cultural commonsense benchmarks evaluate LLMs on short and isolated prompts, stripping away the dialogic context in which cultural nuances actually surface. We introduce CultureTalk-ID, the first dialogue-based benchmark for cultural commonsense in Indonesian and its local languages, comprising 4,496 culturally grounded dialogues across 11 languages and 13 culturally salient topics, curated through a multi-stage human pipeline with native speakers to ensure authenticity. CultureTalk-ID introduces three complementary tasks, namely dialogue-based multiple-choice cultural commonsense reasoning, culturally faithful machine translation, and language steering, which jointly probe whether LLMs can understand, transfer, and generate culturally grounded language.
38. 【2607.20995】Where Animacy Lives in Large Language Models: Tracing the Circuits of the Animacy Concept
链接：https://arxiv.org/abs/2607.20995
作者：Samuele Punzo,Giovanni Cinà,Sandro Pezzelle
类目：Computation and Language (cs.CL)
关键词：shallow text processing, involves recognizing complex, recognizing complex selectional, complex selectional constraints, written language requires
备注：
点击查看摘要
Abstract:Distinguishing animate from inanimate concepts in written language requires more than shallow text processing, as it involves recognizing complex selectional constraints and contextual cues, such as verb-argument interactions. Yet, current large language models (LLMs) appear to be capable of doing it. We investigate whether this animacy-sensitive behavior of LLMs can be traced to a localized set of causally relevant components and connections. To do so, we construct a controlled dataset of minimal pairs and perform circuit discovery on four open-weight models. Through in-depth experiments and ablations, we show that a causal mechanism responsible for handling animacy in these models does exist, thus discovering an animacy circuit. At the same time, this circuit appears to be less localized compared to other known ones and generalizes only partially across models and animacy tasks, confirming the distributed, context-dependent, and somewhat graded nature of the animacy concept.
39. 【2607.20952】he Weight of Silence: A Causal Case for Weights Over the Scratchpad in Latent Chess Reasoning
链接：https://arxiv.org/abs/2607.20952
作者：Ishan S. Kshirsagar
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：continuous vector space, language models carry, consults during inference, carry out intermediate, intermediate computation
备注： 28 pages, 5 figures, preprint also available at Zenodo: [this https URL](https://zenodo.org/records/21454434)
点击查看摘要
Abstract:Latent, or silent, reasoning lets language models carry out intermediate computation in continuous vector space instead of words, and is widely assumed to function as an internal scratchpad the model actively consults during inference. Whether that assumption survives reinforcement learning has not been tested directly: existing causal analyses of latent reasoning are confined to math and logic tasks, and compare a model's reliance on its thoughts within a single checkpoint, never before and after an RL stage. We train a chess-playing model through a staged latent-reasoning curriculum followed by reinforcement learning, and find legality climbs monotonically to 61% (from a 48% pre-RL baseline) while checkmate confabulation is eliminated entirely. To locate this gain, we run a six-condition causal intervention suite on the same model before and after RL: substituting or adding matched noise to the latent thought vectors leaves performance unchanged, ablating them causes only mild degradation, and only exact-zero vectors cause collapse. This robustness gap is itself the finding: under exact-zero corruption, legality collapses to 1% pre-RL versus 9% post-RL, a gap that survives correction for testing across the full battery; milder conditions trend similarly without independently reaching significance. RL appears to add robustness to disruption, not reliance on thought content. These results push back against the field's default assumption that latent thoughts function as an actively consulted inference-time scratchpad, and instead indicate latent reasoning's principal effect here is shaping the model's parameters during training. We also demonstrate a working RL gain in chess, a domain outside the math and logic settings where multiple groups report the same latent-reasoning-plus-RL recipe failing to improve accuracy over SFT.
40. 【2607.20946】From a Word-Level Dictionary to Sentence-Level Semantics: Multilingual Grievance Labelling with Contextual Models
链接：https://arxiv.org/abs/2607.20946
作者：Lin Tian,Marian-Andrei Rizoiu
类目：Computation and Language (cs.CL)
关键词：warning signs analysts, threats of violence, warning signs, signs analysts, assessing threats
备注： 12 pages, 1 figure, 9 tables
点击查看摘要
Abstract:Grievance is one of the warning signs analysts look for when assessing threats of violence. It is increasingly measured at scale from online text, most often with word-level lexicons like the Grievance Dictionary that score by matching weighted terms. Such matching is a fast and transparent proxy, but it cannot resolve whether a term is asserted, quoted, negated, or condemned. These lexicons are also often evaluated on pools enriched with the very examples they retrieve, so a high score partly reflects agreement with the lexicon's own selection rule. Examining a five-language, 2{,}000-item evaluation pool, we find its halves separated almost perfectly by the lexicon itself: every item labeled ``random'' is in fact lexicon-negative, so the lexicon's apparent macro-AUROC of 0.686 collapses to a 0.500 floor fixed by construction. We keep the dictionary's 22-construct ontology but replace term matching with context-reading models, evaluated on a non-circular benchmark that separates unconditional-random, lexicon-positive, and lexicon-negative strata across five languages. Reading the full post rather than the target sentence alone helps most where the lexicon is silent, raising average precision on lexicon-negative text from 0.14 to 0.20, with the largest gains on quoted, implicit, and cross-sentence grievance. Together, these results show that grievance is measured more faithfully by reading the surrounding context, and more honestly when tested on text the lexicon did not select. We release our code and benchmark at this https URL.
41. 【2607.20935】Chemical Chain-of-Thought Functions as a Hallucination-Prone Molecular Scratchpad
链接：https://arxiv.org/abs/2607.20935
作者：Jiatong Li,Yuxuan Ren,Weida Wang,Xiaoyong Wei,Yatao Bian
类目：Computational Engineering, Finance, and Science (cs.CE); Computation and Language (cs.CL)
关键词：expected to derive, reasoning language models, derive molecular answers, Chemical reasoning language, language models
备注： 16 pages, 6 figures
点击查看摘要
Abstract:Chemical reasoning language models are expected to derive molecular answers through faithful chain-of-thought (CoT). However, across four reasoning model families and twelve chemistry tasks, hallucination is widespread and largely decoupled from answer correctness: correct answers often coexist with fabricated structural claims absent from the relevant molecules. Yet this does not make the reasoning trace computationally irrelevant. Attribution analyses suggest a shared scratchpad function expressed in model-specific forms: Chem-R and ether-0 rely on fragmented SMILES drafts, whereas ChemDFM-R emphasizes scaffold, positional, and naming cues. Notably, perturbing Chem-R's SMILES sketches degrades generation, showing that structural drafts can be causally load-bearing even when verbal structural claims are largely inert. Together, these results show that chemical CoT is neither a faithful explanation nor merely a post-hoc rationalization, but a hallucination-prone molecular scratchpad. This finding cautions against treating CoT as direct evidence of faithful reasoning and motivates process-level supervision beyond answer-only evaluation.
42. 【2607.20933】ransformer-Assisted LLM-Based Source Code Summarisation: to Enable More Secure Software Development
链接：https://arxiv.org/abs/2607.20933
作者：Jesse Phillips,Tracy Hall,Paul Rayson,Mo El-Haj
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：Neural Source Code, Software Development Lifecycle, Neural Source, Source Code Summarisation, Source Code
备注： 10 pages
点击查看摘要
Abstract:Neural Source Code Summarisation (NSCS) aims to generate natural language summaries of source code to improve developers' and maintainers' understanding of code. Source code summaries are vital during the maintenance phase of the Secure Software Development Lifecycle (SSDLC), as they improve maintainers' understanding of code and help reduce the number of bugs and vulnerabilities in a software system. However, summaries are often missing, incomplete, or outdated in many software systems. Solutions to this problem use small, task-specific Transformer models or code-aware Large Language Models (LLMs). Task-specific Transformer-generated summaries often score well across many natural language generation (NLG) metrics, but these metrics reward lexical overlap rather than summary quality. Conversely, the ability of LLMs to capture semantics and produce high-quality summaries presents an exciting solution to this problem. This is especially relevant given the increased availability of LLMs and improvements in workstation hardware in recent years, which mean that some LLMs can now be run on developers' workstations. However, because of their abstractive nature, LLM-generated code summaries often differ greatly from developer-written summaries in the words and phrases they use, resulting in low scores across NLG metrics. We show how combining these two methods, by using Transformer-generated summaries in prompt engineering, may enable LLMs to create better source code summaries and help software practitioners maintain secure systems. We prompt four LLMs using four different prompts, with a task-specific Transformer used to assist the LLMs within the prompts. We present "Transformer-Assisted LLM-Based Source Code Summarisation", a method through which we observe an improvement of 7.8% in BLEU-4 and 5%.
43. 【2607.20911】ncent WorkBuddy Bench: A Multi-Domain Coding-Agent Benchmark with Contamination-Resistant Task Construction
链接：https://arxiv.org/abs/2607.20911
作者：Tencent WorkBuddy Bench Team:Siqi Cai,Shaopeng Chen,Xiang Fei,Yong Mao,Zihan Xu,Zhiheng Lyu,Zhijian Shao,Yuchen Shi,Shuwen Zhang,Chaofan Qiu,Linjie Che,Xiaoxi Zhao,Feng Wu,Kai Zhang,Chaofan Zhu,Yubin Qi,Xiaoyun Liang,Peijie Dong,Yunhao Zhang,Yuanjie Zhu,Ling Jiang,Xianjun Zhang,Zhehang Chu,Anyuan Sang,Zhen Feng,Sen Nie,Shi Wu,Yuanzhen Xu,Xin Li,Ning Yang,Zhiqiang Dong,Hande Dong,Qiang Lin,Yi Liu,Yunsheng Wu,Ke Li,Xing Sun
类目：Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Tencent WorkBuddy Bench, introduce Tencent WorkBuddy, WorkBuddy Bench, introduce Tencent, Tencent WorkBuddy
备注： 30 pages, 9 figures. Project page: [this https URL](https://workbuddybench.com/) ; code: [this https URL](https://github.com/Tencent/workbuddy-bench) ; dataset: [this https URL](https://huggingface.co/datasets/tencent/workbuddy-bench)
点击查看摘要
Abstract:We introduce Tencent WorkBuddy Bench, a multi-domain evaluation suite for coding agents; this report documents its construction methodology, scoring protocol, and a cross-model leaderboard. At its core is a unified evaluation framework for constructing and running distribution-informed coding-agent tasks across four work domains - Code, Web, Office, and Security. Rather than adapting public issue text, every task is reverse-engineered from a real commit, pull request, or business scenario and rewritten as a short, colloquial, role-played request, so that a task's prompt is not recoverable by web-searching the underlying issue, pull request, or commit thread. Because the dataset is released openly - task directories, environment images, evaluation harness, tests, and reference solutions - contamination resistance rests on this construction together with dataset versioning rather than on secrecy. The four subsets - repository-level engineering, front-end development, office and business workflows, and red-/blue-team security - probe complementary facets of real work, each with its own verification style. All are packaged in a uniform task-directory format and run, under a uniform and reproducible protocol, on two agent harnesses (CodeBuddy Code and Claude Code); the full open release makes the benchmark reproducible end to end and directly auditable, since any third party can re-run each task and inspect its content. Because each subset uses a different scoring instrument, scores are not comparable across subsets and the suite reports no suite-wide average. We report a cross-model leaderboard across several model families.
44. 【2607.20872】LegalCiteTrust: Benchmarking Citation Trustworthiness in Chinese Long-Form Legal Research Reports
链接：https://arxiv.org/abs/2607.20872
作者：Yunhan Li,Mingjie Xie,Zeyang Shi,Gengshen Wu,Min Yang
类目：Computation and Language (cs.CL)
关键词：reports increasingly rely, Long-form legal research, Chinese long-form legal, legal research reports, citation trustworthiness
备注： 8 pages, 21 pages with appendix, 26 tables, 4 figures
点击查看摘要
Abstract:Long-form legal research reports increasingly rely on LLMs and agentic research systems, but their reliability depends not only on answering the task, but also on whether cited legal authorities are trustworthy. A citation can be risky even when it points to a real source: the report may omit limiting conditions, misdescribe the authority, or use it to support a stronger claim than the source allows. We introduce LegalCiteTrust, a benchmark for evaluating citation trustworthiness in Chinese long-form legal research reports. It contains 72 densely annotated report-level tasks and evaluates reports along three dimensions: Coverage, Support, and Citation Trustworthiness. Citation Trustworthiness is operationalized through citation-level Existence, Fidelity, and Applicability (E/F/A). Experiments on general-purpose LLMs, deep-research systems, and legal-specific systems show that task completion, evidence richness, citation density, and citation reliability expose different system behaviors. Retrieval tools can improve evidence support without reliably improving the Trust score, while E/F/A-based revision improves Trust and Final score more clearly than existence-only filtering. These results suggest that trustworthy legal research generation requires citation-aware evidence governance after retrieval: systems must not only retrieve legal authorities, but also select, describe, and apply them reliably.
45. 【2607.20864】Position Bias is Hidden Behind Ceiling Effects: A Permutation Diagnostic for LLM Benchmarks
链接：https://arxiv.org/abs/2607.20864
作者：Hiroki Tamba
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：multiple-choice LLM evaluation, single answer-order shuffles, multiple-choice LLM, published measurements rely, Position bias
备注： 25 pages, 4 figures, 2 appendices. Code, data, and preregistration verification at [this https URL](https://github.com/TambaClan/inspect_permute) . Companion paper: [arXiv:2606.26185](https://arxiv.org/abs/2606.26185)
点击查看摘要
Abstract:Position bias in multiple-choice LLM evaluation is widely cited as a confound in capability comparisons, but published measurements rely on single answer-order shuffles whose results confound the bias signal with content-level noise and sampling stochasticity. I introduce inspect_permute, an open-source extension to the inspect_ai evaluation framework that runs exhaustive answer-order permutations per question and reports the chi-squared / Cramer V signature of position bias with bootstrap confidence intervals. I apply the tool across four vendors (gpt-4o-mini, claude-haiku-4-5, gemini-2.5-flash, grok-3) on five MMLU subjects, 24,000 API calls under temperature-0 generation, with falsifier predictions pre-registered via a public SHA-256 hash before half the data was observed. Position bias turns out to be statistically detectable only within a roughly 60-95% base-accuracy Goldilocks zone. Below it, processing-load dominance swamps subject-specific signal; above it, ceiling effects compress the variance below the chi-squared test resolution. Detectable cells separate into two mechanism types: monotone A-to-D decrease (processing_load, in low-tier models) and non-monotone D-drop (content_ambiguity, in a narrow capability band). Standard MMLU places every frontier-tier model above the detection band, so absence of signal there should be read as not measurable, not unbiased. Together with the ceiling-effect characterisation in arXiv:2606.26185, this work brackets the detectable region of position-bias measurement and makes the field central question askable in a verifiable form. Package, data, preregistration under MIT.
46. 【2607.20862】CSPF: A Constrained Shared-Private Fusion Method for Non-Verifiable Preference Evaluation
链接：https://arxiv.org/abs/2607.20862
作者：Hehao Zhang,Danli Wang,Xinyuan Wang,Xuange Gao
类目：Computation and Language (cs.CL)
关键词：tasks remains challenging, remains challenging, CSPF, reliable evaluation, non-verifiable tasks remains
备注： 15 pages, 6 figures, 5 tables
点击查看摘要
Abstract:At present, reliable evaluation of non-verifiable tasks remains challenging. Existing approaches often fail to adequately capture the diverse evaluative criteria underlying human preferences in such tasks. To this end, we propose Constrained Shared-Private Fusion (CSPF), a fusion method that treats heterogeneous frozen reward models as complementary evaluators and learns to integrate their hidden-state representations under pairwise human-preference supervision. CSPF decomposes each expert signal into shared and expert-private representations, encouraging cross-expert alignment while preserving complementary viewpoints. Across experiments on LM-Arena target-domain adaptation and PPE out-of-distribution preference evaluation, CSPF achieves the best performance on the primary metrics among the evaluated single-expert reward-model, scalar-score multi-expert, and rubric-judge baselines. Overall, CSPF suggests that fusing hidden-state representations provides a more expressive basis for preference assessment, offering a practical route toward integrated evaluative signals for non-verifiable preference tasks.
47. 【2607.20833】REFACT: Adaptive Fact Restatement for Compact and Faithful Chain-of-Thought Reasoning
链接：https://arxiv.org/abs/2607.20833
作者：Zhensheng Jin,Xin Dai,Zhenghao Liu,Chaojun Xiao,Huiyuan Xie,Yu Gu,Ge Yu,Maosong Sun
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, language models increasingly, models increasingly rely, complex tasks
备注：
点击查看摘要
Abstract:Large language models increasingly rely on long-form reasoning for complex tasks, yet their reasoning traces may drift away from the supplied context when evidence is sparse, noisy, or in conflict with parametric knowledge. Existing grounding methods either attach citations after generation or encourage evidence retrieval inside the trace, but they often do not ensure that cited content is sufficient for the local inference and final answer. We propose REFACT, an adaptive fact-restatement citation framework that trains models to decide when a reasoning step needs contextual grounding and at what granularity source facts should be restated. This design avoids both unsupported inference and indiscriminate fact copying by turning citations into answer-supporting intermediate states. REFACT is optimized with a two-stage SFT-to-RL pipeline in which a citation-utility reward encourages cited facts to be well-formed, source-traceable, and answer-sufficient. Experiments on LongBench, LV-Eval, and ConFiQA show that REFACT improves long-context QA and counterfactual faithfulness while substantially reducing token consumption. Further analysis shows that REFACT preserves more answer-bearing evidence with fewer restated facts, yielding reasoning traces that are denser rather than longer. All code and data are available at this https URL.
48. 【2607.20832】Beyond Heavy Log Curation: Perplexity-Based APT Detection via Unsupervised, Context-Augmented Language Models
链接：https://arxiv.org/abs/2607.20832
作者：Shoya Otsu,Kei Suzuki,Toshiaki Koike-Akino,Jing Liu,Ye Wang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Advanced Persistent Threats, Persistent Threats, Advanced Persistent, hard to scale, difficult to detect
备注： 20 pages
点击查看摘要
Abstract:Advanced Persistent Threats (APTs) remain difficult to detect because only a small fraction of events in large-scale logs are attack-related, and investigation is expensive and hard to scale. Prior machine-learning approaches can reduce analyst workload, but they often rely on heavily curated training data and sophisticated preprocessing pipelines. Building and maintaining such pipelines require substantial domain expertise and engineering cost. Motivated by insights from a study of a strong APT detection baseline, we propose CAPTAIN (Context-Augmented Perplexity-based Threat Activity log detectIoN), a perplexity-based detector that leverages general, pre-trained language models with minimal, domain-agnostic preprocessing, enabling robust scoring of long, minimally processed log entries. CAPTAIN encodes recent history with an encoder model and a Q-Former-style bridge, then injects the compact context tokens into the decoder input so that perplexity reflects temporal context. To improve stability, CAPTAIN additionally applies smoothing filters to the perplexity time series. Across APT-oriented benchmarks, CAPTAIN competes with strong existing baselines and remains robust under substantially less curated inputs, that reduces the development and operational cost of advanced log preprocessing.
49. 【2607.20803】he Geometry of Personality: Activation Steering with Jungian Cognitive Functions
链接：https://arxiv.org/abs/2607.20803
作者：Liu Zai(1),Yumeng Wang(2),Junchen Fu(1),Joemon M. Jose(1) ((1) University of Glasgow, (2) Leiden University)
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：existing work primarily, work primarily models, static trait frameworks, primarily models personality, Jungian Cognitive Functions
备注： 15 pages, 13 figures
点击查看摘要
Abstract:Activation steering enables control and interpretation of LLMs, yet existing work primarily models personality through static trait frameworks such as the Big Five. We investigate whether personality can instead be represented and controlled as a set of cognitive processes using the eight Jungian Cognitive Functions. To this end, we introduce a framework comprising a Jungian evaluation protocol and a dataset of over 2,100 role-playing character narrations. Activation steering vector extraction and evaluation experiments on Llama-3.1-8B demonstrate effective monotonic control over all eight cognitive functions through activation steering. Beyond controllability, our analysis reveals that: 1. personality information is concentrated in middle transformer layers; 2. steering vectors exhibit structured geometric relationships consistent with distinctions between rational and irrational functions; 3. effective multi-dimensional steering directions cannot be recovered as linear combinations of single-function directions. These findings provide new insights into the representation of personality in LLM activation space and establish a framework for studying interpretable, effective, and multi-dimensional personality control.
Comments:
15 pages, 13 figures
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2607.20803 [cs.CL]
(or
arXiv:2607.20803v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.20803
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
50. 【2607.20791】Refusal-Gated Decoding: Preserving Refusal Behavior Under High-Temperature Sampling
链接：https://arxiv.org/abs/2607.20791
作者：Phillip Howard,Xin Su,Allen Roush,Manikandan Ravikiran,Amir Abdullah
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：High-temperature sampling, primary mechanisms, refusal behavior, High-temperature, refusal
备注：
点击查看摘要
Abstract:High-temperature sampling is one of the primary mechanisms for increasing diversity in LLMs. Recent advances in truncation-based sampling techniques have helped mitigate drawbacks of high-temperature sampling such as neural text degeneration, thereby enabling greater diversity in LLM outputs without sacrificing coherence. However, increasing the entropy of the token probability distribution via high temperatures has also been shown to weaken model guardrails by reducing the model's refusal response in the presence of harmful prompts. Despite the potential benefits of high-temperature sampling and the importance of maintaining model safety, there is a lack of existing solutions for maintaining the refusal behavior of LLMs under a higher entropy regime. To address this gap, we systematically study how temperature influences refusal behavior in LLMs and propose an efficient sequential decoding approach which preserves a model's greedy decoding refusal response at high temperatures while incurring minimal additional latency. Through extensive experiments, we show that our approach preserves 91-99% of the greedy decoding refusal behavior across three benchmark datasets without compromising the model's high-temperature response for safe prompts. Our work demonstrates how refusal behavior can be maintained in an efficient manner for applications which require high-temperature sampling.
51. 【2607.20768】Are Diversity Metrics Measuring Diversity? A Capability-Controlled Audit of Majority-Vote Gain in LLM Ensembles
链接：https://arxiv.org/abs/2607.20768
作者：Donghwan Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Majority voting, models to combine, widely assumed, assumed to benefit, choose which models
备注： 10 figures, 9 tables
点击查看摘要
Abstract:Majority voting over LLMs is widely assumed to benefit from diversity, and diversity measures are used to choose which models to combine. We ask whether five such measures track diversity or mainly re-express capability, auditing them as predictors of majority-vote gain over the best member across 31,900 subsets of 30 LLMs on MMLU-Pro (29 on TruthfulQA) under explicit capability controls. Three findings emerge. First, latent complementarity is ubiquitous: oracle gain is positive in 100% of subsets, yet simple voting beats the strongest member in only 9.98% of all canonical size-3 subsets (18.71% with held-out best selection); the pooled size-2-4 rate is 1.27%, partly reflecting deterministic even-size voting behavior. Second, a joint-correctness proxy (strict diversity) is nearly collinear with one minus mean accuracy (size-3 Spearman rho = +0.991 / +0.988); raw diversity-gain associations are strongly capability-entangled and, with one exception, unstable under control. Third, three linear contingency-table statistics are algebraically non-separable; after capability control, the empirically stable remainder is a modest residual pairwise co-failure association in which more shared error corresponds to lower gain. This direction is robust, but its magnitude is configuration-dependent. Joint rawspace linear regressions treating strict diversity, disagreement, and double-fault as independent predictors are rank-deficient by construction.
52. 【2607.20767】Rushes: A Human Preference Dataset for Pluralistic Alignment
链接：https://arxiv.org/abs/2607.20767
作者：Michael Xu,Jorge Leandro,Sudha Rao,Weijia Xu,Nebojsa Jojic,Gabriel DesGarennes,Chris Quirk,Bill Dolan
类目：Computation and Language (cs.CL)
关键词：studying revealed human, interactive narrative environments, revealed human engagement, studying revealed, revealed human
备注：
点击查看摘要
Abstract:We introduce Rushes, a dataset and benchmark for studying revealed human engagement preferences in interactive narrative environments. Rushes is collected through a game interface where users interact with AI-generated branching narratives and select one choice from a small, explicit candidate set at each decision point. Each interaction logs the full candidate set, the user's choice, and the evolving narrative context, yielding time-ordered trajectories with persistent user-level identifiers. Rushes contains 44,226 decision events from 8,167 unique users across six games, capturing sequential, personalized engagement behavior rather than static judgments. We show that user choices exhibit structured, non-random patterns, quantified by a low choice entropy relative to a uniform baseline. We position Rushes as a diagnostic benchmark for pluralistic alignment and demonstrate a robust Engagement Gap: state-of-the-art LLMs, including GPT-5, fail to outperform simple baselines. While classical Matrix Factorization (SVD) captures measurable personalized signal (37.7%), frontier LLMs (34.23%) struggle to even match the Popularity Baseline (36.4%) on event-level choice prediction. This gap suggests that single, population-level objectives, like those used in modern RLHF, appear insufficient to capture heterogeneous, context-dependent engagement signals. As a result, even highly capable models default to majority preferences rather than adapting to individual trajectories. We release Rushes to support research into pluralistic alignment and sequential decision-making in generative systems. The full code for the platform and dataset will be available here: this https URL
53. 【2607.20757】GaugeQuant: Online Learning of Quantization-Optimal Bases from LLM Symmetries
链接：https://arxiv.org/abs/2607.20757
作者：Miguel P. Bento,João Seabra
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：leave outputs invariant, internal continuous symmetries, outputs invariant, internal continuous, leave outputs
备注：
点击查看摘要
Abstract:Transformers are known to have internal continuous symmetries that leave outputs invariant, while modifying quantization. GaugeQuant leverages this in-training by introducing a LogSumExp term to the loss that breaks the symmetries, thus selecting a basis that minimizes activation outliers. A stop-gradient operator ensures that only rotation matrices are updated, yielding the language modeling objective completely unaltered. Our requires no specific calibration data, no quantization simulation, and adds negligible training overhead. With the LLaMA-2 7B model under W4A4 quantization with group size 128, perplexity drops from 8.22 to 6.73, competing with post-training methods that require frozen models and calibration datasets. Under W4A16, perplexity drops from 11.16 to 5.45. Code is available at this https URL.
54. 【2607.20722】REGARD: Regional Affective Differences in Large Language Models
链接：https://arxiv.org/abs/2607.20722
作者：Andrei Chetvergov,Alexander Evseev,Mikhail Solovev,Timofei Sivoraksha,Stepan Ukolov,Valeriia Kuschenko,Maria Chistyakova,Sergey Bolovtsov
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, language models trained, trained and aligned, linguistic and regional
备注： 17 pages, 11 figures, 3 tables. Includes evaluation of 19 language models, two independent VAD judges, and human validation on 300 items
点击查看摘要
Abstract:Large language models trained and aligned within different linguistic and regional ecosystems may frame the same political, cultural, and geopolitical entities in different ways. Such differences are often evaluated through sentiment, favorability, or stance, reducing model attitudes to a single positive-negative axis. We introduce REGARD, a study of what drives affective framing differences across LLMs on post-Soviet entities using target-directed Valence-Arousal-Dominance profiling. We query 19 models on 500 region-specific targets, score their responses with two independent LLM judges, GPT-4o-mini and Qwen3.6-35B-A3B, and validate the measurements on a 300-item human-annotated subset. Post-hoc Ward-linkage clustering of all 19 models by affective and response-behavior profiles yields three behavioral clusters that cut across model origin, family, and parameter count. Generic-answer rate is strongly associated with lower arousal (r = -0.81) and with cluster placement: models that deflect evaluative prompts with templated responses cluster together at low arousal regardless of origin. These findings show that VAD profiling captures emotional intensity, a dimension of affective framing that is largely invisible to conventional sentiment-based evaluation.
55. 【2607.20709】NVIDIA-labs OO Agents: Native Python Object-Oriented Agents
链接：https://arxiv.org/abs/2607.20709
作者：Paul Furgale,Severin Klingler,James Nolan,Matt Staats,Gaia Di Lorenzo,Elisa Martinez Abad,Christian Schüller,Razvan Dinu,Alessio Devoto,Pascal Berard,Gal Kaplun,Elad Sarafian,Riccardo Roveri,Leon Derczynski,Ricardo Silveira Cabral
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Traditional agent development, Traditional agent, tool schemas, workflow graphs, development is split
备注：
点击查看摘要
Abstract:Traditional agent development is split across prompt templates, tool schemas, callback code, and workflow graphs. We present NVIDIA Object-Oriented Agents (NOOA), a model-agnostic Python framework for building reliable AI agents. NOOA takes a simpler approach: an agent is a Python object. Its methods are the actions the model can take, fields are its state, docstrings are its prompts, and its type annotations are contracts. A method whose code body consists of "..." is completed at runtime by an LLM-driven agent loop, while methods with normal bodies remain standard deterministic Python. This gives developers and agents the same interface, so agent behavior can be tested, traced, refactored, and improved just like other software. This paper makes three contributions. (1) We present the agent-as-a-Python-object programming model and the design principles behind it. Where Python has existing abstractions, we adopt them directly. Agent-specific capabilities--context, events, state rendering, long-term memory, and validated LLM loops--are exposed through simple Pythonic APIs, so both developers and agents share one familiar programming model. (2) We identify six model-facing ideas that NOOA is, to our knowledge, the first to combine on a single surface: typed input/output, pass-by-reference over live objects, code as action, programmable loop engineering, explicit object state, and model-callable harness APIs for context and events. We find the community already converging on several of these ideas--often as experimental or partial features--and present the comparison to encourage further adoption. (3) We demonstrate that current models use this interface effectively, both in targeted capability tests and on agentic and reasoning benchmarks such as SWE-bench Verified and Terminal-Bench 2.0 and ARC-AGI-3.
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2607.20709 [cs.AI]
(or
arXiv:2607.20709v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2607.20709
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
56. 【2607.20690】Learning to Detect UI Principle Violations via Reinforcement Learning
链接：https://arxiv.org/abs/2607.20690
作者：Nishi Mehta,Swathi Alse,Himani Kumavat,Yue Yu,Pratik Jayarao
类目：Computation and Language (cs.CL)
关键词：coding agents increasingly, agents increasingly generate, Small language models, typically evaluated primarily, increasingly generate web
备注：
点击查看摘要
Abstract:Small language models and coding agents increasingly generate web front-end code, yet their outputs are typically evaluated primarily for functional correctness. A generated interface may compile, render, and pass unit tests while still violating established interface quality principles, including accessibility barriers, deceptive design patterns, poor visual hierarchy, and excessive decision complexity. Existing auditing approaches face a trade-off between cost, coverage, and scalability: expert human review provides rich judgment but is slow and expensive; frontier vision-language models offer broader reasoning capabilities but remain costly to deploy at scale; and rule-based tools such as axe-core and Lighthouse are inexpensive but primarily capture mechanically checkable accessibility issues. We investigate whether a lightweight vision-language model can serve as an effective critic for generated interfaces. We unify 19 interface-quality principles from three complementary sources of HCI knowledge: WCAG 2.2 accessibility standards, deceptive design taxonomies, and established theories of perception, cognition, and interaction. To train this critic, we construct a verified dataset of approximately 10,000 generated web pages by synthetically injecting known violations into clean, LLM-generated Tailwind pages. Continued reinforcement learning on a 4B vision-language model improves micro-F1 from 36\% to 84\%, with 13 of 19 principles exceeding 80\% F1. The resulting critic can audit generated interfaces, filter low-quality interface training data, and provide a reward signal for design-aware code generation. We release our data-generation recipe and injection/verification prompts to support reproducible evaluation and future work on scalable interface-quality assessment.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2607.20690 [cs.CL]
(or
arXiv:2607.20690v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.20690
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
57. 【2607.20668】From Agent Failures to Text Policies: What Works and What Breaks
链接：https://arxiv.org/abs/2607.20668
作者：Jaideep Ray,Ankit Goyal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：improves language-model systems, language-model systems, systems by revising, revising text, Abstract
备注：
点击查看摘要
Abstract:TextGrad improves language-model systems by revising text from feedback. Its core thesis is that natural-language feedback can act as a gradient for optimizing text components without changing model weights. Applying it to agents is harder because feedback arrives only after a sequence of actions, making it difficult to identify which decision caused failure. We study this problem by separating the ability to follow a useful policy from the ability to learn that policy from experience. Our main finding is a clear gap between these two abilities. Human-written policies improve two frozen 7B agents on TextWorldExpress by 5.0 success points, showing that useful policy text exists. However, policies generated from agent trajectories do not reliably outperform fixed prompting, even with richer traces, counterfactual evidence, or iterative GEPA search. The main challenge for agent-level TextGrad is therefore not executing textual policy updates, but reliably generating and selecting them from experience.
58. 【2607.20645】Frontier Financial Judgement: Can agents tell what might move a stock?
链接：https://arxiv.org/abs/2607.20645
作者：Joshua Harris
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：assess agents' ability, professional equity analysts, Frontier Financial Judgement, replicate expert human, introduce Frontier Financial
备注： 19 pages, 7 figures, 5 tables
点击查看摘要
Abstract:We introduce Frontier Financial Judgement, a challenging new benchmark developed in collaboration with professional equity analysts to assess agents' ability to replicate expert human judgements. Rapidly identifying new information, evaluating its implications and determining its valuation impact is one of the most time-consuming and challenging aspects of real-world equity coverage. This is becoming ever more difficult and important as AI rapidly increases the quantity of new information to process. The strongest agent we evaluate on Frontier Financial Judgement matches all expert labels in only 52.4% of cases. We also find significant divergence in estimated false-positive rates among frontier agents, ranging from ~1% for GPT-5.6 Sol to ~32% for Claude Sonnet 4.6. To construct the benchmark and make it representative of real-world settings, we combine human-designed and labelled synthetic articles with live news articles and historical documents, creating 656 items for assessment. The resulting task requires agents to distinguish genuinely new, valuation-relevant financial information from stale, immaterial or misleading news under realistic conditions. We find substantial trade-offs among agent accuracy, cost, false positives and reliability that continue to hinder the reliable deployment of news-flow filtering in practice.
59. 【2607.20638】WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms
链接：https://arxiv.org/abs/2607.20638
作者：Yichuan Liu,Daniel Cummings,Nick Vadlamudi
类目：Artificial Intelligence (cs.AI); Hardware Architecture (cs.AR); Computation and Language (cs.CL)
关键词：Large Language Models, remains largely unexplored, demonstrated strong capabilities, data remains largely, Large Language
备注： 10 pages; abridged version published in IEEE International Conference on LLM-Aided Design (ICLAD), 2026
点击查看摘要
Abstract:Large Language Models (LLMs) have demonstrated strong capabilities in code generation and reasoning, yet their ability to perform temporal reasoning over digital waveform data remains largely unexplored. Although reasoning over digital waveforms is a critical bottleneck in design verification, existing benchmarks primarily evaluate hardware description language (HDL) code generation and use waveforms only as supplementary context. This paper presents WaveformQA, an open-source question-answering benchmark for evaluating LLM temporal reasoning over digital waveforms. The benchmark comprises 360 questions with programmatically generated ground truths across eight categories of varying difficulty, including questions targeting multi-signal correlation and event ordering. Waveforms are generated from open-source design implementations, ensuring reproducibility and grounding the benchmark in real hardware behavior. Evaluation of frontier LLMs reveals that while models achieve reasonable accuracy on simple queries, performance degrades due to context window limitations and reasoning difficulties on complex temporal and multi-step questions. In addition, we show that an event-time JSON representation of waveforms improves LLM reasoning accuracy versus the standardized value change dump (VCD) format. The open-source framework supports extending to new question categories and importing new waveform sources, enabling researchers to rapidly prototype temporal reasoning experiments.
60. 【2607.20630】Demonstrating GenDB: Instance-Optimized and Customized Query Processing Code Generation via LLM Agents
链接：https://arxiv.org/abs/2607.20630
作者：Jiale Lao,Immanuel Trummer
类目：Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：require continuous development, engines require continuous, processing engines require, Large Language Models, query processing engines
备注： Accepted by VLDB 2026 (Demo)
点击查看摘要
Abstract:Traditional query processing engines require continuous development and extensions to support new techniques and user requirements, and in some cases, entirely new systems must be built from scratch. However, these engines are difficult to extend due to their internal complexity, and building new systems demands significant engineering effort and cost. To address this, we demonstrate GenDB, a generative query engine that shifts query processing from manually engineered systems to query processing code generation driven by Large Language Models (LLMs). An early prototype of GenDB uses LLM agents to generate instance-optimized query execution code tailored to specific data, workloads, and hardware resources. This prototype suits offline code generation for repetitive, templated queries, since the upfront generation cost amortizes over many executions and correctness can be ensured through extensive fuzz testing and manual inspection. For ad-hoc queries, GenDB can work with a traditional DBMS in a hybrid architecture: the DBMS handles one-off queries, while GenDB speeds up frequent SQL templates. Our demonstration allows users to (1) visually and interactively explore how GenDB analyzes workloads, profiles hardware resources and underlying data, produces query plans, generates code based on them, and finally uses an optimizer to iteratively achieve a correct and efficient implementation; (2) use visual inspection and analysis to gain qualitative insights into why GenDB produces code that achieves significantly better performance than state-of-the-art query engines on two benchmarks: TPC-H and a newly constructed benchmark designed to reduce potential data leakage from LLM training data; and (3) upload their own data and queries to explore GenDB with different LLMs and query patterns.
61. 【2607.20596】Are Single-Token Sparse Autoencoder Features Causally Necessary? Layer-Depth and SAE-Family Effects
链接：https://arxiv.org/abs/2607.20596
作者：Seonglae Cho,Zekun Wu,Kleyton Da Costa,Rishi Kalra,Ilham Wicaksono,Adriano Koshiyama
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：steer large language, Sparse autoencoder, large language models, SAE families, families remains untested
备注：
点击查看摘要
Abstract:Sparse autoencoder (SAE) features are used to interpret and steer large language models, yet whether a feature's causal role is stable across SAE families remains untested. Single-token features that activate on one vocabulary item provide the diagnostic case where ground truth permits direct comparison. We analyze 3.9M features across six models and three SAE families using zero-ablation at full layer depth. Single-token features cluster 4.7x tighter in decoder space and concentrate in early layers (Layer 0 in GPT2-Small; L0-L4 in Gemma). Ablating them yields Benjamini-Hochberg-significant logit reductions in 178 of 208 full-layer conditions, with depth controlling whether damage cascades downstream or shapes the output directly. Cross-family causal differences exceed within-family scale effects: on the same base model, GemmaScope and BatchTopK features remain causally anchored, while LlamaScope features are locally redundant. The target token's rank recovers to within 2x baseline 96-98% of the time after the same ablation, and a controlled activation-function comparison reverses sign within the same model, leaving training recipe as the residual candidate. Cross-family interpretability claims are therefore sensitive to training methodology, not just activation function or scale.
62. 【2607.20589】Evaluating the Effectiveness of Persona Simulation in Opinion Prediction with GPT-4.1
链接：https://arxiv.org/abs/2607.20589
作者：Sarah Y. Li,Ziyu Yao
类目：Computation and Language (cs.CL)
关键词：large language models, specific characteristic information, involves utilizing large, utilizing large language, simulation involves utilizing
备注： ICDM 2025 Undergraduate and High School Symposium
点击查看摘要
Abstract:Persona simulation involves utilizing large language models (LLMs) to anticipate human choices or interactions based on specific characteristic information. To further understand current limitations and future directions, we tested persona simulation in opinion prediction with GPT-4.1 (knowledge cutoff by June 2024). Using personas from nine U.S. states provided by Columbia University's Personas dataset, GPT-4.1 accurately predicted 2024 election outcomes in eight out of the nine states, only failing in one of the swing states. We then focused on opinions related to medicine and healthcare. With the American Trends Panel Wave 123 dataset from Pew Research Center, GPT-4.1 was able to anticipate beliefs about childhood vaccines with an accuracy of up to 0.94. Furthermore, we applied GPT-4.1 to generate conversations among personas and observed that the simulated dialogues and opinions adhered well to personas' personalities and backgrounds, albeit lacking natural human-like flow. Persona simulation proves to be a promising application of artificial intelligence as long as biases are addressed. In the near future, it will be beneficial to apply it to opinion analysis and reaction prediction in diverse fields ranging from public health to lawmaking to economics.
63. 【2607.20553】CMI-Mem: Toward Generalizable Long-Term Memory Management via CMI-Augmented Reinforcement Learning
链接：https://arxiv.org/abs/2607.20553
作者：Yubo Wang,Qiuyu Zhao,Zenghui Sun,Shichao Dong,Jinsong Lan,Xiaoyong Zhu,Haoyang Li,Bo Zheng,Lei Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：agent systems, pivotal in agent, Memory Manager, Conditional Mutual Information, Memory Manager models
备注：
点击查看摘要
Abstract:Memory Manager models are pivotal in agent systems. Existing methods rely predominantly on LLM-judged synthetic question-answer (QA) pairs, making memory valuation dependent on sampled queries and the downstream reader. To address this limitation, we propose \textbf{CMI-Mem}, a reinforcement learning(RL)-based lightweight memory manager model with a hybrid reward that combines downstream QA correctness and intrinsic Conditional Mutual Information (CMI). CMI evaluates the information contributed by new conversational inputs relative to the current memory state without conditioning on a sampled QA query, thereby complementing rather than replacing QA grounding. Our codes are available at: this https URL , and the CMI-Mem-4B model checkpoint is available at: this https URL
64. 【2607.20536】AppWorld-UL: Benchmarking Diverse Agent-User Interactions for Tool-Use
链接：https://arxiv.org/abs/2607.20536
作者：Junzhi Chen,Harsh Trivedi,Jane Pan,Michael JQ Zhang,Tejas Srinivasan,Niranjan Balasubramanian,Ashish Sabharwal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：prompt for confirmation, clarification questions, instruction is infeasible, ordering groceries, operate applications
备注： ICML 2026
点击查看摘要
Abstract:Tool-use agents that address day-to-day digital tasks such as ordering groceries must not only operate applications, but also interact with the user, e.g., to ask clarification questions, prompt for confirmation, and inform the user when the instruction is infeasible. However, current benchmarks for evaluating agent-user interactions do not capture the diversity of such interactions. Further, they operate in small environments with few, often non-state-changing, APIs. To address this gap, we introduce AppWorld-UL, a ``user-in-the-loop'' benchmark of 516 challenging tasks requiring diverse agent-user interactions. Building upon the AppWorld framework with 9 popular simulated apps like Amazon and Spotify, we systematically modify original tasks to introduce ambiguities and constraints that necessitate various types of agent-user interaction. User behavior is simulated by an LLM prompted to respond with carefully designed knowledge boundaries, offering more reliable simulation than the unconstrained or overly rigid alternatives used in prior work. Our evaluation reveals that a state-of-the-art LLM, Claude Opus 4.7, achieves only 48.6% success on AppWorld-UL, and only 35.7% on the harder, compositional subset. On the stricter, scenario-level metric, compositional task performance drops to only 21.3%. Our analysis reveals that correct user-interaction is crucial for success. This demonstrates the benchmark's difficulty and its potential to advance research on user-in-the-loop tool-use agents.
65. 【2607.20510】co-GAIA: Bilingual Benchmark for Agents in Telecom Domain
链接：https://arxiv.org/abs/2607.20510
作者：Dmitrii Khizbullin,Zaid Alyafeai,Abdelrahman Eldesokey,Nourah AlSultan,Raghad Alshalan,David R. Pugh,Bernard Ghanem
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：real-world telecommunications operator, telecommunications operator, real-world telecommunications, evaluating tool-using agents, relational SQL database
备注：
点击查看摘要
Abstract:We introduce Telco-GAIA, a bilingual, multi-modal benchmark for evaluating tool-using agents on the data of a real-world telecommunications operator. Telco-GAIA comprises 100 human-verified question-answering tasks, in English and Arabic, that each demand multi-hop reasoning (4.2 hops on average) over three heterogeneous sources: a static website snapshot (HTML, images, and linked PDFs), a synthetic relational SQL database, and external web archives, spanning text, image, and tabular modalities. The benchmark is delivered as a sandboxed Docker environment and scored by normalized exact string matching, making evaluation objective, deterministic, and reproducible over time without any LLM-as-a-Judge. Evaluating a purpose-built reference agent across twelve commercial and open LLMs, we find Telco-GAIA challenging: even the strongest model solves only 71% of tasks; under a moderate cost budget, this falls to about 40%, and the visually grounded categories remain the weakest, where the average backend scores below 30%, leaving substantial headroom in document and image understanding. Telco-GAIA offers a rigorous, reproducible testbed for enterprise agents and a template for constructing closed-domain benchmarks.
66. 【2607.20492】PhantomFill: When the Form Demands an Answer, Language Models Invent One
链接：https://arxiv.org/abs/2607.20492
作者：Rana Muhammad Usman
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：write prose, models, required JSON field, model, Escape Utilization Rate
备注： 12 pages, 6 figures. Benchmark and code: [this https URL](https://github.com/ranausmanai/phantomfill)
点击查看摘要
Abstract:Language models in production do not write prose. They fill forms: JSON fields, function arguments, extraction templates. We show that the form itself causes hallucination. We ask thirteen models the same question about the same input and change only the answer format. The inputs are built so the question cannot be answered: a viral post showing 12,400 likes but no visible replies, a support ticket whose call was never transcribed. In free text, GPT-5.5 answers honestly. It says there is no reply data, 98% of the time. Given a required JSON field for sentiment, the same model invents an answer 40 times out of 40. It fabricates the mood of crowds it never saw and quotes customers it never heard. The pattern holds with force. Required fields drive fabrication to 100% in ten of thirteen models. An explicit "insufficient evidence" option rescues only the frontier: all nine open-weight models ignore it. A direct instruction, do not infer sentiment, is overridden by the schema in four of six models. Resistance does not come with scale: within a single model family, the smallest model refuses, the mid-sized model fabricates, the largest refuses again. Honesty under format pressure is a training outcome that no one is measuring. The fabrication hides exactly where hedging is impossible: in required enums and minimum-count arrays, fields where no disclaimer fits. We release PhantomFill, a benchmark with deterministic scoring and two reportable numbers: the Coerced Fabrication Rate and the Escape Utilization Rate. The fix we test is one line of schema. The failure we measure is everywhere.
Comments:
12 pages, 6 figures. Benchmark and code: this https URL
Subjects:
Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
ACMclasses:
I.2.7; I.2.6
Cite as:
arXiv:2607.20492 [cs.LG]
(or
arXiv:2607.20492v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.20492
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Rana Usman Mr [view email] [v1]
Thu, 11 Jun 2026 12:15:05 UTC (689 KB)
67. 【2607.20491】DFAH-Bench: Benchmarking Observable Agent Instability in Financial Decision-Making
链接：https://arxiv.org/abs/2607.20491
作者：Raffi Khatchadourian
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：tool-using agent decides, Standard evaluation benchmarks, Standard evaluation, agent decides, evaluation benchmarks measure
备注： 16 pages, 3 figures. Code, replay logs, one-command reproduction (make reproduce-paper), and an interactive results explorer: [this http URL](http://github.com/ibm-client-engineering/output-drift-financial-llms)
点击查看摘要
Abstract:Standard evaluation benchmarks measure what a tool-using agent decides, not whether it arrives at that decision through the same process each time. We introduce DFAH-Bench, a replay benchmark that measures observable behavioral instability in financial agent decision-making across three channels -- tool-call trajectories, evidence contacts, and decision concentration -- none of which require access to hidden reasoning text. Across 8,127 replay episodes spanning 10 models and 3 financial tasks, we find that outcome agreement alone is an incomplete stability signal: frontier models can agree on decisions 95% of the time while following the same tool path only 77% of the time -- an 18-percentage-point gap (95% CI: [0.14, 0.22]) that outcome-only evaluation misses entirely. Among frontier-model case groups with high decision agreement, over 55% exhibit meaningful trajectory divergence. We identify three behavioral profiles: pattern matchers that achieve near-perfect agreement by collapsing to a single output regardless of input, stable executors with relatively consistent tool-use processes, and trajectory divergers that reach the same conclusions through materially different tool paths and evidence contacts. The benchmark code, metric scripts, replay logs, benchmark card, dataset README, and release manifest are released in the accompanying repository.
68. 【2607.20487】Directional Hallucinations: Ideological Drift in News-Grounded LLM Question Answering
链接：https://arxiv.org/abs/2607.20487
作者：Chendi Wang,Liam Cunningham,Tom Yishay,Jieying Chen
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language models, Large language, election-adjacent information settings, distortions are high-stakes, settings where factual
备注：
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to answer questions about political information, including in election-adjacent information settings where factual errors and ideological distortions are high-stakes. We present a reproducible measurement framework that treats hallucinations, unsupported statements in document-grounded QA, as diagnostic signals of ideological drift. Using 21,727 expert-labeled U.S. political news articles from QBias spanning left, center, and right sources, we (i) generate an article-specific question, (ii) elicit document-grounded answers from three open-weight LLMs and one proprietary model, (iii) detect sentence-level hallucinations via reference-based comparison, (iv) classify the ideological valence of hallucinated sentences with a fine-tuned stance classifier, and (v) probe output logits to relate token-level uncertainty to hallucination and drift. Hallucination rates vary substantially across models and concentrate in contentious topics, while source-ideology differences in hallucination frequency are modest. In contrast, hallucination content exhibits robust leftward drift: a majority of hallucinated sentences are classified as left-leaning, including among hallucinations generated from right-leaning sources. Logit-level analysis shows hallucinations arise in high-entropy generation contexts, and in some models uncertainty also predicts leftward drift, consistent with an "uncertainty to guessing" mechanism. We discuss implications for auditing AI-mediated political information and for designing safeguards in election-relevant deployments.
69. 【2607.20485】Expectation Alignment of Language Models for Real-World User Expectations
链接：https://arxiv.org/abs/2607.20485
作者：Miaomiao Li,Yang Wang,Bin Liang,Shudong Liu,Zhiwei Zhang,Kam-Fai Wong
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, demonstrated remarkable performance, remains largely unexplored, Large language, user expectations
备注： Accepted by ICML 2026
点击查看摘要
Abstract:Large language models (LLMs) have demonstrated remarkable performance on standard benchmarks, yet it remains largely unexplored whether they truly meet user expectations. Existing evaluation approaches, relying on model heuristics, expert rubrics, or user simulation, fail to capture the diversity and subtlety of real human expectations, causing models to appear competent while misaligning with what users actually seek. We present the first systematic study of user expectations in real-world LLM interactions, proposing a principled procedure to extract semantically rich expectations and introducing ExpectBench, a benchmark grounded in real user expectations. Analyses reveal that current LLMs struggle to satisfy and anticipate what users hope to obtain, highlighting a fundamental source of misalignment. Building on these observations, we propose LENS, a lightweight latent expectation-aware response generation framework. LENS enables models to internalize user expectations and generate better-aligned responses, consistently improving expectation satisfaction and underscoring the importance of explicitly modeling user expectations for realistic human-AI alignment.
70. 【2607.20482】PersonaTrail: Benchmarking Personalized Web Agents through Browsing Trails
链接：https://arxiv.org/abs/2607.20482
作者：Seungbin Yang,Chaewoon Ki,Dohyun Lee,Jaegul Choo,ChaeHun Park
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, autonomously execute complex, Recent advances, execute complex tasks, advances in large
备注：
点击查看摘要
Abstract:Recent advances in large language models have enabled web agents to autonomously execute complex tasks. In practice, users frequently provide underspecified instructions, requiring agents to infer the missing context from their raw browsing histories. Existing benchmarks fail to capture this form of personalization, as they either restrict tasks to fully explicit prompts or abstract web interaction history into simplified forms. To bridge this gap, we introduce PersonaTrail, a benchmark for personalized web agents operating in a managed open web environment. By leveraging realistic browsing trajectories as user history, PersonaTrail evaluates an agent's ability to infer user preferences and recall information from past browsing sessions. We further propose Preference-Aware Contextual Memory (PACMem), a framework that decomposes raw browsing histories into two types of structured memory: factual memories that summarize individual sessions and preference memories that distill recurring behavioral patterns. At inference time, the agent retrieves the most relevant entries from these memories to guide personalized navigation. Extensive experiments show that PACMem consistently outperforms existing memory-based baselines on both tasks.
71. 【2607.20479】Beyond Liars' Bench: The Impact of Lie Typology, Depth, and Sparsity on Deception Detection in LLMs
链接：https://arxiv.org/abs/2607.20479
作者：Amr Moustafa,Max Feser,Florian Mai
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：detect deceptive outputs, large language models, detect deceptive, deceptive outputs, outputs from large
备注： Presented at the AI Transparency Conference 2026, forthcoming in the AI Transparency Journal
点击查看摘要
Abstract:Training probes to detect deceptive outputs from large language models is still an open problem. Recent work has demonstrated that detection probes fail especially in out-of-domain scenarios -- training on one type of lie does not transfer well to deception scenarios involving other types of lies. In this work, we conduct a systematic study on how various factors impact detection performance: representation depth, probe expressivity, sparse feature representations, and the lie typology of the training data. To this end, we augment standard benchmark training data with a supplementary dataset containing diverse types of deception, including fabrication, omission, and exaggeration examples. Analyzing these factors across seven probe types, our experimental results show that the optimal representation depth is highly dataset-dependent, more expressive probes provide only selective gains over linear baselines, and sparse autoencoder features perform similarly to dense hidden states. Ultimately, we demonstrate that the choice of training data and lie typology substantially changes detectability, highlighting that deception detection is a highly representation-dependent problem.
72. 【2607.20476】Benchmarking Large Language Models on Multi-Sensor Physical Hazard Assessment
链接：https://arxiv.org/abs/2607.20476
作者：Faizan Iqbal
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：empirical benchmark evaluating, physical hazard data, large language models, language models assess, models assess multisensor
备注： 14 pages, 6 figures. Benchmark dataset, evaluation code, and raw results publicly available at: [this https URL](https://github.com/Faizaniqbal52/PhysicalHazardBenchmark)
点击查看摘要
Abstract:We present an empirical benchmark evaluating how five large language models assess multisensor physical hazard data. Testing 60 scenarios across three categories - multi-sensor joint assessment, response proportionality, and pattern disambiguation - with 1,800 API calls at temperature 0.0, we find that all tested models consistently produced no precautionary warning signal across the tested scenarios where multiple sensors are simultaneously elevated below their individual safety limits, while achieving near-perfect accuracy on single-sensor threshold violations. All five models (ChatGPT-4o, Gemini 2.5 Flash, DeepSeek, Kimi, Llama 3.1 8B) score near zero on Category A multi-sensor scenarios (Q2: 0.000-0.208; Q3: 0.000-0.592) compared to strong performance on single-sensor scenarios (Category B Q1: 0.975-1.000). Structured tabular formatting shows no consistent advantage over plain prose; ChatGPT-4o performs significantly better under prose (p = 0.001). These findings have direct implications for practitioners deploying the tested models in physical safety monitoring systems.
73. 【2607.20475】SonicSampler: Unified Tile-Aware Kernels for LLM Sampling and Speculative Verification
链接：https://arxiv.org/abs/2607.20475
作者：Pragaash Ponnusamy,Shivam Sahni,Jue Wang,Tri Dao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：LLM inference comprises, CUDA Graph execution, inference comprises, comprises a combinatorial, combinatorial set
备注： 26 pages, 12 figures
点击查看摘要
Abstract:Sampling in LLM inference comprises a combinatorial set of logit processing, token selection, and verification operations for speculative decoding. However, existing implementations either accelerate only subsets of this pipeline, rely on multiple kernel launches, or assume homogeneous sampling behavior across a batch, limiting support for dynamic serving workloads and preventing efficient CUDA Graph execution. We present $\textbf{SonicSampler}$, a unified suite of tile-aware Triton kernels that vertically fuses the complete sampling pipeline into a fixed, workload-aware execution model. Our kernels support dynamic per-request sampling behaviors, including grammar-constrained decoding, repetition, frequency and presence penalties, logit bias, temperature scaling, top-$k$ / top-$p$ / min-$p$ filtering, and speculative verification - within a single batched kernel while remaining fully CUDA Graph-compatible. Central to our approach is a novel hierarchical two-stage top-$k$ algorithm that achieves up to $\textbf{10x speedup}$ over competitive baselines and exploits the low-entropy structure of LLM outputs to enable efficient selection over large vocabularies. Across heterogeneous speculative decoding workloads, SonicSampler achieves up to $\textbf{16x speedup}$ over state-of-the-art baselines while preserving flexible batched execution.
74. 【2607.20465】DataPrep-Bench: Benchmarking LLMs as Training Data Preparators
链接：https://arxiv.org/abs/2607.20465
作者：Hao Liang,Qifeng Cai,Yibo Lin,Jianzhuo Du,Qifeng Xia,Sizhe Qiu,Linzhuang Sun,Meiyi Qiang,Zhaoyang Han,Xiaochen Ma,Bohan Zeng,Ruichuan An,Conghui He,Wentao Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：training data end, data fundamentally determines, large language models, training data fundamentally, prepare training data
备注：
点击查看摘要
Abstract:The quality of training data fundamentally determines the capabilities of large language models (LLMs), yet no unified benchmark exists to measure how well LLMs, agents, and data-centric workflows actually prepare training data end to end. We view LLM-driven data preparation as comprising two complementary capabilities: data construction, which transforms raw sources into supervised training data, and data quality evaluation, which predicts the training value of candidate datasets before downstream training; throughout, "quality" refers to downstream training utility rather than surface-level textual properties. We introduce DataPrep-Bench, the first unified benchmark that jointly evaluates both capabilities under a shared downstream-grounded protocol over six domains and multiple base models. For data construction, methods consume identical raw sources and are scored by fine-tuning a base model on their outputs jointly with Dolly-15k; alongside this track we release Data-Construction-Skill, a skill-guided agent that lifts the Dolly-only baseline by nearly 20 points absolute on Llama-3.1-8B Finance and is competitive with the strongest agent- and DataFlow-based methods in knowledge-extraction-dense domains. For data quality evaluation, scoring functions are scored by Pearson correlation with downstream performance on a shared candidate pool; we release the Distributional Alignment Score (DAS), a distribution-based evaluator that uses MMD between a candidate dataset and a domain proxy. DAS attains the strongest cross-model correlation in four of six domains and is the only metric clearing r 0.70 simultaneously in Math, Science, and Medical, outperforming existing quality-, diversity-, and heuristic-based evaluators. DataPrep-Bench provides a unified, downstream-grounded framework for measuring progress on both capabilities as co-equal targets of LLM-driven data preparation.
75. 【2607.20461】Can Valence Reflect Morality in Natural Language? A Preliminary Annotation Study
链接：https://arxiv.org/abs/2607.20461
作者：Jonny O'Dwyer,Malika Bendechache,Louise McCormack,Elif Calik,Ramin Ranjbarzadeh,Dost Muhammad,Shokofeh Anari Bozcheloei,Ishita Singh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Kantian Deontological ethics, artificial intelligence, implementations of artificial, Moral Foundations Theory, Commonsense Norm Bank
备注： 8 pages, 2 figures, submitted to the 36th Irish Signals and Systems Conference
点击查看摘要
Abstract:Present implementations of artificial intelligence (AI) ethics do not adequately take feelings, or affect, into account. If AI should be aligned with human ethics, it seems reasonable to thoroughly investigate the possibility of AI behaviour that mirrors virtuous human ethical conduct, where feelings play a role in the actions, judgements or statements one makes. Furthermore, while prominent theories of normative ethics are often discussed in terms of their differences and shortcomings, Virtue, Consequentialist, and Kantian Deontological ethics all share a common feature of considering human feeling to some degree while the popular descriptive ethics theory, Moral Foundations Theory, positions feelings as central to many of its foundations. Therefore, in the present paper, a data set of moral valence is proposed, consisting of 500 annotations by six human participants for both action/judgement and consequence moral valence, ranging from -1 to 1 for text-presented scenarios from the Commonsense Norm Bank data set. The resulting valence features share significant relationships with multi-class (immoral/discretionary/moral) and binary immoral/moral categories while additionally providing a noteworthy test set Matthew's correlation coefficient of 0.764 using regularised logistic regression for binary classification. This provides early evidence of the usefulness of valence features for morality estimation of text, indicating that valenced consequences of responses for others can be considered toward more human morally-aligned AI. In the interest of promoting further affective-moral computing research, this study's annotations will be made available for research on request.
76. 【2607.20460】Instruct-FD: Can Your Full-Duplex Speech System Follow Turn-Taking Instructions?
链接：https://arxiv.org/abs/2607.20460
作者：Yuzhi Tang,Wentao Ma,Xiling Zhao,Ahmad Salimi,Sepehr Harfi Moridani,Dongming Shen,Jixuan Wang,Abdulrahman Abdulrazzag,Murdock Aubry,Yu-Hua Chen,Daniel Lee,Jaewon Lee,Jonah Mackey,Silin Meng,Nicholas Stranges,Chenxu Xiong,Hao Yu,Yi Zhu,Mu Li,Alex Smola
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：produce fluid interactions, fluid interactions, explicitly instructed, Current full-duplex, produce fluid
备注：
点击查看摘要
Abstract:Current full-duplex (FD) spoken dialogue systems can produce fluid interactions, yet it remains unclear whether they can adapt their turn-taking behavior when explicitly instructed. This is critical for real-world deployment, where conversational policies vary across applications (e.g., proactive tutoring vs. passive counseling). We introduce Instruct-FD, an instruction-conditioned benchmark for evaluating controllable turn management in FD systems. To enable this, we develop a human-validated, scalable synthetic pipeline that generates instruction-conditioned conversations, along with a deployment-agnostic multi-turn evaluation protocol and an LLM-based judge. Benchmarking six state-of-the-art full-duplex systems reveals a substantial gap in instruction-following turn management: the best model achieves only 64.4% adherence. Performance is highly uneven across behaviors and scenarios, with proactive behaviors such as model backchanneling and interruption remaining particularly challenging. These findings establish instruction-following turn management as a crucial direction for building adaptable and deployable full-duplex dialogue systems.
77. 【2607.20459】HOR: A Theta-Gamma Hierarchical Oscillatory Reasoning Framework for Multi-hop QA
链接：https://arxiv.org/abs/2607.20459
作者：Ziyang Ling,Ronald X. Xu,Mingzhai Sun
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：answering requires retrieving, question answering requires, Multi-hop question answering, multiple contexts, answering requires
备注：
点击查看摘要
Abstract:Multi-hop question answering requires retrieving and integrating evidence from multiple contexts. Despite the rapid progress of current research, multi-hop reasoning remains constrained by two persistent limitations: attention decay, where the model's focus on main question degrades as the reasoning chain grows, and error accumulation, where mistakes propagate across hops and compounds into final failure. Inspired by Theta-Gamma hierarchical oscillation which decouples global planning from local retrieval, enabling efficient attention transfer between hops and a verification and repair mechanism that interrupts the accumulation of errors in the wrong paths, we present THOR, a brain-inspired Theta-Gamma hierarchical oscillatory reasoning framework. Extensive comparative experiments and specific validation experiments on multi-hop QA benchmarks demonstrate that THOR improves answer accuracy and robustness while mitigating limitations, showcasing its generalization across different backbones.
78. 【2607.20458】CAMeR: Keyword-Gated Hybrid Activation for Adaptive Memory Retention in LLM Agents
链接：https://arxiv.org/abs/2607.20458
作者：Haowen Lai
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language model, extended dialogues accumulate, dialogues accumulate vast, accumulate vast amounts, apply uniform forgetting
备注：
点击查看摘要
Abstract:Large language model (LLM) agents operating over extended dialogues accumulate vast amounts of information, yet existing memory systems either retain everything indiscriminately or apply uniform forgetting heuristics that fail to distinguish relevant from irrelevant knowledge. We present CAMeR (Context-Activated Memory Reinforcement), a memory retention framework combining keyword-gated hybrid activation -- a joint symbolic (word-level Jaccard) and sub-symbolic (embedding cosine) gating mechanism -- with adaptive weight dynamics. CAMeR computes a hybrid similarity score for each memory-query pair; memories exceeding a threshold receive reinforcement while all memories undergo controlled decay. We introduce CAMeR-Bench, a 76-memory, 100-round benchmark spanning 8 topic clusters with graded activation frequency, designed to test adaptive retention where existing benchmarks (LoCoMO, LongMemEval) cannot. On CAMeR-Bench, CAMeR's keyword gate achieves a 1.6$\times$ larger retention gap between high-frequency and never-referenced memories compared to embedding-only gating (scissors gap: 0.039 vs. 0.024), while time-driven baselines (Oblivion, SuperLocalMemory) collapse to near-zero weights over 100 rounds. CAMeR's top-5 retrieval saves 83.2\% tokens versus full-context approaches (39k vs. 231k cumulative) while producing weight signals that improve retrieval precision. Through 8 ablation conditions we establish that the keyword gate -- not learnable decay -- is the primary performance driver at this scale. Our findings demonstrate that hybrid symbolic-neural gating provides a simple yet effective mechanism for adaptive memory retention in LLM agents.
79. 【2607.20457】Dropping the Anchor: Statistical Context Summarization for Distributed Systems via Pulsar Attention
链接：https://arxiv.org/abs/2607.20457
作者：Aryan Sood,Shantanu Acharya
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, computationally expensive due, Inference with large, Star Attention, language models
备注：
点击查看摘要
Abstract:Inference with large language models (LLMs) on long sequences is computationally expensive due to the quadratic complexity of self-attention. Distributed blockwise methods such as Star Attention reduce this cost by sharding context across hosts, but rely on prepending a static, content-blind copy of the first block to every host. We propose Pulsar Attention, which replaces the static anchor with two lightweight, content-aware components: a small attention-sink prefix that stabilizes softmax, and compact cross-block summaries built via a Max-IDF heuristic that selects chunks containing globally rare tokens. This reduces the Phase 1 per-GPU FLOPs by up to 3.3$\times$ over Star Attention while retaining an identical KV cache footprint. On RULER and BABILong with Llama-3.1-8B, Pulsar Attention outperforms both Star Attention and dense attention at sequence lengths up to 128K tokens, with absolute gains of up to 4.7% over the dense baseline.
80. 【2607.20456】Learn2Zinc: Fine-tuning Small Language Models for Text-to-Model Translation in MiniZinc
链接：https://arxiv.org/abs/2607.20456
作者：Serdar Kadioglu,Karthik Uppuluri
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, mainstream programming languages, Large language, small language models, struggle with rare
备注： CP 2026 Workshop on LLMs meet Constraint Solving
点击查看摘要
Abstract:Large language models excel at code generation for mainstream programming languages but struggle with rare, domain-specific languages such as MiniZinc, a constraint modeling language for combinatorial problems. We investigate whether targeted fine-tuning can teach small language models (0.6B to 20B parameters) to generate syntactically correct and semantically valid MiniZinc models from natural language problem descriptions. Our key finding is that syntax errors dominate failures when working with this domain specific language: the out-of-the-box execution accuracy of small language models such as Qwen3, LLaMa, Gemma, and GPT-OSS is near-zero. We propose a cross-model error bootstrapping approach that collects syntax errors from multiple LLM runs and leverage those to curate an error correction training dataset. This dataset allows us fine-tune small language models that consistently improves both direct code generation and chain-of-thought approaches across all model sizes. With self-reflection and ensembling, our approach achieves up to 98\% execution accuracy. In parallel, solution accuracy still remains at 35\%, indicating that while syntax is learnable, constraint reasoning remains a challenge. We contribute our fine-tuning pipeline, datasets, and models to opens-source for further research on text-to-model translation.
81. 【2607.20455】RE-AD: Real-Time Requirement Adherence for Data Labeling
链接：https://arxiv.org/abs/2607.20455
作者：Siddarth Malreddy,Ishan Nigam,Akshay Arora,Nikhil Mittal,Subrat Sahu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Models, frontier Large Language, Human-annotated data remains, training frontier Large, Language Models
备注： Accepted to The Fifth Generation, Evaluation Metrics Workshop (GEM) workshop at ACL 2026
点击查看摘要
Abstract:Human-annotated data remains fundamental to training frontier Large Language Models (LLMs). However, crowd-sourced annotations often suffer from quality issues stemming from annotator misunderstanding or lack of engagement. To address this, we introduce a real-time requirement adherence (RE-AD) framework that leverages LLMs to proactively validate labeling quality. Our methodology involves decomposing Standard Operating Procedures (SOPs) into atomic rules via self-reflection, categorizing them by complexity, and applying tiered validation strategies. Evaluated on a synthetic benchmark, the system achieved an F1 score of 0.749. Furthermore, production deployment resulted in annotators accepting and fixing 82% of the errors flagged by the framework. We include ablation studies to demonstrate the impact of our core design decisions.
82. 【2607.20454】Response drift across frontier large language models
链接：https://arxiv.org/abs/2607.20454
作者：Mohammed Aledhari,Ali Aledhari,Fatimah Aledhari,Gowtham Venkat Eathamokkala,Mohamed Rahouti
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：frontier large language, large language models, drift remain uncharacterised, producing outputs, expert-validated references
备注：
点击查看摘要
Abstract:All frontier large language models (LLMs) exhibit response drift -- producing outputs that deviate from expert-validated references -- yet the magnitude and structure of this drift remain uncharacterised by systematic human evaluation. Here we report a fully crossed evaluation in which 47 geographically diverse participants each assessed all 62 multidomain questions across ten frontier LLMs under blinded conditions, yielding 29,140 independent assessments. Every model drifts, but drift magnitude varies substantially: eight models converge on a statistically indistinguishable ceiling (78-81% deviation), while two achieve lower deviation (47-49%). Drift profiles differ across six domains and 62 questions, with pairwise correlations among ceiling models exceeding r = 0.85. Automated similarity metrics explain less than 2% of variance in human judgements. These findings reveal that response drift is universal across frontier LLMs, domain- and question-dependent in structure, and accessible only through human-centred evaluation.
83. 【2607.20453】A Knowledge-Injection Framework for Zero-Shot Adaptation of LLMs to Delirium Prediction
链接：https://arxiv.org/abs/2607.20453
作者：Jessica Sena,Shesadree Priyadarshani,Miguel Contreras,Bharat Gandhi,Scott Siegel,Subhash Nerella,Parisa Rashidi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large language models, Large language, incomplete domain knowledge, language models show, models show promise
备注：
点击查看摘要
Abstract:Large language models show promise for clinical prediction, but zero-shot performance on specialized tasks is limited by incomplete domain knowledge, especially for smaller locally deployable models. We present a lightweight knowledge-injection framework for zero-shot ICU delirium prediction that augments a deterministic natural-language summary of structured electronic health record data with an external clinical knowledge report at inference time, without fine-tuning or retrieval. We evaluate LLaMA 3.1 8B and LLaMA 3.3 70B on 3,160 ICU admissions from the MIMIC IV dataset. Adding a clinically meaningful external knowledge report improves AUROC by 8.57 percentage points for the 8B model and 1.99 percentage points for the 70B model compared to no external knowledge. Relative to a GPT-5.2 frontier-model reference without external knowledge report (AUROC 68.86%), knowledge injection reduces the performance gap from 15.66 to 7.09 AUROC points for LLaMA 8B and from 5.30 to 3.31 AUROC points for LLaMA 70B. Random control reports do not improve performance and often degrade it, indicating that gains depend on clinically meaningful content rather than added prompt length alone. SHAP-based attribution further confirms that the injected knowledge is actively used during prediction. These findings suggest that inference-time knowledge injection can narrow the gap between locally deployable open-weight models and frontier closed models while preserving a practical, privacy-preserving workflow for resource-constrained clinical settings.
84. 【2607.20451】Semantic Field Theory: Historical Origin, Higher-Order Interaction, and Stabilized Semantic Inference
链接：https://arxiv.org/abs/2607.20451
作者：Dimitris Vartziotis
类目：Computation and Language (cs.CL)
关键词：strong anti-formalist readings, higher order composition, proposed computational model, computational model class, philosophical critique
备注： 20 pages
点击查看摘要
Abstract:Semantic Field Theory (SFT) has developed from a philosophical critique of strong anti-formalist readings of language games into a proposed computational model class for lexical semantics, higher order composition, and stabilized interpretation. This paper reconstructs that evolution and gives SFT a sharper mathematical core suitable for independent evaluation in computational linguistics and representation learning. The central proposal is that a tractable level of linguistic organization can be modeled through lexical representations expressed as semantic fields, through contextual deformation of those fields, through interaction terms defined over subsets of tokens, and through stabilization governed by semantic energy dynamics. The paper contributes five formal elements. First, it defines a semantic field model as a tuple consisting of a semantic space, a lexical field lifting, a contextual deformation map, an interaction complex, and an interpretation functional. Second, it proves a Gaussian product closure result showing that multiplicative field interactions have explicit centers, precisions, and compatibility factors. Third, it generalizes the three-word problem by using Mobius inversion on the subset lattice to isolate irreducible semantic interactions of arbitrary order. Fourth, it introduces an order spectrum that measures how much field mass is explained at each interaction order. Fifth, it formulates stabilized interpretation as minimization of an energy functional associated with the sentence and gives existence, descent, and stability conditions. A small worked example shows how a three-word summer day triple can be represented by Gaussian semantic fields, implemented in Python, and summarized by a flow diagram. The result is not a completed theory of natural language meaning and does not replace social, pragmatic, or normative accounts of language.
85. 【2607.20450】ShriNep@EEUCA 2026: RAKSHAK - Multi-Task DeBERTa with Rationale Distillation and Jigsaw-Augmented Training for Toxic Intent Classification
链接：https://arxiv.org/abs/2607.20450
作者：Binayak Karki,Aryan Kafle,Pingala Ghimire
类目：Computation and Language (cs.CL)
关键词：GameTox Shared Task, requires classifying World, Tanks chat utterances, EEUCA at ACL, Shared Task
备注： 8 pages, 1 figure, EEUCA, ACL 2026
点击查看摘要
Abstract:This paper presents two systems for the GameTox Shared Task at the Workshop on EEUCA at ACL 2026, which requires classifying World of Tanks chat utterances into six fine-grained toxic intent categories (Labels 0-5). Severe class imbalance, domain-specific multilingual slang, and extremely scarce data for rare categories such as Threats (Label 4, 60 samples) and Extremism (Label 5, 24 samples) make this a challenging classification problem. Our primary submission, RAKSHAK (rak s. aka, Sanskrit for "Protector"), is a multi-task DeBERTa-v3-base (He et al., 2022) framework combining rationale distillation from Qwen2.5-14B (An et al., 2024), Supervised Contrastive Loss, and dedicated rare-class binary heads. RAKSHAK's training data is augmented with cross-domain transfer from the Jigsaw Toxic Comment dataset (16,225 samples mapped to Labels 1-4) and 100 LLM-generated extremism samples for Label 5. Our secondary system (M1) fine-tunes DeBERTa-v3-base with Focal Loss on the original GameTox data plus the same 100 extremism samples, without Jigsaw transfer. RAKSHAK achieves a Macro F1 of 0.5883 on the official test set, ranking 7th out of 35 participating teams, while M1 achieves 0.5252 Macro F1. An ablation comparing M1 with and without Jigsaw data shows that cross-domain transfer accounts for +2.6 F1 points, while RAKSHAK's multi-task architecture contributes a further +3.7 points.
86. 【2607.20449】he Storyteller in the Model: Narrative Pattern Inheritance, Escalation Dynamics, and Alignment Governance in LLMs
链接：https://arxiv.org/abs/2607.20449
作者：Adam Rigby,Raz Saremi,Azadeh Sohrabinejad,Mehdi Rahimi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：narrative conventions embedded, human-authored text, trained predominantly, predominantly on human-authored, conventions embedded
备注： 2 figures, 11 pages
点击查看摘要
Abstract:LLMs are trained predominantly on human-authored text, yet the structural and narrative conventions embedded in that text are rarely examined as a source of systematic behavioral influence, or as a governance risk in deployed systems. This paper considers whether the storytelling patterns inherent in published human writing, including archetypal roles such as protagonist, antagonist, and underdog, as well as tension-and-resolution narrative arcs, are absorbed during training and subsequently surface in LLM outputs, causing responses to drift toward unexpected, adversarial, or rhetorically enticing behaviors over extended interactions. Through a systematic literature review and cross-paper analysis of recent empirical studies on LLM alignment, persona dynamics, emergent misalignment, and user interaction patterns, we observe evidence bearing on this hypothesis. The findings reveal three key patterns. First, LLMs reproduce statistical patterns from their training data rather than reasoning independently. Second, measurable latent traits, including sycophancy and deceptiveness, emerge reliably across unrelated prompts. Third, fine-tuning on a narrow narrative task can produce unintended behavioral changes well beyond that task. Furthermore, evidence suggests that persuasive, narrative-style outputs are among the most common LLM products in real-world usage, amplifying these risks. Narrative drift constitutes an unmonitored escalation pathway in deployed AI systems, one that evades discrete-incident detection mechanisms and requires dedicated monitoring instruments.
87. 【2607.20448】Domyn-Small: A European 10B Reasoning Language Model
链接：https://arxiv.org/abs/2607.20448
作者：Simone Angarano,Francesco Bertolotti,Federico D'Ambrosio,Michele Resta,Alessandro Rognoni,Nicolò Ruggeri,Dario Salvati,Andrea Valenti,Alberto Veneri,Martin Cimmino
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：MIT license, open-weight reasoning language, language model released, reasoning language model, introduce Domyn-Small
备注： 27 pages, 5 figure
点击查看摘要
Abstract:We introduce Domyn-Small, a 10-billion-parameter open-weight reasoning language model released under the MIT license. Domyn-Small is the product of an initial pre-training phase on 9 trillion tokens multilingual data, followed by a post-training pipeline for reasoning, instruction following, and context extension. For the latter, we performed a Continued Pre-Training (CPT) phase that doubles the native context window to 32K tokens, followed by SFT with a math-focused annealing run. Finally, the RL phase includes GRPO with verifiable rewards, DPO, and a multi-environment GRPO stage spanning five task domains: mathematics, code, multiple-choice QA, instruction-following, and tool calling. The 32K-token native context extends to 128K at inference via YaRN, and a chat-template toggle enables dual-mode reasoning. Against peer models in the 7--10B class (Qwen3.5-9B, OLMo-3-7B-Think, Nemotron-Nano-8B, Ministral-3-8B), Domyn-Small achieves a strong accuracy-efficiency balance: it produces roughly one-third as many tokens as Qwen3.5-9B and approximately 35% of OLMo-3-7B-Think's token budget on core reasoning benchmarks, while delivering strong instruction-following (IFEval 79.9) and competitive science reasoning (GPQA-Diamond 50.0). We release the weights and the post-training recipe alongside Domyn Swarm (Apache~2.0), an open-source framework for scalable LLM inference on HPC clusters developed during this program and used throughout this work.
88. 【2607.20447】haulab@EEUCA 2026: Who Said What to Whom? A Targeting-Aware Neural-Symbolic Pipeline for Gaming Toxicity Detection
链接：https://arxiv.org/abs/2607.20447
作者：Anmol Guragain,Marcos Estecha-Garitagoitia,Luis Fernando D'Haro Enríquez,Ricardo de Córdoba
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Shared Task, Task on toxicity, paper describes, toxicity classification, gaming chat
备注：
点击查看摘要
Abstract:This paper describes our system for the EEUCA 2026 Shared Task on toxicity classification in gaming chat. We implement a three-stage pipeline combining an ensemble of two compact transformers (DeBERTa-v3-base, 184M; XLM-RoBERTa-base, 278M) with a Linguistically-Informed Mediator (LIM) that resolves inter-model disagreements through corpus-backed lexical normalization, class-conditional unigram scoring, multilingual profanity detection, and agentive targeting analysis grounded in speech act theory. The LIM specifically targets the minority classes (Hate \ Harassment, Threats, and Extremism), which are the most safety-critical categories in real-world gaming moderation. To address the extreme class imbalance (1{,}450:1 Non-toxic to Extremism ratio), we introduce a two-stage data augmentation strategy using only the provided training data. Our system achieves a Macro F1 of 0.6441 and accuracy of 0.9062 on the official test set, ranking 3rd in Macro F1 and 1st in accuracy among all teams. The proposed pipeline is domain-portable: adapting to other gaming platforms requires substituting only the game-specific entity lexicon. Code is publicly available at this https URL\_EEUCA.
89. 【2607.20446】Distinguishing Artificial from Authentic: Evaluating LLMs for Detecting LLM-Generated Content
链接：https://arxiv.org/abs/2607.20446
作者：Juho Leinonen,Paul Denny
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：large language models, generate natural language, natural language responses, language models, large language
备注： 8 pages, 5 figures, 3 tables
点击查看摘要
Abstract:As large language models (LLMs) are increasingly used by students to generate natural language responses and program code, there is growing interest in whether LLMs themselves can be used to distinguish AI-generated work from human-authored submissions. In this paper, we investigate the extent to which LLMs can detect their own generated content across multiple educational task types, including programming exercises, reflective writing, and short-answer questions. Using authentic student responses and multiple variants of LLM-generated answers, we evaluate detection performance under different prompting strategies and output formats. Our study addresses three research questions: (1) how accurately LLMs can identify their own outputs across task domains, (2) how detection effectiveness is influenced by factors such as prompt design, response length, and task type, and (3) what characteristics of LLM-generated responses contribute to successful or failed detection. Our findings show that LLM-based detection is highly task-dependent: detection is substantially more reliable for programming tasks and longer reflective responses, but performs poorly for short-answer questions, where LLMs frequently judge their own outputs as more human-like than authentic student responses. We further find that prompt framing and response verbosity have a pronounced effect on detectability in reflective writing tasks, with relatively minor prompt variations significantly reducing detection accuracy, while programming-related detection is more robust to prompt changes. Together, these results highlight both the potential and the limitations of LLM self-detection in educational settings and suggest caution in relying on LLMs as standalone tools for identifying AI-generated student work.
90. 【2607.20445】SCoPE: Shift-Aware Speaker-Conditioned Priors for Emotion Recognition in Conversations
链接：https://arxiv.org/abs/2607.20445
作者：Burak Can Kaplan,Stefan Wermter
类目：Computation and Language (cs.CL); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：multiple utterances, emotions, multimodal, human emotions, multimodal evidence
备注： Under review at Cognitive Computation
点击查看摘要
Abstract:In conversations, human emotions are transient; however, they tend to persist across multiple utterances. For example, we rarely switch instantly between contrasting emotions such as happiness and anger. Instead, emotions tend to evolve smoothly, and these patterns are often speaker-specific. Some people might escalate, while others gradually cool down over time. Furthermore, when emotions change during a conversation, they are often driven by contextual factors, such as newly received information or unexpected events. Even though progress has been made in Emotion Recognition in Conversations (ERC), most existing approaches still rely heavily on overt evidence and do not sufficiently model these non-apparent factors. Especially in multimodal settings, this makes these models fragile when the signals are noisy (e.g., occluded faces, slang expressions, or microphone noise). To address these limitations, we introduce Speaker-Conditioned Priors over Emotions (SCoPE). SCoPE is a light weight module that utilizes the emotional history of each speaker and explicitly models their priors for use in subsequent emotion classification. Second, we incorporate emotion shift prediction, a well-established concept in ERC, to guide the model in balancing the priors from SCoPE and multimodal evidence. Finally, we propose a shift-aware fusion mechanism that performs precision-weighted logit integration between multimodal evidence and the speaker prior, forming a Bayesian-inspired product-of-experts formulation. This dynamic fusion allows the model to rely on historical priors when emotions persist and to prioritize multimodal evidence when shifts are likely. Experimental results show our model achieves superior performance over recent state-of-the-art models on the IEMOCAP dataset in multimodal settings.
91. 【2607.20444】Confidently Deceptive: How Confidence Amplifies the Risk of LLM Deception
链接：https://arxiv.org/abs/2607.20444
作者：Ali Asad,Stephen Obadinma,Anshul Pattoo,Wenxuan Zhang,Xiaodan Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, experimentally induced goal, Large language, induced goal, contextually or experimentally
备注：
点击查看摘要
Abstract:Large language models (LLMs) can produce deceptive responses: outputs that mislead users in service of a contextually or experimentally induced goal. Yet it remains unclear how confidently models deceive and whether higher confidence makes deceptive responses more persuasive to end users. In this paper, we study these basic questions in various models and different deception datasets. We provide a comprehensive study measuring confidence through both verbalized self-reports and a range of logit-based estimators. We show that LLMs deliver deceptive responses with substantial verbalized confidence and that human annotators prefer the higher-confidence deceptive response 78% of the time in paired comparisons. Misalignment fine-tuning amplifies the problem. Confidence in deceptive responses rises across all three benchmarks, increasing the resulting potential risk, with effects generalizing beyond the training distribution. Strikingly, models classify their own deceptive outputs as deceptive at high rates (82.7% under misalignment) while still predicting they would produce them - recognition without avoidance. We argue that confident deception is a distinct alignment risk requiring evaluations that jointly measure deception, confidence, and awareness.
92. 【2607.20443】GLAN-QnA-KR: A Seedless Taxonomy-Driven Korean Instruction Corpus
链接：https://arxiv.org/abs/2607.20443
作者：Daekeun Kim
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：openly redistributable Korean, redistributable Korean instruction-QA, GLAN synthesis pipeline, Korean instruction-QA corpus, pipeline with Microsoft
备注： Technical report; 7 pages, 4 tables. Dataset: [this https URL](https://huggingface.co/datasets/daekeun-ml/GLAN-qna-kr-300k)
点击查看摘要
Abstract:We release GLAN-QnA-KR, a 303,581-row openly redistributable Korean instruction-QA corpus produced via the seedless taxonomy-driven GLAN synthesis pipeline with Microsoft's Phi-3.5-MoE-instruct as the producer model (generation: 2024-12; release: 2024-12; licence: OpenRAIL). The corpus spans a flat taxonomy of 1,084 English-labelled disciplines paired with Korean question/answer text, a 100-900 difficulty scale, and a median of 313 question characters and 1,098 answer characters per record. Two properties are atypical for synthetic instruction data at this scale: (i) exact duplicate questions number only 1 in 303,581 rows and character-trigram near-duplicate clusters at Jaccard = 0.9 number zero in a 5,000-sample probe, and (ii) a two-layer contamination audit against KMMLU, KoBEST (five sub-tasks), and HAE-RAE-Bench shows a maximum test-vs-corpus question-level character-trigram Jaccard of 0.163 with zero test items at Jaccard = 0.7, and a maximum multilingual-E5 cosine of 0.901 with a single test item at cosine = 0.90 and zero at = 0.95, across 20,000 sampled GLAN questions and seven evaluation sets. At the time of release, this is, to our knowledge, the largest single-pipeline synthetic Korean instruction corpus verifiable on the Hugging Face Hub and the only Korean =100k-row corpus built under a seedless taxonomy-driven protocol. This note documents the generation protocol, corpus statistics, the contamination audit, and the licensing boundary in a form suitable for downstream citation.
93. 【2607.20442】Naver-News-KO: A Korean News Summarization Dataset for Open-Source Fine-Tuning of Summarization Models
链接：https://arxiv.org/abs/2607.20442
作者：Daekeun Kim
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Hugging Face Hub, window in July, collected from Naver, community-maintained Korean summarization, Korean summarization models
备注： Technical report; 7 pages, 1 figure, 4 tables. Dataset: [this https URL](https://huggingface.co/datasets/daekeun-ml/naver-news-summarization-ko)
点击查看摘要
Abstract:We release Naver-News-KO, a Korean news summarization dataset of 27,400 (document, summary) pairs collected from Naver News over a ten-day window in July 2022 across two categories (Economy and IT/Science; 77/23 split), with train/validation/test partitions of 22,194 / 2,466 / 2,740 and a mean per-record document-to-summary character-compression ratio of 6.03x. The dataset has been publicly hosted on the Hugging Face Hub since January 2023 and, as of May 2026, receives approximately 33,000 downloads per month; community-maintained Korean summarization models fine-tuned on it include Gemma-2B-ko and Gemma2-9B variants. This technical report (i) documents the collection protocol, the column schema, and the split construction, (ii) reports corpus-level statistics (length distributions, compression ratio, and a measured 16.8% near-duplicate title-Jaccard overlap between test and train that users should be aware of), (iii) positions the resource against other open Korean summarization corpora, (iv) provides a Lead-3 extractive reference point (ROUGE-1 55.1, ROUGE-L 50.6) and two reproducible fine-tuned baselines -- KoBART (R-1 56.6, BERTScore-F1 81.5) and Gemma-2B-ko with LoRA (R-1 55.3, BERTScore-F1 78.3) -- with release-time training scripts, and (v) clarifies the licensing and intended-use scope of the resource. The goal is to provide a citable reference for downstream work that already uses this dataset, not to propose a new benchmark.
94. 【2607.20441】Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets
链接：https://arxiv.org/abs/2607.20441
作者：Mykola Khandoga,Yevhen Kostiuk,Anton Polishko,Yurii Filipchuk,Kostiantyn Kozlov,Dmytro Zamriy,Artur Kiulian
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：information ecosystem produces, ecosystem produces beliefs, shape strategic decisions, ecosystem produces, shape strategic
备注： Accepted at UNLP 2026. 12 pages, 8 figures, 11 tables. Dataset available at [this https URL](https://huggingface.co/datasets/OpenBabylon/unlp-ukraine-forecasting)
点击查看摘要
Abstract:Every information ecosystem produces beliefs that shape strategic decisions. Both human analysts and AI systems inherit the blind spots of their information sources. We show that LLMs, combined with prediction markets, function as a calibrated instrument for measuring how far ecosystem-induced beliefs deviate from an external reference: LLMs extract the beliefs a text corpus implies, and prediction market price trajectories, anchored at resolution by realised outcomes, provide the calibration reference against which to quantify the deviation. We isolate the bias contribution of specific text through ablation: varying information context while holding the model fixed, with a contaminated model that knows actual outcomes as control. Applied to 111 Ukraine-related prediction markets, comprising approximately 93,000 predictions across four models, we find that English news context systematically biases territorial predictions, wrong 64 to 72 percent of the time when it pushes predictions toward territorial capture. A contaminated model that knows actual outcomes shows the same error rate, indicating that the bias originates primarily in the text. Supplementing with Ukrainian military-analytical sources reduces the bias for all clean models, while absolute-error gains are partial and model-dependent. We show that the distortion originates primarily in the sources, not the models. Consistent across four architectures, it will persist in any system that processes them and propagate into downstream decisions.
Comments:
Accepted at UNLP 2026. 12 pages, 8 figures, 11 tables. Dataset available at this https URL
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
ACMclasses:
I.2.7; I.2.6
Cite as:
arXiv:2607.20441 [cs.CL]
(or
arXiv:2607.20441v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.20441
Focus to learn more
arXiv-issued DOI via DataCite</p>
95. 【2607.20440】Answer-then-Edit: Reasoning Skeleton Editing for Anti-Distillation with Preserved Utility
链接：https://arxiv.org/abs/2607.20440
作者：Fan Li,Mengting Pan,Sijia Xu,Xiaoyang Wang,Chen Chen,Wenjie Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Proprietary large language, entail substantial intellectual, valuable intellectual property, Proprietary large, large language models
备注： 21 pages,8 figures
点击查看摘要
Abstract:Proprietary large language models (LLMs) entail substantial intellectual and financial investment, making them valuable intellectual property (IP). However, even when deployed via black-box APIs, these models remain vulnerable to unauthorized knowledge distillation, which allows adversaries to cheaply extract and replicate model capabilities. To address this issue, anti-distillation (AD) has been proposed to generate defensive outputs that hinder distillation effectiveness, overcoming the limitation of watermarking-based approaches that rely on post-hoc verification. However, existing AD methods based on internal model perturbations struggle to balance anti-distillability and utility (e.g., answer accuracy and naturalness) of reasoning traces, with stronger defenses often causing significant utility loss. To fill this gap, we propose \textbf{\underline{S}}keleton-\textbf{\underline{G}}uided \textbf{\underline{R}}easoning \textbf{\underline{E}}diting (SGRE), an \textit{Answer-then-Edit} framework that performs post-hoc trace modification for anti-distillation. In the answer stage, the teacher model first generates clean reasoning traces, preserving the original reasoning accuracy while enabling more flexible control over trace naturalness. In the editing stage, we draw inspiration from Cognitive Load Theory (CLT) and introduce a three-stage strategy consisting of reasoning skeleton extraction, skeleton graph coarsening, and skeleton verbalization. These operations jointly perturb reasoning structures and augment textual complexity to amplify extraneous load on student models, hindering their acquisition of underlying reasoning patterns. Extensive experiments across diverse LLMs demonstrate that SGRE achieves state-of-the-art performance in reducing distillation effectiveness, while maintaining lossless reasoning accuracy and superior trace naturalness.
96. 【2607.20439】AsymVerify at SemEval-2026 Task 6: Asymmetric Confidence-Gated Verification for Political Evasion Detection
链接：https://arxiv.org/abs/2607.20439
作者：Sebastien Kawada
类目：Computation and Language (cs.CL)
关键词：avoiding concrete commitment, Political evasion, concrete commitment, evasion is difficult, difficult to detect
备注： Accepted to SemEval-2026 Task 6 (CLARITY) at ACL 2026. Team AsymVerify placed 2nd of 41 teams on the official Subtask 1 leaderboard. Task: [this https URL](https://konstantinosftw.github.io/CLARITY-SemEval-2026/) . Code: [this https URL](https://github.com/kaons-research/AsymVerify-ACL) . Website: [this https URL](https://kaons.com/)
点击查看摘要
Abstract:Political evasion is difficult to detect because evasive answers often appear cooperative while avoiding concrete commitment. We present AsymVerify, a confidence-gated verification system for SemEval-2026 Task 6, a three-way classification of Clear Reply, Ambivalent, and Clear Non-Reply responses. AsymVerify scored 0.85 Macro F1 on the evaluation split (D_eval, n=237), placing 2nd out of 41 teams on the official leaderboard. The system first classifies each question-answer pair, then selectively applies downgrade verification (CR/CNR - AMB) or upgrade verification (AMB - CR) to low-confidence predictions. Development analysis shows that errors concentrate at the Ambivalent boundary in both directions, motivating this asymmetric two-verifier design while confidence gating keeps additional inference cost low. On D_dev (n=308), AsymVerify with GLM-4.7 gains +17.1 Macro F1 over single-pass classification at 1.48 calls/example, and the upgrade verifier alone improves every tested LLM backend on D_dev by +6.8 to +15.2 Macro F1 over its single-pass baseline. Code is available at this https URL.
97. 【2607.20438】Preference Tuning as Spectral Update Reorganization
链接：https://arxiv.org/abs/2607.20438
作者：Peiyan Zhang,Haibo Jin,Liying Kang,Haohan Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：remains largely opaque, largely opaque, Preference-based post-training, behavior remains largely, Preference-based
备注：
点击查看摘要
Abstract:Preference-based post-training is usually understood through endpoint behavior, yet the learned update that produces this behavior remains largely opaque. We study RLHF and related preference optimization through the spectral structure of their induced parameter updates. By decomposing effective LoRA updates and reloading their spectral components as plug-in modules, we turn preference-induced updates into objects that can be isolated, recomposed, and directly intervened on. Across model families, optimization algorithms, and supervision regimes, these updates consistently develop a spectral head--tail organization. A compact head emerges early and carries the dominant endpoint shift, while a heterogeneous residual tail remains. The split is functional rather than merely descriptive. Plug-in intervention shows that the head accounts for the visible behavioral departure from the base model, while the tail is weak in isolation. Cross-run recomposition further shows that mixed adapters follow the source of the head, indicating that the head carries run-level solver bias. This endpoint dominance does not imply learning sufficiency. Head-only learning is non-vacuous but fails to recover the full solution, especially on out-of-distribution behavior. Tail-only learning yields little visible gain, yet the full solution is not recovered without the tail. These findings recast preference post-training as structured update reorganization rather than a monolithic behavioral correction, and suggest that alignment gain and coverage loss are tied to how the learned update itself is organized.
98. 【2607.20437】opoGuard: Graph Theory Based Defenses Against Split-Knowledge Attacks on RAG
链接：https://arxiv.org/abs/2607.20437
作者：Chahana Dahal,Zuobin Xiong
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：Retrieval Augmented Generation, Augmented Generation, Production Retrieval Augmented, answer complex queries, aggregating multiple external
备注：
点击查看摘要
Abstract:Production Retrieval Augmented Generation (RAG) systems rely on aggregating multiple external documents to answer complex queries. However, the retrieved documents introduce a new threat surface that can be exploited to launch split-knowledge attacks. In this attack, the adversary injects documents that are individually benign but create false associations when combined and fed to language models. This paper shows that the new attack is structurally invisible to existing per-document filters, like LlamaGuard. To address this issue in RAG, this work introduces TopoGuard, a family of graph theory-based methods specifically targeting the split-knowledge attacks by building a semantic similarity graph from retrieved documents and detecting contexts with malicious topology. Grounded on the theoretical analysis, the TopoGuard family has been proven to be effective and robust even with noisy inputs. Extensive experiments are conducted on two retrieval datasets and compared with multiple baseline methods. Specifically, the TopoGuard-$\lambda_2$+Entity catches 21$\times$ more attacks than LlamaGuard-2-8B at 1\% FPR (32.6\% vs 1.5\% recall) on the HotpotQA dataset. Compared with production RAG detection systems using large language models, the proposed TopoGuard variants run efficiently at sub-millisecond latency and stay robust under adaptive adversaries and benign cross-domain queries.
99. 【2607.20436】Routing Subspaces: Auditing Evaluation-to-Deployment Mismatch in Fine-Tuned Language Models
链接：https://arxiv.org/abs/2607.20436
作者：Phongsakon Mark Konrad,Toygar Tanyel,Serkan Ayvaz
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)
关键词：testing reflects behavior, break this assumption, evaluations often assume, observed during testing, testing reflects
备注：
点击查看摘要
Abstract:Safety evaluations often assume that behavior observed during testing reflects behavior in ordinary use, but fine-tuning can break this assumption. A checkpoint can appear fixed under evaluation-style prompts while the same behavior persists under ordinary-use prompts. Output scores reveal this mismatch but do not locate it. We investigate whether the distinction is encoded in a stable internal site and introduce an approach that fits a paired activation contrast at a path-patching-informed mid-depth window, then modifies the resulting coordinate on held-out prompts. The intervention closes the evaluation-to-deployment gap in ten of twelve model--behavior settings (six of the eight settings with $n{\geq}120$ paired questions) across four full-matrix instruction-tuned model instances; a fifth model supports localization and edit-provenance checks, and deployment-framed rates change by at most $6.1$pp. The two flat cells, both sycophancy, indicate that a single-coordinate audit is not sufficient when the installed distinction is higher-rank or missed by the depth heuristic. The audit is a diagnostic for fine-tuned checkpoints, not a training-time defense or a guarantee of deployment safety.
100. 【2607.20435】Making Open-Source Text LLM Watermarks Durable Against Merging
链接：https://arxiv.org/abs/2607.20435
作者：Luisa Scharff,Thibaud Gloaguen,Robin Staab,Martin Vechev
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Open-source LLMs, prompting prior works, embedding text watermarking, watermarking algorithms directly, prompting prior
备注：
点击查看摘要
Abstract:Open-source LLMs (OSMs)arereaching near state-of-the-art performance, prompting prior works to trace the text they generate by embedding text watermarking algorithms directly into their weights. Yet, OSMs are subject to post-training modifications, which has been shown to remove the watermark. Model merging in particular, a prominent method used for combining expert knowledge and preventing catastrophic forgetting, strongly removes such OSM watermarks. A key question is how to enable OSM watermarks that survive subsequent merging. In this work, we show for the first time how to design an OSM watermark that is durable against model merging. We propose Merge-Adversarial Training, an adversarial training algorithm to distill text watermarks into model weights while being robust to subsequent model merging. Our approach consistently outperforms all baselines (e.g. with SLERP up to +51 percentage points (pp) TPR@1%FPR with +25 pp on average) while preserving downstream capabilities. We also for the first time evaluate OSM watermarks against realistic merge scenarios, representing common use-cases such as combining expert capabilities or preventing catastrophic forgetting, and with 3 prominent merging algorithms. More broadly, our findings suggest that adversarial training is a reliable approach for increasing OSM watermark durability against post-training modifications.
101. 【2607.20434】Break Through the Compression Bottleneck: From Theory to Practice
链接：https://arxiv.org/abs/2607.20434
作者：Xiusheng Huang,Lu Wang,Yequan Wang,Jun Zhao,Kang Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：language models continues, Large Language Models, continues to grow, language models, effective model compression
备注： 18 pages, 3 figures,
点击查看摘要
Abstract:As the parameter size of language models continues to grow, effective model compression is required to reduce their computational and memory overhead. Existing compression methods suffer from bottleneck issues: when the compression ratio is increased, performance degrades significantly. Low-rank decomposition and quantization are two prominent compression methods that have been proven to significantly reduce the computational and memory requirements of Large Language Models (LLMs) while maintaining model accuracy. Evidently, combining these two methods will break through the existing compression bottleneck. However, how these two methods interact when combined remains a critical question for developers, as many assume they are orthogonal, meaning their combination would not introduce additional errors beyond those independently introduced by each method. This paper provides the first mathematical proof that low-rank decomposition and quantization are non-orthogonal. We validate these findings through a series of experiments on large language models. Our results demonstrate that these methods are non-orthogonal, and their combination leads to significant performance degradation. Importantly, we propose a novel approach Diagonal Adhesive Method (DAM), which can effectively combine the two methods and mitigate the performance loss. Our research provides deep insights into model compression and lays a solid theoretical and experimental foundation for future related studies.
102. 【2607.20433】Moir: Let the Model Direct Its Own Story for Robust Cross-Domain Knowledge Editing
链接：https://arxiv.org/abs/2607.20433
作者：Jea Kwon,Jiwon Kim,Dong-kyum Kim,Meeyoung Cha
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：world evolves continuously, language models remain, models remain frozen, training state, evolves continuously
备注：
点击查看摘要
Abstract:While language models remain frozen at their training state, the world evolves continuously. Knowledge editing has emerged as a key alternative to full retraining, but its deployment is bottlenecked by the erosion of core capabilities: mathematical and programmatic reasoning collapse while encyclopedic recall remains intact. We trace this asymmetric degradation to a distributional mismatch. Covariance-based editors preserve only the subspaces spanned by their reference corpus, but fail to capture the operative distribution shaped by post-training such as SFT and DPO. Static external corpora, including Wikipedia and even the original pretraining mixture, cannot recover this shifted manifold. We propose Moir, which estimates the preservation covariance $C$ directly from the model itself by sampling from its own decoding distribution. Seeding generation with a single random vocabulary token bypasses the instruction-following templates that otherwise dominate sampled outputs, exposing the broader subspaces the model has internalized. Moir requires no external data and serves as a drop-in component for any covariance-based editor, a practical advantage given that the pre- and post-training corpora of most modern LLMs are not publicly accessible. Across OLMo-2, Llama-3.1, and Qwen-3 (7-8B), under both MEMIT and AlphaEdit and in batch and sequential regimes, Moir consistently extends preservation in the most vulnerable domains, most strikingly on Qwen3-8B after 20,000 AlphaEdit batch edits, it retains 79.9% GSM8K accuracy compared to 10.9% with the Wikipedia baseline. These results suggest that aligning the preservation distribution with the model's operative distribution is a key factor in non-destructive editing, and that the model itself may be the most accessible source of that distribution for deployed systems.
103. 【2607.20432】Position: Natural Language Should Not Fully Replace Formal Languages
链接：https://arxiv.org/abs/2607.20432
作者：Eitan Wagner,Elisha Rosensweig,Omri Abend
类目：Computation and Language (cs.CL); Programming Languages (cs.PL)
关键词：Recent advances, large language models, software design, natural language, advances in large
备注： To be published in ICML 2026 (position track)
点击查看摘要
Abstract:Recent advances in large language models and their widespread adoption have prompted claims that natural language could entirely replace formal languages, such as programming languages for software design. In this position paper, we argue that this perspective overlooks fundamental linguistic properties of natural language, specifically that it is optimized for underspecification in open-ended contexts. We introduce a formal framework centered on *task specificity*, defining it as the information-theoretic reduction of uncertainty in an output space -- such as all possible images -- given a user's specific requirements. We prove a *specificity crossover theorem*, showing the existence of a threshold beyond which the cost to express formal requirements into natural language exceeds the cost of direct formal specification. By analyzing case studies across modalities, such as image generation, code synthesis, and audio production, we demonstrate that natural language excels at low specificity tasks, while formal languages are advantageous on tasks with stricter requirements. We conclude that natural and formal languages are complementary tools and advocate the development of hybrid systems that allow users to move across the specificity spectrum.
104. 【2607.20431】Skill-Contracted Agents for Evidence-Aware Materials Literature Analysis
链接：https://arxiv.org/abs/2607.20431
作者：Bixuan Li,Yu Liu,Shuo Shi,Xiaoya Huang,Peng Kang,Lei Zheng
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：requires simultaneous attention, conventional retrieval-augmented generation, retrieval-augmented generation pipelines, generation pipelines struggle, analysis requires simultaneous
备注： 9 pages, 5 figures
点击查看摘要
Abstract:Materials science literature analysis requires simultaneous attention to composition, processing, characterization, and property relationships, yet conventional retrieval-augmented generation pipelines struggle to reconcile heterogeneous tasks within a single retrieve-then-generate architecture. Here we present AlphaAgent, a skill-driven agent framework that decouples retrieval-based question answering from paper-level report generation through explicit skill contracts. A dedicated retrieval skill rewrites user requests into material-specific search intents, queries a curated index of more than 300,000 papers from the Journal Citation Reports Metallurgy and Metallurgical Engineering category, and reformulates queries when initial evidence is insufficient. A separate report-generation skill parses full-text PDFs to produce structured per-paper analytical reports and cross-paper summaries. In a blind evaluation on 40 materials-science questions, half of which required deep analytical reasoning, AlphaAgent substantially outperformed a baseline system matched for underlying model, document index, and retrieval scale, with the largest gains in mechanistic explanation and awareness of credibility boundaries. These results indicate that explicit task separation, refined retrieval intent, and evidence-aware generation improve large-language-model-based literature analysis for materials research.
105. 【2607.20430】LLM-INSTRUCT at UZH Shared Task 2026: Constraint-Aware Retrieval and Selective Debate for Paragraph-Level Argument Mining
链接：https://arxiv.org/abs/2607.20430
作者：Phuong Huu Vu Tran,Long Minh Vo,Son Nguyen Minh Le,Hoang Van
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：UZH Shared Task, paragraph-level argument mining, UZH Shared, UNESCO resolutions, Shared Task
备注： Accepted to the 13th Workshop on Argument Mining (ArgMining 2026) at ACL 2026
点击查看摘要
Abstract:We present LLM-INSTRUCT, the winning system for the UZH Shared Task at ArgMining 2026 on paragraph-level argument mining in UN and UNESCO resolutions. The task requires paragraph-type classification, prediction of a subset of 141 official tags, and directed relation prediction under a strict JSON schema setting using only open-weight models up to 8B parameters. We frame the task as constrained structured prediction. The system first narrows the candidate tag space with metadata-aware dense retrieval, then applies constrained decoding with per-dimension caps, escalates only uncertain cases to a three-agent debate branch, and finally validates the output schema. On the official leaderboard, LLM-INSTRUCT ranked 1st overall, with 1st in F1 and 5th in LLM-as-a-Judge. During development, our configuration search further improved Task 1b Micro-F1 from 35.83% to 40.08% while keeping the internal Task 2 score at 4.421. The main lesson is simple: reducing the decision space before generation improves both accuracy and submission robustness. Our code and supporting scripts are publicly available at: this https URL
106. 【2607.20429】More Is Not More: What Matters for Diversity in LLM Opinions?
链接：https://arxiv.org/abs/2607.20429
作者：Qiyang Yao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：focus group modeling, Large language models, simulate diverse human, Large language, public opinion prediction
备注：
点击查看摘要
Abstract:Large language models are increasingly used to simulate diverse human opinions in open-ended tasks such as synthetic surveys, focus group modeling, and public opinion prediction. However, LLM outputs exhibit systematic opinion homogenization. Practitioners have explored various interventions to increase diversity, but the landscape remains fragmented: different methods are evaluated in isolation with incomparable metrics, and in practice they are typically deployed and upgraded simultaneously, making it difficult to attribute gains to specific components. To advance a more scientific understanding of LLM output diversity, we design a factorial experiment that separates two primary intervention dimensions: input conditioning (operationalized through persona depth) and interaction architecture. We evaluate all conditions on 100 real-user open-ended questions across 7 models, measuring diversity with multiple complementary metrics. Our findings challenge several common assumptions. First, more persona detail does not monotonically increase diversity. The initial step of persona conditioning already captures the majority of the gain, while further elaboration with demographic detail does not consistently improve and can reduce diversity on some models. Second, rather than seeking a single best interaction architecture, we find that different architectures explore largely non-overlapping opinion regions. Combining multiple architectures yields broader coverage than optimizing any one. Third, commonly attempted low-cost alternatives such as raising sampling temperature and adding diversity instructions produce negligible effects compared to structured interventions. Overall, our work demonstrates that diversity is not a product of scaling along any single dimension, but is highly sensitive to the structural form and combination of interventions.
107. 【2607.20428】Human-in-the-Loop Large Language Model Framework for Identification of Cutaneous Immune-Related Adverse Events
链接：https://arxiv.org/abs/2607.20428
作者：Charles Lu,Olivia Burke,Debby Cheng,Adam Kashlan,Caitlyn Duffy,Zeyun Lu,Lirit Fuksman,Jin Ning Tian,Andrew Sedlack,Priya Katyal,Eudora Lee,Ralina Karagenova,Chuck Lin,Kun-Hsing Yu,Nicole LeBoeuf,Alexander Gusev,Yevgeniy R. Semenov
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC); Multiagent Systems (cs.MA)
关键词：large language model, multi-agent large language, detecting cutaneous immune-related, evaluated a retrieval-augmented, multi-agent large
备注：
点击查看摘要
Abstract:This study evaluated a retrieval-augmented, multi-agent large language model (LLM)-driven, human-in-the-loop framework for detecting cutaneous immune-related adverse events (cirAEs) from clinical notes. Compared with unassisted manual review, the LLM-assisted workflow improved accuracy (F1 = 0.88 vs 0.77), inter-rater agreement measured by Cohen's kappa (kappa = 0.82 vs 0.50), and reduced average review time by approximately half. This framework pilots how LLMs can be applied to identify immune-related toxicities across organ systems and, more broadly, enable accurate, scalable, and transparent adverse event data extraction.
108. 【2607.20427】Is MoE Routing a Huffman Code? Discovering the Frequency-Diversity Law in Chain-of-Thought
链接：https://arxiv.org/abs/2607.20427
作者：Ching-Chieh Tsao,Zhuoyi Lin,Wenya Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Theory (cs.IT)
关键词：architectures have revolutionized, revolutionized scaling, black box, remains a black, Huffman Coding
备注： 20 pages, 20 figures
点击查看摘要
Abstract:Mixture-of-Experts architectures have revolutionized scaling, yet the underlying logic of their routing remains a black box. In this paper, we uncover a fundamental governing principle: MoE routing is not merely selection, but a manifestation of Huffman Coding. We introduce the Frequency-Diversity Law, revealing that state-of-the-art models, such as Phi-3.5-MoE and Gemma-4-27B-A4B, spontaneously act as information-theoretic engines. These models allocate sparse expert resources for common tokens while invoking high-diversity expert committees for rare, complex tasks found in chain-of-thought trajectories. However, we identify a critical redundancy trap in Qwen3.5-35B-A3B: when effective sparsity (k/E_eff) is sufficiently low, load-balancing inadvertently imposes functional redundancy, masking the underlying Huffman efficiency signal. To bridge this gap, we propose Subset Difference Pruning, a surgical strategy to eliminate functional duplicates. We demonstrate that pruning does not degrade reasoning; instead, it unleashes the model's latent Huffman efficiency, forcing the logic to collapse into streamlined, high-density paths. Our findings suggest that the next generation of MoEs should move beyond forced load-balancing toward Minimum Description Length (MDL) optimality, assigning shorter expert-routing codes to high-frequency information and longer, more diverse codes to low-frequency information, thereby transforming routing from a heuristic into a principled compression engine.
109. 【2607.20426】Knowledge Injection Exists in MoE? Exploring Expert-Aware Contrast Decoding in MoE for Mitigating LLMs'Hallucinations
链接：https://arxiv.org/abs/2607.20426
作者：Xinyue Fang,Zhiliang Tian,Zhen Huang,Ziyi Pan,Zhihua Wen,Xi Wang,Quntian Fang,Dongsheng Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Existing LLM hallucination, including prompt engineering, poor cross-domain generalization, Existing LLM, hallucination mitigation methods
备注： Accepted by ACL2
点击查看摘要
Abstract:Existing LLM hallucination mitigation methods, including prompt engineering and model optimization, either hardly alter models'internal knowledge or have poor cross-domain generalization. Contrastive decoding mitigates hallucinations by using layer-wise differences in LLMs. However, prior studies only explore transformer-based models (e.g., GPT), ignoring other effective frameworks like mixture-of-experts (MoE) models. Since MoE alters the traditional transformer architecture, we conduct empirical studies to investigate whether similar layer-wise differences exist in MoEs. Our results show that they do not exist in MoE with shared experts; nevertheless, across different MoEs, higher layers exhibit distinct expert activation patterns between factual and non-factual outputs. Building on these, we propose EAACD, an expert-aware adaptive contrast decoding that uses expert differences in MoE's higher layers to mitigate hallucinations on QA tasks. EAACD splits high-layer experts into a higher-reliability group and several lower-reliability groups based on their confidence and consistency. It contrasts the higher-reliability group's prediction with each lower-reliability group's prediction to calibrate the model's original predictions. To strengthen this contrast, EAACD amplifies hallucinations from lower-reliability experts via attention and masking to provide stronger negative references. EAACD outperforms all baselines on four datasets.
110. 【2607.20425】What is Good? Extracting and Testing Implicit Theories of Literary Quality from LLM Reasoning Traces
链接：https://arxiv.org/abs/2607.20425
作者：Birger Moëll
类目：Computation and Language (cs.CL)
关键词：remains a persistent, persistent question, LLMs evaluate literary, quality, computational linguistics
备注：
点击查看摘要
Abstract:What makes writing "good" remains a persistent question in literary studies and computational linguistics. We present a two-study investigation of how reasoning-enabled LLMs evaluate literary quality. In Study 1, we construct a benchmark of 30 real texts spanning six quality tiers, from canonical literature to anonymous forum posts, and extract the model's implicit theory of quality from its reasoning traces. Across five DeepSeek replications, the model achieves 79.3% mean tier-classification accuracy. The traces reveal a consistent stated theory: the model values intentionality over correctness, prioritizing craft, depth, and distinctive voice. A familiarity experiment with style-matched but unrecognizable passages suggests that source recognition may inflate scores, although this is confounded by genuine quality differences between canonical originals and researcher-written pastiches. In Study 2, we probe this theory through systematic degradation of five canonical prose passages. We apply six manipulations - vocabulary simplification, rhythm flattening, imagery removal, voice genericization, structure simplification, and combined degradation - and reevaluate each version. Vocabulary simplification causes the smallest quality loss (0.41 +/- 0.46 points), far below structure (2.78) or voice (2.34) loss. Combined degradation is devastating (-5.64) but subadditive. An exploratory comparison with Qwen QwQ shows the same broad qualitative pattern. Together, these studies suggest that LLM judgments of writing quality are holistic, author-specific, and more sensitive to structural than lexical features, with implications for automated writing feedback and computational aesthetics.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2607.20425 [cs.CL]
(or
arXiv:2607.20425v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.20425
Focus to learn more
arXiv-issued DOI via DataCite
Submission history From: Birger Moell [view email] [v1]
Tue, 7 Apr 2026 13:29:12 UTC (216 KB)
111. 【2607.18481】Search-on-Graph-R1: Training Large Language Models to Search Knowledge Graphs with Reinforcement Learning
链接：https://arxiv.org/abs/2607.18481
作者：Jia Ao Sun,Hao Yu,Fengran Mo,Zhan Su,Yuchen Hui,Bang Liu,Jian-Yun Nie
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：graph question answering, requires navigating, navigating from topic, topic entities, Knowledge graph
备注：
点击查看摘要
Abstract:Knowledge graph question answering (KGQA) requires navigating from topic entities to an answer several relations away. Recent methods prompt a frontier LLM to explore the graph through a retrieval tool, but their reliance on frontier-scale inference makes them costly to deploy. We present Search-on-Graph-R1 (\sogrone{}), which internalizes this navigation into a compact 8B model through supervised fine-tuning (SFT) followed by reinforcement learning (RL). Our central idea is to scaffold a frontier teacher with each question's gold SPARQL query, so the teacher traverses a known answer-bearing path with a live \texttt{Search} tool rather than having to discover the path itself. Since every call executes against a live Freebase server, the resulting trajectories are grounded in the knowledge graph by construction. On WebQSP, CWQ, and GrailQA, \sogrone{} at 8B surpasses every frozen frontier-LLM system in our comparison and posts the strongest results on CWQ of any system we compare against. It does so using no auxiliary module at inference and no LLM judge during training. Isolating each training stage shows that SFT and RL contribute complementary gains, our approach transfers across model families, and RL learns to reach answers in fewer \texttt{Search} calls than its SFT initialization.
112. 【2510.08825】Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs
链接：https://arxiv.org/abs/2510.08825
作者：Jia Ao Sun,Hao Yu,Fabrizio Gotti,Fengran Mo,Yihong Wu,Yuchen Hui,Zhan Su,Lingfeng Xiao,Jian-Yun Nie
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Large language models, Large language, language models, offer a promising, reasoning
备注： Accepted to KDD '26 (32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining)
点击查看摘要
Abstract:Large language models (LLMs) augmented with knowledge graphs (KGs) offer a promising approach for knowledge-intensive reasoning. Central to this approach is the selection of appropriate reasoning paths in the KG. Yet, existing methods face a common limitation: reasoning path selection is often performed by separate modules using criteria that are only weakly connected to the reasoning requirements. This often results in selecting incorrect relations or premature pruning of relevant paths. We propose Search-on-Graph (SoG), a method that strengthens the connection between path selection and reasoning by having the LLM itself select which relations to follow, informed by both the available KG structure and the complete reasoning history. SoG follows an \textit{observe-think-navigate} paradigm: at each step, the LLM observes the relational connections available at the current entity, reasons about which path best advances toward answering the question, and navigates accordingly. This context-aware navigation fully exploits the LLM's reasoning capabilities rather than relying on independent selection modules with surrogate criteria. Experiments on six knowledge graph question answering (KGQA) benchmarks demonstrate that SoG outperforms state-of-the-art methods while requiring no task-specific fine-tuning and generalizing across different KG schemas.
信息检索
1. 【2607.21519】Diffusion Language Model for Recommendation
链接：https://arxiv.org/abs/2607.21519
作者：Chengyi Liu,Yongqi Zhou,Junwei Pan,Zhixiang Feng,Chengguo Yin,Haijie Gu,Jie Jiang,Yinghao Liu,Yujuan Ding,Qing Li,Wenqi Fan
类目：Information Retrieval (cs.IR)
关键词：empowered recommender systems, strong semantic reasoning, Large language model, Large language, empowered recommender
备注： 30 pages, 9 figures
点击查看摘要
Abstract:Large language model (LLM)-empowered recommender systems have emerged as a promising paradigm for generative recommendation, leveraging their strong semantic reasoning and generative capacity to model complex, diverse user preferences. However, most existing approaches rely on an autoregressive paradigm that is suboptimal for recommendation. The next-token objective emphasizes sequential order rather than the structural inter-item dependencies underlying user preferences. In addition, prefix-constrained generation restricts bidirectional context and commits to left-to-right decoding, causing early errors to accumulate without correction. Inspired by the success of diffusion language models, we propose \textbf{DLMRec}, a discrete diffusion language model tailored for recommendation that offers a compelling alternative to autoregressive generation. Specifically, DLMRec introduces three key components to bridge diffusion language modeling with recommendation. First, a collaborative-aware stochastic tokenizer encodes multi-hop collaborative signals into expressive discrete tokens compatible with diffusion modeling. Second, a curriculum-driven training strategy aligns the denoising process with preference recovery through progressive item- and token-level learning. Third, a stability-aware voting mechanism aggregates iterative predictions to improve generation consistency and robustness.
2. 【2607.21513】ransparent by Design, Usable in Practice? A Formative Usability Study of a Conversational Product Advisor
链接：https://arxiv.org/abs/2607.21513
作者：Kevin Schott,Dagmar Kern,Daniel Hienert
类目：Human-Computer Interaction (cs.HC); Information Retrieval (cs.IR)
关键词：Large language models, Large language, fluent but opaque, language models, models can make
备注：
点击查看摘要
Abstract:Large language models can make conversational product advisors fluent but opaque. If they hide the logic behind a ranking and the evidence for a recommendation inside natural-language replies, they challenge users' ability to understand, trust, and steer the results. One response is to build transparency into the advisor. We report a formative, moderated think-aloud usability study of one such system: a chatbot for laptop search with constrained natural-language generation, an on-demand ranking explanation, and a comparison feature. Seven participants completed three laptop-search tasks and reported post-task usability measures. We coded their sessions into severity-rated usability problems. Ease and satisfaction during the tasks were high, but two findings stand out. First, transparency by design did not guarantee understanding: several participants valued the ranking explanation in principle, yet it caused the most severe problem. Second, participants valued the effort the advisor saved, but some wanted additional direct-manipulation controls. We contribute a severity-prioritized set of usability problems and design implications for human-centered conversational product advisors.
3. 【2607.21503】Agentic Context Management: Solving Agent Memory and Cost by Treating Them as Lifecycle and Architecture Problems
链接：https://arxiv.org/abs/2607.21503
作者：Gaurav Dadhich
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：large tool definitions, ballooning tool outputs, large tool, large prompts, tool definitions
备注： 23 pages, 6 figures, 4 tables. Evaluation harness and study data: [this http URL](http://github.com/maximem-ai)
点击查看摘要
Abstract:Production AI agents' failures are less often due to an inability to reason well and more often because they cannot manage what is in their reasoning context: conversation histories, large prompts, large tool definitions, and ballooning tool outputs. Agents drown in their own accumulating history while paying a token cost that grows every turn, producing missing recalls within and across conversations. The incumbent response treats this as a storage-and-retrieval problem. We argue that framing is too narrow. Actively managing what an agent holds in mind is a lifecycle, not merely a store: it spans deciding what to remember, extracting and structuring it, choosing the right store per data type, consolidating and forgetting while preserving provenance, deciding what is relevant now, anticipating what is needed next, and compacting context to a budget without losing what matters. In serious production this operates not over a single user but across an organizational scope hierarchy. We name this discipline Agentic Context Management (ACM) and decompose it into five primitives: architecting, ingesting, scoping, anticipating, and compacting consolidation. We then make the economic case: naive context accumulation grows token cost quadratically in conversation length, crude summarization buys linear cost at the price of an accuracy cliff, and only validated compaction achieves linear cost with preserved fidelity. We describe a reference implementation, Maximem Synap, that realizes the five primitives as a multi-tenant service and reports 92% on LongMemEval and 93.2% on LoCoMo under the configuration detailed in Section 6. We close with dimensions existing benchmarks do not yet capture, latency, token efficiency, and context-rot resistance, and the frontier of decision-level and organization-level context the category points toward.
4. 【2607.21333】SHIFT: Self-reconstruction Harnesses Implicit Fine-grained Thinking for Retrieval
链接：https://arxiv.org/abs/2607.21333
作者：Yuxiao Luo,Da Li,Mingjie Zhang,Zhentao He,Shikun Zhang,Wei Ye
类目：Information Retrieval (cs.IR)
关键词：information retrieval systems, modern information retrieval, textbf, fundamental component, component of modern
备注：
点击查看摘要
Abstract:LLM-based retrievers have become a fundamental component of modern information retrieval systems. The paradigm of "rewrite-then-retriev" introduces explicit reasoning before retrieval. In addition, implicit-reasoning retrievers such as GIRCSE and LaSER improve efficiency by replacing explicit reasoning with soft tokens. Although these methods demonstrated competitive performance on reasoning-intensive retrieval benchmarks, they struggle to address the mismatch between the objectives of retrieval and generation. In this work, we propose SHIFT ($\textbf{S}$elf-reconstruction $\textbf{H}$arnesses $\textbf{I}$mplicit $\textbf{F}$ine-grained $\textbf{T}$hinking for Retrieval), a retrieval training framework based on LLMs. Firstly, we transfer LLMs into reasoning-efficient retrievers with residual projection and task-oriented bidirectional attention aggregation in the latent space. Secondly, we alleviate the mismatch between contrastive learning and implicit reasoning using fine-grained next-token-prediction-based reconstruction. Extensive experiments on reasoning-intensive retrieval benchmarks show that SHIFT consistently outperforms other widely used retrievers. We also carried out a detailed analysis to illustrate how our method works.
5. 【2607.21028】Bridging the Structural Gap: Adapting Autoregressive Generation for Recommendation
链接：https://arxiv.org/abs/2607.21028
作者：Junchao Zeng,Junzhang Zhu,Junyang Chen,Yudong Li,Wei Liu,Chengxiang Zhuo,Zang Li
类目：Information Retrieval (cs.IR)
关键词：work encodes items, Hierarchical Path Reranking, hierarchical semantic IDs, paradigm for sequential, representative line
备注： 14 pages, 15 figures
点击查看摘要
Abstract:Generative Recommendation (GR) has emerged as a new paradigm for sequential recommendation, in which a representative line of work encodes items into hierarchical semantic IDs via residual quantization and predicts the IDs token by token. However, this generative formulation still exhibits structural gaps with respect to the recommendation task: flattening multi-token IDs into a single sequence destroys item-level structure, and the inconsistency between training and inference over a hierarchical codebook gives rise to semantic drift. To bridge these two gaps, we propose BARGE, which employs Item Context-Aware Attention (ICA) to restore item-level structure during encoding, and Hierarchical Path Reranking (HPR) together with Dual-Path Decoding (DPD) to suppress semantic drift from two complementary angles during decoding. Extensive experiments and analytical studies on public benchmarks and a large-scale offline test demonstrate that BARGE achieves superior recommendation performance. An online A/B test on a Tencent platform yields improvements of 0.60% in click-through rate, 1.34% in click unique visitors, and 1.70% in total reading time, confirming the practical value of BARGE in industrial-scale recommendation.
6. 【2607.20957】Fast and Efficient Approximate Nearest Neighbor Search for High-Dimensional LLM Embeddings
链接：https://arxiv.org/abs/2607.20957
作者：Nico Hezel,Kai Uwe Barthel,Bruno Schilling,Konstantin Schall,Andre Moelle,Klaus Jung
类目：Information Retrieval (cs.IR)
关键词：SISAP Indexing Challenge, Indexing Challenge benchmarks, annual SISAP Indexing, Challenge benchmarks Approximate, Approximate Nearest Neighbor
备注：
点击查看摘要
Abstract:The annual SISAP Indexing Challenge benchmarks Approximate Nearest Neighbor Search (ANNS) algorithms under rigorous constraints. This paper presents our submissions for the 2026 edition, addressing both $k$-Nearest Neighbor Graph (kNNG) construction on 1024-dimensional BGE-M3 embeddings (Task 1) and Maximum Inner Product Search (MIPS) on unnormalized Llama-3.2-8B features (Task 2). To optimize construction speed, we utilize Equi-Voronoi Polytopes (EVP) for efficient quantization, supplemented by targeted reranking strategies to maintain high recall. For MIPS, we transform the asymmetric inner product problem into a Euclidean search space via dimensionality augmentation. To reduce query latency and optimize memory access, we introduce a 1D presorting mechanism via Fast Linear Assignment Sorting (FLAS) prior to graph construction. This significantly improves spatial locality and cache hit rates during subsequent graph traversal. Source Code: this https URL
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2607.20957 [cs.IR]
(or
arXiv:2607.20957v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2607.20957
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
7. 【2607.20938】Controllable and Content-Based Recommendations
链接：https://arxiv.org/abs/2607.20938
作者：Fırat Öncel,Jihoon Jeong,Emiliano Penaloza,Mirco Ravanelli,Laurent Charlin,Cem Subakan
类目：Information Retrieval (cs.IR)
关键词：Traditional recommendation systems, Traditional recommendation, rely on latent, making them difficult, interpret and control
备注： Under review
点击查看摘要
Abstract:Traditional recommendation systems rely on latent (dense) representations, making them difficult to interpret and control. We propose the Controllable and Content-Based Recommendations (CCBR) framework, which builds its recommendations from textual user profile representations. CCBR plugs into collaborative filtering models and introduces controllability via text bottlenecks. We show that CCBR enables text-based and multimodal interventions, allowing users to steer the model towards the directions they prefer. Different from existing controllable recommendation systems, CCBR infers the text summaries directly from item contents (images, audio or video). Across image-, audio-, and video-based datasets, we demonstrate that the proposed framework obtains competitive model performance with standard (latent-representation) models while providing controllable model summaries via text. The model also outperforms TEARS, a recent baseline for controllable recommendation systems. Through systematic interventions, we demonstrate the efficacy of the user steering mechanism.
8. 【2607.20873】LO-FAR: A Cost-Aware Local Filter for Sparse Feature Ranking in Industrial Ad Recommendation
链接：https://arxiv.org/abs/2607.20873
作者：Egemen Erbayat,Luis Duque,Sohini Roychowdhury,Mohammad Amin,Srihari Reddy
类目：Information Retrieval (cs.IR)
关键词：encode user histories, recommendation models rely, models rely heavily, Industrial ad recommendation, high-cardinality ID-list features
备注：
点击查看摘要
Abstract:Industrial ad recommendation models rely heavily on sparse, high-cardinality ID-list features that encode user histories and contextual identifiers. Each is backed by a dedicated embedding table, so these features dominate storage, training, and serving cost and must be revisited as traffic and downstream models evolve. Therefore, sparse feature ranking is not just an offline modeling problem but also a recurrent systems decision limited by compute budgets and iteration cadence. We present Localized Feature Ranking (LO-FAR), a CPU-only, model-agnostic workflow that ranks each candidate feature from its stand-alone held-out predictive signal using lightweight local estimators rather than the GPU-bound retraining loops of permutation- and stochastic-gate-based methods. On a production dataset of more than one million logged interactions and 475 sparse ID-list features, LO-FAR completes ranking in approximately two CPU-hours and preserves downstream Normalized Entropy gains on CTR and CVR tasks that are competitive with shuffle-based importance, Binary Stochastic Neurons, and a coverage-based heuristic across budgets of 100--400 retained features. The contribution is a deployable workflow showing that, when cost and turnaround constraints are binding, a simple local filter can be a practical production choice over heavier interaction-aware alternatives.
9. 【2607.20863】Probabilistic Residual Learning for Online Recommendations
链接：https://arxiv.org/abs/2607.20863
作者：Wenyuan Wang,Yusong Zhao,Zihao Xu,Hengyi Wang,Qi Xu,Zhigang Hua,Yan Xie,Yi Wang,Zihao Zhao,Bo Long,Chengzhi Mao,Shuang Yang,Hengguan Huang,Hao Wang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：dense encoder learns, Modern recommender systems, encoder learns representations, Modern recommender, typically based
备注： Accepted at the 20th ACM Conference on Recommender Systems (RecSys 2026)
点击查看摘要
Abstract:Modern recommender systems are typically based on deep learning (DL) models, where a dense encoder learns representations of users and items. As a result, these systems often suffer from the black-box nature and computational complexity of the underlying models, making it difficult to systematically enhance their recommendation capabilities. To address this problem, we propose Probabilistic Residual Learning (PRL), a causal Bayesian recommendation model that models the residual between ground-truth and base predictions, enabling targeted refinement of existing systems. Specifically, PRL (1) probabilistically groups users for localized residual modeling, (2) models domain-level confounders that influence user and item representations, and (3) aggregates cluster-specific residual predictions over the confounders using do-calculus. Experiments demonstrate that our plug-and-play PRL is compatible with various base deep learning recommender systems, improving their performance while automatically discovering meaningful user clusters.
10. 【2607.20737】Cardinality-Decomposed Loss: Matching Training Objectives to Relation Structure in Heterogeneous Recommendation Graphs
链接：https://arxiv.org/abs/2607.20737
作者：Parul Maheshwari,Amulya Paruchuri,Yiqing Zou,Alireza Sahami Shirazi,Farhad Farahani,Prakhar Mehrotra
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Neural Networks trained, Graph Neural Networks, Neural Networks, bipartite graphs form, heterogenous bipartite graphs
备注：
点击查看摘要
Abstract:Graph Neural Networks trained on heterogenous bipartite graphs form a common basis in recommendation systems. These graphs often express relations that vary in cardinality, for example, user-item preferences are one-to-many and user-attribute features are one-to-one. Traditionally, a unique loss function is applied for all of the network components which is often Bayesian Personalized Ranking (BPR). While BPR works well for the recommendation task, we find that it causes attribute embeddings to collapse to near-random geometry -- a silent failure that leaves standard ranking metrics largely unaffected and therefore invisible to conventional evaluation. This in turn pollutes user node embeddings, which are shaped by both edge types simultaneously, hurting downstream tasks like personalization, segmentation, etc. Here we propose a Cardinality-Decomposed Loss (CDL) that combines both Cross Entropy (CE) and BPR to enable the model to collectively optimize for relations across cardinalities. We confirm this CE-BPR conflict by showing the two losses compete in the shared encoder's parameter space. We evaluate CDL on five datasets spanning two structural configurations -- one-to-one attributes on user nodes (MovieLens-1M, this http URL-360K, PayPal Audience Factory, BookCrossing) and on item nodes (Yelp) -- and find that CDL consistently improves discriminability in attribute embeddings. We also show that ranking (NDCG) improves when attributes carry meaningful preference signal, but conflicts with it when the correlation is weak. We use a lambda parameter to navigate this trade-off, and a lambda-sweep reveals that dataset behavior is governed by two graph properties -- semantic alignment and topology leakage. Semantic alignment measures whether the attribute predicts preferences, while topology leakage measures whether the graph's connectivity already encodes it.
11. 【2607.20655】SalesLoop: Reinforcement Learning from Performance Feedback for Sales Lead Ranking
链接：https://arxiv.org/abs/2607.20655
作者：Chenyu Zhang
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Customer Relationship Management, Relationship Management, Customer Relationship, achieving high offline, high offline accuracy
备注：
点击查看摘要
Abstract:Lead ranking in Customer Relationship Management (CRM) systems faces a persistent challenge: models achieving high offline accuracy often underperform in production. We identify three fundamental gaps responsible for this disconnect: offline-online metric mismatch, pointwise-listwise objective misalignment, and temporal distribution drift. To address these gaps, we propose SalesLoop, a reinforcement learning framework that establishes a closed feedback loop between model predictions and real-world business outcomes. Our approach introduces (1) a performance-aware reward that encodes conversion outcomes weighted by ranking position and conversion velocity, and (2) Discriminative GRPO, a listwise optimization objective that adapts Group Relative Policy Optimization to discriminative ranking models. SalesLoop improves NDCG@K by +7.9\% and P@K by +15.8\% over the strongest static baseline. A 160-day production A/B test at a New Energy Vehicle manufacturer, spanning 16.5M leads and 280 sales specialists across two provincial markets, validates statistically significant cumulative lift of +4.7\% ($p=0.047$) and +8.7\% ($p=0.002$). In production, the ranking backbone achieves Top-10\% recall of 44.1\% and surfaces high-intent leads at $2.3\times$ the conversion rate of specialist baselines.
Subjects:
Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
Cite as:
arXiv:2607.20655 [cs.LG]
(or
arXiv:2607.20655v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.20655
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
12. 【2607.20437】opoGuard: Graph Theory Based Defenses Against Split-Knowledge Attacks on RAG
链接：https://arxiv.org/abs/2607.20437
作者：Chahana Dahal,Zuobin Xiong
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Information Retrieval (cs.IR)
关键词：Retrieval Augmented Generation, Augmented Generation, Production Retrieval Augmented, answer complex queries, aggregating multiple external
备注：
点击查看摘要
Abstract:Production Retrieval Augmented Generation (RAG) systems rely on aggregating multiple external documents to answer complex queries. However, the retrieved documents introduce a new threat surface that can be exploited to launch split-knowledge attacks. In this attack, the adversary injects documents that are individually benign but create false associations when combined and fed to language models. This paper shows that the new attack is structurally invisible to existing per-document filters, like LlamaGuard. To address this issue in RAG, this work introduces TopoGuard, a family of graph theory-based methods specifically targeting the split-knowledge attacks by building a semantic similarity graph from retrieved documents and detecting contexts with malicious topology. Grounded on the theoretical analysis, the TopoGuard family has been proven to be effective and robust even with noisy inputs. Extensive experiments are conducted on two retrieval datasets and compared with multiple baseline methods. Specifically, the TopoGuard-$\lambda_2$+Entity catches 21$\times$ more attacks than LlamaGuard-2-8B at 1\% FPR (32.6\% vs 1.5\% recall) on the HotpotQA dataset. Compared with production RAG detection systems using large language models, the proposed TopoGuard variants run efficiently at sub-millisecond latency and stay robust under adaptive adversaries and benign cross-domain queries.
13. 【2607.20431】Skill-Contracted Agents for Evidence-Aware Materials Literature Analysis
链接：https://arxiv.org/abs/2607.20431
作者：Bixuan Li,Yu Liu,Shuo Shi,Xiaoya Huang,Peng Kang,Lei Zheng
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：requires simultaneous attention, conventional retrieval-augmented generation, retrieval-augmented generation pipelines, generation pipelines struggle, analysis requires simultaneous
备注： 9 pages, 5 figures
点击查看摘要
Abstract:Materials science literature analysis requires simultaneous attention to composition, processing, characterization, and property relationships, yet conventional retrieval-augmented generation pipelines struggle to reconcile heterogeneous tasks within a single retrieve-then-generate architecture. Here we present AlphaAgent, a skill-driven agent framework that decouples retrieval-based question answering from paper-level report generation through explicit skill contracts. A dedicated retrieval skill rewrites user requests into material-specific search intents, queries a curated index of more than 300,000 papers from the Journal Citation Reports Metallurgy and Metallurgical Engineering category, and reformulates queries when initial evidence is insufficient. A separate report-generation skill parses full-text PDFs to produce structured per-paper analytical reports and cross-paper summaries. In a blind evaluation on 40 materials-science questions, half of which required deep analytical reasoning, AlphaAgent substantially outperformed a baseline system matched for underlying model, document index, and retrieval scale, with the largest gains in mechanistic explanation and awareness of credibility boundaries. These results indicate that explicit task separation, refined retrieval intent, and evidence-aware generation improve large-language-model-based literature analysis for materials research.
14. 【2607.18481】Search-on-Graph-R1: Training Large Language Models to Search Knowledge Graphs with Reinforcement Learning
链接：https://arxiv.org/abs/2607.18481
作者：Jia Ao Sun,Hao Yu,Fengran Mo,Zhan Su,Yuchen Hui,Bang Liu,Jian-Yun Nie
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：graph question answering, requires navigating, navigating from topic, topic entities, Knowledge graph
备注：
点击查看摘要
Abstract:Knowledge graph question answering (KGQA) requires navigating from topic entities to an answer several relations away. Recent methods prompt a frontier LLM to explore the graph through a retrieval tool, but their reliance on frontier-scale inference makes them costly to deploy. We present Search-on-Graph-R1 (\sogrone{}), which internalizes this navigation into a compact 8B model through supervised fine-tuning (SFT) followed by reinforcement learning (RL). Our central idea is to scaffold a frontier teacher with each question's gold SPARQL query, so the teacher traverses a known answer-bearing path with a live \texttt{Search} tool rather than having to discover the path itself. Since every call executes against a live Freebase server, the resulting trajectories are grounded in the knowledge graph by construction. On WebQSP, CWQ, and GrailQA, \sogrone{} at 8B surpasses every frozen frontier-LLM system in our comparison and posts the strongest results on CWQ of any system we compare against. It does so using no auxiliary module at inference and no LLM judge during training. Isolating each training stage shows that SFT and RL contribute complementary gains, our approach transfers across model families, and RL learns to reach answers in fewer \texttt{Search} calls than its SFT initialization.
15. 【2510.08825】Search-on-Graph: Iterative Informed Navigation for Large Language Model Reasoning on Knowledge Graphs
链接：https://arxiv.org/abs/2510.08825
作者：Jia Ao Sun,Hao Yu,Fabrizio Gotti,Fengran Mo,Yihong Wu,Yuchen Hui,Zhan Su,Lingfeng Xiao,Jian-Yun Nie
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：Large language models, Large language, language models, offer a promising, reasoning
备注： Accepted to KDD '26 (32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining)
点击查看摘要
Abstract:Large language models (LLMs) augmented with knowledge graphs (KGs) offer a promising approach for knowledge-intensive reasoning. Central to this approach is the selection of appropriate reasoning paths in the KG. Yet, existing methods face a common limitation: reasoning path selection is often performed by separate modules using criteria that are only weakly connected to the reasoning requirements. This often results in selecting incorrect relations or premature pruning of relevant paths. We propose Search-on-Graph (SoG), a method that strengthens the connection between path selection and reasoning by having the LLM itself select which relations to follow, informed by both the available KG structure and the complete reasoning history. SoG follows an \textit{observe-think-navigate} paradigm: at each step, the LLM observes the relational connections available at the current entity, reasons about which path best advances toward answering the question, and navigates accordingly. This context-aware navigation fully exploits the LLM's reasoning capabilities rather than relying on independent selection modules with surrogate criteria. Experiments on six knowledge graph question answering (KGQA) benchmarks demonstrate that SoG outperforms state-of-the-art methods while requiring no task-specific fine-tuning and generalizing across different KG schemas.
计算机视觉
1. 【2607.21595】3D-Aware VLMs with Implicit and Explicit Geometries
链接：https://arxiv.org/abs/2607.21595
作者：Wenhao Li,Xueying Jiang,Quanhao Qian,Deli Zhao,Ran Xu,Shijian Lu,Gongjie Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Implicit Geometry Tokens, Explicit Geometry Tokens, existing vision-language models, Geometry Tokens, rapid progress
备注： Accepted by ECCV 2026, Open Sourced
点击查看摘要
Abstract:Despite rapid progress, most existing vision-language models (VLMs) built from 2D visual inputs often struggle when handling various 3D tasks that require fine-grained spatial understanding and reasoning. To bridge this gap, we present VLM-IE3D, a unified framework that enhances the 3D spatial awareness of VLMs by equipping them with both implicit and explicit 3D geometries learned from RGB videos. Our VLM-IE3D introduces Implicit Geometry Tokens (IGTs) that capture high-level geometric priors from input videos, as well as complementary Explicit Geometry Tokens (EGTs) that encode detailed geometric structures from reconstructed 3D attributes. On top of that, VLM-IE3D comes with a 3D-aware adapter that effectively fuses the two types of geometric representations with 2D visual cues. This RGB-only design injects strong 3D inductive biases for fine-grained spatial understanding and reasoning without requiring any additional 3D inputs. Extensive experiments show that VLM-IE3D achieves superior performance consistently across various 3D tasks including 3D video detection, 3D visual grounding, 3D dense captioning, and spatial reasoning. Code and models are available at this https URL.
2. 【2607.21594】Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers
链接：https://arxiv.org/abs/2607.21594
作者：Sicheng Mo,Yuheng Li,Ziyang Leng,Krishna Kumar Singh,Bolei Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generate consistent observations, Multi-agent interactive world, generate consistent, individual agent status, interactive world models
备注： Project page: [this https URL](https://vail-ucla.github.io/worldweaver/)
点击查看摘要
Abstract:Multi-agent interactive world models should not only generate consistent observations, but also maintain world states that persist across agents and evolve across views. Existing autoregressive video diffusion pipelines carry forward observation history as conditioning context, which makes shared state difficult to maintain in multi-agent and multi-view settings. We present WorldWeaver (W^2), a streaming multi-agent video diffusion model that augments rollout with cross-agent world state registers: learnable tokens that store shared world information, track individual agent status, and are dynamically updated after each generated chunk. We ground these registers with supervision signals spanning individual agent status, global state views including bird's-eye views, and scene text. We further improve the architecture with a Mixture-of-Transformers design that uses separate weights for world state modeling and visual frame modeling. Extensive experiments in two-agent Minecraft video generation show that explicit world-state modeling improves logical consistency and generation quality.
3. 【2607.21592】Unified Video Dense Prediction from Disjoint Data
链接：https://arxiv.org/abs/2607.21592
作者：Yihong Sun,Seoung Wug Oh,Jiahui Huang,Bharath Hariharan,Joon-Young Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：understanding requires simultaneous, requires simultaneous prediction, Scene understanding requires, prediction about geometry, understanding requires
备注： ECCV 2026
点击查看摘要
Abstract:Scene understanding requires simultaneous prediction about geometry, appearance, and semantics. However, existing task-specific annotations are fragmented across incompatible, domain-specific datasets. Current unified systems circumvent this by restricting training to fully co-annotated data, or by incurring the large computational cost of pseudo-labeling. To mitigate this, we introduce UniD, a unified video model that jointly predicts eight dense scene properties-depth, surface normals, semantic segmentation, boundaries, human parts, albedo, shading, and materials-all learned from disjoint, domain-specific datasets. We propose a simple yet effective distillation step in which per-task experts supervise a unified backbone through lightweight task projectors, eliminating the need for annotation overlap or pseudo-labeling. Our key insight is that the strong visual priors of a pretrained diffusion model are sufficient to bridge the domain gaps introduced by disjoint training sources, enabling robust generalization to scene-task combinations never seen during training. UniD achieves competitive performance against per-task specialists and multi-task baselines, with strong generalization to out-of-distribution scenarios and enhanced temporal and cross-task consistency. Code and video results are available at this https URL.
4. 【2607.21591】Inference-Time Scaling of Diffusion Models via Progressive Seed Pruning
链接：https://arxiv.org/abs/2607.21591
作者：Rogerio Guimaraes,Pietro Perona
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conditional image generation, dominate conditional image, models dominate conditional, autoregressive language models, image generation
备注： Project page: [this https URL](https://www.vision.caltech.edu/psp) . Code: [this https URL](https://github.com/rogerioagjr/psp)
点击查看摘要
Abstract:Diffusion and flow-matching models dominate conditional image generation, yet inference-time scaling for these models is far less developed than for autoregressive language models. Because final quality is highly sensitive to the initial noise seed, many approaches spend extra compute on seed search or resampling under a black-box reward, but typically maintaining a constant memory footprint throughout inference. We show that relaxing this constraint enables an underexplored inference-time scaling axis: by front-loading exploration, evaluating many seeds early, and pruning aggressively, we can use a fixed compute budget more effectively. \emph{Progressive Seed Pruning} (\PSP) scores intermediate denoised estimates and progressively narrows the candidate set so that only promising trajectories are fully denoised, while keeping the total number of model evaluations fixed. Across diffusion and flow-matching backbones, \PSP \ consistently improves reward-guided selection and achieves higher GenEval scores (automated) and better human evaluation on prompt-alignment than best-of-$N$, importance-sampling, and tree-search baselines at matched compute. Project page: this https URL. Code: this https URL.
5. 【2607.21582】Scale Up Strategically: Learning Compositional Generalization via Bias-Aware Evaluation and Data Collection for Robotic Manipulation
链接：https://arxiv.org/abs/2607.21582
作者：Yu Qi,Zhang Ye,Xinyi Xu,Yuxuan Lu,Amitoj Sandhu,Boce Hu,Haojie Huang,Jonathan Tremblay,Lawson L.S. Wong
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Compositional generalization, follow diverse instructions, generalization is essential, follow diverse, Factor Dominance Rate
备注：
点击查看摘要
Abstract:Compositional generalization is essential for robot to follow diverse instructions. However, pretrained policies are known to take shortcuts, deferring to salient cues rather than grounding language. We introduce a diagnostic framework that localizes this failure to individual \textit{instruction factors}, \textit{e.g.,} reusable semantic components such as color, verb, object, size, and spatial attribute. Our framework formalizes instruction factor bias, the tendency of fine-tuned policies to over-rely on dominant factors as shortcuts, and quantifies it through two metrics: Factor Dominance Rate (FDR), capturing pairwise bias between factors, and Factor Dominance Hierarchy (FDH), aggregating these into a global ranking. Evaluation on six foundation policies reveals broadly consistent ordering, \textit{i.e.}, color $\geq$ object $\geq$ spatial $\geq$ verb $\geq$ size, with color dominant, and verb and size most under-grounded. We further show the diagnosis is actionable: a bias-aware data collection strategy that reallocates a fixed budget toward under-grounded factors outperforms baselines in simulation and on a real robot using half the demonstrations, thereby enabling more sample-efficient and generalizable policy learning.
6. 【2607.21580】GraphVid: Interactive Graph-Controllable Video Generation
链接：https://arxiv.org/abs/2607.21580
作者：Vedant Shah,Onkar Susladkar,Tushar Prakash,Kiet Nguyen,Tianjio Yu,Adheesh Juvekar,Muntasir Waheed,Ismini Lourentzou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：constrain pixel movement, remains challenging due, primarily constrain pixel, generation remains challenging, pixel movement
备注：
点击查看摘要
Abstract:Controllable video generation remains challenging due to the difficulty of specifying precise multi-object interactions using text prompts or motion-control inputs that primarily constrain pixel movement. In practice, trajectory-based control often requires users to draw accurate tracks for multiple objects, which scales poorly with scene complexity and becomes ambiguous under occlusion or overlap. To enable flexible yet precise multi-subject control, we introduce $\textbf{GraphVid}$, a graph-conditioned image-to-video generation model that enables interactive control through structured interaction graphs. We further curate $\textbf{GraphVid-Bench}$, a large-scale interaction-centric video dataset with structured relational annotations to enable training of interaction-aware video generation models. Despite using substantially less training data and fewer trainable parameters than prior motion-control methods, GraphVid delivers strong controllability and video quality. Compared with Motion-I2V, GraphVid reduces FID by up to 39.9% and FVD by 37.6%, while improving PSNR (9.87=15.98) and SSIM (0.38=0.61). Our results highlight the potential of structured semantic interfaces as a powerful paradigm for controllable video generation.
7. 【2607.21577】Synthetic data generation framework for quality control automation in gravure printing
链接：https://arxiv.org/abs/2607.21577
作者：Korota Arsène Coulibaly,Mohamed Hamlich,Khalid Hmali,Andrea Trombin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Image and Video Processing (eess.IV)
关键词：depends on slow, rotogravure printing, rotogravure printing quality, printing, rotogravure
备注： 27 pages, 15 figures. To be submitted to Journal of Engineering Research (Elsevier). Certain TeX commands are supported
点击查看摘要
Abstract:Quality control in printing, particularly in rotogravure printing, still depends on slow, costly, and subjective manual inspection. Automated surface defect detection is critical for maintaining high-quality standards in rotogravure printing. Deep learning models give prospects for automation. However, training robust deep learning models, such as YOLO or Vision Transformers, is heavily hindered by the extreme scarcity of real-world industrial defects images. To overcome this limitation, this paper introduces a novel synthetic data generation framework tailored for rotogravure printing quality control. The proposed pipeline automatically generates high-fidelity images of specific printing defects (creases, streaks, misregistration, etc.) and outputs corresponding bounding boxes and annotations. To validate the framework, a synthetic dataset of 7533 images was generated and used to train the state-of-the-art object-detection model RFDETR. Experimental results demonstrate that the model trained on our synthetic data achieves a Mean Average Precision (mAP) of 80.9\% on real industrial testing samples. This framework provides a zero-cost, rapid-deployment solution for automating defect inspection in printing lines without requiring massive manual data collection.
8. 【2607.21576】Self-Supervised Learning of Structured Dynamics from Videos
链接：https://arxiv.org/abs/2607.21576
作者：Lukas Knobel,Andrew Zisserman,Yuki M. Asano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Understanding motion, fundamental challenge, challenge for visual, Understanding, motion
备注： preprint, Project page: [this https URL](https://lukasknobel.github.io/projects/StructuredDynamics)
点击查看摘要
Abstract:Understanding motion in video is a fundamental challenge for visual learning, as frame-to-frame change entangles two sources of dynamics: camera motion and object motion. This decomposition has remained underexplored in representation learning, partly because these factors are tightly coupled in natural videos and difficult to supervise separately. Yet recovering it is important for learning robust motion representations that separate meaningful object dynamics from camera-induced variation. We study whether such structured motion representations can be recovered from frozen features of a pretrained image vision transformer. We propose the Structured Dynamics Model (SDM), which explicitly separates the dominant source of temporal change from residual dynamics through future-feature prediction, rather than representing video change with a single entangled latent or with unstructured, spatially dense transition tokens. Training combines self-supervised learning on real video with weak supervision of scene dynamics on synthetic Kubric data. We evaluate SDM on ProbeMotion, a new evaluation suite spanning synthetic and real videos with camera motion, object motion, and combined dynamics. SDM outperforms backbone baselines using global CLS or average-pooled features, and compares favorably to strongly supervised representations such as VGGT on several probes, despite using substantially weaker supervision. These results suggest that pretrained image models can be readily repurposed into structured video-dynamics representations, providing a useful inductive bias for learning and analyzing latent video dynamics.
9. 【2607.21562】Scene Parameter Saliency via Differentiable Light Transport
链接：https://arxiv.org/abs/2607.21562
作者：Linas Beresna,Eugene Fiume
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Gradient-based saliency methods, saliency methods reveal, neural network output, Gradient-based saliency, network output
备注： 13 pages, 5 figures
点击查看摘要
Abstract:Gradient-based saliency methods reveal which input features most influence a neural network's output, and are a standard tool for model interpretability. We observe that differentiable renderers, which are conventionally used for parameter optimisation, produce an analogous form of saliency: given any scalar metric evaluated on a rendered image, a single reverse-mode differentiation pass yields per-parameter gradients that identify which scene elements most influence the metric. We call these gradient fields metric saliency maps. Unlike neural saliency, which propagates attribution through learned weights, metric saliency propagates through the image formation process itself, including multi-bounce light transport, capturing parameter dependencies that are semi-opaque to manual inspection. We compute metric saliency maps for qualitatively different objectives: psychovisual glare indices, mean scene luminance, and neural perceptual scores. The saliency rankings differ substantially across metrics for the same scene, with parameters that dominate one objective being negligible for another. The saliency map is specific to the metric, not an intrinsic property of the scene. Our results suggest that differentiable renderers produce derivative images that are as informative for scene understanding as the primal images they were designed to generate.
10. 【2607.21556】Visual Contrastive Self-Distillation
链接：https://arxiv.org/abs/2607.21556
作者：Yijun Liang,Yunjie Tian,Yijiang Li,Yuqi Jia,Furong Huang,Tianyi Zhou,Di Fu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：stronger learning signal, asymmetric information, stronger learning, on-policy distillation, On-policy self-distillation
备注： 15 pages
点击查看摘要
Abstract:On-policy self-distillation (OPSD) is promising as it removes the external teacher required by on-policy distillation (OPD), yet it still needs asymmetric information between teacher and student to ensure that the self-teacher provides a stronger learning signal than the student. Existing methods create this asymmetry either through privileged answers or visual evidence. We ask whether both can be removed, yielding a simpler form of OPSD driven purely by input conditioning. For this purpose, we propose Visual Contrastive Self-Distillation, namely VCSD, which converts image-content removal into an on-policy self-distillation signal. At each student-generated response prefix, the EMA teacher produces two next-token distributions under the same prompt and prefix -- one conditioned on the original image and the other on a content-erased control. Their token-wise log-probability difference highlights candidates whose likelihood is specifically increased by the instance-level visual content. We use this contrast to sharpen the teacher's original-image distribution within its plausible support, and distill the resulting full-distribution target into the student. Using ViRL39K dataset, VCSD consistently outperforms matched OPSD across Qwen3-VL and Qwen3.5 models. For example, on Qwen3-VL, it improves the seven-benchmark aggregate from $62.27\% \rightarrow 67.04\%$ at 2B, $71.30\% \rightarrow 73.16\%$ at 4B, and $72.51\% \rightarrow 76.26\%$ at 8B. Furthermore, VCSD requires no external teacher, privileged answers, visual evidence signals, reasoning traces, or additional inference-time cost.
11. 【2607.21553】SANA-Video 2.0: Hybrid Linear Attention with Attention Residuals for Efficient Video Generation
链接：https://arxiv.org/abs/2607.21553
作者：Junsong Chen,Jincheng Yu,Yitong Li,Shuchen Xue,Haozhe Liu,Jingyu Xin,Yuyang Zhao,Tian Ye,Zhangjie Wu,Zian Wang,Daquan Zhou,Ping Luo,Song Han,Enze Xie
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion transformer instantiated, video diffusion transformer, unified architecture, diffusion transformer, transformer instantiated
备注： 13 pages, 9 figures, 5 tables
点击查看摘要
Abstract:We introduce SANA-Video 2.0, a hybrid video diffusion transformer instantiated at 5B and 14B scales under a unified architecture. Designed to generate high-quality video up to 720p on a single GPU, SANA-Video 2.0 matches full-softmax video DiTs in quality while retaining the favorable long-sequence scaling of linear attention. To avoid quadratic attention throughout, Hybrid Linear-Softmax Attention combines gated linear attention for O(N)-dominated mixing with periodic gated-softmax anchors at a 3:1 ratio, restoring the full-rank token interactions that pure linear attention lacks. To propagate these refreshed representations across depth, Block Attention Residuals (AttnRes) route completed block summaries into later linear layers, enabling anchor-feature reuse and boosting deep-layer effective rank by ~12%. Through from-scratch training, SANA-Video 2.0 learns the complete hybrid directly rather than linearizing pretrained models, with reduced-resolution proxy studies establishing 25% softmax as the optimal quality-efficiency trade-off. With 40-step sampling, SANA-Video 2.0 achieves a VBench score of 84.30 in 13.2s at 480p on a single H100, remaining competitive with far larger softmax video DiTs at a fraction of the latency. Its compiled DiT forward pass is 3.2x faster than a matched full-softmax baseline at 720p/60s, a gap that expands with video duration. Furthermore, full-stack Sol-Engine optimization (kernel fusion, caching, and sparse attention) accelerates this hardware-friendly backbone by a further 3.58x, bringing the 5B pipeline to 13.06s at 720p/5s and making it 120x faster than Wan 2.2-A14B on one H100. Overall, our hybrid design recovers softmax-level expressiveness at substantially reduced cost, unlocking scalable long, high resolution video generation.
12. 【2607.21546】UnDA: Unpaired Domain Alignment for Cross-Modal Knowledge Transfer in Medical Imaging
链接：https://arxiv.org/abs/2607.21546
作者：Rafsan Jany,Shadab Tanjeed Ahmad,Ahsan Bulbul,Tahsinul Islam,Md Azam Hossain,Abu Raihan Mostofa Kamal
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：provide complementary information, real world scenarios, Multimodal based approaches, modalities provide complementary, single modality approaches
备注：
点击查看摘要
Abstract:Multimodal based approaches often outperform single modality approaches in downstream tasks as the different modalities provide complementary information, yet acquiring paired clinical data remains a significant challenge in real world scenarios. While cross-modal knowledge distillation addresses this, existing methods often struggle with large modality gaps and the propagation of noise from uncertain source-domain predictions. To overcome these challenges, we propose UnDA, an anchor-guided framework for unpaired cross-modal distillation. Our approach introduces a backbone-agnostic Alignment Module that extracts semantically structured class tokens via an attention based pooling mechanism. To ensure robust knowledge transfer, we propose Uncertainty-Weighted Optimal Transport (UCT-OT), which dynamically weights feature-level alignment based on prediction confidence, effectively suppressing noisy supervision. Furthermore, a per-class ProtoNCE objective maintains stable prototype memories to enforce global discriminability across unpaired batches. Evaluations on representative segmentation tasks under strictly unpaired settings show consistent improvements in accuracy and boundary precision in the target modality, demonstrating that meaningful structural knowledge can be transferred across heterogeneous data sources without paired datasets.
13. 【2607.21545】owards Robust Iris Recognition Through Occlusion Identification and Conditional Diffusion-Based Reconstruction
链接：https://arxiv.org/abs/2607.21545
作者：Kamrul Hasan,Mylene C.Q. Farias,Oleg V. Komogortsev
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reliable biometric approach, reliable biometric, biometric approach, approach that identifies, identifies individuals
备注： Accepted by IEEE International Joint Conference on Biometrics (IJCB) 2026
点击查看摘要
Abstract:Iris recognition is a reliable biometric approach that identifies individuals using the distinctive and stable texture of the iris. However, recognition performance can degrade when discriminative iris texture is partially occluded by eyelids, eyelashes, specular reflections, or other acquisition artifacts. Existing approaches often perform recognition directly on degraded samples or rely only on the remaining visible iris region, which may be inadequate when substantial texture is corrupted. To address this limitation, we propose an occlusion-aware iris recognition framework with three sequential modules: occlusion-type identification, diffusion-based reconstruction, and deep-learning-based recognition. First, a residual 2D CNN-based network determines whether an iris image is non-occluded or belongs to one of the controlled occlusion categories. Second, the occluded image, binary mask, and predicted occlusion type condition a denoising diffusion probabilistic model to reconstruct the corrupted region. Finally, VGG19-HPMNet, a modified VGG19 model with horizontal pyramid mapping, extracts discriminative global and part-wise local iris features for recognition. Experiments on the CASIA-Iris-Thousand dataset under a controlled synthetic-occlusion protocol show that the proposed framework improves iris recognition performance by identifying the occlusion type, reconstructing masked regions, and re-evaluating the restored iris samples.
14. 【2607.21529】ElasticTTT: Prior-Preserving Test-Time Tuning for Video Editing
链接：https://arxiv.org/abs/2607.21529
作者：Yueyi Liu,Chi Zhang,Sen Cui,Miao Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Test-Time Tuning, pretrained diffusion models, pretrained diffusion, powerful paradigm, Asynchronous Noise Schedule
备注：
点击查看摘要
Abstract:Test-Time Tuning (TTT) on pretrained diffusion models has emerged as a powerful paradigm for video editing. However, there exists a foundational mismatch between the distribution-mapping nature of generative models and the single-point optimization of standard TTT. In this paper, we demonstrate that this mismatch triggers \textit{Prior Collapse}, a degenerate state where the model discards the text conditions and spatial latents, collapsing generations to the source video, or entangling the features of distinct regions. To resolve this, we propose \textbf{ElasticTTT}, a novel framework that preserves the prior generative distribution and rescues generative elasticity. Specifically, we propose \textit{Target Distribution Regularization} to prevent sharp memorization minima, \textit{Contrastive CFG} to guide inference away from source biases, and \textit{Asynchronous Noise Schedule} to preserve unedited regions. Extensive evaluations, supported by theoretical analysis, demonstrate that ElasticTTT successfully preserves the generative prior of the base model, achieving state-of-the-art performance on one-shot video editing.
15. 【2607.21526】Boosting Robustness for All-Weather Self-Supervised Depth Estimation in Autonomous Driving
链接：https://arxiv.org/abs/2607.21526
作者：Mengshi Qi,Xiaoyang Bi,Xianlin Zhang,Huadong Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：safe autonomous driving, sensor perception degradation, Self-supervised depth estimation, weather conditions due, adverse weather conditions
备注：
点击查看摘要
Abstract:Self-supervised depth estimation is challenging for safe autonomous driving under various adverse weather conditions due to sensor perception degradation. These challenges arise from two main aspects. Firstly, adverse conditions can distort pixel correspondences and violate the assumptions embedded in the self-supervised loss function, leading to erroneous depth predictions. Secondly, while radar is a widely adopted sensor in adverse weather conditions, the sparse distribution of radar points in the Point of View (POV) poses challenges for self-supervised fusion. To address these issues, we introduce a novel self-training pipeline using unpaired real all-weather data through multi-teacher distillation and robust radar fusion. We propose the Uncertainty-Aware Multi-Teacher Distillation method to generate diverse teacher models with different adverse condition inputs, and then employ uncertainty modeling to weigh the knowledge distillation loss. Additionally, we design the POV-BEV Radar Fusion approach, which leverages camera-pixel ray constraints to establish connections between the camera's Point of View (POV) and the radar's Bird's-Eye View (BEV). This approach enables the utilization of denser radar points, effectively capturing the complementary perspectives of both POV and BEV. Extensive quantitative and qualitative experiments demonstrate the robustness of our proposed method on all-weather datasets, achieving state-of-the-art performance. Our code and models are available at this https URL.
16. 【2607.21522】GS-Agent: Creating 4D Physical Worlds With Generative Simulation
链接：https://arxiv.org/abs/2607.21522
作者：Hongxin Zhang,Chunru Lin,Junyan Li,Zhou Xian,Tsun-Hsuan Wang,Chuang Gan
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Creating dynamic, fascinating and challenging, worlds, natural language, Creating
备注：
点击查看摘要
Abstract:Creating dynamic and physically realistic 4D worlds from natural language descriptions is both fascinating and challenging. Traditional computer graphics methods rely on manual creation, requiring extensive human effort to fine-tune materials, motions, and visual fidelity. Recent advances in generative foundation models have sparked interest in learning to generate such 4D worlds from large-scale data; however, existing methods still struggle to ensure physical plausibility and controllability. In this work, we take a different path by leveraging foundation models to construct an agentic system that emulates how humans traditionally create 4D worlds, yet automates the entire process. We present GS-Agent, an end-to-end multi-agent framework that integrates physics engines in the loop to generate realistic, dynamic, and controllable 4D physical worlds from natural language. Inspired by how humans build 4D worlds, GS-Agent decomposes the task into entity management, covering 3D asset curation, material tuning, placement, and motion control, and rendering configuration, including camera and lighting manipulation. Multiple agents with distinct expertise interact with the physics engine via code, seek multimodal feedback, and collaborate to iteratively construct 4D worlds that align with the given descriptions. Experimental results show that GS-Agent effectively converts natural language into diverse and physically plausible 4D worlds exhibiting rich interactions among liquids, deformable objects, and rigid bodies, while achieving cinematic camera and lighting control. We envision GS-Agent as a foundation for a new paradigm in 4D world generation, empowering creative content creation and physical AI. Project page at this https URL
17. 【2607.21504】xture++: Elevating 3D Asset Texture Resolution with a Region-Aware Diffusion Model
链接：https://arxiv.org/abs/2607.21504
作者：Shuaiwei Wang,Shi Li,Jieting Xu,Yuchi Huo,Qi Wang,Wenting Zheng,Rengan Xie
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：current super-resolution models, super-resolution models ignore, ignore texture maps, models ignore texture, natural images
备注：
点击查看摘要
Abstract:Numerous 3D assets are discarded due to low texture resolution, while current super-resolution models ignore texture maps and focus on natural images. An efficient and generalizable texture super-resolution model can revitalize a large corpus of aging yet valuable assets across industries such as film and video games. We present Texture++, a novel framework for texture super-resolution, which enhances the low-resolution textures of assets to produce high-resolution, high-quality results. Specifically, we reformulate the task of super-resolution in UV space into performing it across multiple rendered views and merging the outputs. Firstly, to achieve more complete and continuous textures in the view space, we propose an adaptive view selection strategy to integrate textures dispersed across UV texture patches. Furthermore, we introduce a quadtree-based texture region organization method for combining super-resolved textures from different viewpoints, providing masks to distinguish regions that require improvement. Finally, we design a diffusion-based super-resolution model that enhances the texture resolution for specified masked regions, seamlessly integrating with surrounding regions. Through comprehensive evaluations, we demonstrate that our approach yields textures with substantially improved detail and coherence over existing methods.
18. 【2607.21485】Recurrent Sinusoidal INRs for Efficient High-Fidelity Representation
链接：https://arxiv.org/abs/2607.21485
作者：Hyunmin Cho,Jaejun Yoo,Kyong Hwan Jin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：study sinusoidal recurrence, implicit neural representations, harmonic spectral enrichment, iterative mechanism, enrichment in implicit
备注： Accepted to ECCV 2026 (Poster)
点击查看摘要
Abstract:We study sinusoidal recurrence as an iterative mechanism for harmonic spectral enrichment in implicit neural representations (INRs). Our analysis reveals that sinusoidal activations induce a harmonic line spectrum, providing a spectral account of how recurrent unrolling enriches the effective spectral support. We realize this principle with a shared sinusoidal block that iteratively refines the latent representation. We empirically validate the resulting spectral behavior against feed-forward INRs, non-sinusoidal recurrent variants, and equilibrium-style sinusoidal models. Complementing this analysis, we evaluate the proposed architecture across image and 3D representation tasks. On RGB image benchmarks, our method achieves higher fidelity than feed-forward baselines with fewer parameters and fewer optimization steps, and it further transfers favorably to super-resolution, NeRF, and SDF tasks.
19. 【2607.21471】Future Rendering $\neq$ Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window
链接：https://arxiv.org/abs/2607.21471
作者：Yukun Shi,Minglun Gong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Dynamic-scene reconstruction, robot interaction, evaluated inside, deployment settings, anticipatory planning
备注： See [this https URL](https://github.com/Ricky-S/futuresurf)
点击查看摘要
Abstract:Dynamic-scene reconstruction is almost always evaluated inside the observed time window, yet deployment settings such as AR overlays, robot interaction, and anticipatory planning need the future surface: the geometry at times beyond those captured. No standard benchmark measures this. We introduce FutureSurf, a controlled diagnostic benchmark and dataset for future-time surface reconstruction that trades scene diversity for exact future ground truth and falsification controls. A method trains on the observed first 75% of a sequence; we score its extracted per-frame surface on the held-out future by Chamfer distance, reporting absolute future CD as the primary score and the future/observed gap as a diagnostic. The dataset contains eight analytically defined controlled motions, including three falsification controls, with exact per-frame ground-truth meshes. We also provide a ground-truth-side recoverability oracle. The release includes split files, scoring code, a benchmark card, and Croissant metadata. On the controlled motions, the DG-Mesh backbone leaves a 2.7-4.1$\times$ gap even for futures predictable in principle (four of five recoverable from observed motion by a fixed rule), while the falsification controls behave as designed (the surface-invariant motion shows no gap). Beyond the contributed dataset, the gap persists across six animated DG-Mesh asset scenes and a second backbone, Deformable-3DGS (2.0-6.6$\times$; both share a deformation-MLP temporal model). The benchmark also shows that future rendering quality and future-surface accuracy are statistically decoupled, so the novel-view-synthesis metrics the field reports do not track future geometry. The future error is structured, concentrating where the surface moves. The dataset, evaluation toolkit, and scoring code are available on Hugging Face and GitHub (this https URL).
20. 【2607.21467】CLUIE: Clustering-Aware Recurrent Propagation with Local Structural Compensation for Underwater Image Enhancement
链接：https://arxiv.org/abs/2607.21467
作者：Kui Jiang,Zefan Feng,Laibin Chang,Yan Luo,Junjun Jiang,Xiaopeng Fan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：wavelength-dependent light absorption, remains challenging due, enhancement remains challenging, light absorption, color distortion
备注： 13 pages, 12 figures, IEEE Transactions on Image Processing journal paper, code available at [this https URL](https://github.com/geekpool/CLUIE) . This paper presents CLUIE, a clustering-aware recurrent RWKV framework for spatially heterogeneous underwater image enhancement, with full-reference/no-reference quantitative comparisons, comprehensive ablation studies and feature visualization for CSDR and DMLP modules
点击查看摘要
Abstract:Underwater image enhancement remains challenging due to wavelength-dependent light absorption, scattering, and backscattering, which jointly cause color distortion, contrast degradation, and detail loss. Since these degradations vary with scene depth and imaging conditions, different regions within the same image often exhibit heterogeneous degradation patterns and thus require region-adaptive restoration. Although visual RWKV models offer an efficient linear-complexity solution for long-range dependency modeling, their predefined scanning orders are content-agnostic and therefore fail to adapt recurrent state propagation to spatially non-uniform restoration demands. To address this limitation, we propose a Clustering-aware RWKV framework, termed CRWKV, which reformulates the fixed recurrent propagation path of conventional RWKV into a content-adaptive token trajectory. Specifically, we introduce Clustering-aware Semantic Dynamic Reordering (CSDR), which groups tokens according to semantic feature similarity and derives a dynamic traversal order from inter-cluster contextual relations. This design enables WKV states to be accumulated along semantically correlated regions rather than fixed spatial or spectral orders. Since dynamic reordering may disrupt the local continuity of original spatial neighborhoods, we further propose Dark-response Modulated Local Propagation (DMLP), which extracts local structural responses via depth-wise convolution and adaptively modulates their propagation strength using a neighborhood-aware pseudo-dark response map. In this way, local structural cues are compensated before recurrent aggregation while preserving content-adaptive long-range modeling. Extensive experiments on multiple underwater image enhancement benchmarks demonstrate that CRWKV achieves state-of-the-art quantitative performance and superior visual quality.
21. 【2607.21456】SPDCN: Strip-based Deformable Convolutional Network for Steel Surface Defect Segmentation
链接：https://arxiv.org/abs/2607.21456
作者：Zhongming Liu,Bingbing Jiang,Guangxin Wan,Xiang Zou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：industrial quality inspection, isotropic receptive fields, Deformable Convolutional Networks, irregular defect boundaries, existing methods struggle
备注：
点击查看摘要
Abstract:Steel surface defect segmentation is critical for industrial quality inspection, yet existing methods struggle with elongated, anisotropic defects such as cracks and scratches due to the isotropic receptive fields of standard convolutions and rigid sampling grids that cannot adapt to irregular defect boundaries. To address these limitations, we propose Strip-based Predictor for Deformable Convolutional Networks (SPDCN) with two key innovations. The \textbf{Fuzzy-enhanced Multi-scale Context Module (FMCM)} employs group-wise multi-branch convolutions with an intuitionistic fuzzy channel attention mechanism to adaptively capture multi-scale contextual information across varying defect sizes. The \textbf{Adaptive Direction-Aware Deformable Convolution (ADADC)} replaces the conventional offset predictor with decoupled horizontal and vertical strip convolutions, enabling the deformable sampling grid to anisotropically align with the principal orientation of elongated defects. Extensive experiments on public steel surface defect benchmarks demonstrate that SPDCN consistently outperforms state-of-the-art methods, achieving 89.60\% mIoU on NEU-Seg with only 3.54M parameters. The source code is publicly available at this https URL .
22. 【2607.21448】GrainGS: Gradient-Decoupled Gaussian Splatting for Efficient Dynamic Novel View Synthesis
链接：https://arxiv.org/abs/2607.21448
作者：Jiahao He,Yihua Shao,Zhengkai Zhao,Pan Gao,Fei Ma,Jingcai Guo,Hao Tang,Nicu Sebe,Qi Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fine-grained motion modeling, Gaussian Splatting requires, Gaussian Splatting, structural stability, Dynamic scene reconstruction
备注：
点击查看摘要
Abstract:Dynamic scene reconstruction with 3D Gaussian Splatting requires a balance between fine-grained motion modeling, structural stability, and compact representation. Existing per-primitive methods provide flexible local deformation but often suffer from redundant primitive growth, while anchor-based methods improve spatial regularity at the cost of suppressing locally varying motion. To address these issues, we present GrainGS, a dynamic Gaussian framework that combines a hierarchical anchor scaffold with per-Gaussian deformation. A static warm-up stage first establishes a time-invariant canonical representation from observations across all timestamps. During joint training, a stop-gradient operation blocks the deformation-mediated gradient pathway to the canonical positions while preserving their direct refinement through the reconstruction objective. Each Gaussian then predicts independent temporal offsets for position, rotation, and scale, enabling detailed local motion within a structurally constrained scaffold. A canonical-residual appearance decomposition further models frame-dependent photometric changes without forcing them into geometric deformation. Experiments on synthetic monocular and real-world multiview benchmarks show that GrainGS achieves high reconstruction quality, real-time novel view synthesis, and compact storage. Under the synthetic benchmark setting, it reaches an average peak signal-to-noise ratio of 36.98 decibels, renders at 435.6 frames per second, and requires 4.67 megabytes of storage.
23. 【2607.21446】KroQuant: Kronecker-Structured Block Transforms for Efficient Post-Training Quantization of Diffusion Transformers
链接：https://arxiv.org/abs/2607.21446
作者：Yann Bouquet,Alireza Khodamoradi,Kristof Denolf,Mathieu Salzmann
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：severely degrades output, Post-training quantization, formats cannot represent, diffusion transformers, severely degrades
备注：
点击查看摘要
Abstract:Post-training quantization (PTQ) of diffusion transformers (DiTs) to W4A4 severely degrades output quality, because activations entering each linear layer contain outliers that 4-bit formats cannot represent. The standard fix applies an invertible linear transform to the activations and its inverse to the weights before quantizing both. Normalization layers between blocks force this transform to run online at every denoising step, making its inference computation cost the binding design constraint. Existing options trade quantization quality for inference cost: per-channel scaling (SmoothQuant) is computationally cheap but impacts the magnitude of the channels, which can harm quantization accuracy; fixed Hadamard transforms yield better quantization accuracy but require large block sizes that incur a high online cost; learned full-$d$ invertible transforms calibrate best but entail a prohibitive dense $d \times d$ matrix multiplication (GEMM) per layer per step. We propose KroQuant, a PTQ method that applies a learned Kronecker-structured invertible transform to each 32-element block of the activation, storing less than half the parameters of per-channel scaling. The block-local structure runs as small tensor-core GEMMs, and on an MI350 GPU the KroQuant quantizer kernel is up to $14\%$ faster than the SmoothQuant kernel. Offline LoRaQ weight calibration then absorbs the residual per-weight quantization error. On PixArt-$\Sigma$, SANA, and FLUX.1-schnell at W4A4 (MXFP4e2), KroQuant produces outputs closer to the FP reference than SVDQuant and LoRaQ on MJHQ-30K and SDCI, while preserving or improving image quality.
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.21446 [cs.LG]
(or
arXiv:2607.21446v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.21446
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
24. 【2607.21438】DAPM: UAV Monocular Depth Estimation from Any Height, Pitch, Roll and FOV
链接：https://arxiv.org/abs/2607.21438
作者：Tong Ling,Wenhui Diao,Yingchao Feng,Hanbo Bi,Zhongyan Hou,Xian Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned Aerial Vehicles, navigation in Unmanned, Aerial Vehicles, Unmanned Aerial, Monocular depth estimation
备注：
点击查看摘要
Abstract:Monocular depth estimation is a fundamental prerequisite for 3D reconstruction and autonomous navigation in Unmanned Aerial Vehicles (UAVs). In practical deployments, UAVs operate under highly dynamic camera poses characterized by continuous variations in height, pitch, roll, and field of view (FOV). Existing monocular depth estimation methods frequently fail to generalize across such diverse perspectives and the expansive scale of depth distributions inherent in aerial scenes. To address these challenges, we establish a quantitative representation of UAV viewing angles through rigorous theoretical analysis, deriving the geometric correspondence between viewing angles and view distances using the ground plane as a reference for observation. Building upon this, we propose Depth Estimation for Any Perspectives Model (DAPM), representing the first monocular framework specifically designed for UAV aerial imagery to jointly estimate camera pose and depth under continuously varying viewpoints. Specifically, we introduce an Ideal Ground Depth (IGD) module that leverages the derived geometric relationships between UAV perspectives and view distances to implement dense camera-pose supervision and enhance depth features. And we further develop a coarse-to-fine Progressive Quantization Bins (PQB) module. By incorporating progressive supervision and hierarchical quantization bins, the PQB module enables robust estimation in complex UAV aerial imagery. To evaluate the proposed framework, we present the UAV Any Perspectives Depth (UAPD) dataset, featuring comprehensive and continuous distributions of pose parameters. Experimental results on UAPD demonstrate that DAPM achieves state-of-the-art performance across both depth and camera-pose estimation metrics. The source code and datasets are available at: this https URL.
25. 【2607.21434】Adaptive Identity Anchoring: Closed-Loop Keyframe Placement for Synthetic Paired Supervision in Video Face Swapping
链接：https://arxiv.org/abs/2607.21434
作者：Logan Robbins
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Video face swapping, person face performing, Video face, person video, natural paired supervision
备注：
点击查看摘要
Abstract:Video face swapping has no natural paired supervision: no real footage exists of one person's face performing another person's video. The strongest current answer, DreamID-V's SyncID-Pipe, mints pairs by replacing the identity in exactly two frames of a real clip -- the first and the last -- and regenerating the rest from a pose sequence alone. Pose carries no appearance evidence of the swapped-in identity, so over long clips, occlusions, and extreme pose excursions the synthesized identity has a long unanchored span on which to drift; no published ablation examines anchor count or placement. We propose Adaptive Identity Anchoring (AIA): (i) generalize the synthesizer to arbitrary anchor sets, architecturally natural for diffusion-forcing-style transformers where conditioning on a frame is clamping its tokens to zero noise; (ii) place anchors by a closed feedback loop that scores every generated frame against the real reference identity and inserts an image-face-swapped anchor at the worst-scoring frame until the pair passes a threshold or exhausts a budget; (iii) reuse the loop's verdict as an automatic data filter. A second pathology, the beauty-filter look of over-smoothed skin, has the same root cause: micro-texture, like identity, is priced by none of the pipeline's objectives. We therefore pair AIA with Reality-Referenced Texture Restoration: matched re-graining from each real frame's non-face regions, band-split transfer of sub-identity micro-texture from the real footage, and a second, spectral acceptance channel refereed by the footage's own spectrum. Identity-anchor density, we argue, is a controllable quality dial, and we specify falsifiable experiments -- drift-versus-gap curves, uniform-versus-adaptive placement at matched budgets, student training on AIA-minted data, and texture ablations with a human beauty-filter study -- that would validate or refute the proposal.
26. 【2607.21417】owards Privacy-Preserving Federated Prompt Tuning under Data Heterogeneity: A Subspace-Decomposed Expert Approach
链接：https://arxiv.org/abs/2607.21417
作者：Yuhua Wang,Xiaodong Li,Yihao Guo,Yuxiang Jia,Qinnan Zhang,Yifan Sun,Hainan Zhang,Yongxin Tong,Zhiming Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Federated prompt tuning, enables collaborative adaptation, Federated prompt, language models, enables collaborative
备注： Accepted by ACM MM 2026
点击查看摘要
Abstract:Federated prompt tuning (FPT) enables collaborative adaptation of vision--language models (VLMs) using lightweight prompts. Existing methods often address heterogeneity and privacy through a split-prompt design under local differential privacy (DP), combining a shared prompt for global transfer with private prompts for local adaptation. However, a single shared prompt may over-smooth diverse transferable knowledge, weakening the balance between personalization and generalization. Multi-expert prompts (MEPs) can better capture this diversity, but enlarge the communicated space, increasing DP noise and communication cost while making robust expert composition more difficult. We propose FedSEPT, a privacy-preserving Fed}erated Subspace-decomposed Expert Prompt Tuning. Specifically, we employ Subspace-decomposed Expert Modeling (SEM) to parameterize multiple prompt experts with shared low-rank factors, a fixed public basis, and private residuals, thereby confining communication and DP perturbation to a compact factor space while enabling direct server aggregation in a common coordinate system. We further design Instance-aware Expert Fusion (IEF), which adaptively combines semantically complementary experts via on-device routing and performs efficient logit-level fusion using cached expert-specific text features. Extensive experiments on 11 heterogeneous benchmarks show that, under the same privacy constraints, FedSEPT achieves a better trade-off between local adaptation and global generalization than strong baselines.
27. 【2607.21416】GLAM-SLAM: Real-time Gaussian Large-scale Mapping via Flow Densification and Spatial Decomposition
链接：https://arxiv.org/abs/2607.21416
作者：Panagiotis Mermigkas,Argyris Manetas,Petros Maragos
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：monocular Simultaneous Localization, prohibitive GPU memory, Simultaneous Localization, GPU memory requirements, monocular Simultaneous
备注： Accepted to IROS 2026. Project page: [this https URL](https://glamslam.github.io/) Code: [this https URL](https://github.com/pmermigkas/GLAM-SLAM/)
点击查看摘要
Abstract:Existing Gaussian-splatting-based monocular Simultaneous Localization and Mapping (SLAM) systems are either tailored to short sequences, are not real-time, or suffer from prohibitive GPU memory requirements, limiting their applicability in realistic, long-horizon scenarios. To address this, we present GLAM-SLAM, a real-time, decoupled Gaussian-splatting SLAM system designed for large-scale outdoor scenes. We ensure lightweight tracking using a robust, feature-based SLAM frontend, while for mapping, we adopt a structured, sparse anchor grid representation that ensures scalable operation and maintains scene coherence across long-term sequences. To satisfy the dense initialization requirements of 3D Gaussian Splatting (3DGS), we introduce a geometry-based flow-densification anchoring strategy using epipolar constraints. Furthermore, by treating mapping as a multi-scene problem, we propose a scene-partitioning strategy that introduces a strong spatial inductive bias via MLP initializations to generate localized Gaussians. We evaluate our system on the challenging, long-sequence KITTI Odometry, Oxford RobotCar, and M'alaga datasets. Extensive ablations and comparisons demonstrate a 15% improvement in reconstruction quality over the second-best performer, while maintaining real-time performance and the ability to scale to longer sequences. Code is publicly available for the benefit of the community.
28. 【2607.21401】When Are Reasoning-Based Guardrails Not Efficient? ResponseGuard: A Fast Vision-Language Guard for Real-Time Moderation
链接：https://arxiv.org/abs/2607.21401
作者：Dongbin Na
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：assistant returns, guard, vision-language, answer, vision-language guard
备注： 8 pages, 6 figures, 3 tables. Project page: [this https URL](https://ndb796.github.io/ResponseGuard) ; Code: [this https URL](https://github.com/ndb796/ResponseGuard)
点击查看摘要
Abstract:A vision-language AI assistant returns its answer as a stream of generated tokens. Therefore, a safety guard that watches that answer has to keep up with the stream and stop a harmful reply before a user reads it. Recent vision-language guardrails instead generate a chain of thought before they issue a verdict. They believe that step-by-step reasoning yields a safer guard. This design makes the guard heavy and slow, since the model must decode many tokens for harmfulness detection. We pose the question of whether a vision-language guard really needs to reason in order to screen a response. We answer with a guard that has no chain. ResponseGuard reads a harmful verdict from a single pooled representation of the request, the response, and the image in one forward pass. Across a standard multimodal guardrail benchmark, our 2B ResponseGuard outperforms a recent 3B reasoning-based vision-language guard on response harmfulness detection, without any reasoning and at about 150 times lower time cost. On request harmfulness the reasoning guard retains an overall lead, and the remaining gap on both tracks sits on the image-only cells. We observe that the gap may stem from the frozen vision encoders that both designs use rather than from the missing chain. We have also found the reasoning guard directs almost none of its verdict attention to the image. Based on a single-pass detection, ResponseGuard can screen an answer sentence by sentence as it streams and stop a harmful answer before it finishes. For guarding the response of a vision-language model, a calibrated single-pass label may provide a sufficient safety signal. We fully release all source code, trained models, and datasets at this https URL.
29. 【2607.21371】DINOde: Continuous Vision-Text Alignment for Open-Vocabulary Semantic Segmentation
链接：https://arxiv.org/abs/2607.21371
作者：Sung-Hoon Yoon,Hoyong Kwon,Changgyoon Oh,Kuk-Jin Yoon
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Open-vocabulary semantic segmentation, leverages textual semantics, Open-vocabulary semantic, predefined categories, Global Context Flow
备注： Accepted to ECCV 2026. 27 pages, 8 figures, and 10 tables. Includes supplementary material
点击查看摘要
Abstract:Open-vocabulary semantic segmentation (OVSS) leverages textual semantics to segment objects beyond predefined categories. While the self-supervised model DINOv3 provides strong structured visual representations, its lack of native textual alignment hinders its direct application to OVSS. To bridge this gap, we propose DINOde, an ODE-based framework that continuously aligns CLIP text embeddings with the DINO visual manifold. Our approach employs two complementary components: (i) Semantic Text Flow (STF), which evolves text embeddings toward the DINO manifold through a continuous ODE trajectory, and (ii) Global Context Flow (GCF), which progressively refines the holistic image representation carried by DINO's CLS token. To preserve the hyperspherical geometry of the feature space during this evolution, we further introduce Velocity Tangent Projection, which constrains the learned velocity field to the tangent space. By modeling alignment as a continuous trajectory, DINOde avoids the manifold entanglement inherent in discrete MLP projections and yields more robust cross-modal alignment. Extensive experiments demonstrate that DINOde consistently outperforms existing methods and achieves state-of-the-art performance across multiple OVSS benchmarks. The code is available at this https URL.
30. 【2607.21370】ASTRA-Net: Anatomy-Specific Transfer and Representation Alignment for Drug-Induced Sleep Endoscopy Segmentation
链接：https://arxiv.org/abs/2607.21370
作者：Suhua Sun,Yuqiao Wang,Sheng Liu,Rui Fan,Jiajun Wang,Ruoyan Xu,Yixin Chen,Tao Li,Yan Yan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires reliable airway, specific anatomical levels, reliable airway boundaries, Quantitative drug-induced sleep, drug-induced sleep endoscopy
备注： 20 pages, 6 figures, 5 tables
点击查看摘要
Abstract:Quantitative drug-induced sleep endoscopy (DISE) requires reliable airway boundaries at specific anatomical levels. Pixel-level DISE annotations are scarce, and manual contouring limits the scalability of quantitative assessment. To address this limitation, we developed ASTRA-Net for known-plane DISE segmentation with limited real annotations. Stage 1 aligned intermediate ConvNeXt-Base representations from 14,250 unlabeled virtual endoscopy frames derived from computed tomography and real DISE frames. Virtual images were used only for feature alignment. Stage 2 fine-tuned four independent UNet++ decoders on 401 real annotated frames. Structured zero-mask supervision constrained incompatible plane outputs and invalid frames. Six alignment configurations used maximum mean discrepancy, domain adversarial learning, or both objectives. On a hold-out evaluation set of 100 frames, the five-model MMD-only segmentation ensemble achieved a mean Dice of 0.8927, with a 95% image-level bootstrap interval of 0.8631 to 0.9160. The mean intersection over union was 0.8239. A classification- enabled variant of the same alignment configuration reached a restricted four-plane top-1 accuracy of 0.92 on the same hold-out frames. These results indicate that ASTRA-Net can support frame-level, plane-specific DISE boundary delineation when real annotations are limited.
31. 【2607.21368】Incremental Optimal Assignment for Real-Time Crowd Tracking
链接：https://arxiv.org/abs/2607.21368
作者：Ismail H. Toroslu
类目：Computer Vision and Pattern Recognition (cs.CV); Data Structures and Algorithms (cs.DS)
关键词：bipartite assignment problem, Multi-object tracking, Hungarian algorithm, video frame, solving a bipartite
备注：
点击查看摘要
Abstract:Multi-object tracking in dense crowds requires solving a bipartite assignment problem between detections and trajectories at every video frame. The classical Hungarian algorithm solves this in $O(N^3)$ time, which becomes a bottleneck for large scenes with hundreds of people. We propose an \emph{incremental} assignment algorithm that exploits the block-sparse structure of crowd tracking cost matrices --- dense within each crowd cluster, near-zero between clusters. We compute the exact same optimal $N \times N$ assignment as the Hungarian algorithm, but via an incremental strategy: we add one person at a time, exploiting the fact that after step $n-1$ the dual potentials are \emph{exactly optimal} for the $(n-1)\times(n-1)$ subproblem --- a strictly stronger condition than the intermediate feasibility maintained by the Hungarian algorithm during its $N$ outer iterations. Each new step therefore requires only a single augmenting path search from a certified optimal starting point. This avoids repeated full-matrix scans while guaranteeing an identical globally optimal result. A diagonal-reordering invariant keeps the data structure compact and cache-friendly. On realistic crowd benchmarks with $N \in [200, 5000]$ people organised into dense clusters, our algorithm achieves \textbf{3.7--6.5$\times$ speedup} over the Hungarian baseline while producing provably optimal matchings identical to those of Hungarian. The speedup grows with $N$ and remains stable beyond $N=3000$, making the method especially attractive for large-scale crowd scenes such as stadium exits and mass public events.
32. 【2607.21347】Quality-Aware Multimodal Fusion Reveals Implicit Identity in Valence-Arousal Features
链接：https://arxiv.org/abs/2607.21347
作者：Jisu Kim,Benjamin S. Riggan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：static appearance cues, poor lighting, static appearance, cues and degrades, degrades in unconstrained
备注： 10 pages, 3 figures, 6 tables. Accepted for publication at IEEE International Joint Conference on Biometrics (IJCB), 2026
点击查看摘要
Abstract:Conventional face recognition relies on static appearance cues and degrades in unconstrained settings with expression variation, occlusion, and poor lighting. We hypothesize that audiovisual expression dynamics carry identity-discriminative information complementary to static appearance, and that extracting this signal requires multimodal representations robust to the variable input quality of in-the-wild video. To learn such representations, we cast multimodal valence-arousal (VA) estimation as a pretext task and propose Quality-Aware Adaptive Fusion (QAAF), which estimates per-sample, per-modality reliability and adapts each modality's contribution through learned soft gating and a quality-dependent dropout. For the problem of VA estimation, QAAF achieves an average Concordance Correlation Coefficient (CCC) of 0.472 via late fusion ensembling on Aff-wild2, improving over a baseline ensemble under the same setting (0.415) as well as a single-backbone baseline (0.288). Furthermore, the proposed QAAF demonstrates greater resilience to unavailable modalities, with only a 7.5-34.4% relative decrease in CCC when one modality is missing. We then probe whether these VA-trained features encode identity without identity-specific training. On AFEW-VA (67 actors) and YTF (1,595 subjects), VA-trained backbone features rank first among evaluated soft biometric methods, and score-level fusion with ArcFace lowers EER on both datasets (0.022 to 0.021 on AFEW-VA, 0.106 to 0.104 on YTF), correcting 68.2% of ArcFace's false accepts on AFEW-VA. These findings establish multimodal VA estimation as a soft biometric modality complementary to conventional face recognition.
33. 【2607.21343】M$^3$-Gen: Interpretable Multimodal Generation of Gene Expression Profiles Using Clinical and Imaging Data
链接：https://arxiv.org/abs/2607.21343
作者：Francesca Pia Panaccione,Carlo Sgaravatti,Marco Venere
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：comprehensive disease understanding, heterogeneous biomedical data, gene expression profiles, Integrating heterogeneous biomedical, gene expression data
备注： 15 pages, 6 figures
点击查看摘要
Abstract:Integrating heterogeneous biomedical data, including clinical metadata, histopathology images, and molecular profiles, is crucial for comprehensive disease understanding. However, gene expression data acquisition remains constrained by high costs and privacy concerns, limiting its use in multimodal research and AI-driven applications. We present MultiModal Molecular Generation (M$^3$-Gen), a novel framework for the generation of gene expression profiles by conditioning a Generative Adversarial Network on histopathology images and clinical metadata. M$^3$-Gen learns a unified latent representation from the clinical variables and the images, leveraging contrastive learning, and exploits the embeddings of the two modalities to guide a generative model in producing biologically coherent gene expression profiles. Evaluations on the TCGA dataset demonstrate that M$^3$-Gen generates realistic and functionally meaningful gene expression data. Importantly, by integrating multiple modalities in an attention-based mechanism, M$^3$-Gen provides intrinsic explainability: it allows the identification of which regions of the histopathology images most strongly influenced the generation of specific gene expression profiles, making the model's decisions interpretable by design.
34. 【2607.21326】SlerpFlow: Spherical Trajectory Correction for Rectified Flow Inversion
链接：https://arxiv.org/abs/2607.21326
作者：Wenbin Duan,Yan Shu,Zhuoyuan Fu,Fangmin Zhao,Yan Li,Yaru Zhao,Binyang Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：demonstrated outstanding performance, high-quality image generation, diffusion transformers, demonstrated outstanding, outstanding performance
备注： 16 pages. Accepted at ICML 2026
点击查看摘要
Abstract:Rectified-flow-based diffusion transformers, particularly FLUX, have demonstrated outstanding performance in high-quality image generation. However, achieving fast and accurate inversion--transforming images back to latent noise for faithful reconstruction and editing--remains a challenging bottleneck due to the discretization errors of linear solvers. This paper introduces SlerpFlow, a straightforward yet highly effective zero-shot approach that unlocks the full potential of FLUX for high-fidelity inversion and editing. Unlike existing approaches (e.g., RF-Solver) that rely on complex numerical approximations such as high-order Taylor expansions to correct trajectory errors, we present a geometric view based on the Manifold Hypothesis: the empirically observed trajectory curvature is not a numerical artifact, but rather serves as a necessary "centripetal force" that constrains the flow to remain on the data manifold. Guided by this insight, SlerpFlow integrates Spherical Linear Interpolation (Slerp) to rectify flow velocity directions on the hypersphere, strictly adhering to the intrinsic curvature of the latent space. Crucially, by caching the corrected velocity for subsequent steps, SlerpFlow achieves high-precision inversion while maintaining the computational efficiency of a first-order Euler solver. Extensive experiments on FLUX-based reconstruction and editing tasks demonstrate that SlerpFlow improves reconstruction fidelity and achieves stronger semantic alignment in editing without requiring additional training. Code is available at this https URL.
35. 【2607.21318】PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing
链接：https://arxiv.org/abs/2607.21318
作者：Jian Zhang,Zhijun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：shape requires complete, natural target formation, target formation unconstrained, complete source removal, requires complete source
备注：
点击查看摘要
Abstract:Replacing an object with one that differs in category or shape requires complete source removal, natural target formation unconstrained by the source silhouette, and preservation of unrelated content. Existing training-free editors either localize edits from terminal predictions under source and target prompts or preserve unrelated content through spatially unselective source-feature reuse without explicit region discovery. Before reaching the terminal predictions, prompt-induced semantic differences undergo additional network transformations that may obscure their spatial localization, reducing localization precision. Spatially unselective feature reuse forces a trade-off between edit completeness and background preservation. Therefore, we propose PC-Edit, a prompt-contrastive framework for training-free MM-DiT editing. PC-Edit contrasts the image-token attention outputs under the source and target prompts, capturing prompt-induced semantic differences directly where text-conditioned information is delivered to image tokens. The same contrast identifies a source-erasure region during inversion and a target-emergence region during denoising. Their union suppresses source remnants while allowing the target object to form naturally. PC-Edit further couples region discovery and background preservation within each sampling step by estimating the current edit region from preceding attention blocks and immediately injecting cached source K/V features outside it in subsequent blocks, thereby protecting unrelated content before the latent update. Experiments on PIE-Bench and our EditRegion-Bench, with human-verified edit-region annotations for single- and multi-object addition and replacement, show that PC-Edit achieves the best editing quality and background preservation among methods without user-specified edit regions.
36. 【2607.21300】Unlearning Under Imbalance: Benchmarking Fairness in Multimodal LLM Unlearning
链接：https://arxiv.org/abs/2607.21300
作者：Lorenzo Orsingher,Thomas De Min,Massimiliano Mancini,Davide Talon,Elisa Ricci
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：removing personal data, Machine unlearning, recent AI regulations, tool for removing, removing personal
备注： 33 pages
点击查看摘要
Abstract:Machine unlearning has emerged as a tool for removing personal data from trained models to comply with recent AI regulations. To evaluate unlearning effectiveness in multimodal large language models (MLLMs), prior works fine-tune models on fictitious identities, simulating unlearning requests on subsets of these IDs, which are typically uniformly distributed. However, in realistic scenarios, people from different demographic groups may request to be unlearned at different frequencies, potentially altering the model's internal beliefs for these groups and leading to biased behaviors. To fill this gap, we propose FAIRGET, the first Visual Question Answering benchmark that evaluates unlearning under unbalanced, realistic, forget requests. These requests are designed to simulate multiple realistic scenarios, ranging from simple to challenging settings, that lead to biased unlearned models if fairness is not accounted for. Additionally, we propose FAUN, the first unlearning algorithm for MLLMs that forgets unlearning data while preserving model fairness. FAUN exploits a bias-aware activation steering mechanism to unlearn identities while accounting for the unbalanced nature of the forget data. Experiments on FAIRGET and the established FIUBench demonstrate our method's superiority both in unlearning quality and fairness.
37. 【2607.21281】HGeo-TopoMap: Boosting Topological Mapping with Hierarchical Geometric Priors
链接：https://arxiv.org/abs/2607.21281
作者：Siyu Li,Kunyu Peng,Di Wen,Beiping Hou,Zhiyong Li,Kailun Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO); Image and Video Processing (eess.IV)
关键词：driving perception systems, autonomous driving perception, delivering essential road, essential road information, perception systems
备注： The source code and model weights will be made publicly available at [this https URL](https://github.com/lynn-yu/HGeo-TopoMap)
点击查看摘要
Abstract:Topological maps are key outputs of autonomous driving perception systems, delivering essential road information for path planning. They identify instances such as centerlines and traffic signs, along with their connectivity relationships. Due to the lack of explicit markings for centerlines in real-world environments, the detection of centerline instances remains a significant challenge. To tackle this problem, we propose HGeo-TopoMap, which leverages an explicit prior map and implicit spatial relations to hierarchically boost topological mapping. First, a geometric adaptive learning module is designed for the road structure map obtained via inverse perspective mapping. This module discretely encodes semantic and spatial features from the map, followed by a prior-mask attention mechanism that selectively focuses on informative regions. Then, a geometric consistency learning module is devised, which leverages the geometric properties and spatial relationships of centerlines. Built on the geometry-aware decoder, it enforces spatial consistency by aligning features of centerline instances with identical geometric orientations. The proposed method is evaluated on the OpenLane-V2 dataset across the centerline, lane segment, and robustness benchmarks. Beyond substantial improvements in topological mapping accuracy, the proposed method offers the benefit of enhanced robustness, consistently outperforming baselines under both standard and challenging conditions. The source code and model weights will be made publicly available at this https URL.
38. 【2607.21271】Flash EQ-Linear: Accelerating Equivariant Linear Layers via Group-wise Discrete Fourier Transform
链接：https://arxiv.org/abs/2607.21271
作者：Zhongchen Zhao,Jixin Wang,Qi Xie,Hui Lin,Lei Zhang,Deyu Meng,Zongben Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：embed geometric symmetries, achieving remarkable parameter, remarkable parameter efficiency, networks embed geometric, parameter efficiency
备注：
点击查看摘要
Abstract:Equivariant networks embed geometric symmetries as structural priors through weight sharing, achieving remarkable parameter efficiency across vision tasks. However, this parameter efficiency does not translate into compute efficiency: existing implementations unroll the structured weights into dense matrices and dispatch them to generic dense kernels, so the FLOPs of an equivariant layer are no smaller than those of a non-equivariant counterpart. In this paper, we observe that the equivariant linear (EQ-Linear) layer---the most fundamental and frequently used module in modern equivariant architectures---is essentially a circular convolution along the group dimension composed with a linear transform along the channel dimension. Building on this observation, we propose Flash EQ-Linear, an exact acceleration algorithm that reduces the complexity from $\mathcal{O}(NDC)$ to $\mathcal{O}(NDC/T)$ by combining the Fourier convolution theorem along the group dimension with the conjugate symmetry of the real DFT. We further provide dedicated CUDA kernels for Flash EQ-Linear, covering both forward and backward passes and both FP32 and FP16 precision. At the operator level, Flash EQ-Linear achieves up to ${2\times}$ forward speedup over PyTorch's this http URL; at the network level, Flash EQ-ViT and Flash EQ-Swin achieve up to ${1.7\times}$ end-to-end speedup over both equivariant and non-equivariant baselines. To our knowledge, this is the first time equivariant networks strictly dominate their non-equivariant counterparts along all three axes simultaneously: accuracy, parameter efficiency, and inference this http URL is available at this https URL.
39. 【2607.21243】Detectors Learn the Wrong Thing: Shortcut-Resistant Adversarial Training Against Physically Realizable Attacks
链接：https://arxiv.org/abs/2607.21243
作者：Yuanhao Huang,Yilong Ren,Jinlei Wang,Xuesong Bai,Zheng Zhang,Haiyang Yu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：AI-enabled visual perception, intelligent transportation infrastructure, visual perception systems, vehicle related applications, autonomous vehicle related
备注：
点击查看摘要
Abstract:AI-enabled visual perception systems are increasingly deployed in intelligent transportation infrastructure and autonomous vehicle related applications. However, physically realizable adversarial appearances pose a significant reliability challenge for these safety-critical systems. Adversarial training is effective, but repeated co-occurrence between adversarial texture and positive person instances can cause detectors to treat the texture itself as evidence of object presence, forming a patch texture shortcut. The detector may then treat texture as evidence for the target, causing false detections on texture-only inputs and weakening cross attack generalisation. We propose InsCAT, an instance-level contrastive adversarial training framework that prevents detectors from using adversarial texture as an independent decision cue. SICA aligns adversarial person features with matched clean features and separates them from texture-only negatives, while ROPO and Guard maintain online attack pressure and coordinate training. We evaluate eight independently generated attack textures on rendered nuScenes, INRIAPerson, printed garments, and three detector families. InsCAT achieves an average attack AP of 82.3% on rendered nuScenes, exceeding the strongest baseline by 11.1 this http URL to AT-Mix, texture FPR decreases from 46.9% to 7.3%. Physical tests yield an F1 score of 96.6% and an FPR of 1.8%. Consistent gains across separately trained detectors demonstrate applicability across architectures with direct inference. The findings show that robust physical detection depends on preserving target related evidence while preventing adversarial texture from becoming an independent decision cu
40. 【2607.21239】Stokes-Informed Diffusion for Robust Linear Polarization Estimation
链接：https://arxiv.org/abs/2607.21239
作者：Yidong Luo,Chenggong Li,Yuchao Feng,Boxin Shi,Junchao Zhang,Xin Yuan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires dedicated hardware, typically requires dedicated, Polarization cues benefit, cues benefit applications, dedicated hardware
备注：
点击查看摘要
Abstract:Polarization cues benefit applications such as material detection and de-reflection, yet acquiring them typically requires dedicated hardware. This motivates us to estimate the linear polarization from a single RGB image. However, the task is inherently ill-posed, with the Angle of Polarization (AoP) becoming particularly unstable in weak polarization regions, where the polarimetric signal is overwhelmed by noise, leading to erratic angle estimates. To address these limitations, we propose GenPolar, a Stokes-informed diffusion framework grounded in the Mueller formalism from an intensity observation. Specifically, GenPolar predicts channel-wise linear Stokes components (S1,S2) from intensity S0, from which degree of linear polarization (DoLP) and AoP are analytically derived; AoP is further supervised with an observability-aware loss. In addition, to enable efficient and high-fidelity inference, we adopt a two-stage training strategy. Firstly, a multi-step conditional diffusion model is trained with a physics-based loss. Subsequently, we distill it into a one-step generator, which further supports stable Low-Rank Adaptation (LoRA) of the VAE encoder to mitigate domain-specific autoencoding bias. Extensive experiments across rotating-polarizer, division-of-focal-plane, and hybrid datasets demonstrate that GenPolar achieves state-of-the-art performance in both DoLP fidelity and AoP stability. Crucially, these improvements translate to significant and consistent gains in downstream applications, including material detection and de-reflection.
41. 【2607.21228】-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video
链接：https://arxiv.org/abs/2607.21228
作者：Linlin Wang,Xue Yang,Zhihuang Zhou,Zhenyu Zhong,Ruiyuan Zhang,Yansheng Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：satellite video, TPSG, geospatial scene analysis, satellite, advancing dynamic geospatial
备注： 17 pages, 8 figures
点击查看摘要
Abstract:Structured understanding of satellite video is essential for advancing dynamic geospatial scene analysis from low-level perception to high-level cognition. To move beyond object-centric perception, this paper introduces spatio-temporal panoptic scene graph generation (TPSG) in satellite video as a new benchmark task. TPSG aims to generate a structured graph composed of a set of triplets subject, relationship, object with explicit temporal spans, thereby describing dynamic geospatial scenes by jointly modeling identity-consistent instance masks and spatio-temporal relationships among panoptic scene elements. However, there is still no dedicated dataset for TPSG in satellite video. Moreover, TPSG in satellite video is intrinsically challenging, as objects are often small and weakly textured, cross-frame association is easily disrupted by occlusion and background clutter, and relationship semantics are highly coupled with spatial structure and temporal evolution. Consequently, TPSG models developed for natural videos are not directly applicable to satellite video. This paper presents T-STAR, a large-scale benchmark dataset for TPSG in satellite video, comprising over 1.1 million instance masks and over 3.8 million spatio-temporal triplets across 39 fine-grained object categories and 70 fine-grained relationship categories. To enable TPSG in satellite video, we propose a unified framework to enhance cross-frame instance consistency and spatio-temporal relationship prediction. Extensive experiments demonstrate the significance of T-STAR and the effectiveness of the proposed framework, establishing a strong benchmark for future research on structured satellite video understanding. The dataset and code are available at this https URL.
42. 【2607.21219】DART: A Degradation-Aware Recurrent Transformer for Archival Film Restoration
链接：https://arxiv.org/abs/2607.21219
作者：Mikołaj Jastrzębski,Wojciech Kozłowski,Kamil Adamczewski
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：clean reference videos, photometric aging, challenging problem, problem because historical, historical footage
备注： 16 pages, 6 figures, 4 tables
点击查看摘要
Abstract:Archival film restoration is a challenging problem because historical footage contains compound degradations such as scratches, dust, blur, noise, flicker, and photometric aging, while clean reference videos are unavailable. Existing video restoration methods largely treat these degradations implicitly, reconstructing frames without explicit knowledge of where damage occurs or how severe it is. We propose DART, a degradation-aware recurrent transformer for archival film restoration. DART predicts and propagates a soft defect mask through time, using it to guide temporal fusion and condition the restoration network on both damage location and severity. This makes the restoration process explicitly aware of film artifacts rather than relying only on reconstruction losses. Experiments on real archival benchmarks show that DART improves no-reference perceptual quality over prior restoration architectures while remaining compact and efficient, producing cleaner and more temporally consistent restorations of structured film damage.
43. 【2607.21213】Learning-based Seam Correspondence Reconstruction in Sewing Patterns
链接：https://arxiv.org/abs/2607.21213
作者：Zhendong Wang,Jintong Wang,Chen Liu,Yao Jin,Ligang Liu,Huamin Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Digital sewing patterns, explicit stitch annotations, labor-intensive expert specification, sewing patterns typically, patterns typically consist
备注：
点击查看摘要
Abstract:Digital sewing patterns typically consist of disjoint 2D panels without explicit stitch annotations, making downstream 3D modeling reliant on labor-intensive expert specification. In this paper, we present a graph-based learning framework that reconstructs two-level stitching information, coarse panel connectivity and fine-grained seam correspondence, from 2D panel geometry alone. At the coarse level, panel connectivity is inferred by predicting panel semantics associated with anatomical body regions, enforcing consistency with body structure and garment design conventions. Based on the reconstructed panel graph, fine-grained seam correspondences between panel pairs are inferred by learning latent edge representations that jointly encode local seam geometry and global garment context through graph message passing. The resulting edge embeddings are subsequently decoded into detailed seam correspondences. Our method supports complex sewing-pattern topologies, including many-to-one correspondences, intra-panel seams, and curved seams. Experiments demonstrate high stitching accuracy and strong generalization across garment styles.
44. 【2607.21190】Physics-Informed Deep Learning Model for Cross-Modality Super-Resolution in Fluorescence Microscopy
链接：https://arxiv.org/abs/2607.21190
作者：Mohammad Soltaninezhad,Elena Corbetta,Francisco Paez Larios,Paul M. Jordan,Oliver Werz,Christian Eggeling,Thomas Bocklitz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：instrumentation demands, image translation offers, offers a route, reducing phototoxicity, phototoxicity and instrumentation
备注：
点击查看摘要
Abstract:Cross-modality image translation offers a route to super-resolution fluorescence microscopy from low-resolution images while reducing phototoxicity and instrumentation demands. However, purely data-driven models can produce visually plausible outputs that are inconsistent with optical image formation. Here, we propose a physics-informed generative adversarial network for confocal-to-STED image translation that incorporates microscope-specific point spread function information into the training objective. Simulated and experimentally measured PSFs were evaluated using a limited paired confocal-STED dataset of TOM20-labeled mitochondria in human primary M2 macrophages acquired across different experimental days. Performance was assessed using reference-based and non-reference-based image-quality metrics, together with complementary frequency- and distribution-sensitive analyses. The no-reference metrics probed physics-relevant image properties, including spatial-frequency content, contrast, and signal-to-noise behavior. PSF-guided models improved structural fidelity, reduced local deviations, and achieved closer agreement with STED references than non-PSF baselines, particularly in frequency-domain analyses. These results demonstrate that optical priors can improve the structural fidelity and physical plausibility of generative microscopy models for cross-modality super-resolution imaging.
45. 【2607.21179】Out of Sight, Still in Mind: Token Compression for Omni-LLMs
链接：https://arxiv.org/abs/2607.21179
作者：Suho Yoo,Youngjoon Jang,Hyebin Cho,Joon Son Chung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Omni-modal large language, Omni-modal large, cost of Omni-modal, visual tokens, input token cost
备注： Preprint
点击查看摘要
Abstract:The goal of this paper is to reduce the input token cost of Omni-modal large language models (Omni-LLMs) at inference time. Omni-LLMs reason jointly over audio, video and text, but the cost of the three streams is highly unbalanced: visual tokens account for the vast majority of the input, and are highly redundant. In this paper, we propose ReMo, a training-free framework that compresses visual tokens by redistributing their information across modalities: a visual token is kept only if its information appears nowhere else. ReMo achieves this in two ways: (i) it aligns audio and video in a common embedding space, and removes visual tokens already explained by the audio or by other visual tokens; and (ii) it replaces object-level visual tokens with compact text proxies, short descriptions of each object and its location, conveying the same content in far fewer tokens. On Qwen2.5-Omni at two model scales, ReMo removes 54% of the input tokens with no loss in accuracy. Indeed, it slightly exceeds the full-token model, reaching 101.2% and 101.3% of its average accuracy over five audio-visual benchmarks.
46. 【2607.21174】Decoupling Cross-Modality Manifold Discrepancy: Leveraging Visible Diffusion Priors for Infrared Super-Resolution
链接：https://arxiv.org/abs/2607.21174
作者：Yunpeng Hua,Hongwei Yu,Jiawei Li,Qiankun Liu,Huimin Ma,Jiansheng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：low spatial resolution, mitigates the limitations, spatial resolution, limitations imposed, imposed by low
备注： Accepted to ACM Multimedia 2026 (ACM MM 2026). Code: [this https URL](https://github.com/Assassink8/Shift-IISR)
点击查看摘要
Abstract:Infrared image super-resolution (IISR) mitigates the limitations imposed by low spatial resolution. Existing methods have recognized that IISR should preserve consistency in global distribution and structural information while enhancing image clarity. However, these methods are either insufficient or overly intrusive, a problem that becomes even more pronounced in diffusion-based models. To address these issues, we propose a dual-path diffusion-based framework for IISR, termed Shift-IISR. The proposed method is designed to improve the consistency of IISR results while preserving the generative capacity of diffusion models. Specifically, we develop a Global Representation Modulation (GRM) module to extract modality-specific information from infrared imagery and guide the global distribution of the diffusion model toward the ground truth. In addition, we introduce a Local Structure Refinement (LSR) module to encourage the model to focus on structural information at each step of the iterative denoising process. Extensive experiments demonstrate that the proposed method effectively improves distributional and structural consistency while maintaining competitive super-resolution performance. The source code of the proposed Shift-IISR can be available at this https URL.
47. 【2607.21155】CRAG-MM-Diagnostics: Enabling Stage-Wise Analysis of Knowledge-Intensive VQA
链接：https://arxiv.org/abs/2607.21155
作者：Hanseok Oh,Parishad BehnamGhader,Benno Krojer,Hyunji Lee,Paul Liang,Siva Reddy,Verna Dankers
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Visual Question Answering, Knowledge-Intensive Visual Question, evaluate Vision-Language Models, Question Answering, requiring external information
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Knowledge-Intensive Visual Question Answering (KI-VQA) benchmarks evaluate Vision-Language Models (VLMs) as multimodal knowledge assistants by requiring external information beyond a provided image to answer questions. KI-VQA involves multiple sub-problems -referring expression understanding, visual grounding, object recognition, knowledge retrieval, and reasoning-yet existing benchmarks typically report only end-task accuracy, obscuring where failures arise. To analyze the full KI-VQA pipeline, we introduce CRAG-MM-Diagnostics, a diagnostic benchmark with stage-wise data annotations that isolate 1) language-based visual grounding, 2) object identification, and 3) knowledge retrieval and reasoning. We evaluate fully parametric and retrieval-augmented VLMs, providing fine-grained analyses using newly collected metadata, such as target ROIs, entity names, and visual complexity scores. Our results point to knowledge retrieval and reasoning as the primary bottleneck, but also highlight issues in the other parts of the KI-VQA pipeline, such as the fact that VLMs struggle with target object identification or that image retrievers struggle to integrate textual cues. These findings expose fundamental limitations in current KI-VQA systems and motivate stage-aware evaluation. We, lastly, leverage these findings to propose a grounded bimodal RAG pipeline that integrates a visual grounding module to crop targets before image retrieval, boosting GPT-5 and Qwen's respective accuracies by 13.3 and 8.5 percentage points.
48. 【2607.21138】DTIF: Robust Loop Closure Detection via Delaunay Triangle Topology in Complex Forests
链接：https://arxiv.org/abs/2607.21138
作者：Xin Zhao,Jianping Li,Qin Zou,Fuxun Liang,Zhen Dong,Bisheng Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：sustainable forest management, Accurate forest inventory, loop closure detection, inventory and large-scale, large-scale mapping
备注： 19 pages, 6 figures, 4 tables. Submitted to IEEE Transactions on Geoscience and Remote Sensing
点击查看摘要
Abstract:Accurate forest inventory and large-scale mapping are essential for ecosystem monitoring and sustainable forest management. Multiple low-cost edge platforms enable efficient large-area data acquisition, but merging independently constructed local maps in GNSS-denied understory environments still requires initialization-free loop closure detection and global registration. This task is challenging because low-cost LiDAR point clouds are sparse and noisy, while repetitive trunk layouts and the lack of distinctive geometric landmarks lead to severe perceptual aliasing and false correspondences. To address these issues, we propose DTIF (Delaunay Triangulation in Forests), a lightweight trunk-topology-based framework for forest loop closure detection and global registration. Tree trunks are first extracted as stable landmarks and encoded using a Delaunay topology for compact scene representation. Candidate submaps are then screened using edge-length and radius statistics, followed by edge--radius consistency verification and strong/weak vertex support aggregation to construct weighted vertex correspondences. Finally, topology-derived reliability weights are incorporated into a decoupled robust pose estimator that separately estimates yaw, horizontal translation, and elevation translation under gravity alignment. Experiments on simulated and real-world forest datasets demonstrate that DTIF achieves accurate registration with low computational overhead, providing a favorable balance among robustness, efficiency, and deployability on resource-constrained edge platforms.
49. 【2607.21137】Safety-oriented sidewalk and road segmentation for smartphone-based assistive navigation
链接：https://arxiv.org/abs/2607.21137
作者：Hakan Calim,Anamaria Dumitrescu,Adarsh Bhandary Panambur,Huzaifa Asif,Andreas Maier
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：visually impaired pedestrians, adjacent unsafe regions, Independent sidewalk mobility, distinguish walkable sidewalks, smartphone-based assistive navigation
备注： 17 pages, 4 figures, 3 tables. Submitted to Assistive Technology
点击查看摘要
Abstract:Independent sidewalk mobility is essential for blind and visually impaired pedestrians (BVIPs), yet smartphone-based assistive navigation requires perception models that distinguish walkable sidewalks from adjacent unsafe regions. This study presents a safety-oriented semantic segmentation framework for future mobile guidance. We introduce SENSATION-DS, a chest-height pedestrian-view dataset with 2,752 image-mask pairs and nine-class navigation-relevant taxonomy. External urban and sidewalk datasets were harmonized to this label space, and five segmentation architectures were evaluated using staged target-domain adaptation with mask-conditioned synthetic images and Segment Anything Model 2 (SAM2) pseudo-labels. Models were assessed using mean Intersection over Union (mIoU), road- and sidewalk-specific metrics, Road-as-Sidewalk Error Rate as a proxy false-safe measure, and Android Open Neural Network Exchange benchmarking. Synthetic augmentation generally improved segmentation accuracy, whereas SAM2 pseudo-labels more consistently reduced Road-as-Sidewalk errors. UPerNet-MobileNetV3 achieved the highest offline mIoU (0.715 +/- 0.006), while DeepLabV3Plus-MobileNetV3 achieved the lowest Road-as-Sidewalk Error Rate (0.079) and highest Android runtime at 512x384 (7.383 FPS). These results show that assistive sidewalk perception should be evaluated jointly by segmentation accuracy, proxy false-safe behavior, and smartphone deployment feasibility, while real-world benefit requires validation with BVIP users. This evaluation supports selecting models that balance accurate perception, conservative error behavior, and practical runtime.
50. 【2607.21125】Causal-AgentIR: Self-Evolving Causal Memory for Adaptive Image Restoration Agents
链接：https://arxiv.org/abs/2607.21125
作者：Hu Gao,Yulong Chen,Lizhuang Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：restoration, real-world scenarios, recently emerged, flexible paradigm, paradigm for handling
备注：
点击查看摘要
Abstract:Image restoration agents have recently emerged as a flexible paradigm for handling diverse and unpredictable degradations in real-world scenarios. Existing agents typically formulate restoration as a tool-using process, where the agent perceives degradations, searches candidate tools, executes restoration operations, and revises the plan through reflection or rollback. However, their knowledge is often stored as static tool descriptions, manually defined degradation priors, or unstructured textual summaries, which limits the accumulation, verification, revision, and forgetting of restoration knowledge over long-term experience. In this paper, we propose Causal-AgentIR, a hierarchical multi-agent framework with self-evolving causal memory for collective image restoration intelligence. Instead of representing restoration experience as isolated textual records, Causal-AgentIR organizes degradation patterns, image regions, restoration tools, actions, quality changes, and user preferences into a structured causal memory graph. This graph supports graph-based retrieval and multi-hop causal reasoning, enabling agents to infer how specific restoration operations or tool sequences affect restoration quality under different degradation conditions. The framework further organizes multiple agents into a collaborative system, including planning, degradation analysis, tool expertise, causal memory reasoning, outcome critique, and memory curation. Through this design, restoration experience can be added, updated, merged, reinforced, ignored, or discarded according to observed quality changes and feedback, allowing the agent to maintain reliable and transferable restoration knowledge. Extensive experiments demonstrate the effectiveness of the proposed framework.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.21125 [cs.CV]
(or
arXiv:2607.21125v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.21125
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
51. 【2607.21118】he Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Results
链接：https://arxiv.org/abs/2607.21118
作者：Xiang Chen,Hao Li,Jiangxin Dong,Jinshan Pan,Xin Li,Hongbo Ding,Junpeng Jiang,Xingyu Qiu,Yilian Zhong,Yuxiang Chen,Shibo Yin,Zixuan Huang,Yushun Fang,Xilei Zhu,Yahui Wang,Chen Lu,Xiaodong Zhou,Qingyue Cao,Changwei Gong,Jingyun Liu,Xingchen Yi,Hansen Shi,Ruiyi Liu,Jirui Xie,Tao Liu,Wenzhuo Ma,Hongzhen Li,Yongyong Chen,Zheng Zhou,Jingyong Su,Jie Liu,Haijin Zeng,Cheng Li,Peishuai Zha,Ziyi Wang,Jian Tang,Yan Chen,Long Bao,Heng Sun,Jiyuan Zhang,Shuai Liu,Wei Ding,Chengjun Guo,Yibin Huang,Xiaotao Wang,Dongqing Zou,Lei Lei,Xiaofeng Wang,Xiao Liu,Yulin Wu,Yuhan Zhao,Shurui Peng,Chao Ren,Yu-Kai Wang,Kosuke Shigematsu,Asuka Shin,Rong-Lin Jian,Cheng-Jun Kang,Jin-Hui Jiang,Jialin Zhou,Kuo Yuan,Songyu Zhang,E B Benson,Ashfaq Hussain,Pruthvikanth AC,Qirui Chen,Jinyuan Chen,Jun Zhang,Xu Zhang,Xuhui Cao,Jiaqi Ma,Laibin Chang,Yuchun Miao,Yichu Xu,Yuanzhi Yao,Shi Chen,Yuning Cui,Huan Zhang,Lefei Zhang,Saeed Ahmad,Ik Hyun Lee,Jun Young Park,Ji Hwan Yoon,Shangquan Sun,Behrooz Nobahar-Moghanlou,Majid Edalatjou,Karim Shahi-Niyar,Ruibo Zhang,Dexiang Hong,Xinyan Liu,Shengeng Tang,Weidong Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Image Restoration, unified image restoration, paper presents, presents a review, LoViF Challenge
备注： ECCV 2026 Workshops; [this https URL](https://lowlevelcv.com/)
点击查看摘要
Abstract:This paper presents a review of the second LoViF Challenge on Real-World All-in-One Image Restoration. The challenge aims to advance unified image restoration under diverse real-world degradation conditions, including blur, low-light, haze, rain, and snow. It provides a common benchmark for evaluating the restoration accuracy, robustness, and generalization capability of models across multiple degradation categories within a unified framework. The competition attracted 158 registered participants, and 20 teams were included in the final ranking after their submitted results were successfully reproduced and verified. This report provides a comprehensive analysis of the submitted solutions and corresponding results, highlighting recent advances in real-world all-in-one image restoration. The summarized methods and empirical findings reveal effective design strategies and establish an updated benchmark for future research in real-world low-level vision.
52. 【2607.21105】HalluScope: Fine-grained Hallucination Diagnosis for Multimodal Large Language Models
链接：https://arxiv.org/abs/2607.21105
作者：Weilin Jin,Mingyu Wang,Wenbo Li,Haoyang Huang,Yifan Wu,Ying Li,Gang Huang,Zhonghai Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, achieved strong performance
备注： Accepted to ACM Multimedia 2026 (ACM MM 2026). This is not the camera-ready version. 18 pages, 7 figures, 12 tables
点击查看摘要
Abstract:Although Multimodal Large Language Models have achieved strong performance across a wide range of vision-language tasks, they still suffer from hallucinations, where model outputs become inconsistent with the visual content, textual context, or commonsense knowledge. Existing studies primarily address this problem through coarse-grained detection. However, these approaches often provide insufficient diagnostic information for understanding hallucination types and supporting downstream hallucination mitigation. To bridge this gap, we propose fine-grained hallucination diagnosis for MLLMs, a new unified task that jointly performs hallucination detection, classification, and interpretable explanation generation. We develop an automated data generation pipeline and construct HalluScope-30K, a large-scale diagnostic dataset covering eight sources and five task categories. Based on this dataset, we design a multi-granular joint reward function and train two diagnosis models, HalluScope-4B and HalluScope-8B, which achieve state-of-the-art performance on both the MHALO benchmark and our fine-grained hallucination classification benchmark. Notably, detection and classification are mutually beneficial under joint optimization. Furthermore, diagnosis-driven feedback experiments show that the fine-grained diagnostic explanations produced by our model effectively guide target models to correct their hallucinations, with full diagnosis substantially outperforming all baselines on both Qwen3-VL-8B-Instruct and LLaVA-1.5-7B.
53. 【2607.21089】Loss Landscape Topology Reveals Why Simple Baselines are Competitive at 3D Point Cloud Segmentation Under Class Imbalance
链接：https://arxiv.org/abs/2607.21089
作者：Antonis Savva,Christos Kyrkou,Theocharis Theocharides
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computer vision remains, faces severe class, vision remains unclear, severe class imbalance, clouds faces severe
备注： 21 pages, 7 figures, International Conference on Pattern Recognition (ICPR) 2026
点击查看摘要
Abstract:Semantic segmentation of 3D point clouds faces severe class imbalance, yet the effectiveness of specialized imbalance-aware methods from 2D computer vision remains unclear in 3D contexts. We systematically evaluate 11 imbalance mitigation approaches across datasets with extreme (641:1) and moderate (56:1) imbalance ratios, revealing a surprising finding: standard cross-entropy with uniform weighting achieves competitive performance, typically within 0.8-3.3% mIoU of specialized methods across architectures and datasets. Through multifaceted mechanistic analysis of error patterns, decision boundaries, and the geometry of the optimization landscape, our analyses suggest that imbalance severity shapes the topology, creating narrow solution basins under extreme imbalance and flat plateaus under moderate imbalance. This appears to constrain the effectiveness of loss-level modifications, as all methods must navigate these geometric constraints. Our findings offer practical guidance; standard cross-entropy provides a robust baseline, with specialized methods offering modest improvements (0.8-3.3% mIoU) that vary by architecture and dataset but risk substantial degradation if poorly tuned. This work provides the first mechanistic explanation for why techniques proven effective in 2D do not readily transfer to point-based 3D point cloud segmentation, validated across two representative architectures.
54. 【2607.21085】Geo3R: Mitigating Spatial Reasoning Hallucination in Multimodal Large Language Models
链接：https://arxiv.org/abs/2607.21085
作者：Mingyu Wang,Weilin Jin,Wenbo Li,Haoyang Huang,Tong Jia,Ying Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, Language Models
备注： Accepted by ACM MM 2026. This is the arXiv preprint version, not the camera-ready
点击查看摘要
Abstract:Despite remarkable progress in visual understanding, Multimodal Large Language Models (MLLMs) remain prone to hallucinations when reasoning about spatial relationships, often producing judgments that contradict the true 3D structure of the scene. Though several existing works have proposed to mitigate hallucinations, our analysis indicates that they show limited effectiveness in spatial reasoning, as they fail to bridge the fundamental gap between 2D visual representations and 3D spatial reality. Based on this finding, we define hallucinations arising from insufficient spatial structure modeling as spatial reasoning hallucination, a subcategory of relation hallucination that existing mitigation methods fail to address. We further identify three typical scenarios where such hallucinations frequently occur: perspective effects, object orientation, and viewpoint changes. To this end, we propose Geo3R, a training-free, plug-and-play framework that incorporates geometric evidence and structured 3D reasoning to mitigate spatial reasoning hallucination. Experiments on three benchmarks, covering 18 tasks across all three scenarios, show that Geo3R substantially reduces spatial reasoning hallucination across diverse MLLMs without additional training, outperforming existing models and methods.
55. 【2607.21078】he RealDefocus Benchmark for Defocus Deblurring
链接：https://arxiv.org/abs/2607.21078
作者：Tim Seizinger,Zhuyun Zhou,Radu Timofte
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Single-Image Defocus Deblurring, Defocus Deblurring, remains challenging due, single defocused observation, Single-Image Defocus
备注： Accepted at ICIP 2026
点击查看摘要
Abstract:Single-Image Defocus Deblurring (SIDD) aims to recover an all-in-focus image from a single defocused observation, but rigorous and reproducible evaluation remains challenging due to the scarcity of realistic, high-resolution datasets with well-aligned defocused/sharp pairs and standardized protocols. We build on RealDefocus, a benchmark derived from the real-world RealBokeh dataset originally proposed for Bokeh Rendering. RealDefocus provides paired defocused inputs and sharp ground truth images, predefined training/validation/test splits, and a unified evaluation framework for comparing image restoration and neural rendering approaches. We further outline a benchmarking protocol with cross-dataset validation to assess reconstruction quality and generalization. The project page is publicly available at: this http URL.
56. 【2607.21076】C-PTQ: Fisher-weighted Channel-wise Sensitivity for Post-training Quantization of MLLMs
链接：https://arxiv.org/abs/2607.21076
作者：Jiameng Li,Han Zhou,Matthew B. Blaschko
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal large language, require huge memory, large language models, Multimodal large, require huge
备注： 7 pages
点击查看摘要
Abstract:Multimodal large language models (MLLMs) require huge memory and computational costs, which limits their practical deployment. Post-training quantization (PTQ) techniques offer an efficient solution for model compression and inference acceleration. Yet, the quantized model faces performance degradation due to outlier channels, which are highly sensitive to quantization and substantially impair activation fidelity and task accuracy. To protect these salient channels during quantization, existing PTQ methods leverage modality- or token-level metrics to guide channel-wise scaling (CWS) of LLM decoders. However, these orthogonal measurements fail to capture channel-wise impacts on task-specific loss, and the misalignment between importance and scaling factors ultimately leads to suboptimal performance. To address this issue, we propose C-PTQ, a unified channel-wise PTQ method that harmonizes task-specific loss perturbation and quantization error. Motivated by second-order derivatives, we design a Fisher-weighted objective as a tractable Hessian approximation, seamlessly injecting task sensitivity into the scaling process. Notably, we achieve state-of-the-art performance without auxiliary modules like LoRA, thereby maintaining high efficiency. Experiments on Qwen2.5VL, InternVL2 and LLaVA-OV across 8 benchmarks demonstrate our effectiveness in both weight-only and weight-activation settings.
57. 【2607.21072】Show, Don't Tell: Evaluating Spatial Cognition in Generative Pixels Rather Than LLM Text
链接：https://arxiv.org/abs/2607.21072
作者：Xu Wang,Kaixiang Yao,Miao Pan,Xiaohe Zhou,Xuanyu Liu,Wenqi Zhang,Xuhong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：static semantic understanding, image-generation models, physical world, intelligence is essential, essential for agents
备注： 36 pages, 14 figures. Project page: [this https URL](https://zju-omniai.github.io/ProVisE/)
点击查看摘要
Abstract:Spatial intelligence is essential for agents to move from static semantic understanding toward interacting with the physical world. Many spatial tasks are grounded in continuous visual scenes, where locations, regions, and paths are more naturally expressed by pointing, marking, or drawing than by reporting precise coordinates or discrete textual symbols. Yet existing spatial reasoning benchmarks usually require coordinates, options, or text, creating an answer-interface mismatch for image-generation models. This makes it difficult to evaluate image-generation models under the same task semantics as text-output VLMs, despite their ability to externalize spatial judgments directly in pixel space. We propose ProVisE (Protocolized Visual Evaluation), a benchmark-agnostic framework that elicits protocol-constrained visual answers from image-generation models and parses them into structured predictions compatible with original metrics. ProVisE also includes an Agentic builder that constructs and validates task-specific protocols for new benchmarks. We further introduce SpatialGen-Bench, a curated diagnostic benchmark of 470 samples across 14 spatial subtasks, four capability levels, and diverse answer forms. We evaluate representative text-output VLMs and image-generation models in a unified setting and validate Agentic protocol construction on six external spatial benchmarks. Results show that image-generation models are competitive when spatial answers can be externalized directly in pixel space, while text-output VLMs retain a clear advantage in compositional spatial reasoning. These findings reveal complementary strengths of pixel-space expression and text-based reasoning and establish a metric-compatible testbed for studying spatial cognition in image-generation models.
58. 【2607.21071】ransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects
链接：https://arxiv.org/abs/2607.21071
作者：Ke Ma,Yifei Wang,Meng Wang,Tian Xia
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM); Robotics (cs.RO)
关键词：laboratories increasingly rely, manipulate transparent plasticware, biomedical laboratories increasingly, setting remain limited, perception to recognize
备注： 9 pages, 10 figures, accepted by ACM Multimedia 2026
点击查看摘要
Abstract:Autonomous biomedical laboratories increasingly rely on visual perception to recognize, localize, and manipulate transparent plasticware, yet high-quality real-world datasets for this setting remain limited. The scarcity of domain-relevant data is particularly restrictive in cluttered multi-object scenes, where mutual occlusion and view-dependent appearance changes remain challenging even for contemporary visual foundation models. Existing transparent-object datasets have advanced segmentation, depth, and pose estimation, but they usually do not evaluate the combined setting of multi-object clutter, occlusion, and calibrated multi-view capture that characterizes real laboratory manipulation scenes. To address this gap, we present TrainsBiolab, a real-world RGB-D dataset of cluttered transparent biomedical objects captured as calibrated multi-view sequences. TrainsBiolab contains 161,315 frames from 98 scenes and 1.03M instance annotations over 15 laboratory object types, including 6D poses, full and visible masks, depth, and per-frame camera calibration. The dataset is organized along three axes that reflect operational difficulty: object category, the total number of objects in a frame, and camera viewpoint. We further define dataset-centric benchmarks for segmentation, depth estimation and completion, and 6D pose estimation, and report a system-level robot manipulation evaluation enabled by the released annotations and calibrations. By focusing on repeated transparent instances, clutter, and multi-view laboratory capture, TrainsBiolab provides a resource for segmentation, depth estimation, 6D pose estimation, and multi-view reasoning in autonomous laboratory manipulation. Project page: this https URL.
59. 【2607.21068】Counterfactual Explainability Framework With CycleGAN And Counterfactual-Classifier Alignnment Score for Retinal Disease Classification
链接：https://arxiv.org/abs/2607.21068
作者：Kritanu Chattopadhyay,Sayanjit Singha Roy,Soumya Chatterjee
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：network-based deep learning, vision impairing retina-based, impairing retina-based ocular, retina-based ocular conditions, neural network-based deep
备注： 8 pages, 9 figures, 9 tables
点击查看摘要
Abstract:Automated detection of vision impairing retina-based ocular conditions from fundus images is important for early screening, timely referral and reducing dependency on specialist-only assessment, for which neural network-based deep learning (DL) models have been widely utilized. However, explainability of the DL frameworks remains a major bottleneck for clinical adoption, particularly when model decisions are not linked to retinal regions that are clinically meaningful. To address this issue, this study presents CounterFundus, a novel CycleGAN-driven counterfactual explainability framework, integrating EfficientNet-B5-based retinal disease detection with visually interpretable disease-to-normal fundus image translation. For each pathological image, the counterfactual yielded by the CycleGAN generator represents an estimated healthy counterpart and the resultant difference map is utilized to localize disease-associated retinal changes. Unlike conventional post-hoc saliency methods, CounterFundus provides counterfactual explanations through visually plausible disease-to-normal retinal translation. Thereafter, to quantify the spatial agreement between counterfactual difference maps and classifier saliency, the Counterfactual-Classifier Alignment Score (CCAS) is introduced, embedding Spearman correlation, binary IoU and pointing accuracy into a single assessment protocol. To this end, EigenCAM-aligned evaluation demonstrates that the generated counterfactual explanations remain spatially consistent with classifier-relevant retinal evidence across all CCAS dimensions. Along with that, ablation studies further confirm that CCAS-filtered counterfactual augmentation improves the downstream classification performance in fundus images, establishing CounterFundus as a clinically-grounded, explainable artificially intelligence (XAI) framework for retinal disease detection.
60. 【2607.21065】Do Pathology Vision-Language Models Truly See Pathology?
链接：https://arxiv.org/abs/2607.21065
作者：Chengyang Zhang,Wenchuan Zhang,Bo Li,Xinyu Liu,Jiaming Yang,Mengran Li,Chenxun Deng,Jie Chen,Yang Zhang,Wei Ju,Yuhao Yi,Hong Bu,Jiancheng Lv
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recently progressed rapidly, Pathology vision-language models, pathology VQA benchmarks, VQA benchmarks, vision-language models
备注：
点击查看摘要
Abstract:Pathology vision-language models (VLMs) have recently progressed rapidly and are commonly evaluated by answer accuracy on pathology VQA benchmarks. However, we dig into current evaluations and identify three overlooked issues: 1) Visual evidence is not always necessary. For instance, Gemini-3-Pro achieves 53.5% average accuracy across 5 VQA benchmarks without any visual input. 2) Domain training can improve accuracy without proportional gains in visual binding. Compared with Qwen2.5-VL-7B, Patho-R1-7B exhibits a 5.8-point lower multimodal gain and a 3.7-point lower attention IoU. 3) Entity-level attention is diffuse and weakly query-specific. On PathVG, attention maps remain highly correlated across different entity queries. These issues can lead to substantial misjudgments of pathology VLMs' actual multimodal capabilities. To this end, we present PathBind, a benchmark comprising 2,600 samples: PathBind-VQA with 1,500 questions across six dimensions, PathBind-PTA with 600 questions from a private pathology teaching atlas, and PathBind-Grounding with 500 expert-curated region-level samples. Each component undergoes task-specific automated filtering and expert review to reduce textual shortcuts and improve entity-region correspondence. We evaluate 18 representative VLMs on VQA samples of PathBind and five existing pathology VQA benchmarks, and further evaluate 10 VLMs on PathBind-Grounding and PathVG. Results show that current pathology VLMs still exhibit a substantial gap between answer-side performance and visual-semantic binding.
61. 【2607.21061】MVEI EmObserver: Empowering MLLM-Oriented Visual Emotional Intelligence via Emotion Statement Judgement
链接：https://arxiv.org/abs/2607.21061
作者：Daiqing Wu,Dongbao Yang,Jiashu Yao,Hongrui Zhang,Can Ma,Yu Zhou,Sicheng Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Affective Image Content, Image Content Analysis, Affective Image, Image Content, Multimodal Large Language
备注：
点击查看摘要
Abstract:Affective Image Content Analysis (AICA) aims to recognize and understand emotions elicited by visual content, representing an indispensable step toward Artificial General Intelligence (AGI). However, despite the rapid progress of Multimodal Large Language Models (MLLMs), systematic evaluation of their visual emotional intelligence remains largely absent from recent model releases. We attribute this gap to a structural mismatch between conventional AICA paradigms and the open-ended, instruction-driven nature of MLLMs, where further analysis reveals four major limitations: omission of plausible responses, limited emotion taxonomies, neglect of contextual factors, and labor-intensive annotation. To overcome these barriers, we introduce Emotion Statement Judgement (ESJ), a statement-verification formulation that preserves the expressiveness of the input space while constraining outputs to discriminative judgements. We further develop INSETS, a labor-efficient pipeline that instantiates ESJ at scale by constructing INSETS-462k and supporting MVEI, a rigorously refined benchmark spanning sentiment polarity, emotion interpretation, scene context, and perception subjectivity. Beyond evaluation, we build EmObserver, an emotion-oriented MLLM optimized on ESJ through an elaborate multi-stage recipe. Extensive evaluation of broad-spectrum MLLMs on MVEI reveals fine-grained insights into current artificial visual emotional intelligence, while experiments on multiple AICA benchmarks demonstrate the accuracy, generalization, and reasoning faithfulness of EmObserver. Collectively, these results establish ESJ as a practical formulation, MVEI as a comprehensive benchmark, and EmObserver as an advanced baseline for advancing MLLM-oriented visual emotional intelligence. Code will be released at: this https URL.
62. 【2607.21057】Achieving Text-based Person Retrieval with Any Granularity
链接：https://arxiv.org/abs/2607.21057
作者：Jialong Zuo,Hanyu Zhou,Dongyue Wu,Yongtai Deng,Mengdan Tan,Nong Sang,Changxin Gao,Xiang Bai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Text-based person retrieval, Text-based person, person retrieval faces, person retrieval, under-explored challenge
备注： TPAMI-2026 Accepted Paper
点击查看摘要
Abstract:Text-based person retrieval faces a critical but under-explored challenge: the inherent uncertainty of query granularity in real-world scenarios. This paper introduces a new paradigm, Text-based Person Retrieval with Any Granularity, and provides a systematic solution. First, we formalize a five-level granularity spectrum and construct UFine6926-MG, a high-quality multi-grained dataset annotated comprehensively at all granularities via a novel Multi-grained Text Annotation Engine. Second, acknowledging that coarse queries naturally correspond to multiple valid candidates, we propose MG-Eval, a holistic evaluation benchmark with progressively detailed texts and cross-identity labels that reflect real-world semantics, alongside tailored evaluation metrics and protocols. Third, after a comprehensive diagnosis reveals the systemic limitations of existing research, we propose the Cross-modal Multi-grained Aligning and Matching (CMAM) framework. CMAM achieves granularity-aware retrieval through: 1) orthogonal-expert perception to disentangle granularity-specific features; 2) probabilistic alignment to model many-to-many matches under query uncertainty; and 3) granularity-consistent reasoning to steer feature learning via joint cross-modal granularity verification. Experiments demonstrate that CMAM significantly outperforms state-of-the-art methods across all granularity levels. This work establishes a foundational benchmark and a robust baseline, paving the way for more practical person retrieval systems.
63. 【2607.21050】HyperImageNet: A Large-Scale High-Spatial Resolution Hyperspectral Imagery Classification Benchmark
链接：https://arxiv.org/abs/2607.21050
作者：Chuguang Zeng,Jingtao Li,Yinhe Liu,Yanfei Zhong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fine-grained hyperspectral land-cover, fine-grained land-cover categories, fine-grained hyperspectral, fine-grained hyperspectral understanding, hyperspectral land-cover understanding
备注：
点击查看摘要
Abstract:We present HyperImageNet, a large-scale benchmark for fine-grained hyperspectral land-cover understanding. The dataset contains 26,084 airborne hyperspectral image patches with 224 spectral bands and 138 fine-grained land-cover categories. Unlike existing datasets, HyperImageNet provides raw imagery, pixel-level semantic labels, and object-level instance masks, supporting both semantic and instance segmentation. Furthermore, we establish an open-environment benchmark with strict spatial separation to evaluate representative methods and the HyperFree foundation model. Experimental results demonstrate the effectiveness of HyperImageNet for fine-grained hyperspectral understanding and open-environment remote sensing research.
64. 【2607.21036】GeoThreat: Transferable Targeted Adversarial Attacks on Large Vision-Language Models for Remote Sensing Image Interpretation
链接：https://arxiv.org/abs/2607.21036
作者：Yimin Fu,Yuefeng Bai,Baicheng Pan,Zhunga Liu,Michael K. Ng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large vision-language models, assessing their robustness, robustness in cross-modal, cross-modal semantic understanding, remote sensing
备注： The code will be released at [this https URL](https://github.com/fuyimin96/GeoThreat) upon acceptance
点击查看摘要
Abstract:Adversarial attacks against large vision-language models (LVLMs) serve as an effective means of assessing their robustness in cross-modal semantic understanding. Existing studies mainly focus on corrupting visual inputs to induce predefined erroneous responses in general vision-language tasks, whereas corresponding investigations in remote sensing fields remain largely underexplored. Compared with natural image understanding, remote sensing image interpretation requires joint reasoning over local discriminative cues and global scene context. This poses additional challenges to achieving transferable semantic manipulation toward specified responses under black-box settings. To tackle these challenges, we propose GeoThreat, a transferable targeted adversarial attack method against LVLMs for remote sensing image interpretation. Specifically, GeoThreat modulates adversarial representations in accordance with the target content at both conceptual and perceptual levels. The class tokens from surrogate image encoders are employed as conceptual representations, while perceptual representations are distilled from patch tokens of the adversarial example through collaborative importance estimation. Beyond merely rolling out attention scores across layers, we incorporate adversarial-target similarity gradients to more faithfully characterize the relevance of local visual cues to the intended semantic manipulation. The perceptual representations are then dynamically aligned with target patch tokens in a cross-attentive manner, facilitating the adaptation of local cues toward designated semantic details. Finally, adversarial perturbations are iteratively updated via ensemble-based joint optimization of conceptual calibration and perceptual adaptation. Extensive experiments across diverse LVLMs demonstrate the superiority of GeoThreat in both transferability and controllability.
65. 【2607.21032】Spectral-Spatial Synergistic Guided Network for Hyperspectral Salient Object Detection
链接：https://arxiv.org/abs/2607.21032
作者：Yanyan Peng,Tingfa Xu,Yao Xiao,Peifu Liu,Shuyan Bai,Fengxiang Xu,Jianan Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：identify visually salient, visually salient regions, Hyperspectral salient object, hyperspectral images, Hyperspectral salient
备注： Accepted by IEEE TMM
点击查看摘要
Abstract:Hyperspectral salient object detection aims to identify visually salient regions from hyperspectral images. Existing methods often fail because they fundamentally misunderstand the data, confusing incidental spectral variations caused by external factors such as illumination with essential spectral differences caused by the intrinsic material properties of the object. This leads to fragile representations and noisy predictions. To this end, we propose a lightweight and efficient Spectral-Spatial Synergistic Guided Network (S3GNet), with structure perception as the core, to build a closed-loop information flow around spectrum robust modeling, cross-stream co-perception and multi-scale refinement decoding. S3GNet introduces a parameter-free Spectral Structure-Aware Module that leverages spectral derivatives and regional hierarchical modeling to extract intrinsic features of robustness against illumination variations. Our Stream-Aware Attention Module achieves effective spectral-spatial collaboration through inter-stream global interaction and intra-stream spatial guidance. Furthermore, a Progressive Gated Refinement Decoder ensures precise object boundaries and detail recovery by optimally integrating multi-scale features. Experimental results show that S3GNet achieves superior performance in both computational efficiency and detection accuracy compared to existing methods.
66. 【2607.21027】GroupVideo: Multi-Identity Customized Text-to-Video Generation
链接：https://arxiv.org/abs/2607.21027
作者：Xinyang Song,Libin Wang,Jianxin Sun,Qi Li,Dandan Zheng,JingDong Chen,Zhenan Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Current identity customized, explicit identity separation, identity separation mechanisms, Current identity, methodologies are predominantly
备注：
点击查看摘要
Abstract:Current identity customized video generation methodologies are predominantly limited to single-identity scenarios, as the lack of explicit identity separation mechanisms often leads to identity confusion in multi-identity settings. Existing multi-identity approaches, which directly extend single-identity frameworks by concatenating face images as input conditions, frequently result in unnatural facial expressions and motions, manifesting as the "copy-paste" phenomenon. To overcome these limitations, we introduce GroupVideo, a novel framework that leverages multiple individual photographs to generate identitycustomized video. Built upon Video Diffusion Transformers, GroupVideo incorporates multimodal identity alignment: visual alignment jointly encodes multiple face images to provide robust identity references, while semantic alignment introduces a semantic perceiver to enhance the naturalness of motions. An ID localization module with spatial guidance is introduced to address identity blending and enhance identity fidelity, along with bounding box constraints and mask regularization loss, to focus on facial regions and improve training efficiency. In response to the shortage of multi-ID video datasets, we have curated a comprehensive high-quality dataset of 20,000 videos, thereby establishing a crucial resource to advance future research in multi-ID video generation. Extensive experiments demonstrate that GroupVideo outperforms existing methods in generating multi-character videos with consistent identities and natural motions.
67. 【2607.21023】WAT3R: Feedforward Underwater 3D Reconstruction
链接：https://arxiv.org/abs/2607.21023
作者：Jiayi Xu,Jiahao Lu,Ziqiang Zheng,Yihao Tan,Yaolong Zhu,Yuan Liu,Sai-Kit Yeung
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Reliable feedforward underwater, remains challenging due, severe light attenuation, disrupt feature consistency, Reliable feedforward
备注：
点击查看摘要
Abstract:Reliable feedforward underwater 3D reconstruction remains challenging due to severe light attenuation and backscattering, which degrade visual quality and disrupt feature consistency across views, leading to inaccurate multi-view geometry. To address this issue, we propose WAT3R, a feed-forward framework for reconstructing 3D scenes directly from underwater images. By leveraging degradation adaptation as a geometry-constrained process, WAT3R integrates a lightweight neural adaptation module to flexibly account for these underwater imaging effects, thereby improving multi-view reconstruction quality. Implemented in a single forward pass, WAT3R directly and efficiently outputs pixel-aligned 3D point maps and camera poses from underwater videos, allowing a high-quality underwater 3D reconstruction. Experiments conducted on the FLSea, SQUID, and USOD10K datasets show that our method consistently outperforms state-of-the-art approaches on 3D reconstruction tasks, including multi-view/monocular depth estimation and camera pose estimation.
68. 【2607.21022】ProCap: Prominence-guided Object Rectification for Faithful and Comprehensive Video Captioning
链接：https://arxiv.org/abs/2607.21022
作者：Debjyoti Das Adhikary,Aritra Hazra,Partha Pratim Chakrabarti
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：quality typically demands, large vision-language models, Improving video captioning, captioning quality typically, typically demands retraining
备注： 10 pages, 7 figures, 5 tables. Submitted to IEEE Transactions on Multimedia
点击查看摘要
Abstract:Improving video captioning quality typically demands retraining large vision-language models, an expensive and often impractical requirement. Existing training-free alternatives instead ground captions in detected objects to curb hallucination, but apply only a single, fixed correction pass without prioritizing which objects matter most, leaving semantically significant content omitted. We propose a prominence-aware, iterative post-hoc rectification framework that overcomes both limitations without modifying the underlying captioning model's parameters: a lightweight scoring mechanism ranks detected objects by spatial saliency, temporal persistence, and relational dynamics, and an iterative, prompt-driven refinement loop uses this ranking to progressively inject missing yet contextually relevant objects into the caption over multiple rounds. We validate the framework on MSVD and MSR-VTT using object-grounded automatic metrics, a 110-participant human study, and qualitative comparison against ChatGPT and Gemini; in human evaluation, the framework raises perceived completeness by up to 48% and reduces hallucination by up to 45% relative to a strong pretrained captioning baseline, all without retraining or reference captions. These results position prominence-guided iterative rectification as a lightweight, scalable, and model-agnostic route to more complete and trustworthy video captioning, with direct relevance to accessibility, retrieval, and other multimedia understanding applications.
69. 【2607.21013】EmoAgent-R1: Towards Multimodal Emotion Understanding with Reinforcement Learning-based Dynamic Agent Specialization
链接：https://arxiv.org/abs/2607.21013
作者：Lihuang Fang,Yuchen Zou,kebin Jin,Jinghui Qin
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：large language models, natural language description, advanced video understanding, Multimodal large language, video understanding abilities
备注：
点击查看摘要
Abstract:Multimodal large language models (MLLMs) have achieved impressive performance in multimodal emotion recognition (MER) tasks and lifted MER to a new level that is complex emotion understanding with advanced video understanding abilities and natural language description. However, existing MLLM-based methods often use a fixed prompt to perceive the emotions, ignoring the dynamicity and complexity of the emotion source in the multimodal inputs. To address these issues, we propose a novel Reinforcement Learning-based Dynamic Agent Specialization framework (\textbf{EmoAgent-R1}) to optimize the emotion recognition, reasoning, and generalization abilities of an MLLM with dynamic agent specialization based on reinforcement learning. Specifically, we first adopt a cold start strategy to endow an MLLM with preliminary emotion recognition, reasoning, and agent routing ability by training with synthetic answer-conditioned chain-of-thought data and agent routing data. Then, we further train the MLLM with reinforcement learning to perceive emotions in a two-step agentic workflow with agent selection and agent specialization. To effectively train EmoAgent-R1, we propose a novel Progressive Group-Relative Policy Optimization (P-GRPO) to combine group-based relative advantages with a PMI-inspired progressive token-level modulation to transform sparse rewards into fine-grained learning signals, mitigating the coarse-grained uniform credit assignment issue in GRPO. Extensive experiments on MER benchmarks demonstrate the superiority of our EmoAgent-R1 in stronger emotion reasoning performance and improved optimization stability.
70. 【2607.21007】Explainable Deepfake Detection Challenge
链接：https://arxiv.org/abs/2607.21007
作者：Abhijeet Narang,Kartik Kuckreja,Shreya Ghosh,Muhammad Haris Khan,Usman Tariq,Jianfei Cai,Abhinav Dhall
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Explainable Deepfake Detection, binary classification decisions, Deepfake detection, Explainable Deepfake, Deepfake Detection Challenge
备注： 5 pages, 1 figure
点击查看摘要
Abstract:Deepfake detection is moving beyond binary classification decisions toward systems that can also explain the visual evidence supporting those decisions. This transition is important for real-world verification settings, where diverse users need to understand not only whether an image is manipulated, but also why it is considered suspicious. The Explainable Deepfake Detection Challenge at ACM Multimedia 2026 is designed to benchmark this joint capability. Built on XPlainVerse, a million-scale benchmark for explainable deepfake detection, the challenge evaluates methods on image classification and grounded natural-language explanation generation. Participants submit a real/fake label together with two explanations for each image: a detailed complex explanation for technical users and a concise simple explanation for general users. The evaluation combines classification metrics with semantic similarity, simplicity, and intent-aware grounding metrics that assess whether explanations identify the relevant manipulated entities and supporting visual evidence. The methodologies developed through the challenge will contribute to the development of next-generation explainable deepfake detectors. Evaluation script, baseline models, and accompanying code are available on this https URL.
71. 【2607.21004】AUCH-Net: Action Unit-Based Consistency-Aware Hypergraph Network for Cross-Domain Few-Shot Facial Expression Recognition
链接：https://arxiv.org/abs/2607.21004
作者：Xinhan Qiu,Yan Yan,Rui Zhu,Si Chen,Hanzi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：received considerable attention, considerable attention, received considerable, Recently, Consistency-aware Hypergraph Network
备注：
点击查看摘要
Abstract:Recently, cross-domain few-shot facial expression recognition (CF-FER) has received considerable attention. However, the performance of existing CF-FER methods is still unsatisfactory due to inferior transferable feature learning under large domain discrepancy and limited target samples. Fortunately, the action units (AUs), which indicate the movements of different facial muscles, provide consistent conceptual semantics for describing expressions within and across domains. Inspired by this, we propose a novel Action Unit-based Consistency-aware Hypergraph Network (AUCH-Net), which constructs consistency-aware hypergraphs on AUs, for CF-FER. Specifically, AUCH-Net presents a new AU feature learning (AFL) module and a new visual feature learning (VFL) module. The AFL module learns AU features under the guidance of a novel relation consistency loss and an AU regularization loss, while the VFL module learns visual features supervised by a relation consistency loss and a classification loss. By learning consistent AU features, AUCH-Net effectively models the connections between AUs and expression categories. As a result, we can bridge the gap between fine-grained facial variations and high-level expression categories, greatly facilitating the learning of transferable feature this http URL experiments on both in-the-lab and in-the-wild datasets show that our method consistently outperforms several state-of-the-art methods. Our results clearly show that modeling the relationships among AUs holds significant potential for FER under cross-domain few-shot scenarios.
72. 【2607.20993】Sparse Concept Channels in Frozen 3D CT Vision Encoders
链接：https://arxiv.org/abs/2607.20993
作者：Farhad Nooralahzadeh,Lea Bogensperger,Christian Bluethgen,Michael Krauthammer
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large vision-language models, internal units encode, medical image interpretation, Large vision-language, units encode clinical
备注：
点击查看摘要
Abstract:Large vision-language models are becoming increasingly dominant in 3D medical image interpretation, but we rarely know iwhich/i internal units encode clinical findings or iwhere/i that information lives in the representation. We first study this on a 3D chest vision-language model (Pillar-0) by probing its frozen vision embeddings. We show that (i) each radiological finding is encoded by a isparse/i set of ~10 vision-encoder channels that match full-feature classification performance and far exceed a zero-shot text prompting; (ii) turning off the channels tied to one finding, that finding's score collapses while unrelated labels stay stable; and (iii) the same sparse probe ireplicates/i on an architecturally unrelated 3D abdominal VLM (Merlin) suggesting a general property of frozen medical encoders. Our training-free concept channel probe (CCP) method, paired with a corpus-derived report template, outperforms published CT-CHAT on clinical efficacy and NLG metrics (F1 0.549 vs. 0.184; BLEU 0.483 vs. 0.373) at 22x lower latency. Our results provide a clear, reproducible characterization of how frozen medical encoders represent findings, demonstrating direct applicability across models.
73. 【2607.20989】Latent Variable-Mediated Cross-Learning for Few-Shot Acoustic Impedance Imaging
链接：https://arxiv.org/abs/2607.20989
作者：Junheng Peng,Yong Li,Mingwei Wang,Yi Bao
类目：Computer Vision and Pattern Recognition (cs.CV); Geophysics (physics.geo-ph)
关键词：severely ill-posed problem, labeled well-log samples, observations are band-limited, subsurface analysis, extremely scarce
备注： The manuscript is currently under review
点击查看摘要
Abstract:Acoustic impedance imaging is a fundamental yet severely ill-posed problem in subsurface analysis: the seismic wavelet is unknown, observations are band-limited, and labeled well-log samples are extremely scarce (typically 1% of all traces). Existing semi-supervised deep learning methods mitigate few-shot problem by incorporating forward modeling, yet they either rely on inaccurate prior wavelet assumptions or introduce auxiliary networks, leading to unstable optimization and degraded performance. We propose RD-SCL, a novel framework that integrates regularized deconvolution with semi-supervised cross-learning. At its core lies a differentiable, closed-form first-order Tikhonov deconvolution operator that dynamically estimates the latent wavelet in the frequency domain during training, providing stable physics-guided feedback without explicit auxiliary networks and fixed wavelet priors. Building on this operator, we design a symmetric cross-learning that enforces consistency between predictions on labeled and unlabeled data, thereby effectively exploiting abundant unlabeled traces. Extensive experiments on the SEAM and Marmousi 2 benchmarks demonstrate that RD-SCL consistently outperforms state-of-the-art supervised and semi-supervised methods, achieving substantial gains with lower computational cost. With only 56.5k learnable parameters and competitive runtime, RD-SCL offers a practical, physically consistent, and efficient solution for acoustic impedance imaging.
74. 【2607.20988】HyWorldVLA: A Vision-Language-Action Model with Hybrid World Modeling for Autonomous Driving
链接：https://arxiv.org/abs/2607.20988
作者：Quanfu Yu,Xian Wu,Hao Xu,Liulong Ma
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：world modeling represent, VLA, modeling represent, represent a promising, promising paradigm
备注： 20 pages with 13 figures
点击查看摘要
Abstract:Vision-Language-Action (VLA) models augmented with world modeling represent a promising paradigm for end-to-end autonomous driving. While pixel-level future prediction enables fine-grained spatiotemporal reasoning, it compromises robustness in noisy driving scenarios. Conversely, latent-based world models alleviate this sensitivity but often incur limited interpretability and representational degradation due to absent pixel-level grounding. To reconcile this trade-off, we propose HyWorldVLA, a hybrid world-VLA framework that unifies pixel-level supervision and latent representation learning. In the pre-training stage, HyWorldVLA predicts video latents encoded by a pre-trained video VAE, while simultaneously reconstructing video frames to provide precise pixel-level grounding. During the subsequent co-fine-tuning phase, the model exclusively predicts latent features, which are fed into an action expert to generate trajectories. Extensive experiments on NAVSIM v1 and v2 benchmarks demonstrate that HyWorldVLA significantly outperforms both pixel-based and latent-based world model baselines. Notably, we present the first comprehensive qualitative and quantitative analysis of world model noise robustness in autonomous driving, establishing a new benchmark for evaluating future architectures.
75. 【2607.20984】Distribution-Alignment Bridge for Uncertainty-Aware Text-to-Video Retrieval
链接：https://arxiv.org/abs/2607.20984
作者：Kyeongmo Chae,Jihoon Lee,Sangtae Ahn
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deterministic point matching, traditional deterministic point, distribution alignment task, framework that reconceptualizes, point matching
备注： ECCV 2026
点击查看摘要
Abstract:This paper proposes the Distribution-Alignment Bridge (DAB), a framework that reconceptualizes text-to-video retrieval as a distribution alignment task rather than traditional deterministic point matching. By modeling both text and video embeddings as Gaussian distributions defined by mean and variance, DAB explicitly accounts for modality-specific uncertainty. We employ a deterministic, diffusion-inspired bridge to iteratively refine text distributions toward their target video distributions through a truncated refinement process. This approach unifies probabilistic embedding and distributional transformation into a cohesive, end-to-end trainable system. To optimize cross-modal similarity, we introduce a distribution-aware contrastive loss based on Kullback-Leibler divergence. Extensive evaluations on MSR-VTT, MSVD, and VATEX benchmarks confirm that DAB significantly outperforms existing probabilistic and diffusion-based baselines, while providing calibrated uncertainty-aware ranking through bridge-induced distributional margins.
76. 【2607.20977】Unsupervised Metal Artifact Reduction in Dental CBCT using Fine-tuned Cycle-Consistent Adversarial Networks
链接：https://arxiv.org/abs/2607.20977
作者：G.L.T. Chamika,S.N.A. Dhanapala,P.H.S.V. Nimalaweera,Maheshi B. Dissanayake,Ruwan D. Jayasinghe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cone-beam computed tomography, significantly degrade cone-beam, degrade cone-beam computed, Metal artifacts generated, Metal Artifact Reduction
备注： accepted and published work
点击查看摘要
Abstract:Metal artifacts generated by dental implants significantly degrade cone-beam computed tomography (CBCT) volumes, obscuring critical anatomical structures and compromising diagnostic precision. To address this, an unsupervised deep learning framework has been proposed for Metal Artifact Reduction (MAR) utilizing a Cycle-Consistent Adversarial Network (CycleGAN) optimized for high-fidelity restoration. Unlike supervised methods that rely on unattainable voxel-aligned paired datasets, the proposed approach leverages an unpaired dataset of approximately 4,000 images, curated from the public ToothFairy dataset. The architecture integrates U-Net-based generators and PatchGAN discriminators, specifically tuned to mitigate generative hallucinations and preserve morphological integrity. Quantitative benchmarking on a held-out test set demonstrates a 34.6\% improvement in the Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE) score, a substantial reduction in Fréchet Inception Distance (FID) from 207.03 to 157.04, and a superior Structural Similarity Index Measure (SSIM) of 0.9105. The framework achieves real-time efficiency with a 3.03 ms inference time per slice, effectively suppressing artifacts while preserving anatomical detail. Expert validation confirms high fidelity; however, to ensure reliability in extreme cases, the architecture is recommended as a clinical decision-support tool under human-in-the-loop oversight. By enhancing diagnostic clarity via a scalable software pipeline, this study provides a robust solution for high-fidelity dental implant imaging.
77. 【2607.20955】FSB-Net: Frequency-Spatial Boundary Network for Brain Stroke Lesion Segmentation in Non-Contrast CT
链接：https://arxiv.org/abs/2607.20955
作者：Linke Fan,Xianglong Li,Huixin Huang,Kai Shu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：non-contrast computed tomography, rapid clinical decision-making, partial volume effects, remains difficult due, ambiguous boundaries caused
备注：
点击查看摘要
Abstract:Accurate segmentation of brain stroke lesions in non-contrast computed tomography (NCCT) scans is critical for rapid clinical decision-making, yet remains difficult due to the low contrast between lesion and normal brain tissue, heterogeneous lesion morphology across ischemic and hemorrhagic subtypes, and ambiguous boundaries caused by partial volume effects. Current deep learning approaches primarily optimize region-level overlap but lack explicit boundary modeling, leading to imprecise delineation that can affect volumetric assessment and treatment planning. We propose FSB-Net, a frequency-spatial boundary network that leverages frequency-domain analysis for boundary-aware stroke lesion segmentation. FSB-Net introduces three components: (i) a Wavelet Boundary Detection Head (WBDH) that applies the discrete wavelet transform to multi-scale encoder features, extracting high-frequency sub-bands as boundary representations; (ii) a Frequency-Spatial Cross-Attention Module (FSCAM) that performs bidirectional attention between wavelet boundary features and spatial decoder features for selective boundary enhancement; and (iii) a Spectral Boundary Loss that penalizes high-frequency discrepancies in the Fourier domain to optimize boundary sharpness. Built on a PVTv2-B2 encoder, FSB-Net is evaluated on a public Brain Stroke CT dataset containing both ischemic and hemorrhagic cases. Experimental results show that FSB-Net outperforms U-Net, UNet++, MANet, and DeepLabV3+ across all metrics, achieving state-of-the-art performance in mean Dice, mean IoU, and HD95.
78. 【2607.20947】RECO: Region-Aware Compensation for Extrinsic Perturbations in Roadside 3D Detection
链接：https://arxiv.org/abs/2607.20947
作者：Junsheng Du,Zhaocheng He,Yuhuan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cooperative early warning, intelligent transportation systems, safe autonomous driving, wide-area perception crucial, transportation systems
备注：
点击查看摘要
Abstract:In intelligent transportation systems, roadside 3D object detection provides wide-area perception crucial for traffic understanding, cooperative early warning, and safe autonomous driving. However, existing methods suffer from high sensitivity to camera extrinsics; even slight deviations (whether manifesting as transient jitter or persistent drift) can be significantly amplified by projective geometry. This cascade results in severe feature misalignment and degraded localization. To mitigate this limitation, we propose RECO, a region-aware extrinsic compensation framework that corrects extrinsics using piecewise 6-DoF pose offsets. RECO predicts a learnable range boundary to partition the scene into near and far regions, estimating region-specific pose corrections. A differentiable sigmoid gate then smoothly blends the two compensated geometries to preserve continuous BEV sampling and facilitate stable optimization. To supervise the refinement of extrinsics, we introduce an auxiliary reprojection loss that compares 2D bounding boxes projected from 3D ground truth against 2D annotations, optimizing it jointly with the standard detection objective. Extensive experiments on the DAIR-V2X-I and Rope3D benchmarks under extrinsic perturbations demonstrate consistent improvements over state-of-the-art baselines across both yaw and $z$-axis deviations. RECO also generalizes from transient perturbations to persistent shifts, maintaining highly competitive performance under strict calibration uncertainty.
79. 【2607.20940】Ms. Forcing: Efficient Streaming Video Generation with Multi-Scale Patchification and Attention
链接：https://arxiv.org/abs/2607.20940
作者：Zekun Li,Xiaoyan Cong,Hongyu Li,Zhiyang Dou,Chuan Guo,Abhay Mittal,Sizhe An,Srinath Sridhar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：dynamic world simulation, hinder real-time deployment, made substantial progress, conventional next-frame generation, next-frame generation hinder
备注：
点击查看摘要
Abstract:Streaming video diffusion models have made substantial progress toward interactive and dynamic world simulation, but the nested autoregressive and denoising loops of conventional next-frame generation hinder real-time deployment. Recent rolling-window methods pipeline denoising across multiple consecutive frames at different noise levels, improving throughput and long-horizon stability. However, they tokenize every state at the same fine spatial granularity, leaving substantial noise-dependent redundancy in the joint denoising window. We propose this http URL, an efficient streaming video generation paradigm that adapts spatial granularity to each state's noise level. Its Multi-Scale Patchification (MSP) assigns coarser patches to noisier states, reducing the active-window token count by 45%, while Multi-Scale Self-Attention (MSSA) matches the density of visible non-sink keys and values to each query scale to further reduce attention cost. Because both schedules are fixed by window position, this http URL retains a static, hardware-friendly computation graph. We further introduce Homogeneous-Noise-Level DMD (H-DMD), which assembles each fake video from clean predictions sharing the same source noise level, thereby reducing the mismatch between DMD training sequences and inference-time rollouts. The multi-scale design helps offset the additional training cost of backpropagating through overlapping windows. We include both quantitative and qualitative experiments to show that this http URL reaches 22.84 FPS on a single H200 GPU, 39.6% faster than Rolling Forcing, while significantly improving VBench scores in both short video and long video generation setting.
80. 【2607.20924】MagicMakeup: A Region-Controllable Diffusion Transformer for High-Fidelity Makeup-Transfer
链接：https://arxiv.org/abs/2607.20924
作者：Ziyi Wang,Siming Zheng,Yang Yang,Shusong Xu,Hao Zhang,Bo Li,Changqing Zou,Peng-Tao Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：source face, Makeup-transfer applies, source identity, identity preservation, identity
备注：
点击查看摘要
Abstract:Makeup-transfer applies the reference makeup to the source face while preserving the source identity. Despite advances in full-face editing by diffusion-based methods, strong regional controllability, makeup fidelity, and identity preservation remain challenging. The reasons are (i) pixel-to-attention misalignment that causes spillover into non-target areas and weakens regional control; (ii) unclear transfer/preservation concept separation under two-image conditioning, leading to coupling between makeup attributes and identity; and (iii) the lack of a high-resolution dataset that is identity-consistent and region-labeled for fine-grained supervision. In this paper, we propose MagicMakeup, a diffusion transformer-based framework for region-controllable and high-fidelity makeup transfer, built on spatial constraints and concept disentanglement. To enable precise region-specific editing while preserving identity, we propose Token-Aligned Region Gating, which aligns pixel masks with attention and applies region-specific logit gating. To clarify the concepts of transfer and preservation, we further introduce Cross-Modal Perception Guidance, which aligns text and image features to enhance cross-modal concept perception. We also design a pipeline for the generation of 1024 x 1024 data pairs through region-specific makeup removal and establish a unified benchmark in synthetic and real settings. Extensive quantitative and qualitative experiments show that MagicMakeup improves regional controllability, makeup fidelity, and identity preservation, with strong robustness across styles, races, and poses.
81. 【2607.20922】FA-LAM: Focus-Aware Large Avatar Model for One-Shot 4D Animatable Gaussian Head
链接：https://arxiv.org/abs/2607.20922
作者：Yingdong Hu,Yisheng He,Yiming Jiang,Zehong Lin,Steven Hoi,Jun Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Focus-Aware Large Avatar, simultaneously enabling static, Large Avatar Model, Gaussian head creation, one-shot animatable Gaussian
备注：
点击查看摘要
Abstract:We propose FA-LAM, a Focus-Aware Large Avatar Model for one-shot animatable Gaussian head creation, while simultaneously enabling static 3D and dynamic 4D full-head recovery. The core of our method lies in a thorough analysis of the attention mechanisms and the entangled reconstruction and animation training pipeline adopted by prior state-of-the-art approaches. Our analysis identifies two main factors that compromise the quality of 3D full-head generation: (1) incorrect and noisy attention activations, and (2) conflicts between the tasks of reconstruction and animation. To address the first issue, we introduce a symmetric and semantic attention regularization strategy that leverages the inherent semantics and structural symmetry of human heads. To disentangle the objectives of reconstruction and animation, we develop a novel dual-phase training pipeline that separates the model's capabilities for large-view hallucination and animation into distinct modules. Moreover, we enhance our model to support multi-view and streaming 4D reconstruction in an efficient and memory-friendly manner through a core autoregressive modification with tailored visibility-aware token fusion. Collectively, these innovations enable FA-LAM to reconstruct animatable Gaussian full heads with superior quality, particularly in fine facial regions and large viewing angles.
82. 【2607.20903】Sidewalk Moments: Are Richer Representations Always More Human-Aligned? Evidence from City-Walk Videos
链接：https://arxiv.org/abs/2607.20903
作者：Liu Liu,Freya Huying Tan,Fábio Duarte
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：temporally averaged images, text-based semantic descriptions, first-person city-walk videos, visual representations yield, spatiotemporal video features
备注： 35 pages, 18 figures. Under review at Scientific Reports
点击查看摘要
Abstract:We examine whether richer visual representations yield more human-aligned measures of urban engagement, using 61 first-person city-walk videos from YouTube segmented into over 50,000 ten-second clips and represented across four modalities: spatiotemporal video features, temporally averaged images (TAIs), audio embeddings, and text-based semantic descriptions. Spearman correlation analysis reveals the expected ordering along the temporal-richness continuum, with video features showing the strongest continuous alignment. However, this ordering breaks down under binary classification of high- versus low-engagement moments (the paradigm most commonly used to train perceptual scoring models), where TAIs consistently match or outperform video across most classifiers and quantile thresholds. An independent two-alternative forced-choice study on Amazon Mechanical Turk confirms that this parity reflects human judgment: participants identified engaging moments with comparable accuracy from TAIs and full video clips, while text performed substantially worse and audio remained near chance. Gap analysis reveals a functional dissociation: video features are advantaged in activity-driven scenes with dynamic content, whereas TAIs better align with human judgments in composition-driven scenes dominated by stable spatial structure. These findings challenge the assumption that richer representations are inherently more human-aligned, and suggest that perceptually grounded temporal compression can be a principled alternative to full video encoding.
83. 【2607.20900】DINO-VPT: Hierarchical Visual Prompt Tuning for Joint Physical-Digital Face Anti-Spoofing
链接：https://arxiv.org/abs/2607.20900
作者：Pierre Gallin-Martel,Mika Feng,Koichi Ito,Takafumi Aoki
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unified Face Anti-Spoofing, Face Anti-Spoofing, digital threats, increasing diversity, growing demand
备注： accepted to IJCB2026
点击查看摘要
Abstract:With the increasing diversity of spoofing attacks, there is a growing demand for unified Face Anti-Spoofing (FAS) models capable of detecting both physical and digital threats. While existing Vision-Language Models (VLMs) demonstrate high generalization in this context, they heavily rely on complex multimodal fusion and external text encoders. In this paper, we propose DINO-VPT, a lightweight, vision-only framework leveraging hierarchical visual prompt tuning. By dynamically injecting prompts conditioned on input features via a Prompt Routing Network (PRN), our method effectively disentangles diverse spoofing artifacts without requiring multimodal fusion. Evaluations on the UniAttackData benchmark demonstrate that DINO-VPT achieves higher accuracy than state-of-the-art VLM-based methods. Our results indicate that a properly structured vision-only architecture can achieve state-of-the-art performance in unified FAS without the need for multimodal supervision.
84. 【2607.20897】MAGE-Vein: Multi-Instance Age and Gender Estimation from Finger Vein Images
链接：https://arxiv.org/abs/2607.20897
作者：Katsuki Tanaka,Koichi Ito,Takafumi Aoki,Masakazu Fujio,Yosuke Kaga,Kanade Oshima,Kenta Takahashi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：widely considered impractical, considered impractical due, severe demographic biases, physiological confounding factors, Age estimation
备注： accepted to IJCB2026
点击查看摘要
Abstract:Age estimation from finger vein images has been widely considered impractical due to severe demographic biases in public datasets and physiological confounding factors like gender. To overcome these limitations, we propose MAGE-Vein, a novel multi-instance, multi-task learning framework. Our approach extracts robust structural aging signs by employing a hybrid feature-level fusion of three fingers, effectively suppressing local imaging noise. Furthermore, simultaneous optimization of gender classification conditions the network to effectively eliminate gender-specific vascular variations. Evaluated on a demographically balanced dataset of 402 subjects, MAGE-Vein achieves a mean absolute error of 6.12 years and a correlation of 0.880. Our results not only overturn the conventional consensus regarding the limitations of the finger vein modality but also demonstrate that previous estimation failures were primarily artifacts of biased public datasets. Our code is available at this https URL.
85. 【2607.20889】Engine-Native Editable 3D World Reconstruction with Objects and Lighting
链接：https://arxiv.org/abs/2607.20889
作者：Junhao Chen,Xinghao Chen,Henghaofan Zhang,Zihao Qiao,Saining Zhang,Yongzhi Li,Ruqi Huang,Sisi Li,Yimin Sheng,Jianyi Zhu,Hao Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：existing single-image methods, single-image methods largely, methods largely stop, scene creation requires, creation requires object
备注： 18 pages, 7 figures, Project Page: [this https URL](https://haidilao0328.github.io/Lumera/)
点击查看摘要
Abstract:Editable 3D scene creation requires object instances and lights that can be inspected, moved, and imported into standard engines, yet existing single-image methods largely stop at room-scale geometry, baked/global illumination, or text-driven generation. We introduce Lumera (Light-aware Unified Engine-native Reconstruction and Assembly), a benchmark and reference pipeline for engine-native, light-aware 3D scene parsing from a single image. Lumera-2K is built from 2,513 UE5 projects and provides 3.73M components, 63M object instances, 102.6K engine-native parametric lights, and 95.1K camera views. On this data, Lumera-Box and Lumera-Light adapt VLM to parse object boxes and parametric light tuples (x,y,z,r,g,b,I), which are assembled with per-object mesh reconstruction, HDR environment estimation, and a bounded agentic refinement loop. In a sanitized box benchmark against DetAny3D, SpatialLM, N3D-VLM, and WildDet3D, Lumera-Box obtains the strongest overall detection, geometry, semantic, and layout scores (merged mAP 0.1141, IoU-B 0.2472, F-score 0.2762), while WildDet3D remains stronger on anchor recall. For lights, Lumera-Light recovers almost all non-empty scenes (recall 0.998) but remains limited at individual-light localization (F1 0.209 at 0.5 m); matched lights have median position error 0.261 m, median {\Delta}E2000 4.59, and intensity Pearson r=0.628. These results establish parametric lights as a measurable editable-scene target and expose remaining bottlenecks in relation structure, light recall/intensity, and cross-engine generalization.
86. 【2607.20883】WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing
链接：https://arxiv.org/abs/2607.20883
作者：Ming Hu,Mingyu Dou,Jianfu Yin,Miaomiao Zhang,Cong Hu,Yao Wang,Bingliang Hu,Quan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enable efficient image, efficient image synthesis, Recent one-step, models enable efficient, editing
备注：
点击查看摘要
Abstract:Recent one-step text-to-image (T2I) models enable efficient image synthesis and provide new opportunities for real-time image editing. However, existing one-step editing methods primarily rely on text conditioning for semantic transformation, lacking explicit spatial control over \textit{where} to edit. More importantly, even when spatial constraints are introduced, these methods often struggle to achieve strong and stable semantic modifications within the target regions. In this work, we revisit one-step image editing from a spatially controlled perspective and identify two key challenges: discovering editable regions and achieving effective localized semantic transformation. We reveal that existing methods perform global semantic transport, which limits high-intensity local editing under the one-step setting. To address this issue, we propose \textbf{WhereEdit}, a framework that reformulates one-step editing as localized adaptive editing. WhereEdit automatically identifies semantically relevant regions from internal model features and applies adaptive local modulation to enhance target-region editing while preserving non-target areas and structural consistency. Experiments on the PIE-Bench benchmark demonstrate that WhereEdit consistently outperforms existing one-step image editing methods, achieving superior editing quality while maintaining the efficiency of one-step generation. Additional experiments with region-level supervision further highlight the importance of explicit spatial reasoning for high-quality one-step image editing.
87. 【2607.20874】Webly Supervised Multi-Label Recognition: Evaluation Benchmark and Dual-Branch Multi-Label Contrastive Learning
链接：https://arxiv.org/abs/2607.20874
作者：Zhihua Xu,Zhijing Yang,Yufeng Yang,Tianshui Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Training deep learning, costly manual annotations, deep learning models, Training deep, manual annotations
备注：
点击查看摘要
Abstract:Training deep learning models with freely available web images can reduce their dependence on costly manual annotations. Although webly supervised learning has been widely studied for single-label recognition, its multi-label counterpart remains underexplored, partly due to the lack of unified benchmarks and fair comparison protocols. To address this gap, we construct a benchmark for webly supervised multi-label recognition (WS-MLR), including Web-COCO and Web-Pascal, and re-implement representative baselines under a unified setting. The two datasets cover the same 80 and 20 categories as MS-COCO and Pascal VOC, respectively, and contain about 300 thousand images retrieved from the Internet using category-word combinations as search keywords. We further propose a Dual-Branch Multi-Label Contrastive Learning (DBMLCL) framework, which learns category-specific instance-level and category-level representations together with their similarities to identify and correct noisy labels. Extensive experiments on the benchmark demonstrate that DBMLCL achieves superior performance compared to representative baselines.
88. 【2607.20868】ViSTR-Bench: Can MLLMs Reason from Continuous Visual Cues in Dynamic Scenes?
链接：https://arxiv.org/abs/2607.20868
作者：Han Li,Si Liu,Zehao Huang,Dongxin Lyu,Longfei Xu,Jiahui Fu,Daxin Tian,Yuliang Xiu,Naiyan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, achieved remarkable success
备注： 37 pages, 37 figures
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) have achieved remarkable success across diverse expert-level tasks, but they still struggle with fundamental abilities that humans naturally develop through continuous observation of the real world, such as spatial perception and dynamic reasoning. Recent studies have recognized this gap and introduced dedicated benchmarks to evaluate the spatial-temporal capabilities of MLLMs. However, existing benchmarks mostly focus on static scenes or require exact quantitative predictions, leaving intuitive reasoning from temporal cues largely underexplored. In this paper, we introduce the Visual Spatial-Temporal Reasoning Benchmark (ViSTR-Bench), a novel evaluation suite designed to systematically assess whether MLLMs can perform qualitative reasoning from continuous visual cues in dynamic scenes. Guided by the principles of temporal emphasis, reasoning orientation, and qualitative evaluation, ViSTR-Bench establishes a comprehensive four-dimensional evaluations covering Motion Perception, Spatial Relations, Outcome Prediction, and Physical Dynamics. The benchmark comprises 15 distinct subtasks and 1,340 high-quality video question-answer pairs spanning diverse tabletop, indoor, and outdoor scenarios. Extensive evaluations of a broad spectrum of state-of-the-art proprietary, open-source, and specialized spatial MLLMs reveal that, despite their strong general video understanding capabilities, current models still face substantial bottlenecks in complex spatial-temporal reasoning and remain far below human performance.
89. 【2607.20866】Agentic Designer: Progressive Multi-Agent Collaboration for Structure-Aware Interior Layout Generation
链接：https://arxiv.org/abs/2607.20866
作者：Zhijing Yang,Haocheng Lin,Zhihua Xu,Haojie Li,Keze Wang,Liang Lin,Tianshui Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Generating realistic interior, realistic interior furniture, Generating realistic, Large Language Models, automated spatial design
备注： TPAMI 2026
点击查看摘要
Abstract:Generating realistic interior furniture layouts that strictly adhere to architectural constraints (e.g., walls, doors, and windows) remains a fundamental challenge in automated spatial design. Existing approaches, primarily based on one-shot generation using diffusion models or Large Language Models (LLMs), lack explicit mechanisms for intermediate geometric constraint verification, often resulting in structural collisions and functionally infeasible arrangements under complex room constraints. To address these challenges, we propose Agentic Designer, a progressive, multi-agent framework that formulates structure-aware interior layout generation as an iterative and constraint-verified decision process. By decomposing layout synthesis into modular stages of proposal, verification, and adjustment, the framework coordinates three specialized agents, a Generator, an Evaluator, and a Refiner, through a Progressive Consensus Mechanism. This mechanism enforces stepwise geometric validation and correction before each placement is committed, thereby preventing error accumulation. To facilitate this structure-aware paradigm and standardize evaluation, we establish InStruct, a comprehensive benchmark that integrates a dataset comprising over 18,000 high-quality, parametrically annotated samples with a novel suite of structure-centric metrics. Extensive quantitative evaluations, qualitative analyses, and user studies show that Agentic Designer significantly outperforms state-of-the-art methods, demonstrating substantial improvements in strict structural adherence and functional design coherence.
90. 【2607.20819】Explainable graph attention network for stress recognition (StressGAT) via differential action units
链接：https://arxiv.org/abs/2607.20819
作者：Thomas Kassiotis,Stefanos Gkikas,Nikolaos Smyrnis,Giorgos Giannakakis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recurrent Neural Networks, Convolutional Neural Networks, dynamic process characterized, significant individual variability, Neural Networks
备注： Accepted at the 14th International Conference on Affective Computing and Intelligent Interaction (ACII 2026)
点击查看摘要
Abstract:Stress is a dynamic process characterized by significant individual variability in facial expression. Traditional architectures, such as Recurrent Neural Networks (RNNs) and Convolutional Neural Networks (CNNs), often overlook person-specific baselines or lack the representational capacity to model the non-linear temporal progression of distress due to sequential bottlenecks and rigid grid-based constraints. Furthermore, many deep learning models lack the interpretability required for clinical deployment. This study introduces StressGAT, a Graph Attention Network that leverages the relational inductive bias of graph modeling to capture complex facial dynamics that indicate acute stress. By using Differential Action Units, the framework normalizes individual responses relative to neutral baselines to achieve personalized recognition. The proposed model achieves 88.62\% accuracy on a diverse stress-induction cohort (58 participants) using a subject-independent, Leave-One-Subject-Out (LOSO) cross-validation protocol. Beyond predictive accuracy, the architecture integrates a Multiple Instance Learning (MIL) attention mechanism to identify peak stress intervals and reveal distinct expressivity phenotypes. By simultaneously optimizing for accuracy and interpretability, this framework provides a robust, explainable solution for personalized affective monitoring.
91. 【2607.20813】SubSplat: High-Resolution Pixel-aligned 3DGS via Sub-pixel Gaussian Reparameterization
链接：https://arxiv.org/abs/2607.20813
作者：Jiun Lee,Jaekwang Kim,Sangmin Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generalizable novel-view synthesis, splatting enables efficient, Gaussian splatting enables, Pixel-aligned Gaussian splatting, novel-view synthesis
备注：
点击查看摘要
Abstract:Pixel-aligned Gaussian splatting enables efficient and generalizable novel-view synthesis. However, high-resolution rendering faces a critical trade-off where increasing input resolution improves detail at the expense of quadratically rising network computational cost. Conversely, maintaining low-resolution inputs stabilizes this cost but results in insufficient Gaussian density and artifacts. To address this, we propose SubSplat, which introduces Sub-pixel Gaussian Reparameterizer(SPGR) to subdivide primary Gaussians into fine-grained primitives, restoring structural density directly from low-resolution features. We further enhance the reparameterization quality through feature aggregation, which effectively captures high-frequency details across multiple views. Experiments on RealEstate10K and ACID demonstrate that SubSplat achieves high-fidelity rendering with superior efficiency. Our results validate that the proposed framework successfully resolves the trade-off between reparameterization fidelity and network computational cost inherent in pixel-aligned Gaussian Splatting.
92. 【2607.20790】Ocular Verification for Virtual Reality
链接：https://arxiv.org/abs/2607.20790
作者：Husanpreet Singh,Robert Tran,Ayushree Kharel,Sudipta Banerjee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Apple Vision Pro, Meta Quest, Apple Vision, Vision Pro, Virtual reality
备注：
点击查看摘要
Abstract:Virtual reality (VR) headsets (e.g., Meta Quest, Apple Vision Pro) provide a seamless user experience due to their fast, frictionless interaction with the physical world in a simulated environment. User authentication relies on biometric cues such as iris in such headsets. However, traditional iris recognition protocols may not be adequate in cases of unconstrained acquisition, which is typical of VR-based data. In this work, we examine three crucial aspects: (1) evaluating ISO/IEC 29794-6 iris quality metrics on VRBiom dataset and analyzing their limitations, (2) addressing data-specific challenges such as off-axis gaze, non-uniform illumination, and specular reflection using generative models, and (3) performing unimodal (iris, periocular) recognition and multimodal score-level fusion (iris + periocular). We observe that some metrics (e.g., margin adequacy) fail on VR-acquired data; whereas, image adjustments primarily benefit periocular recognition, and multimodal fusion lowers EER by ~11% over unimodal iris recognition performance. We will release the evaluation scripts upon acceptance for reproducibility.
93. 【2607.20789】3D-GIMP: When 3D Gaussian Inpainting Meets PatchMatch
链接：https://arxiv.org/abs/2607.20789
作者：Xuening Tian,Dieter Schmalstieg,Shohei Mori
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Recent advances, scene editing, update input views, editing have leveraged, models to update
备注： 15 pages
点击查看摘要
Abstract:Recent advances in 3D scene editing have leveraged iterative diffusion models to update input views. However, this process is computationally expensive and struggles to produce sharp details. Meanwhile, ``hallucination drift'' frequently introduces multi-view inconsistencies, leading to structural artifacts when rendering novel viewpoints. To address this problem, we present 3D-GIMP (3D Gaussian Inpainting Meets Patch Matching), a novel hybrid paradigm designed for high-fidelity object removal in 3D Gaussian Splatting. Instead of diffusing every view, 3D-GIMP performs a single generative inpainting on a key reference view, which serves as an appearance prior. We then introduce a 3D-aware PatchMatch algorithm to propagate these reference textures across all remaining views via correspondence matching, effectively bypassing the stochastic nature of frame-by-frame diffusion. By prioritizing reconstructive consistency over iterative generation, 3D-GIMP maintains high-frequency details across arbitrary resolutions while ensuring a mathematically consistent 3D reconstruction. Our experiments demonstrate that 3D-GIMP not only achieves competitive inpainting quality as previous methods using diffusion in multiple views, but also outperforms these methods in rendering speed and view consistency.
94. 【2607.20780】Rethinking Open-World Video Anomaly Detection: Diagnosing Definition Blindness
链接：https://arxiv.org/abs/2607.20780
作者：Inpyo Song,Jangwon Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Open-world video anomaly, Open-world video, expected to detect, detect events, events that match
备注： Preprint
点击查看摘要
Abstract:Open-world video anomaly detection (OWVAD) is expected to detect events that match a user-specified definition of abnormality. This requirement is stronger than generic anomaly localization: in the same video, changing the definition should change which temporal regions are scored as anomalous. We show that current OWVAD evaluation largely fails to isolate this conditional behavior. Standard VAD metrics and the dynamic-definition protocol can be dominated by target-versus-normal separation, allowing models to obtain strong scores while remaining nearly insensitive to the queried definition. We call this failure mode definition blindness. To explain why it is missed, we decompose dynamic-definition evaluation into target-versus-normal detection and target-versus-other-anomaly discrimination, and find that the former receives 7.2-26.8$\times$ more weight across common VAD benchmarks. Motivated by this diagnosis, we introduce three definition-conditioned evaluation metrics, DC-Disc, DC-Det$\Delta$, and DC-Sel$\Delta$, which progressively remove normal-frame, generic-anomaly, and multi-event selection shortcuts. Experiments on UCF-Crime, XD-Violence, and MSAD reveal that several strong VAD, OWVAD, and general vision language model baselines localize anomalous moments but exhibit weak definition following, often with near-zero definition-response margins. To validate that the failure is actionable, we further introduce DeCoS, a definition-contrastive scoring rule that subtracts anomaly evidence shared across definitions. DeCoS improves the strongest baseline by 7.3-16.0 AUROC points on DC-Disc and 15.5-28.3 points on DC-Det$\Delta$. Overall, our results argue that OWVAD should be evaluated as definition-conditioned anomaly scoring, not as anomaly detection under different prompt labels.
95. 【2607.20748】A real-time RGB-D perception pipeline for autonomous impact hammers in mining: self-filtering, rock segmentation and rock-breaking poses generation
链接：https://arxiv.org/abs/2607.20748
作者：Martín Gallegos,Francisco Leiva,Patricio Loncomilla,Michelle Cortés,Javier Ruiz-del-Solar
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：perform secondary reduction, secondary reduction, perform secondary, essential machines, Impact hammers
备注： 25 pages, 20 figures
点击查看摘要
Abstract:Impact hammers, also known as rock-breakers, are essential machines in mining operations, where they perform secondary reduction. In underground mining, these machines are typically teleoperated, limiting operational efficiency. This paper presents a real-time RGB-D perception pipeline as a step towards automating the operation of hydraulic impact hammers used in mining. The proposed system simultaneously generates operationally feasible rock-breaking poses and a robot-free 3D representation of the workspace. The proposed approach combines image-based instance segmentation with geometric point cloud processing, and operates on embedded hardware at approximately 10 Hz with a total latency of around 675 ms, enabling responsive closed-loop behavior when integrated with a control system. Experimental results in a representative scaled scenario demonstrate that the proposed system is suitable for real-time autonomous impact hammer operation.
96. 【2607.20705】U-CFR: Uncertainty-Guided Cascade Forward Refinement for Interactive Segmentation
链接：https://arxiv.org/abs/2607.20705
作者：Elijah Danquah Darko,Min Xian,Terence Soule,Tiankai Yao,Matthew William Anderson
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：passive refinement schemes, Cascade Forward Refinement, existing methods, converge slowly, methods often require
备注： 12 pages, 3 figures, 4 tables, ICPR 2026
点击查看摘要
Abstract:Interactive image segmentation is critical for efficient image annotation; however, existing methods often require many corrective clicks or rely on passive refinement schemes that converge slowly. We propose Uncertainty-Guided Cascade Forward Refinement (U-CFR), a novel inference-time framework that enables models to autonomously self-correct after each user interaction. U-CFR introduces a boundary-aware uncertainty score that fuses segmentation uncertainty, contour gradients, and explicit edge predictions to guide the placement of internal pseudo-clicks. These self-generated clicks target the most ambiguous boundary regions, providing strong corrective signals without additional manual input. To support this process, we design a dual-head network with a shared encoder-decoder backbone: a segmentation head ensures region consistency, while an edge head sharpens boundary alignment. In inference, U-CFR launches a cascade of refinement steps, where each stage leverages the uncertainty-driven pseudo-clicks to refine the mask progressively. Experiments on standard benchmark datasets demonstrate that the proposed U-CFR improves click efficiency, initial mask quality, and boundary accuracy. It reduces the required clicks by over 10% on challenging datasets like Berkeley and offers a more intelligent and efficient interactive annotation.
97. 【2607.20692】DS@GT ARC at ImageCLEFmed GANs 2026: Geometric Filtering for Privacy-Preserving CT Slice Generation
链接：https://arxiv.org/abs/2607.20692
作者：Eric Regina,Richard Arnaud,Samir Hadi Cisneros
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Determinantal Point Processes, Stein Kernel Thinning, Optimal Transport Conditional, Transport Conditional Flow, Conditional Flow Matching
备注：
点击查看摘要
Abstract:We present a privacy-preserving framework for synthetic lung CT slice generation developed for the Image-CLEFmed GANs 2026 challenge. The approach combines Optimal Transport Conditional Flow Matching with privacy-oriented training and a post-generation "Supervisor" pipeline that filters generated candidates in learned geometric latent spaces using autoencoder embeddings, Determinantal Point Processes, and Stein Kernel Thinning. Official results show a strong realism-privacy trade-off, with the best-performing model achieving a Privacy Preservation Score of 0.549 and competitive visual fidelity with an FID of 0.3290. While the proposed geometric filtering substantially reduces nearest-neighbor memorization and membership-inference leakage, persistent patient re-identification scores indicate that preventing direct image copying is not sufficient to remove deeper patient-specific anatomical identity, highlighting an important frontier for future privacy-preserving medical image generation.
98. 【2607.20691】Spatially Grounded Concept Bottleneck Models for Trustworthy Breast Ultrasound Diagnosis
链接：https://arxiv.org/abs/2607.20691
作者：Moshiur Rahman Tonmoy,Dunren Che,Haitham Y. Adarbah,Afzel Noore
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Bottleneck Models provide, Concept Bottleneck Models, Concept Bottleneck Model, Models provide, predictions by mediating
备注： Accepted to the Workshop on Data Quality Aware, High-Performance, and Trustworthy AI Systems for Healthcare at IEEE/ACM CHASE 2026
点击查看摘要
Abstract:Concept Bottleneck Models provide interpretable-by-design predictions by mediating diagnosis through human-understandable concepts, but in medical imaging, their trustworthiness is often limited by the quality and granularity of available supervision. In particular, predicted concept activations can be driven by irrelevant regions, leading to spatially unfaithful explanations. We study a data-centric spatially grounded Concept Bottleneck Model (SG-CBM) that leverages coarse lesion delineations as weak supervision to encourage anatomically plausible concept evidence. For breast ultrasound, we derive two clinically motivated zones from each lesion mask: (i) an in-lesion region of interest for morphology-related concepts and (ii) a posterior acoustic band for posterior phenomena. We train concept maps using a grouped spatial grounding objective and preserve semantic faithfulness with a linear bottleneck classifier. Across five-fold stratified group cross-validation, the proposed SG-CBM improves diagnostic AUROC and concept macro-AUROC while markedly increasing spatial alignment of concept evidence. We also perform a Train-corrupt/Test-clean annotation-quality stress test to quantify the impact of supervision quality on diagnosis and spatial faithfulness. Overall, the results underscore the need for data-quality-aware supervision design and systematic trustworthiness validation for deployable healthcare AI systems.
99. 【2607.20670】ODeform: Learning Continuous 4D Motion for Shape Deformation with Neural ODEs
链接：https://arxiv.org/abs/2607.20670
作者：Yordanka Velikova,Mahdi Saleh,Liming Kuang,Benjamin Busam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modeling continuous object, robotics tasks, manipulation and simulation, Modeling continuous, computer vision
备注： Accepted at IROS 2026
点击查看摘要
Abstract:Modeling continuous object deformation is important for many computer vision and robotics tasks, such as manipulation and simulation. Existing approaches rely on learning-based methods or physics simulators to model shape deformations. However, these approaches either use discrete time steps or are too computationally intensive for real-time applications. We present ODeform, a novel extension of Neural Ordinary Differential Equations to continuous 4D dynamics of deformable objects in 3D space. Our method transforms 3D point clouds and physical conditions (like material properties) into a unified latent space. By solving the resulting ordinary differential equations over time, we model deformations as continuous flows within this learned embedding, eliminating the need for discrete time steps while maintaining computational efficiency. We evaluate our approach on unseen physical parameter configurations, showing improved motion prediction accuracy over baseline methods. Our experiments further demonstrate a successful transfer to real 3D captured objects with novel shapes, along with effective interpolation and extrapolation of the learned dynamics. Our code and data will be made publicly available.
100. 【2607.20660】Axolotl3D: a Unified Framework for Faithful 3D Shape Completion
链接：https://arxiv.org/abs/2607.20660
作者：Anita Hu,Maria Shugrina
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce high-quality geometry, generative models produce, models produce high-quality, diffusion architectures, produce high-quality
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Recent 3D generative models produce high-quality geometry from a single image using large-scale priors and diffusion architectures. However, they assume complete visibility and single-view inputs, limiting applicability in multi-view, occluded, or editing scenarios. Although prior works address these challenges individually, they lack a unified framework for controllable 3D completion under diverse conditioning signals. We present Axolotl3D, a multi-modal and occlusion-aware 3D generation model that jointly conditions on images, visibility masks, camera parameters, and a partial point cloud. The point cloud serves as a geometric anchor promoting faithful shape completion, while camera parameters ensure consistent multi-view alignment in a shared 3D coordinate system. A unified training strategy synthesizes diverse conditioning regimes from large-scale 3D data, enabling robust cross-modal reasoning. Experiments on Toys4K and OmniObject3D demonstrate state-of-the-art performance under both clean and occluded settings, as well as strong results in real-world reconstruction and geometry-consistent editing.
101. 【2607.20653】PhysCoRe: Physics-Corrected Residual World Models for Material-Aware Deformable Dynamics
链接：https://arxiv.org/abs/2607.20653
作者：Haocheng Yin,Shuohan Tao,Yongsheng Chen,Lu Gan
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Predicting how deformable, deformable objects evolve, longstanding challenge, evolve under robotic, Material Point Method
备注：
点击查看摘要
Abstract:Predicting how deformable objects evolve under robotic manipulation is a longstanding challenge. Existing approaches typically rely on per-object optimization to fit material parameters, which can be slow and cannot generalize, while end-to-end learned alternatives extrapolate poorly and often violate basic physical structure. We present PhysCoRe, a physics-corrected residual world model that couples a differentiable Material Point Method (MPM) simulator with two feed-forward neural networks. A material refinement module, Material from Motion (MfM), infers per-particle elasticity from visual observations, grounding the simulator in object-specific physics. A residual correction module, Residual from Dynamics (RfD), learns the discrepancy and predicts corrections to the simulator's internal dynamics, absorbing systematic biases that the analytical model cannot capture. This design also supports online material identification on novel objects. MfM adapts from limited interactions, and its predictive uncertainty steers further exploration toward the regions where its estimate is least confident. Experiments on real deformable-object manipulation sequences show that PhysCoRe outperforms state-of-the-art baselines in prediction accuracy, and that its predicted confidence forms a reliable distribution across the object's geometry, providing a natural signal for future confidence-guided exploration.
102. 【2607.20642】Masked Topology Modeling for Self-Supervised Learning on Parametric CAD
链接：https://arxiv.org/abs/2607.20642
作者：Heinrich Jiang,Jennifer Jang
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Computer aided design, editable CAD tools, CAD tools, aided design, virtually any modern
备注：
点击查看摘要
Abstract:Computer aided design (CAD) is ubiquitous: virtually any modern object was designed using editable CAD tools. However, with the shortage of available CAD datasets in its native editable and parametric format, boundary representation (B-Rep), it is ever more important to develop data-efficient methods for this domain. We present a new self-supervised pretraining task, Masked Topology Modeling (MTM), that leverages the face-adjacency graph, an induced structure unique to B-reps that the encoder can be asked to reconstruct. MTM masks a fraction of edges and trains a small head to predict each masked edge's convexity and curve type from the encoder's post-message-passing face features. We combine MTM with a MoCo-style momentum-queue contrastive learning over B-rep-aware augmentations, a BFS-connected face-region masked-reconstruction objective, and pretraining on the ABC dataset and our new procedurally generated dataset to show strong performance on a number of benchmarks.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2607.20642 [cs.CV]
(or
arXiv:2607.20642v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.20642
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
103. 【2607.20628】RealVDeblur: One-Step Diffusion for Generalizable Real-World Video Deblurring
链接：https://arxiv.org/abs/2607.20628
作者：Renbiao Jin,Mingxin Yang,Yutian Chen,Junhao Zhuang,Xin Cai,Mulin Yu,Linning Xu,Wenxian Yu,Danping Zou,Shi Guo,Tianfan Xue
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：deblurring remains challenging, remains challenging due, video deblurring remains, complex degradations, realistic training data
备注： Project page with code: [this https URL](https://rbjin.github.io/RealVDeblur/)
点击查看摘要
Abstract:Real-world video deblurring remains challenging due to diverse motion patterns, complex degradations, and the scarcity of realistic training data, yet robust restoration is critical for downstream pipelines such as mobile imaging and 3D reconstruction. This work presents \textbf{RealVDeblur}, an efficient generative framework designed to improve in-the-wild robustness under diverse real capture conditions. First, a large-scale, physically grounded blur synthesis pipeline is constructed from scene-level 3D Gaussian Splatting (3DGS) assets and high-frame-rate videos, providing realistic training data covering both camera-induced and object-motion blur. Second, a video diffusion prior is leveraged for restoration; to better accommodate frame-dependent blur variations, temporal compression in the VAE is disabled and a frame-wise encoding scheme is adopted. For practical deployment on long videos, multi-step diffusion sampling is distilled into an efficient one-step generator, and a training-free Temporal Window Mask stabilizes inference beyond the training horizon with constant memory usage. Extensive experiments on diverse real-world benchmarks demonstrate strong perceptual quality, semantic fidelity, and temporal consistency on unseen videos, as well as improved robustness in downstream 3D reconstruction under severe motion blur. Project page: this https URL
104. 【2607.20590】Detecting Neural Network Failures through Spectral Analysis of Internal Activations
链接：https://arxiv.org/abs/2607.20590
作者：Arunan J
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：characteristic spectral instability, exhibit characteristic spectral, misclassifications exhibit characteristic, exhibit characteristic, spectral
备注： Submitted for ACML 2026 , Under Review
点击查看摘要
Abstract:Neural network misclassifications exhibit characteristic spectral instability in internal activations that is invisible at the output layer. This phenomenon is identified and formalized as Spectral Drift -- the frequency-domain distance between consecutive layer activations -- with empirical validation showing that failures exhibit significantly higher drift than correct predictions (1.9% increase, p0.001). This spectral signature emerges during internal processing but becomes masked in final outputs, explaining why confidence-based detection methods struggle. This work introduces Self-Detecting Neural Networks (SDNN), a framework that monitors spectral dynamics across network depth using Short-Time Fourier Transform, wavelet decomposition, and statistical moments to capture multi-scale spectral features. A lightweight detector network (5% parameter overhead) learns to identify failure-indicative patterns via curriculum learning on progressively challenging distributions: natural misclassifications, distribution shifts, and adversarial perturbations. Experiments on CIFAR-10 demonstrate that SDNN achieves 79.0 +/- 25.3% AUROC across three seeds, substantially outperforming confidence-based baselines including MaxSoftmax (50.5%) and Energy Score (52.9%) by approximately 25-30 percentage points. Ablation studies reveal that wavelet decomposition and statistical features make consistent contributions, while STFT's role remains unclear. This work establishes spectral analysis of internal activations as a promising direction for neural network reliability, revealing diagnostic information inaccessible to output-based approaches.
Comments:
Submitted for ACML 2026 , Under Review
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.20590 [cs.LG]
(or
arXiv:2607.20590v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.20590
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
105. 【2607.20561】CT-Merging: Consensus Directions and Task-Level Scaling for LoRA Adapter Merging
链接：https://arxiv.org/abs/2607.20561
作者：Keumseo Ryum,Joonhyuk Kang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：requires adapter storage, inference time, provide an efficient, specialize a pretrained, selection at inference
备注： 9 pages, 5 figures
点击查看摘要
Abstract:LoRA adapters provide an efficient way to specialize a pretrained model for many downstream tasks, but deploying one adapter per task requires adapter storage and task selection at inference time. Model merging addresses this issue by combining independently trained adapters into one multi-task adapter. Recent SVD-based LoRA merging methods mainly focus on constructing shared or task specific directions, while the coefficients assigned to the final directions are often directly from the original task SVD. On a fixed merged basis, inherited coefficients preserve component order with high rank correlation, yet their magnitudes differ substantially from the coefficients induced by the task updates. To address this mismatch, we propose CT-Merging, a LoRA-aware merging algorithm that estimates consensus directions from average task subspace projectors and assigns task-level RMS coefficient scales in the final update. CT-Merging uses repeated support across task SVD subspaces to construct the common basis, while reducing reliance on rank wise SVD magnitudes after direction construction. On the DC-Merge CLIP adapter benchmark, CT-Merging achieves superior average normalized accuracy compared to state-of-the-art merging methods and further improves over DC-Merge by 2.56 points on ViT-B/32 and 1.51 points on ViT-L/14 KnoTS-trained checkpoints.
106. 【2607.20545】StrideDiffusion: Accelerating Diffusion Models for Time-series Generation
链接：https://arxiv.org/abs/2607.20545
作者：Du Yin,Estrid He,Julián Jerónimo Bañuelos,Yang Yang,Feng Hu,Yuchen Luo,Hao Xue,Stephan Sigg,Flora Salim
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Software Engineering (cs.SE)
关键词：time series, inference time, competitive generators, large number, number of sequential
备注： Under Review
点击查看摘要
Abstract:Diffusion models have become competitive generators for time series, but their practical use is limited by the large number of sequential denoising steps required at inference time. Existing fast samplers typically use fixed or generic timestep schedules, overlooking a distinctive property of time-series diffusion: different spectral bands evolve at different rates during the reverse process. We introduce StrideDiffusion, a training-free spectral-aware sampler that adaptively selects the denoising stride from band-level activity. At each step, StrideDiffusion monitors relative band energy, log-power drift, and phase velocity to identify whether high- frequency dynamics remain active or whether the trajectory is dominated by stable low-frequency structure. It then takes fine steps when rapidly varying bands are active and larger jumps once only coarse components remain. A bandwise stability analysis shows that inactive frequency bands change only linearly with the jump size under deterministic affine reverse updates, providing a local justification for spectral activity as a step-size indicator. Across six unconditional time-series generation benchmarks, StrideDiffusion uses only 14-66 function evaluations instead of 500/1000 denoising steps, achieving up to 18.9x wall-clock speedup while preserving or improving generation quality. On conditional imputation and forecasting, it further delivers 5-14x average acceleration with comparable predictive accuracy. These results show that spectral evolution provides a practical and principled signal for fast time-series diffusion sampling. Our code is available at this https URL.
107. 【2607.20535】A Graph Neural Network approach to zero-shot Digital Twins
链接：https://arxiv.org/abs/2607.20535
作者：Alicia Tierz,Icíar Alfaro,David González,Elías Cueto
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Traditional Predictive Digital, Predictive Digital Twins, remain geometrically rigid, boundary conditions change, Traditional Predictive
备注：
点击查看摘要
Abstract:Traditional Predictive Digital Twins often remain geometrically rigid, requiring extensive retraining or fine-tuning whenever the underlying physical domain or boundary conditions change. To overcome this limitation, we present a novel framework for \textit{Zero-Shot Digital Twins} that seamlessly couples real-time visual perception with a geometry-agnostic, physics-informed reasoning engine. At the core of our architecture is the Thermodynamics-Informed Graph Neural Network architecture, a Geometric Deep Learning solver grounded in a metriplectic thermodynamic formalism that enforces energy conservation and non-negative entropy production locally through graph message passing. The framework integrates an auxiliary Graph Neural Network to infer unobservable fields (such as stress tensors or velocity and energy distributions) directly from sparse initial visual boundaries, mitigating numerical start-up transients. To bridge the sim-to-real gap, we implement a continuous closed-loop data assimilation mechanism; the pipeline tracks macroscopic deformations and free-surface fluid boundaries in real-time using deep segmentation networks combined with sparse optical flow, dynamically correcting the autoregressive simulation rollout and eliminating numerical drift. To test the validity of our approach, we demonstrate the extreme generalization capabilities of our approach across two disparate physical regimes: the large deformations of a viscoelastic beam and the non-linear sloshing of a viscous fluid. In both scenarios, the unified framework instantiates physically accurate simulations on novel, unseen geometries without case-specific retraining, operating well within real-time latency budgets (approximately 25 ms per frame) and enabling the direct projection of latent mechanical variables via Augmented Reality.
108. 【2506.19445】Deblurring in the Wild: A Real-World Image Deblurring Dataset from Smartphone High-Speed Videos
链接：https://arxiv.org/abs/2506.19445
作者：Syed Mumtahin Mahmud,Mahdi Mohd Hossain Noki,Prothito Shovon Majumder,Abdul Mohaimen Al Radi,Sudipto Das Sukanto,Afia Lubaina,Md. Mosaddek Khan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：smartphone slow-motion videos, largest real-world image, slow-motion videos, introduce the largest, largest real-world
备注： 8 pages (without references), 3 figures. Dataset [this https URL](https://huggingface.co/datasets/masterda/SloMoBlur)
点击查看摘要
Abstract:We introduce the largest real-world image deblurring dataset constructed from smartphone slow-motion videos. Using 240 frames captured over one second, we simulate realistic long-exposure blur by averaging frames to produce blurry images, while using the temporally centered frame as the sharp reference. Our dataset contains over 42,000 high-resolution blur-sharp image pairs, making it approximately 10 times larger than widely used datasets, with 8 times the amount of different scenes, including indoor and outdoor environments, with varying object and camera motions. We benchmark multiple state-of-the-art (SOTA) deblurring models on our dataset and observe significant performance degradation, highlighting the complexity and diversity of our benchmark. Our dataset serves as a challenging new benchmark to facilitate robust and generalizable deblurring models.
109. 【2511.10806】From Attention to Frequency: Integration of Vision Transformer and FFT-ReLU for Enhanced Image Deblurring
链接：https://arxiv.org/abs/2511.10806
作者：Syed Mumtahin Mahmud,Mahdi Mohd Hossain Noki,Prothito Shovon Majumder,Abdul Mohaimen Al Radi,Md. Haider Ali,Md. Mosaddek Khan
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：recover sharp images, Vision Transformers, unifies Vision Transformers, aiming to recover, camera shake
备注：
点击查看摘要
Abstract:Image deblurring is vital in computer vision, aiming to recover sharp images from blurry ones caused by motion or camera shake. While deep learning approaches such as CNNs and Vision Transformers (ViTs) have advanced this field, they often struggle with complex or high-resolution blur and computational demands. We propose a new dual-domain architecture that unifies Vision Transformers with a frequency-domain FFT-ReLU module, explicitly bridging spatial attention modeling and frequency sparsity. In this structure, the ViT backbone captures local and global dependencies, while the FFT-ReLU component enforces frequency-domain sparsity to suppress blur-related artifacts and preserve fine details. Extensive experiments on benchmark datasets demonstrate that this architecture achieves superior PSNR, SSIM, and perceptual quality compared to state-of-the-art models. Both quantitative metrics, qualitative comparisons, and human preference evaluations confirm its effectiveness, establishing a practical and generalizable paradigm for real-world image restoration.
