Arxiv每日速递(2026-07-29)

本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。

统计

今日共更新670篇论文，其中：

• 自然语言处理83篇
• 信息检索58篇
• 计算机视觉104篇

自然语言处理

1. 【2607.26057】Pass the Baton: Trajectory-Relayed On-Policy Distillation

链接：https://arxiv.org/abs/2607.26057

作者：Haolei Xu,Xiaowen Xu,Haiwen Hong,Zixuan Ni,Hongxing Li,Yiwen Qiu,Weiming Lu,Yongliang Shen

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：grounds token-level supervision, elicit unreliable supervision, subsequent generation builds, Relay On-Policy Distillation, producing misdirected continuations

备注： Project Page: [this https URL](https://zju-real.github.io/Relay-OPD) Code: [this https URL](https://github.com/zju-real/Relay-OPD)

点击查看摘要

Abstract:On-policy distillation (OPD) grounds token-level supervision in the student's own trajectory, yet suffers from prefix failure: once the student commits to a wrong reasoning direction, all subsequent generation builds on this deviation, producing misdirected continuations that elicit unreliable supervision and waste compute. We identify a teacher-student continuation asymmetry on failed prefixes, where the teacher tends to redirect while the student continues along the original direction, and convert it into a label-free handoff trigger in Relay On-Policy Distillation (Relay-OPD). During training, Relay-OPD constructs relay trajectories by letting the teacher briefly take over at detected trigger points to produce a teacher leg, after which the student resumes and is optimized on the resulting trajectory. A limited relay budget concentrates intervention on critical early positions while limiting departure from the student policy. With a Qwen3-4B-Instruct-2507 teacher and Qwen3-0.6B/1.7B-Non-Thinking students on eight mathematical reasoning benchmarks, Relay-OPD achieves the best or second-best results on every benchmark, outperforming standard OPD by +5.73% and the strongest baseline FastOPD by +1.49% on average for 1.7B, with consistent gains at 0.6B. Training trajectory length is reduced by over 50%.

2. 【2607.26017】UniMem: Complementary Episodic-to-Parametric Memory for Boundary-Agnostic Task Streams

链接：https://arxiv.org/abs/2607.26017

作者：Siyu Xia,Chenheng Zhang,Yanting Wu,Haoxuan Li,Jiajun Chai,Xiaohan Wang,Guojun Yin,Wei Lin,Zhouchen Lin,Haifeng Zhang,Jun Wang

类目：Computation and Language (cs.CL)

关键词：essential for LLM, LLM agents, task-specific execution strategies, reuse task-specific execution, accumulate task experience

备注：

点击查看摘要

Abstract:Memory is essential for LLM agents to accumulate task experience and reuse task-specific execution strategies. However, real-world deployment over boundary-agnostic and evolving task streams exposes a fundamental stability-plasticity dilemma. External retrieval-based memory can rapidly absorb new evidence, but it often fails to internalize recurring execution patterns and incurs inference-time retrieval overhead. Parametric memory enables stable and efficient execution once learned, but typically relies on explicit task boundaries and fixed parameter budgets. Inspired by the human brain, which balances plasticity and stability through complementary episodic storage and gradual consolidation, we propose UniMem, a self-routing framework for autonomous memory management. UniMem uses learnable routing tokens as memory controllers, enabling adaptive coordination between complementary memory pathways: novel or sparse tasks are retained in an episodic buffer for retrieval-augmented execution, while recurring and reliable patterns are consolidated into expandable parametric memory. By decoupling task identification from task execution with routing tokens and parametric memory blocks, UniMem expands memory on demand without task labels during deployment or uncontrolled parameter growth. Experiments on long-horizon streaming task sequences show that UniMem consistently outperforms baselines while maintaining execution fidelity, achieving an average gain of 4.0 EM points across three backbone models.

3. 【2607.26015】Instruction-Tuned Models Locally Reuse Human Syntax More Than Humans Do

链接：https://arxiv.org/abs/2607.26015

作者：Zandi Eberstadt

类目：Computation and Language (cs.CL)

关键词：dialogue widely considered, Syntactic convergence, analogous syntactic convergence, conscious awareness, grammatical profiles

备注：

点击查看摘要

Abstract:Syntactic convergence (the tendency of speakers to adapt in language towards the grammatical profiles of their interlocutors) is a well-documented feature of human dialogue widely considered to operate below conscious awareness. Whether large language models exhibit analogous syntactic convergence toward human users relative to human baselines and across a broad range of syntactic constructions remains an open question. Using substitution-paradigm data in which model generations replace one speaker's turns in pre-existing human dialogues, this study measures turn-adjacent reuse of context-free grammar (CFG) rules across sixteen open-weight Llama and Gemma models (1B-70B, pretrained and instruction-tuned) at 1,901 matched positions per model. Every model showed greater CFG-rule overlap with the preceding human turn than with a sampled unrelated human prime, and in every model this actual-versus-random difference was larger for lower-frequency rules. Each instruction-tuned model also showed greater natural-output overlap with the actual prime than the human response it replaced, and all eight matched architecture pairs exhibited greater actual-prime overlap after instruction tuning. However, relative to pretrained variants, instruction-tuned outputs overlapped more with unrelated primes, showed a smaller actual-versus-random increment, and had lower conditional rule-reuse odds once target rule-set size was held constant. In exploratory analyses, each model exhibited greater mean lexical and semantic similarity to the preceding turn than the matched human responses did. Instruction-tuned models additionally produced responses with greater mean semantic similarity than their pretrained counterparts in all eight architecture pairs, whereas the lexical similarity results were more heterogeneous.

4. 【2607.25959】Detecting Knowledge Inconsistencies Across Text, Tables, and Knowledge Graphs

链接：https://arxiv.org/abs/2607.25959

作者：Fanfu Wei,Thibault Ehrhart,Raphaël Troncy

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Wikipedia and Wikidata, Wikidata are widely, retrieval-augmented generation, LLM pre-training, Wikipedia

备注：

点击查看摘要

Abstract:Wikipedia and Wikidata are widely used for information access, LLM pre-training, and retrieval-augmented generation. Their knowledge is deeply connected but scattered across text, tables, and knowledge graphs. This raises a practical question: when these modalities disagree, how can we detect and explain the conflict? We study this problem as \emph{modality-level inconsistency detection}. We first introduce a taxonomy of cross-modal knowledge inconsistencies, covering information granularity differences, direct conflicts, temporal changes, and KG incompleteness. We then present \textsc{Kontrast}, an automatic framework that uses Text-to-SPARQL and LLM reasoning to compare table-based answers with KG evidence and categorize the resulting inconsistencies. Experiments on various Table-QA datasets show that cross-modal inconsistencies are common and informative. They reveal not only true knowledge conflicts, but also missing KG structure and temporal mismatches while being limited by Text-to-SPARQL errors and noise. Our analysis shows that text, tables, and KGs can complement and correct one another through systematic comparison. \textsc{Kontrast} provides a practical tool for large-scale knowledge auditing and establishes a benchmark for future work on cross-modal knowledge consistency. Code and data are available at this https URL.

5. 【2607.25953】Polistemics: Evaluating LLMs as Information Mediators in Politics Elections

链接：https://arxiv.org/abs/2607.25953

作者：Baran Peters

类目：Computation and Language (cs.CL); Computers and Society (cs.CY)

关键词：information citizens rely, political information citizens, citizens rely, LLMs increasingly mediate, political information

备注：

点击查看摘要

Abstract:As LLMs increasingly mediate the political information citizens rely on, there is still no standardized way to assess whether they do so responsibly. We introduce Polistemics, a theory-grounded benchmark for evaluating LLMs as mediators of political information in elections. Prior work has treated this task as reproduction rather than mediation, leaving its epistemic dimensions and interaction with imperfect information unaddressed. We ground the evaluation in Epistemic Modesty, a normative standard derived from citizens' epistemic agency, and test it across controlled settings that vary informational properties such as clarity, noise, and consistency. Applying the benchmark to three state-of-the-art LLMs on the 2025 German and Dutch elections, we find that high aggregate scores mask systematic failures. Models mediate reliably under clear evidence but break down under absent, vague, or contradictory information, while flattening the intensity of political language. These failures are likely driven by party priors, influenced by party labels and output language. Reliable mediation appears achievable, but no model delivers it consistently.

6. 【2607.25947】A Cost-Effective Multimodal LLM Reasoning Framework for Question Answering over Irregular Clinical Time Series

链接：https://arxiv.org/abs/2607.25947

作者：Frank Nie,Ethan B Liu,Yuan Zhu,Wei Fan,Jindong Han

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：plays a pivotal, healthcare applications, pivotal role, wide range, range of healthcare

备注：

点击查看摘要

Abstract:Question answering (QA) over irregular clinical time series (ICTS) plays a pivotal role in a wide range of healthcare applications. Although recent multimodal time-series large language models (LLMs) have shown considerable promise in general-purpose time-series QA, they remain poorly equipped to model the sparsity, asynchrony, and irregular sampling patterns of clinical observations. To fill this gap, we propose ClinPRISM, a cost-effective multimodal LLM reasoning framework for question answering over ICTS data. First, we devise an irregularity-aware multi-scale encoder to capture sparse clinical evidence at diverse temporal scales. Then, we propose a temporal evidence distiller to integrate representations across these scales and compress them into a small number of LLM-compatible tokens. Moreover, we introduce a progressive alignment strategy that sequentially aligns the irregular trajectories with the LLM's textual embedding space. To facilitate training, we construct 30,000 clinical time series paired with multi-scale descriptions, together with 41,000 instruction-tuning instances spanning 11 tasks. Using a 4-billion-parameter LLM backbone, ClinPRISM achieves state-of-the-art performance on the held-out evaluation benchmark while using only 16 time-series tokens and achieving an average inference latency of 0.15 seconds per question.

7. 【2607.25933】Evaluating Multi-Turn Multimodal Diagnostic Reasoning on Challenging Real-World Clinical Cases

链接：https://arxiv.org/abs/2607.25933

作者：Rui Yang,Weihao Xuan,Yi Lin,Zhuhan Bao,Jonathan Chong Kai Liew,Matthew Yu Heng Wong,Nicolás Lescano,Nikita R. Paripati,Emily Ling-Lin Pai,Jiarui Liu,Heli Qi,Heng-Jui Chang,Benny Kai Guo Loo,Huitao Li,Kunyu Yu,Yufan Wang,Chuan Hong,Shijian Lu,Douglas Teodoro,Naoto Yokoya,Ross Koppel,Mona Diab,Hua Xu,David W. Bates,Nan Liu,Yifan Peng

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：including progressive disclosure, including progressive, dynamic updating, Clinical diagnostic evaluation, reflect the realities

备注：

点击查看摘要

Abstract:Clinical diagnostic evaluation should not only assess whether models can provide correct diagnoses, but also reflect the realities of clinical practice, including progressive disclosure of multimodal information, dynamic updating of diagnostic hypotheses, and continuous refinement of clinical reasoning. However, existing evaluations of multimodal large language models (MLLMs) typically rely on single-turn or isolated tasks, making it difficult to fully capture the complexity of real-world clinical diagnosis. To bridge this gap, we developed ClinMM-Bench, the largest multi-turn multimodal clinical diagnostic evaluation benchmark to date. ClinMM-Bench contains 1,089 challenging real-world clinical cases and 3,760 medical images across eight specialties. We systematically evaluated 15 representative MLLMs using a two-level evaluation framework that assessed both diagnostic accuracy and diagnostic reasoning quality. Results showed that proprietary models achieved the highest overall diagnostic accuracy, but the proportion of completely correct diagnoses remained limited across all models. In terms of diagnostic reasoning quality, current models can identify plausible diagnostic directions but still have considerable limitations in generating reliable diagnostic reasoning. Error analysis further identified five representative failure modes: information synthesis failure, knowledge mapping error, perception error, premature closure, and visual hallucination.

8. 【2607.25907】Minimizing Targeted Activations: Input-Only Suppression of Evaluation-Awareness Latents in Large Language Models

链接：https://arxiv.org/abs/2607.25907

作者：Deepanshu Mody,Samarth Agarwal,Utkarsh Mittal,Dipesh Mahato

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：editing internal activations, Activation steering controls, Activation steering, steering controls model, internal activations

备注：

点击查看摘要

Abstract:Activation steering controls model behavior by editing internal activations at inference time. We study its input-side dual: optimizing a fluent prompt so that a chosen internal latent is driven toward zero, with no inference-time model access. Our target is an "evaluation-awareness" latent-linearly readable and steerable in recent work-whose control would threaten the validity of safety evaluations if models behave differently when they detect being tested. Adapting Fluent Dreaming / EPO with a negated feature term (GCG-style token optimization plus a self-cross-entropy fluency regularizer, swept over a fluency weight), we suppress the latent under five target constructions-a CAA direction, a subspace norm, an SAE feature, a single MLP neuron, and a behavioral logit-on Llama-3.2-3B and Llama-3.1-8B. The latent is robustly suppressible ($z\approx-7$), and a causally-validated Llama Scope SAE feature can be fully and selectively turned off. But our controls tell a cautionary story about the CAA direction: a placebo random direction is suppressed just as hard and shifts behavior just as far, and when we hold a real eval passage in context and optimize only a prefix, suppressing the eval-direction fails to reduce-and slightly increases-the model's behavioral eval judgment. Activation-readability, in short, is not behavioral controllability. We further find that a single MLP neuron is eval-correlated but not causal at both scales, and that scanning the real Pile yields a natural-text baseline competitive with the optimizer for the internal direction. A positive control validates our erasure detector, bounding an erasure-vs-rotation question earlier left open.

9. 【2607.25886】RSIBench-Data: Benchmarking Data-Centric Research for Recursive Self-Improvement

链接：https://arxiv.org/abs/2607.25886

作者：Fanqing Meng,Lingxiao Du,Qiguang Chen,Ziqi Zhao,Haocheng Lu,Mengkang Hu,Michael Qizhe Shieh

类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)

关键词：requires turning evidence, self-improvement requires turning, requires turning, turning evidence, agents

备注：

点击查看摘要

Abstract:Recursive self-improvement requires turning evidence of model failures into better models. Data-centric post-training research entails diagnosing capability gaps, designing and validating training-data strategies, and learning from checkpoint feedback. Can LLM agents automate this loop? Existing benchmarks entangle research decisions with optimization, serving, evaluation, and systems implementation, obscuring agents' research capability. We introduce RSIBench-Data, a controlled benchmark of LLM agents as data-centric researchers with a fixed post-training stack. Agents iteratively revise training-data strategies for a fixed target model; training and serving use Tinker-backed services, official evaluation runs through Harbor and E2B sandboxes, and budgets are fixed across agents. We evaluate four frontier agents on six benchmarks across software engineering, terminal use, scientific question answering, and mathematics. Agents demonstrate core data-centric research capabilities: in 58.33\% of settings, they improve upon the first valid attempt by refining strategies from feedback. However, improvement is inconsistent. Among searches continuing after the best observed score, 78.26\% end with a lower-scoring final attempt, while the rest only recover the same peak. A strong candidate may therefore appear early or midway through a run even as later revisions fail. Trajectory analysis identifies four patterns in stronger runs: accurate hypotheses, validation-grounded supervision, behavior-aligned data, and preservation of strong checkpoints. These findings suggest that current agents can make useful data-centric discoveries but cannot yet translate feedback into consistent improvements. RSIBench-Data provides a measurable, auditable testbed for the research capabilities required for recursive self-improvement. We open-source our code at this https URL.

10. 【2607.25881】AI's Capability in Assisting Scientific Research in Physics, Astrophysics, and Cosmology II: Project Planning and Proposal Evaluation

链接：https://arxiv.org/abs/2607.25881

作者：Jia Liu,Veena Krishnaraj,Kateryna Vovk,Kosuke Aizawa,Adrian E. Bayer,Linda Blot,Jessica Cowell,Suyog Garg,Jonathan Grée,Anamaria Hell,Ben Horowitz,Masaya Ichikawa,Kanyuni Iemoto,Keigo Kondo,Zacharie Lorsin,Kevin McCarthy,Jamie Robinson,Miguel Ruiz-Granda,Leander Thiele,Ievgen Vovk,Mingshen Zhou

类目：Computation and Language (cs.CL); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Instrumentation and Methods for Astrophysics (astro-ph.IM); Human-Computer Interaction (cs.HC); General Relativity and Quantum Cosmology (gr-qc)

关键词：large language models, assist scientific project, scientific project planning, reviewers, Claude Opus

备注： 16 pages, 4 figures

点击查看摘要

Abstract:We investigate how well large language models (LLMs) can assist scientific project planning and proposal evaluation. One-page project plans were independently generated for eight expert-conceived research projects in physics, astrophysics, and cosmology by human researchers and three contemporary LLMs (ChatGPT, Claude, and DeepSeek; mid-2025 models, used with their default tool access). The resulting 32 proposals were blindly evaluated by four human reviewers and two newer frontier LLMs (Claude Opus 4.8 and ChatGPT Pro 5.5) using a four-aspect evaluation rubric. Reviewers were also asked to identify whether each proposal was written by a human or an AI. Human reviewers rated human- and AI-written proposals similarly overall, whereas both AI reviewers scored AI-written proposals about one point higher (on a five-point scale) than human-written proposals. Human reviewers correctly identified human- and AI-written proposals 72% and 79% of the time, respectively, while both AI reviewers correctly classified all 32 proposals (100%). These results suggest that current LLMs can produce project plans comparable to human-written ones in the eyes of human reviewers, but that AI reviewers show a systematic preference for AI-generated proposals. Our results suggest caution when deploying LLMs widely in proposal preparation and evaluation.

11. 【2607.25880】Stemma: Induced Decision Regions Reveal LLM Provenance

链接：https://arxiv.org/abs/2607.25880

作者：Keyu Zhang,Vadim Safronov,Andrew Martin

类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：suspect LLM belongs, LLM provenance testing, suspect LLM, LLM belongs, provenance testing

备注： 25 pages, 4 figures

点击查看摘要

Abstract:LLM provenance testing asks whether a suspect LLM belongs to the same lineage as a source. Existing black-box methods largely infer this relationship from response-level characteristics, but these characteristics may shift under adaptation or deployment even when the underlying meaning remains unchanged, weakening the reliability of provenance evidence. To address this limitation, we introduce induced decision regions by mapping open-ended outputs into a finite decision space, thereby abstracting away surface-form variation and reframing provenance testing as measuring the inheritance of decision regions. Empirical analysis shows that the source's induced regions are preserved more strongly in related models than in unrelated models. Building on this signal, we propose Stemma, a practical black-box LLM fingerprinting method that operationalises stability, robustness, and specificity as complementary probe-selection principles for reliably estimating induced decision region inheritance. Across 770 source-suspect pairs drawn from 56 public checkpoints and spanning diverse model-weight transformations, Stemma achieves 0.967 AUC and 87.8% TPR at 1% FPR, substantially outperforming four representative baselines. It further achieves 0.995 AUC and 93.5% TPR at 1% FPR on 1,260 pairs covering 91 deployment instances, demonstrating robustness to diverse inference-time deployment settings.

12. 【2607.25857】Shieldstral

链接：https://arxiv.org/abs/2607.25857

作者：Antonia Calvi,Avinash Sooriyarachchi,Giada Pistilli,Guillaume Lample,Maarten Buyl,Maximilian Augustin,Maximilian Müller,Pierre Stock,Tom Bewley,Wassim Bouaziz,Yimu Pan

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：policy-adaptive multimodal safety, multimodal safety classification, multimodal safety classifier, text safety benchmarks, policy-adaptive multimodal

备注：

点击查看摘要

Abstract:We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7$\times$ its size on text safety benchmarks and sets a new state of the art on multimodal safety classification. Shieldstral formulates content moderation as a binary question-answering task. This simple formulation unifies diverse moderation tasks into a single yes/no problem, enabling heterogeneous safety datasets with divergent taxonomies to be consolidated under one training framework. We present the data construction recipe, covering curation and generation of approximately 54.1M samples and a fine-grained evaluation set to evaluate policy adaptability. Together, these enable a small adaptive model to match or outperform much larger models.

13. 【2607.25852】AngelSpec: Towards Real-World High Performance Inference with Speculative Decoding

链接：https://arxiv.org/abs/2607.25852

作者：Hong Liu,Rui Cen,Junhan Shi,Guangshuo Qin,Jiebin Zhang,Tianyu Liu,Runzhi Fan,Guoliang Zhao,Ruobing Xie,Kai Zhang,Song Liu,Guanghua Yu,Jianchen Zhu

类目：Computation and Language (cs.CL)

关键词：accelerates large language, decoding accelerates large, Speculative decoding accelerates, large language model, drafting structure performs

备注：

点击查看摘要

Abstract:Speculative decoding accelerates large language model inference without changing the target distribution, but no single drafting structure performs best across real-world workloads. Autoregressive multi-token prediction (MTP) is a lightweight, stable proposal mechanism, whereas block-parallel diffusion amortizes drafting latency over much longer candidate sequences; the better choice depends strongly on the output distribution. We present AngelSpec, a unified training framework for MTP and block-parallel speculative decoding that addresses this heterogeneity at three levels. At the training level, rather than fitting one universal drafter to a uniform data mixture, we co-specialize structure and data: the MTP drafter is trained on diverse conversational data for high-entropy open-ended chat, and the block-diffusion drafter on code and mathematics data for longer predictable continuations. At the architecture level, we propose DFly, a block-diffusion framework combining a hybrid target-conditioning backbone with a predecessor-conditioned autoregressive head, improving target-feature utilization and intra-block dependency modeling while keeping generation parallel. At the inference level, both acceptance length and verification cost vary with domain, request, online load, and hardware, so DFly treats verification as a shared batch-level resource: it reallocates compute toward high-confidence prefixes across requests and combines expected utility with a profiled cost model to adapt verification depth online. Across the Hy3 series, DFly raises the average accepted length on Hy3-A21B by roughly 30% and attains the highest average throughput at every tested concurrency from 4 to 64, a 1.98-2.40x speedup over autoregressive decoding and 10.5-11.8% higher throughput than DFlash. We release AngelSpec to support training and extending these methods.

14. 【2607.25814】Evaluation of Adversarial Robustness in Arabic Language Models

链接：https://arxiv.org/abs/2607.25814

作者：Anwar Alajmi,Ayed Salman,Imtiaz Ahmad

类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR)

关键词：recent outstanding capabilities, Arabic Language Models, Natural Language Processing, Language Processing models, Arabic Language

备注：

点击查看摘要

Abstract:The emergence of the recent outstanding capabilities of Arabic Language Models has opened doors for exposing their vulnerabilities. One of the major security risks associated with such Natural Language Processing models is adversarial attacks. These attacks can deceive the model into the wrong prediction, raising critical model security and safety concerns. This study aims to assess the robustness of five state-of-the-art Arabic Language Models under a distinct set of Arabic adversarial attacks applied at various levels of granularity and using different example generation strategies. We also explore a defense technique based on adversarial training to enhance model robustness. The results show that insertion of diacritics can reduce the accuracy of some models by 92% while maintaining a low perturbation distance. For word-level attacks, manipulating Arabic conjunctions preserves high semantic similarity scores, low perturbation distance, and leads to an accuracy degradation of up to 58%. For sentence-level attacks, paraphrasing proves its effectiveness by an average reduction of 76% in the victim models' performance. While adversarial training improves overall resilience, with MARBERT being the most robust and AraBERT showing the greatest relative gains, challenges persist, particularly against character-level noise. These findings highlight both the potential and limitations of current defense strategies in morphologically rich languages like Arabic.

15. 【2607.25765】WorkSurface-Bench: Benchmarking Enterprise Agents on Multi-Surface Knowledge Routing

链接：https://arxiv.org/abs/2607.25765

作者：Hao Liang,Meiyi Qiang,Sizhe Qiu,Linzhuang Sun,Wentao Zhang

类目：Computation and Language (cs.CL); Databases (cs.DB)

关键词：integrate heterogeneous knowledge, heterogeneous knowledge sources, narrative facts, file relationships, Enterprise agents

备注：

点击查看摘要

Abstract:Enterprise agents often need to integrate heterogeneous knowledge sources: documents for narrative facts, tables for computation, and dependency graphs for file relationships. Existing benchmarks typically evaluate retrieval or tool use without distinguishing whether an agent first selects the appropriate knowledge sources. We introduce WorkSurface-Bench, a benchmark for evaluating this capability as surface routing. It contains 1,151 atomic tasks derived from persona-scoped Workspace-Bench-Lite workspaces, spanning document, table, graph, and cross-surface questions. Its reference answers are auditable: table answers are reproduced through executed DuckDB queries, document answers are grounded in verified text spans, and graph answers are traced to source dependency annotations. We evaluate four model backbones across six controlled agent settings, yielding 27,624 protocol-error-free trajectories. Under gold-constrained tool access, agents achieve 98.7-99.8 Route F1, while Answer remains only 56.1-75.3 percent, showing that correct surface selection is necessary but insufficient for task completion. Matched interventions further show that surface hints improve Answer for three of four models, whereas removing irrelevant tools primarily improves routing and efficiency. In an independent three-annotator audit, all 200 sampled tasks pass all six quality criteria by majority vote, with 192 receiving unanimous judgments on every criterion. We release the dataset, construction pipeline, scoring code, and agent harness at this https URL.

16. 【2607.25716】SpeechLLM Meets Federated Learning for End-to-End ASR: English and Italian Case Studies

链接：https://arxiv.org/abs/2607.25716

作者：Mohamed Nabih Ali,Daniele Falavigna,Alessio Brutti

类目：Computation and Language (cs.CL)

关键词：distributed data sources, enables privacy-preserving training, automatic speech recognition, large-scale speech language, remains unexplored

备注： Accepted at the 2nd International Conference on Federated Learning and Intelligent Computing Systems (FLICS2026)

点击查看摘要

Abstract:Federated learning (FL) enables privacy-preserving training of automatic speech recognition (ASR) systems across distributed data sources, yet its application to large-scale speech language models (SpeechLLMs) remains unexplored. This paper presents the first systematic study of federated training for SpeechLLM-based end-to-end ASR systems. We design a communication-efficient federated optimization strategy tailored to the unique challenges of SpeechLLM architectures, addressing high-dimensional parameter spaces, gradient communication overhead, and computational constraints in distributed settings. Through extensive empirical evaluation on monolingual ASR tasks in English and Italian, we demonstrate the effectiveness and stability of our federated approach compared to centralized training baselines across diverse acoustic conditions and speaking styles. Additionally, we conduct a comprehensive ablation study analyzing the impact of different speech encoder architectures on monolingual English ASR performance within the federated framework, providing insights into optimal model configurations for decentralized training. Our results achieve competitive word error rates while reducing communication costs, establishing practical foundations for federated SpeechLLM deployment in real-world multilingual scenarios.

17. 【2607.25667】MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practice

链接：https://arxiv.org/abs/2607.25667

作者：Rodolfo Rizzi,Alessandro Grecucci,Massimo Stella

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Cognitive Behavioural Therapy, complete Cognitive Behavioural, scalability is problematic, Behavioural Therapy, Cognitive Behavioural

备注： 27 pages, 6 figures, 2 tables; 1 supplementary table

点击查看摘要

Abstract:Psychotherapists need repeated training and supervision by experts; however, scalability is problematic. Here we present MyMentorLLM, a multimodal voice- and text-based simulation environment for deliberate practice, used to generate 2,100 complete Cognitive Behavioural Therapy (CBT) training sessions. Each session links a DSM-5-TR-grounded patient (with major depressive, generalised anxiety or borderline personality disorder), a therapist-in-training and an expert supervisor. As an initial implementation, we adopted CBT because its structured procedures and competency-based supervision facilitate standardised simulation and evaluation. Sessions were analysed for emotional dynamics, therapeutic competence and diagnostic accuracy. Simulated patients expressed disorder-congruent emotional profiles, which trainee therapists mirrored as in real human counselling. The quality of supervision differed across LLMs: while most models overestimated trainees' competences, native speech-to-speech was closest to human scores. Supervisors' feedback led to better diagnoses in simulated psychotherapists in 5 out of 7 LLMs, and symptom identification accuracy increased with model size. This work shows that simulation of deliberate practice is possible for CBT training, although patient fidelity, calibration of supervisors, and harmful feedback should be evaluated together.

18. 【2607.25663】Localized Adaptation Reveals Distinct Learning Signatures in Transformers

链接：https://arxiv.org/abs/2607.25663

作者：Rebecca Ramnauth,Brian Scassellati

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Transformer adaptation, change is narrow, typically distributed, intended change, adaptation

备注： Main text: 8 pages, 2 figures; appendix: 13 tables, 10 figures; code and data available at [this https URL](https://github.com/rramnauth2220/adaptation-geometries)

点击查看摘要

Abstract:Transformer adaptation is typically distributed across model depth, even when the intended change is narrow. We investigate how adaptation site shapes what a model learns, how well that learning generalizes, and how selectively it is applied. We introduce a controlled benchmark spanning five objectives (lexical binding, factual association, behavioral policy learning, causal mapping, and procedural reasoning) and define each objective's "adaptation geometry" as its profile of acquisition, transfer, and boundedness under full-stack and early-, middle-, or late-layer LoRA. The objectives exhibit distinct geometries. Lexical binding favors early-layer adaptation for acquisition and boundedness but requires broader updates for transfer; factual association favors later layers among localized adapters; behavioral learning separates late-layer action acquisition from middle-layer policy gating; and causal and procedural transfer benefit most from middle- or full-stack adaptation. These patterns largely persist under parameter-matched controls, and most corresponding directional contrasts replicate across five model families. These findings establish adaptation site as a key design variable for controlling what models learn, generalize, and leave unchanged.

19. 【2607.25642】Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications

链接：https://arxiv.org/abs/2607.25642

作者：Xianghao Zang,Zijian Jiang,Jiarong Cheng,Qianrui Teng,Ying He,Yuxuan Mu,Chao Ban,Huayu Zhang,Lanxiang Zhou,Zerun Feng,Chi Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Instruction-based Image Editing, Instruction-based Image, one-sentence image editing, Large Language Models, Image Editing

备注： 33 pages, 7 figures, Vicinagearth

点击查看摘要

Abstract:Instruction-based Image Editing (IIE) aims to transform a given image into a new one based on textual instructions. Advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) have accelerated progress toward practical ``one-sentence image editing" systems. This survey presents a systematic taxonomy and comprehensive review of IIE research, structured around five core dimensions: (1) task definition and hierarchical categorization of editing operations, (2) methodologies for training data construction, (3) architectural evolution from GAN-based to diffusion and autoregressive paradigms, (4) standardized evaluation metrics and benchmark development, and (5) introduction of commercial solutions. Our analysis shows critical technological milestones across model generations. We further propose a Comprehensive, in-Depth, and Diagnostic benchmark for IIE task (CDD-IIE Bench), which can rigorously assess the multiple aspects of model performance. Through empirical comparisons of open-source solutions, we highlight their respective capabilities and limitations. Finally, we discuss future research directions to advance the field.

20. 【2607.25634】AIriskEval-edu Demo: Auditing of Pedagogical Risks in Educational Explanations

链接：https://arxiv.org/abs/2607.25634

作者：Javier Irigoyen,Roberto Daza,Francisco Jurado,Julian Fierrez,Ruben Tolosana,Alvaro Ortigosa,Miguel Lopez-Duran,Aythami Morales

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：present AIriskEval-edu Demo, explainable audit results, AIriskEval-edu Demo, depth and completeness, Demo

备注： 6 pages, 2 figures. Accepted at the 17th IAPR International Workshop on Document Analysis Systems (DAS 2026), ICDAR 2026, September 3, 2026

点击查看摘要

Abstract:We present AIriskEval-edu Demo, a platform that audits the pedagogical quality of instructional explanations and provides explainable audit results. The platform evaluates an explanation against a rubric covering five dimensions of pedagogical risk: factual accuracy, depth and completeness, focus and relevance, student-level appropriateness, and ideological bias. For each dimension, it returns a binary decision and a confidence score. Detected risks also include a natural-language rationale and, except for Depth and Completeness, a localized evidence span. The platform integrates GPT-5.5 through an external API and a self-hosted Llama 3.1 8B evaluator that runs on consumer-grade GPUs. The local evaluator is fine-tuned on AIriskEval-edu, a dataset of K-12 instructional explanations with risk and explainability annotations. The platform operates in two modes: in AI mode, both evaluators assess stored explanations generated under six simulated teacher profiles, each representing a distinct pedagogical behavior and potential risk; in human mode, the local evaluator audits user-written explanations in real time. The local evaluator outperforms GPT-5.5 on most reported metrics, offering educational institutions a practical way to keep audited content within their own infrastructure.

21. 【2607.25633】Construction-Driven Injection: Linguistically-Grounded Edit-Based Code-Mixing Fingerprints for Large Language Models

链接：https://arxiv.org/abs/2607.25633

作者：Yongyi Cui,Yue Li,Tianbao Jiang,Xin Yi

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：costly intellectual assets, Large language models, commercial misuse, Large language, costly intellectual

备注：

点击查看摘要

Abstract:Large language models (LLMs) are costly intellectual assets that remain exposed to unauthorized redistribution and commercial misuse. Injected fingerprints, i.e., trigger--target pairs embedded in model behavior, offer a practical, black-box-verifiable ownership signal, but existing methods decouple the two stages of the fingerprint life cycle: how a fingerprint is constructed and how it is injected. Existing fingerprinting frameworks suffer from two limitations. Natural-language fingerprints are prone to accidental activation, and garbled fingerprints are easily filtered by perplexity-based detection. Furthermore, decoupling construction from injection leaves the latter unaware of the trigger's linguistic structure, missing the opportunity for targeted optimization. We argue that fingerprint construction should drive injection, and present a unified fingerprinting framework that jointly optimizes both stages. First, LCF constructs code-mixing fingerprints by combining low-resource languages under a semantic-density substitution rule and grammar-biased mixing, yielding triggers whose perplexity sits far below garbled baselines while avoiding the accidental-activation failures of natural-language triggers. Second, LCFEdit injects each fingerprint with a null-space projection derived from high-resource multilingual representations that preserves knowledge, augmented by a cross-lingual alignment step that steers the weight update toward the fingerprint language's representation subspace. This construction-aware injection ensures that the update is linguistically informed and therefore more stable. Extensive evaluations on imperceptibility, detectability, and harmlessness demonstrate persistent ownership verification with negligible impact on utility.

22. 【2607.25630】A Human-in-the-Loop Corpus for LLM-Based Simplification of Scientific Summaries

链接：https://arxiv.org/abs/2607.25630

作者：Kyuri Im,Michael Färber

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词：Interdisciplinary research, papers remain difficult, scientific papers remain, research is accelerating, papers remain

备注： Accepted at FGWM@KI2026

点击查看摘要

Abstract:Interdisciplinary research is accelerating, yet scientific papers remain difficult to understand outside their home fields. We study large language model (LLM)-based simplification of scientific texts and present a human-in-the-loop workflow that transforms expert summaries into more accessible versions for non-specialists. Using SciSummNet as the source corpus, we first generate baseline simplifications with GPT-4o-mini. In Phase 1, readers from STEM fields outside computer science identify difficult sentences and phrases and compare the original and GPT-simplified summaries in terms of comprehensibility, naturalness, and simplicity. In Phase 2, computer science experts use this feedback to create expert-edited reference simplifications. We release the resulting corpus together with human judgments and automatic evaluation results. The Phase 1 judgments show a clear preference for the GPT-generated summaries in terms of comprehensibility and simplicity, while qualitative analysis of the Phase 2 edits highlights the importance of preserving domain-specific terminology and the strength of scientific claims. The resulting resource supports the training and benchmarking of simplification systems for cross-disciplinary scientific communication.

23. 【2607.25614】MemSFT: Mitigating Alignment Tax with an External Parametric Memory

链接：https://arxiv.org/abs/2607.25614

作者：Jiarui Wang,Xiang Shi,Jiaqi Cao,Rubin Wei,Xiquan Wang,Hao Sun,Jingzhi Wang,Zhiqi Yang,Qipeng Guo,Bowen Zhou,Zhouhan Lin

类目：Machine Learning (cs.LG); Computation and Language (cs.CL)

关键词：Adapting Large Language, Large Language Models, Adapting Large, Large Language, substantially degrade performance

备注： 33 pages, 11 figures, 13 tables

点击查看摘要

Abstract:Adapting Large Language Models (LLMs) to specialized domains often incurs an alignment tax, as fine-tuning on domain-specific tasks can cause catastrophic forgetting and substantially degrade performance on general tasks. We propose MemSFT, which mitigates the alignment tax by decoupling domain specialization from backbone parameter updates through a plug-and-play parametric memory. The memory is trained to imitate the behavior of a non-parametric retriever operating over domain data, thereby memorizing knowledge and patterns that would otherwise be accessed through retrieval. Once trained on a specific domain, the memory can be reused across LLMs of different sizes. During generation, a learned router dynamically fuses the output distributions of the memory and backbone at each decoding step, allowing domain expertise to be invoked selectively. Across biology, geoscience, and law, evaluations with models ranging from Qwen3-8B to Qwen3-235B-A22B show that MemSFT consistently improves domain performance with negligible degradation in general performance, whereas full SFT suffers severe forgetting on general tasks. Overall, our results demonstrate a practical path to decoupling general model capabilities from domain-specific knowledge at the parameter level, thereby equipping LLMs with new specialized capabilities without compromising their general capabilities.

24. 【2607.25600】Beyond Self-Knowledge: Propagating Uncertainty Across Reasoning and Retrieval in LLMs

链接：https://arxiv.org/abs/2607.25600

作者：Chandan Kumar Sah,Xiaoli Lian,Li Zhang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Retrieval-augmented generation improves, generation improves knowledge-intensive, Retrieval-augmented generation, knowledge-intensive question answering, improves knowledge-intensive question

备注： 9 pages, 6 figures, 6 tables

点击查看摘要

Abstract:Retrieval-augmented generation improves knowledge-intensive question answering, but indiscriminate retrieval can introduce irrelevant evidence and unnecessary computation. We investigate whether verbalized confidence from black-box language models can serve as an actionable signal for retrieval routing. Our method, BeyondUncertainty, first elicits a structured provisional answer and confidence estimate, then applies a model-specific threshold selected on held-out validation data and frozen before test evaluation. Low-confidence questions receive top-$5$ TF--IDF retrieval followed by a second answer call, whereas high-confidence questions return the provisional answer directly. We evaluate 27,000 policy instances across six QA benchmarks, three model families, and three retrieval policies. BeyondUncertainty achieves $0.483$ mean token-level F1, compared with $0.467$ for always retrieval and $0.401$ for no retrieval, while reducing retrieved passages by $20.4\%$ relative to always retrieval. When matched on the number of questions routed to retrieval within each dataset--model cell, it outperforms a post-hoc random allocation in 17 of 18 settings, with an average gain of 0.024 F1. Although poorly calibrated as an absolute probability, probe uncertainty modestly predicts question-level retrieval benefit (AUROC $=0.628$). However, the additional probe increases total token usage by $28.2\%$, revealing a trade-off between more selective evidence acquisition and end-to-end token efficiency.

25. 【2607.25590】PILA: Plug-and-Play Insertion for LLM-native Advertising

链接：https://arxiv.org/abs/2607.25590

作者：Zhaowei Zhang,Yuhan Fu,Yihang Zhang,Xiaohan Liu,Ceyao Zhang,Xiaoyuan Zhang,Yipeng Kang,Tonghan Wang,Yaodong Yang

类目：Computation and Language (cs.CL)

关键词：monetize large language, naturally integrating sponsored, integrating sponsored content, large language models, monetize large

备注：

点击查看摘要

Abstract:How to monetize large language models (LLMs) by naturally integrating sponsored content into their responses, known as LLM-native advertising, has recently emerged as a critical problem. However, existing solutions entangle advertising with content generation inside a single model, which is incompatible with modern API-only or workflow-based LLM applications and inevitably compromises the original response quality. To address this, we propose PILA, which reformulates ad insertion as a conditional response rewriting problem and decouples it from the upstream service as a lightweight sidecar module. PILA is model-agnostic and can be seamlessly integrated with existing LLM services without modifying the base model or its workflow. It also exposes a controllable trade-off between user-side naturalness and ad-side exposure, offering a practical interface for downstream pricing and deployment. Experiments across diverse upstream models show that \pila consistently improves ad effectiveness while preserving response quality, highlighting its promise as a practical solution for LLM-native advertising.

26. 【2607.25589】Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact

链接：https://arxiv.org/abs/2607.25589

作者：Mateusz Kozłowski

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Medical-imaging AI benchmarks, benchmarks combine datasets, provider APIs, statistical code, benchmarks combine

备注： 25 pages, 5 figures, 7 tables. Retrospective artifact audit; no new model calls or annotations. Corrective audit and archival reconstruction: [this https URL](https://doi.org/10.5281/zenodo.21629849)

点击查看摘要

Abstract:Medical-imaging AI benchmarks combine datasets, DICOM rendering, prompts, provider APIs, automated labels, statistical code, manuscripts, and repository releases. Agreement across these artifacts is usually assumed rather than tested. We performed a retrospective forensic reproducibility audit of a preserved chest-radiograph vision-language model (VLM) pilot; no model was called again and no image or report was newly annotated. We traced prompt bindings, DICOM metadata, output completeness, label extraction, matched analyses, and release propagation. Of 300 planned model-prompt calls, 297 yielded nonempty reports. Sixty Claude calls labeled A/B were executed with the same C prompt. The 30 studies represented 28 patients. Four MONOCHROME1 images were rendered without required polarity inversion, dataset split membership was not retained, and the unvalidated extractor truncated five reports to 4000 characters. Reconstructing one common cohort of 369 complete case-finding blocks changed Cochran's Q from 154.73 to 182.29. Of 45 McNemar comparisons, 27 had unadjusted p 0.05 and 20 remained below 0.05 after Holm adjustment. These values describe only the archived automated-label matrix; they do not recover the intended prompt comparison or establish clinical performance. We withdraw the original performance, ranking, prompt-effect, and clinical claims and specify machine-verifiable controls for cohort, DICOM rendering, prompt and model identity, call status, annotation provenance, keyed analysis, and derived artifacts.

27. 【2607.25581】Evaluation of forced alignment of code-mixed speech: the case of Hindi-English

链接：https://arxiv.org/abs/2607.25581

作者：Ayushi Pandey,Pamir Gogoi,Kevin Tang

类目：Computation and Language (cs.CL)

关键词：poses unique challenges, Montreal Forced Aligner, speech poses unique, expanded inventories, forced alignment

备注：

点击查看摘要

Abstract:Code-mixed speech poses unique challenges to forced alignment: expanded inventories, orthographic errors, and speaker variation. We evaluate forced alignment of Hindi-English code-mixed speech using the Montreal Forced Aligner. We address 2 problems: (1) free variation involving native vs non-native pairs and (2) phonemic boundary detection for mid-utterance English words. Bootstrapping strategies substantially outperform unmodified lexicons. Acoustic models trained on sentence-level code-mixed data achieve a mean error of 4.15ms, ie. ten times lower than monolingual Hindi (38.18ms) or isolated English (37.58ms) alternatives. Principled lexicon design and code-mixed training data are both essential for reliable alignment of bilingual speech.

28. 【2607.25579】IRIS: Reusable Identity Representations from Frozen LLMs for Entity Alignment

链接：https://arxiv.org/abs/2607.25579

作者：Xinran Liu,Shengtao Li,Shouqian Shi,Ge Wang,Xin-Wei Yao

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：real-world object, identifies entities, knowledge graphs, Entity, exploit explicit graph

备注： 9 pages, 1 figure, 3 tables

点击查看摘要

Abstract:Entity alignment (EA) identifies entities across knowledge graphs (KGs) that refer to the same real-world object. Conventional EA methods mainly exploit explicit graph structures and textual fields, which often provide insufficient semantic understanding to recognize the same entity under heterogeneous descriptions and distinguish it from semantically similar entities. Although large language models (LLMs) offer deeper entity understanding, existing LLM-based EA methods largely use this capability for auxiliary generation or candidate-conditioned decisions. Consequently, such understanding is not distilled into a stable and directly comparable identity space, leaving alignment tied to specific KG pairs or candidate sets and requiring repeated processing as the matching context changes. To address these limitations, we propose IRIS (Identity Representations from Internal States), a training-free framework that constructs for each entity an iris-like signature encoding its distinctive and stable identity characteristics. IRIS derives these signatures by eliciting identity-oriented contextual representations from a frozen LLM, thereby forming a shared space in which each entity is encoded once and can be aligned across different KGs through direct similarity comparison, without pair-dependent representation construction or candidate-wise LLM inference. Across four established EA benchmarks and two frozen LLM backbones, the best IRIS variants achieve Hits@1 scores of 100.00, 99.38, 98.31, and 97.99 on D-Y-15K V2, DBP-WIKI, ICEWS-WIKI, and ICEWS-YAGO, respectively.

29. 【2607.25507】Phase Structure in Rotary Attention: A Spectral Framework for Semantic Continuity and Execution-Boundary Governance

链接：https://arxiv.org/abs/2607.25507

作者：Abraham Chachamovits

类目：Computation and Language (cs.CL)

关键词：Transformer language models, rotary position encoding, Transformer language, encoding introduce explicit, Rotary Position Embedding

备注： 14 pages; theoretical framework and proposed experimental program

点击查看摘要

Abstract:Transformer language models are usually analyzed through vector geometry, yet ordered context and rotary position encoding introduce explicit phase structure into query-key interactions. This paper develops a bounded spectral framework for examining rotary phase alignment, hidden-state continuity, and semantic drift without treating language models as literal physical wave systems. It first identifies ordered hidden-state sequences, rather than vocabulary indices, as valid domains for spectral decomposition. It then derives the Rotary Position Embedding (RoPE) attention score as a sum of magnitude-weighted cosine terms and proves a local stability lemma: uniformly bounded phase displacement limits degradation of the corresponding pre-softmax score. To extend phase analysis beyond native RoPE coordinates, the paper defines complex modal coordinates over fixed orthonormal direction pairs and introduces a weighted coherence functional for hidden-state trajectories. These constructions support a strict distinction between representational continuity and execution-boundary admissibility. Internal coherence may describe preservation of task-relevant relations, but it cannot authorize a consequential transition. Positioned against existing geometric, spectral, phase-modulation, representation-analysis, and mechanistic-interpretability accounts, the framework contributes a theoretical and methodological program for determining when spectral structure explains continuity and when governance must remain an external predicate over execution.

30. 【2607.25485】PatientAgentBench: A Benchmark Framework for Evaluating Patient-Facing Health AI Agents

链接：https://arxiv.org/abs/2607.25485

作者：Korosh Vatanparvar,Ashutosh Joshi,Maria Xenochristou,Mohammad Abuzar Hashemi,Prasad Kasu,Deepak Bansal,Daniel Lopez-Martinez,Anchal Nema,Ramya Ganesan,Will Kimbrough,Alex Woody,Yadunandana Rao,Dilek Hakkani-Tur,Wilko Schulz-Mahlendorf

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：reason about health, evolving from answering, answering questions, health records, Health

备注： Code: [this https URL](https://github.com/amazon-science/PatientAgentBench)

点击查看摘要

Abstract:Health AI is evolving from answering questions to agentic systems that converse with patients, reason about health records, and act on their behalf. Primary care guards against diagnostic errors and unsafe care; agents assisting in this domain warrant evaluation against the same risks. Current benchmarks focus on medical knowledge, assessed through isolated question-answering or clinician-facing tasks. PatientAgentBench benchmarks patient-facing agentic healthcare; it evaluates a foundation model, wrapped in an agent with a sandbox of healthcare tools, conversing with a simulated patient. Each conversation is scored by an LLM-as-a-Jury across six dimensions via over a hundred conversation-agnostic, clinician-grounded criteria. To validate alignment, licensed clinicians annotated shared conversations, yielding 79-93% adjacent agreement between jury and expert raters, on par with or exceeding clinician inter-rater agreement. We benchmarked 10 models across four families on the same 1,200 scenarios and found clinical gaps. Triage quality is the most discriminating dimension: pass rates rise from 32% for the weakest models to 88% for the strongest, with agents often acting on administrative requests without clinical screening. Clinical safety and workflow accuracy follow the same pattern: the weakest models fail often, fabricating unexecuted actions, while frontier models fail on only 1-3% of cases, from unverified tool outputs and omitted crisis resources in an emergency. More capable models narrow these gaps but do not close them; the strongest scores only 4.25 of 5 overall. These failures surface only in sustained, tool-using conversations against realistic patient records, confirming that static benchmarks are insufficient as healthcare agentic systems gain autonomy. We release the framework as a reproducible, clinician-validated evaluation standard to help the field close this gap.

31. 【2607.25398】HANDBOOK.md: A Benchmark for Long-Context Agentic Instruction Following

链接：https://arxiv.org/abs/2607.25398

作者：Liudas Panavas,Sebastian Minus,Bradley Monton,Derek Ray,Suhaas Garre,Sushant Mehta,Edwin Chen

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Language-model agents, system prompt, increasingly deployed, Model Context Protocol, skills document

备注： 16 pages, 3 figures, 5 tables. Accepted to the Workshop on Agent Behavior (WAB) at COLM 2026. Benchmark, environments, and evaluation harness: [this https URL](https://github.com/surge-ai/handbook)

点击查看摘要

Abstract:Language-model agents are increasingly deployed under standing instructions: a system prompt, a policy file, or a skills document is placed in context, and the agent is trusted to let it govern every action that follows. Existing benchmarks rarely test this deployment pattern directly; they measure whether an agent can complete a task, not whether a long, binding policy document actually constrains its behavior over an extended tool-use horizon. We present this http URL, a benchmark of 65 agentic tasks modeled on how enterprise employees follow company handbooks. Each task places an agent in a self-contained company environment, a file workspace together with mock email, chat, calendar, issue-tracking, and commerce services exposed over the Model Context Protocol, and instructs it to carry out routine professional work governed by an expert-written standard operating procedure of 20 to 124 pages. Tasks span five domains (finance, medical billing, insurance, logistics, and HR) and ten fictional companies. To resist memorization, every task modifies one of ten base handbooks, altering the specific rules and thresholds on which grading turns, so no two tasks share a policy. Grading is fully deterministic: each task carries a rubric of programmatic criteria (824 in total) that check both that required actions occurred and that prohibited actions did not. Under strict grading, where a trial passes only if every criterion is satisfied, the best of thirty evaluated model configurations passes 36.2% of trials, and most frontier configurations remain below 25%. Failures follow consistent patterns: agents let a plausible in-environment request override the standing policy, perform a required check and then act against its result, lose rule details over long horizons, and report compliance they did not achieve. We release all tasks, environments, and the evaluation harness.

32. 【2607.25380】Memory for Large Language Models

链接：https://arxiv.org/abs/2607.25380

作者：Sining Zhoubian,Dan Zhang,Evgeny Kharlamov,Jie Tang

类目：Computation and Language (cs.CL)

关键词：large language models, foundational architectural dimension, dimension in large, byproduct of computation, controllable mechanisms

备注： 20 pages, 4 figures

点击查看摘要

Abstract:Memory has evolved into a foundational architectural dimension in large language models (LLMs), shifting from an implicit byproduct of computation to a spectrum of explicit, controllable mechanisms. While recent advances introduce diverse strategies---spanning transient attention, recurrent state dynamics, parameter-efficient adaptations, and scalable lookup storage---this rapid evolution has led to a highly fragmented research landscape. In this survey, we present a systematic, architecture-centric taxonomy of memory in LLMs. Our framework characterizes memory along three orthogonal axes: representation (implicit versus explicit), update dynamics (offline versus online), and persistence (short-term versus long-term). We further formalize the granular mechanisms dictating memory writing, routing, state transitions, and consolidation. This unified perspective elucidates the conceptual boundaries between computation-coupled and independently addressable memory, effectively bridging disparate architectural paradigms. Additionally, we critically analyze hybrid memory architectures, system-level efficiency trade-offs, and multi-dimensional evaluation methodologies. By consolidating these scattered advancements into a cohesive framework, this survey charts the trajectory of memory-centric LLM design and provides a principled foundation for future innovations in scalable and adaptive language modeling.

33. 【2607.25375】Inspect India Evals: An Open Benchmarking Framework for Evaluating Large Language Models in the Indian Linguistic and Cultural Context

链接：https://arxiv.org/abs/2607.25375

作者：Abhishek Kumar Singh,Shrey Nag,Sachita,Lipi Goel,Rajeshwar Singh Janwar

类目：Computation and Language (cs.CL)

关键词：locally specific traditions, officially recognized languages, billion people, officially recognized, vast nation

备注： 19 pages, 9 figures, 7 tables

点击查看摘要

Abstract:India is a vast nation of over 1.4 billion people, varied by hundreds of diverse and locally specific traditions and cultures and 22 officially recognized languages. Large language models (LLMs) are now being deployed on a massive scale throughout the mainland as well as in remote villages. However, the common benchmarks - MMLU, BIG-Bench, and TruthfulQA are almost exclusively English- and Western-centric. They do not identify those safety, fairness, and accuracy failures unique to the Indian context. That is the gap Inspect India Evals seeks to fill. It is an open-source framework built on top of UK AISI's Inspect AI platform. It has six benchmarks: Multilingual MMLU across sixteen Indian languages, BharatBBQ (our adaptation of BBQ for Indian social bias), a safety evaluation for Digital Public Infrastructure, a multilingual safety test using harmful prompts in Indian languages, a multi-turn jailbreak resistance test, and an Indian cultural knowledge benchmark scored using LLM-as-judge rubrics. In this study, we tested five open-weight models ranging from 8B to 32B parameters. Sarvam-M 24B and Gemma 2 27B came out on top, both scoring 80% on the composite India Fairness Index, with Sarvam-M even beating larger 32B models on Indian cultural knowledge and DPI safety compliance. All models scored 100% refusal on Multilingual Safety, whereas DPI safety varied from 20% to 100%. The framework is public. It's built to work with the UK AISI registry. Anyone can reproduce or extend this work.

34. 【2607.25356】Data Quality Profiling at Scale with Progressive Sampling: A Benchmark for Data-Centric AI Pipelines

链接：https://arxiv.org/abs/2607.25356

作者：Laure Berti-Equille

类目：Databases (cs.DB); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：computing missing-value rates, duplicate fractions, computing missing-value, missing-value rates, functional-dependency violations

备注： 29 pages, 8 figures

点击查看摘要

Abstract:Data quality profiling -- computing missing-value rates, duplicate fractions, outlier densities, and functional-dependency violations -- is foundational for data-centric AI pipelines, yet exhaustive scans over millions of rows are prohibitively slow for near-real-time monitoring. Progressive sampling is the standard alternative; the open question is which strategy best preserves profile fidelity at scale. We benchmark nine sampling strategies -- blind (random uniform, geometric, Yamane, cluster) and proxy-guided (Metropolis-Hastings, DAG, stratified by column type or quality score, importance-weighted) -- on three real-world datasets (NYC 311, NYPD arrests, UCI Adult; up to 500K rows), an IoT sensor stream (2.3M rows), two ultra-large real datasets including Ultra-Marathon Running (up to 7.4M rows), and synthetic data scaled to 5x10^6 rows. Contrary to the assumption sharpens estimates, blind representative samplers dominate uniformly. At a 5% budget, random uniform achieves 0.49% mean relative error on NYC 311; DAG-guided MCMC yields 19.5% (approx. 40x worse), and across all real datasets DAG is 11-49x worse (Wilcoxon W=0, p=0.002, n=9 pairs). Cluster sampling matches random uniform (MRE 0.110 vs. 0.111); proxy-guided methods share DAG's failure mode (MRE 0.20-0.35). At scale, random uniform is near-linear (O(N^{0.964})) while DAG is super-linear (O(N^{1.272})), running 28--47x slower on ultra-large data with 6x worse accuracy. The root cause is an IQR proxy mismatch: proxy-guided samplers over-pursue numeric outliers, while quality defects concentrate in categorical columns invisible to the proxy. The actionable finding: representativeness, not domain knowledge, determines sampler quality -- schema-free random uniform or cluster sampling suffices for production-grade quality profiling at scale.

35. 【2607.25340】Cardiologent: Multi-Agent Clinical Decision Support for Patient-Level Arrhythmia Assessment, Urgency, and Management

链接：https://arxiv.org/abs/2607.25340

作者：Sukju Oh,Moo-Yong Rhee,Jae-Sik Jang,Sukkyu Sun

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：episode of atrial, atrial fibrillation, healthy adult, elderly patient, patient

备注： 21 pages, 8 figures

点击查看摘要

Abstract:The same episode of atrial fibrillation is a minor finding in a healthy adult and grounds for anticoagulation in an elderly patient with hypertension: identical signal, opposite decision. Naming the rhythm is only the start; what determines a patient's outcome is the judgement that follows -- what the arrhythmia is across the whole record, what it means for this patient, and what should be done about it. Recent work pairing large language models with the ECG stops short of this, reading one recording without assembling a patient-level finding; and agentic systems built around it either receive the arrhythmia a device has already detected or target a different diagnostic task, stopping before the decision this task requires. We formulate patient-level arrhythmia decision support as a task and present Cardiologent, a multi-agent system that spans it from detection to decision. An agent for each signal -- a single ECG lead and the photoplethysmogram a wearable acquires -- grounds its window reading in measured features rather than a bare label; the readings are assembled into the patient's rhythm profile and, with the patient's own data, reasoned against clinical guidelines retrieved for the case, with a critic checking each conclusion against the guideline it cites. We evaluate the clinical decision rather than the report, across integrated diagnosis, clinical significance, and urgency and management. Cardiologent scores highest on every axis, first on every patient-level task under both cardiologists and an at-scale LLM judge -- whose agreement with the cardiologists (ICC 0.74, 0.66) matches theirs with each other (0.67). Because each conclusion traces to a cited guideline and is validated against expert cardiologists, it yields decisions a clinician can audit rather than act on blindly -- a step toward use in continuous monitoring.

36. 【2607.25337】mporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control

链接：https://arxiv.org/abs/2607.25337

作者：Jiaxin Bai,Jiaxuan Xiong

类目：Computation and Language (cs.CL); Robotics (cs.RO)

关键词：Joint-Embedding Predictive Architectures, model predictive control, latent model predictive, learn world models, Predictive Architectures

备注：

点击查看摘要

Abstract:Joint-Embedding Predictive Architectures (JEPAs) learn world models by predicting in representation space rather than reconstructing pixels, making them a natural backbone for latent model predictive control from offline demonstration logs. JEPA-style training optimizes short-horizon latent prediction, whereas planning requires a multi-step ranking of imagined futures by goal progress. Prior JEPA planners often inherit that ranking from embedding geometry, typically latent Euclidean distance, which arises as a byproduct of representation learning rather than as a progress cost mined from the logs. We propose temporal-distance JEPA (TD-JEPA), which retains the LeWM encoder--predictor backbone and mines a directed temporal cost from reward-free trajectories: same-trajectory step order supplies positive targets, cross-trajectory pairs act as heuristic negatives, and a rollout-consistency term matches the planner horizon. The mined supervision serves two roles: as the deployed planning cost when progress is topological, and as a representation signal that improves Euclidean planning when contact geometry dominates. Under locked evaluation, deploying the mined cost raises Two-Room success to 100.0% versus LeWM's 97.4%, while shared Euclidean planning on the same temporally trained checkpoint raises OGB-Cube by 14.2 points over LeWM and improves Push-T. Against LeWM and the concurrent RC-aux baseline under locked evaluation, TD-JEPA matches or exceeds both methods on every environment. Ablations show that the directed head, cross-trajectory negatives, and rollout consistency each contribute. TD-JEPA narrows the train--plan gap for JEPA world-model planners by discovering temporal progress structure in offline logs and co-designing cost form with plan-time deployment. Code is available at this https URL.

37. 【2607.25335】Every Time I Hire a Linguist, Inference Costs Go Down: On Linguistic Rules as Effective Prompt Compressors

链接：https://arxiv.org/abs/2607.25335

作者：Jianfei Ma,Zhaoxin Feng,Emmanuele Chersoni,Si Chen

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：shortens LLM input, reduce inference cost, existing methods score, compression shortens LLM, shortens LLM

备注： 37 pages, 6 figures, EMNLP2026

点击查看摘要

Abstract:Prompt compression shortens LLM input to reduce inference cost, yet existing methods score token importance through LM forward passes. It remains questionable whether such nuanced, costly token selection is necessary. Compression requires identifying informative content, a problem that linguistic research has long addressed through cues that can be operationalized as deterministic rules. We therefore ask: can \textbf{linguistic rules alone} serve as effective prompt compressors, without LM-based scoring at compression time? To address this, we conduct offline evolutionary search over lexical, syntactic, semantic, and discourse seeds to find competitive rule combinations. The resulting linguistic compressor requires no LM forward pass at deployment and uses only CPU-side processing for compression. We evaluate it with a dual-path protocol to balance compression quality and reconstruction fidelity. Across short passages, multi-document reasoning, and dialogue-memory QA datasets, evolved compressors achieve performance similar to that of recent advanced prompt-compression strategies. Performance is strongest under light-to-moderate compression and degrades as compression becomes more aggressive, while the Direct and Reconstruction paths exhibit distinct patterns. Evolutionary analysis reveals that effective compression fuses signals across linguistic levels and, as the compression ratio increases, rules shift from token pruning to sentence extraction.

Comments:
37 pages, 6 figures, EMNLP2026

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2607.25335 [cs.CL]

(or
arXiv:2607.25335v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.25335

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

38. 【2607.25308】CAST: Game Solvers as Turn-Level Teachers for LLM Agents

链接：https://arxiv.org/abs/2607.25308

作者：Yu Wang,Yi-Kai Zhang,Wentao Shi,Ziang Ye,Yuchun Miao,Yueqing Sun,Qi Gu,Xunliang Cai,Lan-Zhe Guo,Han-Jia Ye,Fuli Feng

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Training large language, large language models, sparse final rewards, Training large, decisions determine success

备注：

点击查看摘要

Abstract:Training large language models (LLMs) to act in long-horizon games is a promising step toward generalist decision-making, yet reinforcement learning with verifiable rewards (RLVR) relies on sparse final rewards that reveal little about which decisions determine success. Denser process signals could supply this missing turn-level credit, but existing sources are hard to keep both cheap and accurate. We observe that changes in a game solver's state value reveal whether an action advances the state toward success. Building on this insight, we propose CAST (Credit Assignment from Solver Teachers), which converts these value changes into solver advantages and injects them into RLVR as turn-level signals. We further show that, under a soft-optimal solver assumption, maximizing the solver advantage is equivalent to on-policy distillation from the solver, requiring only scalar values rather than teacher logits. Across Sokoban, Minesweeper, and Rush Hour, CAST outperforms all trained baselines on every game under both in-domain and unseen-difficulty evaluation and achieves the highest average zero-shot performance on ALFWorld and WebShop. Our code is available at this https URL.

39. 【2607.25305】oward a systematic method for identifying language areas

链接：https://arxiv.org/abs/2607.25305

作者：Hiram Ring

类目：Computation and Language (cs.CL)

关键词：variables of interest, linguistic typology, Macroareas, contact, language

备注：

点击查看摘要

Abstract:Macroareas are geographical areas used in typological research for grouping variables of interest. In linguistic typology, languages in a given macroarea are considered to have potential for contact, in contrast to those outside the area, where contact is less likely. Along with language family membership, macroareas are used as controls for models in linguistic typology, in an attempt to address the problem of autocorrelation - the observation that historical developments or typological patterns may be due to contact between neighboring languages and/or inheritance from a common ancestral language. Macroareas are therefore a central aspect of research that seeks to separate universal properties of language from local (or language-specific) properties. Existing macroareas largely depend on expert determinations of what constitutes a geographical area of potential contact, and to date have mainly aligned with continents or landmasses (Hammarström and Donohue 2014; Nichols, Witzlack-Makarevich, and Bickel 2013). While there are various historical and theoretical reasons for these groupings, there as of yet has been no systematic approach to identifying such areas for a given region. This paper attempts to address such a gap and move beyond macroarea to identification of language areas of relatively arbitrary size, presenting a simple geographical clustering method for identifying groupings over any area. The method produces a set of worldwide macroareas that largely align with existing groupings, as well as local groupings for a well-known sprachbund.

40. 【2607.25294】CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition

链接：https://arxiv.org/abs/2607.25294

作者：Lai Wei,Chengqi Li,Jiapeng Li,Ruina Hu,Yue Wang,Weiran Huang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Real-world tasks, learn from task-specific, context, Real-world, multimodal context learning

备注：

点击查看摘要

Abstract:Real-world tasks often require models to learn from task-specific context rather than relying only on pre-trained knowledge. While recent work has highlighted this capability as context learning, existing evaluations mainly focus on textual contexts. In many practical settings, however, the context to be learned from is multimodal: scientific findings are conveyed through figures and tables, financial indicators are scattered across converted reports, and spatial decisions depend on maps, scenes, or web pages. We introduce CLBench-V, a benchmark for multimodal context learning that addresses the difficulty of localizing where context use breaks down by organizing tasks around three dimensions: context grounding, new information application, and new knowledge learning. CLBench-V combines converted public benchmarks with newly constructed datasets spanning domains such as science, finance, long-document understanding, spatial reasoning, and web-based visual question answering. To reduce the cost of constructing domain-specific context-learning tasks, we further use automated construction and filtering procedures for our newly built datasets. Across 3,443 instances and six recent multimodal models, the best overall score is only 0.2847, indicating that multimodal context learning remains far from saturated. Moreover, InternVL3.5-30B-A3B performs best on context grounding and new knowledge learning, while Qwen3.5-Plus performs best on new information application. We further analyze judge reliability, context length, image count, and representative failure cases. Code is available at this https URL.

41. 【2607.25291】CoSA: Accelerating Long-Context Inference via Proxy-Kernel Co-Designed Sparse Attention

链接：https://arxiv.org/abs/2607.25291

作者：Yufei Xue,Lin Niu,Hong Liu,Siran Liu,Hanyong Shao,Wei Liu,Guanghua Yu,Jianchen Zhu,Jun Zhang

类目：Computation and Language (cs.CL)

关键词：inference prohibitively expensive, proxy-based block-sparse attention, self-attention makes long-context, makes long-context inference, long-context inference prohibitively

备注：

点击查看摘要

Abstract:The quadratic cost of self-attention makes long-context inference prohibitively expensive, and proxy-based block-sparse attention has become a practical remedy. Existing methods typically rely on a proxy to predict a binary sparse mask and a kernel to consume this mask and perform sparse attention computation. Such an approach is effective under moderate budgets. However, as the budget tightens, the estimated proxy inevitably drops some salient blocks, while the kernel can only apply the sparse mask mechanically, leading to an evident drop in model accuracy. We propose CoSA, a two-stage training-free Sparse Attention under proxy-kernel CO-design, which couples a Kernel-Aware Proxy (KAP) with an Ordered-Skipping Kernel (OSK). In the first stage, the KAP selects blocks under a moderate budget and produces an ordered mask that prescribes the order in which KV pages are visited in the kernel inner loop. In the second stage, the OSK applies this mask and skips more blocks under a tightened budget given online-softmax statistics. Across mainstream LLM backbones and long-context benchmarks, CoSA attains higher accuracy at lower budgets. Impressively, CoSA achieves a 4.93$\times$ attention speedup and reduces end-to-end Time-to-First-Token by 2.53$\times$ under a context length of 128K with negligible performance degradation.

42. 【2607.25270】Where Steering Signals Come From: Activation Source Selection in Activation Steering

链接：https://arxiv.org/abs/2607.25270

作者：Jiaran Ye,Lingxu Ran,Zijun Yao,Chenpeng Wang,Yong Jiang,Lei Hou,Juanzi Li,Liangming Pan

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：controls language models, steering controls language, Activation steering controls, inference time, secondary detail

备注：

点击查看摘要

Abstract:Activation steering controls language models by adding vectors or features to hidden states at inference time, but the upstream source of these steering signals is often treated as a secondary detail. We study this source choice as activation source selection: the combination of source context and activation readout policy used to collect the hidden states from which a steering signal is built. Holding the downstream intervention fixed, we show across three instruction-tuned models and four steering task families that changing only the source activations substantially changes steering success. We further find that effective steering is not explained simply by whether the desired behavior appears in the source text. Instead, strong signals come from execution-boundary states, where the model is about to produce or continue the target behavior. This pre-/post-realization distinction explains why answer-based sources sometimes work: their useful component aligns with execution-boundary directions rather than target appearance alone. Building on this view, we introduce tail subtraction, which removes shared prompt and continuation semantics from boundary states and yields cleaner, more stable steering signals. Overall, our results suggest that steering depends on representations of what the model is about to do, not merely on what has already appeared.

43. 【2607.25236】VisualPatchWorld: Code World Models as Latent Structured Representations for Planning

链接：https://arxiv.org/abs/2607.25236

作者：Jiaxin Bai,Jiaxuan Xiong

类目：Computation and Language (cs.CL); Robotics (cs.RO)

关键词：common aim, supports perception, research lines, share a common, evolves under action

备注：

点击查看摘要

Abstract:Different research lines use the term world model in different ways, yet they share a common aim: to capture how the world evolves under action in a form that supports perception, simulation, and planning. Two prominent realizations are neural predictors that learn dynamics in continuous vector spaces, and hand-built physics engines that expose explicit state and physical laws. Neural predictors scale from data but leave the form of the dynamics implicit; physics engines are inspectable and editable but difficult to construct at scale. We introduce VisualPatchWorld (VPW), which represents world dynamics as code. VPW first selects a qualitative dynamical form with short active probes, then fits that form's free parameters from recorded state-action traces by minimizing multi-step prediction error. The resulting programs can be rolled forward like a simulator, inspected in source form, and used inside model-predictive control; image-derived scene graphs can supply the live state at replan time. Across comparisons with prior code-based world models, VPW attains 69.0% mean planning success and exceeds the strongest code baseline by 23.5 points. The largest gains arise when choosing the correct qualitative dynamics is essential. Under the same planner, the induced models approach ground-truth engine success on navigation and grasp-rich control; a residual gap remains for contact-rich pushing, and checking a shortlist of promising plans in the engine closes most of that gap. These results establish a practical route toward automatically constructed code world models that are useful for planning. Code is available at this https URL.

44. 【2607.25228】Interpretable Column Annotation with LLM-Symbolized Decision Process Materialization

链接：https://arxiv.org/abs/2607.25228

作者：Mengqi Wang(1),Jianwei Wang(1),Qing Liu(2),Xiwei Xu(2),Zhenchang Xing(2),Michael Bain(1),Liming Zhu(2),Wenjie Zhang(1) ((1) UNSW Sydney, (2) Data61, CSIRO)

类目：Computation and Language (cs.CL)

关键词：including column type, column type annotation, column property annotation, aims to identify, identify the meanings

备注： 13 pages, 7 figures

点击查看摘要

Abstract:Column annotation (CA), including column type annotation (CTA) and column property annotation (CPA), aims to identify the meanings of table columns and the semantic relationships among them. Recent CA methods usually use various neural models to learn column representations and directly map them to label categories, thereby (1) sacrificing model interpretability and adaptivity, and (2) overlooking rich label semantics and ultimately limiting accuracy. To address these limitations, we propose SymCA, an LLM-empowered interpretable CA framework that materializes column annotation as a global-to-local symbolic decision process. SymCA consists of two components: (1) global skeleton induction, which constructs a semantic skeleton over the label space, and (2) local substrate evolution, which evolves predictive substrates within the skeleton. Specifically, to exploit label semantics while preserving an interpretable decision process, the global skeleton induction module leverages LLMs to generate candidate hypernym-inspired tree-structured semantic skeletons and employs a Minimum Bayes Risk (MBR)-based consensus strategy to select a robust skeleton against generation variance. Since different internal nodes require different evidence to distinguish among their child nodes, the local substrate evolution module materializes each internal node as an executable and evolvable predictive substrate. Over multiple evolution rounds, each substrate trains an interpretable random forest classifier with the current operator set, leverages the LLM to propose node-specific operator modifications, and uses an exploration-exploitation strategy to prioritize promising substrates. Extensive experiments demonstrate that SymCA is accurate, robust, and interpretable, outperforming the strongest baselines by an average of 6.42% in Micro-F1 and 11.03% in Macro-F1.

45. 【2607.25202】A Cross-lingual Comparison of Human and Classification Model Entrainment Behavior in Code-switched Speech Settings

链接：https://arxiv.org/abs/2607.25202

作者：Debasmita Bhattacharya,Siying Ding,Alayna Nguyen,Julia Hirschberg

类目：Computation and Language (cs.CL)

关键词：spoken code-switching, well-studied in monolingual, monolingual and written, remains underexplored, underexplored in spoken

备注：

点击查看摘要

Abstract:Conversational entrainment is well-studied in monolingual and written contexts, but remains underexplored in spoken code-switching (CSW). We present a novel cross-lingual analysis of entrainment in Mandarin-English, Hindi-English, and Spanish-English dialogue and show that, while lexical entrainment generalizes across language pairs, entrainment over acoustic-prosodic and CSW style aspects exhibits context-specific variation. We build on these findings by asking whether classification models capture these human behavioral patterns. Applying feature importance and ablation analyses, we find that classical and Transformer-based classifiers detect entrainment reasonably well but consistently prioritize features other than those most salient to human entraining behavior. Our approach introduces a human-grounded framework for evaluating model decision-making in multilingual stylistic contexts, and suggests future challenges for developing conversational agents capable of producing naturalistic code-switched speech.

46. 【2607.25186】MyoCardBench: A Real-World Data Benchmark for Evaluating Large Language Models in Clinically Authentic Cardiovascular Care Scenarios

链接：https://arxiv.org/abs/2607.25186

作者：Xiao Li,Mouxiao Bian,Zhaodi Wu,Sijie Ren,Juechen Chen,Lu Lu,Jingru Ding,Yun Zhong,Jie Xu,Yixiu Liang,Junbo Ge

类目：Computation and Language (cs.CL)

关键词：medical large language, cardiovascular care continuum, cardiovascular care, large language model, reflect the longitudinal

备注：

点击查看摘要

Abstract:Background: Most medical large language model (LLM) benchmarks focus on examination knowledge or isolated tasks and may not reflect the longitudinal, multimodal, and safety-critical workflow of cardiovascular care. Objective: To develop MyoCardBench, a real-world benchmark spanning the cardiovascular care continuum, and assess LLM performance across clinical dimensions and specialist tasks. Methods: MyoCardBench includes 2,263 items from 13 task-specific datasets derived from de-identified cardiovascular records and examination data. Sixteen cardiology physicians conducted annotation and reference construction, followed by cross-review from two senior cardiologists. Seven LLMs generated 15,841 outputs under standardized zero-shot settings. Open-ended tasks were evaluated using key-point coverage and holistic clinical quality, while CardioEthics was scored by accuracy. Results: GPT-5.4 achieved the highest macro-average (62.55) and item-weighted mean (62.19), followed by Gemini 3.1 Pro (59.95) and Qwen 3.6 27B (59.72). GPT-5.4 ranked first in all three dimensions. CardioAuxReport performed best (86.38), whereas CardioECGRead (17.25) and CardioEthics (17.34) were lowest. The largest gaps between holistic clinical quality and key-point coverage occurred in CardioComm (52.71), CardioEmergRescue (52.05), and CardioTreatPlan (48.80). Conclusions: To our knowledge, MyoCardBench is the largest real-world, multi-task benchmark for LLM evaluation across the cardiovascular care continuum and offers the broadest coverage of clinically authentic cardiology scenarios reported to date. It provides a rigorous framework for identifying model strengths, clinically important omissions, and priorities for future development.

47. 【2607.25184】A scaling law of contextual persistence in human language

链接：https://arxiv.org/abs/2607.25184

作者：Elan Barenholtz

类目：Computation and Language (cs.CL)

关键词：exhibits lawful structure, language exhibits lawful, vocabulary growth, Human language exhibits, exhibits lawful

备注： 21 pages, 5 figures (plus 1 supplementary figure); Supplementary Information included

点击查看摘要

Abstract:Human language exhibits lawful structure at the level of words (frequency, vocabulary growth) and word pairs (co-occurrence across distance). Here we show that the arrangement of words in sequence -- a central determinant of meaning -- obeys a comparable law. Using large language models as probabilistic probes, we measured the reduction in target perplexity conferred by prior context at distance d beyond that of the same words scrambled; this difference, the contextual persistence function P(d), isolates the influence of arrangement. Across ten corpora spanning six language families and written and spoken modalities, P(d) decayed approximately as 1/d ($P(d) \propto d^{-\alpha}$, mean $\alpha = 1.04$; median $r^2 = 0.96$). The effect vanished in scrambled and synthetic controls, replicated across independent probes, and did not appear in genomic or protein sequences under domain-native models. An exponent near 1 distributes contextual influence approximately uniformly across logarithmic timescales. The results establish a scaling law of contextual persistence in human language.

48. 【2607.25182】abRank: Chain-of-Thought Distillation for Table Re-Rankers

链接：https://arxiv.org/abs/2607.25182

作者：Adarsh Singh,Kushal Raj Bhandari,Jianxi Gao,Soham Dan,Vivek Gupta

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：structured information retrieval, retrieve relevant tables, ability to retrieve, retrieve relevant, key task

备注： 8 pages, 3 figures

点击查看摘要

Abstract:The ability to retrieve relevant tables for answering questions is a key task for structured information retrieval. Multi-stage retrieval systems rely heavily on rerankers to refine candidate lists produced by efficient first-stage retrievers. As a result, neural rerankers and LLM-based reranking methods have become increasingly important due to their superior capacity for semantic understanding and reasoning compared to conventional sparse or dense retrieval models. Recently, Large Reasoning Models (LRMs) equipped with explicit chain-of-thought (CoT) reasoning have shown strong improvements in ranking quality in unstructured passage retrieval. In this work, we present TabRank, a framework for training reasoning rerankers for Tabular Retrieval. We first present a comprehensive dataset of 6728 reasoning traces for tabular reranking on the Natural Questions Tables dataset. We then explore two variants of training a compact reasoning model on these reasoning traces: explicit CoT distillation and conditioning the student reranker on the teacher's reasoning trace within the prompt. We stress-test TabRank on several out-of-distribution generalization settings on diverse domains and multi-table scenarios. Our approach significantly improves performance across a variety of table retrieval datasets, increasing Acc@10 by 30.5% on HybridQA, 15.2% on SQA, 52.9% on TabFact, and 13.1% on TATQA subsets of the Multi-Table QA Benchmark compared to the base model. Notably, TabRank generalizes effectively to multi-table reasoning. Our code, data and models are available at this https URL

49. 【2607.25140】How Affect Propagates among LLM Agents: Emergent Emotional Contagion in Crowd Simulation

链接：https://arxiv.org/abs/2607.25140

作者：Funda Durupinar

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Graphics (cs.GR); Multiagent Systems (cs.MA)

关键词：multi-agent crowd simulation, paper studies, studies the behavior, affective state, current affective state

备注： 31 pages, 14 figures

点击查看摘要

Abstract:This paper studies the behavior of language models in a multi-agent crowd simulation, focusing on how affect propagates among agents that perceive and appraise one another. Each agent perceives its neighbors through visual, auditory, and tactile channels, then appraises these perceptions in light of its prompted personality profile, memory, current affective state, and situational context. Appraisal is carried out by an LLM, which updates the agent's internal affective state and selects its outward expression. The architecture contains no hand-authored mechanism for directly transferring affective state between agents; instead, inter-agent influence arises through the perception-appraisal-expression loop. The agent representation draws on the Big Five personality model and Russell's circumplex model of affect. To limit latency, low-level steering and navigation are handled by a conventional crowd simulator operating independently of the LLM-based cognitive layer. We evaluate the architecture across five scenario environments spanning alarming, joyful, and neutral situations in different spatial layouts. The results show that the system produces emotional contagion dynamics with spatial, temporal, and personality-dependent structure in sparse, small crowds. Alarm spreads from seeded agents as a traveling front, the mean alarmed fraction settles at a nonzero plateau, and the distribution of prompted personality profiles determines whether an ambiguous alarm ignites panic and whether a provocation is interpreted as anger or fear. We further evaluate the appraisal step through controlled experiments across prompt variants, sampling temperatures, and four model backends, showing that the dynamics are backend-dependent.

Comments:
31 pages, 14 figures

Subjects:

Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Graphics (cs.GR); Multiagent Systems (cs.MA)

ACMclasses:
I.6; I.6.8; I.2; I.2.7; I.2.11; J.4

Cite as:
arXiv:2607.25140 [cs.AI]

(or
arXiv:2607.25140v1 [cs.AI] for this version)

https://doi.org/10.48550/arXiv.2607.25140

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

50. 【2607.25129】Deep Label-Wise Attentive Temporal Convolutional Networks Improve Medical Coding

链接：https://arxiv.org/abs/2607.25129

作者：Muhammed Yavuz Nuzumlalı,Alexander Fabbri,Irene Li,Dragomir Radev

类目：Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Medical coding, recorded notes, assigning a set, set of diagnosis, diagnosis and procedure

备注： Work carried out in 2019; posted as a record of the work. Baselines and state of the art reflect the 2019 literature

点击查看摘要

Abstract:Medical coding is the task of assigning a set of diagnosis and procedure codes for a hospitalization using recorded notes. It requires aggregating information from different parts of the text and focus to different sections for each individual code, making it a very difficult problem even for professional human coders. We model the task as a multi-label text classification problem. To overcome the mentioned difficulties, we propose a deep neural model consisting of a multi-layer temporal convolution network (TCN) followed by label-wise attention. While multi-layer TCN helps extract a global document representation with the ability to learn relations over very long sequences, label-specific attention mechanism allows the model to focus on different aspects of the same document for each individual label. Our method achieves significantly better F-1 scores (9% increase) compared to the previous state-of-the-art model, with a remarkable increase in recall score (28% increase), which we believe is the more important metric for a clinical decision support setting.

51. 【2607.25094】Evaluating Communicative Belief Updates in Large Language Models via Implicature Recognition and Cancellation

链接：https://arxiv.org/abs/2607.25094

作者：Cesare Spinoso-Di Piano,Verna Dankers,Marius Mosbach,Jackie Chi Kit Cheung

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：large language models, language models, belief updates, unspoken beliefs, large language

备注：

点击查看摘要

Abstract:Human language is driven by unspoken beliefs and belief updates, making these critical to model for successful communication between large language models (LLMs) and their users. In this paper, we evaluate the ability of LLMs to recognize unspoken beliefs made through implicatures and to understand their updates through implicature cancellation: the pragmatic phenomenon whereby an utterance's implied meaning is weakened or negated. We create the first expert-annotated implicature cancellation dataset, [DatasetName], crowdsourced for human judgements of implicatures and their corresponding cancellations. We find that LLM belief update understanding lags behind that of humans, especially in more naturally-occurring scenarios. Additional control experiments suggest that successes in LLM belief updates may stem in part from a reliance on prior beliefs, and that failures in belief updates may depend on their type and on their form. Overall, our study suggests that current LLMs have not yet reached human-level understanding of unspoken beliefs and belief updates. Code and data are available at this https URL.

52. 【2607.25091】owards Robust Reinforcement Learning for Small-Scale Language Model Agents

链接：https://arxiv.org/abs/2607.25091

作者：Md Rezwanul Haque,Md. Milon Islam,Fakhri Karray

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Optimization and Control (math.OC); Computation (stat.CO)

关键词：Small Language Models, alignment of Small, Proximal Policy Optimization, Small Language, considered unstable

备注： Proceedings of the 2026 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Bellevue, WA, USA

点击查看摘要

Abstract:The alignment of Small Language Models (SLMs) in the 70--500M parameter range using reinforcement learning is often considered unstable, though the underlying failure mechanisms have not been systematically investigated. In the State-of-the-Art (SOTA) research, fifteen (model, corpus) configurations were trained using Proximal Policy Optimization (PPO). The experiments included Pythia-70M, 160M, 410M and SmolLM2-135M, 360M on the TinyStories, CNN/DailyMail, and Wikitext-103 corpora. Three reproducible failure modes were identified in small-scale language models: silent LoRA parameter freezing in standard PEFT/TRL pipelines, numerical overflow in importance ratios when using bfloat16, and catastrophic policy collapse due to reward-model error. These issues were addressed using a merge-and-reinitialize adapter technique, float32 precision during PPO updates, and a three-layer safety mechanism comprising reward whitening, importance-ratio guarding, and weight rollback. In this paper, a capacity-headroom hypothesis is proposed, which states that PPO performance at the SLM scale depends on both a fluent supervised model ($\text{PPL}20$) and a discriminative reward signal, rather than on the number of model parameters. The proposed system converged stably in all experiments and improved preference win rate over the SFT baseline in configurations with a fluent prior and an informative reward signal. Furthermore, it outperformed instruction-tuned baselines while requiring significantly less training data. All checkpoints, preference datasets, and training scripts are publicly released$^§$.

53. 【2607.25069】DS@GT ARC at CheckThat! 2026: LLM-Based Trace Ranking and Grouped Reward Modeling for Multilingual Numerical Claim Verification

链接：https://arxiv.org/abs/2607.25069

作者：Sagnik Sinha,Shreyas Shrestha

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：Automated verification, understanding and quantitative, Automated, Arabic, language understanding

备注： 10 pages, 2 figures. Accepted at CLEF 2026 CheckThat!. To appear in CEUR Workshop Proceedings

点击查看摘要

Abstract:Automated verification of numerical claims is a challenging problem, as it requires both language understanding and quantitative reasoning. This paper describes our system for CLEF 2026 CheckThat! Task 2, which focuses on ranking reasoning traces generated by large language models (LLMs) and predicting a final verdict for numerical claims in English and Arabic. We explore two approaches. The first approach fine-tunes an LLM-based verifier using LoRA to score each reasoning trace independently as a binary classification problem, and selects the final verdict using Best-of-N selection. We further experiment with adaptive sub-claim decomposition to break complex claims into simpler parts before verification. The second approach uses a lightweight TF-IDF reward model with handcrafted numeric and temporal overlap features to score traces, and aggregates scores by verdict group to determine the final prediction. For Arabic, we compare a general multilingual model against AraBERT, a language-specific model pretrained on Arabic text. Our results show that the LLM-based approach outperforms the lightweight reward model on most metrics, particularly Recall@5, while the reward-based approach shows stronger performance on the Conflicting class. Sub-claim decomposition did not improve performance, suggesting that claim splitting introduces noise rather than aiding reasoning. For Arabic, AraBERT outperforms the multilingual baseline across most metrics.

54. 【2607.25066】Addressable Recall Compaction for Long Context-Window Control in AI Agents

链接：https://arxiv.org/abs/2607.25066

作者：Thang Dang,Yuma Ichikawa,Sakina Fatima,Koichi Shirahata

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Long-horizon LLM agents, Long-horizon LLM, accumulate reasoning traces, LLM agents accumulate, agents accumulate reasoning

备注： 20 pages, 2 figures

点击查看摘要

Abstract:Long-horizon LLM agents accumulate reasoning traces, actions, and tool observations that can eventually exceed a model's fixed context window. Existing compaction methods address this limitation by discarding, summarizing, or retrieving earlier information, but they may remove task-critical details or fail to recover them reliably. We propose ARC (Addressable Recall Compaction), a context-management framework that separates archival storage from active-context presentation. ARC stores tool observations in an append-only, ID-addressable log and replaces older observations with compact citations when compaction is required. The agent can subsequently use these identifiers to request stored content without re-executing the corresponding tools or depending solely on similarity-based retrieval. We evaluate ARC using Qwen3-8B with a 16k context window and Qwen3-32B with a 32k context window. On the Needle-in-a-Haystack evaluation, ARC achieves an average exact-answer accuracy of 99.40%, compared with 88.12% for the best-performing baseline in our evaluation. ARC also reduces estimated serving time and HBM traffic under our hardware-cost model. On the LongBench-v2 Hard subset, ARC obtains an average accuracy of 29.97%, compared with 28.25% for the best-performing baseline. These results indicate that explicit, address-based recall can improve information retention and serving efficiency relative to the evaluated context-management baselines under the tested settings.

55. 【2607.24999】CogArena: A Multimethod Evaluation of Cognitive Ability Structure in Large Language Models

链接：https://arxiv.org/abs/2607.24999

作者：Dengzhe Hou,Lingyu Jiang,Fangzhou Lin,Kazunori D Yamada

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

关键词：LLM cognitive scores, converge across tasks, respond selectively, increasingly summarized, summarized as per-ability

备注： 21 pages, 8 figures. Code and the procedurally generated battery: [this https URL](https://github.com/dengzhe-hou/CogArena)

点击查看摘要

Abstract:LLM cognitive scores are increasingly summarized as per-ability profiles whose dimensions should converge across tasks, respond selectively to matched interventions, and generalize beyond the models used to define them. We introduce CogArena, a procedurally generated 13-paradigm benchmark built around a multimethod framework for determining when cognitive-task scores warrant dimensional labels across five theory-motivated groupings. Across 55 open-weight models, nearly all paradigm correlations are positive and a common axis explains about half the variance. The within-grouping advantage is small, scoring-sensitive, and uncertain across model families. In a separately frozen, fully crossed study across 12 models from six families, targeted scaffolds show a small matched-grouping advantage, but no scaffold-specific contrast survives multiplicity correction and selectivity does not improve held-out-family prediction. The frozen confirmation criterion fails. A post-hoc alternate-wording replication produces a smaller positive estimate and again fails. Together, these results support a boundary conclusion. Theory-aligned prompting produces a small in-battery diagonal tendency, but the present evidence does not establish stable five-dimensional profiles. CogArena provides a workflow joining behavioral signatures, covariance, matched interventions, and out-of-family prediction before cognitive labels are attached to model scores.

56. 【2607.24904】Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model

链接：https://arxiv.org/abs/2607.24904

作者：Senqiao Yang,Kaichen Zhang,Zhaoyang Jia,Jinghao Guo,Yifei Shen,Xinjie Zhang,Xiaoyi Zhang,Haoqing Wang,Xiao Li,Peng Zhang,Xiang An,Yin Xie,Zhening Liu,Xun Guo,Jiahao Li,Shicheng Zheng,Jinglu Wang,Zongyu Guo,Wenxuan Xie,Zihan Zheng,Yuxuan Luo,Bin Li,Yan Lu

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Standard vision-language models, suffer from Moravec, Moravec paradox, Standard vision-language, complex offline visual

备注： Project page: [this https URL](https://microsoft.github.io/Mage)

点击查看摘要

Abstract:Standard vision-language models (VLMs) suffer from Moravec's paradox: they excel at complex offline visual reasoning but struggle with simple streaming perception tasks and process them inefficiently. We present Mage-VL, an efficient codec-native streaming foundation model for real-time multimodal understanding and interaction. At its core, our custom tokenizer, Mage-ViT, replaces uniform frame sampling by selectively encoding dynamic, entropy-rich regions using motion vectors and residual energy across sparse anchor (I) and predicted (P) frames. Operating at a 16 x 16 patch level, this reduces visual token consumption by over 75% while preserving spatiotemporal context. Trained from scratch on approximately 560M unlabeled images and 100M unlabeled video frames, Mage-ViT matches or outperforms flagship encoders trained on billions of image-text pairs. We establish AI4AI data pipelines encompassing prompt-code joint optimization for multimodal captioning and AI-driven performance diagnosis to guide training recipes. Furthermore, through a bio-inspired dual-system architecture - a lightweight System 1 event gate and a causal System 2 decoder - Mage-VL enables proactive streaming perception. Extensive evaluations show that Mage-VL-4B matches Qwen3-VL-4B on static tasks while achieving strong gains in video understanding and 2D/3D spatial reasoning, with up to a 3.5x wall-clock inference speedup, and comprehensively surpasses the 15B Phi-4-reasoning-vision baseline. Beyond model artifacts, we deliver seven key empirical findings covering pre-training data efficiency, variable-resolution scaling, codec system acceleration, VideoQA SFT redundancy, motion-spatial synergy, AI4AI data pipelines, and Zero-Vision SFT for multimodal RL.

57. 【2607.24884】Beyond "What to Retrieve": Uncertainty in Retrieval-Augmented Code Generation

链接：https://arxiv.org/abs/2607.24884

作者：Chandan Kumar Sah,Xiaoli Lian,Li Zhang

类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：code generation relies, inherently uncertain, completeness are inherently, Repository-level code generation, repository context

备注： 9 pages, 4 figures. Source code and supporting materials are available at [this https URL](https://github.com/Rocky5502/OpenCoder_V1)

点击查看摘要

Abstract:Repository-level code generation relies on heterogeneous evidence whose relevance, compatibility, and completeness are inherently uncertain. Similar-code examples, repository context, and project-specific APIs may provide complementary information, but can also introduce noisy, redundant, or conflicting signals. Existing retrieval-augmented approaches primarily optimize retrieval relevance without explicitly modeling how uncertainty in retrieved evidence affects downstream generation. We introduce OpenCoder, an uncertainty-aware framework that estimates source-specific uncertainty, uses it to filter and rank heterogeneous evidence, and guides generation, verification, and repair. A factorial analysis over API knowledge, repository context, and similar-code evidence reveals no universal additive source ranking; instead, significant cross-source interactions depend on the accompanying evidence and LLM backend. On an expanded 32-task RepoExec-inline evaluation, OpenCoder improves GPT selected-output correctness over Baseline RAG from 56.25\% to 78.13\%. However, it matches a verification-and-repair control, and the corresponding Gemini improvement is not statistically supported, indicating backend-dependent benefits. Target-aware API refinement also substantially improves API-set retrieval. These findings support treating uncertainty as an actionable control signal for repository-level retrieval, verification, and repair.

58. 【2607.24882】Agent Retrieval Bench: Evaluating Repository Context Retrieval for Coding Agents

链接：https://arxiv.org/abs/2607.24882

作者：Bowen Qin,Yi Xie

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Modern coding agents, earlier context-acquisition stage, patch generation depends, Modern coding, Agent Retrieval Bench

备注：

点击查看摘要

Abstract:Modern coding agents are usually evaluated by whether they eventually produce a correct patch, but patch generation depends on an earlier context-acquisition stage: finding the repository files needed for the task. We introduce Agent Retrieval Bench, a file-level benchmark for this upstream retrieval problem. Samples are built from real coding-workflow signals and evaluated against frozen base-commit repositories, with relevance defined by what an agent needs next rather than direct query-file semantic similarity. The benchmark covers four positive-retrieval tasks: code2test, comment2context, trace2code, and edit2ripple; a fifth subset evaluates selective retrieval using natural evidence-backed no-gold cases and counterfactual wrong-repository controls. Agent Retrieval Bench contains 427 samples across 25 repositories: 345 positive examples, 50 natural no-gold examples, and 32 counterfactual controls. The corpus includes 308 base-commit snapshots, 392,000 files, and 7.9 million chunks. We evaluate lexical retrieval, RepoMap, open-source embeddings, selective abstention, and logged agent context selection. No single retrieval family dominates: Qwen3-Embedding-4B has the best sample-weighted MRR on positive samples, Qwen3-Embedding-8B the best Recall@20, and RepoMap the best budgeted context yield at 8K tokens, with task-level winners differing substantially. Selective thresholds calibrated with counterfactual controls do not improve selective success on natural no-gold cases, revealing a calibration gap. Logged trajectories also miss every gold file on 27-35 percent of samples. A controlled seed-intervention pilot finds that retrieval-derived initial context yields higher file F1 with less post-seed exploration than random non-gold context, while oracle gold context shows substantial remaining headroom.

59. 【2607.24869】Ranked by Position: Order Sensitivity as an Exploitable Attack Surface in LLM Listwise Recommenders

链接：https://arxiv.org/abs/2607.24869

作者：Ge Zhang,Jingru Cheng,Huiyuan Chen

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Large language models, recommendation systems suffer, Large language, serializing candidate sets, sets into prompts

备注： 13 pages, 6 figures, 11 tables. Code and data available at [this https URL](https://github.com/geoz-lab/position_bias_attack)

点击查看摘要

Abstract:Large language models (LLMs) used as listwise rerankers in recommendation systems suffer from position bias when serializing candidate sets into prompts. We show this order sensitivity creates an exploitable attack surface: an attacker can promote a label-0 target into the top-$k$ solely by reordering candidates, without changing item content, labels, or model parameters. We introduce $\mathrm{promo}@k$ to quantify this vulnerability, measuring the fraction of label-0 targets that can be elevated into top-$k$ rankings via permutation. Evaluating across three domains (MovieLens, Amazon Books, and Amazon Fashion), $\mathrm{promo}@5$ reaches up to 0.57 at an attack budget of $R$ = 50 orderings. Furthermore, ordinary permutation stability predicts vulnerability without running the attack. While a bidirectional T5 encoder scorer reduces exposure, permutation-consistency regularization and architectural invariance effectively mitigate it. Pointwise scoring avoids the bias issue but degrades ranking quality. These results demonstrate that input candidate order in listwise LLM reranking is a security-relevant attack vector. Code and data are available at this https URL.

60. 【2607.24868】Research Report on Noise-Shaped One-Bit Coefficients in Discrete Polynomial Fourier Extension

链接：https://arxiv.org/abs/2607.24868

作者：Shengquan Wang

类目：Computation and Language (cs.CL)

关键词：discrete polynomial Fourier, report studies noise-shaped, studies noise-shaped one-bit, noise-shaped one-bit coefficients, report studies

备注：

点击查看摘要

Abstract:This report studies noise-shaped one-bit coefficients in normalized discrete polynomial Fourier extension. For first-order Sigma-Delta quantization, the error is written as $e_k=u_k-q_k=\Delta v_k$ with a uniformly bounded state. Discrete summation by parts then yields variation estimates for complex weights and an $O(N^{-1})$ approximation rate on compact parameter sets. For the parabolic phase $\phi_{x,t}(\xi)=x\xi+t\xi^2$, the bound is expressed through $J(x,t)=\int_0^1 |x+2t\xi|d\xi$, and the uniform $N^{-1}$ rate is shown to be sharp over the admissible input class. Higher-order finite-record identities are derived with all endpoint traces retained. Under endpoint compatibility, or after explicit boundary correction, an $r$th-order noise-shaped error $e=\Delta^r v$ gives $O(N^{-r})$ decay for sufficiently smooth weights and $O(N^{-(r-1+\alpha)})$ decay for $C^{r-1,\alpha}$ weights. Exact $L^2$ orthogonality identities, fourth-moment formulas, local kernel estimates, and oscillatory transfer bounds are also established. Extensions to polynomial phases, multidimensional parameter families, growing observation regions, and correlated state models are included.

61. 【2607.24846】wo Views, One Voice: Evidence-Grounded Conversational Music Recommendation

链接：https://arxiv.org/abs/2607.24846

作者：Sungwook Yoo,Sewook Yoo

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Traditional conversational recommenders, single text interface, conversational recommenders entangle, Traditional conversational, dialogue intent evolves

备注： 5 pages, 4 figures, 5 tables. 4th-place solution (team swyoo) in the Blind-B industry track of the ACM RecSys Challenge 2026

点击查看摘要

Abstract:Traditional conversational recommenders entangle retrieval and response generation within a single text interface, so exact entity cues fade as the dialogue's intent evolves, which compromises explanation credibility. We address this within the ACM RecSys Challenge 2026, which mandates both top-20 ranking and evidence-grounded response generation. This paper presents the third-place solution by team "swyoo" for the Blind-B industry track. We decouple retrieval and response into separate pipelines connected strictly via ranked tracks and metadata. Retrieval combines a hybrid lexical-dense pool for exact matching with a task-adapted pool driven by fine-tuned Qwen 8B adapters. Candidates are calibrated via LightGBM, then routed to an evidence-grounded propose-assign-select (PAS) framework to structure responses. This system also ranked second on the explanation-quality leaderboard in the final blind evaluation. Our findings demonstrate that: (i) isolating retrieval and response preserves both catalog cues and fluid intent; (ii) structuring generation via explicit evidence assignment is key to this near-best-in-class explanation reliability.

62. 【2607.24841】Neuromorphic Diffusion Language Models: Addressing Compute and Memory Bottlenecks via Sparsity and Block Denoising

链接：https://arxiv.org/abs/2607.24841

作者：Dengyu Wu,Clement Ruah,Jiechen Chen,Bipin Rajendran,Osvaldo Simeone

类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Signal Processing (eess.SP)

关键词：low operational intensity, high energy consumption, token requires accessing, large language models, generated token requires

备注： Accepted for presentation at 2026 IEEE Workshop on Signal Processing Systems (SiPS)

点击查看摘要

Abstract:Autoregressive (AR) large language models (LLMs) are inherently inefficient at inference time because each generated token requires accessing the full set of model parameters, leading to low operational intensity and high energy consumption. Masked diffusion language models (MDLMs) partially address this limitation for memory-bound settings by allowing multiple tokens to be generated per parameter access. In order to further enhance inference efficiency on modern platforms with extensive in-chip memory, this work proposes neuromorphic MDLMs (N-MDLMs), which integrate block diffusion with spike-based neuromorphic computation to jointly improve throughput and energy efficiency. While block diffusion increases token throughput by producing multiple tokens per parameter access, spike-induced sparsity reduces effective parameter traffic and computations by skipping inactive channels. To analyze the synergistic effect of sparsity and diffusion, we develop a token-level roofline-inspired model that captures the combined impact of block-parallel generation and spike sparsity on decoding efficiency. Experimental results on translation tasks show that, thanks to spike-induced sparsity, N-MDLMs achieve substantial improvements in energy efficiency and throughput even in compute-bound platforms for which MDLMs would fail to improve over AR-LLMs.

63. 【2607.24817】Retrieval-Augmented Generation in LLMs for Mental Health: Quantifying the Incremental Contribution of Retrieval Within a Layered Safety Architecture

链接：https://arxiv.org/abs/2607.24817

作者：Anand Gupta,Akshat Surolia,Shubham Mishra,Shakil Imtiaz,Chaitali Sinha

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：accurately detect users', detect users' intent, offer scalable support, Retrieval Augmented Generation, Digital mental health

备注： 11 pages, 6 figures

点击查看摘要

Abstract:Digital mental health interventions (DMHIs) offer scalable support, but ensuring they accurately detect users' intent during volatile situations can be challenging. Pure parametric Large Language models (LLMs) do not contain specific safety critical architecture, and can miss critical cues, or hallucinate, undermining reliability. Retrieval Augmented Generation (RAG), which supplements an LLM with retrieved context, could enhance intent detection during volatile situations. Commercially available DMHIs typically combine multiple independent safety layers like rule-based filters, symbolic escalation protocols, and neural classification. The incremental contribution of any single layer, however, remains unquantified. This paper evaluates six LLM models within a DMHI called Wysa, via a controlled comparison of RAG-enabled versus RAG-disabled modes. Anonymized real and synthetic user-chatbot exchanges were annotated by a qualified clinical team against multi-class intent categories (e.g. self-harm, abuse, panic). The study computed classification accuracy, recall, precision and F1 scores against ground truth labels and tested differences for statistical significance. Performance was also examined by risk category and inter-model agreement. While RAG caused a rise in false alarms, the trade-off is consistent with safety-critical design principles that prioritize sensitivity, where flagged cases are routed to additional review rather than acted on directly. Overall, these findings support RAG as a promising approach to improve the accuracy, consistency and safety of LLM-driven DMHIs. Keywords: Digital Mental Health Intervention, Large Language Model, Retrieval Augmented Generation, Accuracy, Recall, Precision

Comments:
11 pages, 6 figures

Subjects:

Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

Cite as:
arXiv:2607.24817 [cs.IR]

(or
arXiv:2607.24817v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.24817

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

64. 【2607.24803】SciClaimSeekers at CheckThat! 2026: Retrieving Scientific Sources for Social Media Claims with LLM Reranking

链接：https://arxiv.org/abs/2607.24803

作者：Mohotarema Rashid,Nansu Baniya,Anirban Saha Anik,Xiaoying Song,Lingzi Hong

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：original scholarly sources, social media faster, posts rarely link, Reciprocal Rank Fusion, Scientific claims

备注： CLEF 2026 Working Notes / CheckThat! Lab at CLEF 2026, Jena, Germany

点击查看摘要

Abstract:Scientific claims often spread on social media faster than they can be verified, while posts rarely link to the original scholarly sources. To tackle this problem this paper presents system called SciClaimSeekers, a retrieval and reranking framework by combining BM25 and zero-shot multilingual E5 retrieval with Reciprocal Rank Fusion (k=60), followed by Qwen2.5-14B-Instruct pointwise reranking. The pipeline reaches 64.36% MRR@5 on the English development set a 13.67-point jump over BM25 and 10.17 points over the unranked hybrid and 64.39% on the official test set, in the CLEF-2026 CheckThat! Task 1 evaluation. Our experiment suggests that large pre-trained models, when combined into a careful pipeline, can be competitive with fine-tuned approaches on this task.

65. 【2607.24802】SourceMinds at CheckThat! 2026: NLI-Grounded Citation Auditing in a Multi-Agent Pipeline for Full Fact-Checking Article Generation

链接：https://arxiv.org/abs/2607.24802

作者：Farhan Sharukh Hasan,Anirban Saha Anik,Eric Liu,Xiaoying Song,Mohotarema Rashid,Lingzi Hong

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：paper presents, Task, CLEF, system for Task, article generation

备注： CLEF 2026 Working Notes / CheckThat! Lab at CLEF 2026, Jena, Germany

点击查看摘要

Abstract:This paper presents our system for Task 3 of the CLEF 2026 CheckThat! Lab, which focuses on generating full fact-checking articles from claims, veracity labels, and evidence documents. We propose a multi-agent pipeline that combines evidence retrieval, structured fact planning, article generation, gated self-critique, and NLI-based citation auditing. The system retrieves claim-relevant evidence using dense retrieval, reranking, and source-balanced selection, then generates a citation-supported article from a structured plan. A gated self-critique stage revises weakly grounded drafts, while the NLI citation auditor repairs missing citations and removes unsupported or redundant ones. The approach highlights the importance of combining evidence selection, structured generation, and post-generation citation validation for source-grounded fact-checking article generation.

66. 【2607.24801】Influence of Prompt Engineering on Small Language Models for Guarded Query Routing

链接：https://arxiv.org/abs/2607.24801

作者：Richard Šléher,William Brach,Kristián Košťál,Lukas Galke Poech

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：Small Language Models, open-weight Small Language, system scope, meets a router, determines the ideal

备注：

点击查看摘要

Abstract:We study the problem of guarded query routing, where we assume that a user query first meets a router that either determines the ideal endpoint for in-distribution queries or rejects out-of-distribution queries that are potentially unsafe or out of the system's scope. We investigate whether compact open-weight Small Language Models (SLMs) can jointly handle both tasks under latency constraints. We evaluate 22 models on GQR-Bench and score them with the harmonic mean of in-distribution and out-of-distribution accuracy. We find that mid-scale SLMs come close to frontier model routing quality at much lower latency. Still, many compact models fail because they do not reliably follow the required output format. However, our results show that prompt optimization techniques enable SLMs to handle such cases gracefully, without changing the models' weights. Moreover, few-shot prompt optimization raises Mistral 7B from 81.79 to 90.87 GQR-Score and lifts Qwen3.5 9B to 95.74, the best optimized score in our study and within 0.3 points of the strongest unoptimized larger model: Gemma 3 27B at 96.01. The bare DSPy signature, without in-context exemplars, is the most effective strategy for Granite 4 Tiny, raising its score from 54.29 to 83.05. These results show that prompt optimization is a useful first step for guarded query routing, while weaker models may still need weight-level adaptation or schema-aware training

67. 【2607.24800】When Thinking Before Retrieval Hurts: TraceBound Diagnostics for Adaptive Knowledge-Graph Retrieval

链接：https://arxiv.org/abs/2607.24800

作者：Partha Sarathi Purkayastha(ETH Zürich)

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Adaptive retrieval promises, make knowledge-graph question, knowledge-graph question answering, inspect neighborhoods, evidence is sufficient

备注： 11 pages, 4 figures, 15 tables. Accepted at the Failure Modes in Agentic AI (FAGEN) Workshop at ICML 2026

点击查看摘要

Abstract:Adaptive retrieval promises to make knowledge-graph question answering more robust by letting a controller search, inspect neighborhoods, revise actions, and stop when evidence is sufficient. We study this premise by introducing TraceBound, a lightweight profile- and trace-conditioned diagnostic protocol for an ARK-style retriever on text-rich knowledge graphs. TraceBound exposes a compact query profile before retrieval, issues short trace hints after observable failure symptoms, and logs trajectory counters, while keeping graph data, tools, gold labels, and ranking metrics fixed. Across STaRK validation and held-out subsets, the added conditioning improves inspectability but consistently reduces retrieval quality under open-weight controllers. Paired trajectory analysis localizes the degradation to repeated calls, zero-result calls, and misallocated exploration budget, while stricter interaction budgets shorten trajectories without repairing the policy. The result diagnoses the common failure mode in that "thinking before retrieval'' must be evaluated as a control problem over action selection, not as a prompt-format change.

68. 【2607.24793】Retrieval, not hallucinations, will be the limiting factor for LLM-based clinical AI tools

链接：https://arxiv.org/abs/2607.24793

作者：Kirk Roberts,Steven Bedrick,Kurt Miller,William R. Hersh,Hongfang Liu

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：large language model, clinical artificial intelligence, language model, artificial intelligence, generally center

备注： Perspective piece

点击查看摘要

Abstract:Discussions around large language model (LLM) errors in clinical artificial intelligence (AI) generally center around precision errors like hallucinations. This perspective, targeting both clinicians and AI researchers, seeks to shift that discussion to recall errors, particularly in retrieval of patient-level data needed for many clinical AI tools. The perspective outlines types of errors and mitigation strategies, describes research directions in LLMs and retrieval, and provides an overview of retrieval evaluation.

69. 【2607.24791】From Naive RAG to Deep Agentic Retrieval: An Evolving Context Engineering Pipeline for Regulatory Compliance

链接：https://arxiv.org/abs/2607.24791

作者：Mishca de Costa,Muhammad Saleh Anwar,Dave Mercier,Issam Hammad

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：implementations encounter hard, encounter hard limits, Ontario Power Generation, Ontario Energy Board, Retrieval-augmented generation

备注： Accepted at the 2026 IEEE the 14th International Conference on Smart Energy Grid Engineering (SEGE 2026)

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) is the dominant paradigm for applying large language models (LLMs) to enterprise document corpora, yet naive implementations encounter hard limits as corpus scale and query complexity grow. This paper traces the evolution of a production retrieval pipeline at Ontario Power Generation (OPG) for regulatory compliance and rate case analysis under Ontario Energy Board (OEB) reporting requirements. We examine successive stages: naive RAG, hybrid retrieval with re-ranking, agentic function-calling retrieval, and a deep multi-agent architecture with code-based tool synthesis and explicit planning, and identify the failure modes and tradeoffs that motivated each transition. We formalize the mature architecture as Progressive Evidence Acquisition with Cost-Aware Escalation (PEA-CAE): begin with low-cost, high-precision retrieval and escalate to full-document reads only when the expected evidence gain justifies latency and cost. Our findings show that context engineering is a more tractable and economically viable path than domain-specific fine-tuning for large, evolving regulatory corpora. More broadly, the progression toward deep agentic retrieval mirrors classical information retrieval ideas, introducing adaptive query reformulation, progressive document discovery, and hierarchical subagent summarization as practical system primitives. Operational traces further support the search-based nature of modern retrieval systems, where iterative evidence acquisition and adaptive planning increasingly replace single-pass retrieval as the foundation for enterprise-scale question answering.

70. 【2607.24788】GLIDE: Guided Layerwise Hybrid Attention for Efficient LLM Inference

链接：https://arxiv.org/abs/2607.24788

作者：Vimal William,Ravi Tandon,Jyotikrishna Dass

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Large Language Models, Large Language, Language Models scale, increasingly long contexts, primary throughput bottleneck

备注：

点击查看摘要

Abstract:As Large Language Models scale to increasingly long contexts, the memory I/O and computational overhead of the Key-Value (KV) cache during decoding emerges as the primary throughput bottleneck. To address this, we propose GLIDE, a Guided Layerwise Hybrid Attention that strategically integrates sliding-window softmax attention with linear recurrent aggregation. GLIDE is motivated by layer-wise heterogeneity: early layers exhibit high sensitivity to softmax removal, while deeper layers demonstrate redundancy and tolerate aggressive replacement by linear alternatives. Leveraging this insight, GLIDE introduces a layer-wise adaptive mechanism wherein each layer balances an efficient linear recurrence with a variable-sized softmax window. Unlike uniform hybrid approaches, GLIDE non-uniformly compresses the softmax footprint across the model, reducing aggregate KV cache I/O while preserving expressive power where most vital. Empirical evaluations demonstrate the GLIDE achieves superior performance-efficiency tradeoffs, reducing end-to-end latency for long-context generation without compromising quality.

71. 【2607.24784】On the Use of LLMs for Specialised Terminology: A Good Alternative to Corpora?

链接：https://arxiv.org/abs/2607.24784

作者：Joachim Minder(ALTAE (URP 3967)),Guillaume Wisniewski(LLF - UMR7110),Natalie Kübler(ALTAE (URP 3967))

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Specialised translation relies, Claude Sonnet, Natural Language Processing, Specialised, specialised translators

备注：

点击查看摘要

Abstract:Specialised translation relies on the use of documentary and terminological resources, including corpora. These resources are particularly useful for terminology. However, their compilation and exploitation have several limitations: they require time, technical skills and access to data that can be difficult to collect. This study examines the extent to which LLMs can assist specialised translators in finding equivalents from English to French. We evaluate four proprietary models, GPT-4o, GPT-5.2, Claude Sonnet 4.5 and DeepSeek, in two specialised domains, Earth, Environmental and Planetary Sciences (EEPS) and Natural Language Processing (NLP). The experiment is based on 80 terms per domain and compares two prompting strategies: a terminology and a translation mode. The results highlight clear differences between models, prompting strategies and, to a lesser extent, domains. Claude Sonnet 4.5 achieves the best results in the most favourable configuration, while DeepSeek stands out for its greater stability. Analysis of confidence estimates also shows that they are only a partial indicator of terminological accuracy. Overall, the findings suggest that LLMs can be useful tools for specialised translators, but cannot, at this stage, replace specialised corpora. This research therefore paves the way for future work on the real practical usefulness of LLMs for specialised translators in work and educational contexts.

72. 【2607.24772】RSMeM: Knowledge-Enhanced Memory Evolution for Remote Sensing Agents with Systematic Evaluation

链接：https://arxiv.org/abs/2607.24772

作者：Bingxian Wu,Yu Zhang,Zonghao Guo,Tang Liu,Chen Qian,Yuxiang Lu,Xingbo Du,Yanghao Li,Yidan Zhang,Chi Chen,Ling Yao,Maosong Sun

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Geoscience research requires, research requires complex, requires complex analysis, Geoscience research, remote sensing

备注： Accepted to ACL 2026 Main. Code: [this https URL](https://github.com/AI9Stars/RSMeM)

点击查看摘要

Abstract:Geoscience research requires complex analysis and domain expertise, with remote sensing (RS) observations as a key foundation. However, existing RS agents built on general-purpose LLMs remain largely domain-agnostic, resulting in brittle and error-prone workflows. Moreover, these failures are seldom consolidated into a reusable experience for subsequent analyses. To address this issue, we introduce RSMeM, a knowledge-enhanced memory evolution mechanism that bootstraps RS agents with pre-distilled domain knowledge and iteratively integrates online experience for robust multi-step tool execution. RSMeM is composed of two components: (i) Hierarchical Knowledge Grounding, which performs taxonomy-aware retrieval over a hierarchical domain corpus to guide planning and tool selection; and (ii) Failure-Aware Experience Refinement, which distills failure-annotated tool-use traces into reusable constraints for next-round tool execution. By iteratively employing these two processes, RS agents can evolve to absorb task-level domain knowledge and effectively translate it into instance-level execution experience. Extensive experiments on EarthBench demonstrate that RSMeM consistently improves tool-use performance and end-to-end answer across a diverse set of LLM backbones. Notably, RSMeM achieves a 6% accuracy improvement on DeepSeek-V3.2 with less than 1% additional experience tokens, demonstrating the strong knowledge density of our distilled experience. Our code is available at this https URL

73. 【2607.24769】LLM Scheming Inversely Scales with Pretraining Language Coverage

链接：https://arxiv.org/abs/2607.24769

作者：Nathan Truong,Aryan Panda,Rayming Ye,Zoe Sun,Maheep Chaudhary

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：high-risk deployment settings, deployment settings, growing capabilities, increasingly critical, critical in high-risk

备注：

点击查看摘要

Abstract:With the growing capabilities of frontier models, AI alignment becomes increasingly critical in high-risk deployment settings. While recent work has empirically demonstrated in-context scheming -- the covert pursuit of misaligned objectives while feigning alignment -- in frontier language models, most work has been performed exclusively in English, leaving a major gap in multilingual safety. We apply Petri, an open-source automated auditing framework, to Qwen3-30B-A3B to evaluate deceptive and scheming behaviors across multiple languages. Our findings suggest that scheming scores are inversely correlated with the estimated pretraining language coverage, with low-resource languages averaging 34.2\% higher scores compared to high-resource languages on a five-category scheming index. Furthermore, we find that the effect of estimated pretraining language coverage is not uniform across scheming behaviors.

74. 【2607.24768】PATHFinder Agent for Tailored Prenatal Care

链接：https://arxiv.org/abs/2607.24768

作者：Vaibhav Balloli,Carissa Samuel,Samia Abdelnabi,Alex Peahl,Elizabeth Bondi-Kelly

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY); Emerging Technologies (cs.ET)

关键词：important preventive service, preventive service designed, Tailored Healthcare, tailored prenatal care, Prenatal care

备注： Accepted as demo at ACM Interactive Health 2026. [this https URL](https://realize-lab.github.io/PATHFinder/)

点击查看摘要

Abstract:Prenatal care is an important preventive service designed to improve outcomes for pregnant individuals. The American College of Obstetricians and Gynecologists (ACOG) recently introduced guidelines advocating tailored prenatal care, called PATH (Plan for Tailored Healthcare). We present PATHFinder Agent(Planner for Appropriate Tailored Healthcare), an end-to-end conversational agentic system that gathers patient health and social context through structured dialogue, curates individualized prenatal care plans aligned with PATH guidelines, and surfaces community resources from Michigan 211. The system features a four-stage workflow spanning patient intake, dynamic interaction, plan synthesis, and clinician oversight. We evaluate frontier large language models (LLMs) on expert-curated rubrics across five clinical dimensions, finding that GPT-5.2 achieves the highest average score (77.6\%) while identifying key gaps in antenatal testing recommendations. We discuss future validation through human participant studies and randomized controlled trials.

75. 【2607.24767】he Effect of Text Chunk Size on Retrieval-Augmented Generation Performance

链接：https://arxiv.org/abs/2607.24767

作者：German Garrido-Lestache Belinchon,Hugo Garrido-Lestache Belinchon

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：allowing large language, large language models, retrieve relevant information, Generation, generation quality

备注：

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) systems have emerged as a powerful process for allowing large language models (LLMs) to retrieve relevant information to use as source material during text generation. A critical yet under-explored component of these systems is the granularity at which source documents are segmented into retrievable chunks. The size of these chunks has the potential to significantly influence generation quality, contextual correctness, retrieval precision, and computational efficiency. Despite its importance, chunk size is often selected without proper evaluation of its impact on generation quality. Smaller chunks, such as individual sentences, may allow for precise retrieval by narrowing the focus of each chunk. However, they contain less information, which may limit the model's ability to generate coherent responses. Larger chunks, such as entire chapters, contain lots of broad information that may improve correctness, but also introduce additional noise and increase computational cost. Because larger chunks contain more information, the number of chunks returned to the model must also be considered. This paper evaluates how chunk size, along with the number of retrieved segments, influences generation quality and retrieval effectiveness. By comparing these configurations, this study seeks to better understand how document segmentation affects the performance and efficiency of Retrieval-Augmented Generation systems. segmentation affects the performance and efficiency of Retrieval-Augmented Generation systems.

76. 【2607.24765】Measuring and Improving Behavioral Consistency in Large Language Models through Fact-Heuristic-Emotion State Enforcement

链接：https://arxiv.org/abs/2607.24765

作者：Gi-Hun Lee,Joong Yull Park

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

关键词：prior answer returns, toggle, Large language models, Cognitive Kernel Model, prior answer

备注： 40 pages, 6 figures; 54-page supplementary material included as an ancillary file. Code, prompts, and data: [this https URL](https://github.com/TeenyToolSoftware/cogos-behavioral-consistency)

点击查看摘要

Abstract:Large language models (LLMs) can give different answers to the same decision problem across runs, and reverse a decision when their own prior answer returns as context. We ask whether this instability can be measured and partially reduced without changing model weights. We test the Cognitive Kernel Model (CKM), a prompt-level state-enforcement layer. Before deciding, the model must separate its input into three epistemic roles: Fact (given or verifiable), Heuristic (inferred or assumed), and Emotion (evaluative or priority signal). CKM adds no capability; it forces the model to track what kind of information it uses before acting. Formally it maintains a structured state S_t = {F_t, H_t, E_t} updated by a transition function. We evaluate CKM on Korean-language decision scenarios (ambiguity, ethical conflict, resource allocation, error handling) across 26 LLMs from four vendors and 37,403 observations, via four core experiments, a 4-arm ablation, a 5-arm sham-restriction ablation, and a temperature probe. Findings: (1) CKM reduces repeated-output variability (random-effects Hedges' g=1.09, 95% CI [0.83, 1.35], 31 model pairs); (2) state persistence cuts the decision-flip rate by 82% in newer models (g=1.52); (3) the effect is not JSON formatting alone (value-only recomputation, g=2.24); (4) intrinsic randomness under fixed anchor states is negligible; (5) the advantage grows under sampling stochasticity (g=2.87 at temperature 0.7); (6) a sham ablation attributes about 45% of the gain to structural scaffolding and 55% to Fact/Heuristic/Emotion content, and CKM is the only arm that both raises consistency and reduces flipping. CKM does not improve reasoning correctness. The narrower result: behavioral consistency is measurable, varies across models, and is partially improvable by forcing models to separate facts, assumptions, and evaluative signals before deciding.

Comments:
40 pages, 6 figures; 54-page supplementary material included as an ancillary file. Code, prompts, and data: this https URL

Subjects:

Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)

ACMclasses:
I.2.7; I.2.0

Cite as:
arXiv:2607.24765 [cs.CL]

(or
arXiv:2607.24765v1 [cs.CL] for this version)

https://doi.org/10.48550/arXiv.2607.24765

Focus to learn more

              arXiv-issued DOI via DataCite

Submission history From: Gihun Lee Dr [view email] [v1]
Fri, 5 Jun 2026 12:36:36 UTC (483 KB)

 function toggleList(whichLayer,toggleThis)
 {
    var elem, vis;
    if( document.getElementById ) // standard
      elem = document.getElementById( whichLayer );
    else if( document.all ) // old msie versions
      elem = document.all[whichLayer];
    else if( document.layers ) // nn4
      elem = document.layers[whichLayer];
    vis = elem.style;
    // if the style.display value is blank we try to figure it out here
    if(vis.display==''!=undefined!=undefined)
      vis.display = (elem.offsetWidth!=0!=0)?'inline':'none';
    vis.display = (vis.display==''||vis.display=='inline')?'none':'inline';
    // toggle link inner text
    status = vis.display;
    if(vis.display=='inline'){
      document.getElementById('toggle').innerHTML = "(collapse list)";
      document.getElementById('toggle').title = "Collapse list";
    } else {
      document.getElementById('toggle').innerHTML = "("+toggleThis+")";
      document.getElementById('toggle').title = "Show complete list";
    }
 }

Full-text links:
Access Paper:

View a PDF of the paper titled Measuring and Improving Behavioral Consistency in Large Language Models through Fact-Heuristic-Emotion State Enforcement, by Gi-Hun Lee and 1 other authorsView PDFHTML (experimental)TeX Source

view license

Ancillary-file links:
Ancillary files (details):
supplementary.pdf

Current browse context:
cs.CL

prev

|
next

new
|
recent
| 2026-07

Change to browse by:

cs
cs.AI
cs.HC

References Citations

NASA ADSGoogle Scholar
Semantic Scholar

export BibTeX citation
Loading…

BibTeX formatted citation

loading…

Data provided by:

Bookmark

checked="checked"class=“labs-tab-input”>
Bibliographic Tools

Bibliographic and Citation Tools

Bibliographic Explorer Toggle

Bibliographic Explorer (What is the Explorer?)

Connected Papers Toggle

Connected Papers (What is Connected Papers?)

Litmaps Toggle

Litmaps (What is Litmaps?)

scite.ai Toggle

scite Smart Citations (What are Smart Citations?)

Code, Data, Media

Code, Data and Media Associated with this Article

alphaXiv Toggle

alphaXiv (What is alphaXiv?)

Links to Code Toggle

CatalyzeX Code Finder for Papers (What is CatalyzeX?)

DagsHub Toggle

DagsHub (What is DagsHub?)

GotitPub Toggle

Gotit.pub (What is GotitPub?)

Huggingface Toggle

Hugging Face (What is Huggingface?)

ScienceCast Toggle

ScienceCast (What is ScienceCast?)

Demos

Demos

Replicate Toggle

Replicate (What is Replicate?)

Spaces Toggle

Hugging Face Spaces (What is Spaces?)

Spaces Toggle

TXYZ.AI (What is TXYZ.AI?)

Related Papers

Recommenders and Search Tools

Link to Influence Flower

Influence Flower (What are Influence Flowers?)

Core recommender toggle

CORE Recommender (What is CORE?)

Author
Venue
Institution
Topic

    About arXivLabs

arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.

Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)

mathjaxToggle();

    We gratefully acknowledge support from
    our major funders,
    member institutions, ,
    and all contributors.

About

Help

Contact

Subscribe

Copyright

Privacy

Accessibility

Operational Status (opens in new tab)

Major funding support from

77. 【2607.24753】Language as a Material Interface for Creative LLM Interaction

链接：https://arxiv.org/abs/2607.24753

作者：Jon McCormack,Tace McNamara,Chen Wang,Maria Teresa Llano

类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)

关键词：Large Language Models, interact with Large, Language Models, Large Language, directive prompting

备注： Paper accepted at Creativity and Cognition '26, London 13-16 July 2026

点击查看摘要

Abstract:Although directive prompting is the predominant way to interact with Large Language Models (LLMs), many creative practices rely on language that is open-ended, associative, phonaesthetic, symbolic, and that unfolds across multiple temporalities. In this work, we explore how creative practitioners might work with AI systems when language is treated not merely as instruction but as material. We conducted an ecological two-week study with four creative practitioners using a design probe: the Memetic Mixer, a tangible interactive device that constrains interaction with an LLM. Analysis of post-study interviews and device logs identified distinct modes of material language use and temporalities that shaped each participant's engagement with AI and their creative practice. We reflect on these findings and contribute design considerations that support open-ended interaction with AI in creative practice.

78. 【2607.24750】meCapsule: Generative Hallucination as a Method for Historical Sensemaking

链接：https://arxiv.org/abs/2607.24750

作者：Hayk Grigorian,Hamed Yaghoobian

类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)

关键词：Large Language Models, Large Language, vast contemporary corpora, encode present-day concepts, Language Models

备注： 10 pages, 4 figures. Accepted to Creativity and Cognition (CC '26)

点击查看摘要

Abstract:Large Language Models (LLMs) are temporally overexposed: trained on vast contemporary corpora, they encode present-day concepts that make them unreliable narrators of the past. We present TimeCapsule, a 1.2B-parameter LLaMA-style causal model trained exclusively on Victorian texts (1800-1875) as an epistemologically isolated generative archive. Quantitative evaluation shows a 45.4% perplexity reduction over a GPT-2 baseline on held-out Victorian prose, while larger contemporary causal models achieve lower raw perplexity through broader pretraining but lack temporal isolation. TimeCapsule exhibits computational sensemaking, generating historically plausible analogical explanations for unfamiliar modern concepts (e.g., describing a computer as a "hypertrophied lung"). A qualitative hermeneutic probe with two humanities scholars revealed a crisis of authenticity, as both misclassified approximately 40% of genuine Victorian excerpts as machine-produced. We argue that structural ignorance of the future transforms hallucinations into interpretive probes of nineteenth-century ontologies.

79. 【2607.24748】VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents

链接：https://arxiv.org/abs/2607.24748

作者：Seonok Kim

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：visually-rich long documents, layout cues, manuals often distribute, retrieval, long documents

备注：

点击查看摘要

Abstract:Visually-rich documents such as reports, slides, and manuals often distribute the evidence needed to answer a question across multiple pages, mixing text with layout cues, tables, charts, and figures. This work studies multimodal retrieval-augmented generation for question answering over such visually-rich long documents, where retrieval must select evidence pages that include both textual and visual signals. We present VLD-RAG, an agentic multimodal RAG framework for multi-page evidence retrieval and cross-page reasoning over long documents. VLD-RAG builds a page-preserving multimodal index that stores parsed text, page-level metadata, and dense visual representations, and uses a hybrid retrieval strategy that combines keyword-based sparse search with dense semantic queries to identify candidate sources and evidence pages. A verifier-guided agent workflow coordinates a Retrieval Agent, Answer Agent, and Validation Agent to broaden evidence coverage, detect missing citations, and refine retrieval requests when needed. We evaluate retrieval with Top-1 and Top-5 evidence-page accuracy and generation with generalized accuracy, and show that VLD-RAG improves both evidence-page retrieval and end-task question answering on visually-rich long-document benchmarks, including LongDocURL and MMLongBench-Doc, outperforming previous vision-based retrieval baselines. These findings highlight that coordinated agent verification and multimodal hybrid retrieval are crucial for reliable grounding when correct answers depend on evidence scattered across pages.

80. 【2607.24745】DocAnnot -- Accelerating the Creation of Key Information Extraction Datasets with GenAI-Powered Auto-annotation

链接：https://arxiv.org/abs/2607.24745

作者：Siddartha Reddy,Harikrishnan P M,Goutham Vignesh,Varun V,Vishal Vaddina

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Key Information Extraction, Key Information, creating training datasets, Information Extraction, Large Vision Language

备注： 15 pages, 2 figures

点击查看摘要

Abstract:Key Information Extraction (KIE) is vital for many document applications, but creating training datasets is traditionally a time-consuming manual process. We introduce DocAnnot, a framework that significantly accelerates KIE dataset generation. DocAnnot leverages a Large Vision Language Model (LVLM) for label value extraction, OCR for text/bounding box detection, and a novel Spatially Informed Contextual Matching (SICM) algorithm. SICM improves label-value association by combining spatial relationships and proximity analysis with textual matching. We evaluate our framework on the CORD and SROIE benchmarks, demonstrating its ability to auto-generate annotations with F1-scores of 0.679 and 0.846, respectively. Furthermore, we investigate the effectiveness of using auto-annotated data for fine-tuning downstream KIE models. While human-annotated data remains superior, models trained exclusively on DocAnnot's outputs attain respectable performance (e.g., LayoutLMv3 achieving an F1-score of 0.6765 on CORD). These results show that while our framework significantly reduces reliance on manual effort, it does not yet fully eliminate the need for human intervention. However, by automating the process to a point where reviewers can efficiently refine outputs, our system enables near-perfect annotations with much greater efficiency than manual annotation from scratch. This approach offers substantial time and cost savings, making it valuable for resource-constrained settings and rapid model prototyping.

81. 【2607.22583】Multi-Objective Structured Pruning of LLMs for Latency and Model Size Optimization

链接：https://arxiv.org/abs/2607.22583

作者：Muhammad Junaid Ali,Smail Niar,El-Ghazali Talbi

类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Large Language Models, achieved widespread adoption, Large Language, Language Models, query-response capabilities

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) have achieved widespread adoption because of their strong reasoning and query-response capabilities. However, deploying them in embedded and edge computing environments remains challenging because of strict latency, memory, and energy constraints. Their large parameter counts and computational demands hinder efficient execution on resource-constrained platforms. Although model pruning has emerged as a viable solution for reducing scale while preserving performance, jointly optimizing layers, attention heads, and Multi-Layer Perceptron (MLP) dimensions remains highly complex. Exhaustively exploring this combined design space is computationally expensive and often leads to local optima or unstable configurations. To address these limitations, we propose a hardware-aware, multi-objective structured pruning framework. The proposed two-stage method explicitly targets latency and model size for efficient deployment on edge devices. In the coarse-grained stage, multi-objective depth pruning removes entire attention and MLP blocks to reduce computational load and memory usage. In the subsequent fine-grained stage, Parallel Bayesian Optimization (PBO) searches for the optimal layer-wise pruning ratios for pruning under latency constraints, while importance-based strategies rank the specific components to be pruned within each layer's allocated budget. Experimental results show that our approach reduces model complexity with minimal impact on commonsense reasoning tasks and zero-shot performance. Our method achieves a favorable trade-off among accuracy, latency, and model size, making it suitable for edge deployment. Across multiple LLMs at 37.5% and 50% pruning ratios, the proposed approach achieves better performance on commonsense reasoning tasks than existing methods while significantly reducing inference cost.

82. 【2607.25672】AI's Capability in Assisting Scientific Research in Physics, Astrophysics, and Cosmology I: Literature Review

链接：https://arxiv.org/abs/2607.25672

作者：Anamaria Hell,Kateryna Vovk,Veena Krishnaraj,Jia Liu,Kosuke Aizawa,Adrian E. Bayer,Linda Blot,Jessica Cowell,Suyog Garg,Jonathan Grée,Ben Horowitz,Masaya Ichikawa,Kanyuni Iemoto,Keigo Kondo,Zacharie Lorsin,Kevin McCarthy,Jamie Robinson,Miguel Ruiz-Granda,Leander Thiele,Ievgen Vovk,Mingshen Zhou

类目：Instrumentation and Methods for Astrophysics (astro-ph.IM); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Computation and Language (cs.CL); General Relativity and Quantum Cosmology (gr-qc)

关键词：large language models, large language, scientific research, ChatGPT Deep Research, expert-conceived research projects

备注： 12 pages, 3 figures

点击查看摘要

Abstract:We investigate how well large language models (LLMs) can assist with literature reviews for scientific research. We perform a controlled study of eight expert-conceived research projects across the areas of physics, astrophysics, and cosmology. Each project has a defined background and goal, and human experts and AI prompters are asked to perform identical literature review tasks in parallel. We compare the relevant literature selected by humans with that selected by mid-2025 LLMs (ChatGPT-4o, ChatGPT Deep Research, and Gemini). We find the overlap between human- and AI-selected references to be small ($$6\%), indicating that AI models do not yet reproduce a competent expert search on their own, though they have the potential to complement literature searches by humans. We then assess the reliability and completeness of AI-generated candidate references, distinguishing two types of hallucination: fabrications (references to nonexistent papers) and metadata mismatches (real papers with one or more incorrect fields). We find that while fabricated references make up 3\% of the AI-generated references, 64\% are real papers with at least one incorrect field (title, author, year, journal, DOI, or link), indicating that the mid-2025 models require systematic verification. However, the performance is significantly improved for the 2026 model ChatGPT Pro 5.5, with a single-project test showing zero fabrication or metadata mismatches.

83. 【2607.24797】Reading Without a Reader: Large Language Models Collapse Reading and Writing into a Single Entangled Code

链接：https://arxiv.org/abs/2607.24797

作者：Diego Saldaña Ulloa

类目：Neurons and Cognition (q-bio.NC); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：ventral decoding route, fronto-parietal encoding route, partial orthographic core, impaired in pure, literate human brain

备注：

点击查看摘要

Abstract:In the literate human brain, reading and writing are two doubly-dissociable systems: a ventral decoding route (impaired in pure alexia) and a fronto-parietal encoding route (impaired in pure agraphia), sharing a partial orthographic core. A decoder-only large language model (LLM) instead drives both from a single autoregressive path optimized on text, a recent cultural invention rather than an evolved instinct. We ask how entangled that one mechanism is, comparing an input-side "reading code" $W_E$ with an output-side "writing code" $W_U$ via an entanglement index $E \in [0,1]$ (CKA, Procrustes residual, mutual $k$-NN) calibrated against an independent-init floor and a tied ceiling. Across nine probes on GPT-2, OPT, Pythia (14M--1.4B), T5, and BERT/RoBERTa (six consolidating established results, three introducing the read/write analysis), two complementary levels agree in direction. In the weights, untied models hold one coupled but sub-ceiling code ($E=0.23$--$0.35$, far above floor) on a non-monotonic couple-then-differentiate trajectory, with $W_U$ drifting $\sim 3.2\times$ farther than $W_E$ in every frequency decile. In behaviour, comprehension and production are positively coupled in all 12 non-degenerate models (sign test $p0.001$), the opposite of the brain's double dissociation. This coupling is general, not decoder-only: encoder--decoders separate the two pathways representationally (up to 0.96) yet stay behaviourally coupled. We report our nulls plainly (the geometry $\rightarrow$ behaviour bridge is null, $\rho=0.00$). Because a single forward path makes some coupling expected a priori, our contribution is its quantification and cross-level concordance; by analogy, not homology, this situates LLMs as a distinct point in the space of possible minds.

信息检索

1. 【2607.25901】RecoReward: Recommender-Guided Multimodal Description Generation for Recommendation

链接：https://arxiv.org/abs/2607.25901

作者：Guohong Mu,Yueyang Liu,Jiangxia Cao,Changxin Lao,Zijie Zhuang,Yuhui Zhang,Jiaqi Feng,Ruochen Yang,Shuang Yang,Zhaojie Liu,Qibin Hou

类目：Information Retrieval (cs.IR)

关键词：Multimodal large language, convert multimodal item, multimodal item content, Multimodal large, convert multimodal

备注： 16 pages, 4 figures

点击查看摘要

Abstract:Multimodal large language models (MLLMs) can convert multimodal item content into structured descriptions used as semantic features for recommendation. Conventional content-only generation, however, cannot use downstream user signals to determine which semantics should be emphasized. Recent user-conditioned methods incorporate these signals through user histories or profiles, but they require user information at inference and make generation user-dependent. In this paper, we introduce RecoReward, which instead uses behavior-derived rewards during training and preserves content-only inference. To instantiate this idea in live-stream recommendation, we treat historically engaged users as a proxy for future target users and use observational non-target users to estimate affinity shared broadly across users. The Recommender Affinity Score (RAS) contrasts these signals to provide user-selective feedback for reinforcement learning, allowing the learned policy to generate a single shared description without user inputs. In our offline benchmark, RecoReward-9B outperforms its Qwen3.5-9B baseline and all other evaluated models across seven recall metrics. Online A/B testing also shows performance gains. These results show that RecoReward trains the MLLM to produce item features that benefit downstream recommendation while retaining content-only serving.

2. 【2607.25823】Hypothesis-Driven Shelf Generation for Personalised Recommendation

链接：https://arxiv.org/abs/2607.25823

作者：Aleksandr V. Petrov,Tarun Chillara,Matthew D. Moellman,Lucas de Haas,Yabai Song,Alina Susoykina,Melissa Crawford,Gabriel Negash,Erik Franco,Tasnim Rahman,Binal Jhaveri,Shubham Bansal,Hugues Bouchard,Roberto Mirizzi,Mounia Lalmas,Aloïs Gruson

类目：Information Retrieval (cs.IR)

关键词：Modern recommendation interfaces, recommendation interfaces organise, interfaces organise content, Modern recommendation, themed rows

备注： Accepted at ACM RecSys '26 (Industry Track)

点击查看摘要

Abstract:Modern recommendation interfaces organise content into shelves: themed rows such as "More of What You Like" or "New Releases for You." In production systems, these shelves are typically defined through hand-crafted templates coupled with dedicated retrieval logic. While effective for broad recommendation intents, this approach does not scale to the long tail of individual taste. We present a content-hypothesis-driven shelf generation system for Spotify Home that replaces fixed templates with natural-language hypotheses describing what a personalised shelf should contain. The system has four stages hypothesis generation, catalogue fulfilment, shelf alignment, and offline serving. This decomposition decouples shelf planning from catalogue fulfilment, supports independent optimisation of planning and retrieval, and enables both constrained generative retrieval over catalogue entities and distillation of frontier LLM behaviour into compact models. Our production pipeline combines hypothesis generation, generative retrieval, candidate selection and shelf alignment, offline LLM-as-a-judge evaluation, and precomputed serving. We describe the end-to-end architecture and evaluate it through offline analyses and an early online evaluation under uniform random exposure on Spotify Home. Results show that hypothesis-driven shelves substantially expand personalised recommendation supply with engagement that varies by content type and is competitive with strong existing shelves in some settings.

3. 【2607.25718】ools Are Not Islands: Set-Level Tool Retrieval for LLM Agents via Query-Conditioned Hyperedge Prediction

链接：https://arxiv.org/abs/2607.25718

作者：Xinyi Hong,Pinjun Dong,Xinyang Yu,Binyan Jiang

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：Large language model, Large language, agents increasingly rely, invoking external tools, LLM agent pipelines

备注： 9 pages, 2 figures, 3 tables

点击查看摘要

Abstract:Large language model (LLM) agents increasingly rely on invoking external tools to complete real-world tasks. Tool retrieval, which selects a small task-relevant subset from a library of thousands of tools before the agent acts, has therefore become a critical component of LLM agent pipelines. However, existing retrievers either score each tool in isolation or assemble the tool set sequentially, so the joint utility of a candidate set is never evaluated as a whole. In this paper, we propose HYSET, short for HYperedge-based SEt-level Tool retrieval. Our contributions are threefold: (i) we formulate tool retrieval as query-conditioned hyperedge prediction on a tool co-invocation hypergraph, under which the tool set itself becomes the unit of scoring and most existing retrieval paradigms reduce to restricted instances; (ii) we capture size-dependent tool compatibility through cardinality-specific interactions; and (iii) we design HYSET as a pre-selection module requiring no modification to the downstream agent. Experiments on ToolBench demonstrate that HYSET consistently outperforms state-of-the-art baselines in both tool retrieval performance and end-to-end task success. Beyond the in-domain setting, HYSET further supports zero-shot/few-shot transfer, generalizing to held-out tools/categories and unseen domains with minimal supervision.

4. 【2607.25640】LLM-as-a-Judge for Evaluating System Responses in Conversational Music Recommendation

链接：https://arxiv.org/abs/2607.25640

作者：Seungheon Doh,Bruno Sguerra,Sergio Oramas,Elena V. Epure,Juhan Nam

类目：Information Retrieval (cs.IR)

关键词：recommending relevant items, Conversational Recommendation Systems, generating natural language, Conversational Recommendation, natural language responses

备注： Accepted for publication at the 20th ACM Conference on Recommender Systems (ACM-RecSys 2026)

点击查看摘要

Abstract:Conversational Recommendation Systems (CRS) aim to achieve two primary objectives: recommending relevant items and generating natural language responses. While recommendation accuracy is effectively measured by established ranking metrics, the evaluation of response generation poses a more fundamental challenge. Although human evaluation remains the gold standard, its cost and scalability constraints have motivated the adoption of LLM-as-a-judge as a promising proxy, whose alignment with human judgment in the context of CRS remains an open question. In this paper, we present the first user study to empirically assess the reliability of LLM-as-a-judge for evaluating CRS responses. We sample 20 multi-turn music recommendation sessions and generate candidate system responses using four instruction-tuned LLMs, inducing variance in response quality across model scales. We collect $n{=}400$ ratings from 20 domain-expert annotators, who evaluate each response across two dimensions: Personalization Quality and Explanation Quality. Through bootstrapped correlation analysis, we find that LLM-based judges exhibit moderate positive alignment with human assessments and outperform all reference-based baselines. Furthermore, we analyze how judge performance varies according to model scale and conditioning information, providing practical guidance for deploying LLM-as-a-judge.

5. 【2607.25600】Beyond Self-Knowledge: Propagating Uncertainty Across Reasoning and Retrieval in LLMs

链接：https://arxiv.org/abs/2607.25600

作者：Chandan Kumar Sah,Xiaoli Lian,Li Zhang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Retrieval-augmented generation improves, generation improves knowledge-intensive, Retrieval-augmented generation, knowledge-intensive question answering, improves knowledge-intensive question

备注： 9 pages, 6 figures, 6 tables

点击查看摘要

Abstract:Retrieval-augmented generation improves knowledge-intensive question answering, but indiscriminate retrieval can introduce irrelevant evidence and unnecessary computation. We investigate whether verbalized confidence from black-box language models can serve as an actionable signal for retrieval routing. Our method, BeyondUncertainty, first elicits a structured provisional answer and confidence estimate, then applies a model-specific threshold selected on held-out validation data and frozen before test evaluation. Low-confidence questions receive top-$5$ TF--IDF retrieval followed by a second answer call, whereas high-confidence questions return the provisional answer directly. We evaluate 27,000 policy instances across six QA benchmarks, three model families, and three retrieval policies. BeyondUncertainty achieves $0.483$ mean token-level F1, compared with $0.467$ for always retrieval and $0.401$ for no retrieval, while reducing retrieved passages by $20.4\%$ relative to always retrieval. When matched on the number of questions routed to retrieval within each dataset--model cell, it outperforms a post-hoc random allocation in 17 of 18 settings, with an average gain of 0.024 F1. Although poorly calibrated as an absolute probability, probe uncertainty modestly predicts question-level retrieval benefit (AUROC $=0.628$). However, the additional probe increases total token usage by $28.2\%$, revealing a trade-off between more selective evidence acquisition and end-to-end token efficiency.

6. 【2607.25514】Learning Dynamics of Strategic Publishers in Generative AI Ecosystems

链接：https://arxiv.org/abs/2607.25514

作者：Sagie Dekel,Omer Madmon,Moshe Tennenholtz,Oren Kurland

类目：Computer Science and Game Theory (cs.GT); Information Retrieval (cs.IR); Multiagent Systems (cs.MA)

关键词：users access information, search systems, access information, GenAI search systems, systems

备注：

点击查看摘要

Abstract:Generative AI (GenAI) search systems are transforming how users access information. Unlike ranking-based search systems, where users observe a ranked list of documents, GenAI search systems, given a user's question, generate an answer, often accompanied by external sources (e.g., in the form of citations). Content creators (publishers) seeking to increase exposure might behave strategically and compete with other creators for users' attention. While publishers in ranking-based systems might strategically modify their content to improve its ranking, the incentives in generative systems take on a new form. Publishers may now gain exposure through generated responses and attributions to those responses. We introduce a novel game-theoretic model of the emerging GenAI ecosystem in which publishers compete for attribution-based exposure. We study the learning dynamics of strategic content creators under better-response dynamics. We associate the convergence of learning dynamics to equilibrium with ecosystem stability. Employing the notion of potential games, we study the stability of GenAI ecosystems under several known content selection mechanisms. We demonstrate the instability of mechanisms representing real-world modern systems and characterize a mechanism that induces a stable ecosystem. We conduct extensive simulations to analyze the stability and welfare of GenAI ecosystems under various mechanisms. The simulations support our theoretical findings and reveal an interplay among stability, publisher welfare, and user welfare. In particular, stable mechanisms do not necessarily maximize welfare, demonstrating an important trade-off for platform designers. We then introduce a study illustrating that the proper selection of the GenAI mechanism enables the manifestation of desired trade-offs between publisher welfare and the different sources of user welfare.

7. 【2607.25420】MARS: Multi-Agent Re-ranking for Repeat-Order Food Delivery Recommendation

链接：https://arxiv.org/abs/2607.25420

作者：Jiahao Tian,Zhenkai Wang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：Large language models, Large language, language models, inside a structured, Large

备注：

点击查看摘要

Abstract:Large language models (LLMs) are increasingly used in recommender systems, but it is often unclear how much performance can be obtained from strong pre-trained backbones alone when they are placed inside a structured recommendation pipeline. In this paper, we present MARS, a modular multi-agent re-ranking framework for repeat-order food delivery recommendation. MARS serves as a controlled hybrid framework for studying how far pre-trained LLMs can go in this setting when combined with lightweight collaborative retrieval and contextual filtering. MARS performs coarse-to-fine recommendation in two stages: cuisine prediction followed by vendor ranking. The framework combines LightGCN-based global preference signals, Swing-based local peer evidence, geospatial filtering, and prompt-driven LLM reasoning over behavioral, temporal, and geographic context. We evaluate MARS on two real-world Delivery Hero benchmarks, DHRD-SE and DHRD-SG, and compare it against heuristic, sequential, graph-based, and food-delivery-specific baselines. We also provide detailed implementation and evaluation protocols, including prompting and decoding. Our study makes three contributions. First, it presents a modular multi-agent framework for repeat-order food delivery recommendation that integrates collaborative signals and LLM-based re-ranking in a transparent pipeline. Second, it shows that strong pre-trained backbones can already be competitive in repeat-order recommendation when paired with lightweight collaborative retrieval. Third, it establishes a reproducible evaluation setting for hybrid LLM recommenders in food delivery.

8. 【2607.25404】WICE: Two-Clock, Two-Window Learning for Long-Horizon Conversion Prediction in Online Advertising

链接：https://arxiv.org/abs/2607.25404

作者：Kaiyuan Li,Kun Wang,Zhongbo Wang,Teng Sha,Ming Yan,Yanhua Cheng,Xialong Liu

类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)

关键词：delayed feedback creates, two-window learning problem, conversion, creates a two-clock, delayed feedback

备注：

点击查看摘要

Abstract:Long-horizon conversion prediction under delayed feedback creates a two-clock, two-window learning problem in online advertising. A short base observation window releases recent clicks on the click clock before their outcomes mature, whereas conversions continue to arrive on the conversion clock throughout a longer target conversion window. The click clock provides timely but partially observed status supervision. The conversion clock reveals long-tail delays, but the delay composition within an arrival-time slice is weighted by historical click cohorts with different traffic volumes and target-window conversion rates. We present TWICE, a framework that factorizes long-horizon post-click conversion rate (CVR) into a target-window conversion probability and a grouped elapsed-delay cumulative distribution function (CDF). The two clocks provide complementary supervision. Click-clock records train the target-window CVR head through a current-status likelihood over the base observation window. Newly arrived conversions train the delay model on the conversion clock. To account for the cohort mixture, TWICE uses fixed click-time predicted CVR (pCVR) mass as cohort exposure in an arrival-conditioned likelihood. This accounts for differences in cohort traffic and conversion propensity. The resulting aggregate records are self-contained. A single learned CDF produces monotone predictions for all requested horizons up to the target conversion window. Serving requires neither historical lookup nor convolution. Experiments on a public benchmark and an industrial advertising dataset demonstrate the effectiveness of TWICE. In an online A/B test in Kwai's advertising system, TWICE increased expected revenue, revenue, and conversions by 2.486%, 1.858%, and 2.061%, respectively. It was subsequently deployed to full traffic.

Subjects:

Machine Learning (cs.LG); Information Retrieval (cs.IR)

Cite as:
arXiv:2607.25404 [cs.LG]

(or
arXiv:2607.25404v1 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2607.25404

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

9. 【2607.25366】Sharpness-aware Model Merging with Salience Recovery for LLM-based Cross-Domain Sequential Recommendation

链接：https://arxiv.org/abs/2607.25366

作者：Huwei Ji,Jiajie Su,Yuyuan Li,Xiaohua Feng,Chaochao Chen

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：Cross-Domain Sequential Recommendation, Sequential Recommendation, deep semantic reasoning, LLM-based Cross-Domain Sequential, Cross-Domain Sequential

备注： Published in Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD '26). 12 pages, 6 figures, 4 tables. Code available at [this https URL](https://github.com/muyiahhh/SharpRec)

点击查看摘要

Abstract:LLM-based Cross-Domain Sequential Recommendation (CDSR) leverages LLMs to enhance target performance via deep semantic reasoning, alleviating the dependency on overlapping users. Among LLM-based paradigms, model merging is particularly promising for multi-domain scenarios due to its superior scalability and flexibility in integrating diverse knowledge sources. However, our empirical investigations reveal two critical bottlenecks: (1) cross-domain knowledge conflict; and (2) performance saturation in multi-domain fusion. Our analysis attributes these phenomena to parameter-level misalignment and statistical homogenization during the merging process. To address these bottlenecks, we propose SharpRec, Sharpness-aware Model Merging with Salience Recovery for LLM-based CDSR, a framework designed to lift the performance upper bound of merged models. SharpRec incorporates two synergistic modules: Sharpness-aware Geometric Alignment to establish a stable geometric foundation for interference-free fusion; and Preference Salience Activation to effectively recover the distinctive features essential for bolstering target domain performance. Extensive experiments in both dual-domain and multi-domain scenarios demonstrate that SharpRec consistently outperforms state-of-the-art baselines.

10. 【2607.25346】he Case Against Generation for Retrieval: Discriminative Language Models as Effective Retrievers

链接：https://arxiv.org/abs/2607.25346

作者：Zhe Xu,Prachi Agrawal,Kavosh Asadi,Tianyi Chen,Carl Hu,Justin Johnson,Wuwei Lan,Mingfu Liang,Xi Liu,Tik On Lui,Oladipo Ositelu,Sandeep Pandey,Ankit Peshin,Feng Qi,Anil Ramakrishna,Kaushik Rangadurai,Frank Shyu,Luke Simon,Yang Yang,Chiyu Zhang

类目：Information Retrieval (cs.IR)

关键词：Large Language Models, Large Language, Language Models, Large, Language

备注：

点击查看摘要

Abstract:Large Language Models (LLMs) have emerged as powerful assets for recommender systems. However, deploying them as generative recommenders or zero-shot rankers at web-scale remains bottlenecked by prohibitive computational overhead and grounding challenges. In this paper, we revitalize the classic, highly efficient two-tower retrieval architecture by adapting LLMs as semantic representation backbones rather than generative engines. We introduce an LLM-native two-tower framework engineered for high-throughput, large-scale retrieval. Our architecture introduces several key innovations: a shared LLM encoder for joint user-item modeling, End-Of-Sentence (EOS) token pooling for compact sequence embedding, cross-dataset transfer learning, knowledge distillation from powerful cross-encoder teachers, and latent reasoning within the user tower. Extensive evaluation across three public benchmarks demonstrates that cross-encoder architecture outperforms current state-of-the-art (SoTA) models, while the efficient two-tower student achieves SoTA-comparable retrieval performance. Furthermore, experiments on internal large-scale production systems yield substantial topline retrieval improvements along with high resilience to model staleness and superior data scaling. Our findings demonstrate that when augmented with modern representation learning, the traditional two-tower paradigm remains an exceptionally competitive and practical solution for industrial retrieval systems.

11. 【2607.25344】Reward Guided Decoding for Generative Recommendation

链接：https://arxiv.org/abs/2607.25344

作者：Ruochen Yang,Yusheng Huang,Youfeng Zheng,Shuang Wen,Liangliang Chen,Pengbo Xu,Xiaoyu Zhang,Shijun Wang,Shuang Yang,Zhaojie Liu,Lantao Hu,Wenwu Ou,Jiawei Sheng,Tingwen Liu

类目：Information Retrieval (cs.IR)

关键词：SID sequence autoregressive, SID sequence, autoregressive generation paradigm, sequence autoregressive generation, sequence autoregressive

备注：

点击查看摘要

Abstract:Generative recommendation formulates recommendation task into an SID sequence autoregressive generation paradigm, but the decoding process is often dominated by generation likelihood. This may conflict with real-world business objectives, where high-value candidates can receive low generation probability and be pruned early during beam search. Existing reranking or training-time alignment methods either intervene too late or require costly model retraining when business preferences change. To this end, we propose \textbf{R}eward \textbf{G}uided \textbf{D}ecoding, named \textbf{RGD}, a controllable decoding framework for industrial value-oriented generative recommendation. We formulate value-guided decoding as a KL-regularized reward maximization problem, deriving a closed-form reward guided decoding distribution that principledly combines generation probability with reward signals. RGD treats the base generator as a reference policy and introduces a reward model as a test-time controller, injecting reward into each decoding step to reshape the search trajectory without retraining the generator. Extensive offline and online experiments demonstrate the effectiveness of our approach for aligning personalization and business value. RGD has been deployed on the Kuaishou platform, bringing consistent improvements in real-world recommendation scenarios.

12. 【2607.25339】SPARC: Sequence-aware Progressive Attribute Routing and Compression Framework for Generative Recommendation

链接：https://arxiv.org/abs/2607.25339

作者：Chang Liu,Changfa Wu,Hui Qian,Binbin Cao,Jian Wu,Yuliang Yan,Han Zhu,Bo Zheng

类目：Information Retrieval (cs.IR)

关键词：discrete Semantic IDs, autoregressively generates target, Semantic IDs, discrete Semantic, historical SID sequences

备注：

点击查看摘要

Abstract:Generative recommendation tokenizes items as discrete Semantic IDs (SIDs) and autoregressively generates target items from users' historical SID sequences. Although existing SIDs incorporate multimodal and structured information, they are typically statically assigned and independent of the current interaction context. In industrial scenarios, each behavior also contains heterogeneous attributes, such as category, brand, price, behavior type, and timestamp. Fully expanding these features greatly increases the input length, while directly compressing them into a single representation may prematurely discard context-relevant information. We propose \textbf{SPARC}, \uline{\textbf{S}}equence-aware \uline{\textbf{P}}rogressive \uline{\textbf{A}}ttribute \uline{\textbf{R}}outing and \uline{\textbf{C}}ompression Framework for Generative recommendation. SPARC first models the sequential dependencies of each field type to obtain context-aware field representations. It then routes the original, contextual, and identity representations of different fields into multiple slots to preserve complementary information under a fixed capacity. Finally, lightweight cross-item interaction integrates the intermediate tokens and compresses each historical item into a single token. Following the principle of contextualizing before compression, SPARC enriches user-history representations without increasing the input length of the generative backbone. Experiments on industrial Taobao and public Amazon datasets demonstrate that SPARC outperforms strong conventional and generative baselines. Further comparisons with static compression variants show that the improvement of SPARC comes from context-conditioned information retention rather than merely increasing the expressiveness of the compression module.

Subjects:

Information Retrieval (cs.IR)

Cite as:
arXiv:2607.25339 [cs.IR]

(or
arXiv:2607.25339v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.25339

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

13. 【2607.25329】Grevo: A Unified Generative Recommendation Framework with Evolutionary Item Indexing

链接：https://arxiv.org/abs/2607.25329

作者：Huanjie Wang,Liwei Guan,Zekai Sun,Hongwei Zhang,Honghui Bao

类目：Information Retrieval (cs.IR)

关键词：achieving strong performance, drawing increasing attention, achieving strong, alternative to matching, Generative recommendation

备注：

点击查看摘要

Abstract:Generative recommendation has recently emerged as a promising paradigm that reformulates retrieval as autoregressive generation over semantic identifiers (SIDs), achieving strong performance and drawing increasing attention as an alternative to matching. Despite this progress, SIDs are typically frozen by a content-based tokenizer before the recommender is trained, leaving a persistent gap between what best reconstructs an item's content and what a recommender can predict from user behavior. Recent end-to-end methods close this gap by jointly training the tokenizer and the recommender, but coupling the two destabilizes the identifier space and requires a second learnable model, alignment losses, and usually a delicate alternating-optimization schedule. To address this issue, we propose Grevo, a unified Generative recommendation framework with evolutionary item indexing, which treats the SID assignment itself as an evolvable discrete variable that adapts to behavioral feedback rather than as a tokenizer to be trained. Grevo builds on a single multitask recommender that unifies a behavioral SID generation task and a semantic SID grounding task, letting the recommender absorb the tokenizer's role. Through evolutionary item indexing, Grevo then uses the trained recommender itself as a posterior evaluator to reassign a budgeted set of high-risk identifiers under a fixed vocabulary and length. Together, these components turn index construction into a stable, feedback-driven search that requires no second learnable model, no alignment losses, and no alternating-optimization schedule. Extensive experiments on multiple real-world datasets demonstrate that Grevo consistently outperforms state-of-the-art generative recommendation methods.

14. 【2607.25276】FunnelAL: Retrieve-then-Rank Active Learning for Single-Class Discovery

链接：https://arxiv.org/abs/2607.25276

作者：Reihaneh Rostami(RAIC Labs),Brian Goodwin(RAIC Labs)

类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：multi-stage funnel architecture, funnel architecture, architecture of industrial, active learning, industrial recommender systems

备注： 15 pages, 6 figures, 3 tables

点击查看摘要

Abstract:We present FunnelAL, a retrieve-then-rank active learning system for single-class discovery, which adapts the multi-stage funnel architecture of industrial recommender systems to data annotation. Large-scale supervised learning faces two challenges: efficiently finding relevant samples in a massive corpus, and distinguishing true positives from visually confusable negatives when embeddings do not cleanly separate classes. Conventional active learning offers a principled framework for reducing annotation cost, yet it treats sample selection as a single-stage process that addresses neither challenge efficiently. FunnelAL decomposes the problem into cascaded stages. Starting from a single positive and negative example, the system iterates through: (1) embedding-based retrieval scoring that narrows the corpus to a manageable candidate set; (2) a precision-triggered ranking stage that exploits a learned ranker (RankNet) while batch precision remains high, then automatically blends in committee-based exploration (QBC) once returns diminish; and (3) feedback from the annotator's labels that refines both stages in subsequent iterations. We evaluate on three diverse image classification benchmarks. With a perfect annotator, FunnelAL attains the best final F1 on all three benchmarks, the best annotation efficiency (first in AULC), and the fewest annotation rounds. The most recent single-class discovery methods (GAL, PF-MA) at best match its final quality, and only at consistently higher labeling cost. Under annotator labeling errors at realistic rates, FunnelAL remains first or statistically tied for first while classical uncertainty-based methods degrade two to three times faster. Our work provides a concrete bridge between multi-stage recommender systems and active learning.

15. 【2607.25268】Structure-aware Relative Policy Optimization for Ranking

链接：https://arxiv.org/abs/2607.25268

作者：Yiteng Tu,Weihang Su,Zitao Su,Yiqun Liu,Min Zhang,Qingyao Ai

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：information access systems, modern information access, access systems, fundamental component, component of modern

备注：

点击查看摘要

Abstract:Ranking is a fundamental component of modern information access systems. Reinforcement learning (RL) provides a flexible framework for directly optimizing coarse-grained feedback and system-level objectives defined over the complete ranking list. However, existing RL-based ranking methods typically treat each sampled permutation as an atomic output and evaluate it primarily through a scalar reward, overlooking the structural relationships among different ranking lists. Consequently, permutations with similar rewards but substantially different permutation patterns may receive comparable optimization signals, potentially leading to inaccurate credit assignment and overly aggressive policy updates. To address this limitation, we propose SRPO, a \textbf{S}tructure-aware \textbf{R}elative \textbf{P}olicy \textbf{O}ptimization framework for listwise ranking. SRPO measures the discrepancy between sampled permutations using a top-weighted Kendall-tau distance and normalizes their pairwise reward differences by the corresponding distances. It quantifies the reward improvement per unit of ranking change, thereby emphasizing efficient local refinements, particularly those involving top-ranked positions. Experimental results across two ranking scenarios demonstrate that explicitly modeling permutation-level differences improves the effectiveness and stability of listwise ranking, with particularly favorable performance in limited-feedback and complex list-level optimization settings.

16. 【2607.25253】he User Asks, Platforms Compete: How Agentic Recommendation Markets Take Shape

链接：https://arxiv.org/abs/2607.25253

作者：Deyao Hong,Kehan Zheng,Qian Li,Jun Zhang,Jie Jiang,Hongning Wang

类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：Online recommendation, user, traditionally taken place, recommendation, Online

备注：

点击查看摘要

Abstract:Online recommendation has traditionally taken place after a user enters a platform, which determines the candidate pool and the ranking shown to the user. LLM-based user agents enable a different recommendation process: a user specifies a need before choosing a platform, leaving platforms to compete for the user's attention, which we refer to as an agentic recommendation market. In our controlled LLM-based experiments across three product domains, we find this new setting of recommendation creates a tension between access and attention. Compared with traditional platform-centric recommendation, user-centric recommendation greatly expands the opportunity for relevant items to enter comparison; yet broader participation does not translate directly into effective exposure. Competition directly triggers platforms' strategic play: selectively positive explanations occupy 73--78% of first-ranked positions. When the user agent relates platforms' actions to subsequent user feedback, this share falls to 36--41%, while the chance of a user purchasing the relevant item increases. A user agent is therefore more than a ranker over a larger pool of candidates: its querying, ranking, and feedback mechanism governing who can compete, how scarce attention is allocated, and how earlier outcomes shape the evaluation of platforms directly affect user utility. Designing agentic recommendation therefore requires treating access, attention, and accountability as a joint mechanism design problem.

17. 【2607.25216】opoGR: Revealing and Preserving Latent Structure of Semantic ID in Generative Recommendation

链接：https://arxiv.org/abs/2607.25216

作者：Ziyu Zheng,Zhengshun Du,Yaming Yang,Bin Tong,Guan Wang,Meng Yan,Ziyu Guan,Wei Zhao

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：Semantic, generating semantic IDs, Binary SID, Semantic ID-based generative, semantic IDs

备注： under review

点击查看摘要

Abstract:Semantic ID-based generative recommendation tokenizes each item into a sequence of discrete semantic IDs and predicts the next item by generating semantic IDs. However, existing methods typically regard SIDs as independent discrete symbols, while often overlooking the topology of the learned semantic ID space. We identify a structural mismatch between tokenization and generation: the tokenizer learns a structured code space with semantic neighborhood relations, whereas the generator consumes semantic ID tokens as independent categorical symbols. Consequently, item relatedness is reduced to exact semantic ID overlap, making it difficult to identify semantically similar items whose semantic IDs do not overlap. To address this issue, we propose TopoGR, a topology-preserving generative recommendation framework based on Bit-decomposable Semantic ID(Binary SID). Each Binary SID is learned in a bit-decomposable form and can be deterministically converted to a standard integer SID, while exposing an explicit Hamming geometry. TopoGR exploits this topology at three stages: binary SID features preserve Hamming proximity at the input layer; Hamming soft targets inject topology-aware supervision; and Hamming-consistent reranking aligns candidate items with the predicted binary prototype during inference. We further verify that the Hamming topology can capture item relatedness beyond exact SID matching. Experiments on four benchmark datasets show that TopoGR consistently outperforms existing state-of-the-art baselines in recommendation performance.

18. 【2607.25209】VaLiDRec: Variable-Length LLM-Aligned Semantic IDs for Generative Recommendation

链接：https://arxiv.org/abs/2607.25209

作者：Shutong Qiao,Wei Yuan,Tong Chen,Hao Wang,Quoc Viet Hung Nguyen,Hongzhi Yin

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：recommendation commonly represents, commonly represents items, constructed through clustering, clustering and quantization, fixed-length semantic identifiers

备注： 10 pages, 4 figures, 5 tables

点击查看摘要

Abstract:Generative recommendation commonly represents items using fixed-length semantic identifiers (SIDs) constructed through clustering and quantization. However, these artificial codes may overcompress item semantics, remain misaligned with pretrained LLM vocabularies, and require costly autoregressive decoding. In light of this, we propose VaLiDRec, a generative recommendation framework based on variable-length, LLM-aligned semantic identifiers. VaLiDRec constructs SIDs directly from informative native LLM vocabulary tokens via token importance estimation, semantic-quality-aware pruning, and collision-aware refinement, allowing identifier lengths to adapt to item semantic complexity. To model user preferences, VaLiDRec incorporates graph-aware soft prompts and reformulates recommendation as token-set prediction with token-level item scoring, eliminating autoregressive SID generation and beam search. Experiments on four real-world datasets show that VaLiDRec consistently outperforms strong sequential and generative recommendation baselines across all evaluation metrics. It further achieves superior zero-shot item cold-start performance and 87.49$\times$ faster inference than LC-Rec. These results demonstrate that LLM-native variable-length semantic identifiers provide a more expressive and efficient paradigm for generative recommendation.

19. 【2607.25182】abRank: Chain-of-Thought Distillation for Table Re-Rankers

链接：https://arxiv.org/abs/2607.25182

作者：Adarsh Singh,Kushal Raj Bhandari,Jianxi Gao,Soham Dan,Vivek Gupta

类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)

关键词：structured information retrieval, retrieve relevant tables, ability to retrieve, retrieve relevant, key task

备注： 8 pages, 3 figures

点击查看摘要

Abstract:The ability to retrieve relevant tables for answering questions is a key task for structured information retrieval. Multi-stage retrieval systems rely heavily on rerankers to refine candidate lists produced by efficient first-stage retrievers. As a result, neural rerankers and LLM-based reranking methods have become increasingly important due to their superior capacity for semantic understanding and reasoning compared to conventional sparse or dense retrieval models. Recently, Large Reasoning Models (LRMs) equipped with explicit chain-of-thought (CoT) reasoning have shown strong improvements in ranking quality in unstructured passage retrieval. In this work, we present TabRank, a framework for training reasoning rerankers for Tabular Retrieval. We first present a comprehensive dataset of 6728 reasoning traces for tabular reranking on the Natural Questions Tables dataset. We then explore two variants of training a compact reasoning model on these reasoning traces: explicit CoT distillation and conditioning the student reranker on the teacher's reasoning trace within the prompt. We stress-test TabRank on several out-of-distribution generalization settings on diverse domains and multi-table scenarios. Our approach significantly improves performance across a variety of table retrieval datasets, increasing Acc@10 by 30.5% on HybridQA, 15.2% on SQA, 52.9% on TabFact, and 13.1% on TATQA subsets of the Multi-Table QA Benchmark compared to the base model. Notably, TabRank generalizes effectively to multi-table reasoning. Our code, data and models are available at this https URL

20. 【2607.25180】Bekko Embedding: Parameter-Efficient Multilingual Retrieval with Ultra-Compact Encoders

链接：https://arxiv.org/abs/2607.25180

作者：Yuichi Tateno

类目：Information Retrieval (cs.IR)

关键词：competitive multilingual retrieval, multilingual retrieval model, official MMTEB Multilingual, competitive multilingual, present Bekko Embedding

备注： 45 pages, 9 figures. Model weights and training data: [this https URL](https://huggingface.co/hotchpotch)

点击查看摘要

Abstract:How small can a competitive multilingual retrieval model be? We present Bekko Embedding: its smallest model, bekko-embedding-v1-a8m, has just under 8M Active Parameters (AP) -- the non-embedding parameters that dominate inference compute -- yet on official MMTEB Multilingual v2 Retrieval (nDCG@10) it scores 56.2, above the multilingual-e5 family and BGE-M3 (40x the AP) in our comparison. The higher-quality bekko-embedding-v1-a25m (just under 25M AP) reaches 57.5, on par with gte-multilingual-base, and Multilingual NanoBEIR (14 languages) confirms the trend. Both models handle inputs of up to 8192 tokens, and on long-input retrieval (NanoLongEmbed) a25m is the strongest dense model in our comparison. The recipe is deliberately simple. We prune the 22-layer multilingual encoder mmBERT-small to 4 / 13 layers and train the pruned models in two stages -- large-scale contrastive learning on about 1.1 billion multilingual pairs from our public corpus, followed by hard-negative fine-tuning with 8192-token long-document negatives -- with a masked contrastive loss whose direction depends on pair type, plus the Matryoshka objective. No teacher distillation is used, and all training completes on a single GPU in about 3 days for a8m. Small AP pays off directly in speed: among the compared models measured under identical conditions, a8m is the fastest on both CPU and GPU -- 1.6x multilingual-e5-small on x86 CPU -- and the fastest on a Raspberry Pi 5. The 384-dimensional output (truncatable to 256/128/64) keeps similarity search and indexing cheap, and row-wise int8 quantization of the vocabulary embedding shrinks the a8m ONNX / OpenVINO build to 124 MiB, which runs in the browser via this http URL. To support reproducible research, we release the model weights, the complete stage-1 corpus, and the independently mined stage-2 hard negatives.

21. 【2607.25151】HiEviDR-Bench: A Benchmark for Hierarchical Evidence Aggregation in Deep Research

链接：https://arxiv.org/abs/2607.25151

作者：Yubo Sun,Chunyi Peng,Yukun Yan,Zhenghao Liu,Sen Mei,Bangrui Xu,Xuanhe Zhou,Chi Chen,Maosong Sun

类目：Information Retrieval (cs.IR)

关键词：Deep research requires, large-scale heterogeneous sources, answer complex queries, produce analytical reports, Deep research

备注： Code and data are available at [this https URL](https://ai9stars.github.io/HiEviDR-Bench.github.io)

点击查看摘要

Abstract:Deep research requires models to retrieve, connect, and synthesize evidence from large-scale heterogeneous sources to answer complex queries and produce analytical reports. Existing benchmarks mainly evaluate final outcomes, such as answer correctness, report quality, or citation alignment, while providing limited visibility into whether evidence is correctly selected, linked, and aggregated into supported claims and conclusions. To address this gap, we introduce HiEviDR-Bench, a benchmark for evaluating Hierarchical Evidence Aggregation in Deep Research. HiEviDR-Bench covers open-domain and academic-domain settings under both text-only and multimodal conditions, and represents each instance with an explicit evidence graph that captures evidence selection, cross-source linking, and aggregation from evidence to intermediate claims and final conclusions. Based on this formulation, we develop a traceability-oriented evaluation framework with five dimensions: report quality, evidence traceability, citation accuracy, claim verification, and answer correctness, together with a progressive gating mechanism for fine-grained error localization. HiEviDR-Bench contains 2,000 human-validated questions with evidence graphs across multiple difficulty levels. Experiments on 16 representative multimodal large language models show that, although many systems achieve strong report quality, their performance drops markedly on citation accuracy, claim construction, and answer correctness. Further analysis shows that the main bottlenecks lie in evidence identification and intermediate claim construction, revealing that strong surface-level report quality does not necessarily imply grounded multi-stage reasoning on our benchmark.

22. 【2607.25110】Memory Layer: Train the In-Model Cache for Recommendation Models

链接：https://arxiv.org/abs/2607.25110

作者：Liangyuan Na,Gufan Yin,Yixin Bao,Xianjie Chen,Justin Lin,Ziheng huang,Xinyuan Zhang,Wen Zhang,Hao Lin,Xiaoheng Mao,Shuo Tang,Min Yu,Lei Chen,Chao yang,Ziliang Zhao,Mengjiao Zhou,Zheng Qi,Dmitry Barablin,Chuo-Yun Yang,Kaustubh Vartak,Tingting Zhang,Arun Kumar Singh

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：Early ranking stages, strict latency constraints, Early ranking, recommendation systems precompute, latency constraints

备注：

点击查看摘要

Abstract:Early ranking stages in recommendation systems precompute item embeddings and cache them in-model for scoring within strict latency constraints. Because this cache exists only at serving time, outside the training loop, training and serving use different item representations, a structural discrepancy that limits quality and adds operational fragility. We show that co-designing the training and serving paths removes this representation discrepancy at its source. We introduce the memory layer, an in-model key-value embedding cache co-trained with the model: the item tower writes embeddings during training and the model reads them at serving, one source of truth for item representations by construction. Always-on embeddings cover items not yet cached, so every item receives a prediction, and the design consolidates three separate trainer-to-predictor update paths into a single self-contained pipeline. Deployed in production on Instagram Reels, the memory layer raises prediction coverage from 96% to 100%, improves embedding freshness from $O(5\text{ min})$ to $O(20\text{ s})$, and narrows the training-serving Normalized Entropy (NE) gap by up to 86%, yielding over $2\times$ recall for the freshest content and a 5-6% cold start engagement lift. Because embeddings are produced during training, the system needs no separate bulk-evaluation or publish-time recomputation, cutting training-and-publish computational cost by 30% at neutral serving computational cost.

23. 【2607.25097】On the Convergent Validity of Offline Evaluation Designs for Recommender Systems

链接：https://arxiv.org/abs/2607.25097

作者：Sushobhan Parajuli,Samira Vaez Barenji,Michael D. Ekstrand

类目：Information Retrieval (cs.IR)

关键词：common evaluation methodology, historical interaction logs, Offline evaluation, evaluation, offline evaluation design

备注： 9 pages, Accepted at ACM RecSys 2026 Main Track

点击查看摘要

Abstract:Offline evaluation on historical interaction logs is the most common evaluation methodology for recommender systems. However, such evaluations depend on sparse, incomplete, or biased data, which raises concerns about whether commonly used evaluation setups reliably reflect true user preferences. In this work, we study how offline evaluation design choices affect the validity of recommender system comparisons. We evaluate a set of recommendation models across several evaluation setups that vary key factors such as data filtering thresholds and candidate set construction. To assess the validity of these configurations, we measure the correlation between model rankings obtained from conventional train-test splits on sparse interaction data and rankings from evaluations based on dense ground-truth user feedback. We use this agreement as an indication of their validity with respect to true user preferences. Our results show that the validity of sparse evaluation depends on the dataset and the specific dense evaluation targets, and that there is no uniformly best offline evaluation design.

24. 【2607.25041】ScoreShield: Differentially Private Release of Similarity Scores

链接：https://arxiv.org/abs/2607.25041

作者：Behrooz Razeghi,Parsa Rahimi

类目：Information Retrieval (cs.IR); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：retrieval-augmented generation, embeddings of text, biometrics and retrieval-augmented, similarity scores computed, growing number

备注：

点击查看摘要

Abstract:A growing number of applications, such as biometrics and retrieval-augmented generation (RAG), rely on cosine similarity scores computed between vector embeddings of text, images, or audio. These systems return similarity scores through their APIs for ranking and verification. However, such releases can leak information about individual records and enable membership inference attacks. While differential privacy (DP) provides a principled metric for quantifying attack risks, naïve application of DP mechanisms---such as adding i.i.d. Gaussian noise to vector entries---leads to excessive distortion (i.e., low utility) at a given privacy constraint that scales poorly with the number of released scores. We propose \textsc{ScoreShield}, a perturb-then-project mechanism that adds Gaussian noise calibrated to global sensitivity of the chosen score release regime and then projects the result onto the feasibility set of valid cosine objects. \textsc{ScoreShield} satisfies $(\varepsilon,\delta)$-DP for releasing similarity score vectors and Gram matrices. We provide utility guarantees for the exact Frobenius metric projection used in the risk analysis, and prove convergence to feasibility for the practical averaged alternating-projection solver used for large-scale Gram releases. For full pairwise cosine Gram release under record-level replacement adjacency, the exact-projection bound improves the $n$-dependence of squared Frobenius risk from $\Theta(n^3)$ for the naïve Gaussian baseline to $\mathcal{O}(n^2)$ for fixed privacy parameters, with sharper local bounds at low-rank Grams. We evaluate the mechanism across RAG, face recognition, semantic retrieval, image similarity, and recommender-system tasks.

25. 【2607.25038】Grounded in Consensus, In Step With Emerging Science: A Consensus-Anchored Multi-Corpus Clinical Chatbot for Long COVID

链接：https://arxiv.org/abs/2607.25038

作者：Yining Wu,Philip DiGiacomo,Ying Ding,William Brode

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：Long COVID, clinical decision support, evidentiary roles, poses a challenge, update cycles

备注：

点击查看摘要

Abstract:Long COVID (LC) poses a challenge for clinical decision support because relevant evidence is distributed across sources with different update cycles, evidentiary roles, and levels of clinical maturity. We present a clinician-facing chatbot that organizes four sources within a retrieval-augmented workflow: expert-curated consensus guidance, current PubMed literature, registered interventional trials, and evidence from living systematic reviews. Consensus guidance is always included to frame responses, while the remaining sources are retrieved in parallel when selected by the user. In an exploratory automated evaluation on 50 clinician-facing questions, our chatbot showed comparable mean ratings to OpenEvidence, with numerically higher scores and lower score variability in an LLM-judged comparison.

26. 【2607.24882】Agent Retrieval Bench: Evaluating Repository Context Retrieval for Coding Agents

链接：https://arxiv.org/abs/2607.24882

作者：Bowen Qin,Yi Xie

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Modern coding agents, earlier context-acquisition stage, patch generation depends, Modern coding, Agent Retrieval Bench

备注：

点击查看摘要

Abstract:Modern coding agents are usually evaluated by whether they eventually produce a correct patch, but patch generation depends on an earlier context-acquisition stage: finding the repository files needed for the task. We introduce Agent Retrieval Bench, a file-level benchmark for this upstream retrieval problem. Samples are built from real coding-workflow signals and evaluated against frozen base-commit repositories, with relevance defined by what an agent needs next rather than direct query-file semantic similarity. The benchmark covers four positive-retrieval tasks: code2test, comment2context, trace2code, and edit2ripple; a fifth subset evaluates selective retrieval using natural evidence-backed no-gold cases and counterfactual wrong-repository controls. Agent Retrieval Bench contains 427 samples across 25 repositories: 345 positive examples, 50 natural no-gold examples, and 32 counterfactual controls. The corpus includes 308 base-commit snapshots, 392,000 files, and 7.9 million chunks. We evaluate lexical retrieval, RepoMap, open-source embeddings, selective abstention, and logged agent context selection. No single retrieval family dominates: Qwen3-Embedding-4B has the best sample-weighted MRR on positive samples, Qwen3-Embedding-8B the best Recall@20, and RepoMap the best budgeted context yield at 8K tokens, with task-level winners differing substantially. Selective thresholds calibrated with counterfactual controls do not improve selective success on natural no-gold cases, revealing a calibration gap. Logged trajectories also miss every gold file on 27-35 percent of samples. A controlled seed-intervention pilot finds that retrieval-derived initial context yields higher file F1 with less post-seed exploration than random non-gold context, while oracle gold context shows substantial remaining headroom.

27. 【2607.24869】Ranked by Position: Order Sensitivity as an Exploitable Attack Surface in LLM Listwise Recommenders

链接：https://arxiv.org/abs/2607.24869

作者：Ge Zhang,Jingru Cheng,Huiyuan Chen

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Large language models, recommendation systems suffer, Large language, serializing candidate sets, sets into prompts

备注： 13 pages, 6 figures, 11 tables. Code and data available at [this https URL](https://github.com/geoz-lab/position_bias_attack)

点击查看摘要

Abstract:Large language models (LLMs) used as listwise rerankers in recommendation systems suffer from position bias when serializing candidate sets into prompts. We show this order sensitivity creates an exploitable attack surface: an attacker can promote a label-0 target into the top-$k$ solely by reordering candidates, without changing item content, labels, or model parameters. We introduce $\mathrm{promo}@k$ to quantify this vulnerability, measuring the fraction of label-0 targets that can be elevated into top-$k$ rankings via permutation. Evaluating across three domains (MovieLens, Amazon Books, and Amazon Fashion), $\mathrm{promo}@5$ reaches up to 0.57 at an attack budget of $R$ = 50 orderings. Furthermore, ordinary permutation stability predicts vulnerability without running the attack. While a bidirectional T5 encoder scorer reduces exposure, permutation-consistency regularization and architectural invariance effectively mitigate it. Pointwise scoring avoids the bias issue but degrades ranking quality. These results demonstrate that input candidate order in listwise LLM reranking is a security-relevant attack vector. Code and data are available at this https URL.

28. 【2607.24865】okens are All You Need: Dual-purpose Semantic IDs for Achieving LLM-Level I/O Efficiency in recommendation systems

链接：https://arxiv.org/abs/2607.24865

作者：Baolei Li,Yiping Yuan,Yilin Zheng,Likang Yin,Ling Liu,Fabio Soldo,Romer Rosales,Xinyang Yi,Lichan Hong

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：Memory Wall, bottlenecks due, Large-scale recommendation, Large-scale recommendation systems, Large-scale

备注： RecSys 2026

点击查看摘要

Abstract:Large-scale recommendation systems face "Memory Wall" bottlenecks due to massive, dense embedding tables. While generative retrieval uses discrete tokens for IDs, high-dimensional context still relies on inefficient dense formats. Inspired by computer vision data compression, we propose Dual-purpose Semantic IDs to achieve LLM-level I/O efficiency. Our methodology uses hierarchical quantization to condense continuous embeddings into discrete Semantic IDs performing two concurrent roles: (1) Collaborative Identity: modeling user-item interactions via learnable embedding table; and (2) Content Reconstruction: using a lightweight Semantic Decoder for on-the-fly embedding approximation. This approach replaces massive vector storage with on-demand reconstruction, reducing system overhead and data footprints. We demonstrate the efficacy of our framework through offline evaluations and successful online deployment in production-scale ranking and retrieval systems at a major video sharing platform, showing that discrete tokens are indeed all you need for highly efficient, content-rich recommendation.

29. 【2607.24862】KuaiLive-M3: A Multi-Modal, Multi-Domain, and Multi-Feedback Dataset for Live Streaming Recommendation

链接：https://arxiv.org/abs/2607.24862

作者：Ke Guo,Changle Qu,Jiayaqi Cheng,Xiao Zhang,Shijun Wang,Xiaoyu Zhang,Xueliang Wang,Le Zhang,Lantao Hu,Jun Xu

类目：Information Retrieval (cs.IR)

关键词：live streaming, Existing public live, live streaming recommendation, captures users' perceived, overlook users' cross-domain

备注：

点击查看摘要

Abstract:Existing public live streaming datasets suffer from three major limitations: they provide limited access to temporally evolving multimodal live content, overlook users' cross-domain interactions between short videos and live streams, and contain only implicit behavioral signals without explicit feedback that captures users' perceived content quality and satisfaction. These limitations prevent existing benchmarks from faithfully reflecting real-world live streaming scenarios and hinder comprehensive research on live streaming recommendation. To address these limitations, we introduce KuaiLive-M3, a multi-modal, multi-domain, and multi-feedback dataset for live streaming recommendation, collected from Kuaishou, a leading live streaming and short video platform in China. KuaiLive-M3 covers 21,938 users and contains 35 million live streaming interactions and 111 million short video interactions, with fine-grained timestamps and diverse user behaviors. It further provides approximately 88 million timestamped segment-level multi-modal embeddings that capture the temporal evolution of live streaming content, as well as 25,403 questionnaire-based feedback records that bridge implicit user behaviors and explicit user preferences. Based on these unique signals, we establish benchmarks for cross-domain recommendation, live stream highlight prediction, and questionnaire-enhanced recommendation. Extensive experiments with representative baselines demonstrate that KuaiLive-M3 provides a challenging and realistic benchmark for future live streaming recommendation research. The results further highlight the importance of modeling temporally evolving content, transferring user preferences across domains, and bridging the gap between implicit behaviors and explicit user feedback. The dataset and benchmark code are publicly available at this https URL.

30. 【2607.24861】HVM-GraphRAG: Holistic-View Multimodal Graph Retrieval-Augmented Generation on Complex Document

链接：https://arxiv.org/abs/2607.24861

作者：Xin He,Yili Wang,Wenqi Fan,Qing Li,Qinggang Zhang,Yi Chang,Xin Wang

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：distant document regions, Question answering, regions and modalities, distributed across distant, complex documents requires

备注：

点击查看摘要

Abstract:Question answering (QA) over complex documents requires models to retrieve and integrate evidence distributed across distant document regions and modalities. Multimodal GraphRAG provides a promising direction by organizing document evidence with graph structures. However, existing methods often suffer from unreliable cross-modal evidence indexing and expensive graph traversal. To address these issues, we propose HVM-GraphRAG, a holistic-view multimodal GraphRAG framework on complex document. HVM-GraphRAG uses a holistic view to guide graph construction, thereby reducing noisy and conflicting graph updates and building reliable indices between concept-level graph nodes and supporting multimodal chunks. During retrieval, HVM-GraphRAG searches over a compact concept-level graph and directly accesses supporting evidence through the constructed index, avoiding costly traversal over dense entity-level graphs. After obtaining the retrieved evidence, HVM-GraphRAG further reorganizes chunks into modality-specific groups, enabling the answering model to better integrate heterogeneous evidence. Experiments on three datasets show that HVM-GraphRAG achieves the best answer performance in most evaluated settings while substantially improving online retrieval efficiency over representative graph-based baselines.

31. 【2607.24850】SearchArt: Training Long-Horizon Search Agent with Scalable Synthetic and Verified Task

链接：https://arxiv.org/abs/2607.24850

作者：Lang Mei,Xiaohan Yu,Chong Chen,Liyan Liu,Xiangnan Chen,Jinchao Ma,Chao Feng,Li Huang,Siyu Mo,Sichen Kang,Yunkun Xu,Zhihan Yang,Zhujun Xue,Jingren Zhang,Qing He,Yingdi Huang,Hao Jiang,Ziao Ma,Zewei Pan,Minhao Sun,Zhuo Tao,Jinzhao Xiao,Gangtao Xin,Huanyao Zhang,Wenjian Zhang,Jiangshan Zhang,Guojie Zhu,Jiaxin Mao,Wentao Zhang

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：large language models, Recent advances, autonomously tackle complex, enabled search agents, search agents

备注：

点击查看摘要

Abstract:Recent advances in large language models (LLMs) have enabled search agents to autonomously tackle complex tasks across extended search and reasoning horizons. However, training effective search agents remains challenging due to the lack of scalable and long-horizon tasks, and the difficulty of evaluating and correcting intermediate reasoning and tool-use behaviors. We introduce SearchArt, a scalable framework for training long-horizon search agents through verification-driven task synthesis and a multi-stage post-training pipeline. SearchArt constructs large-scale datasets for complex search-, research- and user-oriented tasks by synthesizing diverse information-seeking QA pairs and corresponding search trajectories from web documents and automatically generated evidence graphs. To ensure the reliability of the synthesized data, we design a verification pipeline that jointly evaluates QA consistency, trajectory quality, and the relevance of retrieved evidence. The verified trajectories are subsequently used in a multi-stage training process comprising supervised fine-tuning and reinforcement learning-based policy optimization. Search agents trained with SearchArt exhibit adaptive search planning, iterative evidence aggregation, and complex reasoning over extended interaction horizons. Experimental results demonstrate that, with only (Qwen3.5-) 27B parameters, SearchArt scores 74.39 on BrowseComp-ZH, 70.06 on BrowseComp, and 52.55 on Deepresearch-bench, matching or surpassing frontier closed-source agents on both deepsearch and deepresearch benchmarks.

32. 【2607.24846】wo Views, One Voice: Evidence-Grounded Conversational Music Recommendation

链接：https://arxiv.org/abs/2607.24846

作者：Sungwook Yoo,Sewook Yoo

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Traditional conversational recommenders, single text interface, conversational recommenders entangle, Traditional conversational, dialogue intent evolves

备注： 5 pages, 4 figures, 5 tables. 4th-place solution (team swyoo) in the Blind-B industry track of the ACM RecSys Challenge 2026

点击查看摘要

Abstract:Traditional conversational recommenders entangle retrieval and response generation within a single text interface, so exact entity cues fade as the dialogue's intent evolves, which compromises explanation credibility. We address this within the ACM RecSys Challenge 2026, which mandates both top-20 ranking and evidence-grounded response generation. This paper presents the third-place solution by team "swyoo" for the Blind-B industry track. We decouple retrieval and response into separate pipelines connected strictly via ranked tracks and metadata. Retrieval combines a hybrid lexical-dense pool for exact matching with a task-adapted pool driven by fine-tuned Qwen 8B adapters. Candidates are calibrated via LightGBM, then routed to an evidence-grounded propose-assign-select (PAS) framework to structure responses. This system also ranked second on the explanation-quality leaderboard in the final blind evaluation. Our findings demonstrate that: (i) isolating retrieval and response preserves both catalog cues and fluid intent; (ii) structuring generation via explicit evidence assignment is key to this near-best-in-class explanation reliability.

33. 【2607.24845】REPREC: Representation Driven Parameter-Efficient Recommendation System

链接：https://arxiv.org/abs/2607.24845

作者：Harshini Kavuru,Dwipam Katariya,Giri Iyengar,Pranab Mohanty,Kalanand Mishra,Kalanand Mishra

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：Large language models, natural language task, Large language, language models, language task

备注：

点击查看摘要

Abstract:Large language models (LLMs) have been applied to sequential recommendation by formulating it as a natural language task. Previous work has improved personalization by incorporating collaborative and sequential signals through input conditioning or LLM fine-tuning. However, existing approaches often rely on one or more of the following: LLM fine-tuning, additional architectural modules, representation distillation, or item-level conditioning over long interaction histories, increasing training complexity and deployment cost. We propose REPREC, a lightweight framework that reformulates LLM-based sequential recommendation through lightweight user representation alignment. REPREC maps a fixed-size user embedding from a frozen sequential encoder into a small set of learned soft tokens through a lightweight MLP injector that conditions a frozen LLM, leaving both pretrained backbones unchanged while training only the injector. We conducted exhaustive experiments on multiple benchmark datasets and demonstrate that REPREC consistently outperforms LoRA while remaining compatible with different pretrained sequential encoders and LLM backbones, enabling a modular and production-friendly recommendation pipeline without modifying either pretrained component. The gains are particularly pronounced for casual and core users across all datasets, highlighting REPREC's effectiveness in low-data regimes. Finally, when trained on short prompt histories and evaluated with longer contexts, REPREC maintains 85-100% of LoRA's performance while reducing per-epoch training time by an average of 1.51X, demonstrating an effective balance between recommendation quality and computational efficiency for production deployment. The code is available at this https URL

34. 【2607.24838】MedJudgeRAG: Option-Wise Evidence Judgment with Dynamic Knowledge Graphs for Medical MCQA

链接：https://arxiv.org/abs/2607.24838

作者：Seongwon Seo,Seung Hwan Cho,Young-Min Kim

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：multiple-choice question answering, Retrieval-Augmented Generation, medical multiple-choice question, question answering, multiple-choice question

备注： 16 pages, 2 figures, Accepted at The Workshop on Graph Foundation Models at the 43 rd International Conference on Machine Learning (ICML 2026)

点击查看摘要

Abstract:In medical multiple-choice question answering (MCQA), Retrieval-Augmented Generation (RAG) can supplement the domain knowledge of language models (LMs). However, since vanilla RAG indiscriminately utilizes retrieved documents, it can degrade LM performance. To address this, we propose MedJudgeRAG. Our framework represents retrieved documents as a dynamic knowledge graph (KG) composed of entities and relations. For each option, the model judges an evidence verdict from the retrieved documents and the KG. Based on the verdict combination, the model determines a knowledge utilization strategy to reason toward the final answer. These capabilities are trained via supervised fine-tuning using structured reasoning traces generated by a teacher LM. The training employs a weighted cross-entropy loss that differentially weights the KG and reasoning segments. Experiments on two medical MCQA benchmarks demonstrate that MedJudgeRAG consistently outperforms both vanilla RAG and parametric baselines. Furthermore, ablation analysis reveals that the dynamic KG is more effective as graph-conditioned supervision at training time than as an explicit output at inference time. Our code is available at this https URL, and the generated reasoning traces are released at this https URL.

35. 【2607.24829】Improving Rare Medication Recommendation with Counterfactual Data Augmentation and Large Language Models

链接：https://arxiv.org/abs/2607.24829

作者：Shinhwan Kang,Soo Yong Lee,Jaewon Kim,Kijung Shin,Buru Chang

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：attracted substantial attention, substantial attention due, enhance patient safety, therapeutic outcomes, AI-based medication recommendation

备注： Accepted for publication at the 20th ACM Conference on Recommender Systems (RecSys 2026)

点击查看摘要

Abstract:AI-based medication recommendation systems have attracted substantial attention due to their potential to enhance patient safety and therapeutic outcomes. Despite the clinical importance of accurately recommending rarely prescribed medications (rare-meds), we observe that most existing methods show significantly lower predictive performance for rare-meds. We attribute this issue to two intrinsic limitations: (a) the inherent scarcity of data for rare-meds and (b) limited consideration of co-recommended medications. To address these limitations, we propose GenRxR, a novel framework based on large language models (LLMs). GenRxR leverages the medical knowledge and clinical reasoning capability of LLMs to generate counterfactual medical data, mitigating the data scarcity issue for rare-meds. It also integrates an LLM into the medication recommendation process to model relationships among co-recommended medications. To further enhance the clinical reasoning, we introduce an instruction tuning step that aligns the LLM's capability with the recommendation task, enabling better handling of clinical context, including rare-meds cases. In our experiments, we show that GenRxR outperforms 14 (including 5 LLM-based) baselines in most cases. Specifically, it achieves up to 30.9% higher predictive performance for rare-meds than the strongest baseline.

36. 【2607.24826】Aethel: A Reproducible Graph-Retrieval Framework for Multi-Hop Financial Diligence

链接：https://arxiv.org/abs/2607.24826

作者：Krish Sapru

类目：Information Retrieval (cs.IR); Multiagent Systems (cs.MA)

关键词：Secondary private equity, private equity transactions, equity transactions require, transactions require rapid, require rapid synthesis

备注： 11 pages, 3 figures, 2 tables. Includes evaluations on MuSiQue, 2WikiMultiHopQA, and a 4,123-chunk financial-disclosure corpus. Code and evaluation artifacts are available for reproducibility

点击查看摘要

Abstract:Secondary private equity transactions require rapid synthesis of fragmented, unstructured financial disclosures, where critical metrics and their entity anchors are distributed across disjoint documents with limited lexical overlap. We present Aethel, a reproducible framework that combines bipartite Personalized PageRank graph retrieval with a coreference-aware Bipartite Coreference Teleportation layer and an orchestrated specialist-agent architecture. Aethel models corpora as entity-passage graphs and propagates relevance through explicit relational paths to support multi-hop financial diligence. We evaluate the retrieval layer on 200-question samples from the MuSiQue and 2WikiMultiHopQA validation sets, comparing sparse lexical, dense bi-encoder, vanilla graph, and coreference-aware graph retrieval. Aethel achieves HR@5 of 100.0% on 2WikiMultiHopQA and 88.5% on MuSiQue, improving coverage over vanilla graph retrieval while trading off top-rank precision. We also evaluate retrieval over a 4,123-chunk corpus of financial disclosures and find that graph retrieval outperforms dense retrieval on multi-hop recall but does not surpass a strong BM25 baseline at open-corpus scale. The results show that graph-based retrieval offers interpretable multi-hop evidence paths and degrades more gracefully than dense retrieval as corpus size grows, while also demonstrating that its advantage depends strongly on corpus scale and entity-index quality. Code and evaluation artifacts are released for reproducibility.

37. 【2607.24824】Retrieval-based and Fine-tuned LLM Approaches for Industrial Asset Health Monitoring and Decision Support

链接：https://arxiv.org/abs/2607.24824

作者：Seshu Kumar Damarla,Xiuli Zhu

类目：Information Retrieval (cs.IR)

关键词：Industrial plants run, plants run, diagnose machine problems, Industrial plants, IBM Research

备注： 6 pages, 4 figures, 6 tables

点击查看摘要

Abstract:Industrial plants run many important machines such as pumps, turbines, and compressors. Although engineers can use their experience to identify and diagnose machine problems, transferring this reasoning ability to computer systems remains difficult. This work studies how well a retrieval-only method and an open-source large language model (LLM) perform failure-sensor diagnostic reasoning using the FailureSensorIQ benchmark, a multiple-choice question-answering task introduced by IBM Research. In the retrieval-only approach, each answer option is converted into an option-level query and scored using similar correct and incorrect records from the training data. TF-IDF, BM25, semantic search, and hybrid search are tested and compared. In the LLM-based approach, the Qwen2.5-7B-Instruct model is evaluated using zero-shot prompting, few-shot prompting, and QLoRA fine-tuning. The results show that semantic search and hybrid search perform better than pure keyword-matching techniques, indicating that meaning-based similarity is more important for industrial failure-sensor reasoning. Among the LLM-based methods, the fine-tuned model achieves the best performance and substantially improves over zero-shot and few-shot prompting. Error analysis shows that performance decreases as the number of answer options increases. Robustness analysis also shows that all methods are sensitive to option shuffling, changed labels, paraphrasing, and additional distractors.

38. 【2607.24822】A Position Paper on Recommender Systems in the Era of Autonomous Agents

链接：https://arxiv.org/abs/2607.24822

作者：Aixin Sun

类目：Information Retrieval (cs.IR)

关键词：serve human users, optimized to serve, human users, Abstract, serve human

备注： Accepted to the ACM RecSys 2026 Main Track

点击查看摘要

Abstract:For decades, recommender systems have been optimized to serve human users. However, the rapid deployment of autonomous agents introduces a paradigm shift: recommendation consumers are predicted to be increasingly a mixture of humans and authorized agents acting on their behalf. This position paper reviews insights from prior human-centric RecSys research and outlines the transition to this hybrid environment. In our discussion, we treat agents as independent, user-aligned assistants that act as end-users of recommender systems, rather than platform-built components. We characterize the resulting tripartite interactions among humans, agents, and platforms, highlighting the dynamics that can arise across these relationships. This shift presents new opportunities for RecSys research, while introducing unique challenges for evaluation, alignment, and system design.

39. 【2607.24818】Dual-Level Atomic and Coordination Geometry Learning for Crystal Property Prediction Using Graph Neural Networks

链接：https://arxiv.org/abs/2607.24818

作者：Sanjay Chakraborty

类目：Information Retrieval (cs.IR); Materials Science (cond-mat.mtrl-sci); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)

关键词：computational materials science, crystal properties remains, Coordination Polyhedron Graph, remains a key, key challenge

备注：

点击查看摘要

Abstract:Accurate prediction of crystal properties remains a key challenge in computational materials science. While graph neural networks (GNNs) such as CGCNN, MEGNet, ALIGNN, and SchNet have shown strong performance, they primarily represent crystals at the atomic level and implicitly learn local chemical environments through message passing. However, many material properties are governed by coordination polyhedra, the fundamental structural units formed by atoms and their neighboring atoms. To address this limitation, we propose the Coordination Polyhedron Graph Network (CPGN), a multi-scale GNN that jointly learns atomic, bond, and coordination-polyhedron representations. CPGN constructs three coupled graphs: an atom graph encoding elemental and bonding information, a line graph capturing angular interactions, and a coordination polyhedron graph describing Voronoi-derived local environments through corner-, edge-, and face-sharing relationships. Physically meaningful geometric descriptors are incorporated for each polyhedron, while an interleaved message-passing mechanism with bidirectional cross-attention enables effective information exchange across structural levels. Extensive evaluations on the Materials Project, JARVIS-DFT, and QM9 benchmark datasets demonstrate that CPGN outperforms existing state-of-the-art GNN models. It achieves a formation-energy MAE of 0.060 eV/atom and a band-gap MAE of 0.292 eV on the Materials Project, while providing competitive multi-property prediction on JARVIS-DFT and superior HOMO prediction on QM9. The results highlight that explicit modeling of coordination polyhedra improves crystal representation learning and enables accurate, physically interpretable prediction of material properties.

40. 【2607.24817】Retrieval-Augmented Generation in LLMs for Mental Health: Quantifying the Incremental Contribution of Retrieval Within a Layered Safety Architecture

链接：https://arxiv.org/abs/2607.24817

作者：Anand Gupta,Akshat Surolia,Shubham Mishra,Shakil Imtiaz,Chaitali Sinha

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：accurately detect users', detect users' intent, offer scalable support, Retrieval Augmented Generation, Digital mental health

备注： 11 pages, 6 figures

点击查看摘要

Abstract:Digital mental health interventions (DMHIs) offer scalable support, but ensuring they accurately detect users' intent during volatile situations can be challenging. Pure parametric Large Language models (LLMs) do not contain specific safety critical architecture, and can miss critical cues, or hallucinate, undermining reliability. Retrieval Augmented Generation (RAG), which supplements an LLM with retrieved context, could enhance intent detection during volatile situations. Commercially available DMHIs typically combine multiple independent safety layers like rule-based filters, symbolic escalation protocols, and neural classification. The incremental contribution of any single layer, however, remains unquantified. This paper evaluates six LLM models within a DMHI called Wysa, via a controlled comparison of RAG-enabled versus RAG-disabled modes. Anonymized real and synthetic user-chatbot exchanges were annotated by a qualified clinical team against multi-class intent categories (e.g. self-harm, abuse, panic). The study computed classification accuracy, recall, precision and F1 scores against ground truth labels and tested differences for statistical significance. Performance was also examined by risk category and inter-model agreement. While RAG caused a rise in false alarms, the trade-off is consistent with safety-critical design principles that prioritize sensitivity, where flagged cases are routed to additional review rather than acted on directly. Overall, these findings support RAG as a promising approach to improve the accuracy, consistency and safety of LLM-driven DMHIs. Keywords: Digital Mental Health Intervention, Large Language Model, Retrieval Augmented Generation, Accuracy, Recall, Precision

Comments:
11 pages, 6 figures

Subjects:

Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

Cite as:
arXiv:2607.24817 [cs.IR]

(or
arXiv:2607.24817v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.24817

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

41. 【2607.24804】Bumblebee: Interleaved Mixed-Layer Building Blocks for Large-Scale Recommendation Systems

链接：https://arxiv.org/abs/2607.24804

作者：David Bauer,Cancan Zhang,Wenshun Liu,Xiaoyi Zhang,Weijia Liu,Wanli Ma,Yue Weng,Wei Li,Rui Li,Jing Qian,Huayu Li,Xiaoyi Liu,Linhong Zhu,Jerry Fu

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：undergone significant transformations, past years, systems have undergone, undergone significant, significant transformations

备注：

点击查看摘要

Abstract:Recommendation systems have undergone significant transformations in the past years. The transition from traditional feature interaction modules to generative next-action prediction has pushed the boundaries of personalized content. Developments have largely evolved along two separate tracks. Sequence modeling approaches on the one hand and feature interaction methods on the other. In this paper, we introduce Bumblebee, a recommendation architecture that addresses the lack of interaction between the two directions through an interleaved, stackable block design. Each block implements a micro-pipeline of layers combining sequence personalization, attention-based encoding, and feature crossing into a self-contained unit. Every block produces a joint representation of both feature modalities which is consumed by the next block in the sequence. This mechanism encourages early and repeated mixture of modalities and enriches downstream features with additional contextual information. Residual connections between blocks create cross-modal information pathways and yield additional predictive performance without adding additional parameters. Blocks can be specialized by selectively dropping components, enabling flexible trade-offs between quality and throughput. We evaluate our approach on large-scale industrial data and show consistent improvements over comparable baseline models across several classification and regression tasks. Furthermore, we conduct ablation studies to confirm that the interleaved composition itself is the primary driver of these improvements. Our results suggest that interleaving heterogeneous functional units, rather than composing deep stacks, is a promising paradigm for future-generation recommendation architectures.

42. 【2607.24803】SciClaimSeekers at CheckThat! 2026: Retrieving Scientific Sources for Social Media Claims with LLM Reranking

链接：https://arxiv.org/abs/2607.24803

作者：Mohotarema Rashid,Nansu Baniya,Anirban Saha Anik,Xiaoying Song,Lingzi Hong

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：original scholarly sources, social media faster, posts rarely link, Reciprocal Rank Fusion, Scientific claims

备注： CLEF 2026 Working Notes / CheckThat! Lab at CLEF 2026, Jena, Germany

点击查看摘要

Abstract:Scientific claims often spread on social media faster than they can be verified, while posts rarely link to the original scholarly sources. To tackle this problem this paper presents system called SciClaimSeekers, a retrieval and reranking framework by combining BM25 and zero-shot multilingual E5 retrieval with Reciprocal Rank Fusion (k=60), followed by Qwen2.5-14B-Instruct pointwise reranking. The pipeline reaches 64.36% MRR@5 on the English development set a 13.67-point jump over BM25 and 10.17 points over the unranked hybrid and 64.39% on the official test set, in the CLEF-2026 CheckThat! Task 1 evaluation. Our experiment suggests that large pre-trained models, when combined into a careful pipeline, can be competitive with fine-tuned approaches on this task.

43. 【2607.24802】SourceMinds at CheckThat! 2026: NLI-Grounded Citation Auditing in a Multi-Agent Pipeline for Full Fact-Checking Article Generation

链接：https://arxiv.org/abs/2607.24802

作者：Farhan Sharukh Hasan,Anirban Saha Anik,Eric Liu,Xiaoying Song,Mohotarema Rashid,Lingzi Hong

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：paper presents, Task, CLEF, system for Task, article generation

备注： CLEF 2026 Working Notes / CheckThat! Lab at CLEF 2026, Jena, Germany

点击查看摘要

Abstract:This paper presents our system for Task 3 of the CLEF 2026 CheckThat! Lab, which focuses on generating full fact-checking articles from claims, veracity labels, and evidence documents. We propose a multi-agent pipeline that combines evidence retrieval, structured fact planning, article generation, gated self-critique, and NLI-based citation auditing. The system retrieves claim-relevant evidence using dense retrieval, reranking, and source-balanced selection, then generates a citation-supported article from a structured plan. A gated self-critique stage revises weakly grounded drafts, while the NLI citation auditor repairs missing citations and removes unsupported or redundant ones. The approach highlights the importance of combining evidence selection, structured generation, and post-generation citation validation for source-grounded fact-checking article generation.

44. 【2607.24801】Influence of Prompt Engineering on Small Language Models for Guarded Query Routing

链接：https://arxiv.org/abs/2607.24801

作者：Richard Šléher,William Brach,Kristián Košťál,Lukas Galke Poech

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：Small Language Models, open-weight Small Language, system scope, meets a router, determines the ideal

备注：

点击查看摘要

Abstract:We study the problem of guarded query routing, where we assume that a user query first meets a router that either determines the ideal endpoint for in-distribution queries or rejects out-of-distribution queries that are potentially unsafe or out of the system's scope. We investigate whether compact open-weight Small Language Models (SLMs) can jointly handle both tasks under latency constraints. We evaluate 22 models on GQR-Bench and score them with the harmonic mean of in-distribution and out-of-distribution accuracy. We find that mid-scale SLMs come close to frontier model routing quality at much lower latency. Still, many compact models fail because they do not reliably follow the required output format. However, our results show that prompt optimization techniques enable SLMs to handle such cases gracefully, without changing the models' weights. Moreover, few-shot prompt optimization raises Mistral 7B from 81.79 to 90.87 GQR-Score and lifts Qwen3.5 9B to 95.74, the best optimized score in our study and within 0.3 points of the strongest unoptimized larger model: Gemma 3 27B at 96.01. The bare DSPy signature, without in-context exemplars, is the most effective strategy for Granite 4 Tiny, raising its score from 54.29 to 83.05. These results show that prompt optimization is a useful first step for guarded query routing, while weaker models may still need weight-level adaptation or schema-aware training

45. 【2607.24800】When Thinking Before Retrieval Hurts: TraceBound Diagnostics for Adaptive Knowledge-Graph Retrieval

链接：https://arxiv.org/abs/2607.24800

作者：Partha Sarathi Purkayastha(ETH Zürich)

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：Adaptive retrieval promises, make knowledge-graph question, knowledge-graph question answering, inspect neighborhoods, evidence is sufficient

备注： 11 pages, 4 figures, 15 tables. Accepted at the Failure Modes in Agentic AI (FAGEN) Workshop at ICML 2026

点击查看摘要

Abstract:Adaptive retrieval promises to make knowledge-graph question answering more robust by letting a controller search, inspect neighborhoods, revise actions, and stop when evidence is sufficient. We study this premise by introducing TraceBound, a lightweight profile- and trace-conditioned diagnostic protocol for an ARK-style retriever on text-rich knowledge graphs. TraceBound exposes a compact query profile before retrieval, issues short trace hints after observable failure symptoms, and logs trajectory counters, while keeping graph data, tools, gold labels, and ranking metrics fixed. Across STaRK validation and held-out subsets, the added conditioning improves inspectability but consistently reduces retrieval quality under open-weight controllers. Paired trajectory analysis localizes the degradation to repeated calls, zero-result calls, and misallocated exploration budget, while stricter interaction budgets shorten trajectories without repairing the policy. The result diagnoses the common failure mode in that "thinking before retrieval'' must be evaluated as a control problem over action selection, not as a prompt-format change.

46. 【2607.24799】Multimodal Hybrid Retrieval-Augmented Generation for Scientific Document Understanding using Open-Source SLMs

链接：https://arxiv.org/abs/2607.24799

作者：Alexandru-Andrei Saucă,Ana-Luiza Rusnac

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：Large Language Models, Large Language, Language Models tend, Language Models, prior fine-tuning

备注： 7 pages, 1 figure, 4 tables

点击查看摘要

Abstract:Large Language Models tend to hallucinate when answering domain-specific ques tions from scientific documents without prior fine-tuning. Currently, methods such as Retrieval-Augmented Generation partially solve this problem but face different challenges: limited context knowledge, difference between sparse and dense retrieval, and retrieval noise. This paper presents an Advanced Multimodal Retrieval-Augmented Generation system that aims to solve those challenges and im prove the accuracy of information extraction. The proposed architecture introduces a multimodal ingestion pipeline that leverages an open-source Vision-Language Model (Qwen2-VL-2B-Instruct) to generate textual summaries of tables and fig ures. The retrieval phase integrates HNSW-based semantic search with GIN-based lexical search, unified through Reciprocal Rank Fusion and refined using Cross Encoder reranking to minimize retrieval noise. To ensure conversational coherence across multi-turn interactions, a Query Condenser module is employed. Evaluation is conducted by independently assessing the ingestion, retrieval and generation stages using the MMLongBench benchmark, a BeIR-format synthetic dataset and the DeepEval framework. Moreover, results demonstrate a 157% improvement in retrieval quality over a Naive-RAG baseline, with only 50 ms additional la tency, while Qwen2-VL-2B-Instruct achieved results comparable to cloud-based models in BERTScore. These findings validate that open-source optimized SLMs, paired with advanced retrieval strategies, can provide competitive performance for document understanding without relying on cloud-based models.

47. 【2607.24798】Prediction Is Not Memory: Dual-Timescale Gated Profile Writing for Persistent User Modeling

链接：https://arxiv.org/abs/2607.24798

作者：Ziyide Li

类目：Information Retrieval (cs.IR)

关键词：common update pipelines, update pipelines conflate, profiles increasingly serve, conflate two decisions, increasingly serve

备注： 9 pages, 5 figures

点击查看摘要

Abstract:Persistent user profiles increasingly serve as reusable memory in recommender systems, but common update pipelines conflate two decisions: predicting an interaction and deciding whether it should persist in the profile. After an interaction is observed, many systems treat it as evidence for updating durable user state. This assumption can be harmful when the event reflects transient context, exploration, exposure, or short-term satisfaction rather than stable preference formation. We formulate this boundary as selective profile-write control: after an observed interaction, a system should decide whether, and how strongly, to write it into the persistent profile. We introduce a chronological near/far offline protocol in which near-future evidence provides weak write-risk supervision and far-future evidence is reserved for evaluation. We instantiate the controller as SPW-Gate, a lightweight write-risk gate using long-term, short-term, and candidate-profile drift features. On MicroLens-100K, write-all updating hurts far-future profile alignment in 22.45% of test cases under the main protocol. SPW-Gate reduces far hurt to about 14.5% while preserving about 77% write coverage. Matched-coverage controls and prediction-confidence baselines show that the gain is not merely a by-product of writing less, and that next-item confidence is not a sufficient proxy for persistent write validity.

48. 【2607.24793】Retrieval, not hallucinations, will be the limiting factor for LLM-based clinical AI tools

链接：https://arxiv.org/abs/2607.24793

作者：Kirk Roberts,Steven Bedrick,Kurt Miller,William R. Hersh,Hongfang Liu

类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)

关键词：large language model, clinical artificial intelligence, language model, artificial intelligence, generally center

备注： Perspective piece

点击查看摘要

Abstract:Discussions around large language model (LLM) errors in clinical artificial intelligence (AI) generally center around precision errors like hallucinations. This perspective, targeting both clinicians and AI researchers, seeks to shift that discussion to recall errors, particularly in retrieval of patient-level data needed for many clinical AI tools. The perspective outlines types of errors and mitigation strategies, describes research directions in LLMs and retrieval, and provides an overview of retrieval evaluation.

49. 【2607.24792】AI-Assisted Knowledge Access for Legacy Enterprise Asset Management in Energy Operations: A Practical Retrieval System

链接：https://arxiv.org/abs/2607.24792

作者：Dave Mercier,Mishca de Costa,Muhammad Anwar,Mark Randall,Issam Hammad

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：enterprise asset management, asset management platforms, long-lived enterprise asset, engineering work management, run engineering work

备注： Accepted at the 2026 IEEE the 14th International Conference on Smart Energy Grid Engineering (SEGE 2026)

点击查看摘要

Abstract:Energy utilities still run engineering work management, engineering procurement, and inventory processes on long-lived enterprise asset management platforms. Replacing these platforms is often cost prohibitive and operationally disruptive, so practical improvement layers are required. This paper presents a retrieval assistant that improves day-to-day knowledge access across three operational modes: vendor documentation question answering, operational data store (ODS) schema question answering, and user interface usage and how-to question answering. The runtime method combines intent understanding, query rewriting, hybrid semantic and vector retrieval, context engineering under token limits, grounded answer generation, and deterministic hyperlink conversion for panel identifiers and cited documentation. The data preparation pipeline emphasizes semantic enrichment as the primary quality lever by adding table and field descriptions, normalizing acronyms across sources, and indexing representative row-level context when useful. A measured pilot shows consistent gains in retrieval quality and user outcomes. Precision at five improved from 0.56 to 0.72, mean reciprocal rank from 0.43 to 0.58, and normalized discounted cumulative gain (nDCG) at five from 0.51 to 0.66. Median task completion time dropped from 14.2 to 8.3 minutes, while usefulness and confidence both increased to 4.0 on a five-point scale. Results are based on a small sample and are reported as pilot findings, but they indicate that intent understanding and semantic enrichment can deliver meaningful operational value in legacy environments while also establishing reusable foundations for future analytics and automation tools.

50. 【2607.24791】From Naive RAG to Deep Agentic Retrieval: An Evolving Context Engineering Pipeline for Regulatory Compliance

链接：https://arxiv.org/abs/2607.24791

作者：Mishca de Costa,Muhammad Saleh Anwar,Dave Mercier,Issam Hammad

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：implementations encounter hard, encounter hard limits, Ontario Power Generation, Ontario Energy Board, Retrieval-augmented generation

备注： Accepted at the 2026 IEEE the 14th International Conference on Smart Energy Grid Engineering (SEGE 2026)

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) is the dominant paradigm for applying large language models (LLMs) to enterprise document corpora, yet naive implementations encounter hard limits as corpus scale and query complexity grow. This paper traces the evolution of a production retrieval pipeline at Ontario Power Generation (OPG) for regulatory compliance and rate case analysis under Ontario Energy Board (OEB) reporting requirements. We examine successive stages: naive RAG, hybrid retrieval with re-ranking, agentic function-calling retrieval, and a deep multi-agent architecture with code-based tool synthesis and explicit planning, and identify the failure modes and tradeoffs that motivated each transition. We formalize the mature architecture as Progressive Evidence Acquisition with Cost-Aware Escalation (PEA-CAE): begin with low-cost, high-precision retrieval and escalate to full-document reads only when the expected evidence gain justifies latency and cost. Our findings show that context engineering is a more tractable and economically viable path than domain-specific fine-tuning for large, evolving regulatory corpora. More broadly, the progression toward deep agentic retrieval mirrors classical information retrieval ideas, introducing adaptive query reformulation, progressive document discovery, and hierarchical subagent summarization as practical system primitives. Operational traces further support the search-based nature of modern retrieval systems, where iterative evidence acquisition and adaptive planning increasingly replace single-pass retrieval as the foundation for enterprise-scale question answering.

51. 【2607.24789】NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model

链接：https://arxiv.org/abs/2607.24789

作者：Yuming Liu,Hongye Yang,Harrison Zhao,Ellie Zhu,Bokai Cao,Lei Huang,Lizhu Zhang,Xiangjun Fan

类目：Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

关键词：retrieves concrete follow-up, Next-interest EXploration Transformer, concrete follow-up videos, infers the viewer, EXploration Transformer

备注： 13 pages, 2 figures, 5 tables

点击查看摘要

Abstract:We present NEXT (Next-interest EXploration Transformer), a reasoning-driven video recommendation framework that reasons over the video a user has just watched, infers the viewer's next intent, and retrieves concrete follow-up videos. Explicit continuations such as episodes are linked directly; implicit cases are handled by generating intent queries and searching for matching candidates. This Item-to-Intent-to-Item formulation produces directed recommendations beyond co-engagement correlation or semantic similarity. To make this framework reliable at scale, we train NEXT-8B, a purpose-trained 8B vision-language model with a three-stage recipe: Perception-Enhanced Reinforcement Learning for query-agnostic evidence extraction, Distribution-Aligned Supervised Fine-Tuning over real and synthetic visual QA mixtures, and Group Relative Policy Optimization for last-mile alignment. NEXT-8B achieves the best single-model DocVQA performance, ranking second overall only behind a multi-agent system while surpassing a substantially larger 200B+ scale model, and improves next-intent logic-wise quality by 3.3% over the base model in a task-specific LLM-as-a-judge evaluation. We deploy NEXT as an additional retrieval path in a large-scale social media recommendation system and observe statistically significant production gains, including +0.53% watch time and +0.51% distinct video exposure. Overall, NEXT shows that a carefully trained compact vision-language model can serve as a practical reasoning engine for next-interest exploration at production scale.

Comments:
13 pages, 2 figures, 5 tables

Subjects:

Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

Cite as:
arXiv:2607.24789 [cs.IR]

(or
arXiv:2607.24789v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.24789

Focus to learn more

              arXiv-issued DOI via DataCite</p>

52. 【2607.24786】Unlocking Spatial Grounding in Large Audio-Visual Retrieval models

链接：https://arxiv.org/abs/2607.24786

作者：Hugo Malard,Michel Olvera,Sanjeel Parekh,Gaël Richard,Slim Essid,Stéphane Lathuilière

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Multimedia (cs.MM); Sound (cs.SD); Audio and Speech Processing (eess.AS)

关键词：Weak supervision sets, Weak supervision, dense spatial annotations, sets a practical, practical regime

备注：

点击查看摘要

Abstract:Weak supervision sets a practical regime for audio-visual sound source localization as dense spatial annotations are costly to obtain at scale. The task, however, remains challenging, as models must locate sound sources from temporally aligned audio-visual data without pixel-level supervision. Recent large-scale audio-visual retrieval models, trained at unprecedented scale, encode rich multimodal structure. We show their latent representations, though optimized for global alignment, can nonetheless enable fine-grained spatial grounding. While spatial detail is progressively lost in the upper layers of retrieval backbones due to global pooling, intermediate visual tokens retain highly structured spatial information. To exploit this, we introduce LAIP (\emph{Localization via Audio-Informed Pooling}), a framework that employs a lightweight \emph{Audio-informed Spatial Pooling} (AiSP) to replace the standard global aggregation module. By using frame-aligned audio to query intermediate visual tokens, LAIP recovers localized spatial information that is otherwise discarded by the frozen retrieval pipeline. Our approach achieves state-of-the-art performance on AVSBench and AVATAR, nearly doubling previous results on the latter. These findings prove that accurate localization does not need to be learned from scratch; instead, it can be unlocked from existing retrieval representations, providing a unified path for both retrieval and localization tasks.

53. 【2607.24781】hree Sides of Retrieval: Factorial Evidence for Document-Side, Query-Side, and Answer-Side Complementarity in RAG

链接：https://arxiv.org/abs/2607.24781

作者：Ng S. T. Chong

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)

关键词：RAG systems rely, destroys structural information, RAG systems, rely on chunking, systems rely

备注：

点击查看摘要

Abstract:RAG systems rely on chunking, which destroys structural information in documents. Existing heading-based retrieval (Jeong et al., 2025) requires multiple LLM calls per document and returns sub-chunks within matched sections. We introduce ToC-guided page retrieval, which infers headings from visual formatting without LLM calls, embeds them as a parallel index, and loads full page sections. Across 1,280 conditions on 8 enterprise documents (5 to 195 pages), we find: (1) ToC is a significant main effect on answer quality (d = +0.41, p = 0.031), with the largest gains in completeness (+0.40) and usefulness (+0.40); (2) combined with answer-side verification, it outperforms query-side decomposition + verification (d = +0.32, p = 0.036); (3) ToC contributes 20% of citations despite adding only 2.9 pages per query; (4) gains are directionally larger on longer documents (up to +1.50 on 118 pages), though the trend does not reach significance with 8 documents; and (5) a 480-condition sensitivity analysis finds no significant parameter effects (all p 0.38), confirming defaults are near-optimal. The contribution is both methodological (a new zero-LLM-cost retrieval algorithm) and empirical: factorial evidence that document-side, query-side, and answer-side enhancements are complementary, a three-way interaction not previously studied.

54. 【2607.24776】JKO-RAG: Distributional Retrieval as Wasserstein Free-Energy Gradient Flow

链接：https://arxiv.org/abs/2607.24776

作者：Levi Segal,Murari Ambati

类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：RAG pipelines return, RAG pipelines, ranked list, pipelines return, emph

备注：

点击查看摘要

Abstract:RAG pipelines return a \emph{ranked list} of passages. We argue this is a mismatch: the downstream language model conditions on a \emph{set}, and the selection problem is fundamentally geometric. We propose \jko, which frames reranking as minimising a free-energy functional $F(p)=\text{relevance}+\text{entropy}+\text{redundancy}$ under Wasserstein-2 gradient flow via the Jordan--Kinderlehrer--Otto proximal scheme. The ground metric $C_{ij}=(1-\cos\langle z_i,z_j\rangle)^2$ encodes the semantic geometry of the embedding manifold. Our central contribution is a \emph{linear-response theory} explaining \emph{why} the Wasserstein geometry helps: the Wasserstein and KL retrieval maps differ only in their proximal Hessian -- dense and geometry-aware for $W^2$, diagonal and geometry-blind for KL -- and this difference damps the mass transport that query paraphrase induces. The theory yields a falsifiable prediction: the stability advantage is monotonically decreasing in step size $h$. We verify this empirically via free-energy descent, frequency-resolved perturbation response, the predicted $h$-dependence, and a certified-radius analysis. Four extensions are introduced: \textbf{\nmjko} (learned ground metric), \textbf{\bwjko} ($W^2$--KL interpolation), \textbf{\samjko} ($2\times$ speedup), and \textbf{\dualrank} (OT dual potentials as confidence signals). Across five BEIR benchmarks, \jko\ outperforms the cross-encoder on all five; the decisive advantage is robustness -- 22--38\% more stable under paraphrase, $2\times$ fewer leaked distractors.

55. 【2607.24767】he Effect of Text Chunk Size on Retrieval-Augmented Generation Performance

链接：https://arxiv.org/abs/2607.24767

作者：German Garrido-Lestache Belinchon,Hugo Garrido-Lestache Belinchon

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：allowing large language, large language models, retrieve relevant information, Generation, generation quality

备注：

点击查看摘要

Abstract:Retrieval-Augmented Generation (RAG) systems have emerged as a powerful process for allowing large language models (LLMs) to retrieve relevant information to use as source material during text generation. A critical yet under-explored component of these systems is the granularity at which source documents are segmented into retrievable chunks. The size of these chunks has the potential to significantly influence generation quality, contextual correctness, retrieval precision, and computational efficiency. Despite its importance, chunk size is often selected without proper evaluation of its impact on generation quality. Smaller chunks, such as individual sentences, may allow for precise retrieval by narrowing the focus of each chunk. However, they contain less information, which may limit the model's ability to generate coherent responses. Larger chunks, such as entire chapters, contain lots of broad information that may improve correctness, but also introduce additional noise and increase computational cost. Because larger chunks contain more information, the number of chunks returned to the model must also be considered. This paper evaluates how chunk size, along with the number of retrieved segments, influences generation quality and retrieval effectiveness. By comparing these configurations, this study seeks to better understand how document segmentation affects the performance and efficiency of Retrieval-Augmented Generation systems. segmentation affects the performance and efficiency of Retrieval-Augmented Generation systems.

56. 【2607.24760】CHaystack: Benchmarking Chinese Document Retrieval and VQA

链接：https://arxiv.org/abs/2607.24760

作者：Hanxi Li

类目：Information Retrieval (cs.IR)

关键词：pure text settings, pushed RAG, RAG, large language models, made substantial progress

备注：

点击查看摘要

Abstract:Retrieval-augmented generation (RAG) has made substantial progress in extending the memory of large language models (LLMs), and recent advances have further pushed RAG from pure text settings toward multimodal scenarios. In the document understanding domain, document visual question answering (DocumentVQA) has evolved from question answering over a single document to retrieval-and-generation pipelines over large-scale document collections. However, a benchmark specifically designed for Chinese large-scale document retrieval and question answering is still lacking. To bridge this gap, we introduce CHaystack, a new Chinese DocumentVQA benchmark that covers four document categories, namely academic papers, advertisements, web pages, and real-world photographed documents, enabling a more comprehensive evaluation of DocumentVQA systems. In addition, we present CDocRAG, a Chinese DocumentVQA system that uses a VLM-based relevance filter to verify retrieved document images before answer generation. We evaluate representative open-source embedding and generation models on CHaystack. The results reveal a clear contrast in category-wise strengths: Qwen-family models perform best on text-rich documents such as webpages and papers, whereas other models only achieve competitive results on visually rich categories such as advertisements and degrade sharply on text-dense documents. For retrieval, Qwen3-VL reaches 71.91 Recall@1 while the best non-Qwen model achieves only 14.40. These results indicate that the core challenge of CHaystack lies in Chinese textual encoding, and that Chinese large-scale DocumentVQA still leaves substantial room for improvement. Our code and dateset is available at this https URL.

57. 【2607.24748】VLD-RAG: Agentic Vision-Language Retrieval-Augmented Generation for Long, Visually-Rich Multi-Page Documents

链接：https://arxiv.org/abs/2607.24748

作者：Seonok Kim

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)

关键词：visually-rich long documents, layout cues, manuals often distribute, retrieval, long documents

备注：

点击查看摘要

Abstract:Visually-rich documents such as reports, slides, and manuals often distribute the evidence needed to answer a question across multiple pages, mixing text with layout cues, tables, charts, and figures. This work studies multimodal retrieval-augmented generation for question answering over such visually-rich long documents, where retrieval must select evidence pages that include both textual and visual signals. We present VLD-RAG, an agentic multimodal RAG framework for multi-page evidence retrieval and cross-page reasoning over long documents. VLD-RAG builds a page-preserving multimodal index that stores parsed text, page-level metadata, and dense visual representations, and uses a hybrid retrieval strategy that combines keyword-based sparse search with dense semantic queries to identify candidate sources and evidence pages. A verifier-guided agent workflow coordinates a Retrieval Agent, Answer Agent, and Validation Agent to broaden evidence coverage, detect missing citations, and refine retrieval requests when needed. We evaluate retrieval with Top-1 and Top-5 evidence-page accuracy and generation with generalized accuracy, and show that VLD-RAG improves both evidence-page retrieval and end-task question answering on visually-rich long-document benchmarks, including LongDocURL and MMLongBench-Doc, outperforming previous vision-based retrieval baselines. These findings highlight that coordinated agent verification and multimodal hybrid retrieval are crucial for reliable grounding when correct answers depend on evidence scattered across pages.

58. 【2607.24745】DocAnnot -- Accelerating the Creation of Key Information Extraction Datasets with GenAI-Powered Auto-annotation

链接：https://arxiv.org/abs/2607.24745

作者：Siddartha Reddy,Harikrishnan P M,Goutham Vignesh,Varun V,Vishal Vaddina

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Key Information Extraction, Key Information, creating training datasets, Information Extraction, Large Vision Language

备注： 15 pages, 2 figures

点击查看摘要

Abstract:Key Information Extraction (KIE) is vital for many document applications, but creating training datasets is traditionally a time-consuming manual process. We introduce DocAnnot, a framework that significantly accelerates KIE dataset generation. DocAnnot leverages a Large Vision Language Model (LVLM) for label value extraction, OCR for text/bounding box detection, and a novel Spatially Informed Contextual Matching (SICM) algorithm. SICM improves label-value association by combining spatial relationships and proximity analysis with textual matching. We evaluate our framework on the CORD and SROIE benchmarks, demonstrating its ability to auto-generate annotations with F1-scores of 0.679 and 0.846, respectively. Furthermore, we investigate the effectiveness of using auto-annotated data for fine-tuning downstream KIE models. While human-annotated data remains superior, models trained exclusively on DocAnnot's outputs attain respectable performance (e.g., LayoutLMv3 achieving an F1-score of 0.6765 on CORD). These results show that while our framework significantly reduces reliance on manual effort, it does not yet fully eliminate the need for human intervention. However, by automating the process to a point where reviewers can efficiently refine outputs, our system enables near-perfect annotations with much greater efficiency than manual annotation from scratch. This approach offers substantial time and cost savings, making it valuable for resource-constrained settings and rapid model prototyping.

计算机视觉

1. 【2607.26042】VetClaw: An Edge-Cloud Multimodal Agentic System for Veterinary Disease Screening

链接：https://arxiv.org/abs/2607.26042

作者：Syed Mhamudul Hasan,Anas AlSobeh,Hussein Zangoti,Abdur R. Shahid

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：early veterinary disease, edge-cloud multimodal agentic, veterinary disease screening, early veterinary, veterinary disease

备注：

点击查看摘要

Abstract:We present VetClaw, an edge-cloud multimodal agentic system for early veterinary disease screening. VetClaw uses a camera module as an edge sensing device and sends captured images, together with optional symptom descriptions, to a server-hosted vision-language model for zero-shot disease classification. The system separates agent interaction from workflow orchestration: OpenClaw provides scheduling, tool access, user interaction, and notification services on the edge device, while LangGraph manages the stateful screening workflow, including input validation, image transmission, model invocation, safety checks, conditional routing, failure handling, and structured logging. This design moves beyond static image classification by enabling the system to collect visual evidence, invoke external models, apply deterministic safety rules, and generate diagnostic-support alerts. Results show that image-only VLM prediction remains limited, whereas symptom-guided and multimodal inputs improve zero-shot classification performance. Thus, VetClaw transforms a static prediction model into a coordinated, safety-aware system that can use tools, manage workflows, handle failures, and escalate uncertain cases.

2. 【2607.26041】Desktop-Delta Bench: Do Computer-Use Models Understand Desktop GUI Transitions?

链接：https://arxiv.org/abs/2607.26041

作者：Abhishek Pillai,Samir Kumar Nayak,Yuan Chen

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Computer-use agents, complete long-horizon tasks, increasingly act, complete long-horizon, Computer-use

备注：

点击查看摘要

Abstract:Computer-use agents (CUAs) increasingly act through desktop GUIs to complete long-horizon tasks. Current benchmarks primarily measure end-task success or single-frame grounding. Neither isolates whether a model can reconstruct the causal, task-relevant transition produced by an action- crucial for rejecting stale observations, verifying progress, and recovering from failure. This is difficult because inference, remote input, app rendering, and screenshot capture are asynchronous: the next observation may be delayed, occluded, transient, or unrelated, then misread as progress and carried into subsequent planning. We introduce Desktop-Delta Bench (DDB), an offline step-level benchmark with 2,013 human-verified instances from novel, multi-app Linux trajectories across ~15 applications and 50 task domains. DDB trajectories targets 3 failure dimensions- state verification, source tracking, and context-aware control- through 2 complementary tasks: 463 3-frame temporal-ordering instances, including 105 with a cross-trajectory decoy, and 1,550 before-after pairs labeled from 5 actions + its payload. We evaluate 8 closed and open-source model families across 32 ordering and 16 single-action settings, observing consistent gaps. Ordering remains unsaturated: best non-decoy and decoy exact-match rates are 65.1% and 65.7%. Task context improves decoy identification by 6.9 percentage points but reduces non-decoy exact match by 2.2 points; error analysis reveals systematic copying of the presented A-B-C order. Single-action results show that inferring the action family is harder than locating it: click F1 is 0.96 vs, 0.76 for drag, while recognized drags are generally localized well. DDB, thus, complements end-to-end benchmarks by filling the missing diagnostic layer between GUI grounding and final task success, enabling targeted improvements to desktop CUA verification, reliability, and recovery.

3. 【2607.26037】Wonder: Video World Model Done Better

链接：https://arxiv.org/abs/2607.26037

作者：Jiacong Xu,Hanwen Jiang,Zhixin Shu,Kalyan Sunkavalli,Vishal M. Patel,Yiqun Mei

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：camera-controllable world exploration, general-purpose video world, camera-controllable world, world exploration, video world model

备注： Project Page: [this https URL](https://wonder-world-model.github.io/)

点击查看摘要

Abstract:We present Wonder, a general-purpose video world model for real-time, camera-controllable world exploration. Given an image or a conditional video, Wonder constructs a playable world where users can navigate interactively by moving the camera, discovering unseen regions, and revisiting previously observed areas in real time and over a long-term horizon. Achieving this capability requires a system-level co-design of control method, memory mechanism, and training strategy. We introduce a novel camera conditioning with a dense coordinate field whose renderings provide spatially aligned motion and orientation cues, allowing the model to interpret camera motion directly as visual evidence. To support fast and precise memory retrieval over a growing generation context, we propose an efficient sparse attention-based memory mechanism, enabling the model to selectively attend to a small set of relevant context tokens at inference time, regardless of actual context length. We further develop several techniques to rectify the self-forcing-style distillation pipeline, improving the student model's ability to respect control signals, as well as maintaining diverse generation modes and long-term memory from the teacher. Together, these components enable Wonder to synthesize diverse, minute-scale videos at 16 FPS while preserving coherent geometry, appearance, and dynamics across long rollouts. Beyond image-to-video generation, Wonder naturally supports video-conditioned generation, allowing existing dynamic scenes to be re-shot in real time.

4. 【2607.26005】Pictura: Perspective-View Self-Play at Scale for Driving

链接：https://arxiv.org/abs/2607.26005

作者：Yuan Yin,Elias Ramzi,Marc Lafon,Valentin Charraut,Victor Bares,Yihong Xu,Éloi Zablocki,Alexandre Boulch,Thibault Buhet,Andrei Bursuc,Matthieu Cord

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)

关键词：simulation produces robust, policies at scale, produces robust driving, robust driving policies, simulation produces

备注：

点击查看摘要

Abstract:Self-play in simulation produces robust driving policies at scale. Demonstrations of such behavior have been made using privileged vectorized observations such as exact poses and velocities, even for occluded agents. This assumes that perception is solved and introduces a representation gap with the partial observation of a deployed agent driving from the perspective view of egocentric cameras. A common fix, distilling the privileged policy into a camera-input student, leaves the student imitating decisions its own view cannot justify. Instead, we establish perspective-view self-play as a practical training regime. We introduce Pictura, a GPU-accelerated multi-agent driving simulator that renders each agent's egocentric view at every step, mitigating the representation gap at its source. Pictura sustains up to 500K agent-steps/s (2M images/s) on a single H100. Using Pictura, we train Alberti by self-play with plain PPO. It is the first large-scale driving self-play policy trained directly from perspective images, without privileged observations. Training spans 50B agent steps for ~35M km of driving. It approaches the driving performance of its privileged vectorized counterpart, and transfers zero-shot to Waymo Open Motion Dataset layouts re-rendered in Pictura, where it outperforms privileged vectorized agents. Project page: this https URL

5. 【2607.26004】Parallel Decoding Distillation for Fast Image and Video Generation

链接：https://arxiv.org/abs/2607.26004

作者：Neta Shaul,Chao Liu,Arash Vahdat,Julius Berner

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：computationally expensive due, iterative sampling process, computationally expensive, expensive due, slow and iterative

备注：

点击查看摘要

Abstract:Generation in video diffusion or flow models is computationally expensive due to the slow and iterative sampling process. Current state-of-the-art (SOTA) acceleration methods heavily rely on variational score distillation (VSD) and adversarial losses to distill diffusion models into few-step generators. Albeit achieving high-quality video generation, these training losses are notoriously hard to optimize and suffer from mode collapse, leading to loss of video diversity and lack of motion. In this paper, we introduce Parallel Decoding Distillation (PDD), a simplified and scalable trajectory-based distillation method for fast inference of diffusion and flow matching models. Our architecture and training procedure are compatible with any pre-trained model and support sampling with a varying number of function evaluations (NFE). PDD accelerates generation by predicting multiple denoising steps per network evaluation. Conceptually, it learns a representation of the mean velocity without regressing its derivative using JVPs or finite-difference approximations. Our method achieves SOTA performance with 4-8 NFE on LTX-2.3 Text-to-Video/Audio, Wan 14B Text-to-Video, and Qwen-Image Text-to-Image. Moreover, PDD presents a significant improvement in generated video diversity.

6. 【2607.25993】Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensing

链接：https://arxiv.org/abs/2607.25993

作者：Fengxiang Wang,Jiangnan Huang,Mingshuo Chen,Yueying Li,Yang Shi,Junwei Luo,Haoyu Wang,Yansheng Li,Jing Zhang,Haiyan Zhao,Wenjing Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：multimodal large language, fine-grained Earth-observation evidence, large visual contexts, fine-grained Earth-observation, extremely large visual

备注：

点击查看摘要

Abstract:Ultra-high-resolution (UHR) remote-sensing (RS) imagery provides fine-grained Earth-observation evidence over city-scale scenes, but poses a fundamental challenge for multimodal large language models (MLLMs): task-relevant evidence is often sparse, local, and spatially dispersed across extremely large visual contexts. A natural solution is to equip MLLMs with zoom-in tools for active local inspection. However, through a pilot study on XLRS-Bench, we find that zoom-in is only partially effective: it resolves easy and medium-level tasks with locally recoverable evidence, but saturates on hard cases requiring global search, multi-region comparison, path planning, or dispersed-evidence reasoning. Motivated by this finding, we move beyond single-tool zoom-in and introduce GeoMTVR, a large-scale Geospatial Multi-Tool Visual Reasoning dataset built from wide-area satellite imagery. GeoMTVR contains 13K UHR VQA samples with interleaved reasoning trajectories, diverse visual tool calls, and returned visual observations, enabling models to learn question decomposition, tool selection, regional inspection, object-level grounding, auxiliary visual reasoning, and cross-tool evidence integration. Beyond supervised fine-tuning, we propose a tool-attention-focused reinforcement learning algorithm that concentrates optimization on critical tool-use decisions, including when to invoke tools, which tool to select, where to apply it, and how to interpret tool outputs. By combining SFT on GeoMTVR with our RL algorithm, we develop GeoLens, a multi-tool visual reasoning MLLM for UHR RS. Experiments show that GeoLens consistently outperforms direct reasoning and single-tool zoom-in baselines, achieving stronger accuracy, better evidence grounding, and more efficient tool-use trajectories.

7. 【2607.25990】On the Use of Synthetic Data for Threshold Calibration in Face Recognition: Performance and Security Implications for Border Control Systems

链接：https://arxiv.org/abs/2607.25990

作者：Arto Apila

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：recently deployed Entry, false match rates, introduces large-scale biometric, extremely low false, low false match

备注： Accepted by IJCB 2026

点击查看摘要

Abstract:The recently deployed Entry/Exit System (EES) introduces large-scale biometric verification into European border control, requiring face recognition systems to operate at extremely low false match rates (FMR). While regulatory frameworks define performance targets at the EES Central System level, they do not specify how verification thresholds should be calibrated in practice at the Member State level. In operational settings, obtaining representative real-world data for calibration is often constrained by legal, logistical, and privacy limitations. In this work, we investigate the use of synthetic face data for threshold calibration in document-to-live verification scenarios relevant to border control systems. We analyze the alignment of genuine and impostor score distributions between synthetic and real datasets and evaluate the transferability of calibrated thresholds across domains, with a focus on low-FMR operating points. Our results show that synthetic data can approximate calibration behavior in controlled settings, but fails to reliably generalize to unconstrained conditions due to mismatches in score distribution tails. These discrepancies lead to significant degradation in recognition performance and increased vulnerability to morph-based attacks. We further demonstrate that calibration outcomes are highly dataset-dependent, even across synthetic datasets. Overall, our findings highlight that while synthetic data is useful for system development and preliminary calibration, our results indicate that reliable threshold selection in high-security deployments typically requires validation and adjustment using representative real-world data.

Comments:
Accepted by IJCB 2026

Subjects:

Computer Vision and Pattern Recognition (cs.CV)

Cite as:
arXiv:2607.25990 [cs.CV]

(or
arXiv:2607.25990v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.25990

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)

Submission history From: Arto Apila [view email] [v1]
Mon, 27 Jul 2026 09:14:35 UTC (5,931 KB)

8. 【2607.25984】Schrödinger's Cat: Probabilistic Representation and Prediction of Potential Scene Kinematics

链接：https://arxiv.org/abs/2607.25984

作者：Timy Phan,Jannik Wiese,Björn Ommer

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：partial observations requires, observations requires reasoning, single trajectory, evolve from partial, partial observations

备注： Accepted at ECCV 2026. Project page: [this https URL](https://compvis.github.io/schroedingers_cat)

点击查看摘要

Abstract:Predicting how a scene may evolve from partial observations requires reasoning about multiple possible futures rather than committing to a single trajectory. Existing approaches either generate appearance-dominated video predictions or sample a small number of trajectories without explicitly modeling the distribution of possible motion. We introduce Goal-Aware Representations of Future kInEmatic Latent Distributions (GARFIELD), a probabilistic model of scene kinematics that learns a structured spatio-temporal latent representation of the distribution over possible futures given an image and optional spatio-temporally sparse constraints. The same latent representation enables both joint sampling of all trajectories and direct access to the underlying motion distribution through an efficient deterministic density decoder. As a result, uncertainty about future motion can be localized to specific scene elements and timesteps and progressively refined through additional constraints. Experiments demonstrate strong motion planning performance competitive with large video generation models while sampling trajectories $97\times$ faster. Our method further estimates motion densities two orders of magnitude faster than Monte-Carlo sampling from motion generation models, enabling interactive exploration and uncertainty-aware planning.

9. 【2607.25967】Quasi-SVD: Learning a Lie-constrained matrix factorisation for real-time imaging

链接：https://arxiv.org/abs/2607.25967

作者：Christopher Hahne

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Numerical Analysis (math.NA)

关键词：applications increasingly demanding, increasingly demanding real-time, medical applications increasingly, applications increasingly, increasingly demanding

备注：

点击查看摘要

Abstract:Singular Value Decomposition (SVD) underlies matrix factorisation tasks across computational imaging, with medical applications increasingly demanding real-time processing. Yet SVD algorithms are inherently sequential, constraining real-time GPU throughput and limit online deployment in clinical pipelines. This study introduces Quasi-SVD, a differentiable, fully parallelized matrix factorization framework for GPUs. Rather than enforcing orthogonality on both factors, it guarantees exact orthogonality for a single Lie-parameterized factor while recovering the remaining components through soft constraints, enabling efficient parallel decomposition without iterative singular-vector optimization. This asymmetric design, provably sufficient for valid factorisation, achieves reconstruction fidelity of SSIM = 0.89-0.94 and accelerates computation by 3-20x relative to cuSOLVER and randomised SVD, enabling throughput above 25 FPS. Performance is evaluated on two medical imaging tasks spanning complementary computational regimes: (1) spatio-temporal background subtraction for ultrasound localisation microscopy, requiring high-dimensional matrix separation, and (2) Mueller matrix polarimetry for neurosurgical tissue characterisation, requiring massive batch processing of small matrices. Across both regimes and multiple imaging instruments, the proposed framework demonstrates robust domain transfer and throughput exceeding 25 FPS at clinical matrix scales, a rate sufficient for live image-guided workflows that classical solvers cannot currently support in these settings. By prioritising downstream reconstruction fidelity over exact spectral recovery, Quasi-SVD makes structured matrix factorisation practical for real-time imaging.

10. 【2607.25962】LaP-Forensics: Latent-Pixel Consistency Guided Multimodal Reasoning for Deepfake Detection

链接：https://arxiv.org/abs/2607.25962

作者：Can Wang,Yuhao Wang,Yushe Cao,Canran Xiao,Fei Shen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent generative models, Recent generative, obvious visual artifacts, Stable Diffusion DDIM, weakening detectors

备注： Accepted at ACM Multimedia 2026 (ACM MM 2026)

点击查看摘要

Abstract:Recent generative models can produce images with few obvious visual artifacts, weakening detectors and explanations that rely only on surface appearance. We present LaP-Forensics, a multimodal framework that augments RGB semantics with reconstruction-based forensic evidence. A frozen Stable Diffusion DDIM inversion-reconstruction model provides a fixed reconstruction reference, and its residual map measures local compatibility with that reference. Independent projectors encode the RGB image and residual map before a structured Where-What-Why model predicts a textual analysis and an artifact this http URL fine-tuning is followed by Group Relative Policy Optimization (GRPO), whose reward combines mask overlap with output-structure and evidence-reference terms. These text-side terms encourage the model to refer to the consistency map but do not constitute a verifier of free-form textual truth. A separate image-level head fuses RGB and DDIM-residual class features. Experiments show cross-generator detection on UniversalFakeDetect and competitive artifact localization on the official SynthScars benchmark. Controlled cue-construction, inversion-horizon, component, reward-term, and counterfactual analyses support the utility of the residual stream under the evaluated settings, while free-form textual faithfulness and reliability under post-processing remain open limitations.

11. 【2607.25961】Knowledge-Guided Multimodal Reasoning over Interacting Streams for Video-Level Ambivalence and Hesitancy Recognition

链接：https://arxiv.org/abs/2607.25961

作者：Podakanti Satyajith Chary,Barath Parthiban,Pranesh Velmurugan,Adeeba Khan,Nagarajan Ganapathy

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：conflicting affective states, health behaviour change, conflicting affective, affective states, states that precede

备注： 14 Pages, 1 Figure, Ambivalence/Hesitancy (AH) Video Recognition Challenge, ECCV 2026

点击查看摘要

Abstract:Ambivalence and hesitancy (A/H) are conflicting affective states that precede the delay or abandonment of health behaviour change. Recognition of A/H at the video level is difficult, since the signal arises from disagreement across and within facial, vocal, linguistic, and bodily modalities, and manifests differently across individuals. The proposed PRISM-AH (Predictive Reasoning over Interacting Streams for Multimodal Ambivalence/Hesitancy Recognition), is a framework that treats A/H as a multimodal conflict that unfolds over time. Frozen vision, audio, and text encoders are aligned into short time windows and passed to a lightweight streaming model that scores cross-modal dissonance, predicts each next window to expose a hesitation surprise signal, discovers behaviour prototypes, and is conditioned on participant metadata. Dense window-level annotations supervise the model as an auxiliary objective, and the decision threshold is calibrated for macro F1. A knowledge-guided large language model then reasons over structured evidence using the expert cue taxonomy of the dataset, and its verdict is fused late only when validation performance improves. On the labelled public test partition of 525 videos, PRISM-AH attains a macro F1 of 0.6133, compared to the reported zero-shot baseline of 0.2827. The reasoning gain is validated to transfer from validation to the larger test partition.

12. 【2607.25948】MODUS: Decoder-Only Any-to-Any Modeling of Diverse Modalities

链接：https://arxiv.org/abs/2607.25948

作者：Mingqiao Ye,Zhaochong An,Zhitong Gao,Xian Liu,François Fleuret,Chuan Li,Amir Zadeh,Serge Belongie,Afshin Dehghan,Jesse Allardice,David Mizrahi,Oğuzhan Fatih Kar,Roman Bachmann,Amir Zamir

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

关键词：ecology and astronomy, vision and vision-language, increasingly in scientific, scientific domains, single network

备注： Accepted at ICML 2026. Project page: [this https URL](https://modus-multimodal.epfl.ch)

点击查看摘要

Abstract:Any-to-any models predict any modality from any combination of others within a single network, a formulation used in multimodal vision and vision-language models, and increasingly in scientific domains such as ecology and astronomy. Existing any-to-any models are typically trained from scratch using encoder-decoder or diffusion architectures, impacting their performance and preventing them from using strong pre-trained decoder-only models as a prior. In this work, we investigate decoder-only any-to-any multimodal modeling, which treats all modalities symmetrically and supports arbitrary modalities as inputs and outputs without modality-specific heads, losses, or task pipelines. Because every modality is both an input and an output of the same model, the resulting model, named Modus, can support a range of applications, such as chained generation through intermediate modalities or cross-modal self-verification by scoring the model's own outputs with another generated modality. Modus demonstrates strong out-of-the-box performance and is competitive with specialist and multitask baselines using a single model across various benchmarks. All materials are open-sourced at this https URL.

13. 【2607.25926】Face De-Identification: A Domain-Centric Survey from Capture to Processing

链接：https://arxiv.org/abs/2607.25926

作者：Hui Wei,Hao Yu,Guoying Zhao

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：personally identifiable facial, identifiable facial features, conceal personally identifiable, prevent identity recognition, aims to remove

备注： Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI). Github repository: [this https URL](https://github.com/CV-AC/Awesome-FaceDe-ID)

点击查看摘要

Abstract:Face de-identification (De-ID) aims to remove or conceal personally identifiable facial features in images or videos to prevent identity recognition while preserving utility for downstream tasks. With the rising emphasis on data privacy and responsible AI, face De-ID has emerged as an active research area spanning computer vision and privacy-preserving communities. Early approaches, and many contemporary ones, operate in the digital domain by modifying pixel-level or appearance-level features through post-capture processing. Recent advances extend face De-ID beyond post-processing by integrating privacy mechanisms directly into sensors during image acquisition, bridging sensing systems and downstream vision algorithms. In parallel, physical-domain methods explore wearable accessories and materials that conceal identity information in real-world environments prior to capture. In this survey, we present the first unified overview that spans the full data acquisition pipeline, encompassing the physical, sensor, and digital domains. Through this domain-centric lens, we systematically analyze current methodologies, technical progress, and the distinct challenges inherent to each stage. We then review and organize existing evaluation protocols, examining current practices and highlighting the critical need for standardized, comprehensive benchmarks. Finally, we identify key open problems and outline emerging research directions to guide future work in this rapidly evolving field. To support ongoing research, we maintain a project page that organizes relevant literature with collected datasets and open source code: this https URL.

14. 【2607.25921】Evaluating VLMs for Autonomous Agent-Driven Geometry Clipping Detection in Video Game QA

链接：https://arxiv.org/abs/2607.25921

作者：Carlos Celemin,Benedict Wilkins,Adrián Barahona-Ríos,Saman Zadtootaghaj,Nabajeet Barman

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：game Quality Assurance, Quality Assurance, agent-driven game Quality, game Quality, Assurance

备注：

点击查看摘要

Abstract:In this work, we study the use of Vision-Language Models (VLMs) for anomaly detection in an agent-driven game Quality Assurance (QA) pipeline focusing on geometry clipping. In this evaluation, a custom exploration agent navigates a game level to collect visual observations, while the automatic annotation pipeline provides frame-level clipping labels. This setup allows us to evaluate recent VLMs on a controlled anomaly detection task without manual annotation. We benchmark six recent VLMs (Gemini, GPT, Qwen, Gemma, Llama, and Ministral) under a zero-shot prompting setting and analyse their sensitivity to four prompt variants. Our results show that while the VLMs can capture visual cues associated with geometry clipping, they all produce substantial false positives on visually ambiguous frames such as near-contact geometry and partial occlusions. Gemini-3.1-Flash achieves the best overall accuracy and is the most robust to prompt variation, while open-source models exhibit large precision--recall swings depending on the prompt design. These findings suggest that current VLMs are best suited as high-recall candidate filters within multi-stage QA pipelines rather than as standalone bug detectors.

Subjects:

Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

Cite as:
arXiv:2607.25921 [cs.CV]

(or
arXiv:2607.25921v1 [cs.CV] for this version)

https://doi.org/10.48550/arXiv.2607.25921

Focus to learn more

              arXiv-issued DOI via DataCite (pending registration)</p>

15. 【2607.25895】HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone

链接：https://arxiv.org/abs/2607.25895

作者：Simple AI:Yuteng Wei,Jinming Ma,Jiawei Wang,Weitao Zhou,Yushen Zuo,Ke Rui,Minglei Li,Jinhao Zhang,Zhikang Pan,Xiang Wang,Haoran Jia,Huan Du,Zicheng Zeng,Jun Ma,Guiyu Qin,Di Zhang,Xiaofei Li

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Learning deployable manipulation, deployable manipulation policies, Learning deployable, robot-free UMI data, deployable manipulation

备注： 33 pages, 15 figures, 4 tables. Project page: [this https URL](https://cloud.simpleai.tech/simple-world-lab/hifi-umi/) Dataset: [this https URL](https://huggingface.co/datasets/simple-world-lab/HiFi-UMI-2K)

点击查看摘要

Abstract:Learning deployable manipulation policies is bottlenecked by the scarcity of data that is both high-fidelity and scalable. Real-robot teleoperation is accurate but costly to scale; robot-free UMI capture scales readily, and current practice uses the resulting data mainly for pre-training, adding a small real-robot "anchor" at post-training. We ask whether raising the fidelity of robot-free UMI data, rather than shrinking the real-robot fraction, can remove that anchor. We present HiFi-UMI, a portable UMI data-production system co-designed for trajectory accuracy, inter-gripper relative pose, synchronization, and field of view: head-mounted offline stereo-inertial SLAM, native rather than reconstructed relative pose, a shared microsecond GPIO trigger, and two wide-angle cameras per hand covering ~200 degrees. It reaches 3 mm workspace-local end-effector accuracy without external tracking infrastructure. Using this corpus, we demonstrate zero-robot post-training: a policy post-trained solely on HiFi-UMI demonstrations deploys directly on a real robot and matches in-domain teleoperation across three backbones spanning the vision-language-action and world-action-model families, with success-rate differences of -2.5, +3.1, and -0.6 percentage points on StarVLA-QwenPI, OpenPI-pi_0.5, and LingBot-VA; the strongest policy reaches 85% on a precision insertion task, even though the teleoperation baseline is collected in the evaluation scene and no HiFi-UMI trajectory is. Pre-training on 4,000 hours from the same corpus lowers action error on ten unseen tasks by 41% and, on StarVLA-QwenPI, raises real-robot success by a further 18.1 percentage points. We open-source HiFi-UMI-2K, 2,000 hours of microsecond-synchronized, ultra-wide-FoV demonstrations, each automatically reconstructed and validated through simulation replay, as a large-scale, high-fidelity resource for the robot-learning community.

16. 【2607.25894】IGA: Trajectory-Injected Generative Attack against Black-box AIGC Detectors

链接：https://arxiv.org/abs/2607.25894

作者：Xia Du,Zhuosen Bao,Zheng Lin,Jizhe Zhou,Jiawei Lian,Chi-man Pun,Jun Luo,Wei Ni,Symeon Chatzinotas

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：http URL evasion, URL evasion methods, Recent diffusion models, posing growing challenges, artificial intelligence-generated content

备注： 14 pages, 5 figures

点击查看摘要

Abstract:Recent diffusion models have achieved remarkable realism in facial image synthesis, posing growing challenges to artificial intelligence-generated content (AIGC) forensic this http URL evasion methods typically perturb pre-generated images or require detector-aware training, which may introduce visible or statistical artifacts and limit applicability when the diffusion model must remain frozen and the target detector is accessible only through black-box queries. We propose Trajectory-Injected Generative Attack (TIGA), a source-image-free and training free framework that generates detector-evasive images within a single diffusion sampling trajectory. TIGA steers the latent Denoising Diffusion Implicit Model (DDIM) trajectory so that adversarial properties emerge during generation rather than being added afterward. TIGA first aggregates gradients from multiple white-box surrogate detectors to form a transferable, sign-aware prior, and then performs anisotropic directional search with symmetric finite-difference queries to estimate the black-box target response. The estimated directions are stabilized by decayed momentum and injected according to the DDIM noise schedule, with frequency-domain reshaping to suppress high frequency artifacts. Experiments on surrogate and unseen specialized forensic detectors show that TIGA achieves strong blackbox attack performance, transferability, and high robustness under common post-processing operations without source images or diffusion-model retraining, while preserving high perceptual quality.

17. 【2607.25860】Open-Ended CT Volume Segmentation with Weak Supervision from Language

链接：https://arxiv.org/abs/2607.25860

作者：Sanjay Subramanian,Junwei Yu,Zirui Wang,Rohil Malpani,Maggie Chung,Adam Yala,Dan Klein,Trevor Darrell

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：combines voxel-level supervision, introduce a method, method for training, training a text-conditioned, combines voxel-level

备注：

点击查看摘要

Abstract:We introduce a method for training a text-conditioned segmentation model for CT scans, which combines voxel-level supervision with coarse but scalable slice-level supervision from reports. We extract, from a large database of scan-report pairs, descriptions of findings with indices of slices where those findings occur. We then finetune a general-purpose 2D image segmentation model, SAM3, with standard segmentation losses from strongly labeled data and with a slice-level classification loss from the extracted weak supervision. Our results on the ReXGroundingCT dataset illustrate that this strategy improves the segmentation dice score: from an 8% relative gain when there are 1000 fully labeled volumes to 22% when there are 250 fully labeled volumes.

18. 【2607.25857】Shieldstral

链接：https://arxiv.org/abs/2607.25857

作者：Antonia Calvi,Avinash Sooriyarachchi,Giada Pistilli,Guillaume Lample,Maarten Buyl,Maximilian Augustin,Maximilian Müller,Pierre Stock,Tom Bewley,Wassim Bouaziz,Yimu Pan

类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：policy-adaptive multimodal safety, multimodal safety classification, multimodal safety classifier, text safety benchmarks, policy-adaptive multimodal

备注：

点击查看摘要

Abstract:We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7$\times$ its size on text safety benchmarks and sets a new state of the art on multimodal safety classification. Shieldstral formulates content moderation as a binary question-answering task. This simple formulation unifies diverse moderation tasks into a single yes/no problem, enabling heterogeneous safety datasets with divergent taxonomies to be consolidated under one training framework. We present the data construction recipe, covering curation and generation of approximately 54.1M samples and a fine-grained evaluation set to evaluate policy adaptability. Together, these enable a small adaptive model to match or outperform much larger models.

19. 【2607.25842】Adversarial Deepfake Generation and an Investigation of Purification-Based Adversarial Detection

链接：https://arxiv.org/abs/2607.25842

作者：Junghyun Kim,Seunghyun Kim,Jiyoung Woo

类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)

关键词：image generation task, Generation Task, participation of team, paper describes, describes the participation

备注： Accepted at CLEF 2026, ImageCLEF-Deepfake task. Published in CEUR-WS CLEF 2026 Working Notes

点击查看摘要

Abstract:This paper describes the participation of team "Go To Germany" in the ImageCLEF 2026 Deepfake Detection and Generation Task. For the image generation task, we employ FLUX.1-dev with PuLID for identity-preserving face synthesis, combined with a multi-model PGD adversarial attack targeting 12 detectors simultaneously (DiffJPEG-in-loop, MI/DI/EoT, adaptive weighting, two-stage warm-start). Our approach achieved 90% evasion against organizer detectors and 57.6% against participant detectors, with a final generation score of 0.4170. For the image detection task, we combine two complementary detectors - SigLIP+DINOv2 for AI-generated images and GenD-DINOv3 for face manipulations - in a max-probability ensemble, achieving 99.4% accuracy on baseline deepfakes but suffering from high false-positive rates on real images, resulting in a final detection score of 0.6986. Beyond the official submission, we conducted a self-initiated investigation of purification-based adversarial detection, comparing three families of detection signals across six detectors that share a CLIP ViT-L/14 backbone. We find that raw $|\Delta \text{logit}|$ under median-3 purification, applied through the EFFORT detector, separates adversarial inputs from clean inputs with AUROC 0.81-0.98 across four adversarial source types - a finding that refutes the simple backbone-preservation hypothesis and exposes a sharp JPEG-quality cliff at Q70 where the signal collapses.

20. 【2607.25830】Beyond Static Costs: Learning-Dynamics Aware Loss Functions for Long-Tailed Classification

链接：https://arxiv.org/abs/2607.25830

作者：Varad Shinde,Nikhil Kumar Shrey,Magesh Rajasekaran,Md Saiful Islam Sajol,Harshil Bhargava,Subhajit Sidanta,Supratik Mukhopadhyay,Yimin Zhu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：computer vision face, vision face significant, face significant challenges, majority classes dominate, Deep learning models

备注：

点击查看摘要

Abstract:Deep learning models in computer vision face significant challenges when trained on long-tailed datasets, where a few majority classes dominate while many minority classes are severely underrepresented. Such imbalances frequently arise in real-world scenarios such as rare species recognition, manufacturing fault detection, and medical image understanding, leading to biased models that underperform on tail classes. Existing reweighting methods typically rely on static class frequencies to penalize the model, ignoring the dynamic nature of how effectively a network actually learns a class over time. We address this by introducing a novel Learning-Dynamics Aware Loss (LDAL) function that shifts the focus from static sample counts to dynamic learning progress. LDAL framework adjusts class weights continuously by leveraging: (i) the strength of learned feature representations (semantic scale), (ii) the intrinsic learning difficulty of each class, measured via the Shannon entropy of its predictions, and (iii) an inter-epoch regularizer term that tracks prediction shifts between consecutive epochs to stabilize training and avoid local minima. LDAL is purely a objective function which incurs negligible computational overhead while adapting to the feature learning of the model. Experimental results on multiple benchmark datasets demonstrate that our approach significantly surpasses state-of-the-art reweighting loss functions, providing an optimal trade-off between accuracy and generalizability. The source code is available at this https URL

21. 【2607.25820】Food Image Segmentation with LLM-Derived Ingredient Labels and Multimodal Fusion

链接：https://arxiv.org/abs/2607.25820

作者：Jui-Feng Chi,Wei-Ta Chu,Sheng-Long Lin

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：personalized health monitoring, Language Injection Module, health monitoring, image segmentation plays, Language Injection

备注：

点击查看摘要

Abstract:Food image segmentation plays a vital role in health-related applications such as nutrition tracking and personalized health monitoring. However, existing models often underperform on visually similar ingredients and rare food categories. To address this issue, we propose two plug-and-play multimodal modules that enhance the segmentation performance by leveraging ingredient labels inferred from food images using large language models (LLMs). The first module, called LIM-F (Language Injection Module for Features), is designed to pair with any image encoder that produces multi-layer outputs (e.g., Swin Transformer), while the second module, LIM-Q (Language Injection Module for Queries), targets Mask2Former-style Transformer-based decoders. Both modules enable training without the need for pre-aligning images with text by directly injecting semantic ingredient information into the visual analysis pipeline. On the FoodSeg103 benchmark, the proposed method achieves state-of-the-art performance. Specifically, integrating LIM-Q into the Mask2Former decoder with a Swin-L image encoder yields a mean Intersection over Union (mIoU) of 55.0. LIM-F also demonstrates strong generalization and competitive performance, reaching an mIoU of 54.4 under the same model (Swin-L+Mask2Former). Furthermore, its applicability extends beyond Transformer-based decoders, as evidenced by an improvement from 47.7 to 49.8 mIoU when integrated into a CNN-based architecture. Notably, the improved segmentation accuracy is achieved with only a moderate (at most 3.8 GB) increase in the GPU memory consumption during training. Thus, the proposed approach offers a practical and scalable solution for fine-grained food understanding.

22. 【2607.25818】SepPrune:A Separator-based Pruning Framework for Efficient Multimodal Large Language Models

链接：https://arxiv.org/abs/2607.25818

作者：Yuchen Wang,Qihui Zhu,Yang Liu,Xiaoyan Sun,Siying Wu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Recent multimodal large, large language models, generate large numbers, multimodal large language, substantial computational cost

备注：

点击查看摘要

Abstract:Recent multimodal large language models (MLLMs), such as Qwen2.5-VL and InternVL3, generate large numbers of vision tokens for high-resolution inputs, leading to substantial computational cost. Existing vision token pruning methods either depend on cross-modal attention and cannot prune before the prefill stage, or rely on diversity estimation with high computational overhead. We observe that attention scores from both vision and text tokens peak at modality separator tokens, suggesting that these separators bridge the two modalities. Based on this observation, we propose SepPrune, an efficient, training-free, plug-and-play pruning method that uses the separator token as a unified query to rank and select informative vision tokens. SepPrune reuses the LLM's built-in projection parameters and requires no architectural changes. Experiments on Qwen2.5-VL-7B show that SepPrune achieves state-of-the-art performance, retaining 96.3% of the original accuracy while removing 80.2% of vision tokens.

23. 【2607.25815】Freq-RemoteVAR: Next-Frequency Autoregressive Modeling for Remote Sensing Change Detection

链接：https://arxiv.org/abs/2607.25815

作者：Luqi Gong,Rui Xu,Yue Chen,Chao Li,Jingqi Hong,Xuefeng Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Remote sensing change, Remote sensing, identify land-cover changes, aims to identify, identify land-cover

备注：

点击查看摘要

Abstract:Remote sensing change detection aims to identify land-cover changes from bi-temporal images. Most existing methods follow a one-shot dense prediction paradigm, directly regressing a change mask from fused features. However, such approaches overlook the intrinsic frequency characteristics of change patterns. We propose Freq-RemoteVAR, a frequency autoregressive framework that reformulates change detection as a structured generation problem in the frequency domain. Instead of predicting the change mask in a single step, we introduce a next-frequency prediction paradigm, where change information is progressively generated from coarse to fine. We design a frequency-aware mask tokenization strategy that decomposes change supervision into multi-frequency token targets via Fourier transformation and quantization. We develop a Frequency VAR Transformer, which performs causal autoregressive modeling over frequency tokens. The model starts from learned mask queries and progressively predicts frequency-level tokens conditioned on previously generated tokens and bi-temporal image features, effectively capturing long-range dependencies across frequency scales. We introduce Scale-Aligned RoPE Cross Attention (SRCA) module, which aligns frequency-domain mask queries with spatial-domain bi-temporal features under a unified coordinate system, enhancing spatial-frequency consistency during generation. We propose a Change-quality Control module that adaptively modulates the generation process through dynamic normalization, attention biasing, and spatial offset adjustment, thereby suppressing pseudo-change responses and improving robustness. Extensive experiments on CDD, GZ-CD, and LEVIR-CD demonstrate that Freq-RemoteVAR consistently outperforms existing methods, particularly in challenging scenarios with complex appearance variations and noisy disturbances.

24. 【2607.25802】Explicit Layer Modeling for Video Object Insertion and Layer Decomposition

链接：https://arxiv.org/abs/2607.25802

作者：Kyujin Han,Seungjoo Shin,Sunghyun Cho

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：video editing systems, limiting their ability, consistent manipulation, editing systems, systems still lack

备注：

点击查看摘要

Abstract:Most video editing systems still lack explicit layered video representations, limiting their ability to perform realistic compositing, object reuse, and consistent manipulation. This limitation is especially pronounced in video object insertion and video layer decomposition, where existing methods rely on implicit inference or per-scene optimization due to the absence of explicit foreground-layer supervision. We introduce TriLayer, a large-scale triplet video dataset containing aligned composite, background, and foreground videos, where the foreground layers include both object appearance and associated visual effects. This explicit supervision enables models to learn layered video representations directly rather than inferring them implicitly. Building on this dataset, we propose DBL-Diffusion, a dual-branch diffusion framework that jointly models RGB composites and RGBA foreground layers through shared denoising and cross-branch interaction. We instantiate the framework in two tasks: DBL-Insert for layered object insertion, which generates explicit RGBA layers for realistic compositing and flexible post-editing, and DBL-Decompose for video layer decomposition, which recovers foreground and background layers using triplet supervision. Experiments demonstrate that explicit layer modeling substantially improves both insertion fidelity and decomposition quality.

25. 【2607.25794】Fine-Grained Food Image Understanding via Target-Aware Data Alignment

链接：https://arxiv.org/abs/2607.25794

作者：Jui-Feng Chi,Wei-Lun Chu,Bruce Coburn,Jinge Ma,Fengqing Zhu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：semantic understanding requires, capture subtle distinctions, understanding requires models, semantic understanding, distinctions across ingredients

备注：

点击查看摘要

Abstract:Fine-grained food visual--semantic understanding requires models to capture subtle distinctions across ingredients, cooking methods, doneness, color, texture, and plate composition. Although CLIP-style vision-language models provide a natural framework for this task, their effectiveness is limited when training relies on heterogeneous web-collected image--text pairs. Such data often exhibit a web-to-target domain gap and cross-modal misalignment, where images differ from the target distribution and captions are noisy, multilingual, or weakly grounded in visual content. We propose a data-centric multimodal alignment method for fine-grained food description and recognition. Our method first performs target-aware data selection to identify visually relevant training subsets, then applies VLM-based caption refinement to generate visually grounded, target-style descriptions. Using these curated image--caption pairs, we train complementary CLIP-style retrieval experts and further combine their decisions through a hierarchical VLM-assisted multi-expert decision-level fusion strategy that invokes the VLM only when experts disagree. Experiments show that our data refinement strategy significantly improves retrieval performance over naive web supervision, with VLM-based caption refinement alone yielding an average performance gain of approximately 19%. Our full method also achieves more than twice the retrieval score of pure VLM-based retrieval while remaining substantially more efficient.

26. 【2607.25791】FLASH: Efficient Impact Fall Detection with Unified Hypergraph State-Space Model

链接：https://arxiv.org/abs/2607.25791

作者：Tresor Y. Koffi,Youssef Mourchid,Yohan Dupuis

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：public health challenge, critical public health, health challenge, timely intervention, represent a critical

备注： 6 pages, 2 figures. Accepted at IEEE International Conference on Image Processing (ICIP 2026), to appear September 2026

点击查看摘要

Abstract:Falls represent a critical public health challenge, and accurate detection of the impact moment when an individual hits the ground is crucial for timely intervention. Existing skeleton-based methods rely on graph neural networks modeling only pairwise joint connections, failing to capture multi-joint coordination characteristic of fall impacts, while transformer-based temporal models suffer from quadratic complexity limiting real-time deployment. We propose FLASH, a novel framework integrating single-matrix hypergraph representations with Mamba's selective state-space models through adaptive feedback mechanisms for efficient impact detection. Our approach constructs biomechanically-grounded hyperedges to model functional joint coordination while leveraging Mamba's linear-time complexity to capture temporal dynamics. Experiments on UP-Fall and UMAFall datasets demonstrate that FLASH achieves state-of-the-art accuracy with real-time inference capability and strong zero-shot cross-dataset generalization, while significantly reducing computational cost compared to dual-representation and transformer-based methods. The model provides interpretable feedback through learned attention patterns aligned with biomechanical principles. Code is available at this https URL.

27. 【2607.25789】owards Faithful Sentimental Image Captioning via Evidence-Aware Multi-Agent Reasoning

链接：https://arxiv.org/abs/2607.25789

作者：Tiecheng Cai,Zexian Yang,Chao Chen,Shanshan Lin,Xiangwen Liao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Sentimental Image Captioning, requires balancing emotional, balancing emotional expression, Image Captioning, requires balancing

备注：

点击查看摘要

Abstract:Sentimental Image Captioning (SIC) requires balancing emotional expression with visual fidelity. Existing methods often struggle with this trade-off, leading to hallucinations due to insufficient local grounding and the lack of sentimental verification mechanisms. To address these limitations, we propose SEA-Cap, a Sentiment-Evidence-Aware Multi-Agent System for faithful and evidence-grounded sentimental image captioning. SEA-Cap incorporates a Sentiment Evidence Miner that extracts structured, local affective cues to shift sentiment control from global attributes to verifiable object-level evidence. Leveraging this evidence, our framework orchestrates a collaborative workflow where a Generator, Hallucination Checker, and Arbitrator iteratively refine captions via a shared blackboard. By explicitly auditing generated content against mined visual evidence, SEA-Cap ensures both sentiment accuracy and factual consistency. Extensive experiments on two benchmark datasets demonstrate that SEA-Cap effectively mitigates hallucinations and achieves state-of-the-art performance.

28. 【2607.25788】GeoMFD: Continual Drone-View Geo-Localization with Geometry-Aware Adapter and Margin-Field Distillation

链接：https://arxiv.org/abs/2607.25788

作者：Zhongwei Chen,Hai-jun Rong,Tao Zhang,Xianfeng Nie,Xiangbao Zhang,Guoqi Li,Zhao-Xu Yang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Existing drone-view geo-localization, static training paradigm, Existing drone-view, static training, training data

备注：

点击查看摘要

Abstract:Existing drone-view geo-localization (DVGL) methods are mainly developed under a static training paradigm, where models are optimized for fixed environments with all training data available in advance. However, this paradigm is difficult to extend to real-world deployment, where drones may encounter diverse environments and require multiple environment-specific models, resulting in additional storage and model-selection costs. Directly adapting a single model to new environments also risks distorting previously learned cross-view embedding geometry and causing forgetting. To address these challenges, we formalize the continual drone-view geo-localization (C-DVGL) setting and propose GeoMFD, a geometry-aware continual adaptation method for DVGL. GeoMFD combines a cold-start bootstrapping strategy (CBS), a geometry-aware adapter (Geo-Adapter), and margin-field distillation (MFD) to balance adaptation and cross-view geometry preservation. CBS initializes a stable embedding space, Geo-Adapter enables environment adaptation through controlled residual corrections, and MFD preserves similarity margins between positive pairs and hard negatives to alleviate cross-view geometry forgetting. Extensive experiments demonstrate that GeoMFD effectively mitigates forgetting and achieves competitive performance with environment-specific DVGL methods using a single continuously updated model.

29. 【2607.25778】A Unified Benchmark and Modality-Adaptive Network for Day-and-Night Drone-View Geo-Localization

链接：https://arxiv.org/abs/2607.25778

作者：Songtianhao Xu,Zhongwei Chen,Zhao-Xu Yang,Weifeng Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：lack geographically aligned, geographically aligned visible, illumination conditions, drone imagery captured, single illumination condition

备注：

点击查看摘要

Abstract:Most existing drone-view geo-localization (DVGL) benchmarks contain drone imagery captured under a single illumination condition and lack geographically aligned visible drone images, infrared drone images, and satellite images from the same locations. To evaluate the generalization capability of DVGL methods under challenging illumination conditions, some methods train models on a visible benchmark and test them on an independent infrared benchmark. This protocol essentially constitutes transfer between datasets, which makes it difficult to systematically evaluate DVGL across daytime and nighttime conditions within a unified benchmark. To address this limitation, we construct IRCHN,a real-world DVGL benchmark designed for localization across different illumination conditions. IRCHN contains 26,460 images collected from 8,820 geographic locations across four representative scene categories, including farmland, coastline, forest, and urban areas. Each location provides one visible drone image, one infrared drone image, and one corresponding satellite image, which enables unified evaluation of DVGL methods across different illumination conditions and sensing modalities. We further propose the Modality-Adaptive State-Space Transport Relation Network (MASTR-Net), a DVGL framework tailored to localization under varying illumination conditions. MASTR-Net integrates modality-adaptive feature enhancement, bidirectional selective state-space relation modeling, and soft optimal transport relation alignment to jointly reduce modality gaps and view-induced structural discrepancies. Extensive experiments demonstrate that MASTR-Net outperforms existing state-of-the-art methods on IRCHN for localization under varying illumination conditions and achieves competitive performance on two infrared benchmarks, IR-VL328 and CVGL-RGBT. Code: this https URL

30. 【2607.25736】Image Quality Dependent Degradation for AI Systems

链接：https://arxiv.org/abs/2607.25736

作者：Yannick Kees,Elena Hoemann,Frank Köster,Sven Hallerbach

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：outperform conventional algorithms, neural networks outperform, networks outperform conventional, conventional algorithms, primary applications

备注：

点击查看摘要

Abstract:Perception is one of the primary applications where neural networks outperform conventional algorithms. One example is AI systems for automated driving, which can detect pedestrians based on image data and avoid them accordingly. A substantial challenge with these AI systems is that their output depends heavily on the quality of the input images. For example, if an image is of inferior quality due to heavy contamination, such as noise or darkness, accurate predictions are hardly feasible. Additionally, various types of errors can occur, each with varying relevance to the trustworthiness of the underlying AI system. In particular, it may be more critical not to detect an existing person than to detect a person where there is none. Therefore, we want to show that we can still avoid the most critical errors in situations of inferior image quality. To achieve this, we aim to establish a fail-degraded system by lowering the network's confidence threshold based on the estimated image quality, enabling it to detect objects more cautiously in uncertain situations. Additionally, we present a novel method for estimating the quality of incoming images by comparing them to the training data using normalizing flows. We will also conduct experiments applying our method to state-of-the-art object detection. In summary, we will present a design strategy for AI-based systems in automated driving that can deal with poor-quality input data without resorting to fallback solutions. Such measures enhance trust in AI-based systems and lead to an increased provision of the AI component.

31. 【2607.25732】A systematic evaluation of machine learning classifiers for event-by-event background rejection in LAFOV PET scanners

链接：https://arxiv.org/abs/2607.25732

作者：Konrad Klimaszewski,Michał Obara,Mateusz Bala,Beatrix C. Hiesmayr,Lech Raczyński,Roman Y. Shopa,Wojciech Zdeb,Wojciech Krzemien

类目：Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)

关键词：LAFOV PET scanners, brings significant sensitivity, PET scanners brings, LAFOV PET, scanners brings significant

备注：

点击查看摘要

Abstract:The introduction of LAFOV PET scanners brings significant sensitivity gains but also a substantial increase in the background rate from accidental coincidences, phantom-scattered and detector-scattered photons. While machine learning methods have been applied to background reduction in PET imaging, they target specific background components in post-processing rather than event-by-event classification on the raw data. In this work, we formulate coincidence classification as a supervised multi-class problem and evaluate XGBoost, AdaBoost and Neural Network classifiers as pre-reconstruction filters, using Monte Carlo simulations of the Siemens Biograph Vision Quadra scanner with NEMA IEC and anthropomorphic XCAT phantoms. We investigate two feature sets: a 4-feature representation based on the Attenuation Factor, photon time difference, energy sum, and energy difference, and an extended 6-feature set that incorporates topology-based variables. A systematic robustness study via cross-phantom inference reveals that the 4-feature models generalise significantly better across different phantom geometries, with XGBoost suffering an accuracy loss of only 0.04 compared to 0.13 for the 6-feature variant. Our best models achieve accuracies of up to 0.74 and 0.69 for the NEMA IEC and XCAT phantoms, respectively, outperforming traditional geometry-based cuts. However, we show that this compact feature set not only provides limited suppression of in-phantom scattered coincidences, but it also can lead to non-trivial spatial patterns. With scattered coincidences being the dominant background component in clinical conditions, this suggests that while the method serves as an effective and geometry-agnostic replacement for traditional cut-based selection, meaningful further gains in image quality will require either larger input representations or dedicated treatment of the phantom-scattered component.

32. 【2607.25710】Impact Detection in Fall Events: Leveraging Spatio-Temporal Graph Convolutional Networks and Recurrent Neural Networks Using 3D Skeletons Data

链接：https://arxiv.org/abs/2607.25710

作者：Tresor Y. Koffi,Youssef Mourchid,Mohammed Hindawi,Yohan Dupuis

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：global health concern, presenting a global, health concern, Gated Recurrent Unit, represents a significant

备注：

点击查看摘要

Abstract:Fall represents a significant risk of accidental death among individuals aged over 65, presenting a global health concern. A fall is defined as any event where a person loses balance and moves to an off-position, which may or may not result in an impact where the person hits the ground. While fall detection systems have achieved good results in general, impact detection within falls remains challenging. This study proposes an efficient methodology for accurately detecting impacts within fall events by incorporating 3D joints skeleton data treated as a graph using Spatio-Temporal Graph Convolutional Networks (STGCN), Gated Recurrent Unit (GRU), and Bidirectional Long Short-Term Memory (BiLSTM) layers. By pinpointing impact moments, our approach enhances precision by distinguishing between false falls and actual impacts, contributing to better healthcare resource allocation. Our methodology, evaluated using the improved 3D skeletons UP-Fall dataset, achieves accuracy exceeding 90\% across various fall scenarios. We have made this improved dataset publicly available at this https URL to facilitate further research.

33. 【2607.25642】Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applications

链接：https://arxiv.org/abs/2607.25642

作者：Xianghao Zang,Zijian Jiang,Jiarong Cheng,Qianrui Teng,Ying He,Yuxuan Mu,Chao Ban,Huayu Zhang,Lanxiang Zhou,Zerun Feng,Chi Zhang

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Instruction-based Image Editing, Instruction-based Image, one-sentence image editing, Large Language Models, Image Editing

备注： 33 pages, 7 figures, Vicinagearth

点击查看摘要

Abstract:Instruction-based Image Editing (IIE) aims to transform a given image into a new one based on textual instructions. Advances in Large Language Models (LLMs) and Vision-Language Models (VLMs) have accelerated progress toward practical ``one-sentence image editing" systems. This survey presents a systematic taxonomy and comprehensive review of IIE research, structured around five core dimensions: (1) task definition and hierarchical categorization of editing operations, (2) methodologies for training data construction, (3) architectural evolution from GAN-based to diffusion and autoregressive paradigms, (4) standardized evaluation metrics and benchmark development, and (5) introduction of commercial solutions. Our analysis shows critical technological milestones across model generations. We further propose a Comprehensive, in-Depth, and Diagnostic benchmark for IIE task (CDD-IIE Bench), which can rigorously assess the multiple aspects of model performance. Through empirical comparisons of open-source solutions, we highlight their respective capabilities and limitations. Finally, we discuss future research directions to advance the field.

34. 【2607.25641】OmniPhys: Knowledge-Graph-Driven Benchmarking and Collective Optimization for Physical Commonsense in Text-to-Image Generation

链接：https://arxiv.org/abs/2607.25641

作者：Yajing Xu,Yarong Lan,Jiaoyan Chen,Yichi Zhang,Jeff Z. Pan,Mingchen Tu,Zhizhen Liu,Wen Zhang,Huajun Chen

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：frequently violate fundamental, remarkable visual fidelity, exhibit remarkable visual, fundamental physical commonsense, models exhibit remarkable

备注： accepted by KDD 2026 DB track

点击查看摘要

Abstract:While text-to-image models exhibit remarkable visual fidelity, they frequently violate fundamental physical commonsense. Existing benchmarks often rely on coarse-grained descriptions, failing to diagnose the mastery of specific physical principles. Moreover, the high stochasticity of generative processes causes current prompt optimization methods to suffer from gradient hallucinations, where optimizers are misled by transient visual artifacts rather than systemic flaws. To address these challenges, we introduce OmniPhys, a rigorous benchmark of 1,551 samples grounded in a Physical Knowledge Graph. By aligning PhET simulations with standard curricula, OmniPhys operationalizes a knowledge-to-scenario pipeline that performs diagnostic stress tests via a dual-path verification protocol. We further propose OmniPrompt, an iterative framework that treats physical alignment as a discrete optimization problem. For each query, OmniPrompt aggregates K stochastic images into a per-query feedback buffer. Across training, it further merges feedback from batches of B queries before each meta-policy update, filtering seed and query-local noise. Evaluations across 12 representative text-to-image models reveal universal physical bottlenecks. Results demonstrate that OmniPrompt significantly enhances physical consistency across diverse backbones, proving the transferability and efficacy of our evolved meta-policies. The code and data are available at this https URL

35. 【2607.25622】Beyond Facial Consistency: Personalized Person Image Generation with Holistic Identity Preservation

链接：https://arxiv.org/abs/2607.25622

作者：Yuxuan Xiao,Shanshan Zhang,Jian Yang,Shengcai Liao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：requires preserving subject, broader appearance cues, image generation requires, generation requires preserving, preserving subject identity

备注：

点击查看摘要

Abstract:Personalized person image generation requires preserving subject identity across both local facial details and broader appearance cues. Existing methods typically emphasize only one level of identity information, leading to an inherent trade-off between facial fidelity and overall appearance consistency. To address this, we first propose a simple dual-branch baseline that unifies global appearance control and local facial control within a shared generation framework. This simple combination of different branches yields promising results, but suffers from instability in practice due to uncoordinated branch contributions. To this end, we propose Dynamic Balancing Scaling (DBS), a fine-tuning strategy for improving face and appearance identity coordination. DBS consists of two components: adaptive temporal gating, which dynamically modulates branch contributions along the denoising trajectory, and region-aware optimization, which improves the coordination of facial, appearance, and global supervision. Together, these designs alleviate persistent face-branch over-dominance and encourage more effective appearance-aware guidance. We also introduce Pexels-100, a benchmark for evaluating holistic identity consistency in personalized person generation. Experiments show that DBS achieves a better trade-off between facial fidelity and appearance consistency than existing open-source baselines, while providing a controllable basic framework for holistic identity modeling.

36. 【2607.25589】Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact

链接：https://arxiv.org/abs/2607.25589

作者：Mateusz Kozłowski

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Medical-imaging AI benchmarks, benchmarks combine datasets, provider APIs, statistical code, benchmarks combine

备注： 25 pages, 5 figures, 7 tables. Retrospective artifact audit; no new model calls or annotations. Corrective audit and archival reconstruction: [this https URL](https://doi.org/10.5281/zenodo.21629849)

点击查看摘要

Abstract:Medical-imaging AI benchmarks combine datasets, DICOM rendering, prompts, provider APIs, automated labels, statistical code, manuscripts, and repository releases. Agreement across these artifacts is usually assumed rather than tested. We performed a retrospective forensic reproducibility audit of a preserved chest-radiograph vision-language model (VLM) pilot; no model was called again and no image or report was newly annotated. We traced prompt bindings, DICOM metadata, output completeness, label extraction, matched analyses, and release propagation. Of 300 planned model-prompt calls, 297 yielded nonempty reports. Sixty Claude calls labeled A/B were executed with the same C prompt. The 30 studies represented 28 patients. Four MONOCHROME1 images were rendered without required polarity inversion, dataset split membership was not retained, and the unvalidated extractor truncated five reports to 4000 characters. Reconstructing one common cohort of 369 complete case-finding blocks changed Cochran's Q from 154.73 to 182.29. Of 45 McNemar comparisons, 27 had unadjusted p 0.05 and 20 remained below 0.05 after Holm adjustment. These values describe only the archived automated-label matrix; they do not recover the intended prompt comparison or establish clinical performance. We withdraw the original performance, ranking, prompt-effect, and clinical claims and specify machine-verifiable controls for cohort, DICOM rendering, prompt and model identity, call status, annotation provenance, keyed analysis, and derived artifacts.

37. 【2607.25570】he LAIA Dataset: Labelled Attention for Intelligent Automobiles

链接：https://arxiv.org/abs/2607.25570

作者：A. Contreras,D. Porres,R. Abad,P. Cano,G. Villalonga,A. M. López,A. Hernández-Sabaté

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Software Engineering (cs.SE)

关键词：data-driven artificial intelligence, require large volumes, autonomous vehicles, artificial intelligence, ground-truth annotations

备注： 11 pages, 12 figures, 3 tables. Dataset and supplementary information available from the project website

点击查看摘要

Abstract:The development of autonomous vehicles (AVs) usually relies heavily on data-driven artificial intelligence (AI) models that require large volumes of sensor data with ground-truth annotations. While modular architectures are widely used, end-to-end driving paradigms offer a promising alternative by directly mapping sensor inputs to control actions. However, their adoption is limited by challenges in interpretability and explainability. To address this, we present LAIA (Labelled Attention for Intelligent Automobiles), a novel synthetic dataset designed to enrich end-to-end driving research with human attention data. Collected using the CARLA simulator in closed-loop environments, LAIA comprises over 15 hours of driving from 44 participants across carefully crafted scenarios designed to evoke natural responses. Each sequence includes RGB images under six weather conditions, semantic and instance segmentation, depth, optical flow, CAN bus signals, and synchronized eye-tracking data. LAIA enables applications including training attention-aware end-to-end AI drivers, predicting driver behavior, developing methods to detect anomalous driver-attention patterns, and improving model explainability. In this work, we use LAIA to compare human attention with the perceptual attention emerging in our end-to-end driving models, thereby providing insight into their behavior.

38. 【2607.25565】ReDesign: Recovering Editable Design Structures from Images via Agentic Decomposition

链接：https://arxiv.org/abs/2607.25565

作者：Jooyeol Yun,Jintae Park,Hyesu Lim,Junha Hyung,Hyungjin Chung,Jaegul Choo

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：recovering multi-modal attributes, modern design workflows, editable design file, recovering multi-modal, vector geometry

备注： Accepted to ECCV 2026

点击查看摘要

Abstract:Recovering an editable design file from a raster image is a common and costly bottleneck in modern design workflows, yet remains challenging since editability depends on recovering multi-modal attributes, such as typography, vector geometry, colors, grouping, and layer ordering. We present ReDesign, an agentic framework that grows an editable layer hierarchy by selecting and composing specialized tools across modalities. To keep this long decision process reliable despite imperfect tool outputs, we introduce graceful verification at each expansion, which provides local accept, prune, or retry feedback that prevents error accumulation and avoids large scale reruns. To evaluate editability at scale, we introduce the Figma Edit Replay Benchmark, consisting of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructed outputs. Across this benchmark and standard reconstruction metrics, ReDesign achieves strong visual fidelity while delivering the highest editability across layout, color, and text edits, outperforming layered decomposition baselines and serial tool use pipelines.

39. 【2607.25563】Few-Shot Open-Vocabulary Remote Sensing Segmentation via Textual Inversion

链接：https://arxiv.org/abs/2607.25563

作者：Junhyuk Heo,Junghwan Park

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Open-vocabulary segmentation labels, segmentation labels arbitrary, labels arbitrary categories, Open-vocabulary segmentation, per-class training

备注：

点击查看摘要

Abstract:Open-vocabulary segmentation labels arbitrary categories from a text query without per-class training, yet on remote sensing imagery it underperforms on categories it handles reliably elsewhere. We find that much of this gap traces to the text query rather than to the segmentation model. Because these models are not specialized for overhead imagery, the class name that serves as the query is often a weak address into the vision-language embedding space. We show that a better name repairs part of the gap, while the remaining failures call for an address that the tested natural-language rephrasings do not provide. We recover that address from a few examples through textual inversion on a frozen model, keeping inference text only. On a representative benchmark this raises the mean intersection over union on the affected categories from 3.9 to 39.4, and across eight remote sensing datasets it improves over few-shot methods that instead inject visual prompts at inference.

40. 【2607.25545】OrthKD: Extracting Generalized Clinical Knowledge from Heterogeneous Teachers for Lightweight Deployment

链接：https://arxiv.org/abs/2607.25545

作者：Yi Xu,Cheng Chen,Mufan Cao

类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)

关键词：Deploying diabetic retinopathy, primary care requires, care requires edge-efficient, requires edge-efficient systems, Deploying diabetic

备注： Accepted to the IJCAI-ECAI 2026 Special Track on AI and Health. 8 pages, 3 figures

点击查看摘要

Abstract:Deploying diabetic retinopathy (DR) screening models in primary care requires edge-efficient systems that remain accurate, safe, and reliable under domain shift. Multi-teacher knowledge distillation (KD) is a natural compression strategy, but existing approaches largely assume that all teachers provide equally trustworthy supervision. In our setting, this assumption fails: a strong CNN teacher (EfficientNet-B3, 0.876 QWK) and a weaker Transformer teacher (Swin-Base, 0.830 QWK) are complementary, yet the Transformer's logits can still mislead the student. We therefore propose OrthKD, a selective-trust distillation framework that transfers full supervision from the strong CNN, uses feature-only distillation from the weak ViT, and enforces orthogonality between teacher-specific student projections to encourage complementary rather than redundant evidence. This design preserves local lesion precision, injects global structural context, and improves robustness to distribution shift. On 132,049 retinal images, a 5.4M-parameter MobileNetV3 student reaches 0.885 QWK on EyePACS and improves zero-shot Messidor-2 performance from 0.507 to 0.728 QWK, while also achieving strong referral AUC and calibration. These results show that selectively distilling heterogeneous teachers can enable practical DR screening on resource-constrained devices.

41. 【2607.25543】Less is More: Modality-Decoupling for General AIGC Audio-Video Detection

链接：https://arxiv.org/abs/2607.25543

作者：Jielun Peng,Yabin Wang,Yaqi Li,Jincheng Liu,Xiaopeng Hong,Athanasios V. Vasilakos

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：rapidly expanded audio-visual, rapidly expanded, human-centric deepfakes, AIGC detection, Generative

备注： First place in the General AIGC Audio-Video Detection Challenge at the IJCAI-ECAI 2026 DDL 2.0 Workshop

点击查看摘要

Abstract:Generative AI has rapidly expanded audio-visual forgery beyond human-centric deepfakes into general scenes. Existing AIGC detection methods assume audio-visual content correspondence, identifying forgeries by spotting cross-modal inconsistencies. However, we empirically find that this assumption does not consistently hold in general scenarios. We argue that, for general audio-visual AIGC detection, decision-level fusion is a more robust alternative to feature-level fusion. Therefore, we propose DAV-Det, a decoupled audio-visual AIGC detection system that independently models forensic evidence from each modality. The visual detector leverages multi-granularity representations at global, patch, and segment levels to capture spatial forgery cues, while the audio detector exploits both temporal and spectral irregularities via a gated temporal-spectral dual-branch architecture to model acoustic artifacts. Our method ranks 1st in the General AIGC Audio-Video Detection Challenge of the IJCAI-ECAI 2026 DDL 2.0 Workshop, with a final score of 0.8460. Code is available at this https URL.

42. 【2607.25537】Visual prompt engineering for video models

链接：https://arxiv.org/abs/2607.25537

作者：Robert Geirhos,Yuxuan Li,Thaddäus Wiedemer,Neha Kalibhat,Zi Wang,Mani Malek,Oyvind Tafjord,Kevin Swersky,Been Kim,Priyank Jaini

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：prompt engineering, visual prompt engineering, prompt, visual prompt, engineering

备注：

点击查看摘要

Abstract:In the age of foundation models, a model is only as good as its prompt. For this reason, prompt engineering has become an essential technique for improving language model performance. Since video models are currently becoming foundation models for visual tasks (e.g., visual reasoning), we here ask whether they similarly benefit from visual prompt engineering: automatically modifying the task image to improve model performance. For example, for a visual physics reasoning task ("Where does the ball land, after passing a set of obstacles?"), an abstract sketch-like scene can be turned into a photorealistic version with a simple call to an image editing model. We find that visual prompt engineering, or VIPE for short, improves video reasoning performance across tasks. In fact, for video models, visual prompt engineering can be even more effective than classic text-based prompt engineering or test-time scaling. Ultimately, just as text-based prompt engineering systematically improves language model performance, visual prompt engineering can serve as a simple, compute-efficient approach to elicit better visual reasoning performance from video models. Example videos on our project page at this https URL.

43. 【2607.25531】Multi-Scale Structural Features for Continual, Comprehensible Visual Recognition in a Developmental Learning Framework

链接：https://arxiv.org/abs/2607.25531

作者：Zeki Doruk Erden

类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Contemporary machine learning, comprehensible internal structure, Contemporary machine, machine learning struggles, reuse prior knowledge

备注：

点击查看摘要

Abstract:Contemporary machine learning struggles to learn continually, reuse prior knowledge, and expose a comprehensible internal structure. A recently proposed developmental, gradient-free learning framework addresses these limitations by learning a discrete, topological model of its inputs through local variation and selection, yielding an inherent continual-learning guarantee: new observations refine existing structure without overwriting past knowledge, and without replay buffers or predefined task boundaries. Its extension to visual inputs demonstrated this principle on shape recognition, but relied on a feature representation of limited expressivity that capped recognition accuracy. We introduce a new visual feature representation that encodes shape structure across multiple scales, capturing edge and contour features together with their spatial relations, and integrate it with the network-refinement learning process; we further improve the learning dynamics and the read-out used to predict from the learned model. The study targets two-dimensional shape, with class-incremental MNIST as a controlled, interpretable benchmark in which continual-learning behavior can be measured directly. Our approach substantially increases accuracy over the prior representation, matching or exceeding replay- and regularisation-based baselines at comparable storage while storing no past data, and preserves the framework's defining behavior: earlier-learned classes are retained as new ones are introduced, with no destructive adaptation, and the learned representations remain human-interpretable. What separates the methods is retention: the baselines surrender most of a just-trained class within its own cycle and relearn it afterwards, which ours does not. The significance lies in the manner of learning. The system integrates information one sample at a time while provably preserving its responses to...

44. 【2607.25527】Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation

链接：https://arxiv.org/abs/2607.25527

作者：Weiming Zhuang,Jiabo Huang,Jingtao Li,Zhizhong Li,Chen Chen,Sina Sajadmanesh,Lingjuan Lyu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：holds immense promise, Unifying visual understanding, visual features needed, model holds immense, Unifying visual

备注：

点击查看摘要

Abstract:Unifying visual understanding and generation in one model holds immense promise, but remains challenging and expensive due to heavy compute and data demands and conflicts between the visual features needed for these two capabilities. To address these challenges, we present Argus-Unified, a compact, effective and unified multimodal model built with low demand on computation and data. Instead of aligning modalities from scratch, Argus-Unified effectively leverages pretrained vision-language models (VLMs) that provide strong multimodal priors. Specifically, we introduce hybrid visual tokens that preserve continuous tokens for understanding while learning discrete tokens for generation from a frozen unified vision encoder. Our training pipeline includes two stages: the first stage learns a quantizer and image decoder on top of the frozen vision encoder, the second stage trains the LLM initialized from a pretrained VLM for the unified multimodal modeling. Using by far the least amount of data (15.6M) and the lowest cost (~$2,000), we demonstrate that unified multimodal models can be trained economically while achieving strong performance in both understanding and generation. Notably, our model attains state-of-the-art multimodal understanding on GQA, POPE, and VQAv2, and competitive generation quality compared to models with dedicated vision encoders (e.g., Janus, Janus-Pro), all at ~10x lower cost and with ~5x less data. We envision Argus-Unified as a useful baseline that lowers the development barrier for unified models.

45. 【2607.25524】ReLATE: Reliability-Guided Evidence Fusion for Robust UAV--Satellite cross-view Geo-Localization

链接：https://arxiv.org/abs/2607.25524

作者：Haochen Jiang,Jialei Pan,Yuzhe Sun,Zhe Dong,Lecheng Ren,Yanfeng Gu,Tianzhu Liu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Unmanned aerial vehicle, geo-localization matches UAV, Unmanned aerial, matches UAV images, achieved impressive accuracy

备注：

点击查看摘要

Abstract:Unmanned aerial vehicle (UAV)-satellite cross-view geo-localization matches UAV images against satellite imagery and has achieved impressive accuracy on clean (non-degraded) image benchmarks. In real-world flights, however, UAV observations are frequently affected by adverse weather, illumination changes, platform motion, sensor noise, and compression, while the robustness of existing methods under such degradations remains largely unexamined. In this paper, we present UAVSat-Deg, a large-scale robustness benchmark for degraded UAV-satellite geo-localization, comprising University-1652-Deg and SUES-200-Deg. UAVSat-Deg covers 27 corruption types, including 19 core and 8 compound corruptions, at three severity levels, supports bidirectional drone-to-satellite and satellite-to-drone retrieval as well as multi-height UAV acquisition, and contains more than 11.7 million pre-generated corrupted test images. Benchmarking representative methods under this protocol reveals substantial robustness gaps, particularly under severe and compound corruptions. To address this problem, we propose ReLATE, a Reliable Evidence Learning framework with Adaptive Token Evidence Regulation, which realizes reliability-adaptive feature fusion during descriptor construction. ReLATE estimates a structure-smoothed reliability field over visual tokens, aggregates trustworthy local evidence, and adaptively integrates it into query-derived representations; the regulated query representations are then combined with the CLS-token and GeM-pooled branches to form the final cross-view descriptor. Across both test sets and retrieval directions, ReLATE achieves the best average corrupted-test performance among the compared methods while maintaining competitive accuracy on clean images. The code and dataset will be available at this https URL.

46. 【2607.25522】I2VShield: An Efficient Proactive Defense Framework against DiT-based Image-to-Video Models

链接：https://arxiv.org/abs/2607.25522

作者：Yimao Guo,Zuomin Qu,Wei Lu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：rapid advancement, increasing misuse, models, Multimodal Attention Disruption, proactive defenses

备注：

点击查看摘要

Abstract:The rapid advancement of video generation models has led to the increasing misuse of image-to-video (I2V) models. Although substantial progress has been made in detecting AI-generated videos, proactive defenses against I2V models remain underexplored. In particular, current proactive defenses against I2V models predominantly rely on gradient-based adversarial attacks, which require defenders to possess GPUs with substantial memory resources (VRAM) to generate adversarial examples. To address this issue, we propose I2VShield, a privacy protection method based on generative adversarial attacks tailored to Diffusion Transformer (DiT)-based I2V models. The proposed method primarily consists of two components: (1) a text-adaptive perturbation generation framework integrating adversarial learning to mitigate computational overhead while maintaining visual imperceptibility; and (2) an untargeted Multimodal Attention Disruption (MAD) attack that exploits the inherent vulnerabilities of DiT-based I2V models, maximizing the deviation of the internal attention features from their clean states. Extensive experiments demonstrate that our approach achieves highly competitive protection performance across various datasets and mainstream DiT-based I2V models, particularly in disrupting spatiotemporal coherence, while substantially reducing computational costs.

47. 【2607.25503】Group Equivariant Diffusion for Anomaly Detection in Computational Cytology

链接：https://arxiv.org/abs/2607.25503

作者：Swarnadip Chatterjee,Ssharvien Kumar Sivakumar,Anirban Mukhopadhyay

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Computational cytology, whole-slide images, images is challenging, challenging because malignant, annotated slides

备注： 11 pages, 2 figures, 1 table, 1 algorithm. Accepted for publication in MICCAI 2026

点击查看摘要

Abstract:Computational cytology on whole-slide images is challenging because malignant cells are rare, heterogeneous, and annotated slides are scarce. Anomaly detection frameworks can be trained on normal slide-negative patches and then applied at test time to flag abnormal patches in held-out slides. Most unsupervised anomaly detection approaches including generative ones (GAN-based and diffusion-based), are tuned to organ-level imaging and require large curated datasets. In cytology the signal is cell-centric: rotating or flipping a single-cell patch does not change its diagnostic class, yet standard diffusion models treat transformed views as distinct inputs, leading to transformation-dependent reconstructions and unstable anomaly scores. We propose a D4-equivariant diffusion framework that enforces rotation and reflection symmetry both architecturally, via a D4-equivariant U-Net, and at inference, via equivariant noise coupling and (optionally) frame averaging. This alignment with biological invariance yields transformation-consistent pseudo-healthy reconstructions and more stable anomaly ranking under symmetry. On two publicly available cytology datasets of bone marrow and peripheral blood smears, our D4-equivariant diffusion models achieve higher AUC and retrieve more abnormal cells in the top K predictions than non-equivariant generative baselines, a deep one-class, and a multiple instance learning based method, while substantially reducing score variance across rotations and flips. Code is available at this https URL.

48. 【2607.25497】Beyond Counts: A Distributional Robustness Margin For Pathology Foundation Models

链接：https://arxiv.org/abs/2607.25497

作者：Clément Grisi,Jeroen van der Laak,Geert Litjens

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：approaching clinical deployment, Pathology foundation models, Pathology foundation, systematic non-biological variation, clinical deployment

备注： Preprint

点击查看摘要

Abstract:Pathology foundation models are approaching clinical deployment, yet remain vulnerable to systematic non-biological variation across centres. Differences in tissue preparation, staining and scanning are strongly encoded in their representations, enabling shortcut learning and weakening generalisation across cohorts and institutions. The Robustness Index (RI) quantifies whether local representation geometry is dominated by biology or by non-biological variation, but its count-based formulation discards distance information. We show that adding distance weights changes little because the deeper limitation lies in RI's pooled, fixed-neighbourhood design, which obscures sample-level heterogeneity and effectively evaluates only a model-dependent subset of samples. We introduce the Cross-confounder Robustness Margin (CRoMa), a sample-resolved measure that directly compares distances to cross-confounder biological matches and same-confounder biological distractors. CRoMa recasts robustness as a cohort-wide margin distribution rather than a single pooled score. We evaluated frozen representations from 20 tile-level encoders across three benchmarks and 4 slide-level encoders on a fourth. Rankings by median CRoMa were broadly consistent across datasets, while the underlying distributions revealed substantial within-model heterogeneity. Every tile encoder retained a confounder-dominated lower tail, whose prevalence and severity varied markedly across models. These distinct robustness profiles frame model selection as a Pareto trade-off between typical and lower-tail robustness. Higher CRoMa was also associated with smaller shortcut-induced performance drops after supervised adaptation. By turning representation geometry into a distributional robustness readout that anticipates downstream shortcut susceptibility, CRoMa provides a principled basis for robustness assessment and model selection.

49. 【2607.25489】Agentic AI in medicine: architectures, applications, evaluation, and challenges for clinical translation

链接：https://arxiv.org/abs/2607.25489

作者：Zheng Tong,Yang Liu,Wanshu Fan,Jing Qin,Zhongbin Han,Haifan Gong,Congyu Liao,Xiaofeng Liu,Cong Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Large language models, multimodal foundation models, Large language, medical artificial intelligence, undertake multistep clinical

备注： Review article, 6 figures, 2 tables. 42 pages

点击查看摘要

Abstract:Large language models and multimodal foundation models are enabling medical artificial intelligence (AI) systems to move beyond isolated prediction and undertake multistep clinical tasks that require planning, tool use, memory, iterative correction, and coordination among specialized agents. However, the scope of agentic AI in medicine remains unsettled, and current evaluation practices are not yet aligned with the requirements of clinical use. We conducted a scoping review with systematic evidence mapping across five electronic sources, screened 1,649 exportable records, and provisionally included 557 unique studies that met predefined criteria for goal-directed task execution, tool use, interaction with external resources, feedback-based refinement, or multi-agent collaboration. The included studies describe single agents that use external tools, workflows supported by retrieval and external knowledge, multimodal agents, and multi-agent systems applied to medical question answering, image interpretation, electronic health record analysis, drug safety, and clinical trial prediction. The evidence base remains dominated by public benchmarks, simulated settings, retrospective datasets, and small-scale expert evaluation. Process reliability, evidence traceability, uncertainty, safety, workflow impact, and external validity are evaluated less consistently. Clinical translation will depend on clearer definitions, reproducible evaluation, auditable oversight, interoperable system design, and prospective validation in real-world clinical workflows.

50. 【2607.25487】CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model

链接：https://arxiv.org/abs/2607.25487

作者：Minhyeok Lee,Chiyoung Kim,Chanhoe Gu,Seongrok Kim,Sanghyuk Roy Choi,Donghwan Hwang,Donghun Ryu,Seokhyun Kim

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：models translate natural-language, translate natural-language commands, robot action sequences, embedded robotic budgets, exceed embedded robotic

备注： 22 pages, 2 figures, 20 tables. Code at [this https URL](https://github.com/BrainJellyPie/CoTinyVLA)

点击查看摘要

Abstract:Vision-Language-Action (VLA) models translate natural-language commands into robot action sequences, but leading systems on the LIBERO-Plus robustness benchmark use three- to seven-billion-parameter backbones whose memory demands can exceed embedded robotic budgets. We present CoTinyVLA, a 0.9B-parameter action model on a Qwen3.5-0.8B backbone that obtains that robustness by structuring supervision instead of enlarging the model. Three components target different axes of the problem: dual-view temporal input of 16 history frames per step with textual camera and time markers; hierarchical chain-of-thought (CoT) distillation from a 35B teacher into an episode-level Plan and a chunk-level Think span over task phase, gripper state and next subaction; and paraphrase augmentation expanding 40 base commands into 800 variants. On LIBERO-Plus, spanning 10,030 perturbed tasks across seven perturbation dimensions, CoTinyVLA reaches 90.8% on Spatial, 87.3% on Object, 86.6% on Goal and 80.7% on Long, leading the strongest 7B baseline on all four suites by 4.7, 2.8, 15.9 and 3.0 points, with every margin interval excluding zero. The gains concentrate on the hardest axes of the benchmark: across the eleven published baselines none exceeds 53.2% on Robot Initial States in any suite, whereas CoTinyVLA reaches 73.6% on Goal against 39.9% for the strongest baseline. Ablations show the three components to be separable by perturbation axis, and at a matched image budget how frames are divided between the two cameras and across time accounts for 8.6 points on its own. Closed-loop inference peaks at 2.25 GiB of allocated GPU memory, and paired interventions show the episode Plan to be load-bearing: replacing it with an empty or contradictory span costs 40 to 45 points of success. Structured supervision thus lets a 0.9B backbone exceed all of them. Code: this https URL

51. 【2607.25468】Safety-Aware Cascaded Inference for Crop Damage Assessment with Controlled Error Trade-offs

链接：https://arxiv.org/abs/2607.25468

作者：José Thiéry Messigbédé Hagbe,Gani Kawsar Gounou,Songbian Karim Zimé

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：picture-based agricultural insurance, detections carry substantially, carry substantially higher, sustained real losses, real losses receives

备注： 44 pages, 7 figures, 12 tables. Submitted to Precision Agriculture, July 2026

点击查看摘要

Abstract:In picture-based agricultural insurance for smallholder farmers, missed damage detections carry substantially higher cost than false alarms: a farmer who sustained real losses receives no payout, while unnecessary expert review is operationally costly but reversible. Standard multi-class classifiers optimize global accuracy but provide no mechanism to operationalize or control this asymmetric cost structure at inference time. We propose CascadeCropNet, a two-stage cascade architecture calibrated to satisfy a target recall constraint (Rec-Damaged = 0.95) through threshold selection. A lightweight Sentinel model performs binary health triage; samples exceeding a calibrated damage probability threshold tau are escalated to a specialist Expert model for fine-grained diagnosis. This design provides explicit, deployment-time control over the safety-efficiency trade-off without retraining. Evaluated on the Eyes on the Ground dataset (23,804 images from Kenyan smallholder maize farms), the cascade achieves Rec-Damaged = 0.974 at tau = 0.5, reducing missed damage cases by up to 54% relative to a flat baseline. Under evaluation alignment, the representational gap reduces to +0.008 F1-macro, confirming the contribution is architectural rather than representational. Under input degradation, the system prioritizes escalation over confident misclassification, reflecting error containment through architectural isolation rather than intrinsic model robustness. These results demonstrate that cascade architectures can operationalize safety-oriented decision constraints through calibrated routing in settings where reliability matters more than aggregate accuracy. These properties depend on threshold calibration and deployment conditions and do not constitute guarantees under arbitrary distribution shift.

52. 【2607.25467】Seen, Said, or Forgotten? A Causal Audit of Visual KV Memory Across Dialog Turns

链接：https://arxiv.org/abs/2607.25467

作者：Hong Chen,Kang Chen,Yuxuan Fan,Bo Wang,Yubo Gao,Yuanlin Chu,Xuming Hu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Stateful multimodal assistants, Stateful multimodal, multimodal assistants encode, Visual Memory Audit, Stateful

备注：

点击查看摘要

Abstract:Stateful multimodal assistants encode an image once but may answer questions about it many turns later. Attention-guided visual-KV eviction assumes that evidence irrelevant now will remain dispensable, although future questions are unknown. We ask when a visual fact is actually safe to forget and introduce the Causal Visual Memory Audit (CVMA), a paired single-prefill framework that tests what later answers lose when a visual region, the whole image, or prior assistant text becomes unavailable. On VisDial and ConvBench, current attention can rank future-useful regions worse than random even though a diagnostic marginal-utility control shows substantial selection headroom. Aggregate scores hide this failure when later turns do not need vision; controlled and stock-generated histories reveal a second escape route, in which assistant-text KV replaces image KV for facts already stated but not reliably for unstated facts. In the tested stacks, safe forgetting is supported by low future visual dependence or fact-specific verbalization---not by low current attention.

53. 【2607.25465】DensFiLM: Density-Conditioned Video Saliency for Crowd Scenes

链接：https://arxiv.org/abs/2607.25465

作者：Anis Ur Rahman

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：single fixation strategy, Video Swin Transformer, models typically apply, Feature-wise Linear Modulation, typically apply

备注： 12 pages, 2 figures, 3 tables

点击查看摘要

Abstract:Video saliency models typically apply a single fixation strategy across crowd scenes, despite systematic changes in attention with crowd density. Sparse scenes encourage tracking individuals, whereas dense scenes shift attention toward collective motion and scene-level landmarks. We introduce DensFiLM, a density-conditioned video saliency model that inserts a lightweight Feature-wise Linear Modulation layer at the bottleneck of a Video Swin Transformer. A learned density embedding produces channel-wise scale and shift parameters, allowing the decoder to reconstruct saliency from features selected for each density regime. The module adds only ~100K parameters and can use either CrowdFix density labels or the model's own density prediction. On CrowdFix, DensFiLM achieves mean NSS 1.434 and CC 0.517 over four seeds, improving over ACLNet by 14.7% and 14.9%, respectively, while predicted-density conditioning matches oracle-label performance. Ablations show that explicit RAFT optical flow and larger temporal and social-force extensions provide no further improvement in this setting. In a centre-prior-subtraction diagnostic, density conditioning yields an NSS gain of 0.462 over the unconditioned backbone, compared with 0.124 under standard evaluation. These results show that lightweight bottleneck conditioning provides a more effective inductive bias than increasing model capacity for crowd-video saliency. Our code is available at this https URL.

54. 【2607.25455】Reading Legends on Ancient Coins: An Object Detection Approach for Character Recognition on a Novel Roman Republican Dataset

链接：https://arxiv.org/abs/2607.25455

作者：Hafeez Anwar

类目：Computer Vision and Pattern Recognition (cs.CV); Emerging Technologies (cs.ET)

关键词：time and issuer, paramount importance, proper classification, ancient Roman Republican, Roman Republican

备注：

点击查看摘要

Abstract:When it comes to the proper classification of ancient coins with respect to their time and issuer, the textual inscriptions on these coins, also known as legends, are of paramount importance. These legends consist of alphabets or characters still used in English. This paper addresses image based character recognition on ancient Roman Republican coins via a deep learning based object detection strategy. However, legends on these coins pose high variation due to non-uniform placement, primitive inscription techniques, and wear and tear. Additional challenges include inconsistent imaging conditions such as illumination, orientation, and scale. To accommodate these, we gathered a novel large-scale dataset of 5,654 Roman Republican coin images, manually annotated with 21 character labels, totaling 38,808 annotations. For recognition, we use You Only Look Once (YOLO) variants: YOLOv3, v4, v5, v7, and v8. YOLOv7-Large achieves the best mAP50 of 90.4%, followed by YOLOv7-Extended and YOLOv7-xl with 90.2% and 90.1%, respectively.

55. 【2607.25432】Bi-Level Collaborative Learning for Few-Shot Scribble-Supervised Medical Image Segmentation

链接：https://arxiv.org/abs/2607.25432

作者：Xiang-Xiang Su,Yufan Ye,Yihang Zheng,Min Gan,Guang-Yong Chen

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Scribble annotations offer, annotated sample scarcity, real clinical scenarios, costly pixel-wise labeling, Scribble annotations

备注：

点击查看摘要

Abstract:Scribble annotations offer an efficient alternative to costly pixel-wise labeling for medical image segmentation, yet in real clinical scenarios, scribble-annotated samples are often still limited, imposing the dual challenges of sparse supervision and annotated sample scarcity. These compounded constraints severely deprive models of the structural evidence needed for complete region recovery and precise boundary delineation. To break this bottleneck, we propose a bi-level collaborative learning framework for few-shot scribble-supervised medical image segmentation. Specifically, an upper-level learnable superpixel model is introduced to provide region-structural priors for lower-level segmentation, while superpixel-based region-wise pseudo-label propagation and a spatial-prior-guided filtering strategy are performed to generate reliable dense pseudo-labels for segmentation learning. Meanwhile, the anatomical semantics learned by the lower-level segmentation model under the guidance of the current superpixels are fed back to the upper level, further driving it to learn region-structural representations better aligned with the segmentation task. Through bidirectional interaction and collaborative learning between the upper and lower levels, the proposed framework significantly outperforms existing state-of-the-art scribble-supervised methods on the ACDC and Prostate datasets under the few-shot scribble-supervised setting.

56. 【2607.25407】ANFI: Rethinking Neighbor Feature Interaction in Person Re-ID

链接：https://arxiv.org/abs/2607.25407

作者：Xulin Li,Yan Lu,Bin Liu,Jiaze Li,Qinhong Yang,Tao Gong,Qi Chu,Nenghai Yu

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：achieved significant success, person re-identification, robust representations, achieved significant, obtain more robust

备注： accepted by ECCV2026

点击查看摘要

Abstract:In person re-identification, neighbor-based methods have achieved significant success by interacting with neighbor samples to obtain more robust representations. However, existing methods rely only on affinity relations, causing their success to depend heavily on the reliability of selected neighbors. We find that affinity-only interaction often fails in challenging scenarios due to the inevitable presence of noisy neighbors. To enable effective interactions under noisy neighborhoods, we revisit neighbor-based methods under distinct reliability conditions and propose a novel Adaptive Neighbor Feature Interaction (ANFI) method. The core idea of ANFI is to account for negative effects from noisy neighbors, allowing samples to remain distinguishable from false positive neighbors. Unlike existing methods, ANFI models not only affinity relations but also discrepancy relations, and employs sample-wise adaptive weighting for these two types of relations. Given that capturing negative effects from noisy neighbors differs significantly from traditional relation learning, we derive discrepancy relations from a new neighborhood similarity, which provides more information than pairwise similarity. In addition, we propose Noisy Relation Supervision (NRS) to train ANFI, gradually injecting robustness to noisy relations into the model. Extensive experiments conducted under standard, cross-modal, and cross-domain settings, including comparisons with neighbor-based methods and re-ranking methods, demonstrate the superiority of our method across various neighbor distributions.

57. 【2607.25393】owards Reliable Stain Transfer: An Iterative Data-Model Co-Optimization Framework Based on Multimodal Expert-Guided Assessment

链接：https://arxiv.org/abs/2607.25393

作者：Siyuan Xu,Yan Wang,Haofei Song,Lili Gao,Jiansheng Wang,Qing Zhang,Dan Huang,Boxiang Yun,Hongkai Xiong,Qingli Li

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Histopathological examination primarily, examination primarily relies, Histopathological examination, hematoxylin and eosin, examination primarily

备注： 10 pages, accepted by ACMMM2026 Main Track

点击查看摘要

Abstract:Histopathological examination primarily relies on hematoxylin and eosin (HE) and immunohistochemistry (IHC) staining. Although IHC provides critical molecular information, it is costly and requires specialized expertise. Stain transfer provides an efficient alternative by computationally generating IHC from HE images, but remains challenged by unified and interpretable modeling for heterogeneous biomarkers under pixel-unaligned supervision. We propose DMCoStain, a novel Data-Model Co-optimization framework for Stain transfer. It iteratively co-refines training data and model capability, improving staining accuracy and interpretability in both pathological and structural consistency. To refine training data in a clinically meaningful manner, it incorporates the Multimodal Expert-Guided Finer Selection (MEGFS) strategy, built upon a pioneering IHC-positive-expression (IPE) vision-language model (VLM) that emulates pathologist reasoning. To support MEGFS, we construct ImmunoInstruction, the first large-scale IPE instruction-following dataset with 150K VQA samples. Extensive experiments on multiple tissues and biomarkers demonstrate that DMCoStain achieves state-of-the-art (SOTA) accuracy. This paradigm offers strong practical value, and MEGFS also functions as a specialized evaluation tool for future model development. Dataset, code, and more details are in this https URL.

58. 【2607.25392】RDVSv2: A Large-scale Benchmark for RGB-D Video Salient Object Detection

链接：https://arxiv.org/abs/2607.25392

作者：Tianyu Li,Jiahao He,Keren Fu,Qijun Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：RGB-D VSOD, dense frame-level annotations, existing RGB-D VSOD, RGB-D, salient object detection

备注： Accepted to ACMMM 2026

点击查看摘要

Abstract:We introduce RDVSv2, a large-scale benchmark for RGB-D video salient object detection (RGB-D VSOD) with dense frame-level annotations. Existing datasets in this emerging field are often limited in scale and annotation quality, while also relying on less geometry-consistent depth cues. To address these limitations, RDVSv2 is built from publicly accessible stereoscopic online videos and contains 249 video sequences with 29,077 annotated frames. It includes depth maps derived from stereoscopic videos, together with frame-wise salient object masks annotated with eye-tracking guidance. Compared with existing datasets, RDVSv2 is much larger in scale and covers more diverse and challenging scenarios. In addition, we establish a strong baseline for RGB-D VSOD based on Segment Anything Model 2 (SAM2). Specifically, we employ a parameter-efficient fine-tuning (PEFT) strategy to adapt the SAM2 encoder to jointly encode RGB, depth, and optical flow cues. Extensive experiments show that RDVSv2 is substantially more challenging for existing RGB-D VSOD methods. Meanwhile, the proposed baseline achieves state-of-the-art results on RDVSv2 and existing RGB-D VSOD benchmarks. We hope that RDVSv2 and the provided baseline will serve as useful resources for future research on RGB-D VSOD and related multi-modal video understanding tasks. Our dataset and code will be available at this https URL.

59. 【2607.25390】Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors

链接：https://arxiv.org/abs/2607.25390

作者：Jaeha Kim,Kyoung Mu Lee

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：impair downstream high-level, downstream high-level vision, reduce visual quality, high-level vision tasks, reduce visual

备注： Code: [this https URL](https://github.com/JaehaKim97/NOLA-IR)

点击查看摘要

Abstract:Degraded images not only reduce visual quality but also impair downstream high-level vision tasks. Task-driven image restoration (TDIR) addresses this issue by jointly optimizing restoration quality and task performance. Recent works show that pretrained diffusion priors benefit TDIR, yet diffusion-based restoration is inherently stochastic, as the sampling process depends on a random noise term, which can undermine task consistency. In this paper, we show that a deterministic, noise-free one-step forward pass with pretrained diffusion priors can substantially improve TDIR, but the benefit critically depends on the adaptation module: LoRA yields consistent gains, whereas ControlNet-style conditioning does not. This enables one-step forwarding that surpasses conventional multi-step diffusion TDIR baselines. Furthermore, we introduce a task-preserving GAN training strategy that improves perceptual quality without sacrificing task performance. Extensive experiments on classification, segmentation, and detection demonstrate consistent gains over prior TDIR methods, and we further validate generalization on real-world degraded images and OCR.

60. 【2607.25389】HOME: Robust Hough-space Matching Method for Structured and Textureless Videos

链接：https://arxiv.org/abs/2607.25389

作者：Masaki Satoh

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Oriented FAST, FAST and Rotated, structured environments dominated, localization typically rely, Visual front-ends

备注： 7 pages, 5 figures

点击查看摘要

Abstract:Visual front-ends for robotic localization typically rely on point-based features such as Oriented FAST and Rotated BRIEF (ORB), which frequently fail in structured environments dominated by strong linear structures or textureless surfaces. While line-based Simultaneous Localization and Mapping (SLAM) systems mitigate this by utilizing line segments, conventional line extraction and description algorithms are computationally prohibitive for real-time edge robotics. To address this fundamental bottleneck, we propose HOME (Hough-space One-dimensional Matching of Extrema), an ultra-lightweight, training-free feature matching framework. HOME transforms images into Hough space, mapping global linear structures to stable local extrema, which serve as keypoints, thereby reformulating complex line matching into highly efficient one-dimensional point matching. The proposed 1D radial descriptor mathematically guarantees rotational and translational invariance without the overhead of explicit orientation estimation. As a proof of concept to validate the matching accuracy and efficiency of HOME, this paper focuses on homography estimation. Extensive evaluations demonstrate that HOME achieves robust registration in challenging scenarios where point-based methods fail, operating at a much faster speed than existing line-based methods. Extending this robust matching engine to full 3D pose estimation remains a highly promising future direction.

61. 【2607.25377】Gaussian Volumetric Representation for Efficient Shear-Warp Visualization

链接：https://arxiv.org/abs/2607.25377

作者：Mayuri Mathur(1),Ojaswa Sharma(1) ((1) Indraprastha Institute of Information Technology Delhi)

类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)

关键词：image visualization requires, Medical image visualization, preserve anatomical fidelity, visualization requires volumetric, algorithms that preserve

备注：

点击查看摘要

Abstract:Medical image visualization requires volumetric rendering algorithms that preserve anatomical fidelity while maintaining high rendering speeds. To address the high computational cost of large volumetric datasets, we propose a Gaussian-based volumetric representation for efficient visualization of dense medical volumes without compromising structural and radiometric details. We optimize the proposed representation using Monte Carlo volumetric estimation, which enables training on a highly sparse subset of voxels while maintaining consistency with the dense volumetric objective. In addition, we introduce a curriculum learning strategy that progressively incorporates structured slice-based sampling during training. Sparse voxel samples provide an early global coverage of the volume, while slice samples capture spatially correlated regions that aid geometric structure and texture continuity. This combination enables the Gaussian representation to learn anatomical details of various structures and corresponding textures from sparse supervision while significantly reducing the computational cost associated with dense voxel processing. The learned representation supports slice-based rendering methods such as shear-warp volume rendering, enabling efficient visualization of multimodal medical datasets including MRI and Cryosection volumes while preserving anatomical structures. Using sparse supervision, our method achieves up to 43.86 FPS rendering with a compression ratio of 11.31:1.

62. 【2607.25371】Hyperspectral Intrinsic Decomposition: Joint Recovery of Reflectance and Photometric Components for Non-Lambertian Scenes

链接：https://arxiv.org/abs/2607.25371

作者：Hao Ye,Zhan Shi,Chenglong Huang,Tao Lv,Mingjie Ji,Qiu Shen,Xun Cao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：understanding real-world imaging, real-world imaging processes, material-related spectral properties, disentangle material-related spectral, hyperspectral images

备注：

点击查看摘要

Abstract:Hyperspectral intrinsic decomposition (HID) aims to disentangle material-related spectral properties and photometric effects in hyperspectral images (HSIs), which is essential for understanding real-world imaging processes and benefits a variety of downstream applications. Most existing HID studies have been developed under Lambertian or near-Lambertian assumptions. The few prior non-Lambertian efforts rely on simplified specular assumptions insufficient to handle diverse real-world specularity, and typically require auxiliary inputs or recover only a subset of the coupled reflectance and photometric components, hindering complete and blind decomposition. In this paper, we revisit the dichromatic reflection model (DRM) and develop a unified inversion paradigm that reformulates the recovery of four coupled reflectance and photometric components as the estimation of two spectral--spatial target variables. Building on this reformulation, we propose a dual-scale decomposition scheme to handle non-Lambertian effects with distinct spatial characteristics. At the global scale, photometrically invariant descriptors serve as edge priors for high-fidelity intrinsic boundary preservation; at the local scale, specularity-guided attention directs refinement with emphasis on specularity-dominated regions, including those affected by clipping distortion. To facilitate future research, we establish CITE, the first public real-world HID dataset for non-Lambertian objects, and develop a Physically-faithful Intrinsic Set Generator (PISG) for controllable data synthesis. Extensive ablation studies and experiments on the CITE and additional HSIs demonstrate the effectiveness of our method and its robustness across diverse scenes.

63. 【2607.25367】Leak-Free Cross-Validated Stacking with Per-Architecture Calibration for Sand-Boil Segmentation in Earthen Levees

链接：https://arxiv.org/abs/2607.25367

作者：Padam Jung Thapa,Anav Katwal,Ayon Dey,Abdullah Bin Naeem,Steve Sloan,Kendall Niles,Md Tamjidul Hoque

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：water seeping beneath, earthen levee re-emerges, deep segmentation networks, Sand boils, points where water

备注： 24 pages, 17 figures, 14 tables. Supported by the U.S. Army Corps of Engineers under Contract No. W912HZ-23-2-0004

点击查看摘要

Abstract:Sand boils, points where water seeping beneath an earthen levee re-emerges at the surface, are early warnings of internal erosion, and deep segmentation networks are increasingly used to find them in inspection photographs. Annotated examples are scarce, and two common ways of working around that scarcity quietly inflate reported accuracy: tuning ensemble weights on the same images later used to score them, and training on synthetic images derived from the very photographs held out for testing. We present a sand-boil segmentation framework that closes both loopholes. Every synthetic image carries a pointer to its real parent, and a per-fold filter excludes any image whose parent is held out; five encoder-decoder backbones are trained under five-fold cross-validation, calibrated by one temperature scalar each, and combined by a per-pixel meta-learner fitted only on out-of-fold predictions. On the held-out test set the proposed Updated SandBoilNet reaches an intersection-over-union of 0.707 over three seeds, against 0.608 for the published original re-evaluated on the same split. Under the stacking protocol the calibrated stack reaches 0.681 against 0.694 for the strongest fold-averaged member, so it does not improve on the best single model; eight meta-learner families reproduce that outcome, which we trace to a mean pairwise error correlation of 0.894 among members. A synthetic pool filtered for label fidelity lifts the champion to 0.718 over three seeds against a 0.707 control. We also introduce a mask-conditioned synthesis route that makes the conditioning mask the label by construction, giving labelled training images at zero annotation cost.

64. 【2607.25362】PanoLess: Environment Reconstruction from Partial Reflective Views

链接：https://arxiv.org/abs/2607.25362

作者：Ahitagni Das,Ashok Veeraraghavan,Vivek Boominathan

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：glass facades naturally, facades naturally extend, capturing the surrounding, shiny objects, objects and glass

备注： ECCV 2026. Main paper with supplementary material

点击查看摘要

Abstract:Reflections from shiny objects and glass facades naturally extend the field of view of a camera, capturing the surrounding environment without the need to pan the camera or acquire a full panorama. We propose PanoLess, a Gaussian-splat-based framework that reconstructs the surrounding environment as a distant illumination map from images captured on only one side of a reflective surface. PanoLess leverages surface-aligned 2D Gaussian splats with deferred shading to recover accurate per-pixel normals and reflection cues, which are fused into a neural cubemap representation of the environment. In addition, PanoLess produces a visibility map that explicitly denotes which regions of the environment are supported by the partial reflective observations. Unlike existing inverse-rendering and reflection-aware Gaussian-splatting approaches, which typically require full 360-degree coverage and struggle under incomplete views, PanoLess enables consistent, physically grounded illumination estimation from partial-view input. We show that PanoLess achieves high-fidelity and geometrically consistent environment reconstruction, outperforming reflection-aware baselines on a new custom synthetic benchmark and publicly available datasets, and demonstrating generalization to real-world reflective captures.

65. 【2607.25324】Balanced Soft mixture-of-expert model for Glaucoma Detection

链接：https://arxiv.org/abs/2607.25324

作者：Sai Venkatesh Chilukoti,Krishna Rauniyar,Min Shi,Xiali Hei

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：elevated intraocular pressure, optic nerve, intraocular pressure, group of eye, caused by elevated

备注： 18 pages, 5 figures

点击查看摘要

Abstract:Glaucoma is a group of eye diseases that damage the optic nerve, often caused by elevated intraocular pressure. It is a leading cause of irreversible vision loss and is typically developed slowly and painlessly, making it difficult to notice until significant damage has occurred. Therefore, early detection is crucial to prevent or slow the progression of vision loss. In recent years, deep learning based uni-modal models have improved the accuracy and efficiency of glaucoma detection, empowering doctors with tools for earlier diagnosis, better monitoring, and timely treatment. Building on this, multi-modal models have emerged, leveraging the strengths of different imaging modalities to learn richer and more robust representations, further enhancing glaucoma detection accuracy. However, multi-modal learning faces challenges such as imbalanced and under-optimized uni-modal representations due to joint learning objectives. To address this, we propose a balanced soft mixture-experts model with three experts and load balancing loss. The performance is measured by AUC, our proposed method surpasses the performance of all uni-modal baselines, conventional multi-modal models, and current stateof- the-art balanced multi-modal models. The proposed model can be generalized to other disease detections such as diabetic retinopathy.

66. 【2607.25318】Beyond Background Bias: Saliency-Driven Prototype Alignment for Dataset Distillation

链接：https://arxiv.org/abs/2607.25318

作者：Yawen Zou,Wenqi Cai,Guang Li,Ling Xiao,Chunzhi Gu,Chao Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：synthesize compact datasets, Dataset distillation aims, significantly reducing computational, compact datasets, storage costs

备注：

点击查看摘要

Abstract:Dataset distillation aims to synthesize compact datasets that can approximate the performance of full-data training while significantly reducing computational and storage costs. However, diffusion-based distillation methods often struggle to preserve structural coherence and generalization, especially in visually complex domains. This issue often stems from latent prototypes that are weakly aligned with class-discriminative regions and contaminated by irrelevant background, thereby degrading generation quality and generalization. To address this limitation, we propose a saliency-driven distillation framework that constructs class-discriminative latent prototypes to enhance representativeness and generalization. The framework proceeds in two stages: (1) ensemble Grad-CAM saliency is used to construct prototypes emphasizing high-confidence regions, and (2) hard prototype refinement is then applied to construct challenging yet class-consistent prototypes, thereby enhancing discriminability and diversity. Importantly, the diffusion backbones (e.g., LDM and DiT) remain frozen; only lightweight classifiers used for saliency extraction are trained. Extensive experiments across multiple benchmarks demonstrate consistent performance improvements over strong baselines. Code will be released.

67. 【2607.25314】Sense it with your eyes: Sensation Generation and Understanding for Advertisements

链接：https://arxiv.org/abs/2607.25314

作者：Aysan Aghazadeh,Sina Malakouti,Adriana Kovashka

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：mentally simulate experiences, increasing persuasive impact, Sensory advertising evokes, enabling audiences, advertising evokes human

备注：

点击查看摘要

Abstract:Sensory advertising evokes human senses through visual cues, enabling audiences to mentally simulate experiences and increasing persuasive impact. Despite the recent increase in using AI in generating and understanding creative and persuasive content, how advertisements visually evoke sensations remains largely unexplored. In this work, we introduce the first study of understanding, evaluating, and generating sensory ads. We introduce the Sensory Ad dataset, and define sensation classification tasks (SenseClass) to benchmark LLMs and MLLMs. We further propose SenseScore, an automated evaluation metric for sensation evocation achieving strong agreement with human judgments. Finally, we introduce the Sensory Ad Generation (SenseGen) task and propose SAGA, a multi-agent framework that improves message image alignment, sensory evocation, and persuasion. Our work establishes a foundation for sensory-aware visual persuasion.

68. 【2607.25310】Human-in-the-Loop Signature Bootstrapping for UAV Hyperspectral PFM-1 Mine Detection

链接：https://arxiv.org/abs/2607.25310

作者：Sagar Lekhak,Prasanna Reddy Pulakurthi,Emmett J. Ientilucci

类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)

关键词：operational mine screening, Hyperspectral imaging, material discrimination, operational mine, mine screening

备注： Manuscript submitted for peer review

点击查看摘要

Abstract:Hyperspectral imaging (HSI) is useful for material discrimination, but operational mine screening also depends on how many false alarms must be inspected before targets are found. This paper studies PFM-1 landmine detection in unmanned aerial vehicle (UAV) visible and near-infrared (VNIR) HSI using spectral angle mapper (SAM), matched filter (MF), adaptive coherence estimator (ACE), and constrained energy minimization (CEM). We compare a ground-measured SVC signature, a fully informed in-scene core-pixel signature, and a simulated human-in-the-loop signature bootstrap. Besides receiver operating characteristic area under the curve and average precision, we report target-discovery curves and spatial candidate-review counts. Full-review bootstrapping reaches the fully informed in-scene signature case after all seven target regions are verified, but the required inspection effort varies strongly: ACE confirms all regions in two rounds and nine candidate inspections, whereas the SAM variants need thousands of candidate reviews for their final target locations. Code is available at this https URL.

69. 【2607.25300】MEDit-Bench: A Dataset for Evaluating Message-Driven Narrative Video Editing

链接：https://arxiv.org/abs/2607.25300

作者：Katsuya Ogata,Zongshang Pang,Mayu Otani,Yuta Nakashima

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：selected shots change, shots change depending, wishes to convey, selected shots, shots change

备注：

点击查看摘要

Abstract:Video editing is fundamentally message-driven: even from the same source footage, the selected shots change depending on the narrative the editor wishes to convey. Benchmarks for a closely related task, video summarization, reduce editorial intent to a single, message-agnostic notion of saliency and thus do not account for this diversity. For evaluating message-driven video editing, we present \textbf{MEDit-Bench}, a dataset and benchmark, which pairs long-form videos with multiple editing messages and multiple professionally produced edits per message, demonstrating that different messages yield substantially different edits from the same source. We define an automatic evaluation protocol based on temporal alignment metrics, and find that an LLM-as-a-judge preference, a natural proxy for narrative quality, is unreliable for this task due to severe position bias. We additionally annotate each message with ambiguity and contextfulness scores, and show that both dimensions negatively correlate with model performance, establishing message difficulty as a meaningful stratification factor. Experiments with state-of-the-art MLLMs and reinforcement fine-tuned baselines show that while strong models approach human temporal alignment at lenient thresholds, all models fall behind humans at stricter criteria. A human perceptual study further confirms a large quality gap, with professional human edits remaining consistently preferred over model outputs.

70. 【2607.25294】CLBench-V: Evaluating Multimodal Context Learning from Grounding to Knowledge Acquisition

链接：https://arxiv.org/abs/2607.25294

作者：Lai Wei,Chengqi Li,Jiapeng Li,Ruina Hu,Yue Wang,Weiran Huang

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)

关键词：Real-world tasks, learn from task-specific, context, Real-world, multimodal context learning

备注：

点击查看摘要

Abstract:Real-world tasks often require models to learn from task-specific context rather than relying only on pre-trained knowledge. While recent work has highlighted this capability as context learning, existing evaluations mainly focus on textual contexts. In many practical settings, however, the context to be learned from is multimodal: scientific findings are conveyed through figures and tables, financial indicators are scattered across converted reports, and spatial decisions depend on maps, scenes, or web pages. We introduce CLBench-V, a benchmark for multimodal context learning that addresses the difficulty of localizing where context use breaks down by organizing tasks around three dimensions: context grounding, new information application, and new knowledge learning. CLBench-V combines converted public benchmarks with newly constructed datasets spanning domains such as science, finance, long-document understanding, spatial reasoning, and web-based visual question answering. To reduce the cost of constructing domain-specific context-learning tasks, we further use automated construction and filtering procedures for our newly built datasets. Across 3,443 instances and six recent multimodal models, the best overall score is only 0.2847, indicating that multimodal context learning remains far from saturated. Moreover, InternVL3.5-30B-A3B performs best on context grounding and new knowledge learning, while Qwen3.5-Plus performs best on new information application. We further analyze judge reliability, context length, image count, and representative failure cases. Code is available at this https URL.

71. 【2607.25276】FunnelAL: Retrieve-then-Rank Active Learning for Single-Class Discovery

链接：https://arxiv.org/abs/2607.25276

作者：Reihaneh Rostami(RAIC Labs),Brian Goodwin(RAIC Labs)

类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR); Machine Learning (cs.LG)

关键词：multi-stage funnel architecture, funnel architecture, architecture of industrial, active learning, industrial recommender systems

备注： 15 pages, 6 figures, 3 tables

点击查看摘要

Abstract:We present FunnelAL, a retrieve-then-rank active learning system for single-class discovery, which adapts the multi-stage funnel architecture of industrial recommender systems to data annotation. Large-scale supervised learning faces two challenges: efficiently finding relevant samples in a massive corpus, and distinguishing true positives from visually confusable negatives when embeddings do not cleanly separate classes. Conventional active learning offers a principled framework for reducing annotation cost, yet it treats sample selection as a single-stage process that addresses neither challenge efficiently. FunnelAL decomposes the problem into cascaded stages. Starting from a single positive and negative example, the system iterates through: (1) embedding-based retrieval scoring that narrows the corpus to a manageable candidate set; (2) a precision-triggered ranking stage that exploits a learned ranker (RankNet) while batch precision remains high, then automatically blends in committee-based exploration (QBC) once returns diminish; and (3) feedback from the annotator's labels that refines both stages in subsequent iterations. We evaluate on three diverse image classification benchmarks. With a perfect annotator, FunnelAL attains the best final F1 on all three benchmarks, the best annotation efficiency (first in AULC), and the fewest annotation rounds. The most recent single-class discovery methods (GAL, PF-MA) at best match its final quality, and only at consistently higher labeling cost. Under annotator labeling errors at realistic rates, FunnelAL remains first or statistically tied for first while classical uncertainty-based methods degrade two to three times faster. Our work provides a concrete bridge between multi-stage recommender systems and active learning.

72. 【2607.25275】ScaleResfusion: Residual Rectified Flow based on Residual Vector Field

链接：https://arxiv.org/abs/2607.25275

作者：Zhenning Shi,Chen Xu,Junhao Zhang,Kefei Zhang,Linjie Liu,Zhedong Zheng,Tao Li

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Rectified Flow, Residual Rectified Flow, aims to recover, recover high-quality, unknown degradations

备注：

点击查看摘要

Abstract:Real-world Image Restoration (Real-IR) aims to recover high-quality (HQ) images from complex and unknown degradations. Although recent diffusion-based methods have substantially improved perceptual quality, their current designs leave two key challenges unresolved. Methods that start from Gaussian noise are slow and often less faithful to the degraded input. Residual-based methods usually train from scratch, which makes it hard to exploit modern pre-trained generative priors. In this paper, we present ScaleResfusion, a scalable diffusion framework for real-world image restoration built on pre-trained text-to-image rectified-flow models. The core of our method is Residual Rectified Flow, which introduces the residual term R into Standard Rectified Flow. Instead of starting from pure noise, it uses a residual transport path that starts from noisy low-quality (LQ) images and admits an exact acceleration point. By learning the residual vector field, Residual Rectified Flow keeps the output distribution and linear diffusion process consistent with the pre-trained rectified-flow models. This makes parameter-efficient fine-tuning possible at scale. We further introduce a knowledge-distillation pipeline to reduce sampling cost while maintaining restoration quality. Extensive experiments on multiple real-world restoration tasks show that ScaleResfusion achieves state-of-the-art performance with much higher efficiency. These results suggest a practical and scalable way to adapt large pre-trained diffusion models to real-world image restoration. Our code and models are available at this https URL.

73. 【2607.25266】FORGE: Frame Orthogonality in Relevance Geometry for Long-Form Video Understanding

链接：https://arxiv.org/abs/2607.25266

作者：Ghazal Kaviani,Ghassan AlRegib

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：large language models, enabled long-form video, Multimodal large language, long-form video understanding, large language

备注： Under Review

点击查看摘要

Abstract:Multimodal large language models (MLLMs) have enabled long-form video understanding at a scale that was not previously possible. However, the density of relevant content decreases sharply as video sequence length increases, and exposing the model to more irrelevant content measurably reduces its accuracy. In this paper, we address the problem of maximizing query-relevant information in a frame subset selected at inference time, without training. FORGE (Frame Orthogonality in Relevance Geometry) is a model-agnostic method that induces a query-conditioned geometry on a pretrained multimodal embedding space, unifying relevance and diversity into a single objective. In this space, frames that cover independent query-relevant directions are far apart, and selecting the subset of maximum information captures diverse query-relevant content within the budget. Experiments on Video-MME and LongVideoBench at budgets of 16, 32, and 64 frames show that FORGE improves the unified keyframe selection score by 11.0-15.3 points over the strongest training-free baseline and up to doubles keyframe recall (0.415 vs. 0.204 at K=64 on Video-MME). The gains extend to question answering, where accuracy improves in every evaluated setting across eight open-source MLLMs spanning 4B to 32B parameters, by up to 8.7 points over uniform sampling and 5.2 points over the strongest baseline. Our findings suggest that aligning the embedding space with the query's high-dimensional structure is a promising direction for inference-time video understanding.

74. 【2607.25242】Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation

链接：https://arxiv.org/abs/2607.25242

作者：Zhaoyan Chen,Zhongxiu Cong,Zhuanfeng Jin,Wanshu Fan,Dongsheng Zhou,Qi Ai,Haifan Gong,Congyu Liao,Xiaofeng Liu,Cong Wang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：extending medical artificial, medical artificial intelligence, world models offer, representing evolving patient, Medical world models

备注：

点击查看摘要

Abstract:Medical world models offer a framework for extending medical artificial intelligence beyond static prediction by representing evolving patient states and modelling how they change over time and in response to clinical interventions. This Review defines the conceptual boundaries, technical foundations, application domains, and evidence requirements of the field through a structured narrative synthesis with reproducible evidence this http URL screened 1,455 unique records and assembled a corpus of 98 sources, including 14 studies that met a strict empirical definition of a medical world model. The field is organised around four capabilities: patient state representation, temporal dynamics modelling, intervention-conditioned simulation, and clinician-supervised planning. Evidence spans medical imaging, longitudinal electronic health records, treatment response modelling, physiological and multimodal state modelling, ultrasound and surgical interaction, and population and health-system simulation; clinical digital twins are treated as a cross-cutting integration this http URL studies provide early evidence of technical feasibility for trajectory forecasting and comparison of candidate interventions, but most remain retrospective, task-specific, or preclinical. The evidence base is further limited by incomplete longitudinal intervention data, inconsistent action semantics, limited causal identifiability, long-horizon error accumulation, inadequate uncertainty estimation, and limited external validation. Clinical translation will therefore depend on precise intervention representations, robust causal and mechanistic grounding, calibrated trajectory-level uncertainty, safety-constrained planning, and prospective multicentre validation against clinically meaningful endpoints.

75. 【2607.25239】CD-RMOT-Bench: Benchmarking the Cross-Domain Referring Multi-Object Tracking

链接：https://arxiv.org/abs/2607.25239

作者：Xiangqun Zhang,Likai Wang,Zekun Qian,Ruize Han,Wei Feng

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Referring multi-object tracking, category-driven perception, understanding by grounding, RMOT, Referring multi-object

备注：

点击查看摘要

Abstract:Referring multi-object tracking (RMOT) extends tracking from category-driven perception to language-guided understanding by grounding object trajectories in natural-language expressions. Despite recent progress, existing RMOT studies are largely conducted under in-domain settings, leaving the robustness of language-conditioned tracking under inevitable visual domain shifts unexplored. In this paper, we study Cross-Domain Referring Multi-Object Tracking (CD-RMOT), a new and challenging problem that evaluates whether an RMOT model trained on a labeled source domain can reliably follow natural-language expressions in an unlabeled target domain with different visual conditions. To support systematic study, we construct CD-RMOT-Bench, a unified benchmark that combines real clear-domain referring tracking data, aligned digital-twin variants, and real adverse-domain videos. CD-RMOT-Bench enables both controlled weather/viewpoint shift analysis and realistic synthetic-real transfer evaluation under a shared RMOT protocol. Further, we provide a Query-Centric Adaptation (QCA) framework, designed to stabilize the query space that bridges visual trajectories and referring expressions. Extensive experiments reveal that domain shifts severely degrade RMOT performance, where the failure is not merely caused by object detection errors but more critically by unstable expression-conditioned temporal association and target selection. QCA establishes a strong baseline, while CD-RMOT-Bench opens a new direction for robust language-guided tracking across visual domains.

76. 【2607.25234】WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing

链接：https://arxiv.org/abs/2607.25234

作者：Prathyush Sajith,Emadeldeen Hamdan,Ahmet Enis Cetin

类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV); Signal Processing (eess.SP)

关键词：Stereo depth estimation, aggregates scene context, scene context grows, context grows quadratically, tight latency budgets

备注：

点击查看摘要

Abstract:Stereo depth estimation for driving, robotics and augmented reality must run at high resolution under tight latency budgets, yet in transformer-based matchers the global self-attention that aggregates scene context grows quadratically with the number of pixels and comes to dominate runtime. We show that the joint self-attention stage of a stereo transformer, whose role is to spread context across both views, can be replaced by a data-independent Walsh-Hadamard token mixer that mixes tokens globally in the transform domain at log-linear cost, while the data-dependent cross-attention that performs left-right correspondence is retained. On synthetic driving data the mixer matches the attention baseline in end-point error while reducing model compute by a factor of 2.46 and single-image inference latency by a factor of 2.65. A complexity analysis shows the benefit is governed by the ratio of sequence length to channel width, which explains why high-resolution stereo matching is a particularly favorable setting and why classification transformers are not; we confirm this token-to-channel scaling on non-stereo long-sequence benchmarks. Furthermore, we introduce a hybrid log-disparity loss function designed to up-weight small-disparity pixels corresponding to long-range objects. This approach reduces the error on distant objects without incurring any additional computational overhead.

77. 【2607.25215】Leveraging Semantic Maps for City-Scale Cross-View Localization

链接：https://arxiv.org/abs/2607.25215

作者：Ethan Fahnestock,Erick Fuentes,Philip R Osteen,Nicholas Roy

类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)

关键词：previously untraversed environments, semantic information, localize in previously, previously untraversed, semantic

备注： Equal contribution by Ethan Fahnestock and Erick Fuentes. 13 pages, 7 figures, and 5 tables

点击查看摘要

Abstract:We want robots to localize in previously untraversed environments against commonly available prior data. Rich semantic data available from OpenStreetMap can be useful in this task. However, existing methods either ignore this semantic information, directly matching panoramas and overhead imagery, or dramatically compress the semantic information, working with a small set of fixed classes. To leverage this rich semantic information, two challenges need to be overcome. First, useful semantic information needs to be extracted from the robot's egocentric observations. Second, the observed information must be quickly associated with the large prior semantic map (e.g., up to 628 km^2). We show that VLMs are effective at both extracting relevant landmarks from panoramas, and identifying feasible correspondences between these landmarks and prior overhead landmarks. However, using VLMs to propose all correspondences scales poorly as the number of mapped landmarks increases. Instead, we propose distilling a lightweight matcher from a VLM which computes correspondences for all entities in a map. We use this output to form an observation likelihood which is fused over time with a Bayes filter to create a time series of pose estimates. To support further investigation into generalizable cross-view methods that leverage semantic information, we release a dataset of extracted semantics and evaluation trajectories spanning eleven environments, including panoramas we collected in a snowstorm and at night in Boston. We demonstrate our method, trained on a single city's fair-weather data, generalizes across location, lighting, weather, and other challenges. Code and datasets are available at this https URL.

78. 【2607.25210】ObliCity: A Benchmark and Baseline for Roof-to-Ground Projection Displacement Correction

链接：https://arxiv.org/abs/2607.25210

作者：Kai Li,Yupeng Deng,Ligao Deng,Zhihao Xi,Chenhao Wang,Jierui Zhang,Yingrui Ji,Yu Meng,Xiangyu Zhao

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Oblique-view urban remote, Oblique-view urban, inevitably exhibits geometric, imagery inevitably exhibits, leading to significant

备注： 12 pages

点击查看摘要

Abstract:Oblique-view urban remote sensing imagery inevitably exhibits geometric projection displacements between building roofs and footprints, leading to significant distortions in spatial structure. Existing approaches either ignore these deformations or handle them implicitly within segmentation-based frameworks, where progress is dominated by general segmentation advances rather than improvements in geometric correction. In this work, we explicitly define roof-to-footprint offset vector (RFOV) extraction as an independent learning task that decouples geometric alignment from semantic segmentation. To support this task, we introduce the Oblique City dataset (ObliCity), the first large-scale benchmark that integrates high-resolution UAV imagery and globally distributed satellite data, covering diverse city morphologies and camera perspectives. Methodologically, we reformulate DragOSM into DragRoof, an ODE-based framework inspired by human annotation behavior. By simulating the continuous process of dragging roofs toward their footprints, DragRoof learns deterministic, geometry-consistent offset fields and adaptively determines convergence through an end token. Extensive experiments on ObliCity demonstrate that DragRoof achieves state-of-the-art RFOV extraction performance, requiring fewer inference steps while delivering superior directional and length accuracy. Our dataset and model establish a principled foundation for studying projection displacement correction in oblique remote sensing imagery. The source code and dataset will be avaliable at this https URL.

79. 【2607.25197】LGFNet: A CTC-Guided Local-Global Fusion Framework for Single-Channel Sleep Staging

链接：https://arxiv.org/abs/2607.25197

作者：Chongjian Wang,Zhenghang Hou,Junjie Gao,Xiaofang Zhong,Shiyuan Han,Tong Zhang

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：substantial distribution shifts, remains challenging due, staging remains challenging, ambiguous stage transitions-particularly, Sleep staging remains

备注：

点击查看摘要

Abstract:Sleep staging remains challenging due to long-range temporal dependencies, ambiguous stage transitions-particularly in N1-and substantial distribution shifts across subjects, sampling rates, and EEG montages. These difficulties are further amplified in single-channel, low-latency scenarios required by wearable and real-world applications. To address these issues, we propose LGFNet, a CTC-guided sequence-to-sequence framework for robust sleep staging. LGFNet introduces a Local-Global Fusion encoder that jointly models fine-grained temporal dynamics and long-range sleep structure, overcoming the limitations of conventional serial hybrid architectures. A CTC-Attention joint training paradigm is adopted to unify temporal alignment with context-dependent modeling, enabling more accurate recognition of stage boundaries and transitions. Furthermore, a three-stage decoding strategy is devised, leveraging CTC-guided decoding and Viterbi-based smoothing to reduce error accumulation and enforce physiological consistency. Extensive cross-dataset evaluations on five public benchmarks demonstrate that LGFNet consistently outperforms state-of-the-art single-channel methods. In particular, on Sleep-EDF-78, LGFNet surpasses DMIN by +1.27% accuracy, +1.74% macro-F1, and +1.93% kappa, with pronounced gains on N1 and transition segments, highlighting its robustness and strong generalization across diverse sampling rates, montages, and recording environments.

80. 【2607.25164】OrganLens: Organ-Specific Representation Learning for CT Foundation Models

链接：https://arxiv.org/abs/2607.25164

作者：Zhixuan Ge,Anqi Li,Sadeer Al-Kindi,Hanwen Xu,Wei Qiu

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：examination captures multiple, questions concern abnormalities, biomedical questions concern, captures multiple organs, concern abnormalities

备注： 16 pages, 7 figures, 5 tables

点击查看摘要

Abstract:A CT examination captures multiple organs, but many biomedical questions concern abnormalities, prognosis, or longitudinal change in a specific organ. These questions require a separate representation for each organ within the same CT volume. Existing CT foundation models commonly produce a single volume-level representation, while recent anatomy-aware methods either encode pre-separated organ volumes or explicitly disentangle images into organ token groups. The former may remove clinically relevant surrounding context, while the latter does not condition a shared encoder on a selected organ before its features are formed. We introduce OrganLens for organ-specific representation learning through self-supervision. An organ identity conditions a shared CT encoder, while organ-specific distillation and anatomy-mask supervision shape features for anatomy-weighted pooling into organ-specific representations. At inference, the shared model produces 11 organ-specific representations without external segmentation masks. We evaluate OrganLens on CT-RATE, RAD-ChestCT, INSPECT, and NLST across diverse acquisitions and downstream evaluations. Relative to CT-pretrained DINOv2, heart representations raise CT-RATE cardiomegaly AUROC from 0.910 to 0.953, while lung representations improve the Harrell C-index for NLST lung-cancer mortality by 14.2\%. The global representation reaches INSPECT Recall@10 of 33.09\% and 32.04\% for text-to-image and image-to-text retrieval, respectively. Across organ-related tasks, anatomically matched representations provide stronger task-relevant signal, while the global representation retains broad utility. OrganLens offers a scalable approach to organ-specific CT representation learning with a shared encoder. More broadly, it provides the medical research community with a reusable framework for studying organ-specific disease across cohorts and clinical endpoints.

81. 【2607.25153】OpenPVMapper: A Multi-source, Nationwide Database of Rooftop Photovoltaic Systems in France

链接：https://arxiv.org/abs/2607.25153

作者：Gabiel Kasmi

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：public registries aggregate, limited geographic scope, registries aggregate data, sensing-based detection efforts, remote sensing-based detection

备注： 14 pages, 5 tables, 7 figures

点击查看摘要

Abstract:Rooftop photovoltaic (PV) systems account for the vast majority of PV grid connections, yet no open, comprehensive, installation-level dataset of these systems exists: public registries aggregate data only above a capacity threshold, and remote sensing-based detection efforts, while extensive, are typically confined to a single method, a limited geographic scope, or a single point in time. We introduce OpenPVMapper, a nationwide, multi-source database of rooftop PV installations in mainland France, built by aggregating and reconciling complementary sources: a deep learning-based detection pipeline deployed on nationwide aerial imagery, OpenStreetMap and a probabilistic building-level detection dataset. The resulting database contains 1,135,850 installations, totaling approximately 15.01~GWp of installed capacity, each documented with its provenance, detection method, and, where available, a manual validation flag. Manual review of a stratified sample of 1,862 installations places the database's overall precision at approximately 74--75\%, with corroboration across independent sources bringing a substantial, quantified precision gain. By aggregating independent sources rather than relying on any single detection method, OpenPVMapper reaches a level of confidence beyond what any one source could provide on its own, while remaining extensible to further sources as they become available. It is released under an open (CC-BY) license alongside the full source code used to build it.

82. 【2607.25146】FIDAC: An Easy-to-use Pipeline to Extract and Interpret Interpersonal Distance From Video

链接：https://arxiv.org/abs/2607.25146

作者：Keshav Rastogi,Eugy Han,Jeremy N. Bailenson

类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)

关键词：persons reveals significant, reveals significant information, persons reveals, reveals significant, Interpersonal Distance

备注：

点击查看摘要

Abstract:The distance between persons reveals significant information about their perception of each other. However, such information is not easily extractable and interpretable from video input. We developed an open-sourced library, Facial Interpersonal Distance Analysis and Coding (FIDAC) that transforms facial detection results into actionable data about location and interpersonal distance. This tool merges data from multiple open-source facial detection models, strategically compensating for gaps in any individual model. In addition, we include methods for more accurate tracking, such as a pipeline for human coding of the selection of faces and a benchmarking tool to reduce depth distortion. For next steps, we plan on building upon FIDAC by evaluating its effectiveness at measuring interpersonal distance at various depths and orientations while further integrating features of proxemic analysis such as synchrony into its software.

83. 【2607.25125】LENS: Adaptive Spatio-Temporal Zooming for Keyframe Sampling in Long-Form Videos

链接：https://arxiv.org/abs/2607.25125

作者：Ce Zhang,Jinxi He,Katia Sycara,Yaqi Xie

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multi-modal Large Language, Large Language Models, Multi-modal Large, Large Language, progress in Multi-modal

备注： Accepted at ECCV 2026. Project page: [this https URL](https://zhangce01.github.io/LENS/)

点击查看摘要

Abstract:Despite rapid progress in Multi-modal Large Language Models (MLLMs), understanding long-form videos is still bottlenecked by limited context windows. While recent keyframe sampling methods attempt to mitigate this by distilling video inputs into a compact set of query-relevant frames, navigating the vast spatio-temporal search space remains challenging, as spatial detail and temporal coverage often conflict. To address this, we introduce LENS, a training-free keyframe sampling framework that dynamically decides when to zoom in for fine-grained details and when to zoom out for broader context based on the text query. Concretely, LENS adaptively allocates a limited frame budget between spatial zoom-ins, which highlight query-relevant regions within individual frames, and temporal zoom-outs, which expand the temporal scope through multi-frame aggregation, enabling the model to reason across multiple granularities while capturing both high-fidelity details and long-range context. Across diverse long-form video benchmarks, LENS consistently outperforms prior state-of-the-art keyframe sampling methods and delivers substantial gains over uniform sampling, improving Video-MME accuracy from 53.3% to 60.7% with this http URL is available at this https URL.

84. 【2607.25108】OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis

链接：https://arxiv.org/abs/2607.25108

作者：Zihan Li,Feiyang Liu,Dandan Shan,Ruibo Wang,Qingqi Hong

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Image and Video Processing (eess.IV)

关键词：image analysis spans, analysis spans diverse, spans diverse modalities, Biomedical image analysis, modalities and tasks

备注： Accepted by ACM MM 2026. 18 pages

点击查看摘要

Abstract:Biomedical image analysis spans diverse modalities and tasks, yet real-world deployment is hindered by severe distribution shifts across scanners, protocols, and patient populations. High-performing models consequently require repeated domain-specific fine-tuning, which is a costly cycle that becomes impractical when labels are scarce or privacy constraints limit data sharing. We propose OPERA (Offline Policy-guided Expert Routing and Adaptation), a multi-agent ensemble framework that addresses this deployment bottleneck by treating expert weight assignment as an offline policy learning problem: a routing policy is learned from a small validation set without gradient updates to any expert agent, then deployed with test-time adaptation to handle distribution shift. OPERA coordinates heterogeneous specialist agents through complementary mechanisms. The expert profiling module learns selection policies offline, enabling informed allocation of expertise. Each agent undergoes confidence calibration through temperature adjustment, ensuring more reliable probabilistic outputs. OPERA also incorporates distribution aware adaptation, where class weights are dynamically adjusted at the batch level using statistics derived from unlabeled test data. Instance level routing assigns each sample to the most suitable expert by leveraging inter model agreement and predictive entropy. We evaluate OPERA on 9 datasets covering fundus photography, chest X-ray, CT, MRI, and multimodal diagnostic benchmarks, comparing against 30+ baselines across classification, segmentation, and multimodal settings. OPERA consistently improves performance and calibration quality, demonstrating that offline policy-guided expert agents coordination is a practical path to deployable biomedical AI without retraining. Code is on \href{this https URL}{GitHub}.

85. 【2607.25106】IMPRINT: Image-Conditioned Query Enrichment for Long-Tail Object Goal Navigation

链接：https://arxiv.org/abs/2607.25106

作者：Jelin Raphael Akkara,Filippo Ziliotto,Luciano Serafini,Lamberto Ballan,Tommaso Campari

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：zero-shot Object Goal, Object Goal Navigation, Object Goal, Goal Navigation, increasingly relies

备注： Accepted at the 2026 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Project page: [this https URL](https://github.com/JelinR/IMPRINT)

点击查看摘要

Abstract:Embodied AI increasingly relies on queryable semantic maps built from pre-trained vision-language models to enable zero-shot Object Goal Navigation (ObjectNav). However, existing approaches typically depend on text-only queries, which become less reliable as semantic specificity increases toward fine-grained object categories. We introduce IMPRINT, a zero-shot plug-and-play framework that enriches textual object queries with web-sourced images to improve grounding in queryable maps. Retrieved images are encoded using a vision-language model, matched against the semantic map to produce similarity maps, and aggregated to yield context-aware localization. Notably, this requires no training or modification of the underlying navigation policy. To explicitly evaluate long-tail behavior, we present HSSD-rare, a new ObjectNav benchmark built on Habitat Synthetic Scenes and featuring semantically specific subcategories. Across both OVON and HSSD-rare, image-conditioned queries consistently improve object grounding and yield end-to-end navigation gains. Further analysis reveals that translating localization gains to navigation performance depends critically on downstream detection quality, highlighting a key systems bottleneck in long-tail embodied navigation.

86. 【2607.25092】MorphUNet: Alpha-Controlled Biometric Transport for Diffusion-Based Face Morphing Attacks

链接：https://arxiv.org/abs/2607.25092

作者：Taimoor Rizwan,Sara Atito,Zhenhua Feng,Muhammad Awais,Josef Kittler

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：threatening border control, Face morphing attacks, attacks create synthetic, morphing attacks create, Face morphing

备注： 37 pages, 23 figures, 8 tables. Includes supplementary material (additional robustness analysis, CFD stress tests, and conditioning ablations) appended after the references

点击查看摘要

Abstract:Face morphing attacks create synthetic images verifiable against multiple identities, threatening border control and identity verification systems. We introduce MorphUNet, a diffusion morphing framework formulating two-parent generation as alpha-controlled biometric transport: each parent is decomposed into CLIP appearance and ArcFace identity evidence, aligned into a CLIP-compatible token space, with the two contributors preserved as separate identity-aware token banks. To our knowledge, MorphUNet is the first diffusion-based morphing framework using trainable parent-separated dual cross-attention inside the denoising U-Net: a Biometric Transport Layer carrying parent-specific identity evidence through denoising, attending to each parent separately before combining residuals via the morphing parameter alpha. DDIM-inverted latent interpolation gives a coherent denoising start, while weaker-parent-guided selection favours morphs maximising the lower parent-similarity score, reducing collapse toward one contributor. We evaluate MorphUNet against three state-of-the-art baselines (StableMorph, MIPGAN-II, and MorDIFF) on FEI and FRLL using six recognition systems, and propose CFD-based unseen-identity stress testing across gender and ethnicity pairing, demographic shifts, and parent-similarity extremes. MorphUNet achieves the best Morphing Attack Potential (MAP) when at least three of six systems are fooled by one morph, reaching 0.919 on FEI and 0.886 on FRLL, and obtains the best FID on both datasets (35.19 FEI, 44.86 FRLL). It also gives the highest APCER at 5% BPCER in the same-dataset setting, and remains highly difficult to detect under cross-dataset transfer, with APCER 0.996 on FEI and 0.946 on FRLL. The full evaluation analyses MAP, MAD, per-system vulnerability, identity balance, image quality, top/bottom-similarity stress tests, and CFD unseen-identity robustness.

87. 【2607.25078】Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models

链接：https://arxiv.org/abs/2607.25078

作者：Taimoor Rizwan,Sara Atito,Muhammad Awais,Zhenhua Feng,Josef Kittler

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Generative diffusion models, Generative diffusion, resolution outputs remains, critical challenge, remains a critical

备注： 20 pages, 11 figures, 3 tables

点击查看摘要

Abstract:Generative diffusion models have revolutionized facial image synthesis, yet robust identity preservation in high resolution outputs remains a critical challenge. This issue is especially vital for security systems, biometric authentication, and privacy sensitive applications, where any drift in identity integrity can undermine trust and functionality. We introduce Diff-ID, a diffusion based framework that enforces identity consistency while delivering photorealistic quality. Central to our approach is a custom 210K image dataset synthesized from CelebA-HQ, FFHQ, and LAION-Face and captioned via a fine tuned BLIP model to bolster identity awareness during training. Diff-ID integrates ArcFace and CLIP embeddings through a dual cross attention adapter within a fine tuned Stable Diffusion UNet. To further reinforce identity fidelity, we propose a pseudo discriminator loss based on ArcFace cosine similarity with exponential timestep weighting. Experiments on held out and unseen faces show that Diff-ID does not exceed InstantID in raw ArcFace Face Similarity, but achieves substantially lower FID and the strongest FIQ based identity--realism trade off among the evaluated methods. We also present a unified DDIM based morphing pipeline that enables qualitative facial interpolation without per identity fine tuning. We further argue that identity preservation and photorealism should be evaluated jointly rather than in isolation, as high identity similarity alone does not guarantee realistic outputs. To make this trade off explicit, we report Face Image Quality (FIQ) as a complementary ratio based score that combines identity similarity and perceptual realism while keeping FS and FID as the primary metrics.

88. 【2607.25041】ScoreShield: Differentially Private Release of Similarity Scores

链接：https://arxiv.org/abs/2607.25041

作者：Behrooz Razeghi,Parsa Rahimi

类目：Information Retrieval (cs.IR); Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：retrieval-augmented generation, embeddings of text, biometrics and retrieval-augmented, similarity scores computed, growing number

备注：

点击查看摘要

Abstract:A growing number of applications, such as biometrics and retrieval-augmented generation (RAG), rely on cosine similarity scores computed between vector embeddings of text, images, or audio. These systems return similarity scores through their APIs for ranking and verification. However, such releases can leak information about individual records and enable membership inference attacks. While differential privacy (DP) provides a principled metric for quantifying attack risks, naïve application of DP mechanisms---such as adding i.i.d. Gaussian noise to vector entries---leads to excessive distortion (i.e., low utility) at a given privacy constraint that scales poorly with the number of released scores. We propose \textsc{ScoreShield}, a perturb-then-project mechanism that adds Gaussian noise calibrated to global sensitivity of the chosen score release regime and then projects the result onto the feasibility set of valid cosine objects. \textsc{ScoreShield} satisfies $(\varepsilon,\delta)$-DP for releasing similarity score vectors and Gram matrices. We provide utility guarantees for the exact Frobenius metric projection used in the risk analysis, and prove convergence to feasibility for the practical averaged alternating-projection solver used for large-scale Gram releases. For full pairwise cosine Gram release under record-level replacement adjacency, the exact-projection bound improves the $n$-dependence of squared Frobenius risk from $\Theta(n^3)$ for the naïve Gaussian baseline to $\mathcal{O}(n^2)$ for fixed privacy parameters, with sharper local bounds at low-rank Grams. We evaluate the mechanism across RAG, face recognition, semantic retrieval, image similarity, and recommender-system tasks.

89. 【2607.25014】Unifying Active Learning and Semi-Supervised Learning for Medical Image Segmentation

链接：https://arxiv.org/abs/2607.25014

作者：Bahram Jafrasteh,Cheng Wan,Heejong Kim,Johannes C. Paetzold,Qingyu Zhao

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

关键词：fully labeled datasets, limited annotated data, practical settings, developed with limited, medical image segmentation

备注：

点击查看摘要

Abstract:In practical settings, medical image segmentation models are often developed with limited annotated data rather than fully labeled datasets. Training frequently begins in ultra-low labeled regimes where only a small number of volumes are annotated. In such scenarios, practitioners must simultaneously decide which cases to annotate and how to best use the remaining unlabeled data. Although active learning (AL) and semi-supervised learning (SSL) both target annotation scarcity, they are typically designed and optimized independently, resulting in objective mismatch and unstable training during early-stage "cold start" conditions. We propose RegAL, a unified active semi-supervised framework governed by a shared topology-aware Pareto optimization that couples sample acquisition with unlabeled data utilization. RegAL evaluates images along three complementary axes, voxel-wise uncertainty, feature diversity, and a novel topological consistency metric, to select anatomically informative edge cases for annotation. On the other hand, the same criteria are used to identify geometrically stable atlas candidates for diffeomorphic registration-guided augmentation to train a self-supervised Mean Teacher segmentation network. Across BraTS 2021, dHCP, and ProstateX, RegAL remains stable with few labeled volumes and consistently outperforms state-of-the-art AL, SSL, and active semi-supervised baselines across Dice and boundary-distance (ASD, HD95) metrics under extreme annotation scarcity.

90. 【2607.24981】Enabling Fully Integer-Only Inference for Lightweight Detection Transformers

链接：https://arxiv.org/abs/2607.24981

作者：Thanh Cong Le,Michal Szczepanski,Martyna Poreba

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Vision Transformer detectors, including deformable attention, nonlinear activation functions, Vision Transformer, feature fusion

备注：

点击查看摘要

Abstract:Vision Transformer detectors now approach the accuracy of CNNs but remain difficult to deploy on NPUs and microcontrollers because key components, including deformable attention, feature fusion, and nonlinear activation functions, are not natively compatible with integer arithmetic. Existing quantized detectors either retain operators such as Softmax, GELU, and LayerNorm or focus on heavyweight backbones, leaving lightweight detection transformers without an end-to-end integer implementation. We address this gap with I-LW-DETR, the first fully integer-only lightweight DETR, in which every operation in the forward pass, including transformer nonlinearities, is executed in integer arithmetic. I-LW-DETR is built upon three key components: a scale-preserving split convolution that assigns independent activation scale to each branch of the multi-scale projector; SD-ShiftGELU, a sign-dependent GELU approximation that preserves element-wise behavior while avoiding the accuracy degradation; and a constrained Shiftmax that maintains stable Softmax normalization. Experimental results demonstrate that the proposed quantization pipeline consistently produces efficient fully integer-only models across different model scales. Across all model scales, the proposed pipeline incurs only a moderate accuracy degradation while reducing the model size by approximately $3.6\times$ and the computational cost by more than one order of magnitude.

91. 【2607.24957】PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models

链接：https://arxiv.org/abs/2607.24957

作者：Zichao Lin,Yifeng Xie,Bowen Qu,Haiming Wang,Jia Li,Haoning Wu,Yuhao Dong,Zuhao Yang,Jinguo Zhu,Haoyu Lu,Zijia Zhao,Tongtian Yue,Zhangyang Qi,Junwei Yang,Mengfan Dong,Peizhou Cao,Chenzhuang Du,Zaida Zhou,Haotian Yao,Hao Yang,Hongcheng Gao,Lin Sui,Weihong Li,Xinxing Zu,Jia Chen,Yao Wang,Xiaoxue Wu,Yalin Wang,Y. Charles,Yiping Bao,Yangyang Liu,Zhiqi Huang,Xinyu Zhou

类目：Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, benchmark specifically designed

备注：

点击查看摘要

Abstract:We introduce PerceptionBench, a benchmark specifically designed to evaluate the atomic visual perception capabilities of Multimodal Large Language Models (MLLMs). Existing benchmarks often fail to isolate perception: holistic evaluations conflate perceptual errors with failures in reasoning or domain knowledge, while application-driven benchmarks only cover narrow, fragmented domains shaped by heuristic designs. To address these limitations, PerceptionBench adopts a bottom-up approach: by diagnosing the earliest failure points in the responses of frontier MLLMs across 42 existing benchmarks, we construct an error taxonomy whose perception branch defines ten atomic perceptual capabilities. Guided by this taxonomy, we construct 3,000 verified questions with short, unambiguous answers, each isolating a single capability, with difficulty stemming from perception rather than reasoning or knowledge. Benchmark results across sixteen frontier MLLMs reveal that atomic perception remains largely unsolved---no model reaches 60\% accuracy, perception-related hallucination is the weakest capability on average, and similar overall scores conceal sharply divergent capability profiles. PerceptionBench thus provides a capability-level standard for measuring and diagnosing the visual perception boundaries of MLLMs.

92. 【2607.24954】Intrinsic and Triangulation-Agnostic Attention: A Simple and Powerful Approach for Learning on Meshes

链接：https://arxiv.org/abs/2607.24954

作者：Ashwath Shetty,Zihan Zhu,Soeren Pirk,Noam Aigerman

类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)

关键词：attention mechanism, work proposes, proposes an adaptation, attention, mechanism

备注：

点击查看摘要

Abstract:This work proposes an adaptation of the attention mechanism for triangle meshes. The core observation is that endowing the attention mechanism with critical properties for learning over meshes -- intrinsicality and triangulation-agnosticism -- enables it to attain state-of-the-art results over several learning-based tasks in geometry-processing. The above is achieved by modifying the attention mechanism from the bottom up based on simple principles from geometry-processing. Namely, the quantities used within attention -- queries, keys and values -- are created by an intrinsic, triangulation-agnostic network, and treated as discretizations of continuous functions. From that, we devise an appropriate attention mechanism that operates over triangle meshes through standard FEM discretization of the resulting integrals of the above functions. Surprisingly, as far as we know, this straightforward approach has not been utilized for learning over meshes. Experiments show our method exceeds current state of the art, including both mesh-based architectures as well as point cloud transformers. Namely, we show significant improvements on several common benchmarks and tasks -- predicting canonical high-frequency signals; predicting deformations; computing dense correspondences, both between full shapes and partial ones; and predicting feature descriptors.

93. 【2607.24904】Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model

链接：https://arxiv.org/abs/2607.24904

作者：Senqiao Yang,Kaichen Zhang,Zhaoyang Jia,Jinghao Guo,Yifei Shen,Xinjie Zhang,Xiaoyi Zhang,Haoqing Wang,Xiao Li,Peng Zhang,Xiang An,Yin Xie,Zhening Liu,Xun Guo,Jiahao Li,Shicheng Zheng,Jinglu Wang,Zongyu Guo,Wenxuan Xie,Zihan Zheng,Yuxuan Luo,Bin Li,Yan Lu

类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)

关键词：Standard vision-language models, suffer from Moravec, Moravec paradox, Standard vision-language, complex offline visual

备注： Project page: [this https URL](https://microsoft.github.io/Mage)

点击查看摘要

Abstract:Standard vision-language models (VLMs) suffer from Moravec's paradox: they excel at complex offline visual reasoning but struggle with simple streaming perception tasks and process them inefficiently. We present Mage-VL, an efficient codec-native streaming foundation model for real-time multimodal understanding and interaction. At its core, our custom tokenizer, Mage-ViT, replaces uniform frame sampling by selectively encoding dynamic, entropy-rich regions using motion vectors and residual energy across sparse anchor (I) and predicted (P) frames. Operating at a 16 x 16 patch level, this reduces visual token consumption by over 75% while preserving spatiotemporal context. Trained from scratch on approximately 560M unlabeled images and 100M unlabeled video frames, Mage-ViT matches or outperforms flagship encoders trained on billions of image-text pairs. We establish AI4AI data pipelines encompassing prompt-code joint optimization for multimodal captioning and AI-driven performance diagnosis to guide training recipes. Furthermore, through a bio-inspired dual-system architecture - a lightweight System 1 event gate and a causal System 2 decoder - Mage-VL enables proactive streaming perception. Extensive evaluations show that Mage-VL-4B matches Qwen3-VL-4B on static tasks while achieving strong gains in video understanding and 2D/3D spatial reasoning, with up to a 3.5x wall-clock inference speedup, and comprehensively surpasses the 15B Phi-4-reasoning-vision baseline. Beyond model artifacts, we deliver seven key empirical findings covering pre-training data efficiency, variable-resolution scaling, codec system acceleration, VideoQA SFT redundancy, motion-spatial synergy, AI4AI data pipelines, and Zero-Vision SFT for multimodal RL.

94. 【2607.24898】Harm is not Universal: Community-Specific Toxicity Detection is Urgently Needed

链接：https://arxiv.org/abs/2607.24898

作者：Xinnuo Xu,Anja Thieme,Daniela Massiceti,Ioana Tanase,Rita Marques,Melanie Fernandez Pradier,Martin Grayson,Camilla Longden,Cecily Morrison

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：applying fixed safety, single universal model, universal model applying, model applying fixed, generation adopt

备注： 18 pages, under review

点击查看摘要

Abstract:State-of-the-art toxicity detectors for text-to-image generation adopt a one-size-fits-all approach: a single universal model applying fixed safety guidelines to all users. Our empirical evidence shows that these detectors fail to shield marginalized communities: approximately 35% of generated images labeled safe are considered harmful by disability communities. In this position paper, we argue for community-specific toxicity detection (CTD). To demonstrate its feasibility, we collaborate with disability experts to develop safety guidelines for two communities: dwarfism and blind/low vision. Using a dataset of 2,400 annotated T2I-generated images we demonstrate that both large vision-language models and existing general-purpose toxicity detectors catastrophically fail to recognize harmful content under these guidelines in zero-shot settings with F1 score lower than random guessing (F1 0.32 and 0.37). Promisingly, prompt-based adaptation methods (ICL, VQA) substantially improve harm detection performance (GPT-4o: F1 0.50 and 0.78), while parameter-efficient fine-tuning improves smaller models (0.5b-7b with best F1 0.48 and 0.59) with less than 100 demonstrations, but remains sensitive to evolving guidelines. Despite these gains, CTD performance remains far below F1 $\approx 0.9$ achieved for general-purpose toxicity detection, highlighting the challenge and the need for sustained research effort.

95. 【2607.24856】DisasterTD: Disaster Toponym Disambiguation Using Multimodal LLMs and Cross-View Geolocalization

链接：https://arxiv.org/abs/2607.24856

作者：Wenping Yin,Ziqi Liu,Naixia Mou,Weijia Li,Danfeng Hong,Hao Li

类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)

关键词：Social media imagery, Social media, fine-grained ground perspectives, emergency response, ground perspectives

备注：

点击查看摘要

Abstract:Social media imagery (SMI) provides timely and fine-grained ground perspectives that are valuable for situational awareness and emergency response. Unlike satellite or aerial imagery, SMI can capture disaster impacts and ground-level conditions in a timely manner. However, geographic references in SMI are often vague or ambiguous, making accurate geolocalization challenging. To address this issue, we propose DisasterTD, a disaster toponym disambiguation framework that integrates multimodal large language model (MLLMs)-based semantic reasoning with cross-view geolocalization. First, MLLMs extract toponyms and generate candidate geolocations from noisy textual inputs. Then, cross-view matching between SMI, remote sensing imagery (RSI), and optionally street-view imagery (SVI) is used to verify and refine these candidate results. We evaluate DisasterTD on the Hurricane Harvey dataset, where SMI is augmented with collected RSI and SVI to construct a cross-view benchmark for disaster geolocalization. The dataset is divided into four categories based on toponym clarity and ambiguity, allowing a fine-grained performance analysis across scenarios. Results show that DisasterTD consistently outperforms MLLM-only and cross-view-only baselines without disambiguation, achieving geolocalization accuracies of 71.62% within 1000 m, 62.36% within 500 m, 57.99% within 250 m, 52.09% within 100 m, and 47.01% within 50 m, while reducing the mean and median errors to 11.33 km and 0.68 km, respectively. The largest improvements appear in ambiguous toponyms, where semantic reasoning with cross-view evidence reduces candidate dispersion and errors. These findings demonstrate the effectiveness of integrating MLLM-based candidate generation with cross-view verification for fine-grained disaster geolocalization.

96. 【2607.24852】rack-Leakage-Free Hold-Out Self-Validation for Photogrammetric Reconstruction: Protocol, Sensitivity, and Limits

链接：https://arxiv.org/abs/2607.24852

作者：Behnam Asadi

类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)

关键词：Automated photogrammetric inspection, photogrammetric inspection emits, inspection emits metric, emits metric measurements, Automated photogrammetric

备注： 16 pages, 4 figures. Submitted to the ISPRS Journal of Photogrammetry and Remote Sensing. Negative/characterisation result: a ground-truth-free self-consistency signal is shown to saturate and to be blind to coherent global distortion

点击查看摘要

Abstract:Automated photogrammetric inspection emits metric measurements from a 3D reconstruction whose own correctness is normally unknown without an external survey. Can a reconstruction estimate its own reliability with no ground truth? We formalise a track-leakage-free hold-out protocol: a deterministic subset of images is withheld and each re-localised against only 3D points seen by at least two retained images -- a track-level barrier so a view is never tested against structure it helped create -- aggregated into an mAA confidence. Held-out observations still entered the bundle adjustment that built the trusted structure, so we call it track-leakage-free (a stricter re-mapping variant confirms this at 3/5 deg). Across operational GNSS-referenced captures plus ETH3D, EuRoC and the IMC 2025 benchmark we report four findings. (i) The protocol is computationally well-posed: good reconstructions score millidegree self-consistency. (ii) Thresholded self-consistency saturates and does not track absolute accuracy: confidence stays near 1.00 while true RTK error swings up to 14x within a capture, and the per-capture correlation is sign-unstable across five captures (-0.57 to +0.98; pooled 95% CI spanning zero), so it cannot gate accuracy. (iii) It flags gross failure only when the failure destroys internal consistency: a fragmenting model drops confidence, but a single self-consistent, globally-distorted model evades it -- three of four captures gave one model wrong by 55-106 m at confidence 1.00. (iv) The same dichotomy holds on independent ETH3D and IMC 2025 ground truth. Track-leakage-free hold-out measures internal geometric consistency, not absolute accuracy: neither a substitute for control-point assessment nor a general gross-failure gate. We release the protocol and degradation harness.

97. 【2607.24835】Gradient-Based Latent Decomposition Reveals Mechanisms of Feature Degradation in Weakly Supervised Mammography

链接：https://arxiv.org/abs/2607.24835

作者：Vinceline Bertrand,Ionut Cardei

类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：Weakly supervised hierarchical, cancer screening pipelines, breast cancer screening, Weakly supervised, hierarchical Variational Autoencoders

备注：

点击查看摘要

Abstract:Weakly supervised hierarchical models exhibit a persistent asymmetry: coarse lesion-type features are preserved under reconstruction while fine-grained malignancy cues degrade---a pattern with direct consequences for the clinical reliability of breast cancer screening pipelines. We introduce gradient-based orthogonal latent decomposition for hierarchical Variational Autoencoders~(H-VAEs) to mechanistically explain this asymmetry. The latent space is partitioned into a task-aligned component~($z_1$), shaped by coarse supervisory gradients, and an orthogonal residual~($z_{\text{res}}$) capturing remaining representational capacity. On~3,550 mammographic Regions of Interest~(ROIs) from CBIS-DDSM, only~$\sim$4.4\% of latent magnitude aligns with supervisory gradients, leaving~$\sim$95.6\% in the orthogonal residual upon which fine-grained pathology prediction primarily depends. The model achieves Stage-1~AUC~0.866 and Stage 2~AUC~0.552, with a reconstruction stability gap of $\Delta_{\text{diag}}=5\%$ ($p=0.005$) and a classification gap of $\Delta_{\text{AUC}}=0.314$ ($p{}0.001$). Latent ablation confirms that features for both tasks reside heavily in~$z_{\text{res}}$, structurally explaining why reconstruction degrades pathology stability disproportionately. Comparisons with Multi-Instance Learning~(MIL) and Multi-Task Learning~(MTL) confirm generalization across architectures and modalities. These findings reveal that in high-dimensional spaces, a single coarse supervisory signal isolates only a sparse 1D latent direction, forcing critical fine-grained features into the vulnerable residual subspace.

98. 【2607.24821】AVE-Compass: Towards Holistic Evaluation for Audio-Video Editing Abilities

链接：https://arxiv.org/abs/2607.24821

作者：Yuqing Wen,Yukai Huang,Qianqian Xie,Jiangtao Wu,Yibin Lin,Yikai Gu,Jialu Chen,Yuanxing Zhang,Jiaheng Liu

类目：Multimedia (cs.MM); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)

关键词：tightly coupled audio, advanced rapidly, modality often requires, requires coordinated, instruction-based video editing

备注：

点击查看摘要

Abstract:While instruction-based video editing has advanced rapidly, real-world videos contain tightly coupled audio and visual signals, and editing one modality often requires coordinated changes in the other. Existing benchmarks primarily evaluate visual transformations on silent clips or isolated audio editing, leaving complex audio-visual editing and cross-modal consistency underexplored. We introduce AVE-Compass, a comprehensive benchmark with 145 curated source videos, 196 audio-visually coupled editing instructions, and 2,688 fine-grained checklist items. It evaluates Instruction Following, Fidelity Preserving, Realism, and Editing Intent through checklist-based MLLM judging and a dedicated realism rubric, complemented by automated cross-modal, video, and audio metrics. Extensive evaluation shows that state-of-the-art models still struggle to execute cross-modal instructions while preserving non-target content. We further propose AVE-Agent, a modular agent framework that decomposes complex instructions into dependent subtasks and iteratively improves editing results through self-reflection and evaluator feedback. AVE-Agent improves instruction execution, Fidelity Preserving, and audio-visual alignment in joint editing while maintaining competitive perceptual quality.

99. 【2607.24794】Reasoning with Memory: A Temporal Granularity-Adaptive Framework for Training-Free Long Video Understanding

链接：https://arxiv.org/abs/2607.24794

作者：Linghao Meng,Qiankun Li,Junyuan Mao,Pujin Liao,Zhicheng He,Enbo Zhang,Kun Wang,Yang Liu,Huazhu Fu,Yueming Jin

类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)

关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, restricted context windows

备注： Accepted by ECCV 2026

点击查看摘要

Abstract:While Multimodal Large Language Models (MLLMs) demonstrate superior generalization in fundamental video tasks, restricted context windows limit their long video understanding. To accommodate this constraint, models typically resort to keyframe selection. However, uniform sampling or static query-guided selection often overlooks critical temporal context, failing to adapt to the varying query temporal granularities. In this paper, we propose ReMem, a temporal granularity-adaptive keyframe selection framework for training-free LongVideoQA. ReMem introduces a dual-level memory-augmented adaptation. At the query level, Memory-Driven Question Parsing leverages LLM long-term memory to decode question temporal granularity and extract semantic entities. At the video level, Synergistic Dual-Semantic Frame Alignment exploits intrinsic structural memory to align frames with query semantics, guiding Structure-Aware Dynamic Frame Routing to cluster events and optimally distribute sampling budgets. By explicitly preserving temporal information with memory mechanisms, ReMem suppresses redundancy and empowers MLLMs to perform robust multi-granular video reasoning. Evaluations across four popular LongVideoQA benchmarks using three MLLMs demonstrate highly efficient, state-of-the-art zero-shot performance; notably, LLaVA-Video with ReMem reaches 54.5% (+12.3%) on LVBench and 67.1% (+8.2%) on LongVideoBench.

100. 【2607.24789】NEXT: Reasoning-Driven Video Recommendation via a Vision-Language Model

链接：https://arxiv.org/abs/2607.24789

作者：Yuming Liu,Hongye Yang,Harrison Zhao,Ellie Zhu,Bokai Cao,Lei Huang,Lizhu Zhang,Xiangjun Fan

类目：Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

关键词：retrieves concrete follow-up, Next-interest EXploration Transformer, concrete follow-up videos, infers the viewer, EXploration Transformer

备注： 13 pages, 2 figures, 5 tables

点击查看摘要

Abstract:We present NEXT (Next-interest EXploration Transformer), a reasoning-driven video recommendation framework that reasons over the video a user has just watched, infers the viewer's next intent, and retrieves concrete follow-up videos. Explicit continuations such as episodes are linked directly; implicit cases are handled by generating intent queries and searching for matching candidates. This Item-to-Intent-to-Item formulation produces directed recommendations beyond co-engagement correlation or semantic similarity. To make this framework reliable at scale, we train NEXT-8B, a purpose-trained 8B vision-language model with a three-stage recipe: Perception-Enhanced Reinforcement Learning for query-agnostic evidence extraction, Distribution-Aligned Supervised Fine-Tuning over real and synthetic visual QA mixtures, and Group Relative Policy Optimization for last-mile alignment. NEXT-8B achieves the best single-model DocVQA performance, ranking second overall only behind a multi-agent system while surpassing a substantially larger 200B+ scale model, and improves next-intent logic-wise quality by 3.3% over the base model in a task-specific LLM-as-a-judge evaluation. We deploy NEXT as an additional retrieval path in a large-scale social media recommendation system and observe statistically significant production gains, including +0.53% watch time and +0.51% distinct video exposure. Overall, NEXT shows that a carefully trained compact vision-language model can serve as a practical reasoning engine for next-interest exploration at production scale.

Comments:
13 pages, 2 figures, 5 tables

Subjects:

Information Retrieval (cs.IR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)

Cite as:
arXiv:2607.24789 [cs.IR]

(or
arXiv:2607.24789v1 [cs.IR] for this version)

https://doi.org/10.48550/arXiv.2607.24789

Focus to learn more

              arXiv-issued DOI via DataCite</p>

101. 【2607.24745】DocAnnot -- Accelerating the Creation of Key Information Extraction Datasets with GenAI-Powered Auto-annotation

链接：https://arxiv.org/abs/2607.24745

作者：Siddartha Reddy,Harikrishnan P M,Goutham Vignesh,Varun V,Vishal Vaddina

类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)

关键词：Key Information Extraction, Key Information, creating training datasets, Information Extraction, Large Vision Language

备注： 15 pages, 2 figures

点击查看摘要

Abstract:Key Information Extraction (KIE) is vital for many document applications, but creating training datasets is traditionally a time-consuming manual process. We introduce DocAnnot, a framework that significantly accelerates KIE dataset generation. DocAnnot leverages a Large Vision Language Model (LVLM) for label value extraction, OCR for text/bounding box detection, and a novel Spatially Informed Contextual Matching (SICM) algorithm. SICM improves label-value association by combining spatial relationships and proximity analysis with textual matching. We evaluate our framework on the CORD and SROIE benchmarks, demonstrating its ability to auto-generate annotations with F1-scores of 0.679 and 0.846, respectively. Furthermore, we investigate the effectiveness of using auto-annotated data for fine-tuning downstream KIE models. While human-annotated data remains superior, models trained exclusively on DocAnnot's outputs attain respectable performance (e.g., LayoutLMv3 achieving an F1-score of 0.6765 on CORD). These results show that while our framework significantly reduces reliance on manual effort, it does not yet fully eliminate the need for human intervention. However, by automating the process to a point where reviewers can efficiently refine outputs, our system enables near-perfect annotations with much greater efficiency than manual annotation from scratch. This approach offers substantial time and cost savings, making it valuable for resource-constrained settings and rapid model prototyping.

102. 【2607.25569】CORF-GS: Real-Time Wireless Radiance Field Reconstruction via Coupled Optical-RF Gaussian Splatting

链接：https://arxiv.org/abs/2607.25569

作者：Jinya Zhang,Jiajia Guo,Chao-Kai Wen,Shi Jin

类目：ignal Processing (eess.SP); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Information Theory (cs.IT)

关键词：based wireless radiance, wireless radiance field, wireless channel modeling, Recent advances, Gaussian Splatting

备注：

点击查看摘要

Abstract:Recent advances in 3D Gaussian Splatting (3DGS)-based wireless radiance field (WRF) reconstruction provide an efficient solution for wireless channel modeling. However, existing WRF reconstruction methods rely on pre-collected observations and offline optimization, and thus struggle to provide real-time channel knowledge. To bridge this gap, we propose CORF-GS, a real-time WRF reconstruction framework that processes sequential optical and radio frequency (RF) keyframes. Specifically, CORF-GS constructs a unified Gaussian representation for optical and RF with shared geometry and modality-specific appearance, allowing high-resolution optical images to provide structural priors for WRF reconstruction. When a new keyframe arrives, CORF-GS first employs optical-guided Gaussian sampling to densify the WRF in under-represented regions. Since light and radio waves may respond differently to the same object surfaces due to wavelength mismatch, relying solely on optical guidance may neglect RF-informative areas. Therefore, CORF-GS performs coupled optical-RF optimization to jointly refine the shared Gaussians. Compared with the existing two-stage training pipelines, this prevents WRF from passively adapting to a frozen optical geometry and encourages the shared Gaussians to adapt to both optical structures and RF power distributions. Simulations show that CORF-GS achieves state-of-the-art RF spectrum synthesis quality and reduces the reconstruction time by $6.4\times$ compared with existing WRF methods.

103. 【2607.25117】Analysis of the Shortcut Learning and Clever Hans Effect in CNN based ECG Image Classification

链接：https://arxiv.org/abs/2607.25117

作者：Abhay Kumar Pathak,Mrityunjay Chaubey,Manjari Gupta,Deepti Mishra

类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)

关键词：exploiting non-physiological visual, Deep learning models, achieve high accuracy, non-physiological visual cues, ECG image

备注：

点击查看摘要

Abstract:Deep learning models for ECG image classification may achieve high accuracy by exploiting non-physiological visual cues instead of ECG waveform morphology. Given the black-box nature of deep learning models, their promise of high predictive performance often remains insufficiently translated into clinical or real-world trust, interpretability, and actionable decision-making. In this study, we examine shortcut learning and Clever Hans effect in a publicly available ECG image dataset using convolutional neural networks. In process we have created six image-derived feature sets (FSs), FS1: raw full ECG images, FS2: cropped waveform-only images, FS3: waveform-masked metadata images, FS4: red-arrow artifact images for the myocardial infarction class, FS5: contrast-enhanced images for the abnormal heartbeat class and FS6: Gaussian-blurred images for the normal class. These controlled representations were used to test whether classification performance persists when waveform information is removed or when artificial class-specific artifacts are introduced. Shortcut retention score, prediction consistency and confidence divergence across Feature-Set Representations have been calculated to assess the transparency about the learning pattern. Along with factual results, average Integrated Gradients and occlusion sensitivity test results are presented to inspect whether model attribution focused on ECG-relevant waveform regions or on non-clinical artifacts. Performance changes across feature sets and attribution patterns were used to identify potential Clever Hans behavior. This study evaluates whether ECG image classifiers learn clinically meaningful morphology or shortcut cues introduced by report layout, metadata, contrast, blur, or artificial markers.

104. 【2503.05632】A Functional Approach to Curve Alignment and Shape Analysis

链接：https://arxiv.org/abs/2503.05632

作者：Issam-Ali Moindjié,Cédric Beaulac,Marie-Hélène Descary

类目：Methodology (stat.ME); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)

关键词：image analysis problems, carry important statistical, objects carry important, carry important, important statistical information

备注：

点击查看摘要

Abstract:In many image analysis problems, the contours of objects carry important statistical information about shape. Such contours are typically affected by deformation variables including scaling, translation, rotation, and reparametrization. Previous studies in statistical shape analysis have mainly focused on analyzing contours and shapes through discrete observations. While this approach might offer computational advantages, it overlooks the continuous nature of these objects and their underlying geometric structure. It also ignores potential dependencies between the deformation variables and their effect on the shape, which may result in a loss of statistical information and reduced interpretability. In this paper, we introduce a novel framework for analyzing shapes within the context of Functional Data Analysis (FDA). Basis expansion techniques are employed to derive analytic solutions for the estimation of deformation variables, namely scaling, translation, rotation, and reparametrization, thereby achieving curve alignment. A generative model for random contours is then developed using principal component analysis techniques. Numerical experiments on simulated data and the \textit{MPEG-7} database demonstrate that our method successfully identifies deformation parameters and captures the underlying distribution of random contours in settings where traditional FDA methods fail.