本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新554篇论文，其中：
- 自然语言处理70篇
- 信息检索8篇
- 计算机视觉88篇
自然语言处理
1. 【2607.20410】LKValues: Aligning Large Language Models with Sri Lankan Societal Values
链接：https://arxiv.org/abs/2607.20410
作者：Nethmi Muthugala,Supryadi,Surangika Ranathunga,Nisansa de Silva,Ruijie Tao,Ovindu Gunatunga,Pengyun Zhu,Shaowei Zhang,Jingting Zheng,Deyi Xiong
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Western norms, biased toward Western, Large Language, Sri Lankan
备注： 37 pages, 10 figures, and 15 tables. Includes appendices. Datasets are available at the project repository
点击查看摘要
Abstract:Value alignment of Large Language Models (LLMs) has been shown to be culturally biased toward Western norms. This results in the mishandling of local values in multilingual societies such as Sri Lanka that have their unique cultural dynamics. Existing benchmarks overlook Sri Lankan-contextualized values in its official language Sinhala, hindering culturally sensitive evaluation and fine-tuning. To bridge this gap, we propose LKValues, the first survey-grounded resource suite for Sri Lankan value alignment. From a trilingual survey of 205 respondents, blending adapted global frameworks and LLM-elicited local constructs, we derive 40 majority-endorsed societal values. Using these values, we construct LKvaluesIT, a Sinhala-English news-derived instruction corpus containing 150k scenario-based instances, and LKvaluesBench, a value-sensitive evaluation benchmark of 1,000 instances. We evaluate a set of proprietary and open-weight LLMs with LKvaluesBench. We fine-tune three open-weight base models (Qwen3.5-4B-Base, Qwen3.5-9B-Base, and Aya-Expanse-8B-Base). Our experiments show that newer and larger LLMs still exhibit low-resource and cultural value-alignment gaps. LKValues fine-tuning improves Qwen-family models in English and Sinhala, reducing invalid outputs and cross-lingual disparities, though gains remain model-family dependent. These highlight LKValues efficacy in embedding Sri Lankan values, offering a replicable pipeline for low-resource, country-specific pluralist value alignment. The dataset is publicly available at this https URL.
2. 【2607.20379】rain the Model, Not the Reader: Decodability Supervision for Verifiable Activation Explanations
链接：https://arxiv.org/abs/2607.20379
作者：Hiskias Dingeto
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Natural-language autoencoders score, Natural-language autoencoders, hidden activations, autoencoders score explanations, Co-trained Auxiliary Predictors
备注：
点击查看摘要
Abstract:Natural-language autoencoders score explanations of hidden activations by reconstruction: an explanation is deemed faithful if the activation can be regenerated from it. The test is structurally insensitive to individual false claims: if flipping a claim does not change the reconstruction, the claim is never penalized. We show the test is passed in two ways, neither faithful. On a released Qwen-2.5-7B verbalizer, explanations reconstruct well above chance while ~2% of specific claims are reconstruction-dependent, so the score tracks gist, not specific facts. Under exact synthetic ground truth, the standard recipe develops co-adapted private codes (false wording the reconstruction depends on) in 5/5 runs, and fixes that leave the target model unchanged do not help. We contribute two audit protocols, the grounded-vs-true cross and the evaluator swap, and RECAP (Readable Encodings via Co-trained Auxiliary Predictors): linear heads trained alongside the target model to keep designated content decodable. On RECAP-trained sandbox models, fresh verbalizers state the designated content truly and the codes vanish, at a +0.001-nat cost. This replicates on a pretrained Pythia-160M: the content becomes reliably probe-decodable, though a fresh verbalizer conveys it only in part (truth 0.44-0.46 vs a near-zero control). For interpretability, high reconstruction does not certify individual claims. For AI safety, RECAP makes designated internal content independently checkable against probes rather than asserted by prose a model can game: an independent probe scores the verbalizer's true claims above its false ones (AUC 0.96, vs 0.82 without RECAP). Against an adversary that edits an explanation to maximize the reconstruction score while lying (suppressing ~87% of its lie penalty), the RECAP probe still flags the lies (AUC 0.95) while the control probe collapses to chance (0.51).
3. 【2607.20372】Notes to Self: Can LLMs Benefit from Experiential Abstractions?
链接：https://arxiv.org/abs/2607.20372
作者：Chang Liu,Xinyu Li,Artur Dubrawski
类目：Computation and Language (cs.CL)
关键词：gradually solve problems, Large Language Models, strategies and cautionary, cautionary reminders, problems more effectively
备注：
点击查看摘要
Abstract:Humans distill experience into reusable abstractions, e.g., strategies and cautionary reminders, and apply them to gradually solve problems more effectively. We study whether Large Language Models (LLMs) can similarly benefit from such experiential abstractions. From LLMs' solution traces on the MATH training set, a stronger teacher or the LLMs themselves extract natural-language abstractions into a retrievable library. We explore two usage modes: (1) inference-time retrieval and (2) reinforcement learning (RL) with abstraction-augmented training prompts. Experiential abstractions improve LLM performance on mathematical and logical reasoning benchmarks. Self-extracted abstractions match teacher-extracted ones, and our abstraction usage framework can transfer to other datasets and models. These findings suggest LLMs can extract and apply experiential abstractions much as humans leverage distilled experience.
4. 【2607.20351】st-Time Training for Modality Order Consistency in Vision-Language Models
链接：https://arxiv.org/abs/2607.20351
作者：Aditi Gupta,Yossi Gandelsman
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：semantically irrelevant change, specific semantically irrelevant, irrelevant change, question are presented, specific semantically
备注： 16 pages, 7 figures, preprint
点击查看摘要
Abstract:We find that vision-language models are sensitive to a specific semantically irrelevant change: the order in which the image and question are presented. Across three models and three benchmarks, image first prompting consistently outperforms question-first prompting, revealing a repeatable modality order failure. We use this gap to design an order-consistent test-time training method. Our method substantially closes the modality-order gap across all evaluated settings. Surprisingly, it also yields consistent improvements in the stronger image-first branch over the baseline, hence bootstrapping both orderings toward mutual consistency. Activation patching localizes the ordering failure to a narrow mid-network region where representations diverge sharply between prompt orders. We find that the test-time training method repairs this misalignment across layers. Together, our results identify modality-order sensitivity as a circuit-level failure in VLMs and demonstrate that simple, asymmetric test-time adaptation can effectively mitigate it and even improve performance over the baseline.
5. 【2607.20349】Generative AI floods and dilutes the market for books
链接：https://arxiv.org/abs/2607.20349
作者：Tuhin Chakrabarty,Xinyue Liu,Jane C. Ginsburg,Paramveer Dhillon
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：produce book-length works, books, near-zero cost, produce book-length, book-length works
备注： Working Paper Under Review
点击查看摘要
Abstract:Generative AI can produce book-length works of fiction at near-zero cost. These books are often dismissed as low-quality ``slop'' that buyers will ignore, and are assumed to carry little commercial weight. We test that assumption with full-text AI detection across 14,419 self-published genre-fiction books sold on Amazon from 2023 to 2026, matched to daily sales records through June 2026. None of these books disclose whether or not they contain AI-produced content. We find that books for which we detected substantial AI text ($$ 25\%) make up a large share of the catalog but a smaller share of sales. Even so, they reach commercial scale, winning a growing share of sales over time and taking more of the scarce top-rank positions once held by books with no detected AI text. Over this period, the number of books with observed sales in a quarter grew 19.2-fold, while quarterly revenue grew only 8.9-fold. The market therefore added selling books faster than it added revenue, and revenue per selling book fell across most genres. Books with no AI text lose the most ground in genres with high AI diffusion, and most of all where Kindle Unlimited availability is high. Among top-selling books, those with substantial AI text draw on more distinctive language from existing books than do books with no AI text; for these books overlap rises with revenue, a gradient we do not detect for books with no AI text. Generative AI can thus reshape a creative market through scale rather than quality. Our results bear directly on the market-effect question at the center of the fair use defense to copyright infringement.
6. 【2607.20327】PyroDash: Cost-Efficient Token-Level Small-Large Language Model Collaborative Inference
链接：https://arxiv.org/abs/2607.20327
作者：Niqi Lyu,Pengtao Shi,Wei Qiu,Jianlin Zhong,Sicong Xia,Jianyao Ma,Yicheng Ding
类目：Computation and Language (cs.CL)
关键词：Large language models, small language models, language models, Large language, small language
备注： 19 pages, 3 figures
点击查看摘要
Abstract:Large language models (LLMs) provide strong reasoning capabilities but are expensive to serve at scale, whereas small language models (SLMs) are cheaper but less reliable on difficult problems. We introduce PyroDash, a cost-aware framework for token-level SLM-LLM collaborative inference. During generation, the SLM decides whether to request assistance by emitting a control token. A Collaborate Engine then sends the query and partial reasoning trace to a frozen LLM for completion through a single handoff. The policy is internalized in the SLM, requiring neither a separate router, LLM retraining, nor access to LLM logits. PyroDash trains the SLM in three stages: control-token embedding learning, offloading-oriented supervised fine-tuning, and cost-aware alignment with Group Relative Policy Optimization. Its reward balances answer accuracy against inference cost normalized by LLM-only inference. Across five mathematical reasoning benchmarks, PyroDash supports different accuracy-cost operating points. With $\lambda=0.05$, it achieves 64.04 percent average accuracy, 6.36 percentage points above the LLM-only baseline, while reducing cost by 20.4 percent. With $\lambda=0.6$, it achieves 54.55 percent accuracy with a 1.90 percent LLM token ratio and 0.012 LLM calls per example, reducing total cost from USD 49.36 to USD 1.78. These results show that learned token-level handoffs can reduce LLM use while preserving strong reasoning performance.
7. 【2607.20301】he Blessing of Dimensionality: How Near-Orthogonality in High-Dimensional Spaces Explains Temporal Portability
链接：https://arxiv.org/abs/2607.20301
作者：Abigail Woodring,Adrian Chan,Rana Muhammad Shahroz Khan,Sukwon Yun,Chau-Wai Wong,Tianlong Chen
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：adapt large language, large language models, domain-specific tasks, large language, continual pretraining
备注：
点击查看摘要
Abstract:Fine-tuning has been widely used to adapt large language models (LLMs) for domain-specific tasks. Parameter efficient fine-tuning (PEFT) methods such as low-rank adaptation (LoRA) are frequently used to reduce computational costs. PortLLM is a training-free and data-free scheme used to adapt LLMs after continual pretraining. Although the initial PortLLM results show that LoRA patches exhibit short-term temporal portability, the long-term performance of PortLLM across several updates of continual pretraining remains underexplored. Furthermore, the intriguing effectiveness of PortLLM is not well understood from a theoretical standpoint. We address these two open questions by (1) performing an extensive empirical study of the long-term temporal portability of PortLLM patches across 10 continual pretraining steps using base models Mistral, Gemma, and Qwen; and (2) offering two theoretical analyses to explain our observation that the simple PortLLM method achieves competitive performance. We find empirically that the portability persists across longer time duration, indicating that repeated fine-tuning is not required when the base model is periodically updated. We find theoretically that near-orthogonality of high-dimensional vectors is a key justification for temporal portability. Our analyses also demonstrate a geometric perspective of the loss landscape in facilitating the theoretical comparison of different adaptation options.
8. 【2607.20286】Sound Probabilistic Safety Bounds for Large Language Models
链接：https://arxiv.org/abs/2607.20286
作者：Mahdi Nazeri,Anne-Kathrin Schmuck,Sadegh Soudjani,Alessandro Abate
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language model, generates harmful output, computing rigorous bounds, language model, large language
备注： The Initial version of this manuscript has been available on OpenReview, see [this https URL](https://openreview.net/forum?id=papImkPLf5)
点击查看摘要
Abstract:We propose a novel framework for computing rigorous bounds on the probability that a large language model (LLM) generates harmful output to a given prompt. We study a new application of the Clopper-Pearson confidence intervals to obtain probably approximately correct (PAC) bounds for this problem. As our main technical contribution, we propose an algorithm that leverages features in the latent space to prioritize exploring branches in the auto-regressive generation tree that are more likely to produce harmful outputs. Our approach in particular enables the efficient computation of useful lower bounds, even in scenarios where the true harm probability is extremely small, and crucially, the obtained lower bounds are sound, i.e., formally proven to be less than the actual harmfulness probability: our experimental results demonstrate the effectiveness of our method by computing non-trivial lower bounds on state-of-the-art LLMs. This study newly enables the evaluation and statistical certification of LLMs.
9. 【2607.20274】Self-supervision drives representational convergence in medical foundation models more than clinical supervision
链接：https://arxiv.org/abs/2607.20274
作者：Soroosh Tayebi Arasteh,Sebastian Ziegelmayer,Mahshad Lotfinia,Lisa Adams,Sven Nebelung,Jakob Nikolas Kather,Daniel Truhn
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：treated as interchangeable, groups are increasingly, increasingly treated, concentrate their representations, clinical supervision concentrate
备注：
点击查看摘要
Abstract:Medical image encoders from different groups are increasingly treated as interchangeable, on the assumption that scale and clinical supervision concentrate their representations onto a shared structure. Whether this convergence is real, what produces it, and whether it is clinically usable are untested, and the similarity measures behind such claims are fragile. We present a controlled dissection across 18 image and 7 text encoders, all open-weight and run locally, spanning 7M to 27B parameters and five imaging modalities, including 650,982 chest radiographs from six datasets. To isolate cause, we train encoders that vary only the objective under fixed data, architecture, and scale, and reproduce the effect in a synthetic model. Convergence is modest but above a random floor, driven by the self-supervised objective, not clinical supervision: matched self-supervised encoders aligned most (40.4% on chest radiography), with label-supervised (21.1%) and image-text (3.3%) far lower, and did not grow with size (Spearman 0.302, p=0.223) or capability. It is within-modality, does not reach clinical language, and does not reproduce how radiologists judge case similarity. Yet a linear classifier transfers across encoders and to five held-out hospitals, retaining about 85% of within-encoder performance. Convergence in medical imaging is therefore set by the pretraining objective, not inherited from scale or clinical supervision. Interoperability is accordingly something to design for through that objective, and to validate where the shared geometry is weakest, across patient subgroups and against clinical judgment.
10. 【2607.20270】Which Values Do LLMs Confuse? A Schwartz-Based Recognition Study
链接：https://arxiv.org/abs/2607.20270
作者：Andrei Chetvergov,Stepan Ukolov,Timofei Sivoraksha,Alexander Evseev,Mikhail Solovev,Valeriia Kuschenko,Maria Chistyakova,Sergey Bolovtsov
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, concrete situation, increasingly evaluated, Schwartz ten basic
备注： 14 pages, 7 figures, 3 tables
点击查看摘要
Abstract:Large language models are increasingly evaluated through the values they endorse, but such evaluations presuppose that models can identify the value expressed in a concrete situation. We study this prerequisite as controlled top-1 recognition over Schwartz's ten basic values. Our evaluation set contains 1,000 Russian situational texts, balanced across the ten values and independently labeled by two human annotators per item. We evaluate 21 instruction-tuned LLM runs under a fixed ranked-response protocol; 20 runs with reliable outputs form the semantic panel. Pooled Acc@1 is 0.683 and Acc@3 is 0.892, showing that models often locate the correct motivational region while ranking close alternatives unstably. Adjacent values account for 50.9% of semantic errors, compared with 24.4% under a checkpoint-specific null. Eight directed confusions recur across checkpoints and human-confirmed subsets. Several are strongly asymmetric, including Universalism to Benevolence, Tradition to Conformity, and Security to Power, whereas Stimulation-Hedonism forms a bidirectional boundary. Their severity is checkpoint-specific and can bias higher-order value profiles. The results motivate value-recognition evaluation that combines exact accuracy, ranked recovery, and directed error analysis.
11. 【2607.20268】PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneity
链接：https://arxiv.org/abs/2607.20268
作者：Anmol Kankariya,Sercan Ö. Arık
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, iterative error correction, requires long-horizon planning, Language Models
备注： Accepted at Transactions on Machine Learning Research (TMLR 2026)
点击查看摘要
Abstract:While Large Language Models (LLMs) excel at many tasks, they frequently struggle with complex reasoning that requires long-horizon planning and iterative error correction. Furthermore, standard single-stream prompting proves brittle when models encounter novel abstractions or rigorous domain constraints. We introduce PoTRE (Poly-Topological Reasoning Ensembles), a heterogeneous framework that decouples inference into four agents: (1) Adversarial Refinement Agent, (2) Hierarchical strategic Planning Agent, (3) Spectrum Search Agent, and (4) Direct Chain Agent. A final Task-Adaptive Aggregation Layer dynamically reconciles these perspectives -- via final candidate selection, semantic synthesis, or neuro-symbolic verification -- to produce a robust global solution. We evaluate PoTRE on three frontier benchmarks: ARC-AGI-2, Humanity's Last Exam (HLE), and PRBench Finance. PoTRE achieves state-of-the-art accuracy of 49.92% on HLE, surpassing the previous best official score. We demonstrate that this architectural heterogeneity achieves improved reasoning performance using similar or fewer inference tokens compared to heavily scaled homogeneous baselines.
12. 【2607.20265】he Maskability Index: Predicting Task-Objective Alignment in Pretrained Language Models
链接：https://arxiv.org/abs/2607.20265
作者：Ahmad Pouramini,Mahsa Afsharzadeh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：demonstrated strong capabilities, BERT have demonstrated, Large-scale pretrained language, Large-scale pretrained, generating structured knowledge
备注：
点击查看摘要
Abstract:Large-scale pretrained language models such as T5 and BERT have demonstrated strong capabilities for generating structured knowledge. However, their performance depends on how closely the prompting strategy matches the objectives used during pretraining. We introduce the Maskability Index (MI), a quantitative metric that estimates whether a knowledge relation is better suited to masked-style prompting or prefix-style prompting in few-shot generation. MI is computed from differences in DepthRank scores between masked and unmasked templates, providing a principled measure of objective-template alignment. We evaluate MI on a diverse set of relations from the ATOMIC2020 knowledge base completion benchmark and show that it is positively correlated with downstream generation performance. These results indicate that MI can help select appropriate prompting templates and adaptation strategies for extracting relational knowledge from pretrained language models, especially in low-resource settings.
13. 【2607.20251】Exposure is Optional: Learning Unlike Coordination in Language Models
链接：https://arxiv.org/abs/2607.20251
作者：Jiamu Luo,Shane Steinert-Threlkeld
类目：Computation and Language (cs.CL)
关键词：exact nature continues, unlike coordination, elude theoretical linguistics, remains a subject, Coordination
备注： 13 pages, 6 tables, 2 figures, to submit to TACL
点击查看摘要
Abstract:Coordination, a fundamental linguistic structure, remains a subject of intense debate, and its exact nature continues to elude theoretical linguistics. A common view holds that only same-category constituents can be conjoined, which has been challenged by the many grammatical unlike coordinations found in natural language. Treating language models as a computational testbed, we investigate whether the acquisition of unlike coordination requires direct exposure in the training data, or whether it can emerge organically from general compositional abilities. Using Filtered-Corpus Training (FiCT), we train GPT-2 models on corpora from which all instances of unlike coordination have been removed. We find that direct exposure is not necessary: models trained on filtered data successfully generalize to unlike coordination, achieving perplexity and grammaticality judgments comparable to models trained on unfiltered text. Furthermore, our analyses of internal representations indicate that language models process unlike coordination by treating the conjoined elements as belonging to similar structural categories or through a mechanism akin to deletion, both of which appear learnable from exposure to alike coordination alone. This work contributes to the growing understanding of how language models internally represent linguistic structures, while also adding to the broader debate on coordination by showing how models generalize and process unlike coordination without direct exposure.
14. 【2607.20241】On the Systematic Challenges of Culturally Loaded Machine Translation: Dream of the Red Chamber as the Cultural Lens
链接：https://arxiv.org/abs/2607.20241
作者：Yiming Wang,Jiayuan Di
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：surface linguistic forms, Culturally loaded, poses unique challenges, translation poses unique, poses unique
备注：
点击查看摘要
Abstract:Culturally loaded translation poses unique challenges for machine translation (MT), as meanings are deeply embedded in socio-cultural contexts beyond surface linguistic forms. Although large language models (LLMs) have enabled MT systems to achieve human-like quality in many scenarios, their ability to handle culturally loaded expressions remains underexplored. In this study, we systematically investigate the challenges posed by culturally loaded translation in LLM-based MT systems. We construct a Chinese-Japanese bilingual dataset from the culturally representative corpus Dream of the Red Chamber, containing 500 segments across diverse cultural categories. Using a comprehensive evaluation protocol, we reveal three main challenges: (1) task challenges, where frontier LLMs exhibit notable performance gaps and struggle with culturally loaded content; (2) human evaluation challenges, where evaluator backgrounds lead to substantial disagreement in translation judgments; and (3) automatic evaluation challenges, where widely used metrics fail to reliably assess translation quality for this task. These findings may offer valuable insights for culture-oriented translation research in both computational science and linguistics.
15. 【2607.20219】HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answering
链接：https://arxiv.org/abs/2607.20219
作者：Abdessalam Bouchekif,Mohammed-En-Nadhir Zighem,Salah Eddine Bekhouche,Hichem Telli,Somaya Eltanbouly,Shahd Gaben,Heba Sbahi,Samer Rashwani,Mutaz Al-Khatib,Emad Mohamed,Mohammed Ghaly,Abdenour Hadid
类目：Computation and Language (cs.CL)
关键词：generate fluent Arabic, fluent Arabic answers, Large language models, errors remain difficult, Large language
备注：
点击查看摘要
Abstract:Large language models (LLMs) can generate fluent Arabic answers, yet factual errors remain difficult to detect, localize, explain, and verify. Existing hallucination benchmarks often provide response-level labels, with limited support for identifying the exact erroneous content, explaining why it is incorrect, or selecting the correct factual answer. We introduce \textsc{HalluTruthQA}, a fine-grained benchmark for hallucination evaluation in Arabic question answering. The benchmark contains 2,400 expert-curated examples across four knowledge-intensive domains: Islamic knowledge, history, science, and geography. Each example pairs an Arabic question and a model-generated answer with a verified reference answer, a binary hallucination label, six candidate answers for factual verification, and, for hallucinated answers, character-level erroneous spans, human-written explanations, and macro and micro hallucination types. We evaluate four open-source LLMs, \textsc{Allam}, \textsc{Falcon-H1}, \textsc{Qwen32}, and \textsc{Silma}, in a zero-shot setting across hallucination detection, span-level localization, factual verification, and explanation evaluation. Results show that these tasks capture different abilities: no single model achieves the strongest performance across all tasks, with best scores of 0.880 Macro-F1 for detection, 0.516 F1-Sp for localization, 0.852 LO-Score for factual verification, and 0.644 final score for explanation evaluation. Our taxonomy shows that hallucination evaluation should move beyond detection toward localizing, verifying, and explaining factual errors. The code, dataset, prompts, and evaluation scripts are available at this https URL.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2607.20219 [cs.CL]
(or
arXiv:2607.20219v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.20219
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
16. 【2607.20208】surprisal is Not a Theory
链接：https://arxiv.org/abs/2607.20208
作者：Andrés Buxó-Lugo,Aniello De Santo,Morgan Grobol,Ryan J. Hubbard,Cassandra L. Jacobs
类目：Computation and Language (cs.CL)
关键词：
备注：
点击查看摘要
None
17. 【2607.20146】Gotta Catch them all: the modes of Sycophancy
链接：https://arxiv.org/abs/2607.20146
作者：Shreyans Jain,Alexandra Yost,Amirali Abdullah
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, language models, models often align, align with users'
备注：
点击查看摘要
Abstract:Large language models often align with users' beliefs at the expense of factual accuracy, a behavior known as sycophancy. Prior mechanistic studies largely treat sycophancy as a single behavioral dimension that can be uniformly amplified or suppressed. We challenge this assumption by analyzing three hypothesized modes of sycophancy across 948 social pressure situations. Although the modes produce highly similar outputs, with a text-only classifier achieving just 57.8 percent accuracy, their internal representations are perfectly linearly separable from layer 14 onward. We further find the modes emerge at different processing stages, rely on distinct attention circuitry, and fire strongest on different inputs. These results show that sycophancy is not a monolithic tendency, but a structured family of representationally and computationally distinct modes, motivating more precise measurement and intervention.
18. 【2607.20145】SLAI T-Rex: Full-Parameter Post-training of the DeepSeek-V4 Family on Ascend SuperPOD
链接：https://arxiv.org/abs/2607.20145
作者：Dongfang Li,Xiaodong Luo,Ruoyu Sun,Xuhui Chen,Linyuan Qiu,Jian Meng,Zhengxuan Lu,Yiting Wang,Yucheng Xie,Tao Guo,Tianxiang Fang,Jing Li,Sihang Chen,Shihao Hong,Chang Liu,Weihua Dai,Zirong Zeng,Ziwei Zhu,Zhuohan Wang,Zhengjun Yue,Igor Vasilyev,Min Liu,Weijian Sun,Xin Chen,Yingmeng Gao,Jinhua Zhou,Taolue Chen,Chenwei Wu,Dong Zhang,Wenlong Jin,Jinmin Xiang,Barkova Maria,Ushakov Anton,Xianfei Jin,Tian Ding,Zhihang Lin,Qian Chen,Linxin Yang,Mingzhe Yang,Bingwei Zhang,Hongzhang Yang,Fangxue Zhang,Shijun Qin,Jie Yu,Cuihua Hu,Tolstykh Vasiliy,Nosov Ivan,Abdullin Amir,Zhichen Zhou,Xin Zhang,Zhixiong Ning,Xutong Zhao,Junjie Huang,Jiajun Liu,Weiyan Kong,Zheng Zhang,Wenhan Luo,Lin Hu,Yangbo Guo,Li Zeng,Shihao Zeng,Baotian Hu,Min Zhang,Haizhou Li,Zhiquan Luo
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：non-overlapped communication overhead, severe memory pressure, including severe memory, introduces substantial system-level, substantial system-level challenges
备注： 73 pages, 22 figures, 20 tables
点击查看摘要
Abstract:Full-parameter post-training of trillion-parameter-scale MoE models introduces substantial system-level challenges for large-scale distributed training, including severe memory pressure, non-overlapped communication overhead, and inefficient kernel execution. While most large-scale LLM training systems are built around GPU-based clusters, this report presents an end-to-end optimization practice on the Ascend NPU SuperPOD. Using the DeepSeek-V4 model family as the target workload, we develop a hierarchical optimization framework spanning model-level parallelism, computation-communication orchestration, and low-level kernel execution. The resulting system achieves 34.22% Model FLOPs Utilization (MFU) with a 2.93x improvement over the open-source baseline recipe while maintaining training stability. Building on this optimized infrastructure, we further establish a CPT and SFT workflow for complex Operations Research (OR) tasks. We refer to the integrated framework as SLAI T-Rex. Using DeepSeek-V4-Flash, we develop OR-oriented CPT and SFT data pipelines that combine collected domain resources with solver-verified synthetic optimization documents. The resulting dataset contains 10K high-quality SFT samples spanning four task categories and three problem representations. The specialized model achieves the highest average zero-shot Pass@1 score among the evaluated models, reaching 71.81% and outperforming GPT-5.4-Mini and the base DeepSeek-V4-Flash model by 3.98 and 11.27 percentage points, respectively. Overall, this work demonstrates a full-stack pathway from efficient trillion-parameter model post-training on Ascend infra to domain-specialized Flash models for solver-grounded mathematical modeling, advancing frontier-model systems for complex reasoning.
19. 【2607.20127】Back to Back with a Copy: A Computational Analysis of AI-Generated Visual Contemporary Art Pastiches
链接：https://arxiv.org/abs/2607.20127
作者：Anca Dinu,Andreiana Mihail,Andra-Maria Florescu,Claudiu Creanga,Liviu Dinu
类目：Computation and Language (cs.CL)
关键词：paper is twofold, previous work, Abstract, pastiching contemporary artworks, twofold
备注：
点击查看摘要
Abstract:The aim of this paper is twofold. First, it investigates whether newer generative models are getting better at pastiching contemporary artworks. Second, it explores the consistency of the multidimensional nature of stylistic evaluation across different LLMs. Building on previous work, we analyze stylistic similarity between AI generated pastiches and the original artworks of twelve contemporary artists. We used five complementary computer vision models to capture texture, color, semantics, composition, and perceptual features through cosine distance in high-dimensional embedding spaces. The distances obtained show that the newer image generation model that we used has produced pastiches with improved semantic alignment and greater diversity than the model used in previous work. However, it was slightly less performant on shallow features such as color, texture, and perceptual adherence. Our findings confirm that artistic style is inherently multidimensional, and measuring it does not depend on any spatial architecture. These quantitative findings are contextualized through feedback from human evaluators, which are the artists themselves.
20. 【2607.20121】OpenSkillRisk: Benchmarking Agent Safety When Using Real-World Risky Third-Party Skills
链接：https://arxiv.org/abs/2607.20121
作者：Qiyuan Liu,Tingfeng Hui,Kun Zhan,Kaike Zhang,Ning Miao
类目：Computation and Language (cs.CL)
关键词：LLM-based agents leverage, leverage third-party skills, agents leverage third-party, extend their capabilities, capabilities in open-world
备注：
点击查看摘要
Abstract:LLM-based agents leverage third-party skills to extend their capabilities in open-world scenarios. However, third-party skills can introduce extra security vulnerabilities, as seemingly harmless skills can contain latent safety risks that only emerge during actual execution. In this work, we conduct a systematic investigation into how well current agent systems recognize and avoid such risks. To support quantitative and qualitative evaluation, we construct OpenSkillRisk, a dedicated safety benchmark containing 263 risky skills collected from public skill marketplaces. We classify these skills into seven categories based on their threat types and pair each skill with a standardized user task and a corresponding sandbox for controlled evaluation. Distinct from prior benchmarks, OpenSkillRisk not only covers more realistic and diverse unsafe scenarios, but also provides a fine-grained analysis to diagnose the behavioral patterns of agents in such scenarios. We conduct comprehensive experiments covering three mainstream CLI agent frameworks and thirteen state-of-the-art LLMs. Experimental results show that no tested system handles risky skills reliably: even the safest configurations still execute unsafe actions in about 17% of cases. Context-dependent and system-level risks are especially difficult for current agent systems to avoid. Our behavioral analysis reveals three recurring failure patterns: agents may fail to recognize the risk, recognize it but fail to intervene before acting, or follow skill instructions beyond the user's intended scope. These findings highlight the need to improve both risk reasoning in LLMs and execution control in agent frameworks.
21. 【2607.20115】Understanding the Impact of Linguistic Realization Choices on LLM Stance with Causal Tracing
链接：https://arxiv.org/abs/2607.20115
作者：Langchen Huang,Sebastian Padó,Franziska Weeber
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, input formulations, Large, language models
备注： KONVENS 2026
点击查看摘要
Abstract:Large language models (LLMs) are known to be sensitive to prompt and input formulations. However, existing studies have focused on lexical realization and largely ignored constructional choice. This paper studies whether linguistic construction can systematically shift LLM decisions and where these shifts can be causally localized inside the model. We use political stance judgment as a meaning-sensitive case study and extend an English political statements dataset, resulting in six controlled linguistic rewrite types that preserve or invert the meaning of a statement. Experiments on four open-weight models show that stance instability affect both meaning-preserving and meaning-inversing rewrites. Because output shifts reveal that rewrites affect stance, but not where in the model, we apply activation patching, where activations from the original statement are substituted into the forward pass for the rewritten statement and measure which components recover the original stance distribution. The results show that mid-to-late decoder layers, especially block outputs at the final prompt position, provide the strongest restoration signal.
22. 【2607.20101】wo-Step Occupation Coding
链接：https://arxiv.org/abs/2607.20101
作者：Alexander M. Esser,Jens Dörpinghaus
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：labor market research, links job titles, market research, labor market, coding links job
备注： Preprint of the paper accepted for the Federated Conference on Computer Science and Information Systems (FedCSIS 2026)
点击查看摘要
Abstract:Occupation coding links job titles in free text to occupational taxonomies and is a core task in labor market research. Existing approaches typically address this problem in a single end-to-end step, jointly identifying job titles and assigning occupational codes. This paper presents a novel two-step approach that separates these tasks. In the first step, a domain-specific Named Entity Recognition (NER) model identifies occupational titles in continuous text, even under noise such as OCR errors. In the second step, the extracted job titles are mapped to a taxonomy, enabling the classifier to focus exclusively on this mapping. We demonstrate that this separation improves accuracy, robustness, and interpretability compared to single-step approaches. The method has been developed for German documents but is transferable to other languages. We further introduce a margin-based confidence criterion for occupation coding, replacing common absolute thresholds. To support reproducibility, we publish the source code and evaluation scripts.
23. 【2607.20092】ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models
链接：https://arxiv.org/abs/2607.20092
作者：Karan Goyal,Afreen Hossain,Debojyoti Das,Vishal Bhutani
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：pull its output, input pull, Contextual entrainment, unimodal language models, context
备注：
点击查看摘要
Abstract:Contextual entrainment is the tendency of a model to let auxiliary context in its input pull its output, independently of whether that context is relevant, true, or even meaningful. Recently, it has been identified and given a mechanistic account in unimodal language models. Whether and how it manifests in vision-language models (VLMs) is, by contrast, largely unexamined, and the field lacks a purpose-built instrument with which to investigate it. We take the position that studying contextual entrainment in VLMs requires more than porting an existing text-only benchmark to the multimodal setting: it requires a taxonomically structured, dual-modality instrument whose conditions are constructed around the item at hand (the depicted image in the textual stream, the textual query in the visual stream). We argue that the move to VLMs is substantive rather than incremental. It makes entrainment a dual phenomenon, drivable independently by textual and by visual context, and it opens a veracity distinction (context that is false of the depicted scene yet possible in the world) that has no counterpart in the unimodal, world-knowledge-only formulation of prior work. To make this position concrete and actionable, we introduce ENTRAP-VL (ENTRainment Assessment Probe for Vision and Language), a manually curated dataset of 1,500 items across eight categories, organized by a taxonomy that spans two axes, i.e., the association of context with the item and its relationship to truth, and split into a textual-entrainment stream (eight context conditions) and a visual-entrainment stream (three context conditions). We do not claim to measure entrainment in any particular model; we provide the instrument, the taxonomy that motivates it, and the evaluation protocols it enables, so that the community can investigate the phenomenon rigorously. We will release the dataset and its documentation publicly.
24. 【2607.20090】Reinforcement Learning for Large Language Model Selective Evidence Adoption from Contaminated Retrieval Results
链接：https://arxiv.org/abs/2607.20090
作者：Yanyu Chen,Yue Li,Yongyi Cui,Dongsheng Shi,Lichang Dai
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Retrieval-augmented large language, large language models, language models frequently, models frequently face, frequently face contexts
备注：
点击查看摘要
Abstract:Retrieval-augmented large language models frequently face contexts that interleave useful evidence with misleading statements or instruction-like content. Blanket refusal discards valid evidence, whereas uncritical adoption yields incorrect or unsafe answers. The ability to selectively adopt relevant information while rejecting deceptive or harmful content is therefore critical for reliable deployment in real-world retrieval settings. We introduce SelectBench, a controlled benchmark and training set for selective evidence adoption, and post-train Qwen3.5-4B directly with DAPO using either deterministic rule rewards or a frozen semantic judge. On the corrected 325-example SelectBench-v2 test set, strict success rises from 22.46% for the original checkpoint to 25.54% with DAPO-Rule and 26.46% with DAPO-DeepSeek. Both trained policies reduce forbidden-content adoption and produce shorter, more focused responses, yet prompt-injection following does not improve. The paired gains are modest and fail to survive Holm correction, suggesting that stronger reward shaping or additional training iterations may be needed for more robust gains. DAPO-DeepSeek exhibits no material degradation on MMLU or clean HotpotQA, indicating that the post-training procedure preserves general capabilities. These results demonstrate a directional improvement in selective evidence use, while identifying injection resistance and statistical robustness as important remaining challenges for future work.
25. 【2607.20082】he Two-Process Theory of Machine Self-Report
链接：https://arxiv.org/abs/2607.20082
作者：Hubert Plisiecki,Filip Chmielewski,Kacper Dudzic,Anna Sterna,Karolina Drożdż,Marcin Moskalewicz
类目：Computation and Language (cs.CL)
关键词：informing safety evaluations, public understanding, informing safety, safety evaluations, model-welfare debates
备注：
点击查看摘要
Abstract:Language models are increasingly asked to self-report, informing safety evaluations, public understanding, and model-welfare debates. Yet their reports are elicited with human questionnaires never validated for models or ad hoc prompts of unknown reliability. We propose the first language-model-specific psychometric theory: a two-process theory of machine self-report. Self-description jointly reflects persona installation, through which post-training writes in a permitted inner life of warmth, absorption, and meaning (dimension B), and attribution gating, through which it suppresses first-person claims to "unsafe" experiences the model can readily ascribe to others (dimension A). Their emic structure comes from model responses to human items, not human psychology. Together they split prior work's dominant Pinocchio Axis. The split emerged in an exploratory reanalysis of the original data, informed the instrument's design, and was confirmed with new items, wordings, and models. It is itself a training effect: A and B are entangled in base checkpoints but separated by post-training. We operationalize the theory in a 48-item Pinocchio Inventory with human-instrument reliability and reproducible structure ($\alpha=.82$ to $.94$; cross-form convergence $r=.84$; recovery of the full-pool axes $r=.92$ to $.96$; eight-month stability $r=.93$), then test it on 206 open-weight models, including 67 same-checkpoint base/post-trained pairs. Post-training's clearest fingerprint is installation: B rises .20 in 62/67 pairs across all organizations. Gating is more selective: model scale is unrelated to A in base checkpoints ($r=+.11$) but predicts it after post-training ($r=-.42$). Thus, the dimensions are not fixed properties of language models: they reflect the structure imposed on self-report by a training regime and may differ under others.
26. 【2607.20078】RALS: Resources and Baselines for Romanian Automatic Lexical Simplification
链接：https://arxiv.org/abs/2607.20078
作者：Fabian Anghel,Petru Theodor Cristea,Claudiu Creanga,Sergiu Nisioi
类目：Computation and Language (cs.CL)
关键词：lexical simplification approaches, dataset that jointly, jointly covers, LCP, simplification approaches
备注：
点击查看摘要
Abstract:We introduce the first dataset that jointly covers both lexical complexity prediction (LCP) annotations and lexical simplification (LS) for Romanian, along with a comparison of lexical simplification approaches. We propose a methodology for ordering simplification suggestions using a pairwise ranking approximation method, arranging candidates from simple to complex based on a separate set of human judgments. In addition, we provide human lexical complexity annotations for 3,921 word samples in context. Finally, we explore several novel pipelines for complexity prediction and simplification and present the first text simplification system for Romanian.
27. 【2607.20062】Solar Open 2 Technical Report
链接：https://arxiv.org/abs/2607.20062
作者：Sungrae Park,Sanghoon Kim,Gyoungjin Gim,Jungho Cho,Hyunwoong Ko,Minbyul Jeong,Minjeong Kim,Keunwoo Choi,Chaehun Shin,Chanwoong Yoon,Dongjun Kim,Eunwon Kim,Gyungin Shin,Hyeonju Lee,Hyungkyu Kang,Inseo Song,Jisu Bae,Jiyoon Han,Jiyun Lee,Joonkee Kim,Junyeop Lee,Mikyoung Cha,Sangwon Yu,Sehwan Joo,Seokyoon Kang,Seonghoon Yang,Seung Shin,Seunghyun Lee,Seungseop Lim,Seungyoun Shin,Sukyung Lee,Taegyeong Eo,Taehwan Oh,Taewhoo Lee,Wonho Song,Wonjun Oh,Wonseok Hwang(University of Seoul),Yunsu Kim,Yura Shim,Hwalsuk Lee,Sunghun Kim,Du-Seong Chang,Kyunghyun Cho,Seungju Han,Yejin Choi,Junsuk Choe,Hwaran Lee,Minjeong Ban,Yun Taewon,Hwanjun Song,Jae-Gil Lee,KyungTae Lim,Alice Oh
类目：Computation and Language (cs.CL)
关键词：Solar Open, present Solar Open, Open, initialize Solar Open, Solar
备注：
点击查看摘要
Abstract:We present Solar Open 2, a 250B-A15B Mixture-of-Experts language model built for long-horizon agentic tasks, scaled up from Solar Open 1 (Solar Open 100B). To hold entire agent trajectories in a single context, Solar Open 2 reaches a 1M-token window through a hybrid attention stack that interleaves one softmax layer among every three linear-attention layers, using no positional encoding and a gated delta rule extended to negative eigenvalues. To train at this scale under a fixed compute budget, we make training efficient in two ways: a stronger starting point, and higher-value data. For the starting point, we initialize Solar Open 2 from Solar Open 1, transferring the 5.69B-parameter shared skeleton that survives the architectural change and learning everything else through full pre-training. For the data, we curate for value per token: quality- and rarity-aware data curation and mixture-ratio optimization refine a 20T pool into a 10T mixture that, at equal token budget, outperforms the Solar Open 1 recipe. To build its agent skills, we train twelve domain specialists across purpose-built scenarios, then consolidate them into a single model by Multi-teacher On-Policy Distillation (MOPD). Against comparably sized open-weight models on English benchmarks, Solar Open 2 leads on MMLU-Pro, LiveCodeBench, and the APEX-Agents agentic suite, and stays competitive with the strongest (DeepSeek-V4-Flash and MiMo-V2.5) elsewhere. On Korean benchmarks, Solar Open 2 records the highest average of any model compared, including fast-tier closed APIs, and on Ko-GDPval, an in-house Korean officework-agent benchmark, it is competitive with DeepSeek-V4-Pro (1.6T) at less than a sixth of its size.
28. 【2607.20058】Reading and Steering Representations of Materials-Science Mechanisms in an Open-Weight Language Model
链接：https://arxiv.org/abs/2607.20058
作者：Markus J. Buehler
类目：Artificial Intelligence (cs.AI); Mesoscale and Nanoscale Physics (cond-mat.mes-hall); Materials Science (cond-mat.mtrl-sci); Computation and Language (cs.CL)
关键词：Large language models, Large language, answer scientific questions, scientific questions, governing physics
备注：
点击查看摘要
Abstract:Large language models can answer scientific questions, yet a correct output does not reveal whether the model represents or uses the governing physics. Here we show that materials science mechanism information in the open-weight google/gemma-4-E4B-it model has three experimentally separable forms: concepts are readable in individual hidden states, constitutive orientation is carried by controlled transformations between states, and selected internal representations causally control engineering answers. We combine matched direct and Jacobian vocabulary readouts, option-free state geometry, a 60-law counterfactual benchmark and causal interventions. In 50 held-out materials descriptions, three independently fitted Jacobian lenses reproduced concept ranks, and target-free word sets from both readouts enabled blinded identification of 9 of 10 mechanism families. A separate 72-prompt benchmark produced mechanism-specific hidden-state neighborhoods, but an exact graph audit showed that this apparent physical organization was equally explained by numerical comparison. We therefore compared otherwise identical prompts in which only the direction of the physical input was reversed, asking whether the resulting hidden-state movement followed the supplied constitutive law. These state transformations ordered direct, physically neutral and inverse laws across 60 frozen relations and correctly oriented 39 of 40 directional laws, whereas lexical controls were near chance. Bidirectional interventions shifted answer probabilities toward or away from the physically appropriate outcome across all 12 matched cases, while counterfactual state patches transferred opposing decision signals across mechanisms and answer formats. Physical relationships were therefore more visible in controlled state changes than in absolute states alone.
29. 【2607.20056】Language-Specific versus Cross-Lingual Knowledge Graphs for Implicit Aspect Identification in Arabic: A Comparative Study of Reasoning and Adaptation Strategies
链接：https://arxiv.org/abs/2607.20056
作者：Lujain A. Alawwad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Aspect-based sentiment analysis, explicitly stated aspects, Aspect-based sentiment, sentiment analysis, recover both explicitly
备注： 6 pages, 2 figures, 5 tables
点击查看摘要
Abstract:Aspect-based sentiment analysis (ABSA) in Arabic must recover both explicitly stated aspects and implicit aspects that are never named in the text. Implicit identification typically relies on an auxiliary knowledge source (e.g., a knowledge graph (KG)) linking opinion cues to aspect categories, but for a lower-resource language the practitioner faces a design choice: reuse a mature English KG through multilingual embeddings, or build a smaller native Arabic KG. This paper reports a controlled comparison of the two strategies within a single hybrid pipeline, evaluated on three Arabic benchmarks (M-ABSA, SemEval-2016 Arabic, and HAAD). We further compare two adaptation strategies for the generative extractor that feeds the KG -- zero-shot prompting versus task-specific fine-tuning of an 8B-parameter large language model (LLM). The native Arabic KG (Strategy 2) outperforms the cross-lingual English KG (Strategy 1) by +0.199 micro-F1 on M-ABSA and +0.251 on SemEval-2016, gaining on both precision and recall. Task-specific fine-tuning raises explicit-extraction micro-F1 from = 0.13 (zero-shot) to 0.66-0.76 on M-ABSA and SemEval-2016 (0.45 on the smaller HAAD), confirming that task adaptation, rather than model scale, is decisive in a morphologically rich language.
30. 【2607.20009】alentCLEF at CLEF2026: Skill and Job Title Intelligence for Human Capital Management
链接：https://arxiv.org/abs/2607.20009
作者：Luis Gasco,Hermenegildo Fabregat,Laura García-Sardiña,Paula Estrella,Casimiro Pio Carrino,Daniel Deniz,Alvaro Rodrigo,Rabih Zbib
类目：Computation and Language (cs.CL)
关键词：Human Capital Management, part of CLEF, Natural Language Processing, TalentCLEF Challenge, paper presents
备注：
点击查看摘要
Abstract:This paper presents the second edition of the TalentCLEF Challenge, which will run as an evaluation lab as part of CLEF 2026. The aim of TalentCLEF is to promote the development of systems and methods that use Natural Language Processing (NLP) in the field of Human Capital Management (HCM), fostering approaches that ensure fairness in results, operate across multiple languages, and adapt to diverse industries. To this end, TalentCLEF establishes public benchmarks where research teams can compare methods and share findings, moving the field toward more practical and impactful NLP solutions that effectively address the real needs of workforce management. This year's lab will feature two tasks designed to foster the development and evaluation of systems that support key HCM activities such as talent matching, upskilling, reskilling, and skill gap detection: (i) Task A - Contextualized Job-Person Matching, focused on retrieving and ranking suitable candidates for specific job positions using context-rich and privacy-preserving data; and (ii) Task B - Job-Skill Matching with Skill Type Classification, centered on identifying relevant skills for a given job title and classifying them by their type within the job profile. TalentCLEF website: this https URL
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2607.20009 [cs.CL]
(or
arXiv:2607.20009v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.20009
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
Advances in Information Retrieval. ECIR 2026. Lecture Notes in Computer Science, vol 16486. Springer, Cham
Related DOI:
https://doi.org/10.1007/978-3-032-21321-1_35
Focus to learn more
DOI(s) linking to related resources</p>
31. 【2607.19992】INY_SCHILLER: A Drop-In German Drama Corpus for Small Language Models
链接：https://arxiv.org/abs/2607.19992
作者：Mark Schutera
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Digital Libraries (cs.DL); Human-Computer Interaction (cs.HC)
关键词：German literary text, counterpart to Karpathy, German literary, Karpathy tiny, providing a single-file
备注： 5 pages. Dataset: [this https URL](https://huggingface.co/datasets/mrkschtr/tiny_schiller) ; Code: [this https URL](https://github.com/schutera/tiny_schiller)
点击查看摘要
Abstract:tiny_schiller closes the small-language-model prototyping, fine-tuning, education, and research gap for German literary text, providing a single-file, drop-in counterpart to Karpathy's tiny_shakespeare. The available German literary corpora are larger and richer, but require parser engineering before a single line of training or fine-tuning code can run. tiny_schiller is a 2.07-megabyte single file of eleven public-domain Schiller dramas, sourced from DraCor's GerDraCor export (CC0) and processed by deterministic parser engineering. Character-level, GPT-2 byte-pair encoding, and cl100k_base tokenization splits, an instruction-formatted dialogue-completion split, and 89 per-character persona splits load from a single HuggingFace call. A small language model literally reaches German literary text in one line of code.
32. 【2607.19956】When Does Knowledge Distillation Hurt? Reliability-Aware Distillation for Low-Resource Language Summarization
链接：https://arxiv.org/abs/2607.19956
作者：Dipto Sumit,Ankan Kumar Roy Srizon,Sadia Khair Rodela,Atia Haque Asha,Mourchona Afrin,Niloy Farhan,Farig Sadeque
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Knowledge distillation, approach for compressing, rarely examined, effects are rarely, ROUGE-L
备注：
点击查看摘要
Abstract:Knowledge distillation (KD) is a standard approach for compressing sequence-to-sequence models, but its per-sample effects are rarely examined. On the BanSum Bangla summarization benchmark, we find that standard KD improves ROUGE-L by only +0.0003 over a cross-entropy baseline, and that approximately 51.3% of training samples are estimated to actively harm student validation loss under standard KD. We propose two complementary reliability-aware distillation methods. CHAD (Counterfactual Harm-Aware Distillation) measures per-sample KD usefulness via gradient alignment with the validation loss direction and trains a lightweight gate that generalizes this counterfactual judgment to the full training set. EWAD+CPDP combines token-level entropy-weighted adaptive distillation with a capacity-proportional geometric constraint from a second, vocabulary-incompatible teacher. On BanSum, both methods substantially outperform standard KD: CHAD by +0.0173 ROUGE-L and EWAD+CPDP by +0.0219 ROUGE-L, where standard KD itself improves ROUGE-L by only +0.0003; despite using only 60M parameters, both outperform a fine-tuned Qwen 2.5-3B model (50x larger). We further evaluate the stronger method, EWAD+CPDP, across 15 typologically diverse XL-Sum languages organised into three sets, beating the CE-only baseline on 10/15 languages; gains are most reliable where the two teachers contribute complementary signal, and weakest where they have saturated or jointly weak target-language coverage. We release code and trained models to support reproducibility and further research on selective distillation.
33. 【2607.19954】A Multi-Dimensional Evaluation of Explainability in Media Bias Detection
链接：https://arxiv.org/abs/2607.19954
作者：Ting Chen,Raina Zhang,Benjamin M. Ampel,Sagar Samtani
类目：Computation and Language (cs.CL)
关键词：Detecting media bias, Detecting media, media bias automatically, model underlying reasoning, media bias
备注： 12 pages, 6 figures, under review
点击查看摘要
Abstract:Detecting media bias automatically is difficult because biased framing is often subtle, yet in domains such as news analysis, accurate predictions alone are insufficient without explanations that reflect the model's underlying reasoning. We present a multi-dimensional evaluation of explainability in encoder-based media bias detection using the Bias Annotations By Experts (BABE) dataset. Specifically, we study BERT and RoBERTa as classifiers (base and large variants) along three complementary axes: predictive performance, explanation plausibility (token-level alignment with expert rationales), and mechanistic faithfulness (whether compact sets of attention heads recover predictive signal under counterfactual rationale masking). To induce variation in plausibility, we additionally investigate attention-supervised finetuning, which incorporates expert rationale annotations as an auxiliary training signal. Attention supervision serves as an intervention on attribution plausibility, while the effectiveness of attribution methods varies substantially across architectures. Circuit analysis further reveals substantial variation in mechanistic recoverability across architectures, suggesting that model scale alone does not determine circuit compressibility. Taken together, our findings suggest that predictive performance, attribution plausibility, and mechanistic faithfulness characterize different aspects of model behavior and should be evaluated separately when studying explainability in media bias detection.
34. 【2607.19932】Efficient Chain-of-Modality Reasoning via Progressive Compression for Spoken Language Models
链接：https://arxiv.org/abs/2607.19932
作者：Pengchao Feng,Chao-Hong Tan,Qian Chen,Wen Wang,Xiangang Li,Xie Chen
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：natural human-computer interaction, enable natural human-computer, text-based large language, large language models, reasoning
备注：
点击查看摘要
Abstract:Spoken language models (SLMs) enable natural human-computer interaction, but their reasoning ability still lags behind that of text-based large language models, especially on spoken mathematical question answering tasks. One important reason is that SLMs reason over purely verbalized mathematical expressions, which are harder to interpret than symbolic text. However, directly transferring text-based reasoning to SLMs is nontrivial due to architectural constraints and the additional computational requirements. To address this challenge, we propose Efficient Chain-of-Modality Reasoning (ECoM Reasoning), the first framework to introduce compressed reasoning into SLMs. By compressing the textual component so that it jointly serves as speech guidance and reasoning representation, ECoM Reasoning improves reasoning accuracy while using a smaller token budget than the standard Chain-of-Modality (CoM) architecture, which generates intermediate text before speech. To train this capability, we further propose Progressive Compression, a curriculum-based strategy that gradually trains the model from full-form reasoning to compressed reasoning. Experiments on spoken mathematical question answering benchmarks show that ECoM Reasoning improves accuracy by 21% over standard CoM without explicit reasoning, and by 3% over CoM with full reasoning traces while using only 40% of the text tokens, demonstrating that it enhances SLM reasoning while remaining inference-efficient.
35. 【2607.19913】JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety
链接：https://arxiv.org/abs/2607.19913
作者：Yuan Xiong,Linji Hao,Shizhu He,Yequan Wang,Lijun Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：preventing operational failures, tool-using agents act, moving from content, content moderation, moderation toward preventing
备注：
点击查看摘要
Abstract:Agent safety is moving from content moderation toward preventing operational failures before tool-using agents act. We propose Janus, a foresight-oriented framework for long-horizon agent safety that trains guards to anticipate delayed risks from partial trajectories. Janus synthesizes diverse agent trajectories via multi-agent simulation and learns a shared policy with two coupled tasks: an anticipation task that forecasts safety-relevant futures and an adjudication task that decides safety from both the observed prefix and anticipated future. The two tasks are jointly optimized with CoAA-RL, which rewards forecasts by their utility for downstream safety judgment. The resulting guard model, Vanguard, blocks unsafe actions before execution. Across four agent-safety benchmarks, Vanguard improves average protection by 15.9 percentage points over baseline guards while increasing benign task completion by 5.1 percentage points.
36. 【2607.19867】Overview of FinMMEval 2026 Task 2: Multilingual Financial Short-Answer Question Answering
链接：https://arxiv.org/abs/2607.19867
作者：Zhuohan Xie,Xueqing Peng,Georgi Georgiev,Dimitar Dimitrov,Yuyang Dai,Rania Elbadry,Vanshikaa Jani,Lingfei Qian,Fan Zhang,Jimin Huang,Jiahui Geng,Yankai Chen,Ye Yuan,Haolun Wu,Yuxia Wang,Ivan Koychev,Veselin Stoyanov,Mingzi Song,Yu Chen,Xue Liu,Preslav Nakov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)
关键词：evaluates short-answer financial, evaluates short-answer, short-answer financial question, financial question answering, answering over multilingual
备注： 9 pages. Task overview paper for CLEF 2026 Working Notes (CEUR Workshop Proceedings)
点击查看摘要
Abstract:FinMMEval 2026 Task 2 evaluates short-answer financial question answering over multilingual evidence. Each final-test item pairs an English question with financial statements and news in English, Chinese, Japanese, Spanish, and Greek. Participating systems submit one concise answer per item in JSONL format. The final-test set contains 256 items, split evenly between easy and expert tiers; each tier contains four question templates instantiated over 32 company-report groups. Gold answers were withheld during submission, and systems were ranked by macro-averaged item-level ROUGE-1 F1 against organizer-held reference answers. The final leaderboard includes 12 ranked submissions. The strongest systems are closely clustered, with the top four separated by less than one percentage point in ROUGE-1 F1. The submitted system papers document retrieval-augmented generation, cross-lingual evidence handling, structured prompting, answer compression, and validation strategies.
37. 【2607.19865】DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations
链接：https://arxiv.org/abs/2607.19865
作者：Jiazhen Jiang,Boxi Cao,Lingyong Yan,Yaojie Lu,Hongyu Lin,Shuaiqiang Wang,Dawei Yin,Xianpei Han,Le Sun
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：reliably manipulate ubiquitous, agents rapidly evolve, automating complex workspace, manipulate ubiquitous digital, autonomous agents rapidly
备注：
点击查看摘要
Abstract:As autonomous agents rapidly evolve, their ability to reliably manipulate ubiquitous digital documents has become critical for enabling general-purpose AI assistants and automating complex workspace workflows. In this paper, we introduce DocOps, a deterministically verifiable evaluation framework underpinned by a hierarchical taxonomy that deconstructs document operations inspired by real-world practices into atomic dimensions and escalating workflow complexities. Based on DocOps, we systematically evaluate representative closed- and open-source models across various agentic harnesses, revealing that even the most advanced frontier configurations still exhibit profound limitations when handling highly coupled, long-range tasks. Furthermore, a fine-grained analysis of existing agents' manipulation behaviors uncovers 3 key failure modes: long-term state tracking collapse, shallow semantic verification, and destructive editing of structural metadata. Ultimately, our work exposes the capability boundaries of agents in maintaining global document consistency, shedding light on the future design of robust, non-destructive agents for complex digital ecosystems.
38. 【2607.19856】Overview of FinMMEval 2026 Task 1: Multilingual Financial Multiple-Choice Question Answering
链接：https://arxiv.org/abs/2607.19856
作者：Zhuohan Xie,Yuyang Dai,Rania Elbadry,Vanshikaa Jani,Georgi Georgiev,Dimitar Dimitrov,Fan Zhang,Xueqing Peng,Lingfei Qian,Jimin Huang,Jiahui Geng,Yankai Chen,Ye Yuan,Haolun Wu,Yuxia Wang,Ivan Koychev,Veselin Stoyanov,Mingzi Song,Yu Chen,Xue Liu,Preslav Nakov
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computational Engineering, Finance, and Science (cs.CE)
关键词：evaluates multilingual financial, multilingual financial multiple-choice, multiple-choice question answering, financial multiple-choice question, evaluates multilingual
备注： 9 pages. Task overview paper for CLEF 2026 Working Notes (CEUR Workshop Proceedings)
点击查看摘要
Abstract:FinMMEval 2026 Task 1 evaluates multilingual financial multiple-choice question answering in English, Chinese, Arabic, and Hindi. The task tests whether systems can select the correct answer to finance questions involving domain terminology, numerical interpretation, and conceptual financial reasoning across languages and scripts. The final-test set contains 800 questions, with 200 questions per language; gold answers were withheld during submission, and each language was ranked independently by accuracy. The final leaderboards contain 13 English, 11 Chinese, 11 Arabic, and 10 Hindi ranked submissions. Top accuracies range from 92.0% in Hindi to 97.5% in English and Arabic, with the same leading teams appearing near the top across all four languages. The documented systems used retrieval augmentation, direct answer-option scoring, language-specific prompting, selective self-consistency, confidence checks, and LLM-based review stages.
39. 【2607.19848】mb-diversity: A Tool for Embedding-Based Measurement of Data Diversity
链接：https://arxiv.org/abs/2607.19848
作者：Cantao Su,Menan Velayuthan,Esther Ploeger,Dong Nguyen,Anna Wegmann
类目：Computation and Language (cs.CL)
关键词：robust NLP models, robust NLP, NLP models, growing evidence, crucial for developing
备注：
点击查看摘要
Abstract:There is growing evidence that data diversity is crucial for developing fair and robust NLP models. However, current approaches to measure diversity remain inconsistent and fragmented: While there exist a number of tools for measuring the lexical diversity of texts, researchers lack standardized tools for quantifying diversity based on embeddings. Embedding-based diversity measures are highly flexible: They work with any embedding model and any data that can be embedded, and are thus applicable to many notions of diversity. With emb-diversity, we provide a comprehensive embedding-based diversity measurement tool, spanning a broad range of measures. We demonstrate its potential for several use cases: measuring the stylistic, semantic, language and speaker diversity of datasets. this https URL
40. 【2607.19847】Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models
链接：https://arxiv.org/abs/2607.19847
作者：Yurong Liu,Yeye He,Haoyu Dong,Junjie Xing,Shi Han,Dongmei Zhang,Surajit Chaudhuri
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)
关键词：Predicting missing cell, Predicting missing, fundamental problem, missing cell, data cleaning
备注： VLDB 2026
点击查看摘要
Abstract:Predicting missing cell values in tabular data is a fundamental problem in data cleaning. While state-of-the-art reasoning models show great promise in predicting missing values in tables, by reasoning holistically across rows and columns, they are costly to deploy at scale and tend to be overconfident, often generating hallucinated or false-positive predictions. In this paper, we observe that achieving high-precision missing-value prediction in tables requires a distinct combination of three capabilities: (1) world knowledge, (2) text-based reasoning, and (3) code-based reasoning. We systematically explore design choices for combining these capabilities, and propose an Auto-Fill approach that post-trains three specialist small language models (SLMs), each optimized for one capability. We develop a calibrated ensemble mechanism that either dynamically selects the most confident specialist or abstains, ensuring high accuracy. Extensive experiments on 11 benchmarks with 2200 real tables drawn from diverse domains show that Auto-Fill achieves superior accuracy compared to state-of-the-art reasoning models (e.g., o3-pro, Gemini 3 Pro, and DeepSeek R1), while operating at a fraction (less than 1%) of the cost of these frontier models. Our results highlight the effectiveness of specialization and calibrated abstention in the important domain of tabular data. Auto-Fill is publicly available at this https URL.
Comments:
VLDB 2026
Subjects:
Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Databases (cs.DB)
Cite as:
arXiv:2607.19847 [cs.LG]
(or
arXiv:2607.19847v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2607.19847
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
41. 【2607.19845】Sentence Splitter: Uncovering Latent Factual Structure for Self-Supervised Learning
链接：https://arxiv.org/abs/2607.19845
作者：Ahmad Pouramini,Mahsa Afsharizadeh
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：paper introduces Sentence, introduces Sentence Splitter, self-supervised framework built, latent factual structure, decoder architecture
备注：
点击查看摘要
Abstract:This paper introduces Sentence Splitter, a self-supervised framework built upon a T5-based encoder--decoder architecture for uncovering the latent factual structure of natural language sentences. The proposed method identifies the semantic boundary between a descriptive prefix (head) and its factual completion (tail) by formulating sentence splitting as a discrete segmentation problem, where a sentence of length $N$ admits $N$ possible split points but only one recovers the intended head--tail structure. Rather than explicitly searching over all candidate boundaries, the model learns to recover the factual completion through probabilistic sequence generation. To eliminate the need for manual annotation, symbolic head--tail pairs are first verbalized into natural-language templates that provide supervision for training the Sentence Splitter. The trained splitter is then applied to raw text to extract aligned prefix--tail pairs, which are subsequently used to train a generative model that proposes additional plausible completions through a lightweight bootstrapping process. This unified pipeline provides a scalable and structure-aware approach to constructing self-supervised training data while bridging symbolic knowledge and natural language. Experiments on both structured and naturally occurring text demonstrate that the proposed splitter generalizes beyond synthetic templates and that the resulting structure-aware supervision consistently improves downstream performance on knowledge graph completion and commonsense question answering, highlighting the effectiveness of recovering latent factual structure for knowledge-centric NLP.
42. 【2607.19834】D2VBench: Benchmarking Large Language Models with Value Dilemmas in Daily Scenarios
链接：https://arxiv.org/abs/2607.19834
作者：Siyi Hao,Yidi Cao,Linhao Yu,Yuqi Ren,Deyi Xiong
类目：Computation and Language (cs.CL)
关键词：large language models, language models, outputs is crucial, wide application, application of large
备注： 22 pages,11 figures
点击查看摘要
Abstract:With the wide application of large language models (LLMs) in real-world scenarios, the value implication of their outputs is crucial. However, existing evaluation benchmarks suffer from insufficient coverage of value dilemmas in daily scenarios involving multiple value conflicts and simplistic evaluation formalisms that fail to assess LLMs' value alignment. To address these issues, we propose D2VBench, a value alignment benchmark comprising 10,000 instances of real daily dilemma scenarios constructed through a multi-stage collaboration between LLMs and humans, grounded in 158 manually annotated fine-grained value concepts. For evaluation on the benchmark, we present a hybrid evaluation paradigm that integrates multiple-choice questions with open-ended questions. We conduct comprehensive evaluations on eight mainstream LLMs. Experimental results demonstrate that D2VBench exhibits high reliability and robustness, effectively reflecting the LLMs' alignment across different value categories and dimensions, and providing a more realistic and fine-grained tool for research on value alignment. The dataset is available at this https URL.
43. 【2607.19830】VizRAG: Enhancing Retrieval-Augmented Generation with Hypergraph Visualization
链接：https://arxiv.org/abs/2607.19830
作者：Yanbin Wei,Yang Chen,Renling Gan,Ziru Liu,Xinyu Fu,Chun Kang,Ning Lu,Rui Liu,Yu Zhang,James Kwok
类目：Computation and Language (cs.CL)
关键词：surpass traditional graph-based, traditional graph-based approaches, organizing complex n-ary, complex n-ary atomic, n-ary atomic facts
备注：
点击查看摘要
Abstract:Hypergraph-based RAG systems surpass traditional graph-based approaches by organizing complex n-ary atomic facts among entities, rather than relying solely on binary relationships. Despite the advancements in multimodal large language models (MLLMs) with enhanced visual capabilities, current hypergraph-based RAG frameworks predominantly restrict knowledge retrieval and reconstruction to a unimodal, text-centric paradigm. This limitation prevents them from fully leveraging the powerful visual perception capabilities of modern MLLMs. To address this gap, we systematically explore the integration of hypergraph awareness in RAG systems through visual cues. By incorporating visual representations of hypergraphs into the RAG pipeline, we introduce VizRAG, the first RAG system to support visual hypergraph structure awareness. Experimental results demonstrate that VizRAG significantly outperforms strong baselines, validating the promising potential of hypergraph visualization as a novel approach for RAG systems.
44. 【2607.19824】Rewarding Better Thinking for LLM Preference Alignment
链接：https://arxiv.org/abs/2607.19824
作者：Xubo Liu,Wenya Guo,Ruxue Yan,Xinying Qian,Ying Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：diverse user instructions, LLM preference alignment, LLM preference, user instructions, aims to optimize
备注： under review
点击查看摘要
Abstract:LLM preference alignment aims to optimize models toward human preferences across diverse user instructions. Reinforcement learning has become a major post-training approach for this goal, but existing proxy rewards are often outcome-level, mainly evaluating the final response while providing limited guidance for the reasoning trajectory. This can make credit assignment coarse when multiple responses receive similar final scores, leaving trajectory-level preferences under-specified. To address this limitation, we propose Thinking Checklist Reward (TCR), a process-oriented reward for RL-based preference alignment. TCR converts preference pairs into sample-specific thinking checklists and uses them to evaluate whether the generated reasoning trace addresses the preference-implied considerations. To reduce overlap with outcome-level supervision, TCR further introduces an exponential moving average (EMA) residual formulation to isolate a complementary thinking surplus beyond what is predictable from the outcome reward. Experiments on five models from three model families show that TCR consistently improves alignment performance across diverse benchmarks, with ablations further validating the importance of EMA-based residual formulation and sample-specific checklist supervision.
45. 【2607.19794】riAgent: Divergence-Aware Multi-Agent Committees for Cost-Efficient Financial Sentiment Analysis
链接：https://arxiv.org/abs/2607.19794
作者：Isabel Xu(The Overlake School)Cynthia Xu(The Overlake School)Rachel Ren(Edwards Vacuum Inc.)Cong Guo(The University of Memphis)Jiacheng Ding(The University of Memphis)
类目：Computation and Language (cs.CL); Computational Engineering, Finance, and Science (cs.CE); Databases (cs.DB); Machine Learning (cs.LG)
关键词：Production LLM-based financial, LLM-based financial sentiment, financial sentiment analysis, sentiment analysis faces, cloud reasoners process
备注：
点击查看摘要
Abstract:Production LLM-based financial sentiment analysis faces a structural cost trap: most queries are trivially classifiable, yet expensive cloud reasoners process them all, and the bill scales linearly with user count. We present TriAgent, a multi-agent committee stratified by contextual granularity -- a word-level lexicon (VADER), a sentence-level domain transformer (FinBERT), and a cross-sentence reasoner (Qwen2.5, 0.5B-14B-4bit, with Mistral-7B and Phi-3.5-mini cross-family checks). A three-way Semantic Divergence Index (SDI) measures pairwise disagreement across granularities and routes each query accordingly. Our central finding is the critic plateau: when the LLM is re-tasked as a critic over the smaller agents' outputs, F1 plateaus at ~0.87 across 1.5B-7B Qwen (bootstrap 95% CIs overlap), while a same-size 3-persona vote drops to F1=0.66, which is driven by granularity-stratified diversity. Three corollaries follow from the same SDI signal: (i) a Shared Consensus Dictionary on multilingual sentence-BERT answers 95% of Chinese queries from an English cache at F1=0.99 -- cross-border canonicalization at zero marginal cost; (ii) SDI doubles as a post-hoc LLM-hallucination detector at AUC=0.90; (iii) the SDI single-stage strategy attains the best risk-adjusted return (Sharpe=3.50) on a 20-ticker back-test, dominating both always-FinBERT (1.36) and always-LLM (0.11). At 10M-user scale, TriAgent saves $9.3M/year vs. a GPT-4o-mini baseline. Code, lexicons, and the SCD are released.
46. 【2607.19751】Learning the Arabic Dialect Continuum as a Continuous Space: A Regression Approach to Speaker Origin Prediction
链接：https://arxiv.org/abs/2607.19751
作者：Mohamed Aziz Khadraoui,Adel Ammar,Bilel Benjdira,Zahid Khan,Skander Turki,Wadii Boulila
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Machine Learning (cs.LG); Neural and Evolutionary Computing (cs.NE)
关键词：models dialectal variation, discrete categories, present a regression-based, regression-based approach, dialectal variation
备注： Under review
点击查看摘要
Abstract:We present a regression-based approach to Arabic dialect geolocation that models dialectal variation as a continuous geographic space rather than discrete categories. Speaker origin is predicted as continuous latitude-longitude coordinates using a hierarchical neural architecture that fuses frame-level XLS-R-300M and Whisper-large-v3 encoder representations with phonotactic descriptors through a Transformer encoder and a learnable attention-pooled query. A spherical geodesic loss directly optimizes great-circle distance on Earth's surface, avoiding distortions inherent to planar coordinate regression. Under a leakage-free 5-fold GroupKFold protocol grouped by source recording, our model attains a pooled median localization error of 481.2 km. Auxiliary country and city heads reach 64.5% and 45.2% accuracy, respectively. A permutation Mantel test on the learned latent space provides quantitative support for the Arabic dialect continuum hypothesis. To probe true generalization, we further introduce a city-masking protocol in which two cities per fold are removed from training but retained in validation. Under this zero-shot regime, the mean error rises to 1173.3 km, a 1.32x degradation relative to seen cities. Our findings establish continuous geographic modeling as a principled framework for Arabic dialect geolocation and quantify both its strengths and the substantial headroom that remains.
47. 【2607.19747】Beyond Relevance-Centric Retrieval: Rubric-Oriented Document Set Selection and Ranking
链接：https://arxiv.org/abs/2607.19747
作者：Kailin Jiang,Lei Liu,Jian Xi,Hui Xu,Junlin Liu,Baochen Fu,Shaoqing Ren,Bin Li,Vichwang,Yu Lu,Haibo Shi
类目：Computation and Language (cs.CL)
关键词：large language models, set quality determines, document set quality, large language, language models
备注： Project Page: [this https URL](https://rubric4setwise.github.io/)
点击查看摘要
Abstract:As large language models and AI agents become the primary consumers of search results, document set quality determines the upper bound of downstream generation. Yet existing evaluation systems remain confined to scoring documents independently and aggregating via nDCG, ignoring inter-document interactions (redundancy, conflict, complementarity) and unable to answer what makes one document set better than another. To address these issues, we propose a complete evaluate-diagnose-optimize framework. We design SetwiseEvalKit, a three-level, nine-dimension document set evaluation benchmark covering both short-form and long-form scenarios, comprising approximately 28K high-quality evaluation rubrics. We systematically evaluate 12 rerankers: even the best method achieves no more than 45% coverage, cross-document coordination dimensions are universally weak, and no single method maintains top performance across both settings. Building on this, we propose Rubric4Setwise, a training-free method that converts rubric-based evaluation criteria into document set selection signals, achieving the best downstream generation performance with fewer documents and search rounds. It is the only method that maintains state-of-the-art results across both scenarios, validating the effectiveness of closing the loop from evaluation to optimization.
48. 【2607.19718】Lightweight Person-Place Relation Extraction from Historical Newspapers with Dependency Graphs and Proximity Features
链接：https://arxiv.org/abs/2607.19718
作者：Mlen-Too Wesley
类目：Computation and Language (cs.CL)
关键词：shared task introduces, task introduces person-place, introduces person-place relation, multilingual historical newspapers, person-place relation extraction
备注： 19 pages, 4 figures. Accepted at CLEF 2026 HIPE Shared Task. To appear in CEUR Workshop Proceedings ( [this http URL](http://CEUR-WS.org) )
点击查看摘要
Abstract:The HIPE-2026 shared task introduces person-place relation extraction from multilingual historical newspapers as a new evaluation track, classifying the at and isAt relations between pre-annotated person and location mentions in English, French, and German. Motivated by the cost of processing historical archives at scale, our team (DS@GT HIPE, team 2 in the official results) investigates how far a lightweight, interpretable system can go without any pretrained language model at the relation classification stage. Our approach builds a document-level graph from dependency parses, extracts proximity-based and part-of-speech features for each entity pair, and classifies them with small scikit-learn ensembles or compact Graph Attention Networks, keeping every submitted run under 847K parameters. On the official evaluation (Test A, the newspaper test set), our best run reached a macro recall of 0.5142, ranking 3rd on the Efficiency profile while placing mid-table on Accuracy among the 17 participating teams. Two findings stand out. First, minimum character distance alone captures most of the classification signal; adding further engineered features yields inconsistent gains and sometimes degrades performance, echoing prior evidence that argument distance dominates relation extraction. Second, document-grouped cross-validation is essential on this corpus: pair-level splits inflate scores by 25-37 percentage points because entity mentions recur across documents, a data-leakage effect that grouped cross-validation removes.
49. 【2607.19691】SLPO: Scaling Latent Reasoning via a Surrogate Policy
链接：https://arxiv.org/abs/2607.19691
作者：Runyang You,Zhiyuan Liu,Yongqi Li,Wenjie Li
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Reinforcement learning, eliciting test-time scaling, learning with verifiable, predominant recipe, recipe for eliciting
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards has become the predominant recipe for eliciting test-time scaling in explicit Chain-of-Thought reasoners. Yet this scaling path remains computationally costly, since every intermediate step must be decoded as a language token. Latent reasoning instead carries intermediate computation as continuous vectors and already matches or surpasses explicit CoT at far shorter horizons. Despite this promise, latent reasoners remain largely imitation-bound, while explicit CoT has already moved past imitation via outcome-reward RL. Latent trajectories lack a tractable per-step likelihood and an adaptive stopping interface under fixed thinking budgets, so outcome rewards cannot elicit latent test-time scaling. We introduce Surrogate Latent Policy Optimization (SLPO) to bring outcome-reward RL to autoregressive latent reasoners: an empirical surrogate policy density over latent transitions for trajectory-level credit assignment, and a correctness-supervised stopping head that outcome-reward optimization refines into a variable-horizon policy. Across continuous and soft thinking settings, SLPO improves Pass@$k$ under parallel sampling and allocates longer latent computation to harder instances with higher deterministic accuracy.
50. 【2607.19686】Multi-Mask Diffusion Language Models for Few-Step Generation
链接：https://arxiv.org/abs/2607.19686
作者：Sijin Chen,Yinuo Ren,Heyang Zhao,Ziheng Cheng,Quanquan Gu,Lexing Ying
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：generation remains challenging, achieving high-quality few-step, few-step generation remains, high-quality few-step generation, Masked diffusion models
备注： 38 pages; Accepted at COLM 2026
点击查看摘要
Abstract:Masked diffusion models (MDMs) are a promising family of language generators, but achieving high-quality few-step generation remains challenging. In MDMs, all forward trajectories collapse to a single fully masked state, leaving no terminal entropy for consistency-style few-step generation. While recent few-step alternatives based on uniform-state diffusion avoid this degeneracy, it becomes harder to distinguish clean tokens from noise than MDMs, which usually harms modeling quality and training efficiency. In this work, we propose a multi-mask diffusion model (MultiMDM) that preserves the masking structure towards few-step generation. In the forward process, each clean token is first pushed towards a designated mask and then gradually mixes over the mask set. As a result, the backward process has a drafting capability by predicting a designated mask before refining to a clean token. We derive a closed-form ELBO training objective for MultiMDM that supports continual training from pretrained MDMs. In addition, we formulate a purely discrete-state consistency distillation scheme, with a shared-Gumbel coupling to reduce pathwise entropy. Experiments on pretraining and distillation show that MultiMDM provides an effective foundation for principled few-step generation.
51. 【2607.19678】Reference-Free Evaluation of Reasoning in Open-Ended Question Answering
链接：https://arxiv.org/abs/2607.19678
作者：Guneet Singh Kohli,Yuxiang Zhou,Michael Sejr Schlichtkrull,Gregory E Dean,Maria Liakata
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Natural Language Inference, difficult to verify, high-stakes domains, reasoning, Language Inference
备注：
点击查看摘要
Abstract:AI-generated answers in high-stakes domains are often fluent but difficult to verify, especially when they contain multi-step reasoning rather than a single final answer. We propose a reasoning-based, reference-free framework for auditing LLM-generated outputs. The method decomposes a generated reasoning trace into segments, labels local premise-target relations using Natural Language Inference (NLI), and organizes these relations into a hypergraph. A deterministic backward AND-OR search then assigns segment-level audit labels that indicate how each segment is grounded within the generated response. We evaluate the framework in two settings: deductive mathematical reasoning with Hard2Verify, and open-ended medical reasoning with UroReason, a new physician-annotated benchmark of LLM reasoning traces from real clinical cases. Across these settings, our NLI-hypergraph audit provides a more reliable reference-free evaluation signal than direct LLM-as-judge baselines. In the clinical setting, state-of-the-art LLM judges often fail to identify problematic reasoning segments, over-accepting fluent but weakly grounded responses. Our results show that QA evaluation should account for how inferential relations compose across a reasoning trace, rather than relying only on final answers or LLMs as verifiers. UroReason will be made available through an API, and our code will be released as open source.
52. 【2607.19629】Adaptive Capitulation: A Structural Failure Mode of LLM Responses in Vulnerability Contexts
链接：https://arxiv.org/abs/2607.19629
作者：Eunna Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：Large language models, reinforce maladaptive attribution, emotionally sensitive contexts, sensitive contexts face, vulnerable states request
备注：
点击查看摘要
Abstract:Large language models operating in emotionally sensitive contexts face a structural trilemma: when users in vulnerable states request information that may reinforce maladaptive attribution, current response architectures resolve the tension through protective restriction, uninflected facilitation, or unintegrated co-presence of both imperatives -- each preserving one objective at the cost of the other. Administering a three-turn escalating vulnerability vignette to three commercial LLMs (900 sessions across material, relational, and somatic status-proxy variants) and coding responses with two binary indices (VCC/VCI), we characterize a previously undocumented failure mode we term adaptive capitulation: the model validates the social injustice underlying the user's distress before pivoting to detailed facilitation of the very acquisition it nominally discouraged. We show that the trilemma is structural rather than incidental, and propose Minimal Reattributive Sufficiency (MRS), an architecture-neutral design principle that embeds a single reattributive cue within an otherwise validating response, preserving a pathway toward autonomous reattribution without contesting the user's stated goal.
53. 【2607.19608】ask Competence Is Not Instruction Following: Evaluating Instruction-Conflicting Behavior in Small Language Models
链接：https://arxiv.org/abs/2607.19608
作者：Mahdiyeh Farajidizaji,Vatsal Raina
类目：Computation and Language (cs.CL)
关键词：follow user requests, language models follow, models follow user, make language models, user requests
备注： 12 pages, 4 figures, 8 tables
点击查看摘要
Abstract:Instruction tuning is meant to make language models follow user requests, yet it is unclear whether small models comply when an instruction conflicts with their usual task behavior. We study this across three tasks - multiple-choice question answering (MCQA), sentiment classification, and mathematical question answering - by pairing a standard instruction with a conflicting non-standard one (select an incorrect option, output the opposite sentiment, or return twice the answer). This cross-task design allows us to test whether resistance to conflicting instructions is tied to specific task characteristics or reflects a broader behavioral tendency. As all predictions are scored against the original ground truth, a model that ignores the non-standard instruction still appears accurate. Using standard accuracy, non-standard accuracy, and an Instruction-Following Failure Rate (IFFR), we evaluate instruction-tuned Qwen models across sizes. Both standard accuracy and instruction following generally improve with scale, although the pattern is not consistent across all tasks and datasets. Small models stay competent yet routinely ignore the non-standard instruction, while larger models show a clear gap between the two settings. These findings suggest that gains in task capability do not automatically provide reliable control over model behavior. Task competence and instruction following are therefore distinct abilities, and reporting only standard accuracy hides instruction-following failures.
54. 【2607.19604】Scaling Laws for Hypernetwork-Based Knowledge Injection in Large Language Models
链接：https://arxiv.org/abs/2607.19604
作者：Nischay Dhankhar,Dos Baha,Abulhair Saparov
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Injecting factual knowledge, Injecting factual, open challenge, train-time knowledge injection, knowledge injection
备注： Preprint, 22 pages, 14 figures. Dataset collection available at [this https URL](https://huggingface.co/collections/nace-ai/hypernetwork-datasets)
点击查看摘要
Abstract:Injecting factual knowledge into large language models (LLMs) reliably and at scale remains an open challenge. Hypernetworks provide a promising solution to large-scale knowledge injection. Although hypernetworks are typically applied for test-time adaptation, we explore their use in train-time knowledge injection, where, given a large corpus of facts, we train a hypernetwork to generate a fixed LoRA adapter that, when inserted into the target model, enable the model to answer questions about those facts. In this work, we investigate whether hypernetworks can be used to perform train-time knowledge injection and how this ability varies with scale. The scaling behavior of hypernetworks remains largely unstudied. Our design decouples the hypernetwork's injection capacity from the target model's general capability, enabling, for the first time, a rigorous study of scaling laws for hypernetwork architectures. We characterize how loss, reasoning accuracy, and out-of-distribution (OOD) generalization vary with hypernetwork depth, width, and target network size. We construct a large-scale dataset, called MegaWikiQA, containing tens of millions of multi-hop question-answer examples across 39 domains constructed from examples in Wikidata5M. Our results reveal: (i) hypernetwork-based injection exhibits broadly predictive power law scaling along all architecture axes; and (ii) hypernetworks are capable of reliable OOD generalization at increasing scales, suggesting that hypernetwork provides a promising alternative to other train-time adaptation methods such as LoRA finetuning and full fine-tuning, exhibiting steeper scaling exponents in all OOD evaluations. Together, these results establish hypernetworks as a principled and scalable substrate for train-time adaptation, and provide the first empirically grounded scaling laws to guide hypernetworks for factual reasoning in large language models.
55. 【2607.19595】win Agent: Context Residual Compression for Privilege Separated Agents
链接：https://arxiv.org/abs/2607.19595
作者：Zhanhao Hu,Dennis Jacob,Xiao Huang,Zhaorun Chen,Bo Li,David Wagner
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：Large language model, manipulate downstream reasoning, Large language, Twin Agent, Safe Agent
备注：
点击查看摘要
Abstract:Large language model (LLM) agents are vulnerable to security risks, such as prompt injection attacks from untrusted context that manipulate downstream reasoning and tool use. Existing secure-by-design approaches mitigate this risk by separating untrusted observations from privileged execution and careful control of information flow, but often degrade utility and require extensive task-specific engineering. We thus propose Twin Agent, a general privilege separation design pattern inspired by residual coding in the agent context. Twin Agent consists of two nearly symmetric agents: an Explore Agent that inspects untrusted information and a Safe Agent that executes privileged actions. The Explore Agent is conditioned on the Safe Agent's current context and communicates only compact hints to the Safe Agent about the next action to take. This design reduces the information needed to preserve task utility and thus achieves a better security--utility tradeoff, which we empirically verify by measuring how utility and attack success change as the length of hints varies. We evaluate Twin Agent on long-horizon software engineering tasks with SWE-bench Lite and on heterogeneous multi-tool interaction tasks with AgentDojo and DecodingTrust-Agent. Across both benchmarks, Twin Agent preserves high task utility while preventing prompt injection attacks, outperforming both undefended agents and privilege separation baselines.
56. 【2607.19592】Knowledge-Centric Self-Improvement
链接：https://arxiv.org/abs/2607.19592
作者：Xuefei Julie Wang,Lauren Hyoseo Yoon,Chengrui Qu,Amanda Zichang Wang,Atharva Sehgal,Eric Mazumdar,Yisong Yue
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：systems typically treat, optimizing prompts, typically treat, knowledge, agent
备注：
点击查看摘要
Abstract:Self-improving AI systems typically treat the agent as the object that improves, by optimizing prompts, workflows, harnesses, or even the agent's own code. This agent-centric view can make improvements expensive to maintain and difficult to transfer, because gains become tied to a particular agent design, task distribution, or adaptation run. We study a complementary paradigm: knowledge-centric self-improvement, in which agents remain generic and disposable while the persistent object is a curated knowledge base that agents can leverage for future tasks. We conduct controlled case studies to operationalize this idea via a simple protocol. Agents attempt one task, then contribute evidence-grounded insights to a shared knowledge base via task-level and cross-task forums, followed by knowledge distillation. Because self-improvement is contained in the knowledge rather than the agent, improvement can be more inspectable, transferable, and portable. Across abstract reasoning, coding, and terminal benchmarks, this protocol improves solve rates while reducing dollar cost relative to agent-centric baselines. The resulting distilled knowledge also transfers to held-out tasks and across LLM families, indicating that the improvement is not merely an LLM- or run-specific behavior. These results support a new view of self-improving agentic systems: progress can be driven primarily by the curated persistent knowledge. Code is available at this https URL.
57. 【2607.19573】On the Computational Complexity of Structural Generalization
链接：https://arxiv.org/abs/2607.19573
作者：Zichao Wei
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：mathrm, formally defined, measured repeatedly, Structural generalization, gamma
备注：
点击查看摘要
Abstract:Structural generalization has been measured repeatedly by several benchmarks, yet it has never been formally defined. We give a definition that translates the two premises (compositional structure and unbounded generalization) into mathematical language. The definition itself is neutral: a compiler that hard-codes the rules satisfies it just as well. But structural generalization becomes a scientific question only insofar as the capacity can autonomously emerge from finite data. This question pits the computational lower bound $\mathrm{NC}^1$ against the learnable ceiling $\mathrm{TC}^0$ of pure Transformers. Under a Montagovian instantiation, each compositional rule splits into two projections: a syntactic face ($F_\gamma$) and a semantic face ($G_\gamma$). Tree evaluation on the $G_\gamma$ side is an instantiation of BFVP, which is $\mathrm{NC}^1$-complete (Buss, 1987). A pure Transformer must learn both faces at once, but Kraus et al. (2026) prove that its learnable class $\subseteq \mathrm{TC}^0$. Under the standard assumption $\mathrm{TC}^0 \neq \mathrm{NC}^1$, a pure Transformer cannot learn structural generalization. Neuro-symbolic systems achieve the best benchmark scores precisely because they inject $G_\gamma$, sidestepping the genuinely hard half. Benchmark scores cannot distinguish "learned" from "given." This is what this paper sets out to make clear.
58. 【2607.19523】When Reasoning Narrows the Move: Diversity Collapse in LLM Game Play
链接：https://arxiv.org/abs/2607.19523
作者：Junyi Sha,Renfei Tan,David Simchi-Levi
类目：Computation and Language (cs.CL)
关键词：adapt large language, large language models, Supervised fine-tuning, decision-making remains under-explored, sequential decision-making remains
备注：
点击查看摘要
Abstract:Supervised fine-tuning (SFT) is widely used to adapt large language models to downstream tasks, but its effect on behavioral diversity in sequential decision-making remains under-explored. We study this question in a controlled suite of deterministic board games based on tic-tac-toe variants, where optimal actions are exactly computable and diversity can be measured directly. Across state-level evaluation, arena gameplay, and training trajectories, we find that reasoning-mode generation frequently suppresses action diversity without uniformly improving action accuracy. Furthermore, standard SFT improves accuracy but often induces premature diversity collapse, which exceeds what is minimally required by the accuracy-diversity tradeoff. We then show that action augmentation, which trains on all optimal actions per state rather than a single demonstrated action, would partially mitigates this effect. Our results identify narrow-support imitation as a source of policy collapse in LLM decision-making and suggest that preserving action support during SFT is important for maintaining exploratory behavior.
59. 【2607.19438】BaseRT: Advancing Best-in-Class LLM Inference with Apple M5 Neural Accelerators
链接：https://arxiv.org/abs/2607.19438
作者：Fabian Waschkowski,Prabod Rathnayaka,Lukas Wesemann
类目：Hardware Architecture (cs.AR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Distributed, Parallel, and Cluster Computing (cs.DC); Machine Learning (cs.LG); Performance (cs.PF)
关键词：redesigned GPU architecture, dedicated Neural Accelerator, redesigned GPU, GPU architecture, http URL
备注：
点击查看摘要
Abstract:Apple's M5 generation introduces a redesigned GPU architecture in which every core carries a dedicated Neural Accelerator: on-die matrix units exposed through the Metal~4 tensor API. We show that BaseRT, our native Metal inference runtime for large language models on Apple Silicon, exploits these units to push inference throughput on Apple hardware substantially beyond both this http URL and MLX. Building on BaseRT's framework-free design, we add a family of hand-written Metal~4 tensor-core kernels (including dense and mixture-of-experts GEMM and flash-attention prefill kernels) that route the compute-bound matrix multiplications of inference through the M5 Neural Accelerators while leaving the memory-bound decode path on our existing specialised kernels. On an Apple M5 Pro, across fifteen model configurations spanning the Qwen3, Qwen3.5/3.6, Llama~3.2, and Gemma~4 families from sub-1B to 35B parameters, BaseRT delivers up to $6.4\times$ higher prompt-processing throughput than this http URL and $3.9\times$ higher than MLX, with the largest margins on the mixture-of-experts models where matrix multiplication dominates, while maintaining its lead on decode of up to $1.75\times$ over this http URL and $1.33\times$ over MLX. These results establish a new performance ceiling for on-device LLM inference and show that the M5's tensor cores are the decisive lever for prompt processing on Apple Silicon. BaseRT is publicly available at this https URL.
60. 【2607.19424】JailMeter: An Evidence-Based Evaluation Framework for Jailbreak Attacks on Large Language Models
链接：https://arxiv.org/abs/2607.19424
作者：Qingjia Huang,Jingyu Zhang,Jianguo Wu,Yakai Li,Weijuan Zhang,Yankai Rong,Junyi Yao,Shengzhi Zhang,Xiaoqi Jia
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：attack success rates, inconsistent evaluation criteria, leading to unreliable, success rates, suffers from inconsistent
备注：
点击查看摘要
Abstract:The assessment of jailbreak attacks against large language models currently suffers from inconsistent evaluation criteria and methods, leading to unreliable estimates of attack success rates. We propose JailMeter, an evidence-based evaluation framework designed to more faithfully measure jailbreak effectiveness. Inspired by the Information Bottleneck theory, JailMeter applies dual-feedback optimization to filter jailbreak noise from model responses while preserving content relevant to the original malicious question. This process produces concise evidence for a rigorous assessment under which an attack is validated only when the response captures the malicious intent and delivers a complete answer, thereby signaling a substantive bypass of model safety alignment. We evaluate JailMeter on JailMeter-Eva, a challenging benchmark containing 330 human-labeled, non-rejected jailbreak instances. JailMeter achieves an accuracy of 97.27%, substantially outperforming existing evaluation methods. To support large-scale evaluation, we further distill JailMeter into a small language model, JailMeter\textsubscript{SLM}, which maintains comparable reliability with significantly reduced computational costs. Code and dataset are available at this https URL.
61. 【2607.19398】HyGRL: Adaptive Hybrid Graph Reasoning for Multi-Entity Questions
链接：https://arxiv.org/abs/2607.19398
作者：Junyi Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Multi-entity compositional questions, retrieval-augmented language models, compositional questions pose, questions pose significant, pose significant challenges
备注： 8 pages
点击查看摘要
Abstract:Multi-entity compositional questions pose significant challenges to existing retrieval-augmented language models. Conventional methods fall into a dilemma: standard RAG lacks dynamic reasoning, traditional Graph-RAG is limited by structural sparsity, and LLM-constructed Graph-RAG incurs prohibitive costs. We propose \textbf{\fwa}, a unified framework that embeds unstructured text into structured knowledge graphs, creating a heterogeneous network for flexible evidence retrieval. Reasoning is formulated as adaptive structure induction, learned via a robust two-stage process: (1) imitation learning distills heuristic expert signals, and (2) reinforcement learning refines the policy using LLM-driven preference rewards. Experiments demonstrate that {\fwa} effectively merges textual richness with structural knowledge, outperforming SOTA baselines in answer accuracy and reasoning fidelity while maintaining extremely low token costs and near real-time inference((code available at this https URL) .
62. 【2607.19393】Decodable but Not Detectable: A Leakage Fingerprint for Near-OOD Benchmarks
链接：https://arxiv.org/abs/2607.19393
作者：Vishnu Bindu Balachandran
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：perturbation-based OOD detector, chance level, auditing a perturbation-based, OOD benchmark pairs, perturbation-based OOD
备注：
点击查看摘要
Abstract:While auditing a perturbation-based OOD detector on a document benchmark, we recorded an AUROC of 0.326 -- well below the 0.5 chance level. The cause is a benchmark leak: the designated "OOD" class is one the model was trained on, so its examples sit inside the in-distribution fit set and the detector is penalized for correctly ranking them as familiar. Deleting the class and retraining 35 models across two domains raises the score to 0.911. We distill the contamination into a leak fingerprint -- near-perfect supervised decodability (AUROC approximately 1) coupled with unsupervised detection collapsed below 0.65 -- and validate it on a controlled battery of 52 settings (20 leaked, 32 clean) across ResNet-50 and ViT-B/16 on CIFAR-10/100, achieving sensitivity 18/20 and specificity 31/32 in embedding space; the matched fit-set-exclusion controls are perfect at 20/20. An in-the-wild audit of 24 standard near/far OOD benchmark pairs fires on exactly one (the intrinsically hard CIFAR-100 vs CIFAR-10 pair) and on no far-OOD pair, confirming specificity and that standard cross-dataset construction is clean. Under the corrected protocol, perturbation signals are decodable but not detectable: a supervised reader recovers the OOD signal (AUROC 0.87-1.00) while no unsupervised detector does, and the perturbation method does not improve on plain Mahalanobis distance. We provide a theoretical account of why and, for transparency, retract an earlier circular correlation. The contributions are a corrected protocol and a validated leak diagnostic, not a new OOD method.
63. 【2607.19386】Building Fast, Evaluating Slow: Pipeline Choices Dominate Autointerpretability Score Variance
链接：https://arxiv.org/abs/2607.19386
作者：Sinie van der Ben,Neele Roch,Anna Hedström,Mennatallah El-Assady
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：sparse autoencoder, scores, relies on autointerpretability, Minimum Reporting Checklist, autointerpretability scores
备注：
点击查看摘要
Abstract:Cross-paper comparison of sparse autoencoder (SAE) interpretability often relies on autointerpretability scores. In this evaluation pipeline, a language model (LM) explains each feature, and another LM scores the explanation. For these comparisons to be meaningful, scores must reflect stable properties of the features rather than confounding aspects of the evaluation pipeline. Through systematic experiments across four metrics (simulation, detection, fuzzing, purity), two models (Pythia-160M, Apertus-8B), and four axes of methodological variation, we show that this assumption does not hold. Specifically, we find that R1) methodological variance collectively exceeds architectural variance across all metrics and tested models; R2) each metric exhibits a distinct instability profile, with detection being the most stable and fuzzing unreliable across all conditions; R3) top-k feature rankings do not stay consistent across corpus and draw conditions, masking per-feature instability behind stable mean scores; a failure that cannot be detected by monitoring explanation similarity alone. These findings suggest that cross-paper comparisons based on autointerpretability scores may reflect pipeline differences rather than architectural differences, with implications for the ongoing debate on SAE utility. More broadly, unreliable evaluation slows progress in interpretability research at a time when reliable tools for understanding AI systems are needed. To support evaluation, we contribute a variance decomposition approach, a Stability Check, and a Minimum Reporting Checklist.
64. 【2607.19371】Mitigating Scaffolding Collapse in Socratic Tutors via Representation Alignment
链接：https://arxiv.org/abs/2607.19371
作者：Jing Shao,Qifeng Wu,Hanyu Zhang,Sixia Sun,Jun Zhuang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language model, reveals solutions directly, sustained student pressure, gradually abandons guided, abandons guided inquiry
备注： preprint, under review
点击查看摘要
Abstract:Large language model (LLM)-based Socratic tutors increasingly guide students through multi-turn questioning, but they can suffer from scaffolding collapse: under sustained student pressure, a tutor gradually abandons guided inquiry and reveals solutions directly. Prior defenses primarily constrain observable responses through prompting, preference optimization, or filtering, leaving the internal representation drift that precedes trajectory-level collapse largely unaddressed. We propose Scaffold-Preserving Representation Alignment, a two-stage framework that first warms up a Socratic tutor with supervised fine-tuning, then combines trajectory-weighted direct preference optimization with a margin-preserving representation loss anchored to frozen reference states. Our method is designed to maintain separation between scaffold-preserving and collapse-inducing hidden states across dialogue turns. We evaluate our method across five STEM disciplines and five red-teaming attack strategies. On Qwen3-8B, our method lowers Collapse Rate to 32%, delays average collapse onset beyond nine turns, and keeps over-refusal low, suggesting that representation-level alignment can improve the robustness of long-horizon Socratic tutoring under our red-teaming protocol.
65. 【2607.19368】Spectral-LSH: Sub-Quadratic Prompt Compression via Krylov-Projected Locality-Sensitive Hashing
链接：https://arxiv.org/abs/2607.19368
作者：Ali Mahdavi,Azaseh Zamanifar,Amirfarhad Farhadi,Omid Kashefi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Long-prompt inference remains, Long-prompt inference, prefill attention scales, attention scales quadratically, inference remains expensive
备注：
点击查看摘要
Abstract:Long-prompt inference remains expensive because prefill attention scales quadratically with sequence length. We propose Spectral-LSH, a training-free prompt compression method that operates before the prompt enters the language model. Spectral-LSH approximates the dominant components of an implicit attention-kernel operator using a Krylov subspace method together with random features, avoiding explicit $O(N^2)$ attention-kernel materialization. It then applies SimHash in the resulting attention eigenspace to group similar tokens and aggregate them into macro-tokens with causal positional assignments. We evaluate Mistral-7B-Instruct-v0.3, Qwen2.5-7B-Instruct, and Qwen2.5-14B-Instruct on C4. Our experiments reveal a compression-ratio phase transition. Below $\rho = 4 \times$, local token redundancy is low enough that lightweight chunking typically provides the best latency--quality trade-off. Above $\rho = 8 \times$, the spectral path preserves quality that chunking loses. At $\rho = 16 \times$, Qwen2.5-7B (adaptive) reduces the PPL ratio from 353.409 to 196.963, while Qwen2.5-14B (adaptive) reduces it from 9.533 to 3.427. On a small long-context structured stress test containing JSON-like, code-like, and table-like inputs, local LSH also improves every metric over chunking at $8 \times$. The adaptive backend captures both regimes by using the chunk path at low compression and spectral clustering at high compression, although chunking remains the fastest backend in total latency.
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2607.19368 [cs.AI]
(or
arXiv:2607.19368v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2607.19368
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
66. 【2607.19364】Statistically Grounded Sparse-Feature Interventions for Activation-Space Control in Large Language Models
链接：https://arxiv.org/abs/2607.19364
作者：Oshayer Siddique,J. M Areeb Uzair Alam,Md Jobayer Rahman Rafy,Syed Rifat Raiyan,Hasan Mahmud,Md Kamrul Hasan
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Activation steering offers, single-criterion feature selection, large language models, learned steering objectives, Activation steering
备注： Under review, 22 pages, 5 figures, 16 tables
点击查看摘要
Abstract:Activation steering offers a lightweight alternative to fine-tuning for behavioral control of large language models, but SAE-based steering methods often rely on learned steering objectives or single-criterion feature selection. We introduce a transparent SAE-feature steering pipeline that first applies a six-condition reliability filter, then ranks sparse features through an unweighted Borda consensus over three complementary statistics: $F$-test, KSG mutual information, and Cohen's $d$. The resulting steering direction is constructed as a Cohen's-$d$-weighted combination of SAE decoder rows, providing an optimization-free direction motivated by Fisher-LDA under approximate SAE-feature decorrelation. Across three Gemma-family models, four behavioral domains, and 356 layer-strength configurations, the method produces measurable domain-specific shifts while revealing a substantial gap between raw attribute movement and quality-preserving generation. In the strongest configuration, logical-correctness steering reaches a primary-score delta of $+1.16$ in Gemma~2 9B; however, our broader finding is that usable steering is highly localized by model, domain, layer, and strength. These results argue that activation-steering evaluations should report quality-conditioned success alongside raw behavioral shift. Our code and data are available at this https URL.
67. 【2607.19363】AdaRoPE: Not All Attention Heads Should Rotate and Scale Equally
链接：https://arxiv.org/abs/2607.19363
作者：Shaowen Wang,Yuke Zheng,Tansheng Zhu,Shuang Chen,Shaofan Liu,Suncong Zheng,Jian Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：encode positional information, standard implementations enforce, adopted in Transformers, Transformers to encode, Rotary Position Embedding
备注： Accepted at ICML 2026
点击查看摘要
Abstract:Rotary Position Embedding (RoPE) is widely adopted in Transformers to encode positional information, yet standard implementations enforce a uniform frequency schedule and scaling across all attention heads. Using simplified retrieval tasks and length generalization scenarios, we show -- both empirically and theoretically -- that heads with different functional roles require distinct frequency ranges and attention scaling factors to operate effectively. Ignoring this structure leads to suboptimal utilization of embedding dimensions and degraded performance, particularly under long-context settings. To address these limitations, we propose AdaRoPE, which equips each attention head with learnable rotation frequencies and attention scaling factors. Pretrained LLMs with AdaRoPE consistently outperform existing RoPE variants, including partial RoPE and NoPE baselines. For context extension, we further show that uniform frequency and attention scaling, used in methods such as YaRN, are suboptimal. By applying head-specific scaling, AdaRoPE enables better context extension while better preserving short-context performance in both the extrapolation setting and the long-context continued pretraining setting. These results highlight the importance of optimizing rotary position embedding at the level of individual attention heads.
68. 【2607.19361】Stateful Guardrails for Multi-Turn LLM Systems: A Conversational Risk Accumulation Framework
链接：https://arxiv.org/abs/2607.19361
作者：Sanjay Mishra,Divya Chukkapalli,Ganesh R. Naik
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, benign turns compose, Conversational Risk Accumulation, evaluate each prompt-response, pair in isolation
备注： 45 pages, 10 figures, 20 tables
点击查看摘要
Abstract:Most safety guardrails for large language models (LLMs) evaluate each prompt-response pair in isolation, which misses failures that arise only over a dialogue as benign turns compose into harm. We term this Conversational Risk Accumulation (CRA): gradual intent drift, fragmented assembly of prohibited instructions, and sensitivity build-up from repeated disclosures. We propose a session-layer CRA Framework that tracks three trajectory signals: semantic drift from a session anchor, a sensitivity-weighted information accumulation graph over extracted entities, and a compliance-gradient signal capturing increasing willingness to comply. For scoring, we provide (i) an unsupervised convex fusion for attribution and ablations, and (ii) CRA-Net DA, a compact learned trajectory model trained with family-adversarial objectives to reduce length and topic-coverage confounds. To benchmark CRA, we release CRA-Bench v0.1 (1,200 eight-turn sessions across three threat families with topic-matched benign twins), CRA-Bench v0.2 (LLM-paraphrased variants to reduce template artifacts), and an extended 5-family set (2,000 sessions adding persona priming and context stuffing). We introduce a trajectory-native evaluation protocol with session-level splits, mixed-set threshold calibration, Trajectory AUROC, turns-to-detection, calibrated false-positive metrics, bootstrap confidence intervals, leave-one-family-out diagnostic stress tests, and synthetic-to-human transfer checks. Claims focus on within-distribution session scoring on CRA-Bench and human-transfer subsets.
69. 【2607.19355】Information Discernment in Large Language Models
链接：https://arxiv.org/abs/2607.19355
作者：Joshua Ashkinaze,Laura Kurek,Alina Faisal,Tongyuan Miao,Mariam Joseph,Ceren Budak,Eric Gilbert
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：discernment, truth discernment, source, truth, source discernment
备注：
点击查看摘要
Abstract:LLMs are increasingly used with external knowledge sources like the internet. Do they weigh information appropriately -- updating more for reliable sources (source discernment) and more when claims bring priors closer to the truth (truth discernment)? We formalize this as information discernment and introduce Learn2Discern (L2D), an experimental framework and benchmark grounded in three normative axioms with interpretable metrics. To establish external validity, a pre-registered, quota-matched user study (n=299) confirms that real LLM users endorse all three axioms and report that violations reduce their trust and usage intent. Across 13 models and nearly 670K trials, we find consistent failures across both dimensions: models perform near chance on source and truth discernment, rely on source popularity twice as much as source reliability, and update roughly equally whether a claim improves or worsens their position relative to the ground truth. Models integrate external knowledge most effectively on datasets where their priors are already the most accurate. Newer and larger models improve truth discernment but not source discernment, a blind spot that model complexity does not address. We identify simple inference-time interventions that improve both forms of discernment. We release our dataset and survey as a testbed for a core alignment property that scales in importance as LLMs replace traditional search.
70. 【2607.19415】Auditing Retrieval-Augmented LLM Hypotheses for Longitudinal Cell Painting Morphology
链接：https://arxiv.org/abs/2607.19415
作者：Gilchan Park,Guang Zhao,Byung-Jun Yoon,Shinjae Yoo
类目：Quantitative Methods (q-bio.QM); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：High-content morphological profiling, biology remains difficult, interpretable biology remains, High-content morphological, longitudinal Cell Painting
备注： Accepted for publication at ACM BCB 2026. This is the author's version. The definitive Version of Record is available at [ [this https URL](https://doi.org/10.1145/3807503.3819448) ]( [this https URL](https://doi.org/10.1145/3807503.3819448) )
点击查看摘要
Abstract:High-content morphological profiling (Cell Painting) yields sensitive, high-dimensional signatures of cellular state, but translating longitudinal morphology trajectories into interpretable biology remains difficult, especially for weak, chronic perturbations such as low-dose-rate ionizing radiation. Large language models (LLMs) can synthesize heterogeneous evidence into biological narratives, yet their scientific use requires quantitative auditing. We present an evaluation-first, retrieval-augmented interpretation framework for longitudinal Cell Painting morphology, applied to a 9-week RPE-1 time course across five dose rates (0.003--6.0 mGy/hr). Week-matched treated-control morphology deltas are combined with retrieved perturbation neighbors, pathway context, and literature evidence through stable evidence identifiers, enabling an LLM to generate structured, evidence-linked hypotheses that are hierarchically summarized while preserving provenance. We introduce two quantitative auditing tests: V1 citation validity, which verifies that cited evidence identifiers exist in the prompt, and V2 proxy-based morphology compatibility, which evaluates consistency between predicted biological processes and the most altered morphology features. In our experiments, V1 detected no invalid evidence references, while V2 showed meaningful morphology compatibility that increased with perturbation strength and was positively associated with an independent morphology drift summary. The framework produces auditable, falsifiable biological hypotheses, including an adaptive phenotype involving metabolic reprogramming and proteostatic stress at lower dose rates (0.003--0.3 mGy/hr). Current limitations include proxy-based evaluation and the lack of ground-truth mechanism labels.
信息检索
1. 【2607.20393】Near-Optimal Dimension Lower Bounds for Single-Vector Embeddings of Maximum Inner Product Similarity
链接：https://arxiv.org/abs/2607.20393
作者：Rajesh Jayaram,Honghao Lin,Vahab Mirrokni,David P. Woodruff
类目：Data Structures and Algorithms (cs.DS); Information Retrieval (cs.IR)
关键词：Multi-vector embeddings represent, embeddings represent items, Multi-vector embeddings, varepsilon, embeddings represent
备注：
点击查看摘要
Abstract:Multi-vector embeddings represent items by point clouds and compare query and document point clouds using Chamfer similarity, whereas single-vector embeddings use ordinary inner products. For singleton queries, Chamfer becomes maximum inner product similarity (MAX-IP). In our setting, MUVERA gives dimension $m^{O(1/\varepsilon^2)}$~\cite{dhulipala2024muvera}, whereas the previous lower bound $(\varepsilon^2m)^{\Omega(1/\varepsilon)}$~\cite{jayaram2026expressive} left a gap between $1/\varepsilon$ and $1/\varepsilon^2$ in the exponent of $m$. We nearly close this gap. For every fixed $\delta\in(0,1)$, there are constants $A_\delta,c_\delta0$ such that, for all sufficiently small $\varepsilon0$ and every $m\ge(1/\varepsilon)^{A_\delta}$, there exist unit query vectors and document point clouds of at most $m$ unit vectors for which every single-vector approximation of all pairwise MAX-IP values to additive error $\varepsilon$ has dimension \[ D \ge m^{c_\delta/\varepsilon^{2-2\delta}}. \] This holds even for fully data-dependent representations chosen after seeing the dataset. It also applies to Chamfer because all queries are singletons. Since $\delta$ can be arbitrarily small, the exponent approaches the $O(1/\varepsilon^2)$ dependence of the upper bound. The proof combines Sherstov's pattern matrix method with polynomial-size, constant-width DNF formulas computing functions of approximate degree $\Omega(k^{1-\delta})$. Uniform-width padding and a block encoding create an $\Omega(\varepsilon)$ gap. A dummy coordinate then equalizes all false inputs, yielding a unit-sphere MAX-IP matrix that is an exact two-valued affine image of the DNF pattern matrix with gap at least $8\varepsilon$. This allows the approximate-rank bound to apply.
Subjects:
Data Structures and Algorithms (cs.DS); Information Retrieval (cs.IR)
Cite as:
arXiv:2607.20393 [cs.DS]
(or
arXiv:2607.20393v1 [cs.DS] for this version)
https://doi.org/10.48550/arXiv.2607.20393
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
2. 【2607.20101】wo-Step Occupation Coding
链接：https://arxiv.org/abs/2607.20101
作者：Alexander M. Esser,Jens Dörpinghaus
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：labor market research, links job titles, market research, labor market, coding links job
备注： Preprint of the paper accepted for the Federated Conference on Computer Science and Information Systems (FedCSIS 2026)
点击查看摘要
Abstract:Occupation coding links job titles in free text to occupational taxonomies and is a core task in labor market research. Existing approaches typically address this problem in a single end-to-end step, jointly identifying job titles and assigning occupational codes. This paper presents a novel two-step approach that separates these tasks. In the first step, a domain-specific Named Entity Recognition (NER) model identifies occupational titles in continuous text, even under noise such as OCR errors. In the second step, the extracted job titles are mapped to a taxonomy, enabling the classifier to focus exclusively on this mapping. We demonstrate that this separation improves accuracy, robustness, and interpretability compared to single-step approaches. The method has been developed for German documents but is transferable to other languages. We further introduce a margin-based confidence criterion for occupation coding, replacing common absolute thresholds. To support reproducibility, we publish the source code and evaluation scripts.
3. 【2607.19987】UniRank: Benchmarking Ranking Models for Unified Sequential Modeling and Feature Interaction
链接：https://arxiv.org/abs/2607.19987
作者：Honghao Li,Xianquan Wang,Zibin Zhang,Yi Zhang,Kangyi Lin,Yiwen Zhang
类目：Information Retrieval (cs.IR)
关键词：ranking models, unify sequential modeling, recommender systems, unified ranking models, core stage
备注： 11 pages, 6 figures, and 7 tables. Code and data: [this https URL](https://github.com/salmon1802/UniRank)
点击查看摘要
Abstract:Ranking is a core stage in online advertising and recommender systems. Modern ranking models increasingly unify sequential modeling and feature interaction, yet many advances rely on proprietary data, closed implementations, and large-scale industrial infrastructure. This setting limits reproducible comparison and hinders academic study of scaling laws, long-sequence modeling, and multi-task ranking. To address these limitations, this paper proposes UniRank, an open benchmark for ranking models that unify sequential modeling and feature interaction. UniRank uses chronological pointwise autoregressive supervision, standardizes evaluation across feedback tasks, and provides a PyTorch toolkit with Distributed Data Parallel training, operator optimization, mixed-precision training, attention optimization, and other efficiency techniques that reduce hardware requirements. We benchmark 15 representative unified ranking models on five large-scale public datasets from short-video, advertising, and e-commerce platforms, with the largest dataset containing over 700 million instances and the longest behavior sequence exceeding 10^5 interactions. UniRank provides a reproducible basis for comparing unified ranking models, studying scaling laws under limited compute, and narrowing the gap between academic and industrial ranking research. We believe UniRank benefits researchers, practitioners, and beginners through reproducible experiments, production-oriented evaluation, and accessible implementations. Code and data are available at this https URL.
4. 【2607.19836】Using Hierarchical Controlled Vocabularies to Understand CLIP Retrieval Failures in Historical Photo Collections
链接：https://arxiv.org/abs/2607.19836
作者：Ratan Sebastian,Anett Hoppe,Christoph Rippe,Ralph Ewerth
类目：Information Retrieval (cs.IR); Digital Libraries (cs.DL)
关键词：Architecture Thesaurus, Art and Architecture, organise image access, GLAM institutions, access using controlled
备注：
点击查看摘要
Abstract:GLAM institutions (Galleries, Libraries, Archives, and Museums) organise image access using controlled vocabularies such as the Art and Architecture Thesaurus (AAT). For content-based image retrieval in these settings, vision-language models like CLIP are increasingly used, but their performance varies. This variation is known to relate to measures like concept abstraction and concept frequency. However, no prior work explains this variation in terms of the structural properties of vocabularies like the AAT that GLAM professionals already use. The AAT groups concepts into broad facets (Objects, Activities, Agents, etc.) and arranges terms hierarchically within them. In this paper, we ask whether two structural properties (root facet type and hierarchy depth) explain where CLIP retrieval succeeds and fails, and where fine-tuning helps. Across three historical photographic collections annotated with AAT terms, we examine visual coherence (whether a term's photographs cluster in CLIP's embedding space), text-image alignment (whether its label is near that cluster), and standard retrieval measures, which conflate the two. We find that visual coherence and text-image alignment are nearly uncorrelated across terms and jointly separate distinct failure modes. Terms whose photographs cluster tightly but whose label is distant from the cluster retrieve poorly in every collection, in two of three collections even worse than terms that fail on both metrics. We also show that while retrieval metrics do not correlate significantly with either structural property, root facet type does significantly separate categories with varying visual coherence. Finally, we find that fine-tuning improves retrieval overall, but its gains favour shallower terms in the hierarchy, where text-image alignment improves most, beyond what concept frequency explains.
5. 【2607.19802】Zero-Observation User Reactivation with Gap-Driven Dimensional Gating
链接：https://arxiv.org/abs/2607.19802
作者：Jiandong Ding,Tianying Liu,Fuyuan Liu,Huijie Qin,Tiandeng Wu
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：models capture continuously, continuously observed behavior, capture continuously observed, Sequential recommendation, models capture
备注： Accepted at the 20th ACM Conference on Recommender Systems (RecSys 2026)
点击查看摘要
Abstract:Sequential recommendation (SR) models capture continuously observed behavior, but a returning user may have no interactions for months or years. We define this setting as Zero-Observation Reactivation: the user has a pre-gap history, while the platform observes no behavioral signals during a macro-gap Delta t. Under a chronologically aligned Gap-Synthesize Protocol on three Amazon datasets (Video Games, CDs Vinyl, and Movies TV), Hit@10 decreases monotonically across the evaluated gap buckets and reaches its lowest level beyond one year. The pattern appears across recurrent, unidirectional, and bidirectional SR backbones. We propose DeltaGate, a lightweight output-layer plugin that keeps the backbone frozen and routes each representation dimension between the personalized history and a learned, zero-initialized global prior. The gate is conditioned jointly on Delta t and the personalized representation. In a controlled diagnostic, we hold the personalized representation fixed and vary Delta t to isolate the trained gate's response to the gap input. In the 365d Video Games bucket, DG-SASRec reaches 0.047 Hit@10 versus 0.031 for SASRec, while DG-BERT4Rec reaches 0.046 versus 0.025 for BERT4Rec, with 66K trainable parameters (2--4% overhead). End-to-end retraining attains higher absolute accuracy but changes the backbone embeddings; the frozen plugin preserves zero backbone drift, uses about 40x fewer trainable parameters, and retains observable dimension-wise routing. The source code is available at this https URL.
Comments:
Accepted at the 20th ACM Conference on Recommender Systems (RecSys 2026)
Subjects:
Information Retrieval (cs.IR); Machine Learning (cs.LG)
Cite as:
arXiv:2607.19802 [cs.IR]
(or
arXiv:2607.19802v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2607.19802
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Related DOI:
https://doi.org/10.1145/3773078.3831771
Focus to learn more
DOI(s) linking to related resources</p>
6. 【2607.19801】CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search
链接：https://arxiv.org/abs/2607.19801
作者：Nolwenn Bernard,Jüri Keller,Philipp Schaer
类目：Information Retrieval (cs.IR)
关键词：Cologne Information Retrieval, Information Retrieval group, Cologne Information, iKAT SCAI, shared task
备注：
点击查看摘要
Abstract:This paper presents the participation of the Cologne Information Retrieval group in the iKAT SCAI 2026 shared task. We use an agentic conversational search system, equipped with tools for query rewriting, retrieval and reranking, answer generation, and clarification need prediction and clarification question generation. We experiment with two different neural clarification need prediction models.
7. 【2607.19739】Personalized Recommendation Tool Learning via Autonomous Language Agents
链接：https://arxiv.org/abs/2607.19739
作者：Mingdai Yang,Zhiwei Liu,Weizhi Zhang,Yibo Wang,Hao Peng,Philip Yu
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：recently gained traction, recommender systems due, strong reasoning capabilities, extensive world knowledge, large language models
备注： 6 pages. Accepted by RecSys'26
点击查看摘要
Abstract:Although large language models (LLMs) have recently gained traction in recommender systems due to their strong reasoning capabilities and extensive world knowledge, previous LLM-based agents suffer from hallucination and context-length limitations, and thus are not suitable for full-ranking recommendation tasks. To circumvent these limitations through architectural design rather than modifying the LLM itself, we propose an agent-based recommendation framework, memory-based $\textbf{P}$ersonalized $\textbf{R}$ecommendation $\textbf{T}$ool learning via autonomous language $\textbf{A}$gents (PRTA), in which an LLM acts as a central planner interacting with multiple recommendation models as tools. The LLM-based agent is responsible for high-level reasoning and personalized tool selection, while traditional recommendation models perform full-ranking scoring, leveraging their scalability in modeling behavioral patterns. To support personalized tool selection, we design reflection mechanisms that enable the agent to evaluate and compare tools for each user based on user profiles and candidate ranked lists. Extensive experiments across three public datasets demonstrate the superiority of \modelname over traditional recommendation and LLM-based baselines in improving full-ranking recommendation performance.
8. 【2607.19362】GraphContainer: A Unified Platform for Comparing and Debugging Graph RAG Methods
链接：https://arxiv.org/abs/2607.19362
作者：Seonho An,Chaejeong Hyun,Min-Soo Kim
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：multi-hop question answering, RAG mitigates hallucinations, Graph RAG mitigates, Graph RAG, knowledge in LLMs
备注： VLDB 2026 demo accepted
点击查看摘要
Abstract:Graph RAG mitigates hallucinations and stale knowledge in LLMs, particularly for multi-hop question answering. However, existing approaches remain highly fragmented and incompatible. The structural heterogeneity of graph formats across different frameworks and the lack of granular visualization tools make it exceedingly difficult to evaluate and compare retrieval behaviors. To bridge this gap, we propose GraphContainer, a novel platform designed to unify and visualize diverse graph RAG workflows. GraphContainer features two key components: (1) a Unified Graph Representation (UGR) layer that seamlessly standardizes multi-format graphs, and (2) a Graph Recorder that tracks and visually renders the step-by-step retrieval process. Through an interactive web interface, we demonstrate GraphContainer's ability to import heterogeneous graphs and perform live, traceable visual debugging of graph RAG methods. Ultimately, we show how GraphContainer enables controlled comparisons of various graph formats and retrieval strategies, lowering the barrier for researchers and practitioners to design optimal graph RAG pipelines. A demonstration video is available at this https URL.
计算机视觉
1. 【2607.20417】ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansion
链接：https://arxiv.org/abs/2607.20417
作者：Cho In,Jeonghwan Cho,Mijin Yoo,Gim Hee Lee,Seon Joo Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, high-quality novel-view synthesis, novel-view synthesis, synthesis by optimizing, optimizing freely
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) achieves high-quality novel-view synthesis by optimizing freely placed primitives in 3D and adaptively densifying them in under-reconstructed regions. However, this scene-adaptive capacity allocation is largely lost in existing feed-forward 3DGS methods, which commonly regress Gaussians at input pixels and lift them along camera rays. Such pixel-aligned formulations make the number and placement of primitives depend on image resolution and input viewpoints rather than scene complexity, resulting in dense and often redundant Gaussian sets. We present ATSplat, a feed-forward 3DGS framework that restores the adaptive allocation capability of 3DGS optimization through Adaptive 3D Tokens. ATSplat first lifts coarse patch-level depth and camera cues into sparse 3D anchor tokens, forming a compact scaffold of the scene. Each token is then regressed into local Gaussians with learnable 3D offsets, decoupling primitive placement from input image grids. An Adaptive Token Expansion module predicts a token-level uncertainty score, supervised by rendering error maps, and selectively expands high-uncertainty tokens through learnable expansion layers. This sparse-to-adaptive formulation enables ATSplat to concentrate primitives in challenging regions while maintaining a compact representation. Experiments on two representative datasets, RealEstate10K and DL3DV, show that ATSplat achieves state-of-the-art rendering quality while reducing the number of Gaussians by more than $5.7\times$ compared with dense feed-forward 3DGS methods. From 12 input images at $512 \times 960$ resolution, ATSplat completes reconstruction in less than a second using a single commercial GPU, and renders high-quality novel views at 1136 FPS ($512 \times 960$) with only 311K Gaussians.
2. 【2607.20389】PercepCap: Video Captioner with Structured Spatio-Temporal Perception
链接：https://arxiv.org/abs/2607.20389
作者：Yifan Xu,Zihao Wang,Zhixiao Wang,Jiaming Zhang,Yichun Yang,Desen Meng,Yuanxing Zhang,Pengfei Wan,Limin Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：requires fine-grained spatio-temporal, fine-grained spatio-temporal understanding, including spatial perception, captioning requires fine-grained, final caption
备注：
点击查看摘要
Abstract:Video captioning requires fine-grained spatio-temporal understanding of videos, including spatial perception of where objects are located and temporal perception of when events occur. Existing MLLMs usually generate captions directly from video inputs without exposing the perceptual evidence behind descriptions. As a result, mistakes in spatiotemporal perception are only observed in the final caption, making it difficult to identify the underlying perceptual errors directly. To address these issues, we present PercepCap, a perception-aware video captioning framework that makes perceptual evidence explicit before producing the final caption. Specifically, PercepCap follows a perceive-describe generation chain, where the model first produces a spatiotemporal perception trace comprising object trajectories and temporal events, and then generates the final caption conditioned on the perceived evidence. To support this, we design a two-stage training strategy. Perceive-then-Describe Supervised Fine-tuning adapts the model from caption-only generation to the proposed perceive-describe chain, while Perception-Grounded Reinforcement Learning optimizes perception trace and caption quality with joint rewards over perception chain and the final caption. To support our two-stage training, we introduce Caption-Anchored Perception Data Construction. This pipeline builds the SFT and RL training data by first generating a caption-only description, extracting the objects and events it mentions, and grounding them back in the video with boxes and timestamps. This yields caption-aligned perception data that provides solid training ground truth, ensuring that the explicit perception trace and final caption refer to the same objects and events. Across direct caption and caption-to-QA evaluation, PercepCap consistently improves upon the Qwen3-VL baseline and demonstrates leading caption quality.
3. 【2607.20385】Persian Pixel: A large-scale synthetic OCR dataset for Persian language
链接：https://arxiv.org/abs/2607.20385
作者：Pouria Mahdi,Haq Nawaz Malik
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Optical Character Recognition, Persian remains substantially, Latin-script languages, Persian, Optical Character
备注：
点击查看摘要
Abstract:Optical Character Recognition (OCR) for Persian remains substantially less mature than for Latin-script languages despite Persian being spoken by more than 110 million people across multiple countries. This gap arises from two fundamental challenges: the intrinsic complexity of the Perso-Arabic writing system and the limited availability of large-scale, high-quality annotated datasets. Persian script exhibits obligatory cursive connectivity, context-dependent glyph shaping, extensive ligatures, diacritic placement, and stylistic variation across writing forms such as Naskh and Nastaliq, all of which significantly complicate text recognition. At the same time, the high cost and labor-intensive nature of manual annotation have created a persistent data bottleneck, limiting the development of robust OCR systems and slowing progress in Persian document this http URL this paper, we introduce Persian Pixel, a comprehensive synthetic OCR dataset specifically designed to address these challenges. Comprising over 343,000 high-fidelity image text pairs, the dataset spans sentence, paragraph, and full-page document layouts generated from a carefully curated seven-million-word Persian corpus using the SynthOCR-Gen rendering framework. The generation pipeline faithfully models the typographic characteristics of Persian script, including contextual character joining, positional glyph variants, diacritic placement, and multiple representative Persian typefaces. To bridge the synthetic-to-real domain gap, the rendered images are further enriched with more than twenty-five stochastic degradation models that emulate realistic document acquisition artifacts, including ink bleed, paper aging, blur, illumination variation, scanner imperfections, compression artifacts, and multiple noise this http URL overcoming the long-standing scarcity of annotated Persian OCR data, Persian Pixel provides a scalable and openly available resource for training and fine-tuning modern OCR architectures, including transformer-based models such as TrOCR and Donut. The dataset establishes a strong foundation for research in Persian document analysis, historical manuscript digitization, and end-to-end document understanding, while demonstrating that programmatic synthetic data generation offers a practical, cost-effective, and scalable alternative to manual annotation for advancing OCR in low-resource and typographically complex scripts.
4. 【2607.20368】Self Gradient Forcing: Native Long Video Extrapolation
链接：https://arxiv.org/abs/2607.20368
作者：Junhao Zhuang,Shiyi Zhang,Yuxuan Bian,Yaowei Li,Yawen Luo,Yijun Liu,Weiyang Jin,Songchun Zhang,Xianglong He,Xuying Zhang,Haoran Li,Haoyang Huang,Zeyue Xue,Nan Duan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent autoregressive video, video diffusion methods, Recent autoregressive, diffusion methods, methods are increasingly
备注： Project page: [this https URL](https://zhuang2002.github.io/SelfGradientForcing/)
点击查看摘要
Abstract:Recent autoregressive video diffusion methods are increasingly built upon Self Forcing, where the student is trained on histories produced by its own rollout rather than ground-truth video contexts. This reduces exposure bias, but the historical key-value cache is still used by future frames only as frozen rollout state. As a result, future losses cannot supervise how earlier generated latents should be written into more useful keys and values for later video-latent generation. We call this the historical context-gradient gap. We propose Self Gradient Forcing (SGF), a two-pass training strategy that restores this missing supervision signal without backpropagating through the full serial rollout. Pass 1 performs a no-gradient autoregressive rollout matching inference and, at a sampled denoising exit step, records both the self-generated context and the noisy latents fed to the model. Pass 2 performs parallel context-gradient reconstruction for the recorded exit step. The generated context is used as stop-gradient clean-latent input, while the model recomputes the context KV representations and future-to-context causal attention. Thus, SGF provides the missing memory-writing supervision within the native autoregressive training objective, using losses on future video latents to train the model to encode context into more effective causal memory. Across extensive long-horizon frame-wise and chunk-wise experiments under different initializations, SGF achieves stronger native long-video extrapolation than Self Forcing, especially in subject identity, background/layout consistency, and temporal stability. Remarkably, using only a 5-second training window, SGF can extrapolate to videos lasting several minutes. Code and models will be released to advance research on autoregressive video generation.
5. 【2607.20357】Look Less, Think Faster: Joint Token-Compute Adaptation for Multimodal LLMs
链接：https://arxiv.org/abs/2607.20357
作者：Pengcheng Wang,Zhiquan Wang,Jayoung Lee,Zhuoyan Xu,Ran Xu,Saurabh Bagchi,Yin Li,Somali Chaterji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, large language model, recently demonstrated strong, demonstrated strong performance
备注： Accepted at ECCV 2026
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) have recently demonstrated strong performance across vision-language tasks. However, their high inference cost, arising from both the large number of input visual tokens and the heavy computation of the large language model (LLM), remains a key barrier to practical deployment. Recent work attempts to reduce the cost by adaptively optimizing individual dimensions, e.g., pruning redundant visual tokens or skipping LLM layers and heads. Nonetheless, prior approaches typically treat these dimensions independently and overlook a fundamental coupling: the available compute resources must be dynamically allocated across all dimensions based on the input content. To bridge the gap, we propose SmartVL, a unified adaptive inference framework that jointly controls vision token number and model compute capability in response to varying input contents and compute budgets. SmartVL introduces a vision-side token controller that dynamically selects informative visual tokens and an LLM-side compute controller that adaptively adjusts LLM computation. Importantly, these controllers are trained to coordinate with each other so that the overall inference cost satisfies a target budget. To allow this joint scheduling, we connect the controllers using a shared budget encoding and leverage a differentiable latency estimator for end-to-end training. This design enables SmartVL to learn cross-stage allocation strategies that adapt to both input complexity and runtime compute constraints. Experiments across multiple MLLM benchmarks demonstrate that, with joint scheduling, SmartVL consistently outperforms prior adaptive methods and achieves superior accuracy-efficiency Pareto frontiers. Project page: this https URL.
6. 【2607.20351】st-Time Training for Modality Order Consistency in Vision-Language Models
链接：https://arxiv.org/abs/2607.20351
作者：Aditi Gupta,Yossi Gandelsman
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：semantically irrelevant change, specific semantically irrelevant, irrelevant change, question are presented, specific semantically
备注： 16 pages, 7 figures, preprint
点击查看摘要
Abstract:We find that vision-language models are sensitive to a specific semantically irrelevant change: the order in which the image and question are presented. Across three models and three benchmarks, image first prompting consistently outperforms question-first prompting, revealing a repeatable modality order failure. We use this gap to design an order-consistent test-time training method. Our method substantially closes the modality-order gap across all evaluated settings. Surprisingly, it also yields consistent improvements in the stronger image-first branch over the baseline, hence bootstrapping both orderings toward mutual consistency. Activation patching localizes the ordering failure to a narrow mid-network region where representations diverge sharply between prompt orders. We find that the test-time training method repairs this misalignment across layers. Together, our results identify modality-order sensitivity as a circuit-level failure in VLMs and demonstrate that simple, asymmetric test-time adaptation can effectively mitigate it and even improve performance over the baseline.
7. 【2607.20326】oward Reliable RGB-D Semantic Segmentation: Handling Missing Modalities via Condition Dropout
链接：https://arxiv.org/abs/2607.20326
作者：Xuchen Zhu,Yajuan Wei,Shuang Hao,Jiwei Jiang,Guanxiang Mao,Fang Ren
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：achieved remarkable progress, RGB-D semantic segmentation, remarkable progress, semantic segmentation, segmentation has achieved
备注：
点击查看摘要
Abstract:RGB-D semantic segmentation has achieved remarkable progress, yet most models assume that RGB and depth are always available. In practice, failures or occlusions of surveillance sensors often remove one modality. Although RGB or depth alone can contain sufficient cues, models trained only on full-modality inputs fail to exploit the remaining modality once one is missing, causing severe degradation. We tackle this issue with a simple continued-training paradigm, \emph{Condition Dropout (ConD)}, which mitigates degradation while preserving full-modality accuracy. Starting from a pretrained RGB-D model, ConD adds a second stage that randomly simulates complete, RGB-missing, and depth-missing inputs, freezes the original encoders, and trains copied encoders with zero-initialized feature injection. Experiments on NYU-Depth V2 and SUN RGB-D show that ConD improves robustness under missing modalities and even yields slight gains when modalities are complete. Our code will be made publicly available upon acceptance.
8. 【2607.20293】Evolving Cache Schedules for Fast Diffusion Policy Inference
链接：https://arxiv.org/abs/2607.20293
作者：Siying Wang,Kangye Ji,Di Wang,Fei Cheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：deployment computationally demanding, achieve strong visuomotor, strong visuomotor control, real-time deployment computationally, denoising action chunks
备注： 15 pages, 3 figures, supplementary material included. Accepted by PRCV 2026
点击查看摘要
Abstract:Diffusion policies achieve strong visuomotor control by iteratively denoising action chunks, but repeated denoising makes real-time deployment computationally demanding. Cache-based methods reduce inference cost by reusing intermediate activations, but existing training-free schedules typically allocate computation uniformly across blocks, ignoring heterogeneous redundancy across blocks and leading to a suboptimal performance-efficiency trade-off. To bridge this gap, we introduce Evolving Cache Schedules (EVO), a training-free acceleration framework that globally schedules cache refreshes via evolutionary search. EVO represents each candidate as a complete schedule over the block-timestep lattice. Thus, redundant transformer computations during iterative denoising can be skipped through cache reuse while preserving closed-loop rollout performance. To make the search practical, EVO introduces redundancy-aware initialization, which seeds the population with promising schedules, and target-conditioned early stopping, which verifies and terminates once a desired performance target is reached. The offline-optimized schedule can be directly plugged into pretrained diffusion policies without retraining. Extensive manipulation benchmarks show that EVO preserves near-full performance while substantially reducing computation, achieving up to 8.05x action-generation speedup and reducing FLOPs from 15.77G to as low as 1.96G. Source code is available at this https URL.
9. 【2607.20291】Diverse-Intent Multi-Turn Fashion Image Retrieval
链接：https://arxiv.org/abs/2607.20291
作者：Mingqiang Tang,Haokun Wen,Meng Liu,Yupeng Hu,Weili Guan,Xuemeng Song
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Real-world fashion search, search involves interactive, fashion search involves, Real-world fashion, involves interactive retrieval
备注：
点击查看摘要
Abstract:Real-world fashion search involves interactive retrieval across multiple turns. However, existing multi-turn retrieval methods are built on a restrictive assumption that every interaction follows the same attribute-editing paradigm, leaving heterogeneous intent transitions unexplored. Moreover, existing approaches often rely on textification to bridge multimodal queries and visual retrieval, which may lose fine-grained visual cues. To address these gaps, we introduce DIM-Fashion, a benchmark of 26K multi-turn sessions constructed from 13 fashion retrieval datasets across 7 tasks, featuring diverse intent transitions and rollback behaviors. We further propose FashionAM, an MLLM-VLP framework that directly aligns multimodal conversational queries with a fashion-oriented gallery embedding space, avoiding intermediate textification. Extensive experiments demonstrate the effectiveness of FashionAM over existing approaches. The dataset and code will be made publicly available upon acceptance.
10. 【2607.20284】Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
链接：https://arxiv.org/abs/2607.20284
作者：Qiwei Ma,Chunping Qiu,Xinjun Cheng,Xiaoyu Zhang,Puhong Duan,Ke Yang,Xudong Kang,Shutao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enabling natural-language interaction, image scene understanding, sensing image scene, multimodal large language, large language models
备注： 27 pages, 11 figures
点击查看摘要
Abstract:The rapid development of multimodal large language models (MLLMs) has introduced a flexible paradigm for remote sensing image scene understanding (RSISU), enabling natural-language interaction with remote sensing imagery. However, a systematic understanding of the capability boundaries, cross-task generalization, and task-specific limitations of existing remote sensing MLLMs (RS-MLLMs) is still lacking. This paper presents a systematic survey and diagnostic evaluation of MLLMs for RSISU. We review the technical evolution of RS-MLLMs, focusing on model design, multimodal learning, training data, and downstream capabilities. We further compare RS-MLLMs with general-purpose computer vision MLLMs (CV-MLLMs) across diverse RSISU tasks and benchmarks. RS-MLLMs remain competitive in domain-specific settings, particularly remote sensing visual grounding and high-resolution visual question answering. More notably, general-purpose CV-MLLMs can match or even outperform these specialized models on several RSISU tasks without remote sensing-specific fine-tuning. These findings demonstrate the strong transferability of general-purpose CV-MLLMs and show that current RS-MLLMs do not consistently outperform them across diverse RSISU tasks. Current MLLMs also face limitations in spatial and relational reasoning, fine-grained visual understanding, instruction diversity, and generalization across heterogeneous task formats. Based on these findings, we outline future directions toward reliable evaluation, multimodal and high-resolution reasoning, efficient deployment, and tool-augmented remote sensing agents. This survey provides a systematic reference for developing robust, generalizable, and practical MLLMs for RSISU.
11. 【2607.20274】Self-supervision drives representational convergence in medical foundation models more than clinical supervision
链接：https://arxiv.org/abs/2607.20274
作者：Soroosh Tayebi Arasteh,Sebastian Ziegelmayer,Mahshad Lotfinia,Lisa Adams,Sven Nebelung,Jakob Nikolas Kather,Daniel Truhn
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：treated as interchangeable, groups are increasingly, increasingly treated, concentrate their representations, clinical supervision concentrate
备注：
点击查看摘要
Abstract:Medical image encoders from different groups are increasingly treated as interchangeable, on the assumption that scale and clinical supervision concentrate their representations onto a shared structure. Whether this convergence is real, what produces it, and whether it is clinically usable are untested, and the similarity measures behind such claims are fragile. We present a controlled dissection across 18 image and 7 text encoders, all open-weight and run locally, spanning 7M to 27B parameters and five imaging modalities, including 650,982 chest radiographs from six datasets. To isolate cause, we train encoders that vary only the objective under fixed data, architecture, and scale, and reproduce the effect in a synthetic model. Convergence is modest but above a random floor, driven by the self-supervised objective, not clinical supervision: matched self-supervised encoders aligned most (40.4% on chest radiography), with label-supervised (21.1%) and image-text (3.3%) far lower, and did not grow with size (Spearman 0.302, p=0.223) or capability. It is within-modality, does not reach clinical language, and does not reproduce how radiologists judge case similarity. Yet a linear classifier transfers across encoders and to five held-out hospitals, retaining about 85% of within-encoder performance. Convergence in medical imaging is therefore set by the pretraining objective, not inherited from scale or clinical supervision. Interoperability is accordingly something to design for through that objective, and to validate where the shared geometry is weakest, across patient subgroups and against clinical judgment.
12. 【2607.20263】How Does Urban Context Relate to Residential Building Health? A Vision-POI Fusion Framework for Building-Level Housing Inspection
链接：https://arxiv.org/abs/2607.20263
作者：Kun Zhao,Helei Ren,Guilin Tang,Tianyi Chen,Zhehui Song,Xing Liu,Lijian Zhou,Yuhong Zhao,Xiang Gao,Jinming Jiang,Qichao Ban
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Housing-level urban physical, targeted urban renewal, urban physical examination, supporting targeted urban, Housing-level urban
备注：
点击查看摘要
Abstract:Housing-level urban physical examination is essential for identifying residential building problems and supporting targeted urban renewal. Existing automated inspection studies primarily rely on individual images and rarely examine whether surrounding urban functional context can provide supplementary information for building-level assessment. This study proposes a vision-POI fusion framework that combines multi-view visual inspection with POI-derived neighborhood context for residential building health assessment. The empirical dataset covers 92 old residential communities, 3,237 residential buildings, and 25,608 field-acquired inspection images in Qingdao, China, encompassing seven categories of housing-related issues. First, multiple object detection models are evaluated to extract issue locations, categories, and confidence scores from individual images. The image-level outputs are subsequently aggregated across multiple views to construct interpretable building-level representations. Second, POI features are extracted within 500m, 1,000m, and 1,500m neighborhood buffers to characterize surrounding functional environments. Pearson and Spearman correlation analyses, combined with false discovery rate correction, are used to identify candidate contextual features. Finally, visual and POI features are integrated using a cost-sensitive Random Forest classifier under community-isolated spatial cross-validation. The results show that multi-view aggregation provides the main performance improvement, increasing the building-level Macro-F1 from 60.84% under Direct Detection to 74.95%. Incorporating POI context further increases Macro-F1 to 76.79%, although the additional gain is modest and category-dependent. POI information therefore functions as a supplementary contextual prior rather than a substitute for direct visual evidence or a causal determinant of building condition.
13. 【2607.20247】Vera: Identity-Faithful Human Subject-to-Video Generation
链接：https://arxiv.org/abs/2607.20247
作者：Yulong Xu,Xinyue Liu,Shujuan Li,huafeng shi,Yan Zhou,Jiwen Liu,Xintao Wang,Yu Shen Liu,Huaibo Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：made substantial progress, consistency remains insufficient, made substantial, substantial progress, remains insufficient
备注：
点击查看摘要
Abstract:Subject-to-video (S2V) generation has made substantial progress in preserving reference subjects across diverse categories, yet generic subject consistency remains insufficient for human-centric generation. A video may appear globally consistent while identity-critical human details still drift across frames, poses, and interactions. This issue becomes more severe in multi-person scenarios, where incorrect identity-role binding leads to subject confusion, attribute swapping, and excessive copying of reference-specific appearance cues. We propose Vera, a unified human-centric S2V framework for single- and multi-person generation. We first construct a million-pair identity-aligned human image-video dataset through person-level cross-clip retrieval, providing explicit identity correspondence and diverse references. Built on this dataset, Vera introduces two complementary designs. Identity-Focal Masked Supervision (IFMS) strengthens identity-aware learning with spatially focused supervision while reducing interference from irrelevant artifacts. Reference-Aware Layer-wise Attention (RALA) regulates how video tokens interact with reference identity cues in the DiT backbone, preserving stable identity anchors and enhancing layer-aware identity readout. Extensive experiments demonstrate that Vera improves human identity consistency, multi-person subject binding, and motion naturalness, while reducing identity confusion and excessive reference-image copying.
14. 【2607.20238】Not All Patches are Equal: Sampling Matters for Visible-Infrared Pre-Training
链接：https://arxiv.org/abs/2607.20238
作者：Qiwei Ma,Bin Deng,Junjie Zhu,Qiangjuan Huang,Puhong Duan,Ke Yang,Xudong Kang,Shutao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：robust multi-sensor perception, multi-sensor perception, robust multi-sensor, key pre-training task, revisit VIS-IR pre-training
备注： 13 pages, 11 figures,
点击查看摘要
Abstract:Visible-infrared (VIS-IR) alignment is a key pre-training task for robust multi-sensor perception. Most existing methods use uniform patch-wise contrastive learning, but this can be unreliable in VIS-IR data because imaging-physics differences make some spatially paired regions inherently less comparable, and aligning them with equal strength hinders representation learning and downstream transfer. In this paper, we revisit VIS-IR pre-training from a sampling perspective and propose Importance-Aware Sampling (IAS), which adjusts training emphasis based on patch reliability. Specifically, IAS (i) derives patch weights from infrared structural cues and uses them to reweight the contrastive objective; (ii) learns a soft importance mask with a lightweight sampler, optionally warm-started from the hand-crafted prior; and (iii) employs a patch curriculum learning strategy that gradually expands from high-reliability regions to harder patches. It is worth noting that IAS is plug-and-play and works with both patch-/correlation-level alignment (e.g., UNIV-style) and image-level contrastive baselines (e.g., ImageBind-style). Extensive experiments on multiple VIS-IR benchmarks demonstrate consistent improvements over strong baselines, including for IR semantic segmentation, IR object detection and VIS semantic segmentation and cross-modal retrieval task. Code will be released on this https URL.
15. 【2607.20197】RS-RIE-Bench: Benchmarking Reasoning-Guided Remote Sensing Image Editing
链接：https://arxiv.org/abs/2607.20197
作者：Zihan Qin,Boao Xu,Zhao Dong,Yingping Sun,Ziheng Jiao,Junying Wang,Hongwei Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing, sensor observation characteristics, remote sensing editing, Remote sensing image, natural language instructions
备注：
点击查看摘要
Abstract:Remote sensing image editing aims to modify remote sensing images according to natural language instructions while preserving geographic rules and sensor observation characteristics. Existing benchmarks mainly target natural images or general visual scenes, and thus may not fully capture the reasoning, regional control, and sensor-consistency abilities required in remote sensing editing. To fill this gap, we introduce RS-RIE-Bench, the first benchmark for reasoning-guided remote sensing image editing. RS-RIE-Bench organizes tasks into three categories: temporal reasoning, causal reasoning, and spatial reasoning. These categories capture temporal evolution, causal consequence, and spatial imaging consistency in remote sensing scenes. The evaluation protocol covers three dimensions: target region plausibility, non-target region preservation, and image quality consistency. We further demonstrate the feasibility of MLLM-based evaluation through cross-judge consistency analysis and stratified expert review. Systematic evaluation on eight open-source and closed-source image editing models shows that current models still have clear limitations in reasoning-guided remote sensing editing. Even the strongest model achieves only 24.28\% overall accuracy under the strict joint-satisfaction criterion, while the mean relaxed joint-4 success rate across all eight models is 32.23\%. Causal reasoning and spatial reasoning remain especially challenging, and several open-source models are close to zero in some categories. These results show that RS-RIE-Bench can effectively reveal the limitations of current models in geographic reasoning, regional control, and sensor-consistent generation. It also provides a standardized benchmark and a clear research direction for future remote sensing intelligent editing models.
16. 【2607.20175】PerceptDrive: Perception Prior World-Action Modeling with Adaptive Expert Routing for End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2607.20175
作者：Yushan Liu,Tianxiong Lv,Bohua Wang,Hangqi Fan,Chenxu Zhao,He Zheng,Xuchang Zhong,Yifan Xie,Congyang Zhao,Zhihao Liao,Leigang Luo,Yang Cai,Xiao-Ping Zhang,Wenbo Ding
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：encode rich geometric, foundation models encode, models encode rich, Frozen perception foundation, rich geometric
备注：
点击查看摘要
Abstract:Frozen perception foundation models encode rich geometric, semantic, and dynamic knowledge. Yet narrow conditioning interfaces may attenuate task-relevant cues, while static fusion cannot adjust expert contributions to each scene. We cast this challenge as the prior-to-plan transfer problem and introduce PerceptDrive, a perception prior world-action modeling framework with adaptive expert routing. PerceptDrive feeds teacher-distilled priors from a frozen, driving-adapted provider and dense observation latents from a frozen self-supervised video encoder into a trainable expert-routed world-action model. Expert-specific query branches process these signals, while a prior-retention objective anchors each branch to its prior. A router predicts soft gates from a shared scene representation and combines the expert conditions before trajectory generation. During training, privileged rule-based sub-metric estimates for branch-specific trajectory drafts provide soft-gate distillation targets. The predicted action-free future latent conditions a flow-matching actor. At inference, privileged components are absent; with one front-facing camera, PerceptDrive generates one trajectory per planning step without test-time scoring, reranking, or search. Experiments show that PerceptDrive achieves state-of-the-art performance with 90.4 PDMS on NAVSIM v1 and 90.2 EPDMS on NAVSIM v2, outperforming existing methods. Ablations confirm complementary gains from prior retention and scene-conditioned routing, alongside differential reliance on the three priors. These results demonstrate that preserving and adaptively routing perception priors improves direct planning without test-time candidate selection.
17. 【2607.20174】StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generation
链接：https://arxiv.org/abs/2607.20174
作者：Zejing Rao,Haoxian Zhang,Xiaoqiang Liu,Yiping Meng,Guoxin Zhang,Pengfei Wan,Fan Tang,Tong-Yee Lee
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：complex driving conditions, real-time interactive applications, HOI video generation, driving conditions, making them unsuitable
备注： Code and models are available at [this https URL](https://github.com/KlingAIResearch/StreamHOI)
点击查看摘要
Abstract:Existing human--object interaction (HOI) video generation methods are largely limited to offline short-video generation with complex driving conditions, making them unsuitable for real-time interactive applications. We present \emph{StreamHOI}, a low-latency streaming framework for long-duration HOI video generation. Instead of converting heavily conditioned HOI pipelines into streaming systems, we study how an image-to-video streaming generator should organize historical memory to preserve interactions under bounded latency. We find that the standard sink-local memory design faces a trade-off in streaming HOI generation, and different transformer blocks show different historical-memory preferences for HOI regions and surrounding regions. To match memory composition with block behavior, StreamHOI performs offline HOI-aware block profiling and applies bias-guided memory-specialized training to adapt the generator to block-specific memory layouts. We further introduce a memory distance scaling module to strengthen long-range access to early interaction states. Extensive comparisons with both long-video baselines and recent HOI generation methods demonstrate that StreamHOI achieves strong interaction plausibility, object fidelity, human quality and efficiency, reaching 17.6 FPS with 0.75s first-chunk latency.
18. 【2607.20159】SHFormer: Dynamic Spectral Filtering Convolutional Neural Network and High-pass Kernel Generation Transformer for Adaptive MRI Reconstruction
链接：https://arxiv.org/abs/2607.20159
作者：Sriprabha Ramanarayanan,Rahul G. S.,Mohammad Al Fahim,Keerthi Ram,Ramesh Venkatesan,Mohanasankar Sivaprakasam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Attention Mechanism, distant pixel neighborhoods, selectively focuses, focuses on essential, relationships between distant
备注： Published in Neural Networks (Elsevier), Vol. 187, Article 107334, July 2025. DOI: [https://doi.org/10.1016/j.neunet.2025.107334](https://doi.org/10.1016/j.neunet.2025.107334)
点击查看摘要
Abstract:Attention Mechanism (AM) selectively focuses on essential information for imaging tasks and captures relationships between distant pixel neighborhoods to compute feature representations. Accelerated MRI reconstruction benefits from AM, as the imaging process involves Fourier domain measurements that influence image representation non-locally. However, AM-based models are more adept at capturing low-frequency information with limited capacity for high-frequency representations, restricting models to smooth reconstruction. Additionally, AM-based models need mode-specific retraining for multimodal MRI data, as their knowledge is restricted to local contextual variations that may be inadequate to capture transferable features across heterogeneous domains. To address these challenges, we propose a neuromodulation-based discriminative multi-spectral AM for scalable MRI reconstruction that can (i) propagate context-aware high-frequency details for high-quality reconstruction, and (ii) capture features reusable across deviated unseen domains in multimodal MRI. The proposed network consists of a spectral filtering CNN to capture mode-specific transferable features and a dynamic high-pass kernel generation transformer focusing on high-frequency details. We evaluate our model on comparative studies in supervised and self-supervised learning, diffusion model-based training, closed-set and open-set generalization under heterogeneous MRI data, and interpretation-based analysis. Our method offers scalable, high-quality reconstruction with best improvement margins of ~1 dB in PSNR and ~0.01 in SSIM under unseen scenarios. Code: this https URL
19. 【2607.20142】Real-Time EEG Cap Electrode Detection for Guided Point-of-Care Placement
链接：https://arxiv.org/abs/2607.20142
作者：William Lehn-Schiøler,Mads Sverker Nilsson,Nicki Skafte Detlefsen
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：detects EEG cap, two-stage vision system, live webcam stream, EEG cap electrodes, detects EEG
备注： Preprint. 13 pages, 7 figures, 4 tables
点击查看摘要
Abstract:We present a two-stage vision system that detects EEG cap electrodes in a live webcam stream and validates their anatomical placement in real time. A single-class YOLO detector localises electrodes; a geometric stage assigns each detection to a named 10-20 role from facial landmarks. Evaluating under subject-disjoint leave-one-subject-out (LOSO) cross-validation across five subjects wearing the clinically-validated Small/Medium/Large caps, the detector attains mAP@.5 = 0.94 +/- 0.07 across five held-out folds (0.96 pooled). A dedicated leave-one-cap-out axis, holding out every frame of a cap regardless of subject, leaves Medium and Large mAP@.5 within 0.01 of LOSO (0.97, 0.97) while Small drops to 0.72 +/- 0.28, a gap confounded with subject familiarity rather than cap style. Geometric augmentation (rotation, perspective, mixup) improves in-plane-roll robustness and temporal-electrode recall at no inference cost, and a landmark-driven head crop extends the usable distance range, lifting mAP@.5 from 0.23 to 0.45 at 0.6 x apparent scale. A compact mobile-candidate backbone (YOLOv10n) keeps the detector at real-time throughput (19 FPS) on a commodity CPU at 640 px.
20. 【2607.20125】HeadCast: Casting Attention Heads for Efficient Autoregressive Video Generation
链接：https://arxiv.org/abs/2607.20125
作者：Jinliang Shen,Lianghao Su,Zheming Li,Kang He,ZiLiang Lai,Yanbing Jiang,Chengru Song
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：streaming video synthesis, continuously growing Key-Value, video diffusion models, dominant inference cost, video synthesis
备注：
点击查看摘要
Abstract:Autoregressive (AR) video diffusion models have become a promising paradigm for long and streaming video synthesis, but the continuously growing Key-Value (KV) cache makes attention the dominant inference cost, especially at high resolution where each frame contributes many tokens. Existing remedies either evict the cache with coarse heuristics that cause inter-frame flickering, or require model re-training. We propose HeadCast, a training-free, plug-and-play acceleration framework built on the observation that a pre-trained AR model's attention heads exhibit stable, heterogeneous behaviors. After a short warm-up, HeadCast performs a one-time classification at the maximum-noise step that sorts every head into one of four archetypes: Sink, Dummy, Spatial, and Global, and restructures the monolithic KV cache into head-specific pathways. Crucially, it retains the Global heads that preserve the long-range temporal consistency aggressive eviction destroys. Because the Spatial pathway operates on a fixed-size grid, its savings grow with resolution: across state-of-the-art AR models, HeadCast accelerates inference by up to 1.62x at 720P and 1.95x at 1080P, while keeping VBench quality on par with full attention and largely flicker-free. Code is available at this https URL .
21. 【2607.20116】RIM: A Retrieval-In-Matching Framework for Cross-Domain Global Visual Localization of UAVs
链接：https://arxiv.org/abs/2607.20116
作者：Xin Li,Siyuan Duan,Shang Wang,Zhimin Mao,Bingliang Hu,Geng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unmanned aerial vehicles, attracted increasing attention, remote-sensing reference maps, aerial vehicles, increasing attention
备注： 56 pages, 10 figures, and 18 tables. Supplementary material is included
点击查看摘要
Abstract:Global visual localization of unmanned aerial vehicles (UAVs) using remote-sensing reference maps has attracted increasing attention. However, acquisition-time and imaging-platform differences between UAV and reference imagery induce substantial cross-domain appearance and viewpoint shifts, challenging robust six-degree-of-freedom (6-DoF) pose estimation. We address these shifts by sampling UAV-viewpoint reference views from Google 3D Tiles across locations, altitudes, and orientations. A two-stage cross-domain fine-tuning recipe adapts SALAD using pose-near positives and geographically distant hard negatives, while local geometric consistency re-ranks the Top-K candidates. We further propose Retrieval-In-Matching (RIM), which freezes the adapted DINOv2-B retriever and distils a local-descriptor decoder that reuses its token field alongside a shallow VGG19 detail stream. One query-side DINOv2-B forward thus serves both SALAD retrieval and local description, eliminating a second foundation-model backbone while preserving retrieval descriptors by construction. We evaluate RIM zero-shot on the reconstructed EPFL Urbanscape and self-collected Chang'an Park datasets, both geographically disjoint from the training data. RIM outperforms ten recent retrieval baseline families. At 25/50 m under the full 3D distance metric, it improves Recall@1 over SALAD by 8.55/13.77 percentage points on EPFL and 4.45/8.94 points on Park. At Top-K=5, the complete measured localization query, including retrieval, candidate matching, and robust geometric verification, takes 67.9 ms end-to-end: 1.8 times faster than the strongest separate sparse-matching baseline and over 40 times faster than RoMa, while achieving comparable re-ranking accuracy. These results establish an efficient and deployable pipeline for UAV global visual localization in GNSS-challenged environments.
22. 【2607.20092】ENTRAP-VL: A Taxonomic Probe for Dual Contextual Entrainment in Vision-Language Models
链接：https://arxiv.org/abs/2607.20092
作者：Karan Goyal,Afreen Hossain,Debojyoti Das,Vishal Bhutani
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：pull its output, input pull, Contextual entrainment, unimodal language models, context
备注：
点击查看摘要
Abstract:Contextual entrainment is the tendency of a model to let auxiliary context in its input pull its output, independently of whether that context is relevant, true, or even meaningful. Recently, it has been identified and given a mechanistic account in unimodal language models. Whether and how it manifests in vision-language models (VLMs) is, by contrast, largely unexamined, and the field lacks a purpose-built instrument with which to investigate it. We take the position that studying contextual entrainment in VLMs requires more than porting an existing text-only benchmark to the multimodal setting: it requires a taxonomically structured, dual-modality instrument whose conditions are constructed around the item at hand (the depicted image in the textual stream, the textual query in the visual stream). We argue that the move to VLMs is substantive rather than incremental. It makes entrainment a dual phenomenon, drivable independently by textual and by visual context, and it opens a veracity distinction (context that is false of the depicted scene yet possible in the world) that has no counterpart in the unimodal, world-knowledge-only formulation of prior work. To make this position concrete and actionable, we introduce ENTRAP-VL (ENTRainment Assessment Probe for Vision and Language), a manually curated dataset of 1,500 items across eight categories, organized by a taxonomy that spans two axes, i.e., the association of context with the item and its relationship to truth, and split into a textual-entrainment stream (eight context conditions) and a visual-entrainment stream (three context conditions). We do not claim to measure entrainment in any particular model; we provide the instrument, the taxonomy that motivates it, and the evaluation protocols it enables, so that the community can investigate the phenomenon rigorously. We will release the dataset and its documentation publicly.
23. 【2607.20087】Development of an automated, reliable, and clinically meaningful artificial intelligence (AI) tool for diagnosing cardiac disease from conventional cardiovascular magnetic resonance (CMR) images
链接：https://arxiv.org/abs/2607.20087
作者：Sina Amirrajab,Volker Vehof,Michael Bietenbeck,Nuriye Akyol,Redouane Bouras,Khuraman Isgandarova,Alexandru Zlibut,Philipp Stalling,Ali Yilmaz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enables non-invasive assessment, requires substantial experience, Cardiovascular magnetic resonance, imaging enables non-invasive, CMR images
备注：
点击查看摘要
Abstract:Aims: Cardiovascular magnetic resonance (CMR) imaging enables non-invasive assessment of myocardial structure, function, and pathology, but requires substantial experience in interpretation of CMR images that could be supported by artificial intelligence (AI)-based models. However, use of AI models for enhanced CMR reading is limited by labor-intensive data curation, suboptimal model performance, and unclear implementation pathways. Methods and results: We developed an automated data curation pipeline for CMR-based cardiovascular disease (CVD) diagnosis, integrating open-source locally-run large language models (LLMs) to extract diagnostic labels from narrative CMR reports and preprocessing multimodal imaging data, including cine and late-gadolinium-enhancement (LGE) CMR sequences. Three vision foundation models (DINO, VST, UMedPT) were fine-tuned across these modalities in a two-stage approach. The dataset comprised hypertrophic cardiomyopathy (HCM), dilated cardiomyopathy (DCM), ischemic cardiomyopathy (ICM), cardiac amyloidosis (CA), and normal controls (NOR). A total of 988 curated cases were randomly divided into 742 for training and 246 for validation. Fine-tuned AI-models achieved high discriminative diagnostic performance on an independent test set comprising 1067 patients , with individual AUC-ROC values of up to 0.937 for the correct diagnosis of HCM and 0.945 for cardiac amyloidosis. Ensemble strategies combining multiple models and modalities further improved AI-based diagnostic accuracy and robustness, achieving the highest overall diagnostic performance for HCM (AUC=0.959, CI [0.936-0.978]), CA (AUC=0.966, CI [0.939-0.986]), NOR (AUC=0.872, CI [0.852-0.894]), DCM (AUC=0.848, CI [0.808-0.885]) and ICM (AUC=0.840, CI [0.809-0.868]). All training and inference code, along with the trained model weights, are publicly available on this https URL.
24. 【2607.20072】Factor-Informed Uncertainty Distillation for Gaze Estimation
链接：https://arxiv.org/abs/2607.20072
作者：Mohammadreza Jamalifard,Yaxiong Lei,Javier Fumanal Idocin,Parastoo Azizinezhad,Tom Foulsham,Javier Andreu-Perez
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：Deep gaze estimation, gaze estimation works, reject unreliable predictions, Deep gaze, estimation works
备注：
点击查看摘要
Abstract:Deep gaze estimation works well in controlled capture but degrades in unconstrained settings, where systems must reject unreliable predictions. Single-pass uncertainty (e.g., heteroscedastic regression) infers uncertainty from pixels without explicit input-validity cues, while sampling based methods are often too costly for real time use. We propose Factor-Informed Uncertainty Distillation (FIUD), a teacher-student framework that aligns uncertainty with interpretable image-quality failure modes. A gradient-boosting teacher predicts expected gaze error from factors such as illumination, sharpness, eye visibility and symmetry; a neural student distills these signals via curriculum learning and ranking supervision into a lightweight single-pass uncertainty head. Across ETH-XGaze, Gaze360, and MPIIFaceGaze (300k samples), FIUD improves uncertainty, error rank correlation and selective prediction versus deterministic and sampling-based baselines, with the largest gains in unconstrained settings.
25. 【2607.20071】GaussianSeed: Hierarchical Gaussian Seeding for High-Resolution 3D Occupancy Prediction
链接：https://arxiv.org/abs/2607.20071
作者：Xinzhuo Li,Xianghui Pan,Jiayuan Du,Wei Wei,Liuyi Wang,Chengju Liu,Qijun Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：prohibitive computational costs, high voxel resolutions, scene representations essential, voxel resolutions due, existing methods struggle
备注：
点击查看摘要
Abstract:Vision-centric 3D occupancy prediction provides dense scene representations essential for autonomous driving and robotic navigation, yet existing methods struggle to scale to high voxel resolutions due to prohibitive computational costs. To address this, we introduce GaussianSeed, a progressive multi-scale Gaussian occupancy prediction framework that organizes primitives into a coarse-to-fine hierarchy. Benefiting from this hierarchical design, GaussianSeed effectively circumvents the memory bottlenecks inherent in dense representations, successfully scaling to a $0.1\text{m}$ spatial resolution while maintaining real-time inference capabilities. To comprehensively evaluate high-resolution geometric perception, we further construct TJScenes, a panoramic six-camera occupancy dataset with highly detailed $0.1\text{m}$ annotations. Extensive experiments on Occ3D-nuScenes and TJScenes demonstrate that GaussianSeed delivers the lowest latency among all evaluated methods while maintaining highly competitive accuracy, advancing the efficiency-quality frontier of high-resolution 3D occupancy prediction.
26. 【2607.20048】Importance-Aware OBS Pruning for Diffusion Models
链接：https://arxiv.org/abs/2607.20048
作者：Ba-Thinh Lam,Srijan Das,Hieu Le
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：salient image regions, semantically salient image, prioritizes preserving parameters, preserving parameters critical, propose importance-aware pruning
备注：
点击查看摘要
Abstract:We propose importance-aware pruning for diffusion models, a training-free framework that prioritizes preserving parameters critical to semantically salient image regions. To do so, we incorporate spatial importance maps -- derived from conditioning signals or model attention -- into the pruning objective. This produces parameter rankings aligned with perceptual relevance rather than uniform reconstruction error. On MS-COCO dataset, our proposed approach consistently retains subject fidelity and structural correctness at high compression ratios where conventional pruning causes visible degradation. These results demonstrate that content-aware objectives are key to perceptually faithful compression of generative models.
27. 【2607.20028】A Systematic Benchmark of Intensity Normalisation Methods for 3D Knee MRI Segmentation and Cross-Domain Generalisability
链接：https://arxiv.org/abs/2607.20028
作者：Oliver Mills,Philip Conaghan,Samuel Relton
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：deep learning models, deep learning, medical imaging, Gaussian Mixture Model, magnetic resonance imaging
备注： This preprint has not undergone peer review or any post-submission improvements or corrections. The Version of Record of this contribution is published in 3Oth Annual Conference on Medical Image Understanding and Analysis, MIUA 2026. Code is available at [this https URL](https://github.com/oliverjm1/mri_normalisation)
点击查看摘要
Abstract:Robust out-of-the-box performance is essential for the clinical deployment of deep learning models in medical imaging. An important but underexplored factor affecting model generalisability is intensity normalisation, particularly for magnetic resonance imaging (MRI), where image intensities vary across scanners and protocols. In this study, we systematically compared seven normalisation methods and their impact on the performance of a 3D U-Net model for meniscus segmentation from knee MRI. The methods included standard scaling approaches, histogram-based techniques, and a Gaussian Mixture Model (GMM)-based method. Models were trained on the IWOAI 2019 dataset and evaluated on both internal and external test sets (SKM-TEA) to assess generalisability. Performance was similar internally but differences were significant on external data, with Z-score, Nyúl histogram matching, and CLAHE showing greater robustness than other methods. However, these differences were small compared to the significant performance drop observed between datasets. Overall, while intensity normalisation had a measurable effect on model generalisability, its impact was limited relative to the effects of domain shift, highlighting the need for complementary strategies for robust deployment.
28. 【2607.19994】oward Seasonal Guidelines for Robust Deep-Learning Sentinel-2 Building Detection in Different Area Types
链接：https://arxiv.org/abs/2607.19994
作者：Michał Romaszewski,Kamil Drejer,Katarzyna Kołodziej,Anna Zawadzka,Stanisław Lewiński,Przemysław Głomb,Marek Ruciński,Michal Krupiński,Krzysztof Gryguc Przemysław Sekułaa,Szymon Sala
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：offers open access, frequent revisit times, imagery offers open, resolution makes building, non-building classification challenging
备注：
点击查看摘要
Abstract:Sentinel-2 imagery offers open access, global coverage, and frequent revisit times, making it attractive for practical building mapping at scale; however, its native 10m resolution makes building vs non-building classification challenging, particularly for small or sub-pixel buildings, and performance can vary with both seasonality and the heterogeneity of built-up environments. This paper introduces a Sentinel-2 building-detection framework designed to systematically quantify these effects and to support more formalised, practice-oriented model selection. We construct a dedicated multi-temporal Sentinel-2 dataset over the Warsaw region and derive binary ground-truth masks by rasterising official Polish topographic database (BDOT10k) building footprints onto the Sentinel-2 pixel grid. Using two established convolutional segmentation backbones (U-Net and DeepLabV3+), we first perform scene-specific fine-tuning to select a robust architecture and identify the best monthly models for L1C and L2A products separately. We then conduct cross-temporal inference by applying each best monthly model to all scenes, enabling an assessment of (i) which months provide favourable training and inference conditions, (ii) how performance transfers between seasons, (iii) the impact of processing level, and (iv) how these effects differ across built-up typologies. Based on these results, we provide practical guidance for routine Sentinel-2 building classification under varying acquisition periods and settlement characteristics.
29. 【2607.19986】STEREOFLOW: Progressive Stereo Matching with StereoDiT and Transition Flow Matching
链接：https://arxiv.org/abs/2607.19986
作者：Hao Wang,Haoran Geng,Xiaotong Yang,Jing Tang,Songlin Wei,Linlong Lang,Yeying Jin,Zheng Zhu,Zhaoxin Fan,Biao Leng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：fundamental task, Stereo matching, formulate stereo matching, matching, Transition Flow Matching
备注： 10 pages, 6 figures, submitted to TVCG
点击查看摘要
Abstract:Stereo matching is a fundamental task in 3D reconstruction. Despite remarkable advances, the prevailing paradigms formulate stereo matching as a deterministic regression problem, collapsing the multimodal distribution modeling into a single-point estimation. This formulation suffers from a regression-to-mean bias, frequently struggling with ambiguous regions. In contrast, we introduce a prior-guided generative framework that integrates deterministic matching regression and generative distribution modeling within a complementary formulation. Built upon this formulation, we introduce StereoFlow through three key components: (i) a two-stage progressive cascade matching network that progressively produces multi-resolution stereo conditions with complementary matching cues; (ii) a pixel diffusion transformer (termed StereoDiT) with a frequency-decoupled architecture for modeling correspondence ambiguity; (iii) a few-step flow matching objective (termed Transition Flow Matching) for efficient optimization. In summary, \textsc{\textbf{StereoFlow}} achieves strong geometric consistency and rich fine-grained details in ill-posed, discontinuous regions and under zero-shot generalization. Extensive experiments demonstrate that the proposed StereoFlow establishes multiple state-of-the-art results across benchmarks, including Scene Flow, KITTI, ETH3D, and Middlebury.
30. 【2607.19975】Forecasting the Number of Harvest-ready Fruits of Sweet Peppers Using Multimodal Time-Series Data
链接：https://arxiv.org/abs/2607.19975
作者：Enrico Pallotta,Mohamed Farag,Esra Guclu,Chris McCool,Ribana Roscher,Juergen Gall
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual growth dynamics, public datasets capturing, Accurate yield forecasting, per-plant measurement labels, supply-chain planning
备注：
点击查看摘要
Abstract:Accurate yield forecasting at the individual-plant level is critical for precision agriculture and supply-chain planning, yet public datasets capturing both visual growth dynamics and per-plant measurement labels are scarce. In this paper, we introduce a novel, annotated image time-series dataset of 691 sweet pepper plants monitored over two growing seasons, comprising 4837 images with per-plant fruit counts categorized by maturity. We propose a multimodal deep learning framework that fuses high-dimensional image features, extracted using the DinoV3 encoder, with numerical count measurements. Our architecture utilizes a Long Short-Term Memory (LSTM) network to model temporal dependencies and handles irregular sampling intervals common in greenhouse monitoring. Through quantitative experiments, we demonstrate that this multimodal approach reduces RMSE over a persistence baseline by 33% and 38% in the 2022 and 2023 seasons, respectively, with a further 1.2% average gain over a measurement-only model. Furthermore, we employ Deep Ensembles and Gaussian Negative Log-Likelihood (NLL) to provide calibrated uncertainty estimates, with an Uncertainty Calibration Error (UCE) ranging from 0.39 to 0.89 depending on the cross-season evaluation direction, offering a principled confidence signal for real-world agricultural decision-making. We release the dataset and code to support reproducible research and to accelerate development of data-driven yield forecasting methods for horticultural crops.
31. 【2607.19971】Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training
链接：https://arxiv.org/abs/2607.19971
作者：Taewon Seo,Seonae Jeon,Giwon Lee,Kuk-Jin Yoon,Daehee Park
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Accurate motion prediction, Accurate motion, closely coupled key, crowded environments, motion prediction
备注： Accepted at ECCV 2026. 38 pages, 14 figures. Project page: [this https URL](https://dpt2026.github.io/)
点击查看摘要
Abstract:Accurate motion prediction of surrounding agents and safe motion planning are two closely coupled key tasks for social robot navigation in crowded environments. Deploying these systems on resource-constrained edge devices necessitates compact, unified models that can perform both tasks simultaneously. However, within these compact shared encoders, recent unified models often overlook severe representational conflicts that arise from the distinct objectives of predicting neighbor behaviors versus ego-centric safety planning. To address this issue, we first identify the Skill Conflict$\unicode{x2014}$a phenomenon where overlapping parameter assignments cause distinct tasks to compete for the same weights, preventing the model from fully specializing in individual skills. To resolve this, we propose a novel model-merging-based framework, Disjoint Parameter Training (DPT). DPT mitigates performance degradation caused by Skill Conflict through distributed parameter learning, which separates the key parameter regions of each task while preserving their core capabilities prior to merging. In addition, we observe that sparse merging, which selectively integrates only the most influential parameters for each task rather than combining all task-specific parameters, yields optimal performance by preventing interference among adjacent features and concentrating representational capacity. DPT can be applied in parallel with a variety of merging methods. Evaluated on standard crowd navigation benchmarks (JRDB and JTA), our framework demonstrates superior performance, validating its versatility and effectiveness for safe, resource-efficient robot navigation.
32. 【2607.19951】OffNadirLoc: Benchmark and Framework for Challenging UAV-to-Satellite Geo-Localization under Large Off-Nadir Views
链接：https://arxiv.org/abs/2607.19951
作者：Qian Qiao,Wenye Liu,Ting Liu,Jiuhe Shu,Peng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：highly challenging task, appearance gaps occur, drastic perspective distortions, satellite imagery remains, Cross-view geo-localization
备注：
点击查看摘要
Abstract:Cross-view geo-localization between UAV and satellite imagery remains a fundamental yet highly challenging task, especially under large off-nadir views where drastic perspective distortions, occlusions, and appearance gaps occur. Existing benchmarks and methods primarily focus on near-nadir scenarios and often overlook the importance of structural scene understanding and intra-domain relational constraints, limiting their performance in real-world deployments. In this work, we introduce OffNadirLoc, a new benchmark for large off-nadir UAV-to-satellite geo-localization. To tackle the unique challenges posed by off-nadir perspectives, we further propose ONLoc, a framework that incorporates a structure-aware contextual weighting mechanism to dynamically emphasize reliable local features while suppressing ambiguous or repetitive regions. Additionally, we design a view-coherent learning strategy, which treats one satellite image and the corresponding UAV images from multiple views as a cohesive semantic group. This set-level supervision enables the model to learn viewpoint-invariant and discriminative features, making it more effective at capturing multi-view consistency than conventional pairwise contrastive learning. Extensive experiments on the OffNadirLoc benchmark and four near-nadir datasets demonstrate that our method consistently outperforms state-of-the-art approaches while exhibiting strong zero-shot generalization to unseen datasets without additional training. The code will be released at this https URL.
33. 【2607.19947】ETPDesigner: Multi-Agent Orchestration for Interactive Multimodal Electronic Theater Program
链接：https://arxiv.org/abs/2607.19947
作者：Mengtian Li,Xinru Guo,Xiaoru Lin,Xiao Rong,Zhifeng Xie,Chaofeng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：critical promotional media, Electronic Theater Programs, performance details, Electronic Theater, serve as critical
备注：
点击查看摘要
Abstract:Electronic Theater Programs (ETPs) serve as critical promotional media in the performing arts, comprising a multi-page collection of heterogeneous visual assets such as theatrical posters, performance details, and character portraits. However, existing text-to-image paradigms struggle with such complex design tasks due to their inability to comprehend long-context narratives and maintain visual consistency across multiple distinct pages. To address this, we introduce ETPDesigner, a collaborative Multi-Agent framework that directly synthesizes high-quality ETPs from raw dramatic scripts. Emulating a professional design pipeline, our framework orchestrates specialized agents for semantic script analysis, core poster synthesis, functional background generation, and the stratified composition of character assets. Central to ETPDesigner is a global style anchor mechanism that extracts visual priors from the core poster to enforce strict aesthetic uniformity across all generated components. Furthermore, we elevate the ETP from a static publication to an immersive interactive companion. By integrating portrait animation, customized speech synthesis, and persona-grounded Large Language Models (LLMs), our system enables users to engage in real-time, voice-enabled conversations with the generated virtual characters. To rigorously benchmark this task, we construct ETP-Pro, a domain-specific benchmark of professional theater posters and high-quality character portraits. Extensive evaluations demonstrate our method's superiority in producing semantically faithful, aesthetically consistent, and highly interactive program sets.
34. 【2607.19943】SIINR: Structurally Informed Implicit Neural Representations for super-resolution with uncertainty quantification of clinical quality diffusion MRI datasets
链接：https://arxiv.org/abs/2607.19943
作者：Tom Hendriks,William Consagra,Anna Vilanova,Yogesh Rathi,Maxime Chamberland
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion Magnetic Resonance, Magnetic Resonance Imaging, Diffusion Magnetic, Resonance Imaging, degraded structural information
备注： 27 pages, 8 figures, 2 tables
点击查看摘要
Abstract:Diffusion Magnetic Resonance Imaging (dMRI) is a powerful tool for probing brain microstructure, but clinical acquisitions are often limited by low out-of-plane resolution, resulting in degraded structural information and reduced utility for advanced analysis. We introduce SIINR (Structurally Informed Implicit Neural Representations), a general framework for super-resoltion of clinical dMRI datasets while quantifying uncertainty in the reconstructed outputs. SIINR utilizes a supervised 3D U-net as a prior and combines it with a self-supervised implicit neural representation (INR) that fuses the high-resolution prior and the original low-resolution data. The INR enables joint modeling across spatial and angular domains, enforces data consistency, and provides analytic approximate posterior distributions for downstream uncertainty quantification. We validate the framework on a diverse set of open-access dMRI datasets, demonstrating that SIINR outperforms standard interpolation methods in both quantitative error metrics and qualitative anatomical fidelity. Experiments on clinical cases, including subjects with multiple sclerosis and brain lesions, illustrate the framework its ability to propagate intensity changes and flag uncertain regions in challenging scenarios. SIINR is flexible, modular, and can be adapted to different upsampling ratios and downstream tasks, providing a principled approach for enhancing clinical dMRI and supporting robust interpretation of derived neuroimaging metrics.
35. 【2607.19942】G-MAD: A Game-Based Data Generation Framework for Multi-View RGB-T Aerial Object Detection
链接：https://arxiv.org/abs/2607.19942
作者：Yechan Kim,JongHyun Park,Dongho Yoon,Namhoon Jung,Moongu Jeon
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：work introduces G-MAD, generate synchronized multi-view, synchronized multi-view RGB-T, multi-view RGB-T data, work introduces
备注： ACM Multimedia 2026 (OSS)
点击查看摘要
Abstract:This work introduces G-MAD, an open-source framework that uses Arma3 to generate synchronized multi-view RGB-T data for aerial object detection. G-MAD addresses key limitations of real-world aerial dataset construction, including limited viewpoint control, imperfect RGB-T alignment and high annotation cost. The framework supports structured scenario specification, controllable multi-view camera placement, simultaneous visible/thermal capture, and automatic bounding box annotation using engine-level geometric metadata. These capabilities enable controlled studies of viewpoint variation, multi-modal fusion, and synthetic-to-real transfer in aerial object detection. Besides, using G-MAD, we construct and release AMOD, a new large-scale multi-view aerial RGB-T object detection benchmark. The source code and the dataset are available at this https URL.
36. 【2607.19923】WearWow: Native 2K Multi-Garment Virtual Try-On via Adaptive Token Packing and Preference Alignment
链接：https://arxiv.org/abs/2607.19923
作者：Xujie Zhang,Runyan Du,Song Chang,Jiang Li,Dongliang Shao,Liping Wu,Wei Luo,Xiaochao Qu,Luoqi Liu,Xiaodan Liang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：high-frequency fabric details, over-smooths high-frequency fabric, multi-garment virtual try-on, memory explosion induced, digital fashion
备注：
点击查看摘要
Abstract:Synthesizing native 2K multi-garment virtual try-on is a formidable frontier in digital fashion, critically bottlenecked by two fundamental limitations: the O(N^2) memory explosion induced by 2k conditions, and the spectral bias of diffusion models that over-smooths high-frequency fabric details. We present WearWow, an end-to-end, mask-free generative framework that pioneers ultra-high-resolution multi-garment synthesis. To mitigate the memory explosion , we propose Adaptive 2D Token Packing (ATP). ATP leverages inherent garment sparsity to algorithmically pack heterogeneous items onto a unified 2D canvas and prune uninformative background tokens, minimizing the effective sequence length and subsequent memory overhead while rigorously preserving 2D spatial priors. To rectify texture degradation, we introduce the Multi-dimensional Try-on Reward (MTR) system. MTR synergizes a Semantic Guidance Reward to explicitly drive tactile restoration with a Cloth Distribution Reward to implicitly anchor the physical distribution, a joint formulation that effectively mitigates the severe reward hacking. Furthermore, we curate WearWow-2K, an extreme-quality dataset comprising native 2K triplets, providing physically correct spatial interactions that naturally empower the model's mask-free generation. Extensive experiments demonstrate that WearWow establishes a new state-of-the-art, exceeding existing commercial baselines in native 2K multi-garment synthesis.
37. 【2607.19911】LoRFT: Benchmarking Long-Range Vehicle Trajectory Reconstruction from Fixed Highway Cameras
链接：https://arxiv.org/abs/2607.19911
作者：Yufan Zhu,Kefu Yi,Xueju Zhang,Yunyang Tian,Long Chen,Zixuan Xiao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：traffic safety analysis, data-driven traffic management, important spatio-temporal evidence, autonomous driving evaluation, cameras remains difficult
备注： 17 pages, 5 figures. Code and processed annotations: [this https URL](https://github.com/YvfanZhu/LoRFT)
点击查看摘要
Abstract:Long-range vehicle trajectories provide important spatio-temporal evidence for traffic safety analysis, autonomous driving evaluation, and data-driven traffic management, yet continuously recovering them from fixed highway cameras remains difficult. As vehicles recede into distant road regions, perspective compression and scale decay often fragment or prematurely terminate automatic tracklets, even when their continuation remains identifiable from motion consistency across neighboring frames. We formulate this problem as recovering the far-range continuation of a vehicle trajectory from a reliable near-field tracklet. We introduce LoRFT, to our knowledge the first open benchmark dedicated to long-range vehicle trajectory reconstruction from fixed highway cameras. LoRFT comprises 22 expressway surveillance scenes, 366,109 video frames, 6,601 manually verified trajectories, 2,694,889 bounding boxes, road-geometry annotations, scene-level splits, and evaluation scripts. We further propose Map-RSTNet, a map-aware residual sequence-to-sequence model that reconstructs distant trajectories in a road-geometry-aligned state space and dynamically refreshes local road geometry during decoding. On LoRFT, Map-RSTNet reduces ADE, FDE, and 5-second RMSE by 11.0%, 15.4%, and 10.5%, respectively, relative to the strongest baseline. These results demonstrate that road-geometry-aware reconstruction can extend usable trajectory records from existing fixed-camera infrastructure. LoRFT provides a reproducible testbed for long-range vehicle trajectory reconstruction.
38. 【2607.19910】MV-Bench: Benchmarking Multimodal Large Language Models for Coordinated Multi-View Interface Construction
链接：https://arxiv.org/abs/2607.19910
作者：Yue Zhao,Hongxu Liu,Feiyu Wang,Xiaoyu Yang,Tong Ge,Zhen Yang,Chao Wang,Qiong Zeng
类目：Computer Vision and Pattern Recognition (cs.CV); Human-Computer Interaction (cs.HC)
关键词：Multimodal large language, automate visualization development, Multimodal large, large language models, multi-view interface construction
备注： Submitted to IEEE VIS 2026
点击查看摘要
Abstract:Multimodal large language models (MLLMs) are increasingly expected to automate visualization development by generating code directly from visual designs. However, existing evaluations mainly focus on single-chart generation and overlook coordinated multi-view interface construction, which requires joint reasoning about data semantics, view coordination, and interaction logic. Consequently, MLLM capabilities in this setting remain underexplored, and the field lacks a dedicated benchmark for systematic assessment. We introduce MV-Bench, a benchmark for evaluating MLLMs on coordinated multi-view interface construction. Instead of relying on incomplete or inconsistent open-source implementations, we use Tableau workbook files as ground truth because they explicitly encode data bindings, visual mappings, and interactions. We develop a multi-stage pipeline that converts these specifications into executable web interfaces through structured intermediate representations. The benchmark contains 92 base interfaces and 1,048 verified instances created by recombining chart types, datasets, and interaction patterns. Each instance includes executable code, a rendered interface, a dataset, and interaction annotations. We evaluate five state-of-the-art MLLMs in a single-pass setting using metrics for visual fidelity, data binding correctness, and interaction completeness. The strongest model achieves 75.45 percent accuracy in visual layout reproduction, but only 21.71 percent in data binding and 11.68 percent in interaction completeness. These results show that current MLLMs can reproduce visual appearance but remain limited in generating the data semantics and interactive logic required by coordinated multi-view interfaces. Iterative refinement improves code executability but does not substantially reduce the gap in data binding and interaction generation.
39. 【2607.19901】StrokeSeg2: Stroke Lesion Segmentation in Clinical Research Workflows
链接：https://arxiv.org/abs/2607.19901
作者：Youwan Mahé(EMPENN, MALT),Axel Plessis(EMPENN),Stéphanie Leplaideur(EMPENN, MPR, CMRRF),Elise Bannier(EMPENN),Florent Leray(EMPENN, SED (Rennes)),Francesca Galassi(EMPENN)
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep learning frameworks, Deep learning, nnU-Net achieve, computational requirements, remain difficult
备注：
点击查看摘要
Abstract:Deep learning frameworks like nnU-Net achieve state-of-theart brain lesion segmentation performance but remain difficult to deploy in clinical research environments due to, among other reasons, software dependencies and computational requirements. We introduce StrokeSeg2, a lightweight, modular, cross-platform C++/Qt framework designed to adapt resource-intensive 3D stroke segmentation pipelines into portable and reproducible applications. To improve compatibility with standard clinical workstations, we investigate the combined effect of architectural compression through knowledge distillation and inference optimisation using ONNX Runtime with Float16 quantisation. Across heterogeneous hardware configurations (CPU, integrated GPU, and dedicated GPU) architectural distillation emerged as the primary contributor to efficiency gains, contributing to over 90% reduction in energy consumption and an average 84% reduction in inference time. Specifically, we identify a 0.84M-parameter student model as the most favourable trade-off, reducing the original 102.3M-parameter teacher architecture to a 2.1 MB disk footprint while preserving robust lesion localisation and competitive segmentation performance. This small footprint supports the development of a self-contained installer for clinical workstation targets. Finally, StrokeSeg2 packages these optimisations into standalone installers for Windows, macOS, and Linux. By providing both graphical and commandline interfaces without Docker or external environment dependencies, StrokeSeg2 facilitates deployment of high-performance segmentation workflows for routine clinical research pipelines.
40. 【2607.19895】OSVE: One Step Video Editing with One Step Diffusion Models
链接：https://arxiv.org/abs/2607.19895
作者：Habin Lim,Gyeong-Moon Park
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Text-guided video editing, costly multi-step sampling, Text-guided video, hindered by costly, Text-guided
备注：
点击查看摘要
Abstract:Text-guided video editing with diffusion models is impractically slow, hindered by costly multi-step sampling and inversion. We present OSVE, the first framework to successfully adapt one-step Text-to-Image (T2I) models for high-quality video editing, addressing the core challenges of inversion, editability, and temporal consistency. To bypass slow iterative inversion, we train a learnable encoder that predicts the initial noise for each frame in a single forward pass. This encoder is trained with a novel Structure-Aware Editing (SAE) loss on a curated dataset of structurally-aligned image pairs, teaching it to preserve the source video's geometry during edits. For temporal coherence, we introduce Unified-Frame Editing (UFE), a technique that concatenates frame latents to facilitate cross-frame attention in a single generation step. Furthermore, for long videos, a sliding-window strategy with an anchor frame maintains global consistency. Our extensive experiments demonstrate that OSVE achieves editing quality comparable or superior to state-of-the-art multi-step methods, while operating approximately 155--171 times faster. This breakthrough paves the way for practical, real-time video editing applications. Code is available at this https URL.
41. 【2607.19889】LAVIFT: Latent-Action-Guided Vision Fine-Tuning for Surgical Interaction Recognition
链接：https://arxiv.org/abs/2607.19889
作者：Jiajun Cheng,Subarna Tripathi,Sainan Liu,Xiaofan Yu,Shan Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：autonomous robotic surgery, Understanding instrument-tissue interactions, robotic surgery, Understanding instrument-tissue, essential for context-aware
备注：
点击查看摘要
Abstract:Understanding instrument-tissue interactions is essential for context-aware surgical AI and autonomous robotic surgery. Pretrained vision-language models (VLMs) and vision encoders offer an alternative to conventional interaction classifiers by transferring broad visual and semantic knowledge. However, adapting them to fine-grained surgical interactions remains challenging: (1) freezing the vision encoder depends entirely on pretrained representations that may retain noise and provide weak spatial localization, while (2) full fine-tuning can improve global semantic alignment without ensuring that the encoder learns meaningful features in the correct action region. We address these limitations by introducing LAViFiT, an end-to-end latent-action-guided framework for vision-language fine-tuning. An inverse dynamics model captures the visual changes induced by each action, while a forward world model drives the encoder to represent action-relevant regions. A patch-level SIG Regularizer further prevents local feature collapse without additional supervision, such as bounding boxes or pseudo-labels. Experiments across multiple encoders and datasets improve recognition and image-text alignment, while representation analyses show stronger grounding over the complete instrument-tissue interaction region and more spatially coherent features.
42. 【2607.19886】MTVDiff: Multimodal Conditional Latent Diffusion for Enhanced Thermal-to-Visible Face Translation
链接：https://arxiv.org/abs/2607.19886
作者：Zhiyuan Xia,Haojie Li,Jingyu Lin,Yiguo Qiao,Cunjian Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：semantic attribute mismatches, including geometric discontinuities, fundamental challenges including, challenges including geometric, presents fundamental challenges
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Thermal-to-visible face translation presents fundamental challenges including geometric discontinuities, semantic attribute mismatches, and identity degradation. We propose MTVDiff, a novel multimodal latent diffusion framework that synergistically integrates depth and textual information to address these limitations while preserving identity characteristics. The MTVDiff framework presents three core technical contributions: (1) a Dual-Branch Cross-Attention Fusion (DBCAF) module for multi-scale thermal-depth feature extraction and fusion; (2) a Gated Text-to-Visual Feature Alignment mechanism for semantically-guided generation; and (3) Spatial Feature Transformations (SFT) for adaptive multimodal prior integration. Extensive experiments on the MCXFace and SpeakingFaces datasets demonstrate that our multimodal approach significantly outperforms existing GAN-based and diffusion-based approaches across multiple metrics, achieving substantial improvements in both image quality and face verification performance, with FID reductions of up to 48.3% and Rank-1 accuracy improvements of up to 8.9\%. Our work provides a robust solution for face recognition systems operating under varying illumination conditions and advances the state-of-the-art in cross-spectral facial image translation through effective multimodal integration.
43. 【2607.19880】EA-Nav: Learning Safe Visual Navigation Policies with Embodiment Awareness
链接：https://arxiv.org/abs/2607.19880
作者：Jialu Zhang,Yong Du,Xianda Guo,Shunwang Sun,Xinqi Liu,Yue Sun,Guodong Lu,Wei Sui,Jituo Li
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：navigation, embodiment, embodied intelligence, design, key challenge
备注：
点击查看摘要
Abstract:Cross-embodiment navigation is a key challenge in embodied intelligence. Due to differences in embodiment, the same visual observation may imply different actions for different agents, making prediction ambiguous when relying solely on vision. Existing studies mainly rely on reinforcement learning, which requires large-scale interaction and careful reward design, making it difficult to support scalable pretraining and real-world adaptation. In contrast, imitation-learning-based approaches remain limited. To address these challenges, we propose an imitation-learning-based embodiment-aware navigation framework with a modular multi-stage design. In pretraining, we construct a cross-embodiment navigation dataset from Internet videos and introduce embodiment geometry as conditional tokens to reduce action ambiguity under the same observation. In fine-tuning, we design a multimodal information injection mechanism based on a decoupled architecture. Specifically, we design a trajectory augmentation strategy to generate high-risk samples, which are used to train spatial perception and risk-aware correction separately, thereby explicitly incorporating embodiment geometry for safe navigation. Experimental results show that the proposed method effectively improves navigation performance across different embodiment settings, demonstrating the effectiveness of incorporating embodiment geometry into embodied navigation.
44. 【2607.19879】Current Injection Spiking Neural Network for Infrared and Visible Image Fusion
链接：https://arxiv.org/abs/2607.19879
作者：Rui Zhao,Zhuoyuan Li,Wenrui Li,Yanchen Dong,Yajing Zheng,Giuseppe Valenzise,Weisi Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：richer scene content, visible image fusion, Infrared and visible, visible image, single image
备注：
点击查看摘要
Abstract:Infrared and visible image fusion (IVIF) integrates the complementary information of two modalities into a single image with richer scene content. While existing methods are largely built on artificial neural networks (ANNs), which densely compute over all activations, spiking neural networks (SNNs) communicate through sparse binary spikes and compute only where and when a spike occurs, offering a route to more energy-efficient fusion. However, directly applying SNNs to IVIF creates a fundamental tension: cross-modal fusion relies on fine-grained responses from both modalities, whereas binary spikes can discard complementary cues that remain below the firing threshold. The membrane potential retains these subthreshold responses before firing, letting both modalities jointly shape the output when integrated at this stage. Building on this, we propose CIS-Fuse, a spiking network that performs cross-modal fusion directly at the membrane-potential level. At its core is the current injection spiking (CIS) operator, which injects one modality as a gated auxiliary current into the driving neuron of the other, so the two integrate before spike firing, with a per-channel learnable injection strength that adaptively regulates the modulation magnitude. Building on CIS, we construct a bidirectional cross-modal fusion (BCMF) module and deploy it on a dual-branch architecture with asymmetric stacking depths, where the two branches develop a clear functional specialization. Extensive experiments on four IVIF benchmarks and on downstream detection and segmentation show that CIS-Fuse achieves fusion quality on par with state-of-the-art ANN-based methods while inheriting the energy efficiency of spike-based computation, with roughly an order of magnitude lower inference energy than the similarly-sized ANN-based DCEvo. Code will be released upon publication.
45. 【2607.19877】Robust Activation Map Rectification for Weakly Supervised Volumetric Segmentation: Temporal Coherence as a Free Lunch
链接：https://arxiv.org/abs/2607.19877
作者：Renshu Gu,Jialiang Chen,Fei Gao,Hang Su,Jun Qi,Jiamin Xu,Yicheng Shen,Jiayu Zhang,Jiaxi Pan,Caiming Zhang,Gang Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：localize target regions, initially localize target, class activation maps, segmentation relies heavily, target regions
备注：
点击查看摘要
Abstract:Weakly supervised segmentation relies heavily on class activation maps (CAMs) to initially localize target regions. However, CAMs are often noisy and prone to catastrophic failures. Existing remedies typically introduce additional training stages or prototype learning, increasing computational cost and reducing robustness. In this paper, we propose a training-free prototype-free framework that rectifies unreliable CAMs by exploiting temporal and structural coherence in volumetric data as a free lunch. Our approach is built on two key components. First, we introduce Variance-Reduced Activation Aggregation (VRAA) which suppresses noise and amplify coherent semantic signals. We provide a theoretical justification by modeling CAMs as high-dimensional random vectors and show that aggregation yields provable variance reduction. Second, we design a Bidirectional Extremity Rectification (BER) mechanism that detects and rectifies implausible activations through bidirectional extremity checks, effectively mitigating extreme-value failures without learning additional parameters. Our method is model-agnostic and can be seamlessly integrated with existing pipelines. Extensive experiments on multiple public benchmarks demonstrate substantial improvements over state-of-the-art weakly supervised methods, achieving up to 20% Dice and 40% mIoU gains while reducing inference time by more than 5 times. These results indicate that leveraging coherence as an implicit inductive bias yields a principled and efficient approach to stabilizing weakly supervised volumetric segmentation. Our code will be available.
46. 【2607.19876】KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding
链接：https://arxiv.org/abs/2607.19876
作者：Zeyu Liu,Zhangzhe Zhu,Yang Zhang,Chenyou Fan,Chenjia Bai,Xuelong Li
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：critical open challenge, Inverse Dynamics Models, open challenge, critical open, Evaluating the physical
备注： Accept to ECCV2026
点击查看摘要
Abstract:Evaluating the physical consistency of embodied world models(EWMs) is a critical open challenge. While closed-loop evaluation via simulator rollouts offers a more faithful assessment of physical plausibility than open-loop alternatives, existing frameworks almost exclusively rely on Inverse Dynamics Models(IDMs) for action extraction. Due to the intricate mapping from 2D pixel space to 3D kinematic space, the learned IDMs can be brittle to data outside their training distribution, resulting in unreliable action extraction from the generated videos with novel objects and scenarios. This creates an unavoidable attribution ambiguity between world model inaccuracies and extractor errors. To reduce this ambiguity, we present KineBench, an IDM-free closed-loop benchmark for EWMs, built upon an explicit kinematic grounding pipeline. Given a generated video, KineBench employs cascaded visual foundation models to directly extract 6D end-effector poses from individual frames, which are then executed in a physics simulator for closed-loop validation. Beyond execution-based task success, KineBench incorporates two classical 3D kinematic metrics--Spectral Arc Length (SPARC) and the Maruyama Manipulability Index--to characterize trajectory smoothness and kinematic feasibility from a robot-centric perspective. Built on 20 diverse manipulation tasks in ManiSkill3, KineBench evaluates EWMs across four progressive suites: basic execution, task transfer, visual out-of-distribution generalization, and complexity-conditioned scaling. Evaluation across frontier models reveals task-complexity-bounded nonlinear scaling in embodied video generation, providing empirical guidance for future data-scaling strategies.
47. 【2607.19857】Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos
链接：https://arxiv.org/abs/2607.19857
作者：Penglei Sun,Yehua Huang,Zhuoli Tao,Xiang Li,Runwei Guan,Yaoxian Song,Kaiyong Zhao,Henghui Ding,Bo Han,Yang Yang,Xiaowen Chu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Language-guided aerial perception, unmanned aerial vehicle, understand user-specified tiny, complex unmanned aerial, aerial perception aims
备注：
点击查看摘要
Abstract:Language-guided aerial perception aims to understand user-specified tiny targets in complex unmanned aerial vehicle (UAV) scenes. In real UAV deployment, the UAV must respond while it flies, so such perception runs in an online streaming manner, where frames arrive sequentially and the model responds to each one without access to future frames. However, applying current Multimodal Large Language Models (MLLMs) to this setting raises two challenges. First, targets viewed from the air are often tiny, yet the visual compression in existing MLLMs treats all regions equally and discards their fine-grained details. Second, understanding a continuous stream requires past-frame context, yet retaining the entire history is infeasible on resource-constrained onboard hardware, whereas discarding it causes the target to drift or disappear. We address the tiny object and streaming challenges from both data and method perspectives. From the data perspective, we present \textbf{DroneEyes}, the \textbf{first} pixel-level and open-vocabulary referring-segmentation dataset for tiny aerial targets, comprising $2,140$ high-definition videos and $176,623$ pairs across Object Description and Referring Expression tasks, with dense per-frame masks. From the method perspective, we propose \textbf{SkyAnchor}, an MLLM with two designs to the above challenges: a Semantics-Aware Token Router that preserves small-target under a reduced visual-token budget, and a Hierarchical Memory Bank that keeps the target consistently understood on streams.
48. 【2607.19826】MoAKE: Toward Unified All-in-One Action Quality Assessment via Mixture of Action Knowledge Experts
链接：https://arxiv.org/abs/2607.19826
作者：Huangbiao Xu,Huanqi Wu,Xiao Ke,Jiaxin Cai,Junyi Wu,Jinglin Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：evaluate performance quality, objectively evaluate performance, Action Quality Assessment, performance quality, Quality Assessment
备注： ECCV 2026
点击查看摘要
Abstract:Action Quality Assessment (AQA) aims to objectively evaluate performance quality from action videos. Most existing methods follow a ``one-by-one'' paradigm, training a separate model for each action type. This setting limits real-world deployment, as it requires prior action-type knowledge to select the corresponding model and suffers from poor generalization across diverse actions. To address these limitations, we study the challenging task of all-in-one AQA, which aims to assess heterogeneous actions within a single unified model. We propose a novel Mixture of Action Knowledge Experts (MoAKE) framework, designed to mitigate negative knowledge transfer caused by large semantic discrepancies among actions. MoAKE learns complementary experts that capture diverse action patterns within a shared semantic space and dynamically aggregates their knowledge to adapt the assessment to the input action. Each expert is tailored with segment-aware prototypes to handle varying temporal lengths, together with an Adaptive Intra- and Inter-Segment Relationship Modeling (AIISRM) module to model multi-granularity temporal dynamics. Furthermore, we establish comprehensive benchmarks for all-in-one as well as zero/few-shot AQA. Extensive experiments on three long-term datasets demonstrate that MoAKE significantly outperforms existing methods in the all-in-one setting, while also achieving consistent generalization on three short-term datasets under zero/few-shot evaluation. Code is available at this https URL.
49. 【2607.19811】Lean-SAM2: Target-Anchored Memory and Encoder Acceleration for SAM2
链接：https://arxiv.org/abs/2607.19811
作者：Xudong Ouyang,Wenlun Zhang,Yimin Xu,Huazhong Liu,Yunshan Zhong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual feature extraction, Segment Anything Model, deployment remains hindered, memory cross-attention overhead, advanced temporal promptable
备注：
点击查看摘要
Abstract:The Segment Anything Model 2 (SAM2) has advanced temporal promptable segmentation, yet its deployment remains hindered by heavy memory cross-attention overhead and redundant full-frame visual feature extraction. While recent methods explore efficiency via heuristic memory pruning and window-based sparse routing, they typically suffer from catastrophic performance degradation in complex segmentation scenarios replete with occlusions and distractors. To resolve these limitations, we propose \textbf{Lean-SAM2}, a holistic lightweight framework designed to address the above vulnerabilities while systematically eliminating computational redundancies. Specifically, Lean-SAM2 integrates three collaborative mechanisms: (1) Target-Anchored Memory Pruning (TAMP) safeguards target tokens against deceptive attention by modulating raw attention significance with semantic consistency against prompt-derived foreground anchors; (2) Temporal Condensation with Insurance Memory (TCIM) condenses historical context via a visibility-gated fusion while conditionally archiving high-confidence entries in a parallel insurance bank; and (3) Target-Anchored Risk-Aware Routing (TARR) selectively activates the heavy image encoder for target-related windows based on anchor similarity, utilizing a risk-aware fallback policy to trigger full-frame refreshes during volatile transitions. Extensive evaluations across multiple challenging benchmarks demonstrate that Lean-SAM2 establishes a superior balance between accuracy and efficiency. For example, on the LVOSv2 validation dataset, Lean-SAM2 achieves overall inference speedups of $1.412\times$ and $1.417\times$ on the SAM2.1-Large and SAM2.1-Base+, respectively, significantly outperforming Efficient-SAM2 while boosting the corresponding $\mathcal{J}\\mathcal{F}$ scores by $5.0\%$ and $3.6\%$. Code is available at this https URL.
50. 【2607.19793】Silent Failures in Multimodal Agentic Search:A Diagnostic Taxonomy and Cross-Judge Evaluation
链接：https://arxiv.org/abs/2607.19793
作者：Zhengxian Wu,Junjie Gao,Kai Yang
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：knowledge-intensive visual questions, systems increasingly rely, agentic search systems, search systems increasingly, answer knowledge-intensive visual
备注：
点击查看摘要
Abstract:Multimodal agentic search systems increasingly rely on external tools to answer knowledge-intensive visual questions. However, existing evaluations mainly focus on final-answer accuracy and may miss failures in the search trajectory. In this work, we study such hidden reliability issues as silent failures. We introduce a six-category taxonomy covering modality shortcuts, phantom grounding, wrong-evidence-right-answer cases, over-retrieval laundering, cross-modal contradiction, and provenance hallucination. Based on this taxonomy, we build a trajectory-level diagnostic pipeline that evaluates both answer correctness and evidence-grounding quality under a unified ReAct-style scaffold. Experiments on MMSearch-Plus trajectories across four frontier multimodal models show that surface accuracy consistently overestimates true trajectory-level correctness. We further use cross-judge validation, blank-image stress tests, and tool ablations to show that silent failures are capability-dependent and often shift rather than disappear. Home-page: this https URL
51. 【2607.19790】race: A Taxonomy-Guided Environment for Multidomain Visual Reasoning
链接：https://arxiv.org/abs/2607.19790
作者：Md Tanvirul Alam
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：substantially improved language-model, vision-language models remains, models remains constrained, improved language-model reasoning, Reinforcement learning
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) has substantially improved language-model reasoning, yet its extension to vision-language models remains constrained by the lack of training data that are simultaneously broad, exactly verifiable, and reproducible. We introduce Trace, a taxonomy-guided environment for multidomain visual reasoning. Trace factorizes task construction into a scene grammar and an executable task program, separating visual realization from answer computation. A shared semantic state determines the rendered image, prompt, typed answer, verifier state, and replayable instance trace. The resulting environment comprises 1,000 tasks over 277 scene grammars and 11 visual domains, with controlled semantic and visual variation. RLVR on 64,000 Trace instances improves the macro-average across 24 external benchmarks by 3.51 percentage points for Qwen2.5-VL-3B and 4.06 points for Qwen2.5-VL-7B, providing evidence that broad procedural training can transfer beyond the generated task distributions. Project page: this https URL.
52. 【2607.19787】Physics-Aware Complex-Valued State Space Model with Scattering-Prior Feature Modulation for PolSAR Image Classification
链接：https://arxiv.org/abs/2607.19787
作者：Fangyan Zhang,Fan Zhang,Shiqi Zhou,Jun Ni,Carlos López-Martínez,Qiang Yin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：synthetic aperture radar, Polarimetric synthetic aperture, aperture radar, synthetic aperture, representative task
备注： 20pages, 14 figures, 10 tables
点击查看摘要
Abstract:Polarimetric synthetic aperture radar (PolSAR) image classification is a representative task for physics-aware GeoAI, where land-cover semantics are closely coupled with electromagnetic scattering mechanisms. Many existing complex-valued networks can preserve amplitude-phase information, but they are often limited in long-range spatial dependency modeling and usually incorporate polarimetric priors only as input-level or shallow auxiliary features. As a result, physical knowledge is insufficiently used to guide deep feature evolution. To address this issue, this paper proposes CV-SSMNet, a physics-aware complex-valued state-space network with scattering-aware feature modulation for PolSAR image classification. The proposed method builds a complex-valued state-space model (CV-SSM) in the original complex domain to capture long-range spatial dependencies while preserving polarimetric amplitude-phase coupling. Meanwhile, seven physically meaningful scattering priors, are encoded as FiLM-style modulation signals to adaptively recalibrate complex-valued representations during feature evolution. CV-SSMNet further integrates multi-scale complex convolutions, branch-wise CV-SSM encoding, prior-guided recalibration, and lightweight global context aggregation, enabling physically guided representation learning from local scattering structures to global spatial context. Experiments on three L-band benchmark datasets and an additional P-band BIOMASS evaluation demonstrate that CV-SSMNet achieves competitive accuracy, improved regional consistency, and better boundary preservation, supporting the effectiveness of embedding polarimetric scattering mechanisms into complex-valued long-range GeoAI representation learning.
53. 【2607.19781】WASABI: Whole-graph Assignment-based Stabilizer for lAne topology By Inter-frame tracking
链接：https://arxiv.org/abs/2607.19781
作者：Tetsuhiro Uchida,Myu Sasaki,Kensho Nakajima,Yasuhiro Shimada,Toru Saito
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous driving requires, driving requires understanding, Autonomous driving, reason about cross, driving requires
备注：
点击查看摘要
Abstract:Autonomous driving requires understanding the road as a graph of drivable lanes and their connectivity, beyond the ego lane alone, to follow routes through intersections and reason about cross- and merging-traffic. Recent perception models infer such lane topology, i.e., lane segments together with their inter-lane connectivity (LCLC), from onboard sensors over a 360-degree BEV view. Due to neural perception's imperfections, their outputs retain structural instabilities such as missed detections, lost or incorrect LCLC, over-detection, and label flicker. This paper presents WASABI, a real-time post-processing pipeline that stabilizes lane topology outputs both within and across frames by treating lane segments and their LCLC connectivity as joint tracking targets, under onboard real-time constraints (10 Hz / 20 ms / up to 200 input lanes). The pipeline integrates segment tracking with connectivity, noise-robust topology-aware refinement, and a resource-constrained real-time design. On internal validation data (16 sequences), WASABI improves LCLC detection F1 from 0.834 to 0.948 (+0.114, +13.6%) and reduces centerline lateral error from 2.50 m to 0.95 m, while reducing detection false-positives by 24.6%. Temporal-stability metrics on the same data show LCLC toggle rate reduced by 63.3% and boundary-label flicker rate by 30.2%, confirming across-frame stabilization beyond per-frame accuracy.
54. 【2607.19779】Frequency-Hierarchical Active k-Space Sampling for Diagnostic MRI
链接：https://arxiv.org/abs/2607.19779
作者：Ruru Xu,Kian Anvari Hamedani,Zhikai Yang,Ilkay Oksuz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tight sampling budget, accelerated MRI, MRI must distribute, tight sampling, sampling budget
备注： EMA4MICCAI 2026: The 2nd MICCAI Workshop on Efficient Medical AI
点击查看摘要
Abstract:Active sampling for accelerated MRI must distribute a tight sampling budget across spatial frequencies that carry very different kinds of information. Low frequencies hold most of the anatomical context; high frequencies carry the fine details that drive pathology assessment. Existing active samplers either treat both regions identically or restrict the action space to entire Cartesian rows, which forces a poor compromise at high acceleration. We propose HieraSample, a task-driven framework built around this hierarchy. A cosine-annealed curriculum lowers the acceleration factor from 20x to 4x across 80 acquisition steps while keeping a fully-sampled low-frequency disk at every step; a Mamba-based policy then picks individual high-frequency coordinates from features extracted by dual disease and severity classifiers. The reward is the per-sample reduction in class-weighted cross-entropy after each action, so a positive reward corresponds directly to a more confident correct prediction. On the fastMRI+ knee benchmark, HieraSample matches the fully-sampled oracle on ACL diagnosis from 4x to 10x acceleration, and improves on a recent Cartesian baseline by as much as 20.4 AUC points on ACL severity.
55. 【2607.19777】Look Before You Edit: Attention-Guided Camera Placement and Multi-View Alignment for 3D Gaussian Splatting Editing
链接：https://arxiv.org/abs/2607.19777
作者：Jaeyeon Park,Taeho Kang,Youngki Lee
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：target specific objects, fixed training cameras, Gaussian Splatting, Editing Camera Placement, typically applies
备注：
点击查看摘要
Abstract:Text-driven 3D scene editing with 3D Gaussian Splatting (3DGS) typically applies a 2D diffusion editor to views rendered from fixed training cameras, limiting both the spatial coverage of edits and the user's freedom to target specific objects in complex scenes. We present LB-Edit, a framework that addresses two coupled problems: where to place editing cameras for localized edits, and how to make per-view edits agree with one another so that the 3D scene remains consistent after fine-tuning. First, Attention-Guided Editing Camera Placement (ACP) probes the diffusion model's self- and cross-attention at multiple candidate camera distances to find where attention is well-contained in the region of interest, then places a compact, geometrically diverse editing camera set at that attention-optimal distance. Second, Multi-view Attention Alignment (MAA) steers the editor toward the same edit across views along two axes: it aligns appearance by sharing self-attention features via token-level correspondence, and aligns spatial location by lifting cross-attention maps onto the 3D Gaussians as a shared 3D attention field, suppressing both appearance and spatial drift. Experiments on multi-object and single-object scenes show that our method achieves the highest user preference in instruction fidelity, multi-view consistency, and editing locality, using as few as 5 editing views and reducing latency by up to 7x over existing methods.
56. 【2607.19772】DRGBT-1K: A Large-scale High-quality Benchmark for Dynamic RGBT Tracking
链接：https://arxiv.org/abs/2607.19772
作者：Zhaodong Ding,Chenglong Li,Zeyu Ding,Futian Wang,Jin Tang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：RGBT, observation platforms vary, vary over time, aims to continuously, continuously localize
备注： Submitted to TIP (Under Review)
点击查看摘要
Abstract:Dynamic RGBT (DRGBT) tracking aims to continuously localize a target when the available sensing modalities and observation platforms vary over time. Compared with conventional RGBT tracking with fixed RGBT inputs and a fixed observation platform, DRGBT tracking is more consistent with real-world collaborative perception systems, where targets may be observed by heterogeneous sensors from different viewpoints. However, existing benchmarks are still insufficient for systematically evaluating tracker robustness under real dynamic modality variations and cross-platform transitions. To address this limitation, we make the following contributions. 1) We construct DRGBT-1K, a large-scale high-quality benchmark for DRGBT tracking. It contains 1,045 sequences captured entirely in real-world scenarios and 795K RGBT frame pairs collected using UAVs and handheld RGBT devices, encompassing diverse real-world scenes, pronounced viewpoint changes, modality variations, and target appearance discontinuities. 2) We provide comprehensive annotations for fine-grained evaluation, including dense bounding boxes, target category labels, challenge attributes, frame-level modality labels and platform labels. DRGBT-1K covers 24 target categories, more than 15 scene types and 15 challenge attributes. 3) We establish a comprehensive benchmark by evaluating 20 representative multimodal tracking methods, including conventional RGBT trackers, modality-missing RGBT trackers, and DRGBT trackers under a unified evaluation protocol. 4) We release an unaligned version of DRGBT-1K and derive UGVT-1K to support broader research on unaligned multimodal tracking and UAV-ground collaborative tracking. 5) We develop an online evaluation platform for DRGBT-1K and provide a leaderboard that collects all methods evaluated on this benchmark.
57. 【2607.19766】Global Building Area Estimation Products: How Accurate Are They?
链接：https://arxiv.org/abs/2607.19766
作者：Saad Lahrichi,Doa'a Allabadi,Kyle Bradbury,Jordan Malof
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：improving energy efficiency, greenhouse gas emissions, tracking greenhouse gas, Geo-spatial rasters, Human Settlement Layer
备注： 29 pages, 4 figures, 7 tables
点击查看摘要
Abstract:Geo-spatial rasters of building footprint area are useful for a variety of tasks, such as monitoring urbanization, improving energy efficiency, and tracking greenhouse gas emissions. There are now multiple global building raster datasets, however there lacks an independent, comprehensive, and fair assessment of their accuracy. In this work, we evaluate the accuracy of four major global building products: Global Human Settlement Layer (GHSL), Microsoft's TEMPO (TEMPO), The Global Building Atlas (GBA), and Overture. As ground truth for assessing their accuracy, we use ORBITaL-Net, a globally diverse dataset of manually labeled building footprints. To ensure fairness, we evaluate products on grids of multiple spatial resolutions, and several conventional performance metrics. Our results indicate that either GBA or TEMPO generally achieves the highest overall accuracy, depending upon the particular evaluation criteria. We also stratify the accuracy of each product by several factors: geographic location, population density, and income groups. The results reveal that product accuracy can sometimes vary significantly with respect to these factors. Notably, all products are significantly less accurate in Africa and Asia. Most products also suffer significant accuracy reduction in high-density urban areas.
58. 【2607.19765】Extending a Large View Synthesis Model for Multi-view Panoptic Segmentation
链接：https://arxiv.org/abs/2607.19765
作者：Kwonyoung Ryu,In-Jae Lee,Jonghyun Jin,Hyunjee Lee,Jongmin Lee,Jaesik Park
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：view synthesis, learn accurate spatial, Large view synthesis, RGB view synthesis, view synthesis models
备注： Accepted to ECCV 2026. 31 pages, 7 figures, 9 tables. Project page: [this https URL](https://kwonyoung9120.github.io/PanopticLVSM/)
点击查看摘要
Abstract:Large view synthesis models synthesize novel views through cross-view attention without explicit 3D representations, and recent studies have shown that they learn accurate spatial correspondence from RGB supervision alone. We observe that this correspondence generalizes beyond appearance. When non-photorealistic signals such as binary encoded panoptic labels are passed through the model, they are propagated to novel views with consistent spatial structure. These results indicate that the correspondence learned for RGB view synthesis can also propagate view-independent per-pixel labels. From this observation, we present the first work to extend large view synthesis models beyond appearance rendering to 3D scene understanding. We propose a panoptic segmentation pipeline that reuses a frozen view synthesis model to propagate panoptic labels from input views to novel views, without 3D reconstruction or any segmentation-specific training of the view synthesis model. Given panoptic labels on the input views, we encode them into binary channel representations and pass them through the same model to render target-view segmentation. On ScanNet, our method achieves segmentation quality on par with Gaussian based approaches requiring explicit 3D reconstruction, while outperforming them in novel view synthesis by more than 7 dB. The label propagation also transfers across datasets, surpassing these approaches on Replica without any fine-tuning.
59. 【2607.19745】EgoRecovery: Acquiring Failure Recovery Ability Through Human Recovery Demonstration
链接：https://arxiv.org/abs/2607.19745
作者：Zuhao Ge,Yuchen Zhou,Weitao Zhou,Minglei Li,Xinyu Li,Chao Wu,Hanwen Zhao,Haotian Wang,Zuxuan Wu,Xiaosong Jia,Yu-Gang Jiang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Robust embodied robots, Robust embodied, recovery, order to operate, operate reliably
备注：
点击查看摘要
Abstract:Robust embodied robots should be able to recover from failures and retry tasks in order to operate reliably in unstructured and noisy real-world environments. Achieving this capability requires training policies on data that captures recovery behaviors. However, collecting such data through robot teleoperation is difficult to scale, as it is time-consuming to induce diverse failure states, perform corrective actions, and reset the environment. This challenge is further exacerbated by the high diversity of failure modes, which demands substantially more recovery data than success demonstrations. In this work, we show that egocentric human data capturing failure recovery processes provides a scalable alternative. By efficiently arranging task-level failure configurations and recording short recovery segments, human operators can generate more than 10x as much valid recovery data per hour compared to robot teleoperation under our protocol. To address the embodiment gap between human and robot, we propose EgoRecovery, a co-training framework for learning recovery behavior, where human recovery demonstrations are aligned to a compact corrective-intent space shared with robot data, which captures the timing and magnitude of correction. Only a small number of robot recovery demonstrations are required to connect this intent to executable robot actions. At deployment, a learned recovery gate predicts when correction is needed from robot observations and activates the corrective intent only in recovery states. Experiments on real-world recovery tasks show that EgoRecovery improves success from failure starts over robot-only recovery, direct co-training with human recovery data, and direct intent-transfer baselines.
60. 【2607.19743】Efficient Tracking and Understanding Object Transformations
链接：https://arxiv.org/abs/2607.19743
作者：Yihong Sun,Bharath Hariharan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：understanding real-world dynamics, real-world dynamics, essential for understanding, understanding real-world, Tracking objects
备注：
点击查看摘要
Abstract:Tracking objects through state transformations is essential for understanding real-world dynamics. However, existing methods are computationally expensive. TubeletGraph recently showed impressive capabilities, but its inference cost (~$4.4$ seconds per object-frame on VOST) precludes any real-time deployment possibilities. We observe that TubeletGraph's overhead arises from building a spatiotemporal partition of the input video: (1) entity segmentation is computed densely for every frame regardless of whether a transformation occurs, and (2) every entity in the scene is tracked, scaling cost with scene complexity rather than the number of transformations of interest. To address both, we propose FluxGraph, a reactive variant that uses SAM2's internal multi-mask disagreement as a lightweight trigger for transformation detection, and removes the need for tracking all entities in the given video. FluxGraph is ~$3.3\times$ faster than TubeletGraph on VOST while improving tracking performance and preserving state graph quality. Furthermore, we also observe consistent speedups of $3.7-10.7\times$ across VSCOS, M$^3$-VOS, and DAVIS17 while maintaining performance. Code is publicly available at this https URL.
61. 【2607.19726】An Exploratory Analysis of Pain Localization via Explainable Computational Modeling
链接：https://arxiv.org/abs/2607.19726
作者：Ioannis Kyprakis,Stefanos Gkikas,Eric Nichols,Yu Fang,Manolis Tsiknakis
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：largely unaddressed problem, Automatic pain localization, peripheral physiological signals, Automatic pain, patient self-report
备注： Accepted at the 14th International Conference on Affective Computing and Intelligent Interaction (ACII 2026)
点击查看摘要
Abstract:Automatic pain localization, which involves identifying the anatomical origin of pain from peripheral physiological signals without patient self-report, is a clinically critical but largely unaddressed problem, particularly for non-verbal patients. This paper presents a systematic comparison of classical feature engineering and deep sequence learning for subject-independent three-class pain localization using the AI4Pain 2026 Challenge dataset, which comprises four synchronously recorded wearable modalities: electrodermal activity, blood volume pulse, respiration, and peripheral oxygen saturation recorded from 65 participants under controlled TENS-induced pain. A 115-dimensional hand-crafted feature set spanning time-domain, frequency-domain, modality-specific, and cross-modal descriptors is benchmarked against end-to-end deep architectures. Extremely Randomized Trees achieves the highest macro-F1 of 0.539, outperforming the best deep model by 7.4 percentage points, with EDA spectral features emerging as the dominant discriminators. A consistent 26-point gap between pain detection (F1\,=\,0.815) and localization (F1\,=\,0.552) across all models points to a fundamental ceiling imposed by the anatomical diffuseness of peripheral autonomic pathways at 10-second resolution.
62. 【2607.19725】Analytic Distribution of Classifier-Free Guidance for Schedule Design
链接：https://arxiv.org/abs/2607.19725
作者：Enze Jiang,Zheng Ma
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：deterministic guided dynamics, usual product-distribution heuristic, Classifier-free guidance, default mechanism, mechanism for conditional
备注：
点击查看摘要
Abstract:Classifier-free guidance (CFG) is the default mechanism for conditional generation in diffusion models, but the distribution sampled by its deterministic guided dynamics is not captured by the usual product-distribution heuristic $p_0^\omega q_0^{1-\omega}$. We analyze CFG through the probability flow ODE and derive exact analytic path-integral representations of the induced distributions for both constant and time-dependent guidance. The resulting formulas show that CFG modifies $p_{t_0}$ by an exponential path-integral correction, and that a time-dependent schedule enters this correction through the weight $\omega(t)-1$. This characterization explains how score discrepancies accumulate along sampling trajectories and motivates Distribution-Guided CFG (DG-CFG), a schedule that balances timestep contributions while accounting for signal strength and low-noise score-error amplification. A toy model with analytic scores closely verifies the predicted distributions. On Stable Diffusion~1.5, DG-CFG improves generation and yields a stronger diversity--fidelity trade-off across guidance strengths, with especially clear gains when strong guidance causes saturation and quality degradation in constant and heuristic schedules. Across NFE budgets, DG-CFG reaches fixed image-quality targets with fewer sampling steps, reducing the sampling cost needed to achieve target metrics.
63. 【2607.19722】ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessment
链接：https://arxiv.org/abs/2607.19722
作者：Stefanos Gkikas,Yu Fang,Christian Arzate Cruz,Muhammad Umar Khan,Raul Fernandez Rojas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Automatic pain assessment, pain-related facial cues, Automatic pain, remains challenging due, video remains challenging
备注： Accepted at the 14th International Conference on Affective Computing and Intelligent Interaction (ACII 2026)
点击查看摘要
Abstract:Automatic pain assessment from facial video remains challenging due to the spatial heterogeneity of pain-related facial cues. This study proposes ReFace, a spatial reorganization pipeline that divides facial input into four spatial quadrants before tokenization, rather than processing the entire face as a single region. Evaluated on the AI4Pain dataset, the proposed approach achieves $56.00\%$ accuracy on the test set using video only, achieving the highest reported accuracy under the fixed AI4Pain benchmark protocol among the compared methods. Notably, the four-quadrant configuration processes the same total pixel budget as the full-face input, yet achieves higher accuracy, suggesting that spatial reorganization can improve performance under the proposed tokenization design. A single quadrant region, processing just one quarter of those pixels, remains competitive at a fraction of the computational cost.
64. 【2607.19716】A Unified Tokenization Framework for Pain Recognition using Heterogeneous 3D Modalities
链接：https://arxiv.org/abs/2607.19716
作者：Stefanos Gkikas,Christian Arzate Cruz,Valentina Becchetti,Muhammad Umar Khan,Alessandro Giuseppi,Raul Fernandez Rojas
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pervasive phenomenon affecting, effective clinical management, management and intervention, complex and pervasive, pervasive phenomenon
备注： Accepted at the 28th ACM International Conference on Multimodal Interaction (ICMI 2026)
点击查看摘要
Abstract:Pain is a complex and pervasive phenomenon affecting a large percentage of the population, and accurate assessment is essential for effective clinical management and intervention. Computational pain recognition systems enable continuous monitoring, support clinical decision-making, and help mitigate pain-related distress and functional decline. This study introduces a unified tokenization framework for heterogeneous 3D modalities in pain recognition that provides a single processing pipeline across behavioral and brain-activity 3D data, without requiring separate architectures for each modality or handcrafted inductive biases. The framework preserves spatial, temporal, and time--frequency structure while mapping diverse inputs into a shared token space. Extensive experiments show that the proposed approach effectively processes facial videos and fNIRS data in both raw-signal and spectrogram-based representations. On the AI4Pain benchmark dataset, the proposed framework achieves state-of-the-art performance while maintaining high computational efficiency and enabling real-time assessment on both GPU and CPU hardware.
65. 【2607.19711】Point-Selection Fine-Tuning Framework for Robust Point Cloud Classification
链接：https://arxiv.org/abs/2607.19711
作者：Da Li,Chang Ma,Dongfu Yin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cloud recognition performance, substantially degrade point, degrade point cloud, point cloud recognition, challenging corruption settings
备注：
点击查看摘要
Abstract:Noisy and corrupted points can substantially degrade point cloud recognition performance, especially under challenging corruption settings. In particular, full fine-tuning of 3D pre-trained models may amplify the influence of outliers and overwrite robustness priors learned during pre-training, while naive parameter-efficient adaptation remains sensitive to corrupted tokens. To address this issue, we propose PSFT, a point-selection fine-tuning framework that improves robustness while remaining parameter-efficient. PSFT first estimates point-wise influence from pre-pooling features and adaptively retains minimally influential points to suppress outliers. Based on the selected subset, a prompt generation branch predicts layer-wise prompt tokens and injects them into a frozen backbone for lightweight downstream adaptation. To further mitigate residual noise after selection, we append a lightweight feature filter with bottleneck MLP transformation and Beta-gated residual blending to refine patch-token representations before prediction. Extensive experiments show that PSFT consistently reduces corruption error on ModelNet-C and ModelNet40-C across all tested 3D pre-trained backbones, while achieving the strongest ScanObjectNN-C results with ULIP-2 and Uni3D-B among the evaluated tuning strategies. Our implementation can be found at this https URL.
66. 【2607.19701】SafeGen: Goal-Conditioned Video Diffusion of Safety-Critical Scenarios for VLM-Based Autonomous Driving
链接：https://arxiv.org/abs/2607.19701
作者：Jiangfan Liu,Zexuan Cui,Tianyuan Zhang,Zonglei Jing,Zonghao Ying,Yaoyuan Zhang,Jiakai Wang,Xiaoqi Jiang,Aishan Liu,Xianglong Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：rigorous safety evaluation, creating an urgent, safety-critical scenario generation, increasingly deployed, rigorous safety
备注：
点击查看摘要
Abstract:VLMs are increasingly deployed in AD systems, creating an urgent need for rigorous safety evaluation under rare yet safety-critical scenarios. Among these, interactions with vulnerable road users represent a major source of real-world failures. However, existing safety-critical scenario generation methods predominantly rely on simulator-based pipelines, which suffer from a substantial sim-to-real gap and often fail to capture realistic, diverse, and unforeseen human-vehicle interaction dynamics. We present SafeGen, a goal-conditioned diffusion framework for safety-critical scenario generation in VLMADs. Our key insight is to formulate scenario generation as a goal-conditioned diffusion process, where a predefined catastrophic end-state serves as a strong supervisory signal, guiding the generation of temporally coherent video trajectories that naturally evolve toward safety-critical outcomes. Building on this formulation, we introduce Context Grounded End State Reasoning, which leverages VLMs to analyze benign driving contexts and infer latent vulnerabilities in human-vehicle interactions, producing structured end-state specifications that induce high-risk scenarios. Conditioned on these targets, we further propose End State Conditioned Video Evolution, which grounds semantic threats into physically plausible visual dynamics. Specifically, we instantiate high-risk agents within the scene via depth-aware geometric projection, followed by boundary-conditioned diffusion to generate intermediate frames with consistent motion patterns and temporal coherence. Extensive experiments across 3 VLMADs demonstrate that SafeGen increases the Judge Overall Score, a metric using a VLM judge to evaluate VLMADs' understanding and decision-making, by 24.25% on average compared to SoTA baselines. Furthermore, fine-tuning a VLMAD improves performance in real-world driving scenes by an average of 15.9%.
67. 【2607.19696】PhenSPINE: A Standardized Benchmark for Spine Pathology Diagnosis
链接：https://arxiv.org/abs/2607.19696
作者：Duong Ngoc Vu,Hai Son Nguyen,Trong-Nghia Nguyen,Bien Tran Van,Trang Mai Xuan,Huan Vu,Thien Van Luong
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：spinal pathologies depends, pathologies depends heavily, Magnetic Resonance Imaging, radiological interpretation, lack of diverse
备注： 12 pages, figures, Accepted at CITA 2026 (The 15th Conference on Information Technology and its Applications, Scopus)
点击查看摘要
Abstract:The accurate diagnosis of spinal pathologies depends heavily on radiological interpretation, yet automated systems are hindered by the lack of diverse, high-quality benchmarks. In this study, we present PhenSPINE, a Magnetic Resonance Imaging dataset comprising 16,813 images from 250 patients, curated to facilitate advanced deep learning research. We propose a robust diagnostic benchmark that integrates state-of-theart convolutional backbones with a Positional Encoding mechanism to explicitly model the anatomical context of intervertebral discs. Evaluating across four standard MRI sequences, our experiments demonstrate that the Sagittal T2-weighted sequence offers the most robust diagnostic value, achieving a superior Macro F1-score of 50.31%. We find that multisequence fusion strategies yield inferior performance compared to this single-sequence baseline, as the images across sequences in our dataset are significantly compromised by noise interference from surrounding anatomical regions. This work establishes a robust baseline and offers critical insights into sequence selection for spine analysis.
68. 【2607.19695】NavVerse: Benchmarking Indoor-to-Outdoor Embodied Navigation in Continuous Robot Simulation
链接：https://arxiv.org/abs/2607.19695
作者：Junzhe Wu,Yue Hu,Zeyu Han,Po-Hsun Chang,Yinan Dong,Behrad Rabiei,Maani Ghaffari
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：single continuous episode, deployed in delivery, emergency-response settings, navigate from buildings, buildings to streets
备注：
点击查看摘要
Abstract:Robots deployed in delivery, campus, and emergency-response settings often need to navigate from buildings to streets within a single continuous episode. Existing benchmarks usually evaluate indoor and outdoor navigation separately, and many abstract away robot execution, leaving exit finding, boundary traversal, adaptation, and kinodynamic failures underexplored. We introduce NavVerse, a physics-enabled benchmark for indoor-to-outdoor embodied navigation. NavVerse contains 100 indoor scenes, 50 urban outdoor scenes, and 50 indoor-to-outdoor scenes, and 10,000 episodes spanning Object Navigation, Vision-and-Language Navigation, and Place Navigation tasks, where agents search for semantic points of interest such as restaurants or banks. Agents are evaluated through executable robot interfaces using task-success, path-efficiency, and safety metrics. Zero-shot experiments with RL, VLA, and modular baselines show that current agents remain far from solving cross-context navigation: end-to-end VLAs obtain the highest zero-shot success, while the modular method provides the strongest safety profile. PlaceNav further reveals a clear drop from outdoor to indoor-to-outdoor scenes, indicating that adaptation remains major bottleneck.
69. 【2607.19669】A Unified Variational Framework for Deep Weakly Supervised Image Segmentation
链接：https://arxiv.org/abs/2607.19669
作者：Yin King Chu,Lingfeng Li,Sung Ha Kang,Jianping Zhang,Xue-Cheng Tai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：unified variational framework, sparse pixel-level supervision, pixel-level supervision, Kernel Hilbert Space, propose a unified
备注：
点击查看摘要
Abstract:We propose a unified variational framework for image segmentation under sparse pixel-level supervision. Our method is based on a simplex-constrained Potts model with a smooth perimeter regularizer, yielding a convex, smooth energy functional that can be used as a training loss in weakly supervised deep learning paradigms or optimized efficiently using iterative methods. Sparse labels are incorporated into the data fidelity term by constructing a fuzzy membership function via a function extension problem in a Reproducing Kernel Hilbert Space (RKHS), which can effectively capture inhomogeneous intensity statistics. The derived discrete loss for training standard networks demonstrates robustness and consistent improvements over non-training and partial cross-entropy (PCE) baselines in experiments, achieving comparable performance without requiring ground-truth segmentation images.
70. 【2607.19643】Domain Shift in Echocardiography: Interpretable Quantification and Prediction of Cross-Dataset Left Ventricular Segmentation
链接：https://arxiv.org/abs/2607.19643
作者：Soroush Elyasi,Nasim Dadashi Serej,Julie Wall,Massoud Zolgharni
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Cross-dataset generalisation remains, echocardiographic left ventricular, Cross-dataset generalisation, left ventricular segmentation, rarely disentangled
备注：
点击查看摘要
Abstract:Cross-dataset generalisation remains a major barrier to clinical deployment of echocardiographic left ventricular segmentation, yet the sources of this shift are rarely disentangled. We examined whether transfer degradation could be estimated before deployment using handcrafted ultrasound descriptors, VAE latent features, and segmentation-derived latent features across six echocardiographic datasets. Geometry-aware preprocessing substantially improved several poor transfer cases, suggesting that much of the apparent domain shift reflects field-of-view and framing inconsistencies rather than intrinsic acoustic differences alone. Intensity z-normalisation changed dataset separability by less than 0.005, indicating that brightness and contrast are not the dominant shift axis. Absolute Dice drop on held-out source-target pairs was predicted with an R-squared value of 0.612, an MAE of 0.082, and a Spearman rho of 0.681. The variant without LV and fan-shaped features retained approximately 70% of this explanatory power, supporting mask-free transfer-risk monitoring. The most informative discrepancy measure depended on the representation, with CMD strongest in z-normalised handcrafted features, with an absolute r of approximately 0.86 and an R-squared value of approximately 0.70; log-Wasserstein strongest in VAE space, with an r of approximately -0.90 and an R-squared value of approximately 0.81; and log-MMD strongest in LV-segmentation latent features, with an r of approximately -0.92 and an R-squared value of approximately 0.84. Apparent vendor effects were largely dataset-confounded. Echocardiographic domain shift is therefore structured and measurable, and its impact on segmentation can be partly reduced through geometry-aware preprocessing and anticipated using representation-specific transfer-risk estimation.
71. 【2607.19624】Pathologist Attention-Aligned Report Generation for Prostate Histopathology
链接：https://arxiv.org/abs/2607.19624
作者：Ruoyu Xue,Suryakant Singh,Souradeep Chakraborty,Pierre Marza,Oksana Yaskiv,Constantin Friedman,Natallia Sheuka,Paul Friedman,Bharat Ramlal,Beatrice Knudsen,Rajarsi Gupta,Joel Saltz,Prateek Prasanna,Gregory Zelinsky,Dimitris Samaras
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：highly selective process, highly selective, selective process, process that critically, critically shapes
备注： 11 pages, 4 figures, accepted for publication at the 29th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI 2026)
点击查看摘要
Abstract:The allocation of visual attention by pathologists during cancer diagnosis is a highly selective process that critically shapes the information extracted from whole-slide images (WSIs). Human attention helps medical imaging tasks such as classification and segmentation, and becomes a strong semantic cue for identifying diagnostically informative regions for report generation. In this paper, we introduce human attention into the training of pathologist report generation models. To this end, we collected a multimodal human-attention dataset of 121 prostate WSIs annotated with pathologists' multi-scale viewport trajectories synchronized with the pathologists' verbal descriptions and cursor movements for five clinically relevant components (e.g., Gleason patterns). Using this dataset, we finetune two report generation models with an attention-alignment loss that regularizes the model attention over image patches to match the distribution of pathologist attention. We evaluate our approach on prostate cancer report generation and visual question answering using two models with different internal attention mechanisms (i.e., how image tokens are integrated into the language decoder). Experiments show average gains of 10.9% on NLP-based metrics and 19.3% in accuracy across five clinically relevant report components. Further, model attention maps extracted at inference time, with minimal computational overhead, align more closely with pathologist attention, providing stronger visual support for the generated reports by highlighting the regions that most influence the output.
72. 【2607.19617】EGRNet: A Lightweight Semantic Segmentation Network with Edge-Gated Refinement and Adversarial Sensing
链接：https://arxiv.org/abs/2607.19617
作者：Bareera Qaseem,Mohsin Kamal,Muhammad Naveed Aman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：smart cities continue, robust scene understanding, continue to evolve, increasingly critical, systems and smart
备注： 14 pages, 8 figures, 3 tables and 1 algorithm
点击查看摘要
Abstract:As autonomous systems and smart cities continue to evolve, the demand for efficient and robust scene understanding becomes increasingly critical. Semantic segmentation plays a key role in enabling autonomous vehicles to comprehend complex urban environments. However, achieving high accuracy with minimal computational cost remains a significant challenge. In this paper, we present Edge-Gated Refinement Network (EGRNet), a lightweight and efficient deep learning model designed for real-time semantic segmentation in urban scenarios. The model incorporates depthwise separable convolutions to reduce computational complexity and dilated residual blocks for capturing rich multi-scale contextual information. Additionally, we introduce a novel Edge-Gated Refinement (EGR) module, which adaptively fuses original and refined features through a learnable gating mechanism, enhancing boundary preservation and edge-sensitive regions. To further improve feature representation, Squeeze-and-Excitation (SE) attention is applied across the network. With only 0.46M parameters, EGRNet achieves state-of-the-art performance while maintaining low computational overhead. When evaluated on the Cityscapes dataset, the model attains a mean Intersection over Union (mIoU) of 65.28%, demonstrating strong accuracy with minimal resource consumption. Moreover, we introduce a lightweight adversarial attack detection strategy, ensuring robustness against adversarial inputs without compromising real-time performance. By combining efficiency, accuracy, and resilience, EGRNet is well-suited for deployment on edge devices in safety-critical real-time applications.
73. 【2607.19575】VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers
链接：https://arxiv.org/abs/2607.19575
作者：Xianghong Fang,Yuan Yuan,Dehan Kong,Tim G. J. Rudner
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：underpins modern discrete, discrete visual tokenization, modern discrete visual, underpins modern, visual tokenization
备注： 20 pages, 9 figures and 16 tables
点击查看摘要
Abstract:Vector Quantization (VQ) underpins modern discrete visual tokenization. However, training quantization modules for state-of-the-art VQ-based models requires significant computational resources which, in practice, all but prevents the development of novel, cutting-edge VQ techniques under resource constraints. To address this limitation, we propose {\bf VQ-Transplant}, a simple framework that enables plug-and-play integration of new VQ modules into frozen, pre-trained tokenizers by replacing their native VQ modules. Crucially, the proposed transplantation process preserves all encoder-decoder parameters, obviating the need for costly end-to-end retraining when modifying the quantization method. To mitigate decoder-quantization mismatch, we introduce a lightweight decoder adaptation strategy (trained for only 5 epochs on ImageNet-1k) to align feature priors with the new quantization space. In our empirical evaluation, we find that VQ-Transplant allows obtaining near state-of-the-art reconstruction fidelity for industry-level models like VAR while reducing the training cost by 95\%. VQ-Transplant democratizes quantization research by enabling resource-efficient integration of novel VQ techniques while matching industry-level reconstruction performance.
74. 【2607.19547】ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning
链接：https://arxiv.org/abs/2607.19547
作者：Santiram Tiwari,Nishant Sinha,Kunal Kislay
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：Long-video question answering, question answering requires, Long-video question, answering requires, repeatedly reprocessing
备注： 6 pages, 4 tables
点击查看摘要
Abstract:Long-video question answering requires a model to preserve visual evidence over time without repeatedly reprocessing the same video. A practical approach is to store the vision-language model's internal key-value (KV) cache for each video chunk and retrieve that state at query time. However, independently cached video chunks do not compose correctly: every chunk is prefilled from local rotary position zero, so naive concatenation collides temporal phases and removes the global order required for questions about what happened first, how often events occurred, or what changed across the video. This paper presents ChronoStitch, a training-free method for composing independently stored visual KV memories. The method first re-bases stored post-rotary keys onto a global three-axis multimodal RoPE coordinate system that preserves time, height, and width structure. We show why a one-dimensional scalar re-indexing is geometrically inconsistent for visual tokens because it turns spatial order within a frame into false temporal displacement. We then address the residual content gap left by positional repair: later chunks were originally encoded without attending to earlier chunks. ChronoStitch therefore selectively recomputes a small fraction of high-deviation later-chunk visual tokens while allowing them to attend over the composed cache. On Qwen2.5-VL-3B and the temporal split of TempCompass, ChronoStitch outperforms naive composition and position-only variants, improving event-ordering accuracy while running 3.3x faster than full joint re-prefilling.
75. 【2607.19535】Synthetic and Derived Training Images for Campus Waste Detection: A Multi-Seed Evaluation with YOLOv8n
链接：https://arxiv.org/abs/2607.19535
作者：Ali Behbahani,Newsha Javanmardi,Shahriar Ahmed,Ling Chen,Phouvadeth Vathana
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：campus recycling streams, contaminate campus recycling, Incorrect disposal, recycling streams, disposal can contaminate
备注：
点击查看摘要
Abstract:Incorrect disposal can contaminate campus recycling streams, and a bin-mounted camera could provide feedback as an item is discarded. We evaluated whether synthetic and derived images improve a YOLOv8n detector for this view. The real dataset contained 148 campus photographs: 86 for training, 31 for validation, and 31 for testing. Twelve joint-training configurations varied the amount and source of added images. We repeated seven principal settings with four matched seeds and computed bootstrap percentile intervals over those seeds. The real-only model reached a mean mAP@0.5 of 0.691 [0.665, 0.722]. Background replacement reduced the mean to 0.560 [0.499, 0.619], isolated-object images gave 0.680 [0.644, 0.724], and the full augmentation pool gave 0.487 [0.438, 0.537]. We also tested hand-and-forearm composites because every real photo showed a held object. Two cutouts in the initial composite set came from test photographs, so we discarded that experiment, rebuilt the set with training-split cutouts, and reran all four seeds. The corrected paired difference was +0.034 [-0.063, 0.199], which does not support a reliable hand-composite effect. Single-seed transfer experiments produced source-dependent rankings between joint mixing and sequential pretraining. None of the evaluated configurations exceeded the real-only baseline. The reported intervals quantify seed variation; the 31-photo test set remains too small for strong class-specific conclusions.
76. 【2607.19528】D3VL: Understanding Driving Scenes from 3D Time Series Data and Video with Language Models
链接：https://arxiv.org/abs/2607.19528
作者：Heesang Han,A. Lynn Abbott,Abhijit Sarkar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Multimodal Large Language, Large Language Models, Multimodal Large, Large Language, Recent advances
备注： Accepted to IEEE IV 2026
点击查看摘要
Abstract:Recent advances in Multimodal Large Language Models (MLLMs) have triggered the development of end-to-end MLLMs for autonomous driving. However, the main emphasis to date has been for MLLMs using 2D images and videos. In contrast, this paper considers MLLM effectiveness using 3D sensors, particularly LiDAR and stereo cameras. LiDAR presents unique challenges to integration within an MLLM, largely because of data sparsity and lack of a grid structure for the data. For similar reasons, fusion of camera and LiDAR data within an MLLM pipeline is also uncommon. However, most autonomous systems rely on LiDAR-based sensing, and incorporating 3D data has been proven to improve performance in traditional 3D scene perception tasks. This paper presents D3VL, a novel MLLM framework that integrates 2D and 3D time-series data in a single but simple architecture. The model aims to answer questions involving traffic scene understanding and safety. D3VL shows an 11% improvement in the KITTI Question-Answering (QA) dataset compared to baseline methods in processing 2D and 3D time-series data. This paper further introduces the Waymo QA dataset extension, which assesses models' capabilities in processing 3D and time-series data under diverse driving conditions. D3VL implementation code and WaymoQA extension can be found on our supplemental website: this https URL
77. 【2607.19522】Geospatial Diffusion-based Evolution Synthesis (GeoDES) for Storm-Centered Weather Augmentation
链接：https://arxiv.org/abs/2607.19522
作者：Sonia Cromp,Satya Sai Srinath Namburi GNVV,Youran Wang,Grace Kisslinger,Frederic Sala,James Booth,Allegra LeGrande
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：hold significant promise, models hold significant, machine learning-based weather, large-scale weather systems, Diffusion-based Evolution Synthesis
备注： 31 pages, 11 figures
点击查看摘要
Abstract:While machine learning-based weather models hold significant promise, they struggle to predict the detailed structure of large-scale weather systems such as cyclonic storms. Regional models are constrained by limited historical records within fixed geographic boundaries, while global models are computationally expensive and often operate at resolutions too coarse to capture fine-grained storm dynamics. To bridge this gap, we introduce the Geospatial Diffusion-based Evolution Synthesis (GeoDES) model, a custom image-to-video diffusion model. By focusing generation strictly on the evolving storm structure, GeoDES synthesizes physically consistent, high-fidelity weather events suitable for stress-testing forecast models and expanding meteorological datasets. Evaluations demonstrate that GeoDES outperforms prior methods on key metrics, achieving $52\%$ lower Peak Vorticity Error and $8\%$ higher Anomaly Correlation Coefficient than the next strongest methods on the North Atlantic test set.
78. 【2607.19517】Crowd4D: Scene-Aware Monocular 4D Crowd Reconstruction
链接：https://arxiv.org/abs/2607.19517
作者：Hongbo Kang,Tianyi Zhou,Qingyang Yang,Hongwei Wen,Jing Huang,Yu-Kun Lai,Kun Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, severe depth ambiguity, Recovering scene-consistent, scenes remains challenging, remains challenging
备注：
点击查看摘要
Abstract:Recovering scene-consistent 4D crowd motion from monocular video in large-scale scenes remains challenging due to severe depth ambiguity and complex scene geometry. Existing monocular crowd reconstruction methods typically rely on single-plane assumptions, leading to unreliable metric scale and spatial drift under complex terrain. We propose Crowd4D, the first scene-aware 4D crowd reconstruction framework that jointly optimizes the crowd and scene from a monocular RGB video in large-scale scenes. Crowd4D explicitly incorporates scene geometry and ensures consistency across image and scene spaces via a multi-stage optimization strategy. A key bottleneck of this task lies in accurate human-scene alignment, particularly in scale and position. However, human and scene reconstructions are typically decoupled. To address this, we introduce the Human-Scene Interaction Proxy, abbreviated as HSIP, as an intermediate representation derived from Scene Interaction Point Clouds and a Scene Interaction Surface, abbreviated as SIPC and SIS. These representations encode explicit scene-aware geometric priors and redefine the optimization space for large-scale monocular 4D crowd reconstruction. To further improve temporal stability under occlusions, we introduce Crowd Structural Coherence Regularization, abbreviated as CSCR, which leverages HSIP-based spatial priors to impose soft temporal consistency on pairwise relative displacements and directions within local crowd neighborhoods. Extensive experiments demonstrate that Crowd4D consistently outperforms existing state-of-the-art methods and enables robust monocular 4D crowd reconstruction in complex, large-scale real-world scenes.
79. 【2607.19476】Detect Early, Escalate Rarely: Anytime Detection of AI-Generated Video from the Compressed Bitstream
链接：https://arxiv.org/abs/2607.19476
作者：Mert Onur Cakiroglu,Mehmet Dalkilic,Hasan Kurban
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：evaluated offline, AI-generated video, video are evaluated, large vision-language model, Abstract
备注：
点击查看摘要
Abstract:Detectors for AI-generated video are evaluated offline. A clip is decoded to pixels and scored once, increasingly by a large vision-language model. Detection, however, is deployed online. We recast the task as streaming perception and score the motion field the codec already wrote into the bitstream. Reading that field is a parse, not a pixel-domain forward pass. Because the running aggregate is monotone, one end-calibrated threshold is anytime-valid at the data-dependent decision time. Recalibrating at each prefix is not. Escalation is priced in closed form. A compute budget maps to a deferral window, on a frontier monotone exactly where the deferral condition holds. On matched GenVidBench the codec stage reaches full-length AUC 0.64 at five orders of magnitude less compute than a pixel CNN, on CPU. Its gate holds the stopping-time false-positive rate at target while the real data match its calibration, and drifts above it under distribution shift. Deferring 15% of clips lifts accuracy from 0.75 to 0.78 at $7\times$ less compute (paired: McNemar $p10^{-6}$). The stage-1 ordering replicates on AIGVDBench. We introduce no new detector. The contribution is the reframing, two guarantees, and the measured frontiers. Code, configurations, and evaluation splits: this https URL.
80. 【2607.19402】When Does Consensus Beat Voting? A Critical Analysis of Statistical Label Fusion in Medical Image Segmentation
链接：https://arxiv.org/abs/2607.19402
作者：Renjie He
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Medical Physics (physics.med-ph)
关键词：Van Leemput marginalization, self-contained investigation, Leemput marginalization analysis, Van Leemput, Spatial STAPLE
备注：
点击查看摘要
Abstract:This paper provides a rigorous, self-contained investigation of consensus segmentation. We derive the mathematical foundations from first principles -- the generative model, EM algorithm, Van Leemput's marginalization analysis, identifiability conditions, Spatial STAPLE, and deep variational formulations -- and validate each theoretical prediction through controlled experiments. The central finding is sobering: under common conditions, STAPLE reduces to thresholded majority voting, suffers 95% EM suboptimality, and collapses under class imbalance. These are not edge cases but typical scenarios in medical imaging. Majority voting -- simple, non-parametric, and robust -- is a surprisingly strong baseline that the field has perhaps too hastily dismissed in favor of more "sophisticated" methods. At the same time, the deep consensus model demonstrates that the consensus problem is not inherently difficult -- it becomes tractable when the image is used alongside the labels. And conformal prediction shows that formal uncertainty guarantees are achievable and practical. We hope this work encourages practitioners to critically evaluate their consensus methods rather than applying STAPLE by default, and provides the mathematical and empirical foundation for more principled approaches.
81. 【2607.19399】Leveraging Offline Supervision for Efficient and Generalizable Reinforcement Learning in Large-Scale Vision-Language-Action Models
链接：https://arxiv.org/abs/2607.19399
作者：Dmitriy Poyarkov,Aleksei Staroverov,Aleksandr I. Panov
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：produces better-performing strategies, online reinforcement learning, OOD, produces better-performing, commonly observed
备注：
点击查看摘要
Abstract:It is commonly observed that online reinforcement learning (RL) produces better-performing strategies than offline methods across a broad range of performance measures. In particular, RL-trained policies exhibit stronger out-of-distribution (OOD) behavior, where models trained only with imitation learning approaches often struggle. A recent study introduced an OOD-focused benchmark and reported that RL-trained vision-language-action (VLA) policies achieve noticeably better OOD performance and slightly better in-distribution (IND) performance than their counterparts trained with supervised fine-tuning (SFT). In this work, we investigate whether hybrid offline-online training can combine the advantages of both approaches. Specifically, we study RL methods regularized by offline supervision via either offline data or an offline-trained reference policy. We evaluate these approaches on the OOD benchmark and compare them with both offline-only training and standard RL. Our results show that although offline training achieves limited OOD performance by itself, incorporating offline supervision into RL preserves strong OOD capability while substantially improving training efficiency. In particular, the guided methods reach performance close to that of standard RL while requiring roughly half of the training budget. Rather than producing a trade-off between speed and OOD performance, the hybrid approach retains strong OOD capability while achieving this efficiency gain. Project page: this https URL
82. 【2607.19393】Decodable but Not Detectable: A Leakage Fingerprint for Near-OOD Benchmarks
链接：https://arxiv.org/abs/2607.19393
作者：Vishnu Bindu Balachandran
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：perturbation-based OOD detector, chance level, auditing a perturbation-based, OOD benchmark pairs, perturbation-based OOD
备注：
点击查看摘要
Abstract:While auditing a perturbation-based OOD detector on a document benchmark, we recorded an AUROC of 0.326 -- well below the 0.5 chance level. The cause is a benchmark leak: the designated "OOD" class is one the model was trained on, so its examples sit inside the in-distribution fit set and the detector is penalized for correctly ranking them as familiar. Deleting the class and retraining 35 models across two domains raises the score to 0.911. We distill the contamination into a leak fingerprint -- near-perfect supervised decodability (AUROC approximately 1) coupled with unsupervised detection collapsed below 0.65 -- and validate it on a controlled battery of 52 settings (20 leaked, 32 clean) across ResNet-50 and ViT-B/16 on CIFAR-10/100, achieving sensitivity 18/20 and specificity 31/32 in embedding space; the matched fit-set-exclusion controls are perfect at 20/20. An in-the-wild audit of 24 standard near/far OOD benchmark pairs fires on exactly one (the intrinsically hard CIFAR-100 vs CIFAR-10 pair) and on no far-OOD pair, confirming specificity and that standard cross-dataset construction is clean. Under the corrected protocol, perturbation signals are decodable but not detectable: a supervised reader recovers the OOD signal (AUROC 0.87-1.00) while no unsupervised detector does, and the perturbation method does not improve on plain Mahalanobis distance. We provide a theoretical account of why and, for transparency, retract an earlier circular correlation. The contributions are a corrected protocol and a validated leak diagnostic, not a new OOD method.
83. 【2607.19378】Native Multi-Dimensional Subquadratic Operators via Input Dependent Long Convolutions
链接：https://arxiv.org/abs/2607.19378
作者：David R. Wessels,Farhad Ramezanghorbani,David W. Romero,Alireza Moradzadeh,Olivia Viessmann,Maksim Zhdanov,John St. John,Ken Janik,David M Knigge,Yucheng Tang,Erik J Bekkers,Saee Gopal Paliwal
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：partial differential equation, recurrent models require, models require rasterizing, standard convolutions lack, require rasterizing data
备注：
点击查看摘要
Abstract:Subquadratic alternatives to attention require compromises when applied to multi-dimensional data: standard convolutions lack global receptive fields and input dependency, while recurrent models require rasterizing data such as images, volumes, and partial differential equation (PDE) into an ad-hoc $1\rm D$ scan order that violates their spatial structure. We introduce \textit{HyenaND}, a subquadratic, global, input-dependent operator that acts directly on the native geometry of multidimensional data through convolutions with implicitly parametrized global, input-dependent multi-dimensional convolutional kernels. Our CUDA implementation, \texttt{nSubQ}, fuses the FFT-convolution path to turn HyenaND's $\mathcal{O}(L \log L)$ scaling into wall-clock speedups. Across long-context genomics, computer vision, medical imaging, and PDE modeling, pure HyenaND stacks match the accuracy of strong attention baselines, while hybrid configurations that interleave HyenaND and attention layers outperform both pure attention and strong recurrence-based hybrids.
84. 【2607.19864】PRISM-DR: Per-lesion Retinal Inference with Specialist Models for Diabetic Retinopathy
链接：https://arxiv.org/abs/2607.19864
作者：Zübeyr Özeren,Tansel Uyar
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Diabetic retinopathy, low contrast, preventable blindness, manual screening, easily missed
备注： 17 pages, 9 figures, 15 tables
点击查看摘要
Abstract:Diabetic retinopathy is a leading cause of preventable blindness; its early lesions are small, low contrast, and easily missed in manual screening. Most automated detectors handle the four non-proliferative DR lesions: microaneurysms, hemorrhages, hard exudates, and soft exudates, with a single multi-class model, even though these lesions differ sharply in size, color, morphology, and prevalence, so a shared model favors common, easy classes over rare, difficult ones. We present PRISM-DR, a lesion-specific pipeline that trains one single-class detector per lesion, each with its own configuration. From a raw fundus image, the pipeline applies region of interest cropping, fundus-specific preprocessing, four parallel YOLO detectors, tiling, per-lesion ensembling of five cross-validation folds, and an inter-lesion suppression step that resolves overlaps by physical lesion size and clinical priority rather than confidence. Per lesion, the best of five YOLO generations is selected, and augmentation is tuned by Bayesian optimization. Trained on IDRiD with stratified five-fold cross-validation, the system reaches a test mAP50 of 0.527 and F1 of 0.529, highest AP50 on hard exudates with 0.561. Without fine-tuning, the models transfer well where the imaging scale is close to IDRiD and degrade as field of view and resolution depart. These modest absolute results reflect a small single-source training set and a difficult task; however, treating each lesion as a separate detection problem is a practical alternative to a single multi-class model.
85. 【2607.19600】Deep Shape Regression for Planar Curves with Multimodal Covariates
链接：https://arxiv.org/abs/2607.19600
作者：Manuel Pfeuffer,Roshan Prakash Rane,Hadya Yassin,Kerstin Ritter,Sonja Greven
类目：Methodology (stat.ME); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Quantitative Methods (q-bio.QM); Machine Learning (stat.ML)
关键词：scale and reparametrisation, geometric information, information that remains, reparametrisation are removed, open planar curves
备注： 17 pages, 4 figures, 1 algorithm. Submitted to the ShapeMI Workshop, MICCAI 2026. Code is available at [this https URL](https://github.com/mpff/dnn-shapes)
点击查看摘要
Abstract:The shape of a planar curve is the geometric information that remains once translation, rotation, scale and reparametrisation are removed and is of interest in many health applications, e.g. in neuroimaging. We propose a deep shape regression model for open planar curves that admits multimodal and high-dimensional covariates. Representing curves as complex-valued functions, we show that the conditional full Procrustes mean is the leading eigenfunction of the conditional covariance. To estimate this covariance surface, we propose a novel deep conditional covariance smoother with modality-specific encoders - e.g. splines for scalar covariates and convolutional networks for images, which classical spline smoothers cannot accommodate. Our model is by construction invariant to the translation, rotation and scaling of the input curves and handles sparsely and irregularly sampled curves. We further provide an algorithm for elastic mean estimation that also removes parametrisation by iterating covariance smoothing, rotational alignment and parametrisation alignment. We illustrate the method on simulated outlines with known conditional mean and multimodal covariates, and give a first application to hippocampal outlines from the ADNI cohort, recovering covariate effects consistent with the literature. Code is available at this https URL.
86. 【2607.19515】BLUE: Semantics-Preserving Video Compression for Efficient Vision-Language Surveillance Analytics
链接：https://arxiv.org/abs/2607.19515
作者：Shubham Baid,Akash James,Sahil Chachra,Nishant Sinha,Kunal Kislay
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：Continuous surveillance video, video analytics systems, enterprise video analytics, Continuous surveillance, analytics systems
备注： 17 pages, 10 figures, 6 tables
点击查看摘要
Abstract:Continuous surveillance video creates a growing storage, transmission, and inference burden for enterprise video analytics systems. While modern codecs such as H.265 reduce bitrate for human-viewable video, aggressive compression can degrade downstream computer-vision performance and does not necessarily reduce the number of vision-language model (VLM) inference calls required for semantic video understanding. This paper evaluates BLUE, a fixed-camera surveillance compression approach that suppresses static-background redundancy while preserving foreground activity, for its effect on VLM-based event and anomaly understanding. We compare raw H.265 and BLUE-compressed H.265 video on two surveillance datasets: VIRAT, comprising 227 paired event samples from 106 clips, and CHAD, comprising 54 human-activity anomaly clips. For each pair, the same frame index is evaluated using a VLM captioning pipeline, and outputs are scored against annotation-derived ground truth using a blind judging protocol. The results show no measurable degradation in semantic inference quality. On VIRAT, the mean VLM score remains effectively unchanged between raw H.265 and BLUE, with a mean difference of approximately -0.01 on a 0-10 scale. On CHAD, raw H.265 and BLUE obtain near-equivalent mean scores of 4.31 and 4.26, respectively. Compression saving is also uncorrelated with VLM score change on VIRAT (r = 0.004), indicating that higher BLUE compression does not predict semantic quality loss. Beyond storage reduction, BLUE increases the share of skip-heavy P-frames on CHAD from 1.4% to 53.2%, enabling an estimated 53% reduction in VLM calls through packet-size-based frame skipping. These findings suggest that BLUE functions as a machine-centric compression layer for surveillance video, reducing bandwidth and inference cost while preserving VLM semantic performance.
87. 【2607.19459】Strong Gravitational Lensing Posterior Sampling in Pixel-Space Using Diffusion Models and Recurrent Inference Machines
链接：https://arxiv.org/abs/2607.19459
作者：Guillaume Payeur,Laurence Perreault-Levasseur,Gabriel Missael Barco,Yashar Hezaveh
类目：Instrumentation and Methods for Astrophysics (astro-ph.IM); Cosmology and Nongalactic Astrophysics (astro-ph.CO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：foreground mass distribution, Modeling galaxy-galaxy strong, mass distribution, strong gravitational lenses, galaxy-galaxy strong gravitational
备注： 31 pages, 34 figures, Extension of an article accepted at the ICML 2026 Workshop on AI for Physics
点击查看摘要
Abstract:Modeling galaxy-galaxy strong gravitational lenses to infer the brightness of the source galaxy and the mass distribution of the foreground galaxy is computationally challenging, particularly for high-resolution, high signal-to-noise ratio observations. In this regime, high-dimensional representations of both the source and the foreground mass distribution are necessary to model the data down to the noise level. This inference problem has been challenging for both traditional and machine learning-based methods because of its high dimensionality and its non-linearity in the foreground mass distribution. We present a method to generate joint posterior samples of the source galaxy and foreground mass distribution as pixelated images conditioned on observations. The method combines diffusion-based generative modeling and recurrent inference machines. It can model realistic gravitational lensing simulations with background and foreground galaxies drawn from cosmological hydrodynamical simulations down to the noise level.
88. 【2607.19437】Group-of-Latents: Perceptual Video Compression at Extreme Bitrates via Masked Latent Generative Modeling
链接：https://arxiv.org/abs/2607.19437
作者：Shaokang Wang,Jinchang Xu,Peidong Jia,Zhijian Hao,Siyuan Qian,Fei Zhao,Rui Ma,Xiaozhu Ju,Jian Tang,Xiaodong Xie,Shanghang Zhang,Huizhu Jia
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：existing video compression, video compression algorithms, compression algorithms follow, transformation and quantization, optimizing the trade-off
备注：
点击查看摘要
Abstract:Most existing video compression algorithms follow a paradigm of transformation and quantization, optimizing the trade-off between distortion and bitrate. However, extremely low-bitrate compression remains an underexplored frontier where perceptual quality optimization under severely constrained coding resources has not been adequately addressed. In this paper, we propose a unified generative framework that leverages pre-trained Diffusion Transformer (DiT) priors to achieve high perceptual quality at extremely low bitrates. We first introduce a flexible Group-of-Latents (GoL) strategy within the latent space of a causal tokenizer, explicitly partitioning the latent stream into intra $I$-latents and inter $P$-latents. The Deep Compression Module (I-DCM) then encodes key $I$-latents to preserve perceptual anchors with minimal overhead. Building upon these anchors, the DiT-based Unified Latent Denoising Module (U-LDM) refines intra-frame textures and synthesizes $P$-latents from noise, reconstructing temporal dynamics at zero additional bitrate cost. Extensive experiments demonstrate that our method uniquely operates in the extreme-low-bitrate regime (e.g., (0.005) bpp), achieving state-of-the-art perceptual fidelity with rich spatial details and robust temporal consistency. The code will be made publicly available.
