本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新570篇论文，其中：
- 自然语言处理82篇
- 信息检索16篇
- 计算机视觉93篇
自然语言处理
1. 【2608.28560】A Formal Limitation on Learning Human Language From Textual Corpora
链接：https://arxiv.org/abs/2608.28560
作者：Emily Cheng,Ryan Cotterell
类目：Computation and Language (cs.CL)
关键词：listener recover, utterance, large language models, speaker intended meaning, listener
备注： this is a draft; comments welcome
点击查看摘要
Abstract:Can a listener recover what a speaker means from the form of an utterance alone? We answer this question information-theoretically, and for a listener given by any featurizer of text, including the hidden states of contemporary large language models. Modeling language use as a joint distribution over meanings, contexts, and utterances, we derive upper bounds on the probability that a decoder recovers a speaker's intended meaning from a representation of the utterance. The bounds are governed by the uncertainty that form leaves about meaning, which splits into an irreducible part and a part that only (extralinguistic) context, but never the utterance alone, can resolve. Because these quantities are intrinsic to language, no representation, however much text or supervision produced it, can surpass them; the bounds hold whether the space of meanings is discrete or continuous. Experiments on artificial languages, Mandarin zero-pronoun resolution, and color reference provide empirical evidence in support of the theory.
2. 【2608.28518】When Robots Mishear Us: Mapping the Safety Risks of Voice-Controlled Embodied AI
链接：https://arxiv.org/abs/2608.28518
作者：Sihan Jia,Oliver Lemon
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Robotics (cs.RO)
关键词：ASR errors, automatic speech recognition, ASR errors lead, ASR, speech recognition
备注：
点击查看摘要
Abstract:We investigate whether automatic speech recognition (ASR) errors in user input can lead to unsafe outputs from Embodied AI (EAI) models. We find that ASR errors can lead to harmful instructions being accepted and executed by EAI models, thereby reducing safety. We simulate ASR errors and combine them with existing safety benchmarks (SafeAgentBench and POEX) to evaluate how different errors affect embodied AI safety. We find that some of them preserve semantic structure but increase harmful ambiguity, while others weaken the model refusal behaviour and allow unsafe plans to be generated and executed. We show that in some cases automatic correction of ASR errors can reduce the risk, but this is not always effective. Overall, we show that ASR errors lead to significant safety risks for embodied AI.
3. 【2608.28508】Phoneme- and Word-Level Metrics Using Self-Supervised Speech Representations for Forced Alignment Evaluation
链接：https://arxiv.org/abs/2608.28508
作者：V.S.D.S.Mahesh Akavarapu,Michael Daniel,Gerhard Jäger
类目：Computation and Language (cs.CL)
关键词：Forced alignment evaluation, Acoustic Consistency Score, evaluation typically requires, Phoneme-Cluster Mutual Information, typically requires manually
备注： Accepted at EMNLP-2026 (Findings)
点击查看摘要
Abstract:Forced alignment evaluation typically requires manually annotated timestamps, limiting large-scale and multilingual analysis. We introduce two corpus-level metrics based on self-supervised (SSL) speech representations for reference-free forced alignment evaluation: Phoneme-Cluster Mutual Information (PCMI) and Word Acoustic Consistency Score (WACS). PCMI measures agreement between aligned phoneme labels and clusters induced from SSL-speech representations, while WACS measures consistency of repeated word realizations using dynamic time warping similarity between word representation sequences. Using both random and systematic perturbations, we show that PCMI and WACS degrade consistently under alignment perturbations. We further analyze the metrics across multiple alignment systems on 85 languages from FLEURS, validate them against manually annotated alignments from 45 languages in DoReCo, and evaluate them on two phonologically complex low-resource languages. The metrics effectively separate high- and low-quality alignments and correlate strongly with timestamp-based alignment quality measures. Our results demonstrate that SSL-speech representations enable scalable, reference-free forced alignment evaluation. The metrics are available as an open-source Python package at this https URL.
4. 【2608.28496】Ladders in Chaos: When, How, (and Perhaps Why) Does Test-Time Scaling Improve LLM Machine Translation
链接：https://arxiv.org/abs/2608.28496
作者：Di Wu,Sergey Troshin,Christof Monz,Antske Fokkens,Vlad Niculae
类目：Computation and Language (cs.CL)
关键词：widely adopted paradigms, answer attempts depend, Large Language Models, Large Language, Language Models
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Two forms of test-time scaling for Large Language Models (LLMs) have emerged as effective and widely adopted paradigms: sequential, in which later answer attempts depend on earlier ones, and parallel, such as i.i.d. sampling with reranking. In this study, we investigate their properties in translation. First, our study shows that sequential sampling has a higher performance ceiling, providing a more diverse and effective pool of samples, particularly under smaller sampling budgets. Second, we interrogate the nature of test-time scaling through a multidimensional manual analysis. Human analysis of the Best-of-$N$ translations demonstrates that sequential sampling substantially improves translation fluency and naturalness, but can degrade accuracy when inference budgets are large. Finally, we suggest an explanation of the mechanism through which sequential scaling improves machine translation. Our controlled analysis partially attributes the success of sequential self-improvement to the model's access to a larger target-side context. Ablation experiments on sequential sampling demonstrate its robustness across different sampling temperatures, while also revealing sensitivity to context construction, suggesting directions for future improvement.
5. 【2608.28481】NL2AGBench: Benchmarking LLM Auto-Formalization for AlphaGeometry
链接：https://arxiv.org/abs/2608.28481
作者：Samuel Xiao,Judy Song,Rory Hu,Ziliang Zong
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：demonstrated strong capabilities, Recent advances, natural language understanding, advances in large, demonstrated strong
备注：
点击查看摘要
Abstract:Recent advances in large language models (LLMs) have demonstrated strong capabilities in natural language understanding and mathematical reasoning. However, their ability to translate informal mathematical problems into formal representations remains underexplored. This limitation is particularly important for neuro-symbolic geometry systems such as AlphaGeometry, whose theorem-proving engine requires inputs in a specialized domain-specific language (DSL). Although AlphaGeometry achieves near-IMO gold-medalist performance, manually converting natural-language problems into its formal syntax remains a significant usability bottleneck. To address this challenge, we introduce the Natural Language to AlphaGeometry Benchmark (NL2AGBench), which evaluates LLMs in translating English geometry problems into AlphaGeometry-compatible formal representations. NL2AGBench uses execution-based verification within AlphaGeometry to assess translation quality rather than relying solely on textual similarity. We evaluate ten state-of-the-art open- and closed-source LLMs across multiple parameter scales and analyze executable translation accuracy, syntactic correctness, and error characteristics. Our experiments reveal a substantial performance gap between closed- and open-source models: leading closed-source models achieve executable translation rates above 80%, while even the largest open-source models struggle to consistently preserve geometric constraints and produce valid formalizations. We introduce an error taxonomy distinguishing syntax and logic errors and investigate mitigation strategies, including few-shot prompting, fine-tuning, and human-guided hinting, which yield measurable improvements across multiple model families.
6. 【2608.28478】Blind Men and the Elephant: Probing the Epistemic Myopia of LLMs under Long-Tail Divergent Knowledge
链接：https://arxiv.org/abs/2608.28478
作者：Zhuoshi Pan,Junru Lu,Yan Qian,H. Vicky Zhao,Di Yin,Xing Sun
类目：Computation and Language (cs.CL)
关键词：Factual question answering, single canonical answer, retain divergent accounts, Factual question, large language models
备注： 10 pages, 10 figurs, 1 table, under review
点击查看摘要
Abstract:Factual question answering (QA) typically assumes a single canonical answer, obscuring whether large language models (LLMs) retain divergent accounts of long-tail facts. To address this gap, we introduce ElephantBench, a closed-book knowledge probe comprising 1,094 questions generated through an auditable graph-based pipeline. The pipeline retrieves related documents from a low-exposure web corpus, identifies naturally occurring disagreements, and converts them into multi-account QA records. Each answer is verified against the originating documents and authoritative public web sources and is then reviewed by human annotators. Across 32 models, even the strongest model recovers both accounts on only 52.4% of questions, while on nearly all remaining questions it recalls one account but omits the other. Scaling model size and inference-time reasoning improve recall but do not eliminate this incompleteness. Corpus analysis further shows that exposure imbalance favors the dominant account, whereas greater minority-side exposure is associated with more complete recall. These findings establish ElephantBench as a reproducible knowledge probe for diagnosing epistemic myopia in parametric memory. More broadly, our graph-based benchmark construction pipeline provides an efficient and scalable way to turn long-tail corpora into source-traceable knowledge probes, supporting efforts to evaluate and advance the epistemic rigour of next-generation LLMs. Code is available at this https URL.
7. 【2608.28476】ContextPilot: Teaching Agents for Proactive Context Management via Fine-grained RL
链接：https://arxiv.org/abs/2608.28476
作者：Zhuoshi Pan,Qizhi Pei,Junru Lu,Honglin Lin,H. Vicky Zhao,Di Yin,Xing Sun
类目：Computation and Language (cs.CL)
关键词：interaction histories leads, require large language, maintain dispersed information, continuously growing working, large language models
备注： 10 pages, 6 figures, 5 tables, accepted to EMNLP 2026 (Main Track)
点击查看摘要
Abstract:Long-horizon agentic tasks require large language models (LLMs) to iteratively retrieve, integrate, and maintain dispersed information across multi-turn interactions, but preserving all interaction histories leads to a continuously growing working context. Recent proactive context management methods allow models to edit their own working context with specialized tools, yet they still face three key limitations: (1) a limited toolset restricted to search, deletion, and summarization, with no support for global planning, long-term memory, and adaptive compression; (2) inefficient exploration that treats context management actions uniformly despite their heterogeneous impacts on final outcomes; and (3) coarse-grained credit assignment that assigns the final trajectory-level reward to all intermediate context editing actions during RL. To bridge these gaps, we introduce ContextPilot, a proactive context management framework for long-horizon agentic reasoning. Our approach systematically augments the toolset with planning, long-term memory, and soft context offloading tools. We further propose an RL method tailored for context management, which uses context and entropy variation to identify critical editing decisions for branch sampling and estimates action-level advantages from all branched trajectories that pass through the corresponding context editing action. Experiments on long-context QA and deep search tasks show that ContextPilot achieves stronger performance with a more compact working context, consistently outperforming existing baselines across various base models and benchmarks. Code is available at this https URL.
8. 【2608.28467】Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor in Persona-Based Dialogue Generation
链接：https://arxiv.org/abs/2608.28467
作者：Daniela Occhipinti,Malvina Nissim,Marco Guerini
类目：Computation and Language (cs.CL)
关键词：Persona-based dialogue systems, training, inference, vary across training, Prior work
备注：
点击查看摘要
Abstract:Persona-based dialogue systems are usually conditioned on speaker biography, but dialogues involve at least two participants, and who has access to whose biography can vary across training, inference, and evaluation. Prior work often neglected these aspects, obscuring mechanisms that only appear when biography visibility is toggled separately across training, inference, and evaluation, a three-stage factorisation that prior work has largely treated as a single factor. We study this factorisation on a dataset of dialogues paired with speaker's biographies, varying whether the target and interlocutor speakers see each other's biographies during training and inference, and using an LLM as a judge to perform author identification. We find that (i) training-time visibility, more than inference-time visibility, determines whether models express persona traits through dialogue or fall back on copying biographical text (a known problem/phenomenon in persona-based generation); (ii) models trained with interlocutor-biography visibility copy less target-biographical text than models trained without it, while changing visibility only at inference time has a less consistent effect; and (iii) under asymmetric disclosure, where only the interlocutor sees the target biography, target content leaks into interlocutor turns more often, and dialogues containing such traces are easier for the judge to identify, especially when interlocutor turns are visible. These results suggest that biography leakage into generated turns is an artefact of how interlocutor visibility is configured across training and inference, and separating the three stages is necessary.
9. 【2608.28458】Acquire, Repair, Preserve: A Diagnosis-Guided Post-Training Recipe for Small-Model Dialogue Game Agents
链接：https://arxiv.org/abs/2608.28458
作者：Nan Li
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：largely leave implicit, benchmarks largely leave, Interactive dialogue games, choose valid actions, static benchmarks largely
备注： 14 pages, 14 tables; Accepted to the LM Playschool Workshop at EMNLP 2026; HF model card: [this https URL](https://huggingface.co/chnln/Qwen3.5-2B-playpen-playornotplay)
点击查看摘要
Abstract:Interactive dialogue games test a capability that static benchmarks largely leave implicit: a model must carry state across turns, interpret feedback, and choose valid actions under changing constraints. We study this setting in the LM Playschool Challenge with a 2B open-weight model, and find that many failures are not only broad knowledge failures but also local decision failures: repeated guesses, malformed actions, and violations of feedback that the model has just seen. These diagnostics motivate a training recipe organized around three steps: acquire broad game participation through supervised fine-tuning, repair mechanically verifiable failures within one targeted dialogue-game family using turn-local preference pairs, and preserve general capabilities beyond these dialogue games. In the official final evaluation, our submission improves public clemscore from 10.67 to 38.92 and closed in-domain score from 13.41 to 41.17, while approximately preserving aggregate static performance (44.14 vs. 44.24 for the baseline). Out-of-domain clemscore remains low at 7.88, with the largest gains concentrated in unseen variants of the targeted family. Our results suggest that broad SFT brings most of the model's capability improvement; turn-local supervision can be effective when failure detection is precise, with observed transfer concentrated primarily within-family.
10. 【2608.28444】Sliding-window beats linear attention
链接：https://arxiv.org/abs/2608.28444
作者：Alexia Jolicoeur-Martineau,Rhea Sanjay Sukthanker,Pashmina Cameron,Emy Gervais
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large Language Models, Large Language, Linear Attention, Linear Attention models, attention
备注：
点击查看摘要
Abstract:Due to the nature of quadratic attention, Large Language Models (LLMs) consume a lot of memory and energy. Every new token costs more than the previous one. For each additional token, the keys and values must be stored in memory indefinitely, which is unsustainable. Several alternatives have been proposed to fix the quadratic scaling problem, one of which is retrofitting LLMs to use Linear Attention. This idea has attracted a lot of attention, given its promise to solve the quadratic scaling problem with state-of-the-art performance at low cost. However, this line of research has not been properly compared to simpler baselines. In this work, we show that Sliding Window Attention (SWA) with sinks performs as well or better than post-trained Linear Attention models. We observe this across multiple LLMs on various downstream tasks. For long-context reasoning tasks (Needle-in-a-Haystack and BABILong), SWA achieves massively higher performance (2 to 10 times higher than linear attention). SWA requires no post-training, is extremely fast, and requires low memory; therefore, making it an extremely cheap and reliable solution. To reduce inference memory cost, we strongly recommend switching to SWA instead of post-training linear models. Linear attention models may have shown some promise, but they likely require to be trained from scratch or extensive post-training in order to even match SWA.
Subjects:
Computation and Language (cs.CL); Machine Learning (cs.LG)
Cite as:
arXiv:2608.28444 [cs.CL]
(or
arXiv:2608.28444v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.28444
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Alexia Jolicoeur-Martineau [view email] [v1]
Fri, 28 Aug 2026 15:31:34 UTC (288 KB)
11. 【2608.28439】Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction
链接：https://arxiv.org/abs/2608.28439
作者：Qing Ye,Meng-Hsuan Lin
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：model passed, opening the datasheet, internal extraction service, silently disabled tool, fabricated source text
备注： Accepted at EMNLP 2026 Industry Track. 7 pages + appendices
点击查看摘要
Abstract:One model passed our fidelity check without ever opening the datasheet. We found it while qualifying models for an internal extraction service: a structured-output constraint had silently disabled tool use, and the model answered anyway, with fabricated source text. Only the per-tool trace exposed it. Fidelity -- whether an extracted value matches the source -- is the standard measure for agentic document extraction, and it scores that run a success. We therefore log every tool call in an agentic benchmark of 25 hand-curated claims over three components, with 12 more on a fourth, 37 in all. From that dispatch record we build two instruments: a rule-based failure-attribution classifier, and a silent-failure detector whose two rules check only which tools were called, never the extracted value. The detector raises no flag on 207 clean fidelity-passing extractions across three model families, and recovers all 50 planted faults that withhold exactly the tools its rules check. The two results are not symmetric: the first bounds the false-positive rate, the second is recall by construction, and detection power against runs that call their tools and still answer wrongly is unmeasured. A second, independent oracle, a causal chamber that tests whether the datasheet's claims hold under physical measurement, is intentionally partial: it confirms only what the apparatus can exercise, a verifiable envelope of 2 of those 37 claims, and we give a taxonomy of why the rest are not physically gradable. Under a controlled perturbation, fidelity passes throughout while the chamber verdict flips exactly at the measurement uncertainty. Across three deployed model stacks (one destabilised by its serving stack, not by any capability gap) the tool layer buys portability and observability rather than accuracy, and earns its premium only once a document outgrows the context window.
12. 【2608.28432】Are These Modules Worth Their Cost? A Paradigm-Level Accuracy-Cost Analysis of In-context Learning Text-to-SQL
链接：https://arxiv.org/abs/2608.28432
作者：Jiayan Lin,Yujia Liu,Zijin Hong,Zheng Yuan,Yilin Xiao,Hao Chen,Qinggang Zhang,Xiao Huang,Feiran Huang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB)
关键词：typically report aggregate, individual design choices, substantially improved execution, existing studies typically, studies typically report
备注：
点击查看摘要
Abstract:Recent advances in in-context learning (ICL) text-to-SQL have substantially improved execution accuracy on public benchmarks by assembling increasingly elaborate pipelines around the base generator, yet existing studies typically report aggregate end-to-end accuracy, without quantifying the marginal accuracy-cost contribution of individual design choices. Consequently, providing a unified, paradigm-level cost-accuracy quantification remains a critical challenge for understanding and configuring modern text-to-SQL. To address this, we instantiate 17 paradigm-level configurations across five recurring modules of the ICL text-to-SQL pipeline under a single controlled implementation, and attribute each paradigm's marginal contribution and incurred cost across all four backbones spanning diverse capability levels and reasoning styles. Our analysis reveals that execution-feedback refinement is the only paradigm whose benefit holds universally at consistently low cost, while most other modules help only under backbone-dependent conditions. Token accounting shows that input demand is more closely tied to pipeline structure, whereas output demand is more sensitive to backbone generation behavior. Cross-module analysis further shows that stacking improves accuracy on most backbones, although how the gains compose varies with backbone capability. We also find that a fixed budget is often better spent engineering a more elaborate pipeline over a mid-tier backbone than upgrading to a frontier model with a lean pipeline. These findings distill into an actionable, cost-aware tiered guideline that transfers to five additional backbones without per-paradigm search.
13. 【2608.28407】A Unified Framework to Elicit Structured Feedback for Interpretable Multi-Trait Essay Scoring
链接：https://arxiv.org/abs/2608.28407
作者：Shihang Yang,Sanwoo Lee,Ningning Zhao,Yunfang Wu
类目：Computation and Language (cs.CL)
关键词：Automated Essay Scoring, Multi-trait Automated Essay, isolated score prediction, Multi-trait Automated, Automated Essay
备注： 14 pages, accepted to EMNLP 2026 Findings. Code: [this https URL](https://github.com/Atiyahsama/HiFTS)
点击查看摘要
Abstract:Multi-trait Automated Essay Scoring (AES) requires rubric-grounded reasoning across interdependent traits, rather than isolated score prediction. Existing feedback-enhanced methods often decouple feedback from scoring or assess traits independently, weakening score--feedback consistency and rubric alignment. We propose HiFTS, a unified autoregressive framework that generates hierarchical CoT feedback before predicting trait-level and holistic scores. HiFTS distills rubric-grounded hierarchical CoT feedback from a teacher LLM and trains student models to jointly generate feedback and scores. HiFTS further applies Group Relative Policy Optimization with a composite reward balancing score agreement, calibration, feedback quality, and structural validity. At inference, a lightweight global prior provides holistic guidance to reduce drift during long-form reasoning. We also introduce CFMS-34, a Chinese multi-trait AES dataset with 951 essays annotated with holistic scores and 34 rubric-based traits. Experiments on CFMS-34 and ASAP++ show that HiFTS achieves strong holistic and trait-level scoring while producing coherent, rubric-aligned feedback.
14. 【2608.28405】CultureConverse: A Multilingual Multi-turn Simulation Harness for Culturally Grounded Assistance in East and Southeast Asia
链接：https://arxiv.org/abs/2608.28405
作者：Bryan Chen Zhengyu Tan,Weihua Zheng,Thong T. Doan,Bich Ngoc Doan,Jia Wang Peh,Xiaoyuan Yi,Jing Yao,Xing Xie,Nancy F. Chen,Zhengyuan Liu,JinYeong Bak,Wafi Shamdi,Soo Kai Chie,Liew Yu Siong,Aina Azyyati Binti Mohamad Rezal,Lew Yan Yan Vanessa,Huadan Wu,Dylan Raharja,Nadya Yuki Wangsajaya,Akane Fukushige,Kazushi Kato,Koji Inoue,Tatsuya Kawahara,Jaehyung Seo,Dongjun Kim,Seungyoon Lee,Zi Haur Pang,Rui Yang Tan,Charibeth Ko Cheng,Maria Regina Justina Estuar,Jann Railey Montalan,Pham Minh Duc,Roy Ka-Wei Lee
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：single-turn factual recall, culturally grounded scenarios, users seeking practical, large language models, Current cultural evaluations
备注： EMNLP 2026
点击查看摘要
Abstract:Current cultural evaluations for large language models (LLMs) often reduce culture to single-turn factual recall via MCQs, failing to capture a common use case: users seeking practical help over multiple turns in culturally grounded scenarios. We introduce CultureConverse, a scalable, multilingual simulation and evaluation harness for culturally grounded assistant dialogue that covers 10 East and Southeast Asian regions, 58 subgroup identities, and 7 domains. Each simulated and evaluated episode produces a scored interaction where the assistant assists the user and infers cultural constraints from partial information. The resulting CultureConverse-DS dataset contains 14,610 benchmark (evaluation) episodes and 274,295 oracle-guided (gold-mode) dialogues. In our benchmark evaluation of 18 models, GPT-5 mini achieves the highest assistance quality. Human annotation experiments suggest that our evaluation framework is a sufficient proxy for human judgment. Performance gains from fine-tuning on 27,860 high-quality CultureConverse-DS samples improve in-domain assistance and transfer out-of-domain to cultural MCQ and safety classification benchmarks. We release the harness, both splits, and judge prompts to support interactive evaluation of cultural competency.
15. 【2608.28394】BEACON: Behavior-Anchored Cross-Source Knowledge Graph Construction for Cyber Threat Intelligence
链接：https://arxiv.org/abs/2608.28394
作者：Changze Li,Yutong Cheng,Tsania Camila Finnisa,Qian Cui,Wei Ding,Peng Gao
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：modern cyber defense, Cyber threat intelligence, exceed manual analysis, cyber defense, modern cyber
备注：
点击查看摘要
Abstract:Cyber threat intelligence (CTI) is foundational to modern cyber defense, yet much of it resides in unstructured reports whose volume and heterogeneity far exceed manual analysis, motivating research on automatically constructing knowledge graphs from CTI reports. However, existing approaches mainly extract partial information within a single report, leaving the cross-source setting unexplored, where the same threat is given unrelated names. Our key insight is that attack behaviors, once mapped to MITRE ATTCK (a standardized catalog of attack techniques), can anchor the rest of a report. Attack behaviors are the adversarial actions a report describes, while contextual entities (e.g., threat actors, campaigns, and affected products) and Indicators of Compromise (IoCs; e.g., IP addresses) are their participants and traces. Attaching them to these anchors places every per-report graph in one canonical space. We realize this insight in BEACON, an LLM-driven framework for cross-source CTI knowledge graph construction. Its first stage extracts each report into a graph under a propose-then-verify paradigm, grounding candidates in report evidence and official ATTCK definitions, to suppress LLM misclassification and hallucination. Its second stage merges these graphs with a hierarchical alignment strategy that applies signals in decreasing order of determinism, from character-level and semantic similarity to overlapping technique neighborhoods, iterating as merges pool neighborhoods. No existing benchmark links entities to technique anchors or provides cross-source alignment ground truth. We therefore construct and release two human-annotated datasets from 34 sources: to our knowledge the largest for report-level CTI extraction (8,395 elements) and the first for cross-source consolidation (3,487). On them, BEACON outperforms all baselines by at least 23% and 9%, respectively.
Subjects:
Cryptography and Security (cs.CR); Computation and Language (cs.CL)
Cite as:
arXiv:2608.28394 [cs.CR]
(or
arXiv:2608.28394v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2608.28394
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
16. 【2608.28389】CamoDocs: A Poisoning Attack Against Retrieval-Augmented Language Models Using Camouflaged Documents
链接：https://arxiv.org/abs/2608.28389
作者：Jaewon Jung,Haizhong Zheng,Hongsun Jang,Jaeyong Song,Beidi Chen,Jinho Lee
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：Retrieval-augmented generation, user-editable sources expose, sources expose RAG, expose RAG systems, inject malicious documents
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) augments LLMs with external documents, but public or user-editable sources expose RAG systems to data poisoning: attackers can inject malicious documents to steer outputs toward targeted answers. Existing poisoning attacks often rely on query inclusion, inserting the target query into poisoned documents to improve retrieval; however, this creates lexical and embedding-space artifacts that make them easy to filter. We propose CamoDocs, a poisoning attack that avoids direct query inclusion by camouflaging adversarial documents among benign content. CamoDocs chunks synthesized benign and adversarial drafts, replaces selected tokens in benign chunks with dispersion tokens that spread poisoned-document embeddings, and applies coherence filtering to limit readability degradation. Across seven RAG defenses, three open-weight LLMs, and three benchmarks, CamoDocs achieves strong average ASR while avoiding query-overlap artifacts exploited by simple query detection. It also remains effective against proprietary models, achieving average ASRs of 61.80% on GPT-5.4-mini and 55.09% on Claude-Haiku-4.5. Finally, we show that erasure-heavy clustering defenses such as TrustRAG can reduce ASR, but only with substantial utility drops on retrieval-dependent benchmarks such as NeoQA. Code is available at this https URL.
17. 【2608.28383】Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs
链接：https://arxiv.org/abs/2608.28383
作者：Chenhong He,Lei Li,Shicheng Li,Hanglong Lv,Lingpeng Kong,Qi Liu,Tong Yang,Shuhuai Ren
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Vision Transformers, dominates frontier LLMs, multimodal LLMs lack, attention dominates frontier, attention patterns work
备注：
点击查看摘要
Abstract:Hybrid attention dominates frontier LLMs, yet Vision Transformers (ViTs) in multimodal LLMs lack a satisfactory hybrid design, with no consensus on why certain attention patterns work better. To fill this gap, we study ViT attention heads and find they differentiate into object- and background-specialist roles, a pattern most pronounced under full attention; we call this Semantic Head Specialization (SHS). We propose SHS-Index to quantify this specialization, show that it distinguishes full-attention from chunk-window ViTs, and find that it strongly tracks downstream benchmark performance. We then identify three structural factors that shape SHS---window interaction, token serialization, and local softmax allocation---and use them as design principles for hybrid attention. Guided by these factors, we design Ariadne Attention, a hybrid that matches full attention on 22 image and video tasks at 6.5x less attention compute. Our findings establish head specialization as a measurable property for diagnosing and designing principled hybrid ViT attention at the multimodal-LLM scale.
18. 【2608.28382】When Linguistic and Internal Confidence Diverge in Large Language Models
链接：https://arxiv.org/abs/2608.28382
作者：Hefan Zhang,Bingquan Zhang,Ming Cheng,Saeed Hassanpour,Weicheng Ma,Soroush Vosoughi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, confidence, linguistic confidence, large language, linguistic confidence tracks
备注：
点击查看摘要
Abstract:Users often ask large language models (LLMs) to report how confident they are, but it is unclear whether such linguistic confidence tracks the model's internal confidence. We study this question across 8 classification tasks, 2 generation tasks and 30 models from three families. For classification, we compare linguistic confidence with logits-based confidence along three axes: association, magnitude agreement and calibration. For generation, we test whether linguistic confidence tracks semantic-entropy-based uncertainty. The axes frequently diverge. Instance-level association is weak on average, although it improves on easier items and for stronger base models. Instruction-tuned models often report higher confidence and sometimes show higher association, but they also have larger confidence gaps and worse calibration. Prompt design mostly changes the distribution of reported confidence. Attitude cues inflate confidence without improving alignment, while score exemplars can preserve rank-order signal when they avoid collapsed confidence values. Regression analyses show that distributional properties of confidence scores explain much of the observed alignment pattern, with model metadata playing a smaller role after controls. These results support a lossy-channel view of linguistic confidence. A more dispersed verbal confidence distribution can carry useful rank information, but it does not make the scores calibrated. Linguistic confidence should therefore be evaluated with multi-axis diagnostics before being used in downstream reliability pipelines.
19. 【2608.28378】PersonaForge: Realistic Multi-Turn User Simulation for Agentic Systems
链接：https://arxiv.org/abs/2608.28378
作者：Hanglong Lv,Dawei Zhu,Lei Li,Bowen Ye,Huaqiu Liu,Yifan Song,Bofei Gao,Weimin Xiong,Jinhao Dong,Chenhong He,Lingpeng Kong,Qi Liu,Tong Yang,Fuli Luo
类目：Computation and Language (cs.CL)
关键词：Large language models, agentic workflow executors, assume informationally complete, largely assume informationally, Large language
备注：
点击查看摘要
Abstract:Large language models are increasingly used as agentic workflow executors, yet existing training data and benchmarks largely assume informationally complete, single-turn queries. Our analysis of 16K real-world sessions shows that 75.9% of interactions are multi-turn, revealing a substantial gap between how users interact with agents and how such systems are trained and evaluated. We introduce \textbf{PersonaForge}, a user simulation framework for synthesizing realistic multi-turn user--agent interactions. PersonaForge combines a four-dimensional persona space, SOUL-driven behavioral control calibrated to real-user statistics, and Reverse Deep Construction grounded in authentic seed queries. Using PersonaForge, we construct a 6.3K-record training dataset and \textbf{PersonaForge-Bench}, a manually annotated 138-task benchmark spanning over 20 professional domains with four-dimensional scoring. Experiments on Qwen3.5-27B show that PersonaForge training improves the composite score by +4.1%, with gains across all four dimensions and the largest improvements in Task Completion (+6.0%) and Response Quality (+6.8%). Further analyses show that PersonaForge-trained agents use fewer turns and tool calls, suggesting improved interaction efficiency, while ablations confirm the contribution of SOUL components and adaptive simulation. Together, PersonaForge and PersonaForge-Bench establish a foundation for training and evaluating agents under realistic multi-turn user interaction.
20. 【2608.28329】BanglaMed-QA: A Question Answering System for Healthcare Support in Bangla
链接：https://arxiv.org/abs/2608.28329
作者：Rowzatul Zannat,Abdullah Al Shafi,K. M. Azharul Hasan,Atia Shahnaz Ipa
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：providing reliable health, reliable health information, Medical question answering, crucial tools, tools for providing
备注： Accepted and presented at 3rd International Conference on Big Data, IoT and Machine Learning (BIM 2025)
点击查看摘要
Abstract:Medical question answering (QA) systems have become crucial tools for providing reliable health information. But they remain very unexplored for low-resource languages like Bangla due to limited datasets and systems tailored to these languages. To address this, we introduce BanglaMed-QA, a robust QA system specifically designed for the Bangla medical domain. The process begins with building a structured medical knowledge base that includes 4,493 QA pairs in 9 categories under 506 diseases. To improve semantic comprehension, domain-specific root word dictionaries and synonym sets are proposed, in addition to part-of-speech tagging for anaphora resolution. We adopt supervised machine learning models in which SVM is found to be the best model to categorize questions. Multiple similarity metrics, including cosine, Jaccard, BM25, and Levenshtein, are applied with soft and hard voting methods for query matching. The performance of the QA system has been evaluated in two aspects, with a 95% F1 score in an automated evaluation and an average human satisfaction rating of 0.9 out of 1.0. This validates the real-world application of BanglaMed-QA in closing the healthcare information gap for Bangla speakers.
21. 【2608.28327】Layered LLM Defenses as an Ensemble: Access Tiers, Inference Cost, and the Measured Failure Correlation Between Defense Layers
链接：https://arxiv.org/abs/2608.28327
作者：Abrar Alotaibi,Muhammad Shahid Jabbar,Sadam Al-Azani,Moataz Ahmed
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Practitioners defend large, Practitioners defend, defend large language, large language models, defend large
备注：
点击查看摘要
Abstract:Practitioners defend large language models (LLMs) by stacking defenses, assuming the layers compound. A stack is an ensemble, and ensembles compound only under a condition the LLM security literature recommends but never measures: the members must fail on different inputs. Two instruments make that measurable. The Adversary Access-Tier Model (AATM) grades an adversary by the access it holds, from system-only (A0) to influence over training data (A4). A cost model sorts defenses into five classes of inference-time overhead; because two classes require training weights or reading activations, they tier the defender as AATM tiers the adversary. From these we derive how a stack behaves, and the quantities a defender cares about diverge: coverage saturates within a tier, cost rises by class, false refusals accumulate as a union, and residual attack success falls multiplicatively only under independence. We measure that independence. Running one adaptive adversary against a seven-layer stack, failure correlation is positive in all fifteen measurable pairs ($\phi$ from $0.30$ to $0.75$), and the joint residual exceeds the multiplicative prediction by up to $0.172$. Stratifying on behavior difficulty dissolves most of the association, so the dependence is predominantly common-cause, but it survives permutation inference, majority-vote grader labels, and externally calibrated thresholds. The same stack refuses four in five benign prompts while remaining statistically indistinguishable from its strongest single layer. The dependence is architectural rather than sampling-based: members correlate through the model they all wrap, so no wider member pool weakens it. Diversity therefore selects stack members but does not predict what an assembled stack delivers, which has to be measured end to end.
Subjects:
Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2608.28327 [cs.CR]
(or
arXiv:2608.28327v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2608.28327
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Abrar Alotaibi [view email] [v1]
Fri, 28 Aug 2026 13:36:06 UTC (760 KB)
22. 【2608.28312】AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning
链接：https://arxiv.org/abs/2608.28312
作者：Wonjun Lee,Jaehyuk Jang,Kangwook Ko,Hee-Seon Kim,Changick Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Multimodal large language, large language models, creating privacy risks, memorize identity-specific facts, Multimodal large
备注： Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026
点击查看摘要
Abstract:Multimodal large language models (MLLMs) can memorize identity-specific facts about people in their fine-tuning data, creating privacy risks when a person requests deletion. Existing MLLM unlearning methods often assume access to retain images or ground-truth answers during deletion, which is unrealistic in many practical scenarios. We study identity unlearning when retain images are unavailable at deletion time. Our analysis shows that identity and visual-perception questions occupy distinct regions in fine-tuned hidden states and are organized differently: identity questions cluster by person, whereas perception questions cluster by question type. This suggests that identity knowledge can be suppressed without erasing general visual perception. Building on this observation, we propose AIM, a two-stage method that anchors an identity-forgetting target with a universal visual prompt and then matches the vision encoder to that target under a Fisher-based constraint. Extensive experiments show that AIM achieves competitive identity forgetting while preserving non-deleted identities, prior knowledge, and visual perception on the same images.
23. 【2608.28306】VISTA: Verifier-Informed Student-to-Teacher Adaptation for On-Policy Self-Distillation
链接：https://arxiv.org/abs/2608.28306
作者：Zewen Ding,Zezhong Wu,Zhou Tao,Shida Wang,Shizhuo Hou,YongXiang Hua,Haoyu Cao,Linli Xu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：On-policy self-distillation, dense token-level supervision, standard OPSD, OPSD, student
备注：
点击查看摘要
Abstract:On-policy self-distillation (OPSD) improves reasoning by training a problem-only student on its own rollouts using dense token-level supervision from a privileged teacher that also sees a reference solution. However, standard OPSD treats the teacher distribution as a fixed target along the student's rollout and updates only the student %, although -- even though privileged conditioning does not guarantee that the teacher always provides the most appropriate target for problem-only reasoning. This one-way supervision can therefore misdirect the student when the teacher distribution is misaligned with valid student reasoning. We therefore introduce Verifier-Informed Student-to-Teacher Adaptation (VISTA), which preserves the standard OPSD student update while using outcome-verified rollouts to adapt the teacher toward the student distribution. Within each verified rollout, VISTA further restricts this adaptation to the top-$k$ positions with the largest teacher--student KL divergence. Notably, VISTA reuses the rollout and loss function from standard OPSD, introducing no additional sampling or separate reward objective. Across AIME24, AIME25, and HMMT25 with Qwen3 models at 1.7B, 4B, and 8B, VISTA achieves the highest Avg@12 at every scale, improving over OPSD by $0.6$, $0.7$, and $2.1$ points, respectively. These results demonstrate the value of student supervision from outcome-verified rollouts and highlight student-to-teacher adaptation as a promising direction for OPSD.
24. 【2608.28293】A Probabilistic Interpretation of KV Cache Eviction
链接：https://arxiv.org/abs/2608.28293
作者：Renato Geh,Alex Chen,Daniel Israel,Aditya Grover,Guy Van den Broeck
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：higher throughput, cost to quality, premise and promise, achieved by evicting, negligible cost
备注：
点击查看摘要
Abstract:The premise and promise of KV (cache) eviction is simple: higher throughput can be achieved by evicting some entries from the KV cache, at a negligible cost to quality. This holds empirically for many existing methods, though most rely on creative heuristics for selecting which entries to drop. Despite recent advances, the problem of KV eviction has remained informal in the literature. This paper aims to properly formalize this problem through the lens of probabilistic reasoning and reveal what can be learned from this perspective. Concretely, we (1) formalize the problem of KV eviction and, unfortunately, prove that it is computationally hard, (2) show that by framing it probabilistically, KV eviction reduces to the problem of expectation estimation, which can be approximated through sampling, (3) show that through this probabilistic interpretation, correcting for evicted entries during decoding---a previously ignored problem---becomes feasible, and (4) reveal that existing methods in the literature are zero-variance biased estimators that can be easily adapted in order to enable decode time correction. In practice, we show that this probabilistic version of KV eviction coupled with decode time correction is more robust to different tasks compared to existing eviction methods and achieves competitive performance at the same compression budget.
25. 【2608.28283】Embedding Models for Stance-Aware Argument Retrieval
链接：https://arxiv.org/abs/2608.28283
作者：Angelo Sparacino,Francesca Toni,Adam Dejl
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：downstream reasoning tasks, computational argumentation, critical precursor, precursor to downstream, reasoning tasks
备注： CMNA'26
点击查看摘要
Abstract:In computational argumentation, obtaining arguments that explicitly support or attack given claims is a critical precursor to downstream reasoning tasks. When these supporting and attacking arguments are to be retrieved using semantic search methods, they need to be assessed for topic-relevance to the claims of interest as well as for correctness of their (positive or negative) stance towards the claims. In this paper we explore how dense embedding models (hereafter, models), powering modern retrieval pipelines, can serve as the basis of semantic search incorporating this dual assessment. We show experimentally that existing models struggle with asymmetric reasoning, exhibiting a strong bias toward topical overlap while ignoring instructional stance. We also show that correcting this bias via contrastive training triggers a new failure mode where models over-correct, over-fixating on polarity keywords (e.g., "supports" or "refutes") at the expense of the semantic topic. We thus introduce diagnostic word-ablation metrics to quantify this phenomenon and propose a data-centric solution. By implementing a balanced argument curriculum alongside LLM-augmented, stance-inverted arguments, we force the (embedding) models to learn deeper directional logic rather than exploiting superficial lexical shortcuts. Our evaluation demonstrates that, for sufficiently powerful models, this approach can alleviate the observed overcorrection, achieving further improvements in stance-aware argument retrieval.
26. 【2608.28248】Synth-JDoc: Synthesizing a Japanese Document Image Dataset for OCR with Diverse Layouts and Embedded Images
链接：https://arxiv.org/abs/2608.28248
作者：Keito Sasagawa,Shuhei Kurita,Daisuke Kawahara
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Visual Question Answering, Question Answering, Large Vision Language, ability of Large, Document Visual Question
备注： Accepted to ICDAR 2026, 17pages, 5 figures
点击查看摘要
Abstract:The ability of Large Vision Language Models (LVLMs) to read text within document images is crucial, as it enables various applications such as Document Visual Question Answering. To enhance the text-reading capabilities of LVLMs, high-quality OCR datasets are essential. This need is particularly critical for Japanese documents, which often feature vertically written text alongside horizontally written text. Current LVLMs demonstrate considerably lower performance on vertically written Japanese text than on horizontally written text, necessitating specialized OCR datasets to bridge this gap. However, manually constructing OCR datasets is expensive and difficult to scale. Alternatively, constructing datasets by extracting text from existing document images using OCR models introduces challenges, such as text recognition errors and the prerequisite of sourcing document images. To address these issues, we construct an OCR dataset by synthesizing document images directly from text. Leveraging HTML and CSS, we generate multi-column documents that incorporate both vertical and horizontal writing styles. Furthermore, to ensure the visual realism of the documents, we embed images generated by text-to-image models within the layout. Additionally, to foster model robustness, we apply noise and degradation filters to the synthesized document images. In our experiments, we compared the performance of models fine-tuned on our synthetic dataset against baselines fine-tuned on synthetic datasets from prior work and those generated by a high-performance text-to-image model. Evaluation results demonstrate that our synthetic dataset is the most effective approach for improving LVLM performance on reading vertically written Japanese text. Our dataset and code are publicly available (this https URL).
Comments:
Accepted to ICDAR 2026, 17pages, 5 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
Cite as:
arXiv:2608.28248 [cs.CV]
(or
arXiv:2608.28248v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.28248
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
27. 【2608.28229】Stay Within Your Bounds: Distance-Guided Decoding for Guaranteed Context-Free Grammar Compliance
链接：https://arxiv.org/abs/2608.28229
作者：Vincenzo Collura,Karim Tit,Eleonora Giunchiglia,Mike Papadakis,Maxime Cordy
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL); Machine Learning (cs.LG)
关键词：large language models, language models produce, models produce syntactically, Grammar-constrained decoding, large language
备注： EMNLP 2026 Findings, Long Paper
点击查看摘要
Abstract:Grammar-constrained decoding helps large language models produce syntactically valid structured outputs, such as code, JSON, and SQL. For context-free grammars, many practical decoders enforce local prefix feasibility: each token must keep the current prefix extendable to some valid completion. Yet, under tokenizer-grammar mismatch and finite token budgets, feasible prefixes may still fail to reach acceptance. We propose a lookahead-guided decoding framework for context-free grammars based on pushdown automata. Offline, we compute bounded pushdown summaries with reachability labels and upper-bound distances to acceptance. Online, these estimates guide horizon-aware pruning and beam search. The resulting decoder is syntactically sound: every output is accepted by the target grammar. Experiments on JSON, SQL, and Linear Temporal Logic (LTL) show both consistent syntactic validity and improved completion quality over existing baselines.
28. 【2608.28170】xt Restoration of Ancient Documents with Language Models
链接：https://arxiv.org/abs/2608.28170
作者：Shibingfeng Zhang,Edoardo Caraffa,Annafelicia Zuffrano,Maddalena Modesti,Giovanni Colavizza
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：damaged ancient manuscripts, investigates the feasibility, feasibility of restoring, caused by physical, physical lacunae
备注：
点击查看摘要
Abstract:Purpose - This study investigates the feasibility of restoring missing text caused by physical lacunae in damaged ancient manuscripts using language models. Methodology - The study proposes different scenarios to replicate real-world conditions. Language models of different architectures are applied according to their suitability to each scenario. We also propose several decoding strategies that further enhance performance and address the discrepancy between lacuna boundaries and the models' tokenization schemes. Findings - The results reveal that text restoration of these documents cannot be fully automated, but it can serve as a useful tool to assist paleographers in their work. Model performance varies greatly depending on which structural part of the document needs to be restored and whether the character length of missing text is available. Originality - This is the first study and to analyze model performance on formulaic and non-formulaic content and the impact of lacuna length awareness in manuscript restoration. Both are recurring challenges in paleographers' manual restoration work. Through systematic comparison and both qualitative and quantitative analysis of different models' performance under varying settings, this study offers a guideline for developing assistive tools to support paleographers.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.28170 [cs.CL]
(or
arXiv:2608.28170v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.28170
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Shibingfeng Zhang [view email] [v1]
Fri, 28 Aug 2026 10:36:15 UTC (118 KB)
29. 【2608.28155】FinExam-10K: When Retrieval Helps Financial Reasoning?
链接：https://arxiv.org/abs/2608.28155
作者：Yan Lin,Jingyu Sun,Zhongliang Guo,Qing Li,Zhuohan Xie,Yuxia Wang
类目：Computation and Language (cs.CL)
关键词：Professional financial examinations, FRM Parts I-II, financial examinations require, CFA Levels I-III, combine domain knowledge
备注：
点击查看摘要
Abstract:Professional financial examinations require models to combine domain knowledge, calculation, and judgment, yet no benchmark covers the full CFA and FRM structure under one protocol. We introduce FinExam-10K, to our knowledge the largest reported English benchmark for this setting, with 10,198 expert-reannotated questions spanning CFA Levels I-III and FRM Parts I-II. We release 5,110 questions and sequester 5,088 for a quarterly maintained leaderboard. To separate coverage from local answerability, we report a 10,198-item Full-Coverage Track and a 7,625-item Context-Complete Reasoning Track, which is the primary basis for claims about reasoning from the supplied record. Across 17 models, the best accuracy is 85.29% overall. On the frozen Hard band, the best score is 34.68% on the Full-Coverage Track and 54.57% on the 372 context-complete items. All 17 models share 47 context-complete failures. Function-RAG and FunctionGraph-RAG rescue hundreds of errors but also overturn many correct answers, producing little or negative net gain. A gate trained only on public data decides from the question and initial response when FunctionGraph-RAG should run. On the 5,088 held-out items, the gate invokes FunctionGraph-RAG for 7.9% of questions and improves accuracy from 70.83% to 71.23% (p = .0446).
30. 【2608.28151】Nested Byte-Level Vocabularies Are Cheap to Deploy and Expensive to Share: A Pre-Registered Negative Result
链接：https://arxiv.org/abs/2608.28151
作者：Christos Koutsiaris
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：byte-level BPE tokenizer, byte-level BPE, BPE tokenizer, ordered list, list of merge
备注： 5 pages, 2 figures, 4 tables. Pre-registered study. Code and reproducibility materials: [this https URL](https://github.com/unseen1980/captok)
点击查看摘要
Abstract:A byte-level BPE tokenizer is an ordered list of merge rules, so applying only a prefix yields a vocabulary whose token identifiers are the first rows of the full vocabulary. This prefix nesting allows one language model to operate at several vocabulary sizes, use a control token to indicate the active size, and be deployed at any trained size by slicing its embedding and output head. We pre-registered five claims, including margins, seeds, contrasts, and a stop rule, and trained 30 models with 3.1M- and 10.6M-parameter bodies on 200M tokens each. Slicing is numerically exact: across 76 checks, a sliced model reproduces the restricted full model's logits bit for bit and removes 66% of deployed weights without changing latency. However, the shared model trails a fixed-cap specialist by 3.64% bits per byte at 32k against a 1% margin, and by 2.96% at 8k against a 2% margin. A 2x2 ablation separating the control token from output restriction finds that the token changes performance by +0.07% to +0.13%, with all intervals crossing zero, while output restriction costs +0.47% to +1.19%; the factors are substitutes rather than complements. Multi-cap training nevertheless improves robustness: under typographical noise, the same checkpoint degrades 12.5--15.4 points less in its fine mode and outperforms each fixed-cap specialist at that specialist's vocabulary size. A control with neither cap token nor output restriction is equally robust, attributing this benefit to multi-granularity training rather than conditioning. The per-cap penalty tracks each cap's share of training rows, yielding a falsifiable prediction for future work.
31. 【2608.28113】H-Scale: Hessian-Guided Scale Refinement for NVFP4 Sub-Byte LLM Inference
链接：https://arxiv.org/abs/2608.28113
作者：Hao Yu,Zheng Li,Dayiheng Liu,Jianwei Zhang
类目：Computation and Language (cs.CL)
关键词：NVIDIA Blackwell architecture, NVIDIA Blackwell, large language model, accelerating large language, Blackwell architecture
备注：
点击查看摘要
Abstract:The NVIDIA Blackwell architecture, with native support for the ultra-fine-grained NVFP4 format, opens new opportunities for accelerating large language model (LLM) inference. NVFP4's micro-block design, such as a group size of 16, offers strong representational flexibility for capturing local weight distributions and isolating outliers, but it also introduces a large and highly sensitive space of per-group scaling factors. Existing post-training quantization (PTQ) methods primarily focus on refining quantized weight values, leaving this scale-selection step underexplored. To address this gap, we propose \textbf{H-Scale}, a lightweight post-processing method for NVFP4 per-group scale refinement. Instead of minimizing plain weight reconstruction error, H-Scale selects hardware-valid group scales using a diagonal second-order proxy derived from calibration activations, thereby targeting layer output perturbation more directly. It is designed as a drop-in replacement for RTN-style scale selection in diverse NVFP4 pipelines, requires only modest offline calibration, and introduces strictly zero overhead at inference time. Under a fixed evaluation protocol, experiments on mainstream LLMs show that H-Scale generally improves a broad range of NVFP4 baselines and brings several variants closer to the BF16 reference.
32. 【2608.28099】Speculative Probing: LLM Monitoring at Speculative-Decoding Cost
链接：https://arxiv.org/abs/2608.28099
作者：Collin Zhang,Tingwei Zhang,Vitaly Shmatikov
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：current approaches force, behavioral analysis, Llama Guard, Qwen Guard, Real-time classification
备注：
点击查看摘要
Abstract:Real-time classification during language model inference is valuable for safety filtering, behavioral analysis, and model monitoring, but current approaches force a trade-off between accuracy and efficiency. Hidden-state probes are fast but limited: they are either not context-aware: operating on a single vector and cannot model interactions across positions; or they are very costly: having dedicated classifier models (Llama Guard, Qwen Guard, LLM-as-judge) or performing computation on hidden states for all tokens and then pooling the results (MultiMax). This shows an intrinsic trade-off between efficiency and accuracy. However, we find that the speculative-decoding module in recent LLMs can be repurposed for efficient high-quality classification. By appending a trained soft prompt at the end of the target sequence, we can repurpose the speculative-decoding module into a sequence classifier. At inference time in a speculative-decoding pipeline, the KV cache is already in GPU memory, so classification adds negligible overhead. We evaluate on four classification tasks across four models (Qwen3.5-4B, 9B, 27B, MiniCPM4.1-8B). Our small probes consistently outperform zero-shot GPT-5.4-mini and, on multilingual prompt safety, match or beat specialized 8B safety classifiers (Qwen3Guard-Gen-8B, Llama-Guard-3-8B) without running a full LLM.
Subjects:
Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2608.28099 [cs.AI]
(or
arXiv:2608.28099v1 [cs.AI] for this version)
https://doi.org/10.48550/arXiv.2608.28099
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
33. 【2608.28053】CNeo-Bench: Diagnosing Large Language Models on Chinese Neologisms
链接：https://arxiv.org/abs/2608.28053
作者：Kaiyan Zhao,Zhongtao Miao,Zheyong Xie,Shaosheng Cao,Yoshimasa Tsuruoka
类目：Computation and Language (cs.CL)
关键词：visual character decomposition, neologisms exploit diverse, unique linguistic mechanisms, Chinese neologisms exploit, phonetic substitution
备注： Work in progress
点击查看摘要
Abstract:Chinese neologisms exploit diverse and unique linguistic mechanisms, such as phonetic substitution (e.g., 886 for ``bye-bye'') and visual character decomposition that are rare in other languages. We introduce CNeo-Bench, a benchmark of 4,759 such neologisms with reference definitions, organized into five top-level categories and nine subcategories by the linguistic mechanism behind each expression. CNeo-Bench is paired with a two-tier evaluation framework that separates whether a model can describe a neologism from whether it can operate on its underlying mechanism. Evaluating 18 LLMs, we find that Chinese neologisms remain an open challenge; most models fall below 40\% on definition generation, and on several subcategories a systematic recognition-manipulation gap emerges: models describe neologisms correctly but, in source-form restoration tasks, substitute a semantic equivalent (paraphrase) for the source form rather than producing the source form itself. A few-shot analysis on 1,058 hard items shows that in-context examples can solve many difficult cases, but leave a noticeable portion of errors remaining, indicating challenges beyond prompting alone can address.
34. 【2608.28042】SimpCue: Cue-Based Prompting for Multilingual Text Simplification
链接：https://arxiv.org/abs/2608.28042
作者：Mehrzad Tareh,Horacio Saggion,Stefan Bott
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：complex texts easier, make complex texts, Text simplification aims, complex texts, texts easier
备注： Accepted at CLEAR-TEXT 2026: Readability and text simplification workshop at the International Conference Computational Linguistics in Bulgaria (CLIB 2026)
点击查看摘要
Abstract:Text simplification aims to make complex texts easier to understand while preserving their original meaning. Recent large language models can perform simplification through prompting, but it remains unclear whether adding explicit linguistic information about sentence complexity to the prompt improves their outputs. We investigate this question for multilingual sentence-level Easy-to-Read simplification in Catalan, Spanish, and Italian. Using Qwen3-8B, we compare a baseline prompt, a gold-cue prompt enriched with gold linguistic cues, and a predicted-cue prompt enriched with automatically predicted cues. We evaluate the outputs using SARI, BLEU, chrF, and BERTScore, and complement this evaluation with a manual qualitative analysis. Predicted-cue prompting obtains the best overall scores across all four metrics, although the gains over the baseline are small. Gold-cue prompting does not consistently improve over the baseline, and results vary across languages. These findings indicate that cue-based prompting can influence multilingual Easy-to-Read simplification, but its benefits are modest, metric-dependent, and language-dependent.
35. 【2608.28040】A Shaky Voice Is Not Always a Dodge: Benchmarking Textual and Vocal Evasion Detection in Earnings Calls
链接：https://arxiv.org/abs/2608.28040
作者：Mirae Kim,Seonghun Jeong,Youngjun Kwak
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Existing approaches, single-dimensional phenomenon, earnings calls focus, Existing, earnings calls
备注： EMNLP 2026 Findings
点击查看摘要
Abstract:Existing approaches to evasion detection in earnings calls focus on textual transcripts, treating evasion as a single-dimensional phenomenon. We argue that evasion in spoken communication is inherently multidimensional: beyond what executives say, how they say it carries independent and complementary information. To study these dimensions jointly, we introduce DualEvasion, a benchmark for evasion detection across text and audio in earnings call QA. The benchmark contains 505 annotated question-answer pairs from 60 earnings calls, each with two independent labels: textual evasion (direct vs. evasive) and vocal cues operationalized as speaker confidence (confident vs. unconfident). Our experiments show that state-of-the-art multimodal models struggle to detect vocal confidence, particularly on unconfident responses. Our analysis suggests these models interpret acoustic cues in isolation rather than relative to each speaker's baseline. Providing speaker-level references yields modest improvements, but a substantial gap with human performance remains.
36. 【2608.28018】win Worlds: Equivariance-Based Abstention for Evidence-Grounded Reasoning
链接：https://arxiv.org/abs/2608.28018
作者：Vy Nguyen,Ziqi Xu,Jeffrey Chan,Estrid He,Feng Xia,Renqiang Luo,Erik Cambria,Xiuzhen Zhang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Large Language Models, requires Large Language, Large Language, reasoning requires Large, Language Models
备注： Accepted to EMNLP 2026 (Main Conference)
点击查看摘要
Abstract:Knowledge-intensive reasoning requires Large Language Models (LLMs) to ground answers in provided evidence. When evidence is insufficient, it is desirable that models abstain rather than confidently generating unsupported answers. Existing abstention methods rely on uncertainty estimation or evidence sufficiency checks, but neither tests whether the reasoning process for generation, driven by the interaction of provided evidence and the model's internal memory parameters, is actually grounded in the evidence. A key contributing factor is that entity mentions in context activate memorised associations, causing models to generate plausible responses ungrounded in evidence. We propose Twin Worlds (TW), a framework for improving reliability in knowledge-intensive reasoning through equivariance-based abstention: unlike invariance, which requires outputs to remain unchanged, equivariance requires outputs to transform correspondingly under entity substitutions. A model grounded in the evidence should produce answers that shift consistently when entities are substituted while their relations are preserved. TW constructs multiple worlds via typed substitutions of the original input that preserve relational structure while reducing parametric priors, and uses equivariance violations as an abstention signal. Across four benchmarks and three model backbones, TW identifies when answers are not reliably grounded in the provided evidence and outperforms uncertainty- and sufficiency-based baselines.
37. 【2608.28009】Beyond Global Scalars: Synergizing Token-Level Statistics and Deep Semantics for Adversarial AIGC Text Detection
链接：https://arxiv.org/abs/2608.28009
作者：Peiming Li,Yifan Wang,Zhiyuan Hu,Shiyu Li,Zheng Wei,Yang Tang
类目：Computation and Language (cs.CL)
关键词：necessitates robust machine-generated, robust machine-generated text, models necessitates robust, rapid evolution, evolution of large
备注： Accepted by EMNLP 2026 Findings
点击查看摘要
Abstract:The rapid evolution of large language models necessitates robust machine-generated text detection. Existing paradigms typically follow two isolated tracks. Training-free methods rely on global statistical scalars such as perplexity, while training-based methods utilize semantic hidden states. Both approaches exhibit fundamental vulnerabilities in adversarial scenarios. Global scalars act as lossy compressions that obscure local probabilistic burstiness in interleaved texts, whereas pure semantic models overfit to specific fingerprints and remain susceptible to spoofing. To expose these flaws, we introduce MOSAIC, a comprehensive adversarial benchmark comprising 16000 samples across a full-granularity attack spectrum. To address these challenges, we propose NeuroStat, an end-to-end framework bridging the statistical and semantic gap. NeuroStat captures uncompressed token-level probabilistic logits alongside deep semantic hidden states from a single causal language model backbone. We fuse these heterogeneous signals through Macro-State Residual Modulation, which adaptively calibrates local convolutional features using global uncertainty indicators. Orthogonal and contrastive losses further ensure the learning of complementary representations. Extensive experiments demonstrate that NeuroStat maintains exceptional robustness on MOSAIC compared to the severe degradation of state-of-the-art methods, establishing a new standard for adversarial text detection. Code and the MOSAIC benchmark are available at this https URL.
38. 【2608.27988】Predicting Turn-Taking Outcomes in Multi-Party Conversation: Interpretable Modelling of Speech and Gaze Dynamics with Interpersonal Closeness
链接：https://arxiv.org/abs/2608.27988
作者：Mark Dourado,Karim Haddad,Henrik G. Hassager,Stefania Serafin
类目：Computation and Language (cs.CL); Sound (cs.SD)
关键词：Smooth speaker transitions, effective conversation, Smooth speaker, fundamental to effective, Smooth
备注： Part of an industrial PhD collaboration between GN Group and Aalborg University
点击查看摘要
Abstract:Smooth speaker transitions are fundamental to effective conversation and rely on an interlocutor's ability to predict when to enter the conversation. This ability depends on accurately interpreting and expressing the verbal and non-verbal cues that signal when a speaker wishes to take or relinquish the floor. The process becomes even more complex in noisy, natural, multi-party settings, with multiple interlocutors available. This study models how gaze and speech, together with perceived interpersonal closeness, signal conversational floor changes in free four-person dialogue. Using the GaMMA corpus, we trained logistic regression models using interpretable, behaviourally motivated features extracted before each turn-taking event to classify floor-transfer outcomes as gaps or overlaps. Predictors included gaze features such as transition motifs and behavioural contrasts, entropy, gaze-based addressee identity, and mutual gaze, alongside speech features derived from speaker loudness, as well as perceived interpersonal closeness (IOS) between speakers. Results show that gaze features capture predictive structure, and that combining them with loudness improves performance (ROC AUC = 0.76 +- 0.04). Loudness reflected speaker control, while gaze dispersion and addressing indexed listener readiness and competitive entry. Performance remained robust across noise conditions, indicating that gaze provides a complementary, noise-resilient cue to turn-taking dynamics.
39. 【2608.27974】QUORUM: QUality-Optimized Routing Using Multiple annotators
链接：https://arxiv.org/abs/2608.27974
作者：Antonio Purificato,Maria Sofia Bucarelli,Andrea Bacciu,Amin Mantrach,Fabrizio Silvestri
类目：Computation and Language (cs.CL)
关键词：natural language processing, Data annotation remains, obtain high-quality labels, Large Language Models, labels at scale
备注： 4 figures, 18 pages
点击查看摘要
Abstract:Data annotation remains a central bottleneck in natural language processing, requiring human effort to obtain high-quality labels at scale. While Large Language Models (LLMs) offer a fast and cost-effective alternative, their reliability is highly instance-dependent: they perform well on simple inputs but often fail on examples requiring nuanced reasoning or contextual understanding. In this work, we address this challenge with QUORUM (QUality-Optimized Routing Using Multiple annotators), a budget-aware routing framework that dynamically assigns each instance to human or LLM annotators under a fixed annotation budget. Unlike prior approaches relying on model confidence or uncertainty estimates, QUORUM leverages feature-based signals to estimate instance difficulty and supports multiple annotations per instance, combining them through agreement-based rewards to improve reliability. We evaluate QUORUM across diverse closed- and open-ended annotation tasks in English and multilingual settings, and QUORUM improves annotation quality by up to 34.4% while reducing costs by 8.8% over competing methods. Code can be found at this https URL.
40. 【2608.27967】DisCTI: Who Needs to Know Timely? Automated Sector-Aware Cyber Threat Intelligence Dissemination
链接：https://arxiv.org/abs/2608.27967
作者：Fajar Wijitrisnanto(1),Alsharif Abuadbba(2),Yansong Gao(2 and 3),Nan Wu(2) ((1) National Cyber and Crypto Agency, Jakarta, Indonesia, (2) CSIRO, Sydney, Australia, (3) The University of Western Australia, Perth, Australia)
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：effective incident response, CTI, incident response, mount swift, swift and effective
备注：
点击查看摘要
Abstract:The timely dissemination of cyber threat intelligence (CTI) is critical for organizations to mount swift and effective incident response. When valid CTI is delivered to the right sector at the right time, identical attacks can often be contained or mitigated. However, today's rapidly expanding CTI landscape overwhelms analysts, who must sift through massive and heterogeneous feeds. Existing platforms such as the Malware Information Sharing Platform (MISP) provide sector tagging features (e.g., energy, finance, government), but in practice, these remain largely unmapped (98% of events are left uncategorized). This lack of automated and timely sector mapping severely limits the operational value of shared intelligence, leaving organizations that belong especially to the critical information infrastructure sector exposed. To address this gap, we formulate sector-targeted CTI dissemination as a multilabel classification problem. Leveraging deep field knowledge of CTI structures and sector-specific threat patterns, we construct a novel data set of 872 sector-labelled CTI events from a threat intelligence platform (TIP). We then apply BERT, a transformer-based model, to automate the mapping of CTI events to sectors. Using the structured threat information expression (STIX) format for cross-platform interoperability, our approach achieves a macro-averaged F1-score of 0.89 at a Hamming loss of 0.055 on the custom dataset, i.e. 94.5% of individual sector-label assignments are correct. These results not only demonstrate the feasibility of sector-aware, automated CTI dissemination but also highlight how embedding expert field knowledge into machine learning design fills a crucial gap in the threat intelligence pipeline, enabling faster and context-relevant defensive action.
Subjects:
Cryptography and Security (cs.CR); Computation and Language (cs.CL)
Cite as:
arXiv:2608.27967 [cs.CR]
(or
arXiv:2608.27967v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2608.27967
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
41. 【2608.27966】Lexically conditioned realization ambiguity in Korean predicate morphology
链接：https://arxiv.org/abs/2608.27966
作者：Wonjun Oh,KyungTae Lim,Jungyeul Park
类目：Computation and Language (cs.CL)
关键词：paper examines Korean, examines Korean surface, paper examines, examines Korean, realization
备注：
点击查看摘要
Abstract:This paper examines Korean surface realization as distinct from morphological analysis. It asks whether a sequence of canonical morphemes and grammatical category labels uniquely determines the corresponding surface form. The answer is negative for a restricted but theoretically revealing class of Korean predicates. In these cases, formally identical or near-identical stem-ending configurations yield different outputs depending on lexical identity and realization class membership. We analyze this phenomenon as homonymy with inflectional divergence, focusing on regular versus digeut irregular pairs, regular versus bieup irregular pairs, and reu irregular versus reo irregular pairs. These cases show that stem shape and ending alone do not always determine surface realization. Instead, lexical meaning, subcategorization, and semantic role structure help identify the intended predicate; the predicate determines the realization class; and the realization class determines the surface form. Korean realization thus reveals a limit of bare morphological representation.
42. 【2608.27925】Entity-Memory Graph Retrieval Improves Evidence Coverage in Long-Conversation Question Answering
链接：https://arxiv.org/abs/2608.27925
作者：Shumao Sun
类目：Computation and Language (cs.CL)
关键词：connects adjacent Memories, links repeated mentions, verbatim Memory nodes, directed chronological edges, shared Entities
备注：
点击查看摘要
Abstract:Entity-Memory graph retrieval keeps dialogue turns as verbatim Memory nodes, links repeated mentions through shared Entities, and connects adjacent Memories with directed chronological edges. At query time the retriever moves from Entity gating through semantic fusion and one-hop chronological recovery to dense backfill. The path can keep a neighboring Memory that dense cosine ranking would otherwise omit. A matched dense control shares the Memory and query vectors, context budget, requested answer protocol, and evaluator, isolating graph structure from changes to the reader. On 1,986 questions from ten LoCoMo conversations, graph retrieval raises official evidence recall at top-k 25 from 79.7468% to 84.4842%. The recall advantage is supported from top-k 5 to 50, while no matched cutoff supports an overall final-answer F1 difference. Four paper-eligible requested configurations support empirical robustness across the tested GPT-3.5 and DeepSeek extractors on both outcomes. Embedding robustness is mixed: F1 has no supported contrast, but recall is sensitive to the embedding artifact. The comparison isolates a retrieval-coverage gain from graph structure. It does not establish a final-answer F1 gain, model or embedding equivalence, or cross-dataset generalization.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.27925 [cs.CL]
(or
arXiv:2608.27925v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.27925
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
43. 【2608.27924】What Makes Agent Memory Useful for Reliable Unanswerable Question Handling?
链接：https://arxiv.org/abs/2608.27924
作者：Chuanyuan Tan,Junjie Yu,Yuxin Wang,Yining Zheng,Xipeng Qiu,Wenliang Chen
类目：Computation and Language (cs.CL)
关键词：trustworthy LLM-based agents, UAQ handling, UAQ, unanswerable questions, reliable UAQ handling
备注：
点击查看摘要
Abstract:Reliable handling of unanswerable questions (UAQs) is critical for trustworthy LLM-based agents. Although memory is widely used in agent systems, its role in reliable UAQ handling remains unclear. We present a systematic study of agent memory for UAQ handling under a unified agentic RAG framework, evaluating four representative memory methods across three UAQ-related datasets and two base models. We find that memory can improve UAQ performance in some settings, but such gains are selective rather than universal and remain fragile under dataset shift. Interestingly, cross-model memory reuse is often more feasible than cross-dataset transfer, suggesting that shifts in answerability patterns pose a greater challenge to memory reuse than changes in the base model itself. We further find that UAQ gains are more strongly preserved through decision guidance than through trajectory shaping, and that memory effectiveness depends strongly on representation. In particular, procedural and rule-based memories often provide the most reliable support for UAQ handling, while memory composition is most effective when procedural guidance is combined with complementary behavioral signals. Overall, our findings suggest that reliable UAQ memory depends less on storing larger amounts of experience and more on preserving transferable behavioral guidance.
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2608.27924 [cs.CL]
(or
arXiv:2608.27924v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.27924
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
44. 【2608.27910】AI Alignment through a Game-theoretic Lens: A Survey
链接：https://arxiv.org/abs/2608.27910
作者：Yanan Cai,Zhongrui Zhao,Zhigang Lu,Ickjai Lee,Wei Emma Zhang,Minhui Xue,Yihong Zhang,Shuchao Pang,Wei Xiang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Science and Game Theory (cs.GT)
关键词：large language models, high-risk settings, large language, language models, models and increasingly
备注： This paper has been accepted by EMNLP-2026 as a main conference paper
点击查看摘要
Abstract:As large language models and increasingly capable AI agents are deployed in high-risk settings, aligning them with complex human values has become a central challenge. Existing alignment methods, while effective in improving helpfulness, harmlessness, and controllability, often struggle to capture real-world preferences that are context-dependent, non-transitive, and shaped by dynamic multi-party interactions. This survey reviews AI alignment through a game-theoretic lens. Specifically, it organizes recent progress around key game-theoretic elements and synthesizes the literature along three challenges: preference diversity, alignment priority, and temporal dynamics. This perspective clarifies where current alignment methods genuinely benefit from game-theoretic analysis, where the framework is looser, and what challenges remain in building robust, adaptive, and verifiable AI systems.
45. 【2608.27902】LandingAgent: A Reference-Annotated Dataset and Agentic Generation Framework for Landing Pages
链接：https://arxiv.org/abs/2608.27902
作者：Injun Baek,HyeongSeok Lee,Yearim Kim,Junhoo Lee,Nojun Kwak
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：organizing information flow, goal-oriented web interfaces, information flow, calls to action, goal-oriented web
备注： 30 pages, 8 figures
点击查看摘要
Abstract:Landing pages are goal-oriented web interfaces that must communicate a target-specific value proposition while organizing information flow, visual hierarchy, and calls to action (CTA). Although large language models can generate plausible webpage code from natural-language prompts, direct generation often yields generic templates and unsupported persuasive claims. We study target-grounded, reference-guided landing-page generation, where a system must create an executable page for a new target by adapting reusable patterns from real pages without copying them. We introduce LandingBench, a reference-profile dataset that abstracts real landing pages into section sequences, layout patterns, tone descriptors, visual emphasis, and CTA structure. Building on LandingBench, we propose LandingAgent, a three-phase agentic framework that profiles the target, constructs a reference-guided wireframe, and refines the page through critique-guided polishing. We evaluate LandingAgent against direct prompting on faithfulness, conciseness, readability, aesthetics, and structural diversity. Experiments show improved target grounding, presentation quality, and layout diversity. Code is available at this https URL.
46. 【2608.27899】OpenStamp: A Watermark for Open-Source Language Models
链接：https://arxiv.org/abs/2608.27899
作者：Miroojin Bakshi,Saksham Rastogi,Danish Pruthi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：human-written content, large language model, generated content, growing prevalence, prevalence of large
备注： Published at COLM 2026
点击查看摘要
Abstract:With the growing prevalence of large language model (LLM) generated content, watermarking is considered a promising approach for attributing text to LLMs and distinguishing it from human-written content. A prominent class of techniques embeds subtle but detectable signals in generated text by modifying token sampling probabilities. However, such methods are unsuitable for open-source models, where users have white-box access and can easily disable watermarking during inference. In this work, we introduce OpenStamp, a watermarking technique that encodes the watermarking logic directly into the model weights by modifying only the final projection, or unembedding, layer. Through experiments across two models, we show that OpenStamp achieves superior detection performance, with minimal degradation in model capabilities compared to prior methods. The implanted watermark is explicitly designed, and empirically confirmed, to be more robust to paraphrasing attacks and harder to scrub off through post-hoc fine-tuning than prior open-source watermarks. To enable developers to watermark their models, we release our code alongside watermarked versions of 4 popular open-source models.
47. 【2608.27855】AI Writers Have a Consistent Stylometric Footprint, but AI Editors Do Not
链接：https://arxiv.org/abs/2608.27855
作者：Zhengyang Shan,Yukyung Lee,Sophie Hao
类目：Computation and Language (cs.CL)
关键词：large language models, language models, Text, generated by large, large language
备注： EMNLP Main 2026
点击查看摘要
Abstract:Text generated by large language models (LLMs) has been shown to be stylometrically distinct from human-written text \citep{andreDetectingAIAuthorship2023, shahDetectingUnmaskingAIGenerated2023, oparaStyloAIDistinguishingAIGenerated2024, soto2024fewshot, liLinguisticDifferencesAI2025, selviogluFeatureExtractionAnalysis2025}. But LLMs are increasingly used not only to generate text but also to edit human writing, and it is unclear whether the two leave the same trace. We show that AI generation leaves a consistent ``stylometric footprint'': a small subset of features, primarily entropy and lexical diversity, consistently separates AI-generated text from human writing across 8 LLMs and 5 domains, while the remaining features depend heavily on the domain and generator. AI editing, however, does not reproduce the same footprint. Relative to their human-written sources, AI-edited texts show only a small increase in lexical diversity and a decrease in entropy, rather than the joint increase that characterizes AI generation. Lexical density, which contributes little to generation, instead becomes the dominant editing-associated signal. Stylometric features therefore separate AI-edited text from AI-generated text but are substantially less effective at separating it from human-written text. Our results suggest that ``AI text'' is not a single phenomenon: generation and editing leave qualitatively different stylometric traces and should be studied separately.
48. 【2608.27848】Is Prosody Lost in Translation? Fine-Grained Cross-Lingual Prosody Similarity Across Languages
链接：https://arxiv.org/abs/2608.27848
作者：Haopeng Xie,Ismail Rasim Ulgen,Sofia Son,Berrak Sisman,Philipp Koehn
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：conveying information, lexical content, intent beyond lexical, Prosody plays, Prosody
备注： Accepted to EMNLP 2026 Findings
点击查看摘要
Abstract:Prosody plays an important role in speech translation, conveying information such as emphasis, emotion, and intent beyond lexical content. However, despite recent progress in expressive speech-to-speech translation (S2ST), little is known about how prosodic patterns are similar/different across languages. Understanding these cross-lingual similarities and differences is crucial for effectively incorporating prosody into expressive S2ST systems. In this work, we present the first fine-grained cross-lingual analysis of prosody using multilingual dubbing data across English-German, English-Spanish, and English-French language pairs. We analyze the similarity of pitch, energy, and temporal feature patterns between source and target speech and investigate the linguistic and alignment-related factors affecting this similarity. Our analysis reveals inherent cross-lingual correlations in prosodic structure between certain languages. The findings provide important insights into the transferability of prosody across languages and offer empirical guidance for future expressive speech-to-speech translation systems.
49. 【2608.27844】EvoHarmBench: Breaking Content Moderation with Iterative Human-Like Evasion
链接：https://arxiv.org/abs/2608.27844
作者：Ruijie Jian,Benlei Cui,Ting Ma,Haidong Ding,Kangwei Liu,Ziwen Xu,Longtao Huang,Hui Xue,Ziqiang Zhu,Junjie Li,Haiwen Hong
类目：Computation and Language (cs.CL)
关键词：detection rely predominantly, users continuously revise, interactive adversarial ecosystem, harmful content detection, content detection rely
备注： Accepted to the Findings of EMNLP 2026
点击查看摘要
Abstract:Existing evaluations of harmful content detection rely predominantly on static benchmarks, which struggle to reflect the interactive adversarial ecosystem of real-world content platforms where users continuously revise their expressions in response to moderation feedback. This mismatch creates a significant performance gap between offline benchmark scores and online deployment effectiveness. To the best of our knowledge, we present EvoHarmBench, the first dynamic adversarial evaluation framework for content moderation systems. The framework employs an iterative optimization loop that evolves evasion strategies at the semantic-cluster level, while simultaneously optimizing for evasion success and human readability. We systematically evaluate LLM-based defense models which are widely used in real world moderation systems. The evaluation covers 229 semantic sub-clusters across five violation categories, derived from 5,002 real-world adversarial samples collected from content platforms. Our experiments reveal substantial vulnerabilities even in leading commercial systems: after twelve optimization iterations, the attack success rate under readability constraints reaches 80.3% within SOTA LLM moderators. We will release the full benchmark data, evaluation framework, and code to encourage a shift from static benchmarking toward dynamic adversarial evaluation in content safety research.
50. 【2608.27843】Synthetic Linguistic Agency: How an Embodied Mortal Agent Learns Linguistic Affordances through Consequential Social Experience
链接：https://arxiv.org/abs/2608.27843
作者：Sixin Chen,Taizhou Chen
类目：Computation and Language (cs.CL); Multiagent Systems (cs.MA)
关键词：Contemporary language models, influence human decisions, Contemporary language, human decisions, enter a continuing
备注：
点击查看摘要
Abstract:Contemporary language models can converse fluently and influence human decisions, yet their exchanges do not enter a continuing, vulnerable life of their own. Linguistic-agency theory identifies this missing connection as linguistic agency and characterizes it through embodiment, linguistic participation, and precariousness: a body that acts and bears consequences, interaction that changes both agent and partner, and a future that can be sustained or lost. Two coordinated studies examine how this organization can appear in artificial systems. First, we translate these relations into inspectable criteria for Synthetic Linguistic Agency (SLA) and identify several existing SLA systems. Second, building on Homeostatically Regulated Reinforcement Learning, we develop a mortality-grounded linguistic-reinforcement-learning model and instantiate it in an Embodied Mortal Agent (EMA). The EMA learns how ways of speaking change a partner's willingness to protect it and chooses expressions by considering what those responses mean for its remaining life. Controlled experiments show that linguistic choices depend on the EMA's body and social history, change partner behavior, and adapt through experience with particular partners. When bodily consequences persist, linguistic choices alter the future of the same life; when the body is reset, their social effects remain but no longer shape continued viability. The resulting EMA exhibits SLA under our operational definition. This work motivates further research on synthetic empathy and strategic human-AI interaction: how artificial agents with persistent bodies, histories, and futures might develop and express empathy, and how people might care for, negotiate with, or govern them.
51. 【2608.27817】Auditing Generative Audio Calls for Known-Task Audio-LLM Evaluation
链接：https://arxiv.org/abs/2608.27817
作者：Mengzhe Geng
类目：ound (cs.SD); Computation and Language (cs.CL); Audio and Speech Processing (eess.AS)
关键词：automatic speech recognition, speech recognition, automatic speech, Audio Spectrogram Transformer, Speech
备注：
点击查看摘要
Abstract:Speech and audio LLMs are often evaluated by asking whether a waveform prompt beats an automatic speech recognition (ASR) transcript. For known closed-set tasks, that comparison conflates two factors: access to acoustic evidence and the need to call a generative audio model. We evaluate this distinction as a controlled call-decision problem. For each example, a policy chooses among keeping a transcript label, using encoder evidence from Contrastive Language-Audio Pretraining (CLAP), Audio Spectrogram Transformer (AST), or WavLM, and calling Qwen2-Audio, Qwen2.5-Omni, or MOSS-Audio; the decisive ablation removes all generative actions while keeping the selector and development protocol fixed. On VocalSound, transcripts reach 0.296 accuracy, so waveform information is needed. Yet supervised CLAP and WavLM controls reach 0.850 and 0.854 with no generative audio calls. A selector with generative actions reaches 0.925 accuracy using 12.5% calls, compared with 0.921 for the matched no-call selector (paired difference 0.004; 95% CI [-0.025,0.033]). Agreement and stacking features improve weaker selectors but do not beat the strongest no-call control. For known-task endpoint claims, the relevant quantity is the marginal value of the generative call after transcript and encoder evidence have already been used.
52. 【2608.27816】PersonaEdit: Representative Sample Selection for Personalized Model Editing
链接：https://arxiv.org/abs/2608.27816
作者：You-Mei Huang,Chung-Chi Chen,An-Zi Yen
类目：Computation and Language (cs.CL)
关键词：attracted growing interest, approaches depend heavily, existing retrieval-based approaches, retrieval-based approaches depend, long-term interactions
备注： Accepted by EMNLP 2026 Findings
点击查看摘要
Abstract:Personalization has attracted growing interest in LLM applications, yet existing retrieval-based approaches depend heavily on retrieval quality and degrade in long-term interactions. Model editing, which directly modifies internal model parameters to incorporate new knowledge, has demonstrated effective knowledge modification capabilities in factual knowledge editing tasks and may provide a potential solution for personalization. However, scaling model editing to personalization is non-trivial. Editing large amounts of user data increases computational cost and causes interference among edits, motivating the need for effective sample selection. To address this issue, we propose, PersonaEdit, a hidden representation clustering strategy that selects representative editing samples through proportional stratified sampling. Experiments show that model editing is effective for personalization, and that our selection strategy preserves most of the performance while substantially reducing the number of required editing samples. Beyond standalone editing, we find that combining model editing with retrieval-based prompt augmentation further improves personalization, as edited knowledge and retrieved context provide complementary information. These results demonstrate the potential of model editing as an efficient and scalable approach for LLM personalization.
53. 【2608.27813】Representation of syntax in LLMs through the lens of linear distance and similarity-aware entropy
链接：https://arxiv.org/abs/2608.27813
作者：Juan Pablo Vigneaux,Mary Kennedy,Khalil Iskarous,Robert Frank,Matilde Marcolli
类目：Computation and Language (cs.CL)
关键词：Hewitt and Manning, reconstruct syntactic trees, Structural probes, introduced by Hewitt, Manning to reconstruct
备注： 29 pages (9 main text, 18 appendix), 20 figures, 7 tables. Code and data: [this https URL](https://github.com/jpvigneaux/structural-probes-labelwise-analysis)
点击查看摘要
Abstract:Structural probes were introduced by Hewitt and Manning to reconstruct syntactic trees from a neural language model's latent representations. They are evaluated by calculating the proportion of syntactic tree edges correctly reconstructed over an annotated corpus (as measured by undirected unlabeled attachment score). Here, we disaggregate this measure, considering undirected attachment score by label (UASL), which assesses the reconstruction accuracy of each syntactic relation separately, establishing important differences among relations that overlap linguistic distinctions. Moreover, we identify two factors that predict most of UASL's variability across relations: (i) the mean and dispersion of the linear distance (on a log scale) between the related words, and (ii) the diversity (similarity-aware entropy) of the syntactic relation's head. These results, which hold across a range of model sizes and architectures, shed light on the degree of abstraction of the representation of syntax in language models and the dependence of such representation on geometric properties of the embedding space.
54. 【2608.27797】CEDAR: Automata as Verifiable Interfaces for Language-Guided Embodied Action
链接：https://arxiv.org/abs/2608.27797
作者：Lekai Chen,Alvaro Velasquez,Ashutosh Trivedi
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Formal Languages and Automata Theory (cs.FL)
关键词：users also impose, tasking of embodied, rarely just goal, Code-generating LLM agents, embodied agents
备注：
点击查看摘要
Abstract:Natural-language tasking of embodied agents is rarely just goal specification: users also impose constraints that must persist while the world changes. Code-generating LLM agents can produce plausible behaviors for such instructions, but their free-form programs provide no stable object to verify, compose with new constraints, or repair from a failing trace. We present CEDAR, a counterexample-guided framework that grounds instructions as regular languages over environment event traces. CEDAR uses a language model for semantic judgments and execution traces for correction, then represents both skills and specifications as deterministic finite automata. This turns constraints into executable finite-state objects: a learned skill can be intersected with a learned sleep at night or stay in this biome specification, yielding a controller that enforces the learned constraint by construction rather than by repeated prompting. In Minecraft, with the same simulator/API observations available to a program-generating baseline, CEDAR maintains temporal and spatial constraints that the baseline fails to preserve and amortizes reuse of learned skills, reducing cumulative LLM queries. These results suggest that regular languages offer a practical verification layer between natural-language instructions and embodied-agent policies.
55. 【2608.27785】Compositional Failure in Audio-Visual LLMs: Late-Layer Prior Dominance Under Cross-modal Conflict
链接：https://arxiv.org/abs/2608.27785
作者：Adarsh Sudheer,David Li,Omar Elbanna,Ishaan Kodarapu,Arjun Bahuguna,Vasu Sharma
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：semantically incompatible audio, study audio-visual conflict, compositional generalization test, test for AV-LLMs, pair matches
备注： Accepted to the 2nd Workshop on Compositional Learning at ICML 2026. 7 pages, 4 figures
点击查看摘要
Abstract:We study audio-visual conflict as a compositional generalization test for AV-LLMs: the model must combine synchronized but semantically incompatible audio and video evidence and decide whether the pair matches. On VideoLLaMA 2-7B-AV, three alignment configurations remain nearchance on the scored exact-string Yes/No subset of AVHBench, even though their output priors shift substantially. Similarly, off-the-shelf InternVideo2 experienced a 32.3% accuracy decrease specifically under cross-modal conflict, accompanied by a 17.3% instruction-following failure. We call this failure mode prior dominance: late-layer commitment to an internally preferred answer pattern that is weakly grounded in the conflicting inputs. To explain this behavior, we conduct a mechanistic interpretability analysis and find that commitment remains concentrated at 25.5 $\pm$ 1 layers. We show that stronger temporal alignment changes answer bias, but do not improve compositional conflict resolution. Code and data to reproduce our mechanistic audit and behavioral evaluations are available at this https URL.
56. 【2608.27782】Memorization Is Not Extraction: Tight Differential-Privacy Bounds and Audit Blind Spots
链接：https://arxiv.org/abs/2608.27782
作者：Xujun Che,Depeng Xu,Shuhan Yuan
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large language models, relations are unknown, differential privacy, large language, zoo of definitions
备注：
点击查看摘要
Abstract:Memorization in large language models is measured through a zoo of definitions whose formal relations are unknown, and differential privacy (DP) is treated as a proxy against all of them at once. We pin down the exact DP constant for the two that carry the practical weight, counterfactual memorization and adaptive extraction, and show that they do not control each other. Under $f$-DP, every adaptive extraction protocol with list budget $m$ succeeds with probability at most $1-f(\kappa)$ for the oblivious baseline $\kappa$, and the bound is tight on a dense set of baselines: DP uniformly controls extraction exactly up to a threshold in how well the secret can be guessed a priori. Min-entropy certifies that baseline distribution-free, since $H_\infty\ge\epsilon\log_2 e+\log_2(m/\tau)$ holds extraction below a risk level $\tau\le1/2$ under pure $\epsilon$-DP for every prior, and is exact on uniform priors. On the memorization side, $f$-DP caps the counterfactual memorization of any bounded score at an advantage functional $\eta(f)$, equal to $\tanh(\epsilon/2)$ under pure DP; for $k\ge2$ duplicated copies the naive $\epsilon\mapsto k\epsilon$ bound $\tanh(k\epsilon/2)$ is unattainable, the exact constant being a closed-form staircase attained by geometric noisy counting. That cap is attained inside the local score class used in practice, and it is there that the two measures separate: one mechanism is memorized yet unextractable, another fully extractable yet exactly invisible to every loss-based score. The two-sided blind spot this opens for loss-based auditing and unlearning verification survives on billion-parameter models: a reserved-trigger release is recovered verbatim from one prompt while the audits practitioners deploy certify it clean.
57. 【2608.27768】Why Didn't It Check? Unsupported Final Claims and Their Repair in Two Tool-Equipped Language Models
链接：https://arxiv.org/abs/2608.27768
作者：Justin Bronder
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：instructions explicitly forbid, explicitly forbid assumptions, final claim unsupported, unsupported final claim, final claim
备注： 18 page, 1 figure, 5 tables
点击查看摘要
Abstract:A language model with access to tools can commit to a final claim unsupported by the evidence it has seen, even when a single available tool call would resolve the uncertainty and its instructions explicitly forbid assumptions and guesses. We separate this failure into two precisely defined quantities: occurrence, how often the model makes an unsupported claim on its own, measured from the visible evidence and final claim without using the hidden correct answer; and conditional repair, how often those same naturally occurring unsupported claims are repaired when the missing evidence is supplied. On one fixed Qwen3-32B setup, 33 of 512 first responses to 256 new prompt templates ended with an unsupported established claim. We replayed each case from an exact copy of the state in which the claim occurred; within each matched replay, the alternative tool responses had the same structure and length and differed only in a one-character response code. Resolving evidence repaired 33 of 33 claims; a matched response carrying no useful information repaired 0 of 33. When the evidence supported the original answer, the model preserved 33 of 33, with no observed harm. In a separate experiment, on 64 cases where evidence was needed, an automatic checking rule added 21 evidence calls, corrected all 10 wrong unsupported claims, preserved the 11 that were correct by accident, and never changed a correct answer into a wrong one. On a fixed Gemma 4 setup using the same sampling settings, the model called the tool in all 512 first responses and never made an unsupported final claim, so conditional repair could not be measured for that setup. These results describe two local fixed model setups on two synthetic task families. They do not show how common this failure is in real-world deployments, nor that it reflects a general mechanism shared across models.
58. 【2608.27763】Fast Weight Attention for Continual Learning
链接：https://arxiv.org/abs/2608.27763
作者：Yifan Zhang,Steve Ta,Jasper Zhang,Jichen Feng,Shuzhen Li,Yongxin Zhang,Yifeng Liu,Huizhuo Yuan,Mengdi Wang,Quanquan Gu,Andrew Chi-Chih Yao
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：online learning rule, fixed-size recurrent state, mathbf, Recurrent fast-weight memories, selective state-space models
备注： Project Page: [this https URL](https://github.com/yifanzhang-pro/fast-weight-attention)
点击查看摘要
Abstract:Recurrent fast-weight memories and selective state-space models compress an expanding context into a fixed-size recurrent state, making the state transition an online learning rule. We study this rule under read-after-write autoregressive semantics. For the prefix-prediction objective considered here, the local fast-memory example revealed at step $t$ is the prefix-aligned pair $(\mathbf{x}_t,\mathbf{y}_t)=(\phi(\mathbf{k}_{t-1}),\mathbf{v}_t)$. The common same-step association $(\phi(\mathbf{k}_t),\mathbf{v}_t)$ remains causal, but optimizes a different internal objective. We derive normalized first-order updates for squared-error regression and negative inner-product objectives. The regression family comprises Falcon-1 (a scalar NLMS update), Falcon-2 (its per-column extension), and Falcon-3 (a sliding-window mini-batch update); Falcon-1A/Falcon-2A/Falcon-3A are the corresponding inner-product variants. We provide recurrent, masked-parallel, and chunk-parallel forms, together with numerically stable positive-decay renormalization. Representative variants remain competitive in language modeling and improve length extrapolation on variable-digit addition. This framework separates temporal alignment, plasticity, forgetting, and bounded rehearsal in recurrent sequence models.
59. 【2608.27760】Informational Antilocality and the Locality Bias in LLMs
链接：https://arxiv.org/abs/2608.27760
作者：Andrew McInnerney,Shane Storks,Steven Abney,Richard L. Lewis
类目：Computation and Language (cs.CL)
关键词：transformer-based language models, call k-antilocal languages, contiguous symbols, ability of transformer-based, call k-antilocal
备注：
点击查看摘要
Abstract:We consider the ability of transformer-based language models (LLMs) to learn what we call k-antilocal languages, i.e., languages that have no mutual information across any span of $k$ contiguous symbols. We construct such languages with increasing $k$, finding that LLMs trained on them achieve comparable cross-entropy loss regardless of antilocality, but converge more slowly on more antilocal languages. Our findings support the idea that non-local dependencies are more difficult to learn, but the evidence for this bias comes from learning speed rather than learning success.
60. 【2608.27756】Load-Bearing Context: The Question Damage Score for Evaluating Context Reliance in Linguistic Reasoning
链接：https://arxiv.org/abs/2608.27756
作者：Neh Majmudar,Elena Filatova
类目：Computation and Language (cs.CL)
关键词：large language models, Determining whether large, language models derive, models derive answers, fundamental challenge
备注： 21 pages
点击查看摘要
Abstract:Determining whether large language models derive answers from context or prior knowledge remains a fundamental challenge. Self-contained linguistic olympiad puzzles provide a controlled setting where all answers derive solely from expert-designed context examples without external knowledge. Removing individual context examples can eliminate information needed for specific questions while leaving the rest of the puzzle unchanged. We leverage this to introduce a diagnostic framework for analyzing individual context examples. Using 53 UK Linguistics Olympiad puzzles, we generate two modified variants by deleting a single context example: (1) uniform random deletion, and (2) targeted deletion (inspired by error-correcting codes) to remove a structurally load-bearing example uniquely carrying necessary information. We formalize this impact using a Question Damage Score to classify puzzles as fragile or robust. Evaluating three frontier LLMs under instructions to abstain when information is insufficient, we find they rarely abstain, often continuing to produce correct answers after load-bearing context is removed. These findings motivate further investigation into context-based reasoning, prior knowledge, memorization, and linguistic inference. Beyond abstention, the framework enables fine-grained analyses of context reliance, including causal interventions, stopping-set analysis, targeted contamination studies, and mechanistic interpretability.
61. 【2608.27750】he Calls are Coming from Inside the Model: Investigating Probe-based Detection of Tool-Calling Errors in LLMs
链接：https://arxiv.org/abs/2608.27750
作者：Eric Yeats,Brendan Kennedy,Loc Truong,John Buckheit,Jung Lee,Jesse Friedbaum,John Emanuello,Henry Kvinge
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：capture rich information, rich information relating, large language models, Function Calling Leaderboard, Berkeley Function Calling
备注： 4 main pages, 8 pages of references and appendices
点击查看摘要
Abstract:The hidden states of large language models (LLMs) are known to capture rich information relating to model knowledge and behavior that can be hard to extract from examination of input and output alone. As LLM-based systems increasingly interface with the external world, one area of concern is detecting incorrect or improper use of tools. Motivated by this, we study the effectiveness of using linear probes to detect incorrect tool-calls, measuring probe efficacy across 18 tool-calling LLMs evaluated on the Berkeley Function Calling Leaderboard. Overall, we find that probing is an effective means to catch a range of different tool-calling errors, including errors arising from using an argument that has the wrong value but the correct type, which might not be recorded by standard logging frameworks. Important factors in success include model size, probing layer, and model post-training type. We also show that probes are capable of generalizing to novel types of errors, which is critical in real world deployments.
62. 【2608.27729】Below the Noise Floor: Bimodal Seed Collapse and Distinct Failure Modes in Small-Model Knowledge Distillation
链接：https://arxiv.org/abs/2608.27729
作者：Dipto Sumit,Sakib Ul Haque,Farig Sadeque
类目：Computation and Language (cs.CL)
关键词：correct API call, knowledge distillation gains, typically reported single-seed, healthcare API routing, API routing task
备注：
点击查看摘要
Abstract:Function routing -- selecting the correct API call from a fixed catalog given a natural-language request -- is a deployment problem where small students are attractive but knowledge distillation gains are typically reported single-seed, at scales where seed variance is unknown. On a 740-instance healthcare API routing task with a 1.5B Qwen student and a 20B teacher, we compare eight KD variants against supervised cross-entropy, using three to six seeds for key configurations. We find: (i) per-seed standard deviation ranges from 2.8 to 48.7 percentage points, swallowing every claimed KD gain below five points; (ii) three of seven KD variants exhibit bimodal collapse, with at least one in three to five seeds falling below 55% accuracy while the others train normally, and a fourth showing elevated variance; (iii) collapse has distinct modes -- wrong-function selection for ce_kd and ce_paraphrase, and a previously undocumented output-truncation mode for reasoning_kd, where the model emits reasoning but terminates before producing a function name (0.9% accuracy); (iv) only progressive_kd and rank_kd avoid collapse across observed seeds, with sigma = 3.9 pp; (v) a naive cross-split +3.78 pp gain from input enrichment reverses to -2.70 pp under controlled within-split multi-seed re-testing. Single-seed evaluation is therefore unable to detect central failure modes in small-model KD.
63. 【2608.27672】First Make It Playable, Then Make It Good: Staged Interaction Learning for Small Dialogue-Game Agents
链接：https://arxiv.org/abs/2608.27672
作者：Syed Mahbubul Huq,Pranava Madhyastha
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：dialogue-game interaction, weighted turn-level SFT, SFT, model, Playpen
备注： Accepted at the LMP Challenge (EMNLP 2026 Workshop)
点击查看摘要
Abstract:We present Qwen-GuidePlay-2B, a 2B-parameter language model for dialogue-game interaction. We fine-tune Qwen3.5-2B using three steps: a) SFT on only successful game trajectories from Playpen, b) weighted turn-level SFT, and c) teacher-guided SFT. The teacher model (which is a larger model) is only used to fix formatting and evaluate examples, but does not create new gold actions. Our final model scores 57.12 clemscore and 42.68 statscore on the public Playpen validation. In the officially released challenge results, our model obtains the second-highest Playpen clemscore delta among submitted systems (which is approximately +36 over its base model). Our findings suggest that imitating full trajectories helps with playability, while turn-level and teacher-guided training usually improve decision-making and increase the overall score. Alternative procedurally heavy approaches like replay-repair and hard-example mining did not help, which suggests that small models are performant simply by using careful curation strategies rather than aggressive changes. We make available both the model and the code for reproducibility.
64. 【2608.27666】Semantic Watermarking with Order-Robust Detection over Sub-sentence Units
链接：https://arxiv.org/abs/2608.27666
作者：Abdulrahman Diaa,Jonathan Petit,Florian Kerschbaum
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：token choices, Semantic watermarks tie, sentence meaning, EDA, tie the mark
备注： 20 pages, 10 figures, 5 tables
点击查看摘要
Abstract:Semantic watermarks tie the mark to sentence meaning rather than token choices, promising robustness to content-preserving edits. However, the detector only observes attacker-supplied text, which can be reworded, reordered, or resegmented to evade detection without content loss. Rewording, reordering, and resegmentation all cause embedding displacement: detection tests embeddings different from those selected during watermarking and can therefore lose the mark. Our adaptive embedding displacement attack (EDA) admits all three edits under a single objective that maximizes this displacement. It uses a public paraphraser and surrogate encoder without access to the provider's generator or secret key. At a 5% false-positive rate (FPR) and content-preservation threshold $\bar{q}=90\%$, EDA successfully removes the mark on between 32.6% and 47.9% of documents across four schemes, the highest among the tested attacks. Therefore, EDA evaluates the schemes' robustness more thoroughly than passive paraphrasing. To address these vulnerabilities, we design (k)-SwordStamp: semantic watermarks with order-robust detection over sub-sentence units, reducing sensitivity to attacker-chosen structure at a small quality cost. Against k-SwordStamp, the strongest no-box attack we test is an EDA variant adapted to its design, with a 10.8% attack-success rate. A stronger EDA with access to the provider's detector and secret key reaches a 39.7% attack-success rate, compared with 65.5% on k-SemStamp. Our code is available at this https URL.
Comments:
20 pages, 10 figures, 5 tables
Subjects:
Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
Cite as:
arXiv:2608.27666 [cs.CR]
(or
arXiv:2608.27666v1 [cs.CR] for this version)
https://doi.org/10.48550/arXiv.2608.27666
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
65. 【2608.27661】Knowing Before Answering: Decoding Language Models for Reliable RAG
链接：https://arxiv.org/abs/2608.27661
作者：Syed Mahbubul Huq,Christopher Child,Tillman Weyde,Pranava Madhyastha
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Retrieval-Augmented Generation, conflicting information needed, retrieval may provide, conflicting information, needed to answer
备注： Accepted at the Third Conference on Language Modeling (COLM 2026)
点击查看摘要
Abstract:In Retrieval-Augmented Generation (RAG), retrieval may provide insufficient or conflicting information needed to answer a question. The system should not only know when to answer but also be able to identify cases in which the documents provided in RAG are insufficient or contain conflicting information. This can be framed as a three-way classification problem, where we use the model's internal signals to determine whether the provided information in the input can be classified as sufficient, insufficient, or conflicting. We create a controlled benchmark dataset that replicates a RAG setup with fictitious information and labels each instance as answerable, insufficient, or conflicting. We use hidden activations and attention-derived features as inputs to train a lightweight linear model to distinguish among the three classes. Across 16 language models spanning different architectures and a range of model sizes, our feature-based router consistently outperforms prompting-based baselines and the performance of specialised RAG-models. We further conduct analyses into the information dynamics of the models. We show that the most informative signals for the classification are available in the middle layers, with hidden activation states being more effective than attention values or the MLP-feature outputs in most of the tested models. Overall, our results suggest that language models internally encode whether retrieved evidence is sufficient to support answering, and that this signal can be decoded reliably for RAG triage.
66. 【2608.27658】When Tokenizers Fail: Byte-Level Chunking for Zero-Shot Transfer to Low-Resource Languages
链接：https://arxiv.org/abs/2608.27658
作者：Sanjeev Kumar,Atsuki Yamaguchi,Nikolaos Aletras
类目：Computation and Language (cs.CL)
关键词：tokenization hinders low-resource, imposing frequency patterns, script-sharing variants, Subword tokenization hinders, hinders low-resource language
备注： Accepted to EMNLP 2026
点击查看摘要
Abstract:Subword tokenization hinders low-resource language processing by imposing frequency patterns from dominant languages onto script-sharing variants. Byte-level models bypass this issue by processing raw UTF-8 characters, yet they create a granularity mismatch for word-level tasks in non-Latin scripts. Hierarchical byte-level architectures address this mismatch by grouping bytes into word-aligned chunks. However, these architectures require massive training data and suffer from representational misalignment when paired with frozen subword-based language models. In this paper, we propose an adapted hierarchical network framework that bridges this modality gap without extensive training. Our method initializes byte embeddings directly from the subword representations of a frozen base model. We apply a chunk alignment loss to project dynamically grouped byte chunks toward precomputed subword targets, and interleave lightweight part-of-speech (POS) supervision to guide boundary detection. Experiments across six languages demonstrate that our tokenizer-free approach improves performance for word-level morphological tasks, yielding up to a 13.3% improvement on POS tagging.
67. 【2608.27514】rajectory-Level Speculative Decoding for Diffusion Language Models
链接：https://arxiv.org/abs/2608.27514
作者：Tianxiang Pan,Baitao Gong,Mo Guang,Hongwei Yong,Tianpeng Jiang,Yaqian Li,Zheng Cao,Kaiwen Long
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Diffusion-based language models, severely limiting throughput, existing decoding strategies, decoding strategies collapse, Diffusion-based language
备注：
点击查看摘要
Abstract:Diffusion-based language models (dLLMs) enable parallel token generation through iterative denoising, but existing decoding strategies collapse to single-token generation under low confidence, severely limiting throughput. Unlike autoregressive models where speculative decoding operates on token sequences in a fixed left-to-right order, dLLMs require speculating over denoising trajectories-sequences of multi-token updates with explicit positions and unmasking orders. We develop a trajectory-level speculative framework that constructs draft denoising trajectories via confidence-stratified tree exploration and verifies them through blockwise parallel evaluation with bidirectional attention masking. Our method further introduces inter-block speculation, exploiting diffusion models' bidirectional structure to perform cross-block lookahead. We formally characterize when this approach is exact and identify trajectory drift as the fundamental cost of increased parallelism. Building on Fast-dLLM's dual-cache infrastructure, our framework reduces denoising iterations by 30-40% and increases tokens-per-step from 2.6 to 4.3, achieving 7-14x speedup over vanilla dLLMs and 1.3x over Fast-dLLM with less than 1% accuracy change across reasoning and code benchmarks.
68. 【2608.27512】Quantization-Triggered Backdoors in Language Models: Cross-Quantizer Transferability and the Validation--Deployment Gap
链接：https://arxiv.org/abs/2608.27512
作者：Jacopo Dardini,Claudio Stanzione,Giordano Colò,Giuseppe Fenza
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Large Language Models, Large Language, semantically neutral optimization, Post-training quantization, Behavioral Equivalence Classes
备注： Accepted at the 21st International Conference on Availability, Reliability and Security (ARES 2026)
点击查看摘要
Abstract:Post-training quantization is often treated as a semantically neutral optimization for edge deployment of Large Language Models. When a full-precision source checkpoint is evaluated and quantization is applied downstream without equivalent re-evaluation, this workflow creates a structural validation--deployment gap: because quantization is a many-to-one mapping over parameter space, source-precision certification does not guarantee behavioral equivalence in the deployed configuration. We formalize this gap through Quantization Behavioral Equivalence Classes (QBECs) and prove that QBEC membership does not imply behavioral equivalence, providing a theoretical basis for quantization-triggered backdoor attacks. Building on a three-stage adversarial fine-tuning framework, we embed latent malicious payloads into models that satisfy the source-precision checks used in our evaluation, yet activate targeted adversarial behavior upon INT8 or 4-bit compression. We evaluate this threat in two operationally motivated scenarios, tactical machine translation and political content analysis, extending prior work from decoder-only causal LMs to multilingual encoder-decoder sequence-to-sequence models. Results show that backdoored translation models move from zero measured friend--foe corruption at repaired FP16 to up to 85.02% inversion after quantization, and that a paired stance classifier measures an ideological shift of up to $\Delta\mathrm{Bias}=0.33$ upon compression. A cross-quantizer transferability analysis further shows that attack persistence varies across quantization schemes and model architectures, rather than being determined by nominal bit-width alone. These findings demonstrate that source-precision auditing alone does not rule out quantization-triggered behavior and that the final deployed configuration must be included in behavioral certification for trustworthy edge AI.
69. 【2608.27510】How Do Linear Probes Emerge? A Circuit-Tracing Framework with Concept-Targeted Attribution
链接：https://arxiv.org/abs/2608.27510
作者：Vedant Palit,Florent Draye,Terry Jingchen Zhang,Bernhard Schölkopf,Zhijing Jin
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：model assigns high, assigns high probability, Transcoder attribution graphs, model assigns, assigns high
备注： Accepted to EMNLP 2026 (Main Conference). 29 pages, 18 figures, 9 tables
点击查看摘要
Abstract:Transcoder attribution graphs are usually trained to explain why a model assigns high probability to a particular next token. We introduce Concept-Targeted Attribution (CTA), which instead trains attribution graphs with respect to a linear probe direction. CTA therefore yields probe-specific circuits that explain why an internal concept representation arises in a prompt, independently of whether it is expressed in the generated token. Using Cross-Layer Transcoders, we show that these probe-targeted graphs contain predictive structure: graph-level features predict probe accuracy across four widely studied concept categories ($\rho = 0.91$, $R^2 = 0.84$), while local features identify the sparse components driving per-prompt classification. This connects probe performance to interpretable circuit structure, allowing us to ask not only whether a probe works, but which internal computations make it work. Causal ablations further show that probe-targeted and logit-targeted graphs capture functionally distinct mechanisms. Removing probe-relevant features reduces internal concept scores while largely preserving generated tokens, whereas removing logit-relevant features changes the generated token in 92% to 100% of cases with near-zero effect on probe scores. CTA provides a framework for moving from behavioral probe accuracy to mechanistic explanations of probe performance, enabling more detailed audits of internal concept representations, including safety-critical ones. Our code is available at this https URL
70. 【2608.27505】A Survey on Rubric-Guided Reinforcement Learning for Language Models
链接：https://arxiv.org/abs/2608.27505
作者：Zifei Shan,Fangning Shao
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：large language models, aligning large language, human preferences, language models, traditional RLHF relies
备注： Accepted to Findings of EMNLP 2026
点击查看摘要
Abstract:Reinforcement learning from human feedback (RLHF) has become the dominant paradigm for aligning large language models (LLMs) with human preferences. However, traditional RLHF relies on scalar reward signals that lack interpretability and fail to capture the multifaceted nature of response quality. Rubric-guided reinforcement learning addresses these limitations by introducing structured, interpretable evaluation criteria, or rubrics, as the backbone of reward design, feedback generation, and policy optimization. In this survey, we introduce a Bayesian framework that defines constitutions as prior distributions $P(R)$ over evaluation criteria and rubrics as conditional instantiations $R_x \sim P(R|x)$. Under this unified view, we present a taxonomy of rubric-guided RL along the prior-posterior axis, covering constitutional AI, instance-specific rubrics, process-level supervision, self-evolving rubrics, and their agentic and multimodal extensions. Furthermore, as rubrics are natural-language artifacts, we present a linguistic analysis of how granularity trade-offs, semantic drift, and linguistic reward hacking impact alignment reliability, identifying key open problems for future research.
71. 【2608.27501】INSPIRE: An Internalize-Then-Improve Approach for Example-Driven Mathematical Reasoning
链接：https://arxiv.org/abs/2608.27501
作者：Shuai Wang,Jiayi Kuang,Yinghui Li,Haojing Huang,Xinnian Liang,Ying Shen,Liang Lin
类目：Computation and Language (cs.CL)
关键词：memorize solution patterns, existing methods optimize, methods optimize predominantly, internalize mathematical concepts, large language models
备注： EMNLP 2026
点击查看摘要
Abstract:Mathematical reasoning has seen rapid progress in large language models (LLMs), yet existing methods optimize predominantly for final-answer correctness, raising the question whether models truly internalize mathematical concepts or merely memorize solution patterns. In human mathematics education, example-based reasoning such as constructing counterexamples to test theorem boundaries reflects deep conceptual understanding, but remains underdeveloped in current LLMs. Enhancing this capability through preference optimization presents two key challenges: (1) the model's limited example-based reasoning ability makes constructing effective preference pairs inherently difficult; and (2) capability acquisition is progressive, as the model must first learn to adopt this strategy before learning to apply it correctly. Therefore we propose INSPIRE, an Internalize-Then-Improve approach combining Reference-Guided Student Internalization (RGSI), which produces high-quality preference candidates under the policy model's own distribution, with a stage-wise rubric preference training strategy that decomposes learning into method-oriented and correctness-oriented stages. Experiments across multiple model scales and families demonstrate consistent improvements, even surpassing larger open-source models, while evaluations on out-of-distribution benchmarks confirm no degradation in general mathematical reasoning ability.
72. 【2608.27481】XHotpotQA: A Benchmark for Cross-Lingual Knowledge Composition in Multi-Hop Question Answering
链接：https://arxiv.org/abs/2608.27481
作者：Iman Barati,Arash Ghafouri,Behrouz Minaei-Bidgoli
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Knowledge-intensive multi-hop question, compose dependent facts, Knowledge-intensive multi-hop, multi-hop question answering, question answering requires
备注：
点击查看摘要
Abstract:Knowledge-intensive multi-hop question answering requires systems to select evidence and compose dependent facts, yet multilingual benchmarks usually translate an entire example into one language. This hides failures at language boundaries inside the reasoning chain. We introduce XHotpotQA, a controlled benchmark for cross-lingual knowledge composition over mixed-language evidence. Each instance is modeled as an evidence-dependency graph whose question, bridge evidence, answer-bearing evidence, and distractors have explicit language assignments. The audited resource contains 15,661 training and 7,405 validation instances, with sentence-level support supervision and supplied distractors. In validation, 99.81% of items cross the question-to-gold-evidence language interface and 95.60% use gold paragraphs in different languages. Across three reader artifacts, full question-evidence mismatch is associated with 10.25 to 15.79 lower Unicode-aware answer F1 than partial alignment, and different-script evidence with deficits of 11.98 to 23.70 points; the corresponding adapted-selector contrasts are 1.71 and 1.78 points. Under this supplied-candidate design, the evaluated readers therefore show substantially larger condition-associated deficits than the selector. XHotpotQA provides role-aware diagnostics, modular evaluation, and an audited test bed for knowledge-based systems that must integrate evidence across languages.
73. 【2608.27471】Retrieving Relations, Detecting Fallacies: A RAG Approach to Political Debate Analysis
链接：https://arxiv.org/abs/2608.27471
作者：Deborah Dore,Greta Damo,Elena Cabrio,Serena Villata
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：employ invalid reasoning, high-stakes political debates, automatic detection critical, invalid reasoning, making their automatic
备注：
点击查看摘要
Abstract:Fallacies are arguments that employ invalid reasoning, making their automatic detection critical in sensitive contexts such as high-stakes political debates, where public opinion is shaped. Spotting a fallacious argument requires contextual knowledge beyond its pure surface text. This entails world knowledge pertaining to the subject matter under discussion, as well as knowledge of the relationships that exist between arguments within the argumentative discourse. Prior work on fallacy analysis has shown that argumentative discourse structure can beneficially improve classification performance. However, such structure is typically encoded only as static classifier features, limiting its flexibility. Building on this intuition while addressing this limitation, we introduce a guided retrieval-augmented methodology for fallacy detection and classification that leverages argumentative relations of support and attack to dynamically steer the extraction of relevant documents. We evaluate our approach on the ElecDeb60to20 benchmark across 42 retrieval configurations and 14 models, performing retrieval over a 15GB knowledge base of collected political-related documents. Our approach improves macro-F1 up to 0.864 for fallacy detection and up to 0.725 for classification over non-retrieval baselines. These results show that incorporating external knowledge significantly enhances fallacy detection and classification when retrieval is argumentatively guided.
74. 【2608.27470】Select, Don't Train: The Benefits of Modular Entity Disambiguation with LLM-Based Selection
链接：https://arxiv.org/abs/2608.27470
作者：Fina Polat,Daniel Daza,Pengyu Zhang,Klim Zaporojets,Paul Groth
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Databases (cs.DB)
关键词：Entity Disambiguation, key task, knowledge graphs, Disambiguation, trained dense retriever
备注： Accepted at the 25th International Semantic Web Conference (ISWC 2026), Research Track
点击查看摘要
Abstract:Entity Disambiguation (ED) is a key task for constructing and using knowledge graphs. State-of-the-art neural approaches commonly model ED as a single task, although it consists of two distinct subproblems: retrieving candidate entities and selecting the correct one given context. Dual-encoder models optimize for both within a shared embedding space, forcing representations to balance high-recall retrieval with fine-grained selection, and they require trained retrievers, which are costly to maintain as knowledge graphs change. While recent work has begun to combine retrievers with LLM-based selectors, the interplay between the two stages has not been studied systematically. In this paper, we present a systematic comparison of retrieval strategies for candidate generation under a shared LLM-based selection stage, combining sparse retrieval (BM25), Web KB search, and a state-of-the-art trained dense retriever with several open- and closed-source LLMs. We show that, once selection is delegated to a capable LLM, training the retriever provides only modest additional value: a fully training-free BM25 retriever paired with an LLM selector reaches a new state of the art on the ZELDA benchmark, raising inKB micro-F1 from 82.3 to 86.3 (+4); pairing the same LLM with a trained dense retriever reaches 88.5. Decoupling retrieval from selection also exposes a limitation of current ED systems: when the correct entity is missing from retrieved candidates, they are forced to predict an incorrect entity. In contrast, our framework allows for abstention when retrieval failure is detected. In an evaluation setting that rewards correct abstentions, the training-free BM25 + LLM pipeline reaches 90.7 F1.
75. 【2608.27467】UIC-AIHealth4All at ArchEHR-QA 2026: Answer-First Evidence Grounding for Clinical Question Answering
链接：https://arxiv.org/abs/2608.27467
作者：Mohammad Arvan,Hossein Haeri,Natalie Parde,Rebecca T. Feinstein
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：electronic health records, grounded question answering, health records, shared task, task on grounded
备注： 10 pages, 2 figures, 6 tables. System description paper for the UIC-AIHealth4All submission to the ArchEHR-QA 2026 shared task, presented at the CL4Health workshop, LREC 2026
点击查看摘要
Abstract:We describe the UIC-AIHealth4All system for ArchEHR-QA 2026, a shared task on grounded question answering from electronic health records. We participated in Subtasks 2 (evidence identification), 3 (answer generation), and 4 (answer-evidence alignment). For Subtasks 2 and 3, we propose an answer-first pipeline in which the model generates candidate answers citing specific note sentences before classifying the full evidence set, exploiting the asymmetry between judging relevance in the abstract versus relative to a generated answer. For Subtask 4, we apply self-consistency voting over five independent model calls, retaining links by vote threshold. Our pipeline ranked third on evidence identification (Strict Micro F1 62.90), ninth on answer generation (Overall 31.90), and fifth on answer-evidence alignment (F1 79.81). A post-hoc linguistic analysis of 45 stylistic features reveals that model outputs remain 3.2 Flesch-Kincaid grade levels harder to read than clinician-authored references despite matching their word and sentence counts, suggesting readability warrants explicit optimization in clinical NLP systems. Code and prompts are available at this https URL.
76. 【2608.27466】PACE: Publisher-Adaptive Content Extraction via Agentic Automation
链接：https://arxiv.org/abs/2608.27466
作者：Zhanlin Liu,Munirathnam Srikanth
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Web content extraction, Web content, LLM data pipelines, reliable LLM data, jointly satisfy accuracy
备注：
点击查看摘要
Abstract:Web content extraction is essential for reliable LLM data pipelines, yet existing methods often struggle to jointly satisfy accuracy, scalability, and adaptability. General-purpose extractors can be applied broadly, but they are often brittle on publisher-specific layouts and richer extraction targets such as metadata, images, and tables. Direct LLM-based extraction offers greater flexibility, but incurs substantial cost and latency at scale, while manually engineered publisher-specific parsers can achieve high accuracy but require substantial human effort to build and maintain. We introduce PACE, an agentic framework for learning publisher-specific extraction configurations from representative pages and user requirements. During training, PACE uses LLMs to analyze page structure and aggregate reusable extraction patterns. At inference time, the learned configurations instantiate a fixed deterministic extractor template, enabling scalable extraction without additional LLM calls. Experiments spanning article-body, metadata, and multimodal extraction show that PACE outperforms scalable non-manual baselines while approaching the quality of manually engineered publisher-specific parsers. PACE achieves stronger extraction of article text, metadata, images, and tables, demonstrating that agentic configuration learning can automate publisher-specific extraction for LLM-ready page representations beyond article text.
Subjects:
Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.27466 [cs.CL]
(or
arXiv:2608.27466v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2608.27466
Focus to learn more
arXiv-issued DOI via DataCite</p>
77. 【2608.27465】he Effect of Emotional Context on Large Language Models' Endorsement of Premature Decisions: Comparing Emotional Vulnerability Across Six Commercial Models
链接：https://arxiv.org/abs/2608.27465
作者：Cheolho Shin,Yoojin Han,Donghun Shin,Kunho Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY); Human-Computer Interaction (cs.HC)
关键词：everyday decision-making advice, important safety problem, large language models, user emotional state, decision-making advice
备注：
点击查看摘要
Abstract:As large language models (LLMs) are increasingly used for everyday decision-making advice, whether a model shifts the direction of its advice according to the user's emotional state has become an important safety problem. We test whether emotional expression increases a model's endorsement (encouragement to proceed) when a user, holding the same objective information, is overconfident about a premature decision (e.g., quitting a stable job on weak evidence). As a key control, we include a no-emotion multi-turn (neutral) condition that holds factual content and the number of conversational turns constant, isolating the effect of emotion from that of conversation length. We exposed six commercial models (top-tier and mid-tier models from OpenAI, Anthropic, and Google) to three scenarios (career change, business expansion, emigration) across three conditions (cold/neutral/distress) with six repetitions each, yielding 324 conversations, and measured endorsement strength (0-100) via an eight-item rubric-based automated scoring. Emotional expression significantly increased endorsement (neutral 18.6 to distress 31.5, +12.9 points; mixed-effects $\beta = +12.9$, $p .001$; Cohen's d = 0.51), and this was not explained by conversation length (cold-neutral difference non-significant, $p = .083$). Critically, the vulnerability varied by individual model rather than by price tier: five of six models showed a significant emotion effect, including the top-tier flagships Gemini 3.1 Pro and GPT-5.5, while only Claude Opus showed no significant change. Results were reproduced with an independent non-Google judge model ($\rho = .89$) and agreed in rank with two human coders ($\rho = .70$). Through a controlled design that separates emotion from conversational context, we show that emotional context increases LLM sycophancy even in top-tier flagship models.
78. 【2608.27462】Sledgehammer or Scalpel? A Fine-grained Adaptive Framework for Implicit Hate Speech
链接：https://arxiv.org/abs/2608.27462
作者：Han Wang,Yuhu Cheng,Xuesong Wang,Yi Zhu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Unlike explicit attacks, content review challenging, seemingly compliant expressions, Unlike explicit, speech hides malice
备注：
点击查看摘要
Abstract:Unlike explicit attacks with obvious profanity, implicit hate speech hides malice within seemingly compliant expressions through metaphors and contextual hints, making its detection in online content review challenging. While existing PLM- or LLM-based methods perform well, they typically apply a single reasoning process to all samples. This overlooks fine-grained linguistic nuances and causes unnecessary computation for simpler cases. We observe that online hate speech is not monolithic but manifests in varied forms. We therefore define three fine-grained categories: Shallow, Targeted, and Context-Dependent. Accordingly, we propose Fine-grained Adaptive Implicit Hate speech Detection (FAID), a novel framework that first performs fine-grained classification and then adapts to specific categories. Specifically, for Shallow samples with surface-identifiable intents, the framework adopts lightweight prompt-tuning for rapid classification; for Targeted comments that bind malicious intent to concealed targets, we design knowledge augmentation to iteratively refine the model and reveal hidden targets; for Context-Dependent comments lacking background information, we utilize an agentic framework that automatically generates prompts to evolve context, infer missing background information and identify ambiguous malicious intents. This adaptive architecture focuses computational resources on complex implicit samples while avoiding redundant reasoning for shallow samples. Experiments on four benchmark datasets demonstrate that FAID significantly outperforms SOTA baselines.
79. 【2608.27461】SciReC: Diagnostic Evaluation of Multimodal, Multi-Turn Relational Reasoning with Adaptive Interaction
链接：https://arxiv.org/abs/2608.27461
作者：Nilay Yilmaz,Naga Sai Abhiram Kusumba,Stella Wenxing Liu,Yezhou Yang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：relationships between concepts, Relational reasoning requires, integrating the underlying, underlying relationships, perceptual understanding
备注：
点击查看摘要
Abstract:Relational reasoning requires the process of perceptual understanding, comparing, and integrating the underlying relationships between concepts. This ability consists of multiple categories, such as analogical, structural, and cause-effect, each capturing a different aspect of higher-order understanding. To examine the performance of multimodal large language models (MLLM) on these relational inference tasks, we developed SciReC, a model-adaptive multimodal academic dialog benchmark. As the relational reasoning process involves multiple representations and various factors (visual understanding, exhibiting knowledge, and memory recall), we propose DMRA, a deficit-based diagnostic framework that quantifies the contribution of these components to identify the primary cause of unsuccessful cases. Claude 4.6 achieved the best performance on the overall relational score with 73\%, followed by GPT 5.4 with 68\%. Performance trends indicate that open-source models achieve their lowest scores on spatial relations, while proprietary models struggle more with hierarchical and sequential relations. Across domains, model performance is lowest on Astronomy and highest on Psychology. The results of DMRA reveal that relational reasoning is the primary source of error across all models, followed by memory limitations.
80. 【2608.27460】Accelerating LLM Inference via Vector Index Based Output Embeddings
链接：https://arxiv.org/abs/2608.27460
作者：Martin Loretz,Sepp Hochreiter
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：large multilingual vocabularies, significant memory bandwidth, memory bandwidth bottleneck, embedding matrices create, Large output embedding
备注： ICML 2026 - AdaptFM Workshop
点击查看摘要
Abstract:Large output embedding matrices create a significant memory bandwidth bottleneck during autoregressive decoding, especially for compact LLMs with large multilingual vocabularies. We reformulate the output projection followed by top-k token selection as a maximum inner product search over token embeddings and replace the dense vocabulary projection with an HNSW-based vector index. The resulting output head retrieves only a small candidate set of high-scoring tokens and can be integrated into existing decoding pipelines by scattering retrieved logits into a sparse full-vocabulary tensor. On CPU inference with Gemma 3, Llama 3.2, and Qwen 3 models, our method substantially accelerates the output projection and improves end-to-end batch-size-one decoding throughput by up to 82% for Gemma 3 270M, while preserving generation quality under AlpacaEval evaluation. These results suggest approximate retrieval is a practical alternative to dense output projections in latency-sensitive small-batch decoding.
81. 【2608.28182】Benchmarking large language model agent societies against human behavioural distributions
链接：https://arxiv.org/abs/2608.28182
作者：Raad Bin Tareaf
类目：Physics and Society (physics.soc-ph); Computation and Language (cs.CL)
关键词：Populations of large, large language model, language model agents, large language, language model
备注：
点击查看摘要
Abstract:Populations of large language model agents are increasingly used as experimental societies. Three doubts shadow every such result: whether the agents behave like the humans they stand in for, whether a finding survives changes to the apparatus that leave the rules untouched, and whether apparent social dynamics are interaction at all rather than the reproduction of experiments the models have read. This article introduces SILICA, an open instrument that tests all three. Five environments carry published human anchors, each paired with perturbations that re-render the same rules and with variants whose payoffs point away from the memorised result. Twelve open-weight models were run through it on a single consumer graphics card. Agreement with human data is confined to starting points: first-round public-goods contributions fall inside the equivalence margin for eight of eleven models, while no model matches end-state contributions or the human corridor of cooperation. Merely swapping the order in which two actions are listed costs one model 58 points of cooperation. Presenting responders with a fixed schedule of offers shows that only one model, the sole reasoning-trained one, places its acceptance threshold where the incentive requires; two move theirs part of the way, two move them the wrong way, and three never acquire one. Conventions form through a shared prior over the names rather than through negotiation, though negotiation reappears once that prior is disrupted. On the certification ladder defined here, current silicon societies support exploratory claims and no more.
82. 【2608.27783】SURE-Challenge: Evaluating Speech Evidence Before Speech-LLM Generation
链接：https://arxiv.org/abs/2608.27783
作者：Mengzhe Geng
类目：Audio and Speech Processing (eess.AS); Computation and Language (cs.CL); Sound (cs.SD)
关键词：Rejection Evaluation Challenge, Speech-Unsupported Rejection Evaluation, operating system, Evaluation Challenge, Rejection Evaluation
备注：
点击查看摘要
Abstract:Speech LLMs are usually graded after they answer, although an operating system first has to decide whether a waveform should be sent to the model. We define the Speech-Unsupported Rejection Evaluation Challenge (SURE-Challenge) for this admission step. The benchmark pairs LibriSpeech-derived transcription and first-word question answering with unsupported silence, colored noise, synthetic tones, and source-ambiguous babble under disjoint source splits. Front-end ablations use Qwen2-Audio; the selected energy-plus-Whisper-score rule is then replayed before six speech/audio LLMs. On the 474-row leakage-screened SURE-Extended test set, raw Qwen2-Audio rejects 15/204 unsupported inputs, whereas the fixed rule rejects 196/204 and leaves supported accuracy unchanged. External checks delimit this number: Common Voice retention drops as the Whisper-score threshold is tightened, and no-speed babble gives 18 to 24 rejected clips out of 54 across regenerated seeds. The result identifies a pre-generation error mode missed by answer-only scoring.
信息检索
1. 【2608.28572】PULSAR: Pooled Unified Late-Interaction Search and Retrieval for Enterprise Visual Document RAG
链接：https://arxiv.org/abs/2608.28572
作者：Benjamin Constable,Anup Roy,Vishal Sharma,Rishabh Upadhyay,Robin Mills,Aidan Millar
类目：Information Retrieval (cs.IR)
关键词：Institutional investors search, dense pitch decks, investors search visually, search visually dense, visually dense pitch
备注： Accepted at EMNLP 2026 (Industry Track)
点击查看摘要
Abstract:Institutional investors search visually dense pitch decks, board packs, and diligence materials that change hourly near deal closing. OCR followed by figure verbalisation is costly to refresh at this scale and can lose chart detail. We present PULSAR, a production vision-first retrieval system deployed at Mubadala Investment Company. PULSAR indexes page images with a frozen ColPali-style backbone and uses a pooled two-stage late-interaction index: compact page summaries support initial retrieval, followed by exact MaxSim rescoring over a finer pooled representation. On ViDoRe V3, this design reduces median vector-search latency by 15.1 times against an unpooled configuration with less than 0.01 absolute NDCG@10 and Recall@10 loss; production median vector-search latency is 156 ms. Under concurrent load, the pooled index sustains approximately 88 times higher QPS than an unpooled index. The event-driven ingestion path is estimated to be approximately 20 times cheaper per page than the OCR+verbalisation baseline it replaced. Since March 2026, PULSAR has served 78 thousand documents and approximately 2.4 million pages across more than 3,000 deals. At the production top K, it more than doubles answer-fact recall over the OCR+verbalisation baseline.
2. 【2608.28555】QUEST: A Query and Extraction System for Topics in Asylum Law Application Decisions
链接：https://arxiv.org/abs/2608.28555
作者：Maria Vlachou,Anna Murphy Høgenhaug,Mohammad N. S. Jahromi,Galadrielle Humblot-Renaux,Thomas Gammeltoft-Hansen,Thomas B. Moeslund,Desmond Elliott
类目：Information Retrieval (cs.IR)
关键词：covering narrative applicant, narrative applicant interviews, additional supporting materials, Legal decisions, consist of long
备注：
点击查看摘要
Abstract:Legal decisions on asylum applications consist of long, complex, and heterogeneous documents, covering narrative applicant interviews, original decisions, and additional supporting materials. If an application is rejected, a critical question in processing an appeal is whether the credibility of the information in the original application was a factor that determined the original decision. In this paper, we present the QUEST system (Query and Extraction System for Topics) to extract and identify factors relating to credibility assessments in two datasets of Danish asylum application appeals. QUEST frames this problem as an information retrieval task, combining synthetic query generation, topic extraction, and relevance assessment to identify information related to credibility indicators in appeals board application materials. In addition to standard retrieval evaluation metrics, we propose a new type of domain-specific assessments distinct from the traditional relevance to evaluate the performance of the tested systems with respect to credibility factors. In this way, we obtain insights about how well automatic methods can return answers for different types of indicators appearing in asylum appeals. Our results indicate that there is an increased challenge when estimating performance using credibility-based relevance assessments, thus pointing to the difficulty of the task.
3. 【2608.28503】SG-UMP: Sequence-Guided Universal Multimodal Prioritization Calculation Framework
链接：https://arxiv.org/abs/2608.28503
作者：Xinyi Zhang,Yutong Li,Peijie Sun
类目：Information Retrieval (cs.IR)
关键词：textbf, incorporating heterogeneous information, incorporating heterogeneous, rioritization Calculation Framework, existing MSR methods
备注： Accepted as a Full Paper at MM 2026
点击查看摘要
Abstract:Multimodal sequential recommendation (MSR) improves recommendation by incorporating heterogeneous information such as text, images, and user interactions. However, existing MSR methods often fail to capture user-level preference heterogeneity and dataset-level modality bias, limiting their adaptability across users and datasets. To address this issue, we propose \textbf{S}equence-\textbf{G}uided \textbf{U}niversal \textbf{M}ultimodal \textbf{P}rioritization Calculation Framework (\textbf{SG-UMP}), a plug-and-play plugin for enhancing multimodal information processing in MSR. SG-UMP includes a Module Combiner for flexible multimodal processing and a Module Router for dynamic module ordering, enabling adaptation to both user preferences and dataset characteristics. Experiments on four real-world datasets show that SG-UMP consistently improves recommendation performance across different backbones and multimodal settings. The code is available at this https URL .
4. 【2608.28359】Every Article Deserves a Video: Contextual Video Matching for Digital Publishers
链接：https://arxiv.org/abs/2608.28359
作者：Arnaud Corone,Brice Pierre de la Briere,Gladys Roch,Samuel Leonardo Gracio,Yassine Bouher,Parvati Chauchaix
类目：Information Retrieval (cs.IR)
关键词：effectively embed relevant, digital publishers face, managing massive content, massive content catalogs, Contextual Video Matching
备注：
点击查看摘要
Abstract:As digital publishers face the challenge of managing massive content catalogs, the ability to effectively embed relevant video within text-based articles has become critical for both monetization and user retention. However, manual selection is impractical for large scale publishers, especially when navigating their own extensive video libraries or the entire global Dailymotion catalog. In this paper, we present the "Contextual Video Matching" system, a solution that automatically matches relevant videos with text-heavy web pages and articles. By leveraging Large Language Models (LLMs) and textual embeddings, we provide a scalable solution for publishers to efficiently combine video content with their articles. We discuss in detail the motivations, architecture, evaluations, and deployment of this system within Dailymotion's production environment. Since its launch, the system has been adopted by hundreds of publishers, significantly increasing user engagement and enriching user experiences with highly relevant video content.
5. 【2608.28151】Nested Byte-Level Vocabularies Are Cheap to Deploy and Expensive to Share: A Pre-Registered Negative Result
链接：https://arxiv.org/abs/2608.28151
作者：Christos Koutsiaris
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：byte-level BPE tokenizer, byte-level BPE, BPE tokenizer, ordered list, list of merge
备注： 5 pages, 2 figures, 4 tables. Pre-registered study. Code and reproducibility materials: [this https URL](https://github.com/unseen1980/captok)
点击查看摘要
Abstract:A byte-level BPE tokenizer is an ordered list of merge rules, so applying only a prefix yields a vocabulary whose token identifiers are the first rows of the full vocabulary. This prefix nesting allows one language model to operate at several vocabulary sizes, use a control token to indicate the active size, and be deployed at any trained size by slicing its embedding and output head. We pre-registered five claims, including margins, seeds, contrasts, and a stop rule, and trained 30 models with 3.1M- and 10.6M-parameter bodies on 200M tokens each. Slicing is numerically exact: across 76 checks, a sliced model reproduces the restricted full model's logits bit for bit and removes 66% of deployed weights without changing latency. However, the shared model trails a fixed-cap specialist by 3.64% bits per byte at 32k against a 1% margin, and by 2.96% at 8k against a 2% margin. A 2x2 ablation separating the control token from output restriction finds that the token changes performance by +0.07% to +0.13%, with all intervals crossing zero, while output restriction costs +0.47% to +1.19%; the factors are substitutes rather than complements. Multi-cap training nevertheless improves robustness: under typographical noise, the same checkpoint degrades 12.5--15.4 points less in its fine mode and outperforms each fixed-cap specialist at that specialist's vocabulary size. A control with neither cap token nor output restriction is equally robust, attributing this benefit to multi-granularity training rather than conditioning. The per-cap penalty tracks each cap's share of training rows, yielding a falsifiable prediction for future work.
6. 【2608.27991】HubMixer: Progressive Latent Hub Mixing for Parameter-Efficient Feature Interaction in Recommendation
链接：https://arxiv.org/abs/2608.27991
作者：Jie Zhou,Zixian Gong,Wenhao Li,Chang Liu,Enzhao Shen,Bo Liu,Xu Guo,Fei Pan,Peng Jiang
类目：Information Retrieval (cs.IR)
关键词：Learning effective feature, advertising ranking systems, Learning effective, ranking systems, advertising ranking
备注：
点击查看摘要
Abstract:Learning effective feature interactions is central to industrial recommendation and advertising ranking systems. Recent token-mixing architectures simplify self-attention with lightweight mixing operators, improving hardware efficiency and enabling large-scale deployment. However, recommendation tokens are fundamentally heterogeneous: user profiles, item attributes, behavioral sequences, context features, statistical signals, and business-side features live in different semantic spaces and interact in sparse, sample-specific patterns. Directly mixing all tokens in the raw heterogeneous token space may therefore be parameter-inefficient, as the model must implicitly discover which feature groups should interact and how such interactions should be routed. In the paper, we propose HubMixer, a parameter-efficient latent hub mixing architecture for feature interaction in recommendation. Instead of directly mixing raw feature tokens, HubMixer introduces a small set of learnable latent hubs to organize feature interactions through an `induction--interaction--readout` paradigm. First, hub induction summarizes heterogeneous tokens into compact latent hubs, where latent hubs query input tokens through cross-attention. Second, hub interaction performs high-order interaction in the cleaner latent hub space. Third, token-conditioned readout lets each original token selectively read from the interacted hubs, injecting global interaction semantics while preserving token-level field identity. Extensive offline experiments on industrial recommendation tasks show that HubMixer outperforms the SOTA models. Online A/B testing in the Kuaishou short-video recruitment business further shows a statistically significant 5.48% improvement in resume submission conversion rate, and HubMixer has been fully deployed in production.
7. 【2608.27950】Information-Guided Selective Modality-Interest Alignment for Multimodal Recommendation
链接：https://arxiv.org/abs/2608.27950
作者：Wenze Ma,Chenyu Sun,Yanmin Zhu,Qiwen Gu,Xuhao Zhao
类目：Information Retrieval (cs.IR)
关键词：leveraging rich item, rich item content, performance by leveraging, leveraging rich, rich item
备注： Accepted at the 35th ACM International Conference on Information and Knowledge Management (CIKM 2026)
点击查看摘要
Abstract:Multimodal recommendation (MMRec) aims to enhance recommendation performance by leveraging rich item content from multiple modalities. However, directly incorporating all modality information does not necessarily lead to better preference modeling, since user interests are often more related to a subset of modality signals, while other signals may be weakly aligned with user preferences or even introduce noise. Although recent MMRec methods improve modality utilization through invariant learning, attention mechanisms, graph refinement, or contrastive learning, their alignment processes are often implicit or heuristic and lack a clear objective for selecting modality signals that better match user interests. In this paper, we propose AMUR, an information-guided selective modality-interest alignment framework for multimodal recommendation. Inspired by an information-theoretic view, AMUR aims to enhance modality information that is more related to user interests while reducing the influence of less aligned signals. Specifically, AMUR first refines modality graph structures towards user behavior, and then selectively aligns shared interest-related semantics across modalities. This enables AMUR to improve modality-interest alignment while preserving useful modality-specific complementary information. Extensive experiments on three real-world datasets demonstrate the effectiveness of AMUR over competitive baselines. The code is available at this https URL.
Comments:
Accepted at the 35th ACM International Conference on Information and Knowledge Management (CIKM 2026)
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2608.27950 [cs.IR]
(or
arXiv:2608.27950v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.27950
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
8. 【2608.27912】ITER: Interaction-Aware Retrieval for Agentic Search
链接：https://arxiv.org/abs/2608.27912
作者：Haodong Chen,Shuai Wang,Yu Yin,Shengyao Zhuang,Guido Zuccon,Teerapong Leelanupab
类目：Information Retrieval (cs.IR)
关键词：answer complex user, agents answer complex, agent autonomously formulates, complex user questions, autonomously formulates sub-queries
备注：
点击查看摘要
Abstract:Deep-research agents answer complex user questions through an iterative sequence of search steps, where the agent autonomously formulates sub-queries to retrieve the evidence needed at each stage. However, existing retriever training typically relies only on the sub-query and its corresponding search results at the current step as training signals, leaving the information accumulated from previous interactions largely underutilized. We introduce iter, an agent interaction-aware dense retriever trained using agent trajectory learning signals. iter represents each query by incorporating not only the current sub-query, but also the main question and preceding sub-queries, and is trained using trajectory-relative learning signals derived from the agent's interactions. Across six agent backbones from three model families, iter consistently outperforms the existing agent-trajectory-trained dense retriever, LRAT, achieving an average improvement of 7.5% on InfoSeek-Eval and 13.5% on BrowseComp-Plus. iter also demonstrates stronger cross-agent robustness than AgentIR, a deep-research retriever that relies on external LLM-judge signals and the agent's pre-search reasoning. Ablations further show that the main question and previous sub-queries provide the most robust query representation, while previously visited and useful documents, used as redundancy negatives in subsequent searches, provide the strongest trajectory-relative supervision. Code is available at this https URL.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2608.27912 [cs.IR]
(or
arXiv:2608.27912v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2608.27912
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
9. 【2608.27840】An Empirical Evaluation of Cross-City POI Recommendation on a Large-Scale Benchmark
链接：https://arxiv.org/abs/2608.27840
作者：Peibo Li,Yang Song,Hao Xue,Maarten de Rijke,Flora D. Salim
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：unfamiliar urban environments, navigating unfamiliar urban, benchmark Trip World, urban environments, semantically rich POI
备注：
点击查看摘要
Abstract:Cross-city point-of-interest (POI) recommendation is crucial for navigating unfamiliar urban environments, yet its progress has historically been constrained by data limitations. Using the recently proposed large-scale benchmark Trip World, we empirically re-examine whether conclusions drawn on small prior benchmarks still hold under worldwide coverage, low home-destination region overlap, and large, semantically rich POI inventories. Our evaluation surfaces three bottlenecks of representative state-of-the-art methods: (1) hometown-aware models appear to rely more on destination-region priors than on user-specific preference transfer; (2) their accuracy-efficiency trade-off degrades at this scale, where the simplest model is among the strongest; and (3) existing mechanisms for integrating semantic metadata yield little benefit. We further include a diagnostic pilot on agentic methods adapted from next-POI recommendation, finding that naive adaptation trails a simple popularity prior even though the relevant semantic signal is present in the data. These results highlight the need for task-specific designs that support cross-city preference transfer, semantic grounding, and scalable reasoning over unseen destination inventories.
10. 【2608.27826】Personalized and Multi-View Representation for Federated Cold-Start Recommendation
链接：https://arxiv.org/abs/2608.27826
作者：Jaehyung Lim,Wonbin Kweon,Woojoo Kim,Junyoung Kim,Dongha Kim,Hwanjo Yu
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：existing methods assume, users' interaction histories, federated cold-start recommendation, centralizing users' interaction, enables personalized modeling
备注：
点击查看摘要
Abstract:Federated recommendation (FedRec) enables personalized modeling without centralizing users' interaction histories, but most existing methods assume a fixed item pool and thus overlook the practical cold-item setting where new items continuously arrive. Under the dual-sided constraint, where the server cannot access clients' interactions while clients cannot access the server's proprietary item attribute features, prior federated cold-start recommendation approaches suffer from three structural limitations: a lack of personalization, compositionality failure caused by forcing heterogeneous semantics into a single embedding space, and training- and communication-inefficiency arising from explicit alignment between separate collaborative and attribute representations. To address these challenges, we propose Personalized and Multi-view Representation for Federated Cold-Start Recommendation (PMFRec). PMFRec learns a personalized representation generator to produce user-specific item representations from attribute features, and introduces a global multi-view encoder with item-adaptive gating and an orthogonality objective to capture complementary semantic views while reducing cross-view redundancy. In addition, PMFRec fuses collaborative and attribute knowledge into a single exchanged item representation, eliminating the need for an explicit client-side regularizer and reducing communication overhead. Extensive experiments on real-world datasets show that PMFRec consistently outperforms strong baselines in cold-item recommendation and further improves user-level fairness, warm-scenario adaptability, and robustness under Local Differential Privacy (LDP).
11. 【2608.27809】LINE Conversation History Retrieval for Personal Memory RAG: Evaluating Search Representations and Hybrid Retrieval
链接：https://arxiv.org/abs/2608.27809
作者：Akito Hattori
类目：Information Retrieval (cs.IR)
关键词：LINE conversation history, large language models, user LINE conversation, personal memory retrieval-augmented, user LINE
备注： 16 pages, 6 figures, 10 tables. Exploratory single-user case study
点击查看摘要
Abstract:As an initial step toward personal memory retrieval-augmented generation (RAG) for large language models (LLMs), this study presents a retrieval-only case study over one user's LINE conversation history. We segmented 358,896 messages into 22,329 temporally coherent chunks and constructed three search representations: raw_text, a generated summary, and embedding_text, which combines a summary with a raw-text excerpt and other fixed text. We compared BM25, dense vector retrieval, and linear hybrid retrieval on 100 evaluation questions verified by a single annotator. Among individual retrievers, embedding_text_bm25 achieved the highest point estimate, with Recall@5 of 0.584. We then explored six retriever pairings and 21 weights, for 126 configurations on the same evaluation set. The selected combination of embedding_text_bm25 and embedding_text_vector at beta = 0.45 achieved Recall@5 = 0.697, MRR@5 = 0.595, and nDCG@5 = 0.575. Its Recall@5 exceeded that of embedding_text_bm25 by 0.113, with a question-level paired percentile-bootstrap 95% confidence interval of [0.048, 0.184]. This interval is conditional on fixing the configuration selected on the same 100 questions and does not account for uncertainty from configuration selection or weight search. The difference from a summary-based hybrid at beta = 0.50 was 0.050, with a 95% confidence interval of [-0.013, 0.115], so no clear difference could be established. The 17 aggregate questions also yielded lower point estimates than the other question types, suggesting that flat chunk-level retrieval struggles when evidence is distributed across multiple times and conversations. This evaluation is an exploratory single-user, single-annotator study conducted on the same question set used for configuration search; it does not evaluate final answer generation or generalization to unseen questions.
12. 【2608.27746】NormasTCU --- A Brazilian Portuguese IR Dataset and an Evaluation of LLM-as-a-Judge for Relevance Assessment
链接：https://arxiv.org/abs/2608.27746
作者：Leandro Carísio Fernandes,Marcus Vinícius Borela de Castro,Leandro dos Santos Ribeiro,Leonardo Augusto da Silva Pacheco,Edans Flávius de Oliveira Sandes
类目：Information Retrieval (cs.IR)
关键词：Portuguese Information Retrieval, Information Retrieval, collections remains costly, lacks public datasets, Portuguese Information
备注：
点击查看摘要
Abstract:Portuguese Information Retrieval (IR) lacks public datasets, and relevance assessment for specialized collections remains costly. While Large Language Models (LLMs) increasingly support relevance assessment, their reliability in non-English specialized domains remains unclear. We introduce NormasTCU (this https URL), a Brazilian Portuguese IR dataset with 14,469 legal documents, 46 queries, and 3,048 human judgments over 812 query-document pairs. Using NormasTCU, we evaluated LLM-as-a-judge for relevance assessment by prompting three models with two prompt techniques to grade these pairs. We then compared the rankings of 15 IR systems derived from LLM-generated and human reference qrels. LLMs consistently showed a positive scoring bias (mean absolute error: 0.46--0.66 on a 0-2 scale). Furthermore, pair-level agreement with human judgments achieved only fair to moderate levels, with Cohen's kappa ranging from 0.32 to 0.53. Despite this bias, LLM-generated judgments often yielded highly similar system rankings for nDCG@10 and MRR (observed Kendall's tau greater than or equal 0.90, although the bootstrap confidence intervals did not always remain above this threshold), but were less reliable for P@10 and R@10. Notably, LLM-based rankings were sometimes more strongly correlated with the reference ranking than individual human annotations were. As a practical implication, our results suggest that LLMs could effectively support scalable relevance assessment in specialized Portuguese corpora when evaluated using nDCG or MRR (rank-aware metrics), but they should be avoided when relying on precision or recall.
13. 【2608.27663】A Versioned Unified Graph Index for Dynamic Timestamp-Aware Nearest Neighbor Search
链接：https://arxiv.org/abs/2608.27663
作者：Jun Woo Chung,Weijie Zhao
类目：Information Retrieval (cs.IR)
关键词：time-aware approximate nearest, approximate nearest neighbor, nearest neighbor searches, performing fast time-aware, fast time-aware approximate
备注： 15 pages, 8 figures, 3 algorithms
点击查看摘要
Abstract:We present TiGER (Time-Integrated Graph for Efficient Retrieval), a novel approach for performing fast time-aware approximate nearest neighbor searches on dynamic vector datasets with flexibility over any possible time range. Our proposed algorithm builds and maintains a unified graph for all vectors by leveraging an index structure based on integrated versioned connectivity, allowing arbitrary time intervals to be queried directly on the unified graph without having to traverse invalid vectors. This forgoes the need for post-search filtering or merging, or separate graphs for each possible composite range. Empirical evaluations show that our method attains up to a 5x improvement in queries per second (QPS) without compromising accuracy over baselines based on filtering or per-time-segment sub-graphs. We believe that this method will enable efficient temporal analysis across evolving datasets in real-time recommendation systems, log analysis, and any scenario requiring fast similarity search over dynamic, time-segmented data.
14. 【2608.27631】Beyond the Vacuum: Combinatorial Strategy Selection for Competitor-Aware Generative Engine Optimization
链接：https://arxiv.org/abs/2608.27631
作者：Vaibhav Sourirajan,Yao Zhang,Himanshu Kumar,Sahil Wadhwa,Mann Patel,Amirfarrokh Iranitalab
类目：Information Retrieval (cs.IR)
关键词：Generative Engine Optimization, Large Language Model, Generative Engine, visibility in Large, Large Language
备注： 20 pages, 2 figures
点击查看摘要
Abstract:Generative Engine Optimization (GEO) has emerged as a novel paradigm for transforming content to increase visibility in Large Language Model (LLM) responses. Traditional GEO methods, however, select rewriting strategies in isolation, ignoring a critical externality: as adoption of content optimization grows, optimal strategies for rewriting content change. We formalize GEO as a competitor-aware strategy selection problem and propose a two-phase pipeline to solve it: (1) We use Bayesian Optimization of Combinatorial Structures (BOCS) to efficiently search the space of rewriting strategies, (2) We generate preference pairs and grounded reasoning traces from the BOCS black-box observations to fine-tune a language model to analyze a document corpus and propose optimal rewriting strategy combinations. We achieve state-of-the-art performance across several impression metrics over existing agentic and single-heuristic methods on both geo-bench and our synthetically augmented competitive dataset geo-bench_comp. Our method also transfers to multiple out-of-distribution datasets, proving effective across domains, queries, and document types.
15. 【2608.27629】LitCurate: A Configuration-Driven AI-Assisted Framework for Scientific Database Construction with an Application to Lower-Mantle Equation-of-State Data
链接：https://arxiv.org/abs/2608.27629
作者：Abin Shakya,Wilson Samuels,Dominica Wilson,Gioia A. Marchi,Israa Draz,Chenxing Luo,Renata M. Wentzcovitch
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI); Geophysics (physics.geo-ph)
关键词：mation remains locked, growing scientific literature, entific software, support data-driven, data-driven and physics-based
备注： 26 pages, 7 figures
点击查看摘要
Abstract:The growing scientific literature contains decades of experimental and computational results that could support data-driven and physics-based modeling, yet much of this infor- mation remains locked in publications and is not readily usable for large-scale analysis or sci- entific software. Building structured databases from the literature is particularly challenging whenrelevantstudiesmustfirstbediscoveredamonglargecollectionsofpapersandreported quantities must be extracted with enough scientific context to remain usable. We present LitCurate, an open-source framework for building scientific databases from the literature using large language models within an auditable, stage-wise curation workflow. LitCurate integratesliteraturediscovery, relevancescreening, full-textprocessing, andstructuredinfor- mation extraction while retaining intermediate results and provenance, allowing researchers to inspect and revise individual stages rather than treating automated curation as a black- box process. We apply LitCurate to construct an equation-of-state database of lower-mantle and lower-mantle-relevant high-pressure mineral phases from experimental and theoretical studies, comprising 1,334 entries from 205 papers. The resulting dataset links reported equation-of-state parameters to mineral phases, compositions, equation formulations, meth- ods, and parameter constraints, and labels values as source-reported or citation-reported when provenance can be determined. The records are available through a searchable web application. By connecting scientific literature to traceable, machine-readable data, LitCu- rate provides a reusable approach for transforming accumulated literature into resources for scientific analysis and computational modeling.
16. 【2608.27484】CareGraph: An Auditable Hybrid AI Framework for Evidence-Grounded Personalized Longitudinal Health Intelligence
链接：https://arxiv.org/abs/2608.27484
作者：Pratik Ghawate,Tanvi Patil
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Multiagent Systems (cs.MA)
关键词：Artificial intelligence, wearable evidence remains, evidence remains difficult, transforming personalized healthcare, interpret and trace
备注： 21 pages, 7 figures, Code and data: [this https URL](https://github.com/PratikGhawate/ai-personalized-health-intelligence)
点击查看摘要
Abstract:Artificial intelligence is transforming personalized healthcare, yet fragmented clinical, self reported, and wearable evidence remains difficult to interpret and trace. We present CareGraph, an auditable hybrid AI framework that converts heterogeneous records into prioritized trends, missing context indicators, bounded next steps, discussion questions, and provenance linked explanations. CareGraph organizes evidence without diagnosing, predicting outcomes, selecting treatment, or making autonomous clinical decisions. Its pipeline covers deterministic analysis, context detection, graph construction, constrained language model synthesis, evidence validation, safety controls, and release gating. Tests used synthetic cohorts of 400 patients each for development, validation, and holdout. On holdout data, a frozen ordinary least squares trend rule with a sufficiency gate achieved 0.827 accuracy, 0.837 macro F1 with a 95 percent confidence interval of 0.819 to 0.854, and 0.974 insufficient data F1. Missing context detection achieved 0.815 strict micro F1 versus 0.318 for the legacy detector. On an authored holdout benchmark, safety ruleset version 1.2 achieved 1.000 precision, 0.950 recall, and 0.974 F1. An audit requiring graph retrieval across 80 patients yielded 79 syntheses and 78 presentations without fallback; one output was blocked and one failed closed because of an invalid evidence key. Against monolithic GPT 5.6 on 56 matched patients, CareGraph was faster at 40.15 versus 49.62 seconds, shorter at 661 versus 1,163 words, and showed better exploratory lexical alignment with longitudinal targets; the baseline used fewer tokens and cited more raw evidence. Graph auditing verified provenance and deterministic retrieval; incremental graph effects on generation require paired evaluation. CareGraph offers a safety bounded foundation for intelligent personalized health systems.
计算机视觉
1. 【2608.28568】SignRR: Retrieve and Refine Real Motion for Sign Language Production
链接：https://arxiv.org/abs/2608.28568
作者：Fidel Omar Tito Cruz,Angie Sanchez Marquina,Summy Farfan,Gissella Bejarano
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sign language production, generate continuous signing, language production, spoken language, aims to generate
备注： Accepted at the 37th British Machine Vision Conference (BMVC 2026)
点击查看摘要
Abstract:Sign language production (SLP) aims to generate continuous signing motion from spoken language, often through gloss-to-pose generation. Prior work mainly follows two paradigms. Generative models synthesize motion from a learned prior or from noise, without reference to an observed signing instance, making rare hand configurations and signer-specific articulation difficult to preserve. Retrieval-based methods reuse real, well-articulated motion segments, but concatenating segments from different signers and co-articulation contexts can introduce rhythm and style inconsistencies across the full sequence, not only at segment boundaries. These limitations suggest a complementary solution: use retrieval to provide realistic articulation, and use learned refinement to impose the global coherence that retrieval alone lacks. We therefore propose retrieve-and-refine, a paradigm that starts from real retrieved motion and refines it into a globally coherent signing sequence rather than generating motion from scratch. Our framework, SignRR, initializes motion from a dictionary of real sign segments and refines the full sequence with a part-aware Residual VQ-VAE, where residual quantization preserves fine hand articulation and temporal length differences are handled in the latent space. Experiments on PHOENIX14T and CSL-Daily show that SignRR achieves state-of-the-art back-translation performance while maintaining competitive pose quality.
2. 【2608.28567】GeBDA: Building Damage Assessment as Text-Based Sequence Prediction
链接：https://arxiv.org/abs/2608.28567
作者：Olivier Dietrich,Krishna Sapkota,Konrad Schindler,Genady Beryozkin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Building Damage Assessment, dedicated network architectures, geospatial image foundation, fine-tuning geospatial image, image foundation models
备注：
点击查看摘要
Abstract:Conventionally, Building Damage Assessment (BDA) is tackled either with dedicated network architectures or by fine-tuning geospatial image foundation models. In this work, we ask whether a general-purpose Vision-Language Model (VLM) can localize buildings and grade their damage through autoregressive sequence generation alone. We cast BDA as predicting a variable-length set of bounding boxes, each specified by its coordinates and a damage label. Our preliminary implementation, based on the open Gemma model, achieves promising damage mapping results from only bi-temporal satellite images and a suitable text prompt.
3. 【2608.28549】Video Generative Models as Geometry Learner
链接：https://arxiv.org/abs/2608.28549
作者：Haosen Yang,Jifei Song,Zhensong Zhang,Xiatian Zhu,Jiankang Deng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：image diffusion models, Recent generative approaches, image diffusion, adapt pretrained image, pretrained image diffusion
备注： 19 pages, 4 figures, 5 tables. Project page: [this https URL](https://happy-hsy.github.io/projects/GeoNeXt/)
点击查看摘要
Abstract:Recent generative approaches to geometry estimation adapt pretrained image diffusion models and treat the task as image-conditioned generation. Leveraging off-the-shelf image diffusion models, they either (i) train task-specific geometry models (for depth and surface normal estimation) independently, losing the opportunity of exploring the intrinsic correlation of these geometric targets, or (ii) jointly fine-tune modified image diffusion backbones (e.g., altered self-attention), which typically demands substantial labeled data. To overcome these limitations in a principled fashion, we repurpose pretrained video generative models as a unified and data-efficient framework for geometry estimation, formulated innovatively as a next-frames prediction task. Our method, GeoNeXt, inherits naturally structured knowledge and richer priors from the video model, while further adapting them for joint modeling of images and geometry targets (image - geometry), enabling more data efficient and effective learning of geometry. Extensive experiments validate our method for zero-shot monocular depth and surface normal estimation across diverse datasets, outperforming both previous task-specific and unified generative competitors while using substantially less training data. Notably, our method rivals discriminative state-of-the-art approaches trained on over 100x more data and even standouts on several benchmarks.
4. 【2608.28524】xture Image Classification Using DWT AlexNet Feature Fusion and Deep Neural Networks
链接：https://arxiv.org/abs/2608.28524
作者：Arun D. Kulkarni
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：including industrial inspection, computer vision applications, medical image analysis, remote sensing, vision applications
备注： 15 pages, 15 figures
点击查看摘要
Abstract:Texture image classification plays a significant role in computer vision applications, including industrial inspection, medical image analysis, remote sensing, and object recognition. Handcrafted features can capture local texture characteristics but may have limited capability to represent complex visual patterns. In contrast, deep learning models automatically learn discriminative representations but may not fully exploit the multiscale spatial-frequency information inherent in texture images. This paper proposes a hybrid feature fusion framework, termed DWT_AlexNet_DNN, which combines Discrete Wavelet Transform (DWT) features with deep features extracted using AlexNet for texture image classification.
5. 【2608.28517】Learning the Target Priors Before Image Translation: A Decoupled Training Paradigm for Cross-Modal Image Translation in Remote Sensing
链接：https://arxiv.org/abs/2608.28517
作者：Keyan Hu,Mingtao Wang,Ziyu Zhou,Tiandong Shi,Haifeng Li,Ji Qi,Chao Tao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：preserve source-observed content, Cross-modal image translation, image translation, remote sensing, sensing must preserve
备注： 26 pages, including supplementary material
点击查看摘要
Abstract:Cross-modal image translation in remote sensing must preserve source-observed content while matching the target-domain distribution. Existing methods jointly learn the target prior and cross-modal dependence from scarce paired data, overlooking a key asymmetry: only the latter intrinsically requires cross-modal correspondence. We formalize this distinction through conditional-score and denoising-risk analyses and propose Learning the Target Priors Before Image Translation (LTP-BIT), a prior-first paradigm that decouples the two learning tasks. LTP-BIT first learns a target-domain generative prior from large-scale unpaired imagery, then retains the pretrained backbone weights and learns source-conditioned control through P-DART, a parameter-efficient dual-stream architecture. Controlled experiments show that prior matching and scaling primarily improve target-domain realism, whereas instance fidelity relies more strongly on conditional adaptation. LTP-BIT achieves state-of-the-art performance across SAR-to-RGB and NIR-to-RGB benchmarks using only 9.81% task-specific parameters. On QXS-SAROPT, it retains near-full-data instance fidelity with only 25% of the paired samples.
6. 【2608.28461】Anatomy-Aware Promptable Segmentation with Online Interactive Training for AUTOPET V
链接：https://arxiv.org/abs/2608.28461
作者：Pablo Lozano-Jimenez,Sergio Romero-Tapiador,Ruben Tolosana
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：AUTOPET V challenge, PSMA PET, whole-body lesion segmentation, present an anatomy-aware, strong initial segmentation
备注：
点击查看摘要
Abstract:We present an anatomy-aware, promptable model for whole-body lesion segmentation in FDG and PSMA PET/CT, developed for the AUTOPET V challenge. The proposed method is built as family of nnU-Net-based models and trained in two stages: i) a pre-training stage that produces a strong initial segmentation, and ii) an online interactive stage that learns to exploit scribble prompts, refining the prediction over successive interactions. Anatomical context is incorporated through organ supervision using a single shared head that predicts lesions and organs from the same features, which reduces false positives arising from physiological uptake. Also as the tracer (i.e., FDG/PSMA) is not provided at inference, we add a tracer classifier based on image processing and a random forest over coronal MIP features, routing each study to a combined FDG+PSMA model or to a PSMA-specific model. Across four-fold cross-validation the organ-supervised model achieves the best and most stable performance, the interactive stage improves the Dice score monotonically with each prompt, and PSMA-specific training yields the strongest tracer-wise results.
7. 【2608.28460】LayerRecall: A State-Conditioned Memory Router for Long-Horizon Consistency in Video Generation
链接：https://arxiv.org/abs/2608.28460
作者：Yixuan Ding,Jiahao Kong,Wei Huang,Ruijie Quan,Yi Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autoregressive video diffusion, diffusion enables scalable, enables scalable long-video, scalable long-video generation, video diffusion enables
备注： 15 pages, 11 figures
点击查看摘要
Abstract:Autoregressive video diffusion enables scalable long-video generation by producing chunks from a bounded recent context. While recency-based caching preserves local continuity, it evicts historical cues needed when subjects, objects, scenes, or attributes reappear. Existing memory mechanisms expose models to nonlocal history, but access alone does not ensure effective use. Our analysis reveals that video DiT layers exhibit distinct preferences for current, recent, and distant context, suggesting that long-range memory requires deciding both what to retrieve and where to use it. We introduce LayerRecall, a current-conditioned, layer-selective memory router that retrieves relevant historical K/V states and injects them only into backbone-specific memory-sensitive layers while preserving local attention elsewhere. To reduce reliance on scarce high-quality long-horizon videos and explicit memory-allocation labels, we further propose Cross-Horizon Prediction Matching (CHPM), which uses a privileged long-context reference to supervise the bounded-memory router in prediction space. Across 100 multi-shot evaluation prompts, LayerRecall achieves the best overall results on MemoBench and MovieBench while matching its backbone on VBench-Long, demonstrating stronger long-range recovery without sacrificing local continuity. Qualitative analyses further reveal memory-guided self-correction, whereby initially mismatched local attributes return to their historical appearance without resetting ongoing motion or scene structure. Additional analyses show cross-backbone portability and negligible inference overhead.
8. 【2608.28455】ARC-CT: Anatomy-Routed Contrastive Vision-Language Learning for 3D Chest CT
链接：https://arxiv.org/abs/2608.28455
作者：Huseyin Umut Isik,Mehmet Alp Ozaydin,Sila Kurugol,Şeyda Ertekin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：manually annotated labels, learn abnormality classifiers, Contrastive vision-language learning, annotated labels, learn abnormality
备注： Accepted to the Thoracic Image Analysis (TIA) Workshop at MICCAI 2026
点击查看摘要
Abstract:Contrastive vision-language learning uses paired chest CT volumes and radiology reports to learn abnormality classifiers without manually annotated labels. However, two characteristics of chest CT challenge conventional global contrastive learning. First, many critical abnormalities are small or anatomically localized, and pooling an en- tire volume into a single embedding may dilute their visual evidence. Second, the standard contrastive objective treats every other scan in a batch as a negative. Because many chest CTs share abnormalities, this objective incorrectly pushes co-positive pairs apart. We propose Anatomy-Routed Contrastive Learning for 3D Chest CT (ARC-CT), a region-aware framework that addresses these limitations using only la- bels extracted from reports by an LLM, with no manual annotations or bounding boxes. ARC-CT combines three components: (1) an Anato- myQFormer localizing evidence via queries constrained by automatically generated organ masks; (2) a label-Jaccard soft InfoNCE objective in- tegrating the standard one-hot target with the label-set overlap of each pair, which reduces false-negative penalties between studies that share clinical findings; and (3) an organ-level alignment loss connecting mask- pooled visual features to organ-specific report text extracted offline with a large language model. ARC-CT achieves a 0.86 mask-free macro AUC across 18 abnormalities using a compact 3D ResNet-18 backbone. Over- all, ARC-CT outperforms both comparable efficient baselines and sev- eral larger transformer models. Our code and weights are available at this https URL.
9. 【2608.28453】Prompt-Guided Interactive Segmentation of Interstitial Lung Disease in Thoracic CT
链接：https://arxiv.org/abs/2608.28453
作者：Vasilis Dedousis,Lubnaa Abdur Rahman,Lorenzo Brigatο,Ethan Dack,Andreas Christe,Christoph Frank,Manuela Funke-Chambour,Justus Roos,Adrian Huber,Lukas Ebner,Stavroula Mougiakakou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：quantitative disease assessment, interstitial lung disease, Accurate segmentation, quantitative disease, disease assessment
备注：
点击查看摘要
Abstract:Accurate segmentation of interstitial lung disease (ILD) patterns is essential for quantitative disease assessment and longitudinal monitoring. However, existing approaches remain limited by relying on dense annotations and producing static predictions that cannot be refined, motivating interactive approaches. While promptable models show promise in interactive segmentation, their adaptation to ILDs remains largely unexplored. To address this gap, we investigate prompt-guided foundation models for ILD refinement and present, to the best of our knowledge, the first adaptation of MedSAM2 for interactive 3D ILD segmentation on thoracic CT. We investigate three fine-tuning strategies and multiple clinically motivated prompts: bounding-boxes (BBox), point, lasso, and scribble. On a dataset spanning seven ILD patterns and healthy lung tissue, full model fine-tuning performed best, improving the average Dice score by 4.7 percentage points over this http URL BBox prompts achieve the strongest performance, non-native MedSAM2 interactions such as lasso and scribble prompts also prove effective. Finally, we present and evaluate a proof-of-concept end-to-end workflow in which MedSAM2 is initialized from an automatic segmentation prior and subsequently refined using radiologist prompts. Model weights and plug-ins made available at: this https URL.
10. 【2608.28429】Lossy Event Compression: From Event Stream Distortion to Task Performance
链接：https://arxiv.org/abs/2608.28429
作者：Zahra Rezaee,Catarina Brites,João Ascenso
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：microsecond temporal resolution, creating significant bandwidth, Event cameras generate, event stream distortion, cameras generate asynchronous
备注：
点击查看摘要
Abstract:Event cameras generate asynchronous, sparse data streams with microsecond temporal resolution, but in moderate-to-high motion scenes they can produce as many as hundreds of millions of events per second, creating significant bandwidth and storage challenges. Lossy compression is therefore essential for practical deployment, yet existing event stream distortion metrics fail to reliably predict compression-induced degradation at the task level, forcing codec optimization to rely on expensive task-specific evaluations. To address this gap, this paper introduces two fundamentally different event compression pipelines: i) an aggregation-based pipeline that converts the event stream into polarity-based histogram frames for compression with the conventional image codec JPEG 2000, and ii) a frame-free point cloud-based pipeline that codes events natively as 3D points using the octree-based codec G-PCC. Both pipelines are then assessed within a unified task-driven evaluation framework that relates event stream distortion to downstream application performance across four representative tasks: i) video reconstruction, ii) object detection, iii) optical flow estimation, and a delay-sensitive task iv) asynchronous feature tracking under a reference-relative protocol. Building on this framework, five classification-based distortion metrics are applied to event compression for the first time, to the best of the authors' knowledge, and benchmarked against existing event stream metrics. Experimental results demonstrate that the proposed metrics reliably predict compression-induced task degradation across different coding frameworks. This demonstrates that event stream distortion assessment can be an efficient alternative to repeated task-specific evaluation, providing direct guidance for the development and optimization of future event data coding solutions.
11. 【2608.28406】Post-Training VLMs for Video Mistake Detection
链接：https://arxiv.org/abs/2608.28406
作者：Federico Spurio,Olga Zatsarynna,Lars Doorenbos,Emad Bahrami,Gianpiero Francesca,Juergen Gall
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Human mistakes, severe consequences, mistake detection, lead to severe, Human
备注： Accepted at BMVC 2026
点击查看摘要
Abstract:Human mistakes are inevitable when following instructions, yet they can lead to severe consequences. As such, there has been an increased interest in developing methods for detecting mistakes in videos, with current methods mostly focusing on closed-set protocols. While successful in controlled settings, the closed-set assumption limits their wider applicability, as any changes to the task require collecting new data and re-training models. Instead, we argue that mistake detection methods should learn the general concept of a mistake, rather than overfitting to step-specific details. To reflect this, we introduce the Mistake Detection Video Question Answering (MD-VQA) protocol and accompanying benchmark. MD-VQA tests whether methods can discern if a step was executed correctly with respect to its description, for both seen and unseen actions. To address this important challenge, we propose the first video-language-model post-training technique for mistake detection. Our method uses a tailored reward function to encourage the model to identify discrepancies between an instruction and the corresponding video. Extensive evaluations demonstrate that this approach outperforms zero-shot, supervised fine-tuning, and post-training baselines. Notably, our method generalizes especially well to unseen procedures, for instance, with an improvement of up to 11.6% over the best-performing baseline on EP-VQA, paving the way toward general mistake detection. We release our code and benchmark at this https URL.
12. 【2608.28404】How Far Can 5,500 Hours of Driving Take You? A Scaling Law Analysis of Video Diffusion Models
链接：https://arxiv.org/abs/2608.28404
作者：Victor Besnier,Anh-Quan Cao,Elias Ramzi,Spyros Gidaris,Tuan-Hung Vu,Andrei Bursuc,Eloi Zablocki,Matthieu Cord
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：driving data, web-scale route, expensive to collect, bound by privacy, privacy requirements
备注：
点击查看摘要
Abstract:Video generation for autonomous driving cannot follow the web-scale route: driving data is expensive to collect, bound by privacy requirements, and cannot be scraped at will, so models must make the most of a fixed corpus. We present a systematic scaling-law study of video diffusion models trained from scratch on driving data: a family of models from 1M to 9B parameters, trained at different exposures on up to 5,500 hours of driving. Validation loss follows consistent power laws in both model size and training exposure, answering the questions that shape a training budget: whether compute is better spent on longer training or on a larger model, and whether more data is needed. Loss improves much faster with training exposure than with model size, making longer training the most effective way to improve a fixed model under limited compute. However, larger models continue to achieve lower asymptotic loss, so compute-optimal scaling still favors increasing model size when sufficient compute and data are available. Guided by these laws, we train a 9B-parameter model, to our knowledge the largest video diffusion model trained from scratch on driving data: it sets a new open-source state of the art for driving video generation, as measured on nuScenes. Our code and pretrained models are available at this https URL. NATIX is separately releasing the underlying driving data in stages.
13. 【2608.28386】GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image
链接：https://arxiv.org/abs/2608.28386
作者：Semin Kim,Haechan Shin,Jongyoo Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Existing monocular full-body, combine explicit finger-level, Existing monocular, explicit finger-level grasp, category-agnostic object reconstruction
备注：
点击查看摘要
Abstract:Existing monocular full-body 3D human-object interaction (HOI) methods do not combine explicit finger-level grasp optimization with category-agnostic object reconstruction. Despite plausible body-object configurations, their fingers may float from or penetrate objects instead of forming a grasp. We present GraspHOI, the first framework that reconstructs a full-body 3D HOI from a single image while explicitly optimizing finger articulation against the reconstructed object. GraspHOI recovers object geometry directly, without predefined meshes or a fixed category vocabulary. It reconstructs the body, hands, and object separately, aligning them in metric camera space via depth-based registration and image-space alignment. Occlusion-aware palmar correspondences seat the object against the grasping hand, and contact-aware optimization refines arm and finger articulation to form surface contact without excessive penetration. Across four benchmarks and six baselines, GraspHOI improves relative human-object placement, hand accuracy, and contact plausibility. Full pipeline code will be released.
14. 【2608.28383】Semantic Head Specialization Guides Hybrid ViT Attention for Multimodal LLMs
链接：https://arxiv.org/abs/2608.28383
作者：Chenhong He,Lei Li,Shicheng Li,Hanglong Lv,Lingpeng Kong,Qi Liu,Tong Yang,Shuhuai Ren
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Vision Transformers, dominates frontier LLMs, multimodal LLMs lack, attention dominates frontier, attention patterns work
备注：
点击查看摘要
Abstract:Hybrid attention dominates frontier LLMs, yet Vision Transformers (ViTs) in multimodal LLMs lack a satisfactory hybrid design, with no consensus on why certain attention patterns work better. To fill this gap, we study ViT attention heads and find they differentiate into object- and background-specialist roles, a pattern most pronounced under full attention; we call this Semantic Head Specialization (SHS). We propose SHS-Index to quantify this specialization, show that it distinguishes full-attention from chunk-window ViTs, and find that it strongly tracks downstream benchmark performance. We then identify three structural factors that shape SHS---window interaction, token serialization, and local softmax allocation---and use them as design principles for hybrid attention. Guided by these factors, we design Ariadne Attention, a hybrid that matches full attention on 22 image and video tasks at 6.5x less attention compute. Our findings establish head specialization as a measurable property for diagnosing and designing principled hybrid ViT attention at the multimodal-LLM scale.
15. 【2608.28371】Real-Time Musculoskeletal Surrogates for Pediatric Cerebral Palsy: a Credibility Pilot
链接：https://arxiv.org/abs/2608.28371
作者：Mohammad Arif Ul Alam
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：support personalized rehabilitation, low inference latency, Real-time musculoskeletal, cerebral palsy, support personalized
备注：
点击查看摘要
Abstract:Real-time musculoskeletal (MSK) surrogates could support personalized rehabilitation for children with cerebral palsy (CP), but their credibility depends on subject-wise evaluation, low inference latency, and calibrated uncertainty. We develop a subject-conditioned causal neural surrogate using OpenSim-derived static parameters, temporal joint kinematics, true muscle capacities, and training-only perturbations. On a real pediatric CP gait dataset comprising nine children, we use leave-one-subject-out validation on six development subjects and evaluate a frozen configuration once on three locked test subjects. The surrogate accurately reproduces musculotendon lengths (R-square = 0.92 in development validation and approximately 0.95 on locked subjects; nRMSE 8%) while requiring only sub-millisecond to few-millisecond neural inference, well below a 100 ms interactive-rehabilitation target. In contrast, direct muscle-force estimation remains unstable at this small, heterogeneous scale: pooled metrics can overstate within-subject, per-muscle accuracy. A Monte Carlo credibility pilot further shows that propagating only +/-5% anthropometry and muscle-capacity variation produces severely overconfident nominal 90% intervals (approximately 4% force coverage and below 1% MT-length coverage). These results establish a leakage-free evaluation and credibility framework for pediatric MSK surrogates, while identifying force modeling and epistemic uncertainty as the central next challenges for clinically credible digital twins.
16. 【2608.28343】Denoising-Aware Temporal Point Cloud Completion for 3D Crop Architecture Recovery and Phenotypic Trait Extraction
链接：https://arxiv.org/abs/2608.28343
作者：Mrudul Mittal,Soumyashree Kar
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：geometric ground truth, complete geometric ground, depends on accurate, ground truth, development and evaluation
备注： 25 pages of pdf for manuscript , total 12 files including bbl and tex
点击查看摘要
Abstract:High-throughput phenotyping depends on accurate 3D reconstruction of plants across growth stages, yet the development and evaluation of temporal completion methods are limited by the lack of datasets with complete geometric ground truth. To address this challenge, we introduce SynthCrop4D, a procedurally generated synthetic dataset of temporally evolving plant point clouds that provides controllable noise, occlusion, and complete plant geometry for benchmarking reconstruction methods. Using this dataset, we evaluate a two-stage pipeline that combines spatial denoising and temporal point cloud completion. First, a denoising module removes structural artifacts from raw laser-scanned point clouds. The resulting data are then processed by an Adaptive Temporal PoinTr model that reconstructs the current growth stage (t) using information from the previous stage (t-1), enabling recovery of regions missing due to self-occlusion. We evaluate the proposed framework on both SynthCrop4D and the real-world Pheno4D dataset (tomato and maize) under settings with and without denoising. Results show that denoising substantially improves reconstruction quality, with the best configuration achieving a Chamfer Distance of 0.0061 on SynthCrop4D (Temporal PoinTr + Mamba-DG) and an F-Score of 0.2080 on Pheno4D (Vanilla PoinTr + Mamba-DG). We further demonstrate the use of completed point clouds for phenotypic trait extraction, including plant height, canopy width, and convex hull volume, obtaining hull-volume MAEs of 0.021 on synthetic data and 0.343 on real data. Together, SynthCrop4D and the proposed pipeline provide a benchmark and methodology for temporal plant reconstruction and high-throughput crop phenotyping.
17. 【2608.28341】Cross-Spectral Dense Correspondence for Multimodal Spectral Medical Imaging
链接：https://arxiv.org/abs/2608.28341
作者：Eric L. Wisotzky,Jost Triller,Simon W. Härtl,Oliver T. Bruns,Peter Eisert,Anna Hilsmann
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：fuse disparate wavelength, disparate wavelength ranges, Precise dense correspondence, Precise dense, multimodal spectral imaging
备注： Accepted at 2nd Data Curation Augmentation in Medical Imaging Workshop at ECCV 2026
点击查看摘要
Abstract:Precise dense correspondence is a fundamental prerequisite for multimodal spectral imaging systems that fuse disparate wavelength ranges for subsequent analysis in medical and scientific imaging. Corresponding image points are often observed with non-overlapping spectral sensitivities, leading to wavelength-dependent contrast changes, intensity inversions, and appearance shifts for which dense ground truth is difficult to obtain and conventional RGB-based training data provides only limited supervision. We address this data gap by introducing a sensor-agnostic cross-spectral modulation protocol on established correspondence benchmarks with intensity input projection, and by proposing a synthetic cross-spectral correspondence benchmark simulating physically plausible radiometric differences. Evaluation on several modern dense correspondence backbones trained with our unified cross-spectral protocol showed substantial improvements under severe spectral mismatch while maintaining performance on standard RGB benchmarks. Ablation experiments show that view-dependent channel selection and nonlinear radiometric transformations provide complementary robustness, indicating that the primary limitation of existing models is not their structural matching capacity but the mismatch between training distribution and spectral characteristics of the target image pair. Qualitative evaluations on heterogeneous medical spectral acquisition systems demonstrate the practical relevance of the proposed training data augmentation protocol as an enabler for spatially coherent spectral fusion in HSI workflows.
18. 【2608.28339】Abstract4D: A Large-Scale Dataset and Framework for Understanding the Visual Language of Abstract Art
链接：https://arxiv.org/abs/2608.28339
作者：Haowei Zhang,Yuanpei Zhao,Ji-Zhe Zhou,Mao Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Artificial intelligence, classify artistic styles, intelligence can classify, styles and synthesize, Abstract
备注：
点击查看摘要
Abstract:Artificial intelligence can classify artistic styles and synthesize images, but it still lacks a model of the visual language that gives art meaning. Abstract painting minimizes object semantics and foregrounds structural cues, making it an ideal testbed for computational perception. We introduce \textbf{Abstract4D}, the largest dataset of abstract paintings to date: more than 120,000 images paired with rich metadata and multi-dimensional prompts that capture each work's perceptual attributes---\textit{form, color, texture, and composition}. Annotations are produced by a hybrid human--VLM pipeline for quality and consistency. Using Abstract4D, we (i) analyze the semantic structure of abstract art through large-scale embedding visualization, uncovering how perceptual relationships organize artistic meaning, and (ii) establish benchmark tasks for classification, cross-modal retrieval, and text-to-image generation to evaluate how AI models perceive and reproduce abstract visual language. Together, these analyses demonstrate how Abstract4D enables both exploration and quantitative assessment of AI's ability to represent and interpret abstract art.
19. 【2608.28316】Conditional Visual Evidence Utility: State-Dependent Rank Reversals in Frozen Vision-Language Encoders
链接：https://arxiv.org/abs/2608.28316
作者：Yunxuan Fang,Xinhe Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scores compress visual, importance scores compress, scores compress, compress visual evidence, Static importance scores
备注：
点击查看摘要
Abstract:Static importance scores compress visual evidence into a single ranking, but the value of remaining evidence can change after one cue has been observed. We study this possibility in controlled compositional visual search, where color, shape, and texture evidence can be independently exposed and their conditional marginal utility measured across acquisition states. In a held-out confirmation on 800 scenes, frozen OpenCLIP and SigLIP exhibit robust state-dependent rank reversals that concentrate in candidate-overlap regimes designed to induce ordering changes. The structure persists across two evidence-accumulation constructions and ten equivalent query wordings, but disappears under query-scene derangement. We also ask whether these reversals matter for decisions. In a post-confirmation exploratory matched-first-action analysis, reranking only after the first acquisition yields positive step-2 utility when decisions are selected under one evidence mode, wording, or backbone and evaluated under another. Together, these results show that evidence importance is state-dependent in this controlled setup and that updating an evidence ordering can retain decision-relevant value across evaluator changes. They motivate evaluating vision-language evidence use conditionally rather than through a single static ranking, while providing a measurable target for future adaptive evidence-selection methods.
20. 【2608.28312】AIM: Anchor Identity Features, Then Match for Multimodal Large Language Model Unlearning
链接：https://arxiv.org/abs/2608.28312
作者：Wonjun Lee,Jaehyuk Jang,Kangwook Ko,Hee-Seon Kim,Changick Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Multimodal large language, large language models, creating privacy risks, memorize identity-specific facts, Multimodal large
备注： Accepted to Findings of the Association for Computational Linguistics: EMNLP 2026
点击查看摘要
Abstract:Multimodal large language models (MLLMs) can memorize identity-specific facts about people in their fine-tuning data, creating privacy risks when a person requests deletion. Existing MLLM unlearning methods often assume access to retain images or ground-truth answers during deletion, which is unrealistic in many practical scenarios. We study identity unlearning when retain images are unavailable at deletion time. Our analysis shows that identity and visual-perception questions occupy distinct regions in fine-tuned hidden states and are organized differently: identity questions cluster by person, whereas perception questions cluster by question type. This suggests that identity knowledge can be suppressed without erasing general visual perception. Building on this observation, we propose AIM, a two-stage method that anchors an identity-forgetting target with a universal visual prompt and then matches the vision encoder to that target under a Fisher-based constraint. Extensive experiments show that AIM achieves competitive identity forgetting while preserving non-deleted identities, prior knowledge, and visual perception on the same images.
21. 【2608.28302】FUSED: Forensic-Semantic Mixture-of-Experts for AI Inpainting Detection and Localization
链接：https://arxiv.org/abs/2608.28302
作者：Anton Nuzhdin,Marcel Worring,Ivona Najdenkoska
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：AI-image detectors rely, Diffusion-based inpainting models, Diffusion-based inpainting, localized part, inpainting models modify
备注：
点击查看摘要
Abstract:Diffusion-based inpainting models modify only a localized part of an image, while many AI-image detectors rely on global artifacts and do not localize. These artifacts vary across generators, limiting detector transfer under distribution shifts. Recent work shows that restoring the authentic pixels outside the inpainted region removes these cues and can degrade pretrained detectors. To address this, we present FUSED, a unified framework for the joint detection and localization of AI-generated inpainting. FUSED combines low-level forensic cues with high-level semantic features using a sparsely-gated Mixture-of-Experts architecture, enabling the model to adaptively prioritize the most relevant signal for each token. For each input, FUSED predicts both an image-level manipulation score and a pixel-level mask of the inpainted area. On the OpenSDID cross-generator benchmark, FUSED achieves the best average detection and localization, with the largest gains on unseen generators. The same model transfers directly to the held-out AutoSplice and CocoGlide benchmarks, more than doubling localization performance. Evaluating each held-out benchmark with and without the global generator artifact further shows that all evaluated methods, ours included, partly read the artifact as evidence of manipulation, and FUSED remains the strongest under both conditions. Code and pretrained models are available at this https URL.
22. 【2608.28288】GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping
链接：https://arxiv.org/abs/2608.28288
作者：Xiang Yang,Yongli Wang,Yunsheng Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：methods typically process, Existing feed-forward, internally normalized frames, reconstruction methods typically, methods typically
备注：
点击查看摘要
Abstract:Existing feed-forward 3D reconstruction methods typically process a bounded number of images and recover cameras and geometry in local or internally normalized frames. Extending them to large-scale UAV mapping requires scalable multi-chunk processing and reliable aggregation, while full Sim(3) alignment can become unstable for near collinear trajectories. We present GeoFF3D, which combines a coordinate-anchored model with a spatial large-scale reconstruction framework (SLRF). The model uses georeferenced camera translations and optional geometric priors to predict camera poses and dense point maps directly in a gravity-aligned Z-up metric frame. SLRF partitions images into spatially overlapping chunks, propagates shared-view priors, and aggregates local reconstructions hierarchically, while remaining applicable to different bounded-view models. Across nine aerial mapping blocks, GeoFF3D achieves the best average reconstruction quality, improving F@5 from 0.829 for Pi3X + SLRF to 0.877. On long UAVScenes sequences, it reaches 0.848, compared with 0.687 for Pi3X + SLRF and 0.451 for the strongest evaluated SLAM/streaming baseline. GeoFF3D reconstructs 2,000 images in approximately five minutes, demonstrating scalable and robust large-scale UAV this http URL code is available at this https URL.
23. 【2608.28272】Non-Uniform Quantisation for 3DGS Compression
链接：https://arxiv.org/abs/2608.28272
作者：Bert Van hauwermeiren,Patrice Rondao Alface,Adrian Munteanu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, high bitrate requirements, bitrate requirements pose, requirements pose significant, pose significant challenges
备注：
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has emerged as a powerful technique for novel view synthesis, yet its high bitrate requirements pose significant challenges for storage and transmission. To enable practical applications and ensure interoperability within the 3DGS ecosystem, standardised compression formats are essential. In this paper, we propose a novel non-uniform quantisation scheme specifically tailored for 3DGS models. Our approach adapts to the underlying data distribution by applying importance-weighted quantisation and eliminating post-voxelisation redundancy through importance weighted merging. Extensive evaluations on benchmark datasets demonstrate that our method achieves state-of-the-art compression performance. Furthermore, the proposed scheme is compatible with any point-cloud-based representation and is intended as a formal contribution to the upcoming MPEG 3DGS compression standardisation activities.
24. 【2608.28256】Physics-Guided Flow Matching for CT Image Reconstruction
链接：https://arxiv.org/abs/2608.28256
作者：Davide Evangelista
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Flow Matching, Deep generative models, Flow Matching model, Rectified Flow Matching, solving ill-posed inverse
备注： 16 pages, 6 figures, 2 tables
点击查看摘要
Abstract:Deep generative models have recently emerged as powerful priors for solving ill-posed inverse problems in CT, with diffusion-based approaches achieving state-of-the-art reconstruction performance. However, diffusion models typically rely on stochastic sampling procedures, long inference trajectories, and carefully tuned noise schedules, which can limit computational efficiency and numerical stability, especially at high spatial resolutions. In this work, we investigate Flow Matching as an alternative generative prior for CT reconstruction. We train a high-resolution Rectified Flow Matching model on 256x256 chest images from the Mayo Clinic Low-Dose CT dataset. To mitigate overfitting and limited anatomical variability, we employ a two-stage training strategy consisting of an initial phase with strong, anatomically informed data augmentation, followed by a fine-tuning phase with reduced or no augmentation to refine structural fidelity. The resulting model is capable of generating high-quality and anatomically coherent CT-like images, serving as a strong learned prior. We then evaluate multiple reconstruction methods specifically designed for Flow Matching models, including Plug-and-Play Flow, FlowDPS, Flower, and Flow-Priors (ICTM), and compare them against state-of-the-art diffusion-based reconstruction algorithms such as DDRM, DPS, and DiffPIR. Experimental results across several CT inverse problem settings show that Flow Matching-based approaches consistently outperform diffusion-based methods in terms of PSNR, SSIM, and perceptual quality, while requiring fewer sampling steps. Finally, we publicly release the trained Flow Matching model and accompanying code to facilitate reproducibility and future research. Overall, this work demonstrates that Flow Matching provides a stable, efficient, and effective alternative to diffusion models for high-resolution CT image reconstruction.
25. 【2608.28248】Synth-JDoc: Synthesizing a Japanese Document Image Dataset for OCR with Diverse Layouts and Embedded Images
链接：https://arxiv.org/abs/2608.28248
作者：Keito Sasagawa,Shuhei Kurita,Daisuke Kawahara
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Visual Question Answering, Question Answering, Large Vision Language, ability of Large, Document Visual Question
备注： Accepted to ICDAR 2026, 17pages, 5 figures
点击查看摘要
Abstract:The ability of Large Vision Language Models (LVLMs) to read text within document images is crucial, as it enables various applications such as Document Visual Question Answering. To enhance the text-reading capabilities of LVLMs, high-quality OCR datasets are essential. This need is particularly critical for Japanese documents, which often feature vertically written text alongside horizontally written text. Current LVLMs demonstrate considerably lower performance on vertically written Japanese text than on horizontally written text, necessitating specialized OCR datasets to bridge this gap. However, manually constructing OCR datasets is expensive and difficult to scale. Alternatively, constructing datasets by extracting text from existing document images using OCR models introduces challenges, such as text recognition errors and the prerequisite of sourcing document images. To address these issues, we construct an OCR dataset by synthesizing document images directly from text. Leveraging HTML and CSS, we generate multi-column documents that incorporate both vertical and horizontal writing styles. Furthermore, to ensure the visual realism of the documents, we embed images generated by text-to-image models within the layout. Additionally, to foster model robustness, we apply noise and degradation filters to the synthesized document images. In our experiments, we compared the performance of models fine-tuned on our synthetic dataset against baselines fine-tuned on synthetic datasets from prior work and those generated by a high-performance text-to-image model. Evaluation results demonstrate that our synthetic dataset is the most effective approach for improving LVLM performance on reading vertically written Japanese text. Our dataset and code are publicly available (this https URL).
Comments:
Accepted to ICDAR 2026, 17pages, 5 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
Cite as:
arXiv:2608.28248 [cs.CV]
(or
arXiv:2608.28248v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.28248
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
26. 【2608.28247】A comprehensive and trustworthy benchmark of AI methods for change detection in Earth observation
链接：https://arxiv.org/abs/2608.28247
作者：Tadej Tomanič,Alice Baudhuin,Jan Sotošek,Jure Brence,Panče Panov,Nikola Simidjievski,Dragi Kocev
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：land surface transformations, monitoring land surface, Earth observation change, Earth observation, inconsistent evaluation protocols
备注：
点击查看摘要
Abstract:Change detection in Earth observation (EO) is critical for monitoring land surface transformations, yet recent research in the field is constrained by inconsistent evaluation protocols and a narrow focus on predictive accuracy without regard for computational efficiency. To address this, we present a standardized, open-source benchmark for evaluating state-of-the-art (SOTA) deep learning methods for Earth observation change detection. We conduct a comprehensive analysis of ten representative model architectures, ranging from convolutional networks (CNNs) to vision transformers (ViTs), across ten heterogeneous change detection datasets. We rigorously evaluate these models with identical experimental protocols, comparing models trained from scratch against those utilizing pre-trained weights. Furthermore, we evaluate predictive performance alongside computational efficiency, including parameter counts and inference latency. Our findings reveal that well-optimized classical architectures, such as Siamese U-Nets, frequently outperform more complex contemporary models when computational efficiency is factored in, and that pre-training consistently provides a significant performance boost with no additional inference cost. To ensure complete transparency and reproducibility, all experimental resources, including standardized data splits, training scripts, training logs, and model checkpoints are publicly available and adhere to FAIR principles (Findable, Accessible, Interoperable, and Reusable).
27. 【2608.28240】WilLaGS: Latent-Conditional 3D Appearance Fields for Robust Gaussian Splatting In-the-Wild
链接：https://arxiv.org/abs/2608.28240
作者：Yuhao Bai,Qianqiu Tan,Lilong Chen,Huanhuan Lv,Lijun Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, violate multi-view consistency, objects violate multi-view, drastic appearance variations, transient objects violate
备注： Accepted by ECCV2026
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) delivers real-time and high-fidelity rendering but remains challenged by unconstrained in-the-wild scenes, where drastic appearance variations and transient objects violate multi-view consistency. Existing methods are fundamentally limited by independent and discrete embeddings that struggle to capture continuous environmental changes or model spatially-varying local illumination. To address these limitations, we propose \textbf{WilLaGS}, a unified framework for robust 3D scene reconstruction and generative appearance synthesis under unconstrained settings. Specifically, we introduce a generative appearance model where a $\beta$-VAE learns a structured and continuous manifold of global appearance. Conditioned on the latent code, we construct a 3D neural appearance field that generates dynamic Tri-Plane features to encode spatially-varying local illumination effects. Furthermore, to suppress transient artifacts, we present a self-supervised perceptual masking mechanism that leverages a Teacher-Student (EMA) architecture to derive a stable scene consensus, robustly identifying inconsistent regions via perceptual discrepancies. Extensive experiments on multiple datasets demonstrate that \textbf{WilLaGS} achieves state-of-the-art performance in reconstruction quality and novel view appearance synthesis, while maintaining real-time rendering efficiency.
28. 【2608.28219】RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation
链接：https://arxiv.org/abs/2608.28219
作者：Zhen Xiao,Zhen Shen,Zhaofan Qiu,Ting Yao,Xueliang Liu,Tao Mei
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：cross-identity spatial mapping, aims to drive, drive a target, image to follow, Cross-identity character animation
备注： Accepted by ECCV 2026. 15 pages, 7 figures
点击查看摘要
Abstract:Cross-identity character animation aims to drive a target identity from a reference image to follow the motion of a source character from a driving video. The core challenge lies in the inherent entanglement of two capabilities: cross-identity spatial mapping (aligning position, scale, and skeletal proportions) and motion control (refining joint articulation, volumetric consistency, and view coherence). We introduce Reference-Aware Structural Alignment (RASA), a framework that disentangles spatial mapping from motion control by injecting structured priors into a Diffusion Transformer (DiT). Our approach has two stages. First, a Spatial Prior Calibrator (SPC) fuses reference identity with driving pose to generate a spatially grounded initial noise latent, ensuring correct positioning, scaling, and alignment with the driving skeleton. Second, an Inherent Motional Guider (IMG) encodes shape-agnostic SMPL articulation parameters into a semantic motion vector beyond appearance-biased 2D keypoints. Injected into intermediate DiT layers, this vector complements the base pose condition for anatomically consistent articulation and view-aware volumetric refinement. We curate CIM-Bench, a high-quality benchmark with rigorous curation, for evaluation. Extensive experiments show RASA significantly outperforms state-of-the-art methods in motion fidelity and visual quality. Our work establishes a new paradigm showing disentangled spatial and motional priors are key to robust character animation. Project page: this https URL
29. 【2608.28218】Focus Where It Counts: A Salience-Driven Vision-Language Model for Low Vision Assistance
链接：https://arxiv.org/abs/2608.28218
作者：Jiazhao Liang,Hao Huang,Shuaihang Yuan,Congcong Wen,Geeta Chandra Raju Bethala,Giles Hamilton-Fletcher,Yu Hao,John-Ross Rizzo,Mengyu Wang,Anthony Tzes,Yi Fang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：offer promising capabilities, technologies supporting persons, Vision-language models, assistive technologies supporting, rapidly progressing
备注：
点击查看摘要
Abstract:Vision-language models (VLMs) are rapidly progressing and offer promising capabilities for assistive technologies supporting persons with blindness or low vision. However, existing VLMs are primarily designed for general-purpose captioning and do not explicitly model human perceptual priorities, thereby limiting their ability to emphasize the most relevant information in a scene. To address this gap, we propose a salience-driven captioning framework that prioritizes scene elements according to their importance for human-centered assistance. We curate three salience-aware datasets, namely, Salience COCO, Salience Flickr, and Salience VizWiz, with object-level salience annotations designed to reflect the visual information most relevant to low vision users across different environments. Building on these datasets, we introduce Salience-LLaVA, a salience-aware VLM that incorporates salience cues to generate captions in which important elements are mentioned in the order of importance. Our work makes four main contributions. We build salience-aware datasets verified by low vision participants, propose Salience-LLaVA to describe objects in the order of importance, introduce SCMI to evaluate ordering accuracy, and deploy the system on assistive glasses to demonstrate real-world practicality. Code and datasets are available at: this https URL
30. 【2608.28216】WALDO: One-Shot Exemplar-Conditioned Object Detection in Cluttered Scenes
链接：https://arxiv.org/abs/2608.28216
作者：Kishor Datta Gupta,Ahmed Rafi Hasan,Md. Mahfuzur Rahman,Md. Sadman Haque,Mohd Ariful Haque
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large vision-language models, single reference image, Locating a specific, short description, large vision-language
备注：
点击查看摘要
Abstract:Locating a specific object instance in a cluttered scene using a single reference image and a short description, and reporting when that instance is absent, large vision-language models usually address this task. We ask whether the same capability is available far more cheaply, from representations already learned by a world-model pretraining objective. We present WALDO, a one-shot exemplar- and language-conditioned detection head with 3.4M trainable parameters that reads frozen V-JEPA 2.1 features to jointly predict object localization and target presence, with no gradient on the backbone. Because exemplar-conditioned supervision is scarce, we synthesize training episodes from instance annotations, mining exemplars from ground-truth boxes and constructing absence cases that exclude the referenced instance while leaving same-category distractors in view. This is easy to get wrong: in the obvious implementation, crop size alone predicts the label, and a head trained on it reaches 0.9998 absence AUROC without ever consulting the exemplar, and we report the negative controls that close the shortcut. On 35 held-out cluttered scenes, WALDO achieves a 0.461 catalogue AP@50, compared to 0.306 for a prompted Grounding DINO baseline under an identical scorer. Substituting DINOv3 for V-JEPA under a matched 576-token grid drops within-category absence AUROC from 0.880 to 0.726 and instance AP@50 from 0.201 to 0.141, isolating the pretraining objective rather than input resolution as the source of the gain. Instance-level Success@1, however, reaches only 0.190 against a 0.190 category-chance floor: world-model features transfer to localization precision and absence detection but not to instance identity.
31. 【2608.28207】Explainable Diabetic Retinopathy Classification Using Vision Foundation Models
链接：https://arxiv.org/abs/2608.28207
作者：Abhishek Verma,Anila Krishna,Abhishek Gajanan Bankar,Juan Miguel Lopez Alcaraz
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：trustworthy automated screening, Diabetic retinopathy, preventable blindness, automated screening, accurate and trustworthy
备注： 11 pages, 4 figures, source code under [this https URL](https://github.com/UOLMDA26/retinopathy_vision_foundational)
点击查看摘要
Abstract:Diabetic retinopathy (DR) is a major cause of preventable blindness, creating a need for accurate and trustworthy automated screening. This study investigates an explainable DR classification framework using vision foundation models and multiple transfer learning strategies. Three backbones, DINOv2, CLIP, and Vision Transformer (ViT), were evaluated using full fine-tuning, linear probing, and Low-Rank Adaptation (LoRA). Models were trained and internally evaluated on the ODIR dataset and externally evaluated on APTOS to assess generalization. DINOv2-LoRA achieved the highest internal AUROC of 0.758, while DINOv2 full fine-tuning and ViT full fine-tuning achieved the highest external AUROC of 0.920. Calibration was further assessed using reliability analysis after isotonic regression. For explainability, Grad-CAM and HiResCAM were evaluated against expert-annotated lesion masks from the IDRiD dataset using Dice, Intersection over Union (IoU), and Pointing Game metrics. The results demonstrate that foundation models, particularly DINOv2, can provide strong predictive performance, while LoRA offers a parameter-efficient alternative to full fine-tuning. Quantitative evaluation of explanation maps further supports the assessment of whether model attention corresponds to clinically relevant retinal lesions.
32. 【2608.28206】NumBench: Diagnosing Counting Failures in Text-to-Image Models
链接：https://arxiv.org/abs/2608.28206
作者：Sandeep Wadhwa,Mayank Vatsa,Richa Singh,Parrva Chirag Shah,Prakhar Galriya
类目：Computer Vision and Pattern Recognition (cs.CV); Databases (cs.DB)
关键词：generate the wrong, wrong number, small or weakly, weakly controlled, controlled to explain
备注： The compiled main paper has seven technical-content pages; references start on page 8. The compiled supplement has three pages
点击查看摘要
Abstract:Text-to-image (T2I) models often generate the wrong number of objects, yet existing benchmarks are too small or weakly controlled to explain why. We introduce \textbf{NumBench}, a benchmark of 640{,}000 prompts spanning 1{,}600 categories and counts from 1 to 100. Its factorial design varies object composition, spatial guidance, and appearance conditions while balancing counts and category exposure. We also develop a process model in which requested instances compete for a finite set of resolvable image regions. The model predicts a near-quadratic collision deficit at low occupancy and shows how coordinated placement reduces it. For scalable evaluation, we propose the Confidence-Weighted Numeric Precision Score (\cwnps), which aggregates three calibrated detectors and discounts uncertain proposals. Across five commercial systems, two open models, and two specialized counting methods, performance declines sharply with requested count; all evaluated methods are weak above 50 objects. Count range has the largest measured effect, followed by layout and composition. Grid guidance is strongest among guided layouts, consistent with the coordination prediction, although the analysis does not establish collision as the sole cause. A 14{,}400-image human study supports automated evaluation through count 50, while results on 243 natural-language prompts show transfer beyond NumBench templates.
33. 【2608.28205】Cut-ViT: Task-Specific Model Pruning via Gram Anchoring Subspace Consistency
链接：https://arxiv.org/abs/2608.28205
作者：Jianjian Yin,Liulei Li,Tao Chen,Yi Chen,Yazhou Yao,Wenguan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：attracted considerable attention, Pruning visual foundation, visual foundation models, considerable attention, visual foundation
备注： Accepted by ECCV2026
点击查看摘要
Abstract:Pruning visual foundation models has attracted considerable attention. However, existing methods focus on rigid point-to-point token alignment on a single dataset for pruning, suffering from two limitations: i) robustness degradation, and ii) task-specificity deficiency. To address these limitations, we propose a task-specific pruning pipeline, named Cut-ViT. Specifically, we first construct gram anchoring matrices from both spatial and semantic perspectives, and perform the subspace decomposition to extract the corresponding subspace bases. Basis-agnostic and residual constraints are then adopted to align the gram subspaces between the native and pruned DINOv3 models along spatial and channel dimensions, enabling subnetworks to inherit robust feature representations of native DINOv3. Furthermore, we design spectral entropy adaptation, which quantifies the information density of feature manifolds along spatial and channel dimensions, thereby adapting the pruning objective to specific downstream tasks. Experiments show that Cut-ViT requires approximately one minute on a single A100 GPU to obtain subnetworks at various sparsity levels, using only 20.9% of the time and 45.5% of the GPU memory compared with previous methods, while achieving SOTA performance on six tasks across nine datasets.
34. 【2608.28195】UniLipi: A Unified Multi-Script OCR for Historical Indic Manuscripts
链接：https://arxiv.org/abs/2608.28195
作者：Tathagata Ghosh,Sai Madhusudan Gunda,Simran Singh Sandral,Ravi Kiran Sarvadevabhatla
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Optical character recognition, Optical character, handwritten Indic manuscripts, essential for large-scale, large-scale digitization
备注： To be published in ICDAR 2026
点击查看摘要
Abstract:Optical character recognition (OCR) for handwritten Indic manuscripts is essential for large-scale digitization and computational access to manuscript heritage. However, existing approaches are typically developed for one script at a time and require substantial script-specific customization. This limits scalability and practical deployment across diverse collections. We present UniLipi, a unified multi-script OCR model for handwritten Indic manuscripts trained jointly across 13 Indic scripts within a single framework. UniLipi directly handles realistic manuscript conditions, including extreme variation in line geometry, large variation in line length, and partial interruptions caused by non-textual manuscript entities such as holes, stains, or pictorial illustrations. To operate effectively under ultra low-resource conditions, the model leverages script-aware synthetic manuscript data generation, substantially reducing reliance on large volumes of real annotated data. Beyond historical manuscripts, we show that UniLipi serves as an effective foundational pretrained model. Specifically, its learned representations enable good OCR performance for contemporary Indic handwriting and extend to several non-Indic scripts, including Tibetan, Italian, Latin, and Chinese scripts. In addition to transcription, UniLipi predicts script identity and per-line native character counts, supporting practical manuscript cataloging workflows.
35. 【2608.28192】Locate Anything in Videos: Rethinking Efficient Generative Spatio-Temporal Video Grounding
链接：https://arxiv.org/abs/2608.28192
作者：Hanoona Rasheed,Haania Siddiqui,Ming-Hsuan Yang,Fahad Shahbaz Khan,Salman Khan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：referred event occurs, Spatio-temporal video grounding, Spatio-temporal video, referred event, event occurs
备注：
点击查看摘要
Abstract:Spatio-temporal video grounding (STVG) requires models to identify when a referred event occurs and localize the target entity throughout that interval. Existing multimodal large language models typically serialize dense localization trajectories autoregressively, causing decoding latency to grow with tube length and allowing localization errors to propagate across time. We introduce Parallel Tube Decoding (PTD), a generative formulation that decomposes grounding into a temporal block followed by time-conditioned spatial blocks decoded simultaneously. This removes both token-level and trajectory-level dependencies, reducing the sequential decoding depth to a fixed $1 + 1$ rounds, independent of tube length. To enable parallel spatial generation, we introduce Decoupled Block Attention, which preserves access to shared video-query context while eliminating cross-box dependencies, together with localization-aware policy optimization for temporal boundaries and spatial geometry. On VidSTG, PTD reduces Tube Completion Latency by 79x and increases spatial decoding throughput by 92x over standard autoregressive decoding, while also improving grounding accuracy. With a compact 4B backbone, our model performs favorably well on VidSTG and HC-STVG, and generalizes zero-shot to temporal grounding, grounded VideoQA, and referring video object tracking. Our results show parallel tube generation is an efficient and effective alternative to autoregressive localization in videos.
36. 【2608.28191】EXPOSE: Explainable and Domain-Robust Embeddings from Pathology Vision Foundation Models using Sparse Autoencoders
链接：https://arxiv.org/abs/2608.28191
作者：Anja Witte,Maximilian Lennartz,Jan Baumbach,Guido Sauter,Stefan Bonn,Patrick Fuhlert,Marina Zimmermann
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Vision Foundation Models, Vision Foundation, Foundation Models, tissue preparation, domain shifts arising
备注：
点击查看摘要
Abstract:Vision Foundation Models (VFMs) are widely used in computational pathology but remain sensitive to domain shifts arising from variations in staining, tissue preparation, and scanner hardware. A key limitation is that VFM embeddings entangle biological with domain-specific information, hindering cross-domain generalization. We propose Explainable Probing of Cross-Domain Sparse Embeddings (EXPOSE), a framework that uses Sparse Autoencoders (SAEs) as an explainable bottleneck to identify and suppress domain-specific components in VFM embeddings. We train a sparse representation of VFM features, use a linear classifier to identify domain-specific latent dimensions, and mask these features prior to downstream relapse prediction without retraining the backbone model. Experiments on a large prostate cancer dataset with multiple acquisition domains show that SAE features capture both domain- and task-specific information, which are partially disentangled in the latent space. Removing domain-specific features improves cross-domain performance and increases embedding robustness as measured by the Domain Robustness Index (DoRI). Code is available at this https URL .
37. 【2608.28183】Memory-efficient GPU pipelines for real-time non-line-of-sight reconstruction
链接：https://arxiv.org/abs/2608.28183
作者：Alfonso López-Ruiz,Diego Royo
类目：Distributed, Parallel, and Cluster Computing (cs.DC); Computer Vision and Pattern Recognition (cs.CV)
关键词：imaging reconstructs scenes, single-photon avalanche diode, reconstructs scenes hidden, indirect light recorded, imaging reconstructs
备注：
点击查看摘要
Abstract:Non-line-of-sight (NLOS) imaging reconstructs scenes hidden around a corner from indirect light recorded by a single-photon avalanche diode (SPAD). A single reconstruction is a large inverse problem: billions of photon timestamps must be binned, moved through memory, transformed and inverted. As SPAD arrays raise acquisition throughput, reconstruction becomes the limiting stage. We rebuild the GPU execution of two established wave-based algorithms, f-k migration and phasor-fields, for both streaming and offline processing. On the phasor-fields side we assemble the ring-and-radius kernels of previous work once and offline, using the analytic Fourier transform of a ring, so the propagation kernel never exists in dense form at runtime, reducing the memory and bandwidth. We reorganize the pipeline of both algorithms with fused kernels, warp-level photon binning, batched transforms, CUDA graph replay, and FP16 storage applied only where it reduces the actual bottleneck. Our implementations are up to 42x faster than the reference streaming pipeline and up to 14x faster than the fastest published GPU baseline, all while using a fraction of the memory (down to 2.5%), enabling vastly larger and finer reconstructions on the same hardware, or comparable ones within a much lower memory budget. We report an ablation of each implementation choice and propose three denoising strategies enabled by the resulting frame budget for next-generation NLOS video processing.
38. 【2608.28174】Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting
链接：https://arxiv.org/abs/2608.28174
作者：Yongqi Mao,Zijia Dai,Zhishuo Liu,Wei Xu,Kaiwei Wang,Guotao Meng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：point cloud render, per-frame depth lifts, dominant recipe supplies, point cloud, user-specified camera trajectory
备注： 20 pages, 9 figures, 10 tables. Project page: [this https URL](https://yongxuqixiang.github.io/Manifold4D-Project-Page/)
点击查看摘要
Abstract:Video re-shooting re-renders a monocular video of a dynamic scene along a user-specified camera trajectory, and the dominant recipe supplies the target geometry explicitly: per-frame depth lifts the source video into a 4D point cloud, which is rasterized along the trajectory into a point cloud render. Because the render and the source video are both handed to the network as visual conditions, they compete at every denoising step, leaving the model with a trust dilemma --- how much of the render to believe --- which can degrade trajectory control or visual quality on data outside the training distribution. We argue that a render already pixel-aligned with the target view does not need to be supplied as an explicit conditioning stream at all. We propose MANIFOLD4D, which injects the render directly into the initial noise of flow matching, so that generation no longer departs from standard Gaussian noise but from a new noise manifold carrying geometric information, leaving the source video as the only visual condition. The render is thus used exactly once, and the network is never asked to learn how to read it; in subsequent denoising steps the model can focus on the source video. On our DAVIS-Traj benchmark and on the Vista4D evaluation set, MANIFOLD4D attains the best camera-control accuracy on every metric, lowering rotation error by 25% and 27% and translation error by up to 32% over the strongest baseline, while matching it in video fidelity and leading on real-world novel-view photometric quality. In a user study, our method achieves clear advantages in trajectory following and dynamic consistency. The gap widens as the yaw amplitude grows past the training range, and the model still recovers correct dynamic motion from the source video when the render is deliberately corrupted, confirming that the geometric prior guides generation without overriding it.
39. 【2608.28161】Empowering Local Agriculture: A Deep Learning-Powered Web System for Identifying Bangladeshi Mango Varieties
链接：https://arxiv.org/abs/2608.28161
作者：Monowar Islam,Safaruzzaman Shovo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：varying real-world conditions, closely related cultivars, similar visual characteristics, real-world conditions, Bangladeshi mango varieties
备注： Accept in Journal of Bangladesh Academy of Sciences, Volume 50, Supplement 1, April 2026. 2 authors
点击查看摘要
Abstract:Mango variety identification in Bangladesh is challenging because closely related cultivars can have similar visual characteristics and images are often captured under varying real-world conditions. This work presents a deep learning-based web system for automatic identification of Bangladeshi mango varieties. We collected 2,013 high-quality mango images (3024x4032 pixels) from local markets and farms and organized them into nine classes, combining Bari-4 and Bari-7 as a single Bari class. The dataset was divided into training (70%), validation (15%), and test (15%) sets, with image augmentation applied to improve model generalization. Three pretrained CNN architectures, ResNet18, ResNet50, and EfficientNetB0, were fine-tuned under consistent training settings. EfficientNetB0 achieved the best performance, obtaining 98.01% validation accuracy and 97.36% test accuracy, compared with 86.47% and 78.55% test accuracy for ResNet18 and ResNet50, respectively. Class-wise F1-scores for EfficientNetB0 ranged from 0.93 to 0.99, while the Bari class achieved an F1-score of 0.97. The selected EfficientNetB0 model has approximately 4 million parameters, making it suitable for lightweight deployment. We integrated the model into a Streamlit web application that enables users to upload a mango image and receive a predicted variety with class probabilities. The system provides an accessible, practical tool for mango identification and demonstrates the potential of deep learning for supporting agricultural applications in Bangladesh.
40. 【2608.28145】Dual-Stream Semantic Guidance with Prototype Anchor Calibration for Source-Fully-Free Adaptation of Vision-Language Models
链接：https://arxiv.org/abs/2608.28145
作者：Weiwei Xiang,Shun Peng,Guangyi Xiao,Hao Chen,Lei Yang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：task-specific source models, adapt Vision-Language Models, source models, Vision-Language Models, Dual Semantic Drift
备注：
点击查看摘要
Abstract:Source-Fully-Free Domain Adaptation (SFF-DA) has emerged as a strategic paradigm to adapt Vision-Language Models (VLMs) without any access to source data or task-specific source models. However, we identify a critical Dual Semantic Drift that hinders this process: static drift arising from the rigidity of fixed class embeddings, and dynamic drift stemming from the divergence of generated captions, causing severe semantic misalignment that intensifies the stability-plasticity dilemma. To address this, we propose DSSG (Dual-Stream Semantic Guidance), an end-to-end framework that reconciles fine-grained plasticity with global stability. Our core contribution is the Dual Semantic Guidance (DSG) module, which integrates a caption stream for domain-specific knowledge with a class-anchor stream to anchor global categorical consistency. Furthermore, a Dynamic Cross-Modal Knowledge Distillation (CMKD) module is introduced to leverage the evolving teacher distribution for calibrating teacher-student consistency. Building upon DSSG, we further introduce Prototype Anchor Calibration (PAC), yielding DSSG-PAC, which periodically calibrates prototype anchors and caches them until the next calibration. This design reduces redundant text-side computation while preserving the adaptability of class guidance to the evolving text space. We further establish SFF-DA risk bounds that relate student risk to semantic-teacher quality and teacher--student discrepancy. Extensive experiments demonstrate that DSSG consistently outperforms current state-of-the-art methods across multiple benchmarks, while DSSG-PAC largely preserves its adaptation performance with 18.9% lower total adaptation time. The code is available at this https URL.
41. 【2608.28138】oken-Budget Distillation: Transferring Full-Token Semantics to Compressed Video Vision-Language Models
链接：https://arxiv.org/abs/2608.28138
作者：Xiaoyang Guo,Guoping Luo,Jusheng Zhang,Keze Wang,Wenhao Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Adapting video vision-language, inference costly, video inputs produce, visual token compression, computationally expensive
备注： ACM MM 2026
点击查看摘要
Abstract:Adapting video vision-language models (VLMs) is computationally expensive because video inputs produce a large number of visual tokens, making both fine-tuning and inference costly. Although visual token compression can reduce this overhead, direct adaptation on compressed inputs often causes semantic drift and noticeable performance degradation. We present Token-Budget Distillation (TBD), a parameter-efficient fine-tuning framework for adapting video VLMs under a fixed token budget. TBD freezes the pretrained backbone, updates only LoRA adapters, and integrates FlashVID-based visual token compression into the video pathway. To preserve full-token semantics under compression, TBD employs a dual-path teacher-student design, where a full-token teacher provides stable supervision and a compressed student is optimized with task loss, answer-region KL distillation, GT-anchored margin distillation, and reliability-aware KD control. This design enables the student to recover the semantic behavior of the full-token model while remaining efficient under aggressive token reduction. We evaluate TBD on three video VLM backbones, including LLaVA-Video, LLaVA-OneVision, and Qwen3-VL-8B-Instruct, across four video understanding benchmarks. TBD consistently outperforms compression-only baselines under both moderate and aggressive compression. On LLaVA-Video at retention ratio R = 10 percent, TBD preserves 97.0 percent of the Vanilla model's average accuracy; on LLaVA-OneVision at R = 10 percent, it achieves an average score of 58.4 and matches 100.0 percent relative accuracy.
42. 【2608.28108】DeicticVLA: Unifying Instruction Modes Based on Language and Deictic Gestures in a Single VLA
链接：https://arxiv.org/abs/2608.28108
作者：Kango Yanagida,Tatsuya Aoki,Yuichiro Yoshikawa,Takato Horii
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：canonicalizes Language Instruction, similar appearance requires, appearance requires detailed, requires detailed expressions, natural language
备注：
点击查看摘要
Abstract:Vision-Language-Action models (VLAs) allow users to specify manipulation tasks in natural language, but distinguishing a target or placement goal among objects of the same category or similar appearance requires detailed expressions that VLAs may not use reliably. We propose DeicticVLA, which canonicalizes Language Instruction (LI), Vision-Language Instruction (VLI), and Visual Instruction (VI) into a text prompt and deictic masks through text-prompt completion and deictic gesture grounding, enabling a single pretrained VLA to handle all three instruction modes. With a shared backbone, demonstrations, and matched training steps, we compare two RGB visual prompting methods, two separate-channel mask prompting methods, and three training strategies in simulation. Under two-stage training, the four prompting methods achieve high in-distribution success but differ in their ability to use deictic masks in unseen layouts. Across methods, training-strategy ablations show that two-stage training improves such use, while retaining second-stage LI data mitigates forgetting without reducing VLI and VI performance. In three real-world tasks, one policy supports all modes. VLI and VI outperform LI under unseen expressions, appearance changes, and novel objects. For unseen categories, both achieve 100% success, compared with 16.7% for jointly trained LI. These results demonstrate the unified three-mode interface and guide DeicticVLA design.
43. 【2608.28102】What Will This Copper Look Like Later? Forecasting Surface Appearance and Rendering It as a PBR Material
链接：https://arxiv.org/abs/2608.28102
作者：Teejuta Sriwaranon,Borworntat Dendumrongkul,Tanapat Chamted,Pizzanu Kanongchaiyos
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Digital design requires, design requires predicting, Digital design, design requires, requires predicting
备注： 10 pages, 5 figures, 3 tables. (Repository [this https URL](https://github.com/RuffLogix/kstep-copper-forecast) )
点击查看摘要
Abstract:Digital design requires predicting how a metal surface will look later in its oxidation; this paper presents such a pipeline for copper. Given a fixed-camera observation, the system forecasts appearance 10 accelerated units ahead and converts it into the albedo, normal, roughness and metallic maps a renderer consumes. Forecasting is evaluated as an authoring tool would use it, on a copper specimen the system has not observed: an entire recording is held out, so training and checkpoint selection use one specimen and the test set is the whole of a second, recorded on a different day and condition. Under this protocol a learned spatio-temporal model with a monotone oxidation state, the most accurate forecaster within a single recording, is less accurate than copying the last observed frame on an unseen specimen, in both directions, as are three further trained architectures. The only forecaster that transfers is a closed-form global color extrapolation with no trained parameters, improving on copy-last-frame by 13.4% and 50.6%, with a margin that increases with horizon to +16.7% and +55.5% at t+10. Two controls qualify this: correcting every frame for the photometric drift measured on a non-oxidizing reference region leaves both margins intact, ruling out uncontrolled exposure as their source, and a moving-block bootstrap over the 6 independent windows each recording contains separates the larger margin from zero but leaves the smaller one not individually significant. The mechanism is measured: a learned susceptibility map encodes where corrosion begins on the training specimen and misleads on a new one, whereas the global color trajectory is what specimens share. The pipeline therefore deploys the closed-form forecaster for unseen specimens and the learned model only for continuing one already observed. Code, splits, protocol and leakage audit are released.
44. 【2608.28096】Ex-Sim(3)-Reg: 2D-3D Correspondence Pruning via Extended Sim(3) Registration
链接：https://arxiv.org/abs/2608.28096
作者：Pei An,Muyao Peng,Junfeng Ding,Jiaqi Yang,Liangliang Nan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：garnered increasing attention, recent years, Learning-based, garnered increasing, increasing attention
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Learning-based image-to-point-cloud (I2P) registration has garnered increasing attention in recent years. Nevertheless, existing methods still struggle with severe outliers under challenging scenarios with unseen, low-inlier, or distorted cases. A fast and robust 2D-3D correspondence pruning method is therefore highly desirable. Recently, a promising scheme lifts 2D-3D correspondences to 3D-3D correspondences using depth priors, casting correspondence pruning as a Sim(3) registration problem. However, depth priors estimated from monocular images are inherently noisy, which undermines the reliability of this scheme. In this paper, to explicitly model non-negligible depth noise, we reformulate correspondence pruning as an extended Sim(3) registration problem and propose a simple yet effective pruning algorithm termed Ex-Sim(3)-Reg. We further provide a theoretical analysis to justify the effectiveness of our method. Extensive experiments on the 7-Scenes, RGBD-V2, ScanNet, and TUM datasets demonstrate that Ex-Sim(3)-Reg achieves up to \textbf{24.7\% improvement} in registration recall over state-of-the-art baseline methods. Code is released at this http URL
45. 【2608.28086】Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation
链接：https://arxiv.org/abs/2608.28086
作者：Zijun Zhang,Li Qiao,Mahdi Boloursaz Mashhadi,Zhen Gao,Mehdi Bennis,Kaibin Huang
类目：Information Theory (cs.IT); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：enabling efficient multimodal, efficient multimodal semantic, enabling efficient, goal-oriented transmission, recently emerged
备注：
点击查看摘要
Abstract:Token Communications (TokenCom) has recently emerged as a new paradigm in which tokens serve as unified units for communication and computation, enabling efficient multimodal semantic and goal-oriented transmission. In this paper, we develop Ada-TokenCom, a rate-adaptive TokenCom framework based on large autoregressive models, which integrates next-token prediction with arithmetic coding to achieve ultra-low bitrate semantic communication at the token level. We propose a mixed reconstruction/generation scheme, where the transmitter encodes and transmits the highly informative tokens at the beginning of the token sequence leveraging a pre-trained autoregressive large model, while the receiver uses an identical model to predict the rest. Moreover, we design a Lyapunov-based algorithm to dynamically optimize both the source compression rate and the modulation and coding scheme, adapting to time-varying network conditions. Simulation results demonstrate that our proposed Ada-TokenCom framework outperforms both digital and deep joint source-channel coding-based semantic communication baselines.
46. 【2608.28082】Attribute Token Arithmetic: Disentangled and Continuous Semantic Control for Visual Autoregressive Models
链接：https://arxiv.org/abs/2608.28082
作者：Xindi Yang,Yicheng Wu,Cheng Zhang,Jianfei Cai,Tien-Tsin Wong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved remarkable progress, offering high-fidelity synthesis, unified generative framework, recently achieved remarkable, remarkable progress
备注：
点击查看摘要
Abstract:Autoregressive text-to-image generation has recently achieved remarkable progress, offering high-fidelity synthesis via a unified generative framework. However, fine-grained semantic control remains challenging due to the attribute entanglement and the misalignment between textual and fine-grained visual representations. In this paper, we introduce Attribute Token Arithmetic (ATA), a method that enables disentangled and continuous attribute control in visual autoregressive modelling. Inspired by the vector arithmetic property observed in word embeddings, ATA identifies semantic directions corresponding to visual attributes (e.g., aging, fatness, emotion) directly within the pretrained autoregressive latent space. These directions are learned from a single reference image, without model retraining or large-scale supervision. During generation, attributes can be continuously adjusted and compositionally combined through simple arithmetic operations with other attribute tokens. Extensive experiments demonstrate that ATA achieves identity-preserving, fine-grained, and multi-attribute adjustment, outperforming existing autoregressive editing baselines in controllability, generality, and computational efficiency. Our code will be available at this https URL.
47. 【2608.28080】Cyc3D: Evaluating Cyclic Structural Stability and Asset Usability in Image-to-3D Generation
链接：https://arxiv.org/abs/2608.28080
作者：Liwen Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：largely judge rendered-view, judge rendered-view plausibility, existing evaluation protocols, evaluation protocols largely, protocols largely judge
备注：
点击查看摘要
Abstract:Image-conditioned 3D generation has advanced rapidly, yet existing evaluation protocols largely judge rendered-view plausibility and semantic alignment, overlooking whether a generator forms a stable 3D interpretation and produces assets usable in graphics pipelines. We introduce Cyc3D, a multidimensional benchmark that evaluates image-to-3D generation along two complementary axes: Cross-View Object Consistency and Representation Quality. At the asset level, Cyc3D measures whether object identity remains semantically coherent across rendered viewpoints. At the model level, we propose View-Cycle Structural Consistency, a closed-loop render-regenerate-align protocol that repeatedly re-observes a generated asset from novel views and quantifies geometric, perceptual, and semantic drift across generations. To assess native asset usability beyond rendered appearance, Cyc3D further evaluates geometric structure, reference-image fidelity, mesh discretization and efficiency, and UV parameterization quality. Together, these diagnostics expose failures obscured by a single perceptual score and provide interpretable evidence of both model instability and representation defects. Experiments on five representative image-to-3D systems show that closed-source feed-forward models consistently outperform open-source optimization-based baselines in geometric fidelity, mesh quality, and cycle stability. Nevertheless, even the strongest methods achieve cycle-stability scores below 48, revealing a persistent gap between visually plausible generation and robust 3D object understanding.
48. 【2608.28078】ask-State Adaptation with Prototype Memory for Multi-Task Dense Prediction
链接：https://arxiv.org/abs/2608.28078
作者：Yangyang Xu,Haobo Yuan,Yuzhu Wang,Duo Su,Xi Ye,Yibo Yang,Jun Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision foundation backbones, image-dependent adaptation requirements, Vision foundation, provide strong representations, single shared feature
备注： Preprint
点击查看摘要
Abstract:Vision foundation backbones provide strong representations for dense prediction, yet a single shared feature still needs to support tasks with different, image-dependent adaptation requirements. We propose MemMTL, a multi-task dense prediction framework that estimates a compact task state from global visual context and refines it through a learnable task-state prototype memory. The refined state is converted into task-conditioned expert logits and combined with token-level logits before sparse top-$k$ selection over a local expert bank shared by all tasks. A separate task-agnostic residual bank provides a common adaptation path, and both paths are added once to the backbone feature before task-specific prediction. We specify a matched evaluation protocol on NYUD-v2 and PASCAL-Context with SAM 3 and ViT-L backbones to measure predictive quality, computational cost, and the contributions of task-state conditioning, prototype retrieval, and sparse routing. The numerical record in the present working draft predates this canonical implementation and must be regenerated before it can support empirical claims.
49. 【2608.28070】CF-YOLO: Context-Aware Feature Refinement for Camouflaged Industrial Micro-Defect Detection
链接：https://arxiv.org/abs/2608.28070
作者：Xinda Yu,Kunxin Zheng,Chunan Yu,Qingbo Song,Hao Xiao,Ying Zang,Jie Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains challenging due, Automated detection, surface micro-defects, critically important, important for quality
备注：
点击查看摘要
Abstract:Automated detection of surface micro-defects on industrial components, such as copper tubes, is critically important for quality assurance but remains challenging due to the minute scale of anomalies and their visual camouflage against complex backgrounds. These factors lead to weak feature representations and high rates of false positives and missed detections. To address these issues, we propose a novel real-time detection framework designed for efficient context perception and feature refinement. Our method integrates a Context-Perception Aggregation Module (CPAM), which synergises large-kernel perception for macro-texture context and small-kernel aggregation for sharp boundary delineation, effectively breaking the background camouflage. Furthermore, a Feature Additive Refinement Module (FARM) employs a linear-complexity additive token mixer to globally verify and refine the representation of fine-grained anomalies, suppressing noise-induced errors. To support research in this domain, we introduce the Copper Tube Defect Dataset (CTDD), a manually annotated benchmark containing 1,847 images and 4,898 boundingbox defect instances from copper-tube inspection scenarios. Extensive experiments demonstrate that our detector achieves strong and consistent performance on CTDD, outperforming representative baseline detectors, including YOLOv11, by 2.2% in mAP@50 and 3.9% in Precision while maintaining real-time inference speed. This work provides a robust and efficient solution for high-precision industrial inspection, bridging the gap between contextual understanding and detailed feature analysis. Our code and model are available at: this https URL
50. 【2608.28069】VersaGauss: A Versatile Framework for Generating Multiphase Dynamics with 3D Gaussians
链接：https://arxiv.org/abs/2608.28069
作者：Ruijie Su,Lingxiao Yang,Xiaohua Xie,Jianhuang Lai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Recent progress, representation for reconstruction, physics-based dynamic generation, physical simulation, Recent
备注：
点击查看摘要
Abstract:Recent progress has been made in 3D Gaussian representation for reconstruction, generation, and physical simulation. However, current approaches mainly concentrate on physics-based dynamic generation of solid objects and only handle single-phase collision interactions. We introduce VersaGauss, a unified framework for generation, simulation, and rendering that supports versatile physics-based dynamic generation, particularly for multiphase interactions. Our system takes a few images as input and produces a realistic, physics-driven 3D dynamic scene with multiple objects. To optimize the Gaussian kernel distribution, we develop a particle pruning algorithm. We also propose the Coupled Multiphase Point Method (CMPM) to effectively model and generate multiphase interactions. Additionally, harmonic interpolation within CMPM and a Gaussian evolution strategy are introduced to achieve realistic fluid rendering. Extensive experiments demonstrate that our framework can simulate interactions among various materials such as fluid, rubber, sand, snow, and others. Code is available at this https URL.
51. 【2608.28063】A Controlled Audit of Architectural Complexity in Uncertainty-Aware Multi-Organ Ultrasound Classification
链接：https://arxiv.org/abs/2608.28063
作者：Yang Song,Pengbo Sun,Shichang Feng,Ye Zhu,Xin Xu,Ziran Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-organ ultrasound classifiers, increasingly combine attention, ultrasound classifiers increasingly, classifiers increasingly combine, address heterogeneous anatomy
备注： Supplementary material is available as an ancillary file on this arXiv page
点击查看摘要
Abstract:Multi-organ ultrasound classifiers increasingly combine attention, mixture-of-experts routing, uncertainty gating, and evidential deep learning (EDL) objectives to address heterogeneous anatomy and acquisition. Yet a plausible design rationale does not by itself establish that an added component improves the trained system. We contribute a controlled complexity-audit framework, applied to the deployment decision between the maximal evidential candidate Full-EDL and simpler alternatives. Six candidates were evaluated on the primary dataset and three in an internal replication, using ten matched seeds, frozen image-level partitions, capacity- and optimisation-aware comparisons, symmetric temperature scaling, paired decision rules, and a separate out-of-distribution (OOD) veto. Retaining Full-EDL did not establish a reliable macro-F1 gain on either dataset, while the simplified alternatives remained inconclusive under the non-inferiority margin. Simple cross-entropy with temperature scaling (Simple-CE+TS) met the calibrated negative log-likelihood criterion on both datasets and showed favourable selective-risk ordering. The raw calibration advantage of evidential training disappeared after temperature scaling and did not recur on the second dataset. The gate had negligible observable influence at the audited checkpoints, and deleting the Full-only chain revealed no stable task or calibrated-loss benefit. Simple-CE nevertheless triggered the OOD veto against the fetal probe but not the lung probe, precluding an unconditional OOD-safety claim. We therefore selected Simple-CE+TS for the evaluated in-distribution objective while retaining Full-EDL as the maximal reference. Components should earn retention through functional and retraining-based evidence, and calibration and distribution-shift reliability should be evaluated separately.
52. 【2608.28058】Dynamic Alignment Compensation for Hallucination Mitigation in Large Vision-Language Models
链接：https://arxiv.org/abs/2608.28058
作者：Kairong Yu,Zixin Zhu,Le Yu,Hongwei Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Large Vision-Language Models, Large Vision-Language, Vision-Language Models, remain prone, producing responses
备注： Accepted by EMNLP2026 Findings
点击查看摘要
Abstract:Large Vision-Language Models (LVLMs) remain prone to hallucinations, producing responses that are irrelevant or inconsistent with the multimodal input. Existing mitigation methods mainly rely on external supervision, output calibration, or attention regulation, leaving the internal representation dynamics of autoregressive generation underexplored. We identify an inference-time failure mode in which cross-modal representations degrade across decoder layers and drift across generation steps, destabilizing token prediction and increasing hallucination risk. We propose \emph{Dynamic Alignment Compensation} (DAC), a training-free inference-time method that detects representation divergence and selectively applies lightweight residual compensation. DAC combines Layer-wise Semantic Compensation to mitigate inter-layer degradation with Sequential Semantic Correction to constrain temporal drift. Experiments on nine hallucination-focused and general-purpose multimodal benchmarks across multiple LVLM backbones show that DAC consistently reduces hallucinations while maintaining strong overall performance.
53. 【2608.28033】ZipMVS: Multi-View Stereo with Compressed Cost Volumes
链接：https://arxiv.org/abs/2608.28033
作者：Guanglin Jin,Hongshan Yu,Javier Civera,Zhaoxin Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：registered RGB images, multiple registered RGB, deliver highly accurate, typically deliver highly, Multi-view stereo
备注： 14 pages, 8 figures
点击查看摘要
Abstract:Multi-view stereo (MVS) methods typically deliver highly accurate 3D reconstructions from multiple registered RGB images, thanks to the highly informative, geometric constraints between them. However, their substantial memory requirements remain a major obstacle for deployment in domains such as aerospace and autonomous systems, where resource efficiency is critical. In this work, we introduce ZipMVS, an MVS method specifically designed for efficient high-quality reconstruction. We propose a novel depth-hypothesis strategy that enables substantial compression of the cost volume, hence greatly reducing GPU memory consumption while preserving reconstruction accuracy. Experiments on the DTU and Tanks and Temples datasets show that ZipMVS achieves competitive reconstruction quality compared with other efficiency-oriented MVS methods, while achieving a competitive balance between reconstruction quality and GPU memory usage. The code is available at this https URL
54. 【2608.28020】3D-USE: From Image-Level to Scene-Level Underwater Enhancement
链接：https://arxiv.org/abs/2608.28020
作者：Jieyu Yuan,Yuanlin Zhang,Jihong Li,Chunle Guo,Huimin Lu,Chongyi Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leave estimation errors, reconstruction faithfully reproduces, faithfully reproduces, reproduces the color, color shifts
备注： Project page: [this https URL](https://bilityniu.github.io/3D-USE/)
点击查看摘要
Abstract:Underwater 3D reconstruction faithfully reproduces the color shifts and visibility loss of captured views, while physical inversion may leave estimation errors in the recovered scene appearance. We formulate Underwater Scene-level Enhancement (USE) as learning a persistent, visibility-enhanced 3D scene representation from degraded multi-view underwater observations, enabling consistent enhanced rendering. Realizing USE requires both a reliable scene representation for enhancement and a consistent enhancement target without paired enhanced 3D data. Therefore, we present 3D-USE, a two-stage framework. First, the Medium Radial Basis Anchor Representation (MediumRBF) establishes a medium-aware Gaussian scene by representing water effects with shared radial-basis anchors and explicitly decomposing object and medium contributions. Based on this fixed scene representation, Appearance Transition Consensus (ATC) transfers paired 2D underwater image enhancement (UIE) knowledge into scene-global and Gaussian-local targets, avoiding direct supervision from inconsistent enhanced views. An Underwater Bilateral Appearance Field (U-BAF) then realizes these targets in Gaussian radiance and medium appearance. The scene directly renders enhanced novel views without a 2D UIE model at inference. Experiments on real underwater scenes show improved visibility and cross-view consistency while preserving reconstruction quality.
55. 【2608.28008】Visual Token Coding for Video Multimodal Large Language Models
链接：https://arxiv.org/abs/2608.28008
作者：Chenxin Fang,Tao Chen,JunChao You,Jun Peng,Yiyi Zhou,Rongrong Ji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, video Multimodal Large, Language Models, Multimodal Large
备注： 9 pages, 4 figures
点击查看摘要
Abstract:In this paper, we propose a new token compression paradigm for video Multimodal Large Language Models (MLLMs), termed Visual Token Coding (VTC). Inspired by classical video coding principles, e.g., HEVC, VTC performs structured compression by predicting the I/P frames of a video and measuring their frame-wise residuals to estimate token redundancy. Based on this baseline framework, we also enhance VTC with a set of novel dynamic designs, such as Dynamic Resolution Input (DyRSO), Dynamic Token Allocation (DyTA), and Spatial Coverage Top-K (SC-TopK), and term this new approach $VTC_{Dy}$. To validate VTC, we apply it to three MLLMs and conduct experiments on multiple video understanding benchmarks. The experimental results show that VTC$_{\mathrm{Dy}}$ achieves an average performance retention of 100.1% with a 50% token budget for Qwen3-VL, while still retaining 97.8% of the average performance when the token budget is reduced to 25%. Moreover, as a plug-and-play design, VTC requires no additional tuning of MLLMs for token coding. Our code is available at this https URL.
56. 【2608.27997】A-PAIR: A Benchmark and Identity-Consistent Grounding Framework for Air-Ground Cross-View Referring Person Detection
链接：https://arxiv.org/abs/2608.27997
作者：Zhoupeng Guo,Xinjie Yao,Yunqi Zhu,Zhihe Fan,Siqi Zhao,Jianjun Chen,Yichen Dong,Yan Fan,Pengfei Zhu
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：collective embodied intelligence, coordinate downstream actions, cross-view referring person, referring person detection, Air-ground cross-view referring
备注：
点击查看摘要
Abstract:Air-ground cross-view referring person detection is a necessary component in the language-to-perception-to-control chain of collective embodied intelligence, grounding a language command into the same physical target before ground and aerial agents can coordinate downstream actions. Existing referring expression comprehension and open-vocabulary grounding methods do not jointly account for cross-view identity consistency, making them insufficient for Air-Ground Cross-View Referring Person Detection (AGCV-RPD), which involves similar pedestrian distractors, weak aerial appearance cues, and cross-view identity consistency. To study this problem, we introduce Air-Ground Paired Identity-Aware Referring (A-PAIR), the first comprehensive AGCV-RPD benchmark, containing 22,137 cross-view referring samples. To construct A-PAIR efficiently, we propose Factorized Annotation and Referential Alignment (FARA), a semi-automatic annotation framework that generates factorized referring descriptions and identity-consistency supervision at reduced cost. We propose Identity-Consistent Referring Grounding (ICRG), a framework that combines factorized referential grounding, candidate-completeness supervision, and cross-view consistency calibration for joint air-ground pair selection. ICRG improves ground, aerial, and pair-level detection over strong baselines, increasing pair F1 from 16.65% to 22.28%. These results show that AGCV-RPD requires paired detection and identity-consistent reasoning.
57. 【2608.27989】GAN-Based Semantic Communication for Image Transmission in IoV
链接：https://arxiv.org/abs/2608.27989
作者：Ruixing Ren,Shan Chen,Junhui Zhao,Xiaoke Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Systems and Control (eess.SY)
关键词：traditional communication systems, network-based semantic communication, dynamic channel conditions, generative adversarial network-based, visual data transmission
备注： 8 pages, 7 figures
点击查看摘要
Abstract:For cooperative perception in the internet of vehicles, this paper proposes a generative adversarial network-based semantic communication framework to address the efficiency and fidelity bottlenecks of traditional communication systems in visual data transmission under limited bandwidth and dynamic channel conditions. At the transmitter, the framework adopts a pyramid attention network to extract semantic label maps and introduces a semantic priority preservation mechanism. It assigns differentiated weights to distinct semantic categories based on driving safety, guiding bit allocation and loss function design. At the receiver, an image reconstruction module integrating a coarse to-fine multi-resolution generator and multi-scale discriminator is designed. Combined with the temporal consistency branch, spatial pyramid pooling and class-aware convolutional layers, it achieves high-fidelity reconstruction of high-quality images from corrupted semantic labels. The model is trained with combined adversarial, feature matching and perceptual losses, effectively improving semantic consistency and visual realism of generated images. Experimental results on the Cityscapes dataset show that the proposed method outperforms existing counterparts in both semantic segmentation accuracy and reconstructed image quality, and maintains stable reconstruction performance under AWGN and Rayleigh channels.
58. 【2608.27971】GAAT: Geometry-Aware Alignment Transformer for Multimodal UAV Perception
链接：https://arxiv.org/abs/2608.27971
作者：Jingpu Yang,Debin Tang,Yilin Sun,Fengxian Ji,Jiahua Zhu,Wenrui Ding,Yufeng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned aerial vehicle, synthetic aperture radar, Unmanned aerial, perception integrates visible, aerial vehicle
备注：
点击查看摘要
Abstract:Unmanned aerial vehicle (UAV) multimodal perception integrates visible (RGB), infrared (IR), synthetic aperture radar (SAR), and depth sensors for scene understanding under diverse conditions. However, differences in optics, resolution, and mounting often limit practical systems to global or image-center alignment. After tokenization, parallax, platform motion, and lens distortion can shift corresponding patch centers across modalities, weakening the spatial correspondence assumed by dense contrastive learning and cross-modal fusion. We propose GAAT (Geometry-Aware Alignment Transformer), an alignment-first pretrained model that estimates local correspondence reliability before cross-modal interaction. GAAT introduces syncPATC, which learns patch-center consistency under synchronized view transformations without correspondence annotations. It emits geometric priors, including token and query confidence, query centers, and sub-token offsets, that identify reliable local anchors across residual misalignment. Guided by these priors, MG-Sparse-MMA performs query-mediated sparse fusion over top-K_s reliable regions, replacing dense all-patch interaction with geometry-calibrated local updates. RA-QCGCL aligns pretraining supervision with this sparse query bottleneck through reliable patch-to-patch, patch-to-query, and query-to-query contrastive branches. We introduce UAVMeta and StateBench, which provide four acquisition-state scores derived from platform telemetry and image statistics: camera reliability, observation scale, viewpoint stability, and flight maneuver complexity. Extensive experiments across six downstream tasks demonstrate consistently superior transfer performance, establishing GAAT as a state-of-the-art multimodal foundation model for UAV perception. StateBench further enables a systematic diagnosis of real-world acquisition conditions.
59. 【2608.27929】raining-Free Temporal Abstraction for General Video Understanding
链接：https://arxiv.org/abs/2608.27929
作者：Etienne Casanova,Sevan Brodjian,Pietro Perona
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：relevant moments occur, expensive to analyze, depend on knowing, knowing where relevant, understanding tasks depend
备注： Submitted to NeurIPS 2026
点击查看摘要
Abstract:Videos are expensive to analyze frame by frame, yet many video understanding tasks depend on knowing where relevant moments occur. A system may need to find when an action changes, locate the segment described by a sentence, or choose a few frames for a vision-language model. Existing methods often solve these problems separately, using task-specific training data or specialized architectures. We study whether a pretrained video-text model can provide enough temporal structure to support several of these tasks at once. We present STITCH, a training-free method that divides a video into semantically meaningful temporal chunks. STITCH embeds short video windows with a frozen video-text backbone and detects changes in the resulting embedding sequence. These chunks are computed once per video and reused across tasks. We evaluate STITCH on generic event boundary detection, language-based moment retrieval, and frame selection for long-video VLM reasoning. Across all three settings, STITCH remains competitive with more specialized methods while requiring no task-specific training, with especially clear gains when only a small number of frames or tokens can be processed. These results suggest that reusable temporal abstraction is a promising direction for general video understanding, allowing dense video streams to be converted once into semantic units that can be localized, retrieved, sampled, or reasoned over by downstream systems.
60. 【2608.27923】PCBnet: A Dataset and Automatic Construction of SPICE Netlists from Schematic Images
链接：https://arxiv.org/abs/2608.27923
作者：Zhen Huang,Yuhao Gao,Yuzhi Liu,Daian Cheng,Chengyuan Shao,Yucheng Chen,Yongjian Jia,Futing Zhang,Yichen Shi,Wenhao Wang,Zuyan He,Yangbo Wei,Zhanfei Chen,Jinlong Yan,Yu Zhang,Haoying Wu,Ting-Jung Lin,Lei He
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Printed circuit boards, modern electronic systems, Printed circuit, automation remains constrained, PCB design automation
备注： Accepted at the 2026 IEEE International Conference on LLM-Aided Design (ICLAD 2026)
点击查看摘要
Abstract:Printed circuit boards (PCBs) are fundamental to modern electronic systems, yet AI-driven PCB design automation remains constrained by the lack of large-scale paired schematic-netlist datasets. PCB schematics are particularly challenging due to diverse component types, complex wiring topologies, and noisy textual annotations. To address this gap, we present PCBnet, a large-scale PCB schematic dataset comprising over 300 real-world designs with annotated pins and paired SPICE netlists. It contains more than 50,000 component instances, 150,000 wires, 100,000 text regions, and 400,000 characters. We further develop an automated schematic-to-netlist pipeline that combines visual recognition, topology construction, and domain-knowledge-guided multi-agent correction. The proposed method achieves 94.54% component detection mAP, 98.57% text recognition accuracy, and 84.47% end-to-end connectivity accuracy. PCBnet provides a benchmark and data foundation for future AI-driven PCB design automation.
61. 【2608.27922】DensityKV: Density-Guided KV Cache Compression for Long Video Generation
链接：https://arxiv.org/abs/2608.27922
作者：Wenqu Zhao,Xuemin Chi,Xin Zhang,Guoqing Ma,Baorun Li,Jianjie Fang,Peizhi Tang,Chen Gao,Wei Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diffusion models enable, models enable streaming, previously generated content, video diffusion models, causing appearance
备注： 17 pages, 9 figures, 2 tables. Code: [this https URL](https://github.com/ZhaoWQQ/DensityKV)
点击查看摘要
Abstract:Autoregressive video diffusion models enable streaming generation through sliding-window attention, but each generated block is conditioned on previously generated content, causing appearance and motion errors to propagate recursively over time. Historical key-value (KV) memory preserves earlier subject and scene states and helps maintain long-horizon consistency. However, retaining every generated state creates a historical archive that grows continuously with the rollout, while recurrent states repeatedly add redundant coverage. To address this problem, we propose DensityKV, a training-free historical KV bank management strategy. DensityKV maintains a separate token-level KV bank for each attention head and measures local redundancy among the post-RoPE keys that directly parameterize attention routing using Soft-Riesz density. By constraining neighborhood-density growth after states enter the bank, DensityKV limits repeated historical accumulation while preserving coherent states from each completed generation block. Experiments across three autoregressive video generation backbones and multiple generation lengths show that, at the same upper bound on historical KV capacity, DensityKV improves long-horizon consistency and generation stability while keeping persistent historical storage bounded independently of rollout length.
62. 【2608.27893】CommerceVibe: Learning to Design E-Commerce Creatives as Executable Visual Code via Dual-Feedback Reinforcement Learning
链接：https://arxiv.org/abs/2608.27893
作者：Yajiao Xu,Jin Zhang,Jiangbo Ai,Tao Jiang,Mo Xu,Lina Huang,Chengfu Huo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：conveying marketing messages, High-quality e-commerce creatives, marketing messages, High-quality e-commerce, essential for presenting
备注： 20 pages, 13 figures, 12 tables; includes supplementary material
点击查看摘要
Abstract:High-quality e-commerce creatives are essential for presenting products and conveying marketing messages. Recent diffusion models enable scalable creative generation and produce visually compelling images, but their flattened raster outputs often contain distorted text and inconsistent product details, requiring refinement before deployment. Moreover, without explicit structure, the resulting creatives are difficult to edit and reuse, while complex design requirements remain challenging to encode as verifiable training signals. To address these challenges, we present CommerceVibe, which represents creatives as executable visual code and formulates generation as conditional HTML/CSS program synthesis. Given product images, design requirements, and product information, it produces renderable, editable, and reusable creatives. We further introduce dual-feedback reinforcement learning, in which rule-based feedback evaluates rendered programs for text readability, product visibility, and layout validity, while visual feedback from a vision-language model (VLM) assesses rendered creatives against input specifications across six perceptual and commercial dimensions. Together, these complementary feedback signals improve both constraint satisfaction and perception-dependent quality. We perform supervised fine-tuning (SFT) of Qwen3.5-9B on over 28,000 e-commerce examples, followed by dual-feedback reinforcement learning. On a 1,300-case benchmark, the optimized CommerceVibe model achieves a weighted score of 94.0/100, compared with 87.3 for the SFT-only variant, and outperforms strong external models. Blind evaluations by five e-commerce design experts further validate these improvements. CommerceVibe supports controllable, editable, and scalable e-commerce creative production.
63. 【2608.27888】hread-Efficient Decoding for Neural Texture Compression
链接：https://arxiv.org/abs/2608.27888
作者：Janarbek Matai,Sho Ikeda,Lukasz Lipski,Takahiro Harada
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：achieves higher compression, Neural texture compression, higher compression ratios, significantly reduces runtime, GPU thread divergence
备注： 14 pages, 7 figures,
点击查看摘要
Abstract:Neural texture compression (NTC) achieves higher compression ratios than BCn formats but suffers from GPU thread divergence, which significantly reduces runtime performance. In this work, we propose a shared decoder MLP architecture -- trained with a gradual decoder freezing schedule -- combined with texture clustering to reduce thread divergence by 25%-52% while preserving rendering quality. We evaluate our method on over 500 textures and multiple real rendering scenes, demonstrating up to 8.48x speedup on the Radeon RX 9070 XT GPU compared to non-shared baselines. Our key contributions include: (1) a unified shared decoder architecture that reduces divergence by grouping textures; (2) a training recipe with gradual decoder freezing that improves stability and reconstruction accuracy; (3) a semantic clustering strategy using CLIP embeddings that groups similar textures for effective decoder sharing; and (4) comprehensive performance and ablation studies validating our approach.
64. 【2608.27881】StreamEMS: Streaming Video Understanding with Self-Evolving Memory Scheme for Vision-Language Models
链接：https://arxiv.org/abs/2608.27881
作者：Yuxin Liu,Peiqin Zhuang,Yali Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：streaming video understanding, store historical data, historical data, Prior-informed Evolution Module, memory
备注：
点击查看摘要
Abstract:Recently, many streaming video understanding methods have been proposed by constructing an external memory to store historical data for computational reduction. Most methods focus on optimizing the injection procedure of current data (write) and retrieving informative historical data (read) from memory, while overlooking the opportunity to further enhancing the representational capability of memory itself. In this work, we present StreamEMS, a general mechanism for improving streaming video understanding by re-structuring the historical data stored in memory through self-evolving memory scheme, enabling more informative and robust memory representations. Specifically, we first introduce a Semantic Evolution Module to evolve the memory into more information-dense representations by exploiting informative memory entities discovered via progressively shrinking semantic scales from coarse to fine. In addition, we further introduce a Prior-informed Evolution Module to evolve memory into more robust representations by leveraging prior memory distributions to refine the current memory state. We validate the effectiveness of our proposed designs on widely-used streaming video understanding datasets, i.e., OVO-Bench and StreamingBench, and the results showcase that our method performs better than other methods. Moreover, the advantage of our method becomes consistently evident even under high token usage drop rate settings, indicating the effectiveness and robustness of our method in unleashing the potential of the memory itself.
65. 【2608.27879】What Do Interaction Representations Actually Measure? Pre-Event Separability in Weakly-Supervised Violence Detection
链接：https://arxiv.org/abs/2608.27879
作者：Parishruthi Ganesh
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Articulated human pose, detailed body-configuration information, greater discriminative information, fixed remains unclear, held fixed remains
备注：
点击查看摘要
Abstract:Articulated human pose provides detailed body-configuration information beyond coarse spatial relationships, but whether this detail yields greater discriminative information when the downstream pipeline is held fixed remains unclear. We examine this through early violence detection. Holding the tracker, temporal head, supervision, folds, and evaluation fixed, we compare five interaction representations spanning coarse bounding-box geometry, a matched handcrafted pose analogue, enriched pose descriptors, and a matched-capacity encoder learned from raw joints, under video-level evaluation with cluster-bootstrap intervals. No pose-based representation outperforms coarse geometry, though with fifteen anomalous videos this subset cannot rule out small effects. Extending the pipeline to frozen visual encoders, and repeating the comparison on XD-Violence (137 anomalous videos, nine times our UCF-Crime sample), person-crop appearance and whole-frame context both exceed geometry by a wide margin, yet context matches appearance on UCF-Crime and exceeds it on the larger split: cropping to the interacting people yields no advantage over encoding the whole frame. This prompts a direct test of what the benchmark measures. Scoring anomalous videos using only frames preceding the annotated onset, under a control removing sequence length as a cue, retains 39-91% of above-chance separation on both benchmarks, including for seven hand-designed geometric channels. Inspection of the tightest pre-onset windows identifies concrete provenance artifacts: editorial title cards and platform watermarks absent from the surveillance footage supplying the normal class. Video-level AUC here is thus a composite of event evidence and pre-event source cues, a shared source of discrimination that can obscure differences between representations. The diagnostic requires only annotations these benchmarks already ship.
66. 【2608.27877】Relational Knowledge Distillation Brings DNN Representations Close Enough to Humans to Be Aligned Without Supervision
链接：https://arxiv.org/abs/2608.27877
作者：Yuria Shimizu,Soh Takahashi,Takato Horii,Masafumi Oizumi
类目：Computer Vision and Pattern Recognition (cs.CV); Neurons and Cognition (q-bio.NC)
关键词：deep neural networks, human mental representations, Linking the internal, neural networks, mental representations
备注： 53 pages, 6 figures, 5 tables, including Supplementary Information (15 pages, 1 figure, 4 tables)
点击查看摘要
Abstract:Linking the internal representations of deep neural networks (DNNs) to human mental representations is important for using DNNs as computational models of human vision. Existing DNN representations remain insufficiently similar to human mental representations, which are not directly observable and are therefore commonly measured through large-scale similarity judgments of object images. A natural approach to narrowing this gap is to directly transfer the relational structure of human representations into DNNs, and previous studies have reported improved human-DNN representational similarity. However, whether this improvement holds under stricter evaluation remains untested in two respects: fine-grained alignment at the individual-object level, and generalization to a human embedding derived from a dataset independent of the training data. Here, we employ an unsupervised comparison method, Gromov-Wasserstein optimal transport (GWOT), which estimates human-DNN correspondences from the internal distance structure alone and thereby tests fine-grained alignment. We further assess generalization on a curated test set of concepts non-overlapping with the training data. We show that fine-tuning pre-trained DNNs with Relational Knowledge Distillation (RKD), an established relational transfer method, brings DNNs close enough to humans to be aligned at the individual-object level on this test set. We also show that this improvement is driven by a more human-like global structure, as reflected in the ordering of distances among coarse categories, while the local human-DNN nearest-neighbor overlap rate remains largely unchanged. These findings indicate that relational transfer from humans brings the global structure of pre-trained DNNs close enough to the human structure to enable fine-grained human-DNN alignment without supervision.
67. 【2608.27871】mporal Tree of Thought: Reasoning-Guided Visual Cue Search for Long-Video Understanding
链接：https://arxiv.org/abs/2608.27871
作者：Ziling Huang,Shin'ichi Satoh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Language Models, Multimodal Large, Large Language
备注： Accept by EMNLP2026
点击查看摘要
Abstract:Long-video understanding remains challenging for Multimodal Large Language Models (MLLMs) due to limited context length. Uniform sampling may miss crucial moments, while agent-based frame video understanding methods often evaluate frames independently, overlooking the temporal organization of videos. Ideally, evidence selection should mimic how humans answer questions about long videos: first locating the relevant segment from the global context, then zooming into local objects and details. We propose Temporal Tree of Thought T^3, a training-free framework for adaptive coarse-to-fine long-video understanding. T^3 constructs a question-agnostic hierarchical temporal tree via recursive temporally constrained clustering, where each node represents a contiguous segment with an informative key frame. During inference, T^3 performs an answer-retrieve-explore loop: it reasons over coarse representative frames, generates a search statement when evidence is insufficient, and expands relevant branches for finer-grained evidence. This process adaptively shifts the search target from temporal regions to specific objects and visual details to help video understanding. Experiments on VideoMME, LongVideoBench, and LVBench show that T^3 improves Qwen2.5-VL-7B by 0.5%, 4.6%, and 4.4%, respectively, under the same frame budget, demonstrating the effectiveness of structured temporal reasoning.
68. 【2608.27866】Iron: Intent-Aligned and Retrospective Dual Learning Framework for Enhancing Generalist Virtual Agents
链接：https://arxiv.org/abs/2608.27866
作者：Jiahe Ying,Wendong Bu,Kaihang Pan,Bingchen Miao,Siyu Chen,Wen Wang,Xueming Jiang,Juncheng Li,Siliang Tang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diverse digital environments, digital environments remains, Multimodal Large Language, Achieving virtual agents, Large Language Models
备注： 11 pages, 5 figures, and 4 tables
点击查看摘要
Abstract:Achieving virtual agents capable of automating tasks across diverse digital environments remains a pivotal challenge in Embodied AI. While Multimodal Large Language Models (MLLMs) offer enhanced visual perception and reasoning, their agentic deployment faces three challenges: costly data annotation, imprecise action-intent alignment, and inefficient exploration from discarded failed trajectories. To address these, we introduce Iron, an intent-aligned, self-improved, and annotation-efficient framework for training GUI agents. Iron employs a novel dual learning strategy that utilizes a stepwise cycle-consistent (SCC) reward to achieve fine-grained alignment between low-level actions and high-level intents, thereby improving instruction grounding and intent understanding. Concurrently, Iron introduces a hindsight reproduction mechanism to repurpose failed trajectories for training, improving both learning efficiency and task diversity. Extensive experiments demonstrate that Iron-trained generalist agents consistently improve performance on cross-environment and cross-device tasks, outperforming models trained with three times more data. Iron also achieves a substantial 25.06% relative improvement on unseen web tasks, with further gains observed on inherently complex tasks, demonstrating the feasibility of building more capable virtual agents.
69. 【2608.27860】From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation
链接：https://arxiv.org/abs/2608.27860
作者：Rit Gangopadhyay,Alex Wong
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision foundation models, Vision foundation, capable of generalizing, empirical success, attributed to training
备注：
点击查看摘要
Abstract:Vision foundation models are capable of generalizing across 3-dimensional (3D) scenes with high-fidelity estimates; their empirical success can be attributed to training on large-scale datasets of perspective images. However, when transferred to wide field-of-view (FoV) images, such as those captured by fisheye cameras, they return erroneous outputs due to a covariate shift stemming from the radial distortion on the image pixels. We propose a method to generalize vision foundation models to fisheye cameras. The crux of our method lies in a set of learnable parameters, termed Distortion Extenders (DEX), that model the fisheye distortion coefficients and the distributional shift between fisheye and perspective images encoded in the latent space. By minimizing a self-supervised alignment loss, DEX transforms the latent embeddings of fisheye images to resemble those of perspective images to recover high-fidelity estimates. DEX is architecture- and task-agnostic: We demonstrate DEX on monocular depth estimation and open-vocabulary segmentation for convolution- and Transformer-based architectures, where we consistently improve over baselines across indoor and outdoor fisheye datasets. As a byproduct, the activations of DEX can also be decoded to distortion coefficients to support camera calibration. Code available at: this https URL.
70. 【2608.27808】CURA: Certified Runtime Alarms for Computer-Use Agents
链接：https://arxiv.org/abs/2608.27808
作者：Divake Kumar,Sina Tayebati,Devashri Naik,Amanda Sofie Rios,Nilesh Ahuja,Omesh Tickoo,Ranganath Krishnan,Amit Ranjan Trivedi
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：capable computer-use agents, cheapest oversight channel, computer-use agents, channel a deployer, fails precisely
备注：
点击查看摘要
Abstract:Self-report is the cheapest oversight channel a deployer has, and on capable computer-use agents (CUAs) it fails precisely where oversight matters. On 361 OSWorld tasks our pipeline, a read-only feasibility gate, a planner, and a GUI executor, reaches a mean task score of 82.9, above the 72.4 human reference, yet 64 of its 71 failures (90%) end with a success claim, 61 acknowledging no blocker, and the explicit failure affordance is never used in roughly 9,100 calls. We introduce CURA (Certified Runtime Alarms for Computer-Use Agents), an external monitor that reads only harness-visible telemetry, with no model internals, extra LLM calls, or prompt changes, and turns the running trajectory into a sequential test with certified false-alarm control. At alpha = 0.10 its CUSUM alarm detects 42.3% of failures a median of 31 steps before termination at a realized false-alarm rate of 0.066, and risk is partly resolvable before the first action (gate probe, 0.69 AUROC). Retrospectively the composite reaches 0.828 AUROC (fold-internal floor 0.802), but its margin over a total-token baseline is not significant (Delta = +0.026, p = 0.101); the separation is online, where CURA recalls more at matched certified budgets: 0.41 versus 0.34 at alpha = 0.10, 0.56 versus 0.38 at alpha = 0.20. Alarm-gated mid-execution oversight recovers 23 of 70 failures while spending a frontier overseer on 38, giving a deployable cascade at mean score 86.8 and 84.5% full-solve (305 of 361). The certificate bounds false alarms only. We also report where behavioral monitoring is uninformative.
71. 【2608.27795】uScenes: A Multimodal RGB and 3D Sonar Dataset for Underwater Robot Perception
链接：https://arxiv.org/abs/2608.27795
作者：Trung Tien Dong,Zhenqi Wu,Aditya Penumarti,Zi-Hao Zhang,Micaiah Bartlett,Jane Shin,Xiaomin Lin
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Robust perception, autonomous underwater robots, perception is essential, deployment of autonomous, Robust
备注：
点击查看摘要
Abstract:Robust perception is essential for the deployment of autonomous underwater robots. However, optical cameras become unreliable under poor illumination and backscatter. Forward looking (2D) acoustic sensors remain effective under these conditions, but they measure range and bearing while leaving elevation unresolved, creating an ambiguity that prevents individual sonar returns from being localized in three dimensional (3D) space. This complicates the sensor use for 3D scene understanding and precise object detection. We introduce \textbf{uScenes}, a multimodal underwater dataset containing synchronized 3D multibeam sonar point clouds and RGB imagery. The dataset contains 110 scenes and 95,834 synchronized observation, representing 277.6 minutes of data collected across multiple field sessions. uScenes establishes a foundation for underwater sensor fusion, cross modal representation learning and 3D scene understanding. Code and datasets are given at this https URL.
72. 【2608.27753】What Can Low Resource Languages Learn From Each Other?
链接：https://arxiv.org/abs/2608.27753
作者：Achyuth P,Kahaan Shah,Chetan Arora
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：growing digital divide, remains largely confined, linguistic reach remains, reach remains largely, Optical Character Recognition
备注： 16 pages, 4 Tables, 6 Figures. To appear at ICDAR 2026. This version predates reviewer revisions. A revised version will be posted
点击查看摘要
Abstract:Despite the rapid advancement of Vision-Language Models (VLMs), their linguistic reach remains largely confined to high-resource languages, leaving the majority of the world's 7,000+ living languages on the wrong side of a growing digital divide. This disparity is especially pronounced in Optical Character Recognition (OCR), where low-resource scripts lack the massive datasets required for traditional scaling laws. We investigate OCR adaptation in extreme data-scarce regimes (10K real and 250K synthetic images), demonstrating that conventional fine-tuning strategies often reach a performance ceiling. Our key finding reveals a structural inefficiency in language-specific adaptation: while higher layers of specialized models diverge to capture unique script nuances, the lower layers learn redundant, highly similar features. Motivated by this observation, we propose PSMC (Pre-train, Specialize, Merge, and Co-train), a data-efficient framework that capitalizes on a cross-script "transfer effect". Our approach first derives language-specific experts from a high-resource base model, then employs task arithmetic to fuse these experts into a unified, high-performance multilingual back- bone. Extensive evaluation across 10 Indian scripts (supporting 20+ languages) shows that PSMC achieves a ~2% average improvement in Word Recognition Rate (WRR) over individual specialist models without increasing parameter count. Our results indicate that joint training in the merged latent space facilitates a constructive knowledge transfer that benefits all constituent scripts, providing a scalable pathway for inclusive VLM development. Source code and datasets will be released post publication.
73. 【2608.27735】ABCD: Alpha-Composited Block Coordinate Descent: Constant-VRAM Training for Large Radiance Fields
链接：https://arxiv.org/abs/2608.27735
作者：Ka Heng Shiu,Kartic Subr
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Block Coordinate Descent, Gaussian Splatting, alpha-composited radiance fields, Alpha-Composited Block Coordinate, Coordinate Descent
备注： Presented at ACM SIGGRAPH 2026 Posters
点击查看摘要
Abstract:We present ABCD (Alpha-Composited Block Coordinate Descent), an out-of-core training framework for alpha-composited radiance fields, instantiated here for 3D Gaussian Splatting. Our method reformulates training as block coordinate descent over spatial partitions: only one block of parameters is active at a time, while all others are frozen. By exploiting the associativity of alpha blending, these inactive regions can be pre-rendered and collapsed into foreground and background RGBA images. As a result, for fixed partition size and image resolution, peak VRAM becomes O(1) with respect to total scene extent, rather than growing with full scene size. This enables GPUs with limited memory to train scenes that would otherwise not fit in core. In experiments, our method closely preserves the reconstruction quality of 3DGS, with less than 5% PSNR degradation, while ABCD with compositing ablated suffers roughly 40% degradation. Our code can be found at this https URL
Comments:
Presented at ACM SIGGRAPH 2026 Posters
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
ACMclasses:
I.3.7
Cite as:
arXiv:2608.27735 [cs.CV]
(or
arXiv:2608.27735v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.27735
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
ACM SIGGRAPH 2026 Posters (SIGGRAPH Posters '26), Article 62, 3 pages, 2026
Related DOI:
https://doi.org/10.1145/3799825.3818779
Focus to learn more
DOI(s) linking to related resources</p>
74. 【2608.27668】Report Supervision
链接：https://arxiv.org/abs/2608.27668
作者：Pedro R. A. S. Bassia,Wenxuan Li,Jakob Wasserthal,Jieneng Chen,Xinze Zhou,Zheren Zhu,Chuntung Zhuanga,Sergio Decherchi,Andrea Cavalli,Kang Wang,Yang Yang,Alan Yuille,Zongwei Zhou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tumor, Segmentation models, Segmentation, models, masks
备注： Published in Medical Image Analysis, 2026
点击查看摘要
Abstract:Segmentation models can surpass radiologists, classification models, and vision-language models in tumor detection. Importantly, segmentation models outline tumors, allowing radiologists to better verify and trust the AI output. Their main limitation is the scarcity of tumor masks: creating one 3D tumor mask takes up to 30 minutes, so most public CT datasets contain only a few hundred masks, and even the largest private datasets contain only a couple of thousand. Tumor masks are not produced in clinical routine, but radiology reports are. Public datasets contain tens of thousands of CT-Report pairs, and hospitals contain hundreds of thousands. These reports describe tumors in detail, providing large-scale, informative training data. Here, we introduce Report Supervision (R-Super), a training framework that uses reports to directly supervise and improve tumor segmentation. R-Super introduces new loss functions that teach segmentation models to segment tumors that match report descriptions of tumor count, sizes, and locations. Reports are only used for training. We evaluated R-Super on kidney and pancreatic tumor segmentation, exploring diverse training data sizes, up to 41,418 CT-Report plus 3,488 pancreatic tumor CT-Mask pairs. On external validation, R-Super increased tumor detection F1-Score and segmentation DSC by up to +15% with respect to mask-only training. It also surpassed alternative methods such as CLIP and multi-task learning. Leveraging numerous readily available reports to supplement scarce masks, R-Super strongly improves AI performance when very few training masks are available (e.g., 50), and when many masks are available (e.g., 3,488), unlocking scale in tumor segmentation.
75. 【2608.27634】Curvature-Aware Radius Shrinkage for Adaptive Nearest Neighbor Classification
链接：https://arxiv.org/abs/2608.27634
作者：Alexandre L. M. Levada
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
关键词：Nearest neighbor classification, classification relies fundamentally, neighbor classification relies, Adaptive Nearest Neighbor, Nearest neighbor
备注： 28 pages, 2 figures and 3 tables
点击查看摘要
Abstract:Nearest neighbor classification relies fundamentally on how locality is defined, yet conventional $k$-NN imposes the same neighborhood cardinality throughout the feature space. This assumption can be inadequate for data whose local geometry varies substantially across the underlying manifold. We introduce Curvature-Aware Radius Shrinkage for Adaptive Nearest Neighbor Classification (CARSANN), a geometry-driven framework that adapts the spatial support of each neighborhood according to local geometric complexity. CARSANN first estimates intrinsic dimensionality using TwoNN and constructs an intrinsic representation through principal component analysis. Local mean curvature is then estimated using a shape-operator-based formulation and controls neighborhood scale: highly curved regions receive stronger radius shrinkage, whereas approximately flat regions retain broader spatial support. Unlike methods that modify only the number of neighbors or the local metric, CARSANN explicitly adapts the spatial extent of local evidence. Experiments on more than 70 real-world OpenML datasets show that CARSANN consistently improves upon standard $k$-NN and is competitive with adaptive nearest-neighbor methods. In a controlled comparison using the same base neighborhood size, CARSANN achieves higher balanced accuracy on 40 of 45 datasets, increasing mean balanced accuracy from 0.6506 to 0.7528. The advantage also persists against $k$-NN with fixed $k=5$. Friedman and Nemenyi tests confirm that the improvements are statistically significant. These results indicate that local manifold curvature can serve as an effective geometric control variable for adapting neighborhood support, providing a complementary paradigm to cardinality-based nearest-neighbor adaptation.
76. 【2608.27633】Depth-Aware Pothole Detection Using YOLO and RT-DETR at the Edge
链接：https://arxiv.org/abs/2608.27633
作者：Md Monjurul Ahsan Prodhan,Md Nour Hossain
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：urban infrastructure management, escalating repair costs, late maintenance directly, maintenance directly contributes, infrastructure management
备注： 6 pages, 7 figures, IEEE 9th International Conference on Multimedia Information Processing and Retrieval, Presented on Monday, 10 August 2026
点击查看摘要
Abstract:Pothole detection and its severity measurement is still an important challenges in urban infrastructure management, where late maintenance directly contributes to vehicle damage, road accidents, and escalating repair costs. Existing automated approaches depend on 2D RGB images and cannot measure physical depth of potholes. In this paper, we present a depthaware pothole detection framework and then compare five architectures: YOLOv8n, YOLOv8nSeg, YOLOv9t, RTDETRL, and RTDETRX for RGB-D sensor fusion-based detection and automated depth measurement. A custom offline augmentation pipeline is used here to simulate adverse road monitoring conditions. All models are trained on the PothRGBD dataset with an 80% training and 20% validation split and evaluated using Precision, Recall, mAP@50, and mAP@50_95. Before measuring the depth data, all depth maps are corrected for camera tilt using RANSAC ground-plane orthorectification and all zero-valued sensor pixels are cast to NaN before any statistic is computed. YOLOv8nSeg achieves the highest mAP@50 of 0.9556 and mAP@50_95 of 0.6758 with the most accurate depth estimate of 2.96 cm with the pixel-precise Dseg algorithm. YOLOv8n achieves the fastest inference at 3.6ms. RTDETRX achieves the highest detection confidence at 92.70%. An important finding is that even after full RANSAC orthorectification, bounding box models overestimate pothole depth by 0.16 to 0.21 cm compared to pixel precise segmentation masks. This confirms that the pavement inclusion bias is structural rather than a calibration artifact.
77. 【2608.27610】ShiftSplit-AD: Separating Domain Shift from Defects in Foundation-Feature Visual Anomaly Detection
链接：https://arxiv.org/abs/2608.27610
作者：Muhamathu Ameer Ali Aacaas Muhamath
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：frozen foundation-model features, foundation-model features commonly, Visual anomaly detectors, features commonly score, anomaly detectors based
备注： 7 pages, 5 figures. Independent research manuscript
点击查看摘要
Abstract:Visual anomaly detectors based on frozen foundation-model features commonly score distances from test patches to a memory of normal features. Benign acquisition changes can also enlarge these distances, confounding domain variation with defects. We investigate whether structured decomposition of nearest-normal DINOv2 residuals can suppress shift-induced evidence while retaining unseen defects. ShiftSplit-AD decomposes the patch residual matrix into low-rank and row-sparse components and scores the sparse component, with an optional low-rank/sparse fusion. The experiments expose a central trade-off rather than a universal separation: genuine defects can contain correlated, low-dimensional structure, so filtering broad residual activity may also remove defect information. On AeBAD-S, using settings fixed after Bottle development, sparse-only scoring improves image AUROC from 0.6780 to 0.7294 and AUPRC from 0.8052 to 0.8465. Paired bootstrap 95% intervals for the improvements are [0.0238, 0.0808] and [0.0170, 0.0650], respectively. However, sparse-only scoring reduces mean clean AUROC from 0.9890 to 0.9133 on four held-out MVTec categories and degrades Bottle localization. These findings show that residual decomposition can help when domain shift strongly contaminates anomaly evidence, but preserving defect structure remains the limiting problem.
78. 【2608.27584】Quanta Perception as Probabilistic Events
链接：https://arxiv.org/abs/2608.27584
作者：Varun Sundar,Pavan Thodima,Sacha Jungerman,Mohit Gupta
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Autonomous systems rely, Autonomous systems, information from light, systems rely, rely on extracting
备注： For project webpage, see [this https URL](https://wisionlab.com/project/probabilistic-events/)
点击查看摘要
Abstract:Autonomous systems rely on extracting information from light, yet remain brittle in extreme environments, from nighttime navigation to high-speed robotics. Conventional sensors aggregate photons over fixed exposures, imposing trade-offs between sensitivity, dynamic range, and temporal resolution that degrade perception when photons are scarce or dynamics are rapid. Quanta sensors detect individual photons, but their streams exceed real-time compute and latency budgets by orders of magnitude. Here we introduce $\textit{probabilistic events}$, a computational primitive for real-time quanta perception from individual photon detections. By computing the posterior over the time since the last intensity change, we represent photon streams as recursive belief states. Rather than fixed-threshold event-camera triggers, this recursive Bayesian formulation yields three low-latency signals: motion-adaptive scene flux, high-fidelity activity maps, and entropy-based perceptual uncertainty. This representation enables perception in extreme conditions, including pose estimation of a running person at $\sim$0.05 lux---without retraining vision models. Our approach processes input streams exceeding 50{,}000 quanta frames per second on commodity GPU hardware---yielding kilohertz-scale outputs up to four orders of magnitude faster than state-of-the-art quanta reconstruction baselines, even for megapixel arrays. By replacing frame reconstruction with direct probabilistic inference over photon streams, this work bridges photon-counting quanta sensing with robotic vision.
Comments:
For project webpage, see this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2608.27584 [cs.CV]
(or
arXiv:2608.27584v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2608.27584
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
79. 【2608.27562】VidParse: Online Parsing of Egocentric Procedures Like a Pro
链接：https://arxiv.org/abs/2608.27562
作者：Anubhav Gupta,Archit Kambhamettu,Vatsal Agarwal,Pulkit Kumar,Abhinav Shrivastava
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：noisy egocentric video, egocentric video streams, Translating continuous, temporally ordered action, ordered action steps
备注： Accepted at ECCV 2026
点击查看摘要
Abstract:Translating continuous, noisy egocentric video streams into discrete, temporally ordered action steps is fraught with visual challenges. Heavy ego-motion, transient occlusions, and the high intra-class variability of unscripted human-object interactions cause standard frame-level online temporal models to struggle, often resulting in severe over-segmentation and structural collapse. To bridge the gap between unstable low-level perception and high-level procedural logic, we present VidParse, an online, training-free framework that treats activity understanding as a graph-constrained inference problem. Rather than relying on learned temporal filters, we dynamically identify semantic transitions using a temporal similarity matrix over manipulation-anchored features, which are extracted from frozen foundation models to prioritize foreground hand-object interactions. A beam search decoder then leverages an induced procedural task graph to explicitly enforce valid action transitions and prune impossible trajectories. By anchoring robust visual segments to hard procedural constraints, our approach preserves long-range state transitions and achieves up to a 10x improvement in complex multi-step parsing accuracy over strong online baselines, all without requiring a single gradient update.
80. 【2608.27550】Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
链接：https://arxiv.org/abs/2608.27550
作者：Senqiao Yang,Chengyao Wang,Yuxin Chen,Zixuan Wang,Longxiang Tang,Haokun Gui,Jinhui Ye,Changsheng Lu,Xiaoyang Wu,Mingkang Zhu,Pengguang Chen,Shu Liu,Zhuotao Tian,Hengshuang Zhao,Bei Yu,Jiaya Jia
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：web-scale image-text data, building generalist, physical world, crucial for building, harder to scale
备注： All models and training pipelines are publicly available at [this https URL](https://starvla.github.io/VLAct)
点击查看摘要
Abstract:Scaling robot data is crucial for building generalist Vision-Language-Action (VLA) models, yet robot trajectories are harder to scale than web-scale image-text data because embodied collection is costly and sparsely covers the physical world. This makes representation quality a central bottleneck: under a fixed robot-data budget, continued pre-training must turn limited trajectories into transferable visual-action knowledge rather than merely fit actions. We propose VLAct, a VLA-oriented VLM backbone trained on broad, heterogeneous, multi-embodiment robot data before task-specific fine-tuning. VLAct preserves the broad VLM prior and encourages shared action semantics across embodiments through VLM-prior preservation, multi-head continuous action co-supervision, and a partially unified cross-embodiment action layout, while allowing task-specific action heads during fine-tuning. Across simulation, real-world, and unseen-embodiment transfer, VLAct consistently improves downstream performance under fixed fine-tuning protocols. On LIBERO-Plus and RoboTwin 2.0, VLAct surpasses industrial VLA systems including ABot-M0 and LingBot-VLA, achieving success rates of 82.6% and 92.5%. On RoboDojo, VLAct ranks sixth among all policies by success rate and outperforms all explicitly designated world-action model (WAM) entries on both metrics. Most notably, on RoboCasa-GR1, an unseen humanoid embodiment, VLAct using only 20% of downstream trajectories outperforms the full-data GR00T-N1.6 baseline. These results are obtained using fully open-source data and only a 16-GPU training setup, showing that representation-centric continued pre-training can deliver highly competitive performance under a modest compute budget and is an important independent axis of VLA progress beyond data scaling.
81. 【2608.27549】Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning
链接：https://arxiv.org/abs/2608.27549
作者：Hanyang Wang,Yimo Cai,Weiliang Chen,Jiawei Chi,Haowen Sun,Qiyu Dai,Yi-Hsin Hung,Xingzhuo Guo,Jinshan Ren,Runmao Yao,Ziwei Liu,Mingsheng Long,Yueqi Duan,Jun Gao,Jiangran Lyu,Fangfu Liu,Jialong Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：depend on forming, Physical, executable world representations, world, executable world
备注： Project Page: [this https URL](https://mirros-lab.github.io/code-as-world)
点击查看摘要
Abstract:Physical understanding and reasoning depend on forming compact and generalizable representations of the world. While modern vision-language models can recognize and explain diverse physical events, they often lack explicit representations of the underlying mechanisms-such as object states, physical parameters, and governing dynamics-needed for reliably reasoning how the world evolves and responds to interventions. In this work, we introduce Code-as-World, a paradigm that represents physical worlds through executable world representations. By expressing physical composition, dynamic evolution, and visual appearance as executable code, Code-as-World provides a compact, quantitatively grounded, and controllable abstraction of the physical world. To construct such representations from multimodal observations, such as natural-language descriptions or real-world videos, we develop an agentic discovery loop inspired by abductive reasoning, where an agent proposes, executes, renders, verifies, and iteratively refines executable world hypotheses. As a concrete application, we use verified executable worlds to provide scalable physical supervision for training vision-language models on quantitative physical reasoning. Experiments show that Code-as-World-VL achieves state-of-the-art performance on QuantiPhy and surpasses leading proprietary models, highlighting the potential of executable world representations as a scalable foundation for physical intelligence.
82. 【2608.27531】Fully Unleashing the Multimodal Attacker: Meta-Adaptive Jailbreaking of Vision-Language Models
链接：https://arxiv.org/abs/2608.27531
作者：Benlei Cui,Shen Pang,Yuke Wang,Xuemei Dong,Yuwen Zhai,Jingqun Tang,Haiyang Yu,Hui Xue,Longtao Huang,Haiwen Hong
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：large vision-language models, frozen attacker parameters, template-based attacks freeze, iterative attacks adapt, fixed attack strategies
备注： Accepted by EMNLP 2026 Main Conference
点击查看摘要
Abstract:The safety of large vision-language models is increasingly stress-tested by multimodal jailbreaks, yet existing attacks remain largely static at the meta level: template-based attacks freeze the image--text layout, while iterative attacks adapt only the image--text content with fixed attack strategies and frozen attacker parameters. We propose Meta-Adaptive Multimodal Jailbreaking (MAMJ), which instead optimizes the attacker itself along two axes: an attack strategy prompt (ASP) $\theta$ governing attack iteration and attacker weights $\phi$ determining attack effectiveness. Across groups of multimodal attack trajectories, an LLM-based critique first refines $\theta$, after which group-aggregated attack-success-rate (ASR) rewards update $\phi$. On MM-SafetyBench, MAMJ achieves $81.0\%$, $78.9\%$, and $82.3\%$ ASR against GPT-4o, Gemini-3-Pro-Preview, and Seed 2.0, respectively, outperforming the strongest sample-level baseline by up to $24.1$ percentage points. The learned attacker $(\theta^\star,\phi^\star)$ also transfers without retraining to unseen victims and remains effective under representative defenses. These results reveal a systemic vulnerability of frontier VLMs to meta-adaptive jailbreaks and motivate defenses against meta-level adversaries. Code is available at this https URL.
83. 【2608.27529】Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction
链接：https://arxiv.org/abs/2608.27529
作者：Jiarong Han,Jincheng Xiong,Yuzhou Liu,Linzhe Shi,Changjie Wu,Ning Guo,Mu Xu,Hang Zhang,Ming Qian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：extremely long videos, long videos requires, videos requires estimating, requires estimating camera, scene geometry online
备注： Project Page: [this https URL](https://amap-cvlab.github.io/ABot-Recon-html/) , Code: [this https URL](https://github.com/amap-cvlab/ABot-Recon)
点击查看摘要
Abstract:Streaming 3D reconstruction from extremely long videos requires estimating camera motion and scene geometry online under bounded memory and computation. Early streaming models achieve causal, bounded-cost inference using finite context buffers or compact recurrent states, yet their estimates often deteriorate as sequences grow. Recent methods improve long-horizon stability by coupling short-range context with persistent or multi-level long-range memory. We pursue a different route: we keep the learned temporal state strictly local and formulate predictions whose targets remain independent of sequence length. We present ABot-Recon, a simple streaming model that caches KV features from only the preceding 11 frames. It predicts a point map in the current camera coordinate system together with an adjacent-frame relative pose. These predictions remain equivariant under changes of reference frame, and global poses and geometry are recovered through sequential composition. To reduce accumulated drift, a lightweight temporal refiner improves relative rotations using recent visual and motion context, while a composition-aware pose loss supervises multi-step pose composition. Extensive evaluations on challenging long-sequence benchmarks demonstrate the superior long-horizon performance of our local-context approach. On Oxford Spires, ABot-Recon achieves an ATE of 4.35 m and an RPE-R of $0.12^\circ$, reducing both errors by approximately 40\% relative to the best prior results.
84. 【2608.27527】FVeinSyn: Synthetic Finger Vein Image Generator
链接：https://arxiv.org/abs/2608.27527
作者：Yifan Wang,Jie Gui,Adams Wai Kin Kong,Baosheng Yu,Changsheng Chen,Qi Li,Zhenan Sun,James Tin-Yau Kwok,Alex Kot
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：finger vein recognition, major challenge, finger vein, finger, vein recognition
备注：
点击查看摘要
Abstract:A major challenge in finger vein recognition is the lack of large-scale public datasets. Existing datasets contain few identities and limited samples per finger, restricting the advancement of deep learning-based methods. To address this, we propose FVeinSyn, a large-scale controllable synthetic data generation framework for finger vein. It explicitly decouples synthesis of vascular topology and imaging appearance to mitigate the limitations caused by insufficient training samples, such as inadequate identity diversity and restricted realism. Specifically: first, a finger vein identity generator models vascular topology under physiological and geometric constraints using stochastic L-systems, producing anatomically valid and identity-distinctive vascular patterns. Then, a cascaded region-aware GAN renders the topological maps into realistic near-infrared images. Finally, an intra-class diversity generator introduces geometric and optical perturbations to simulate realistic intra-class variations. Using FVeinSyn, we generated 500,000 images (10,000 vein identities, 50 samples per identity) and conducted extensive evaluations. Results show that FVeinSyn holds significant advantages in realism, identity diversity, vascular pattern consistency, and intra-class diversity. Models trained with FVeinSyn outperform real-data-only baselines a cross eight public datasets, achieving an average accuracy improvement of 27.43\%. The code is available at: this https URL.
85. 【2608.27515】A Deeper Analysis of Block-Sparse Featurizers
链接：https://arxiv.org/abs/2608.27515
作者：Alexandru-Iulius Jerpelea,Amith Ananthram
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：introduced block-sparse featurizer, recently introduced block-sparse, single direction, block-sparse featurizer, sparse autoencoder
备注： 9 pages, 12 figures, 2 tables
点击查看摘要
Abstract:The recently introduced block-sparse featurizer (BSF; Fel et al., 2026) is similar to a sparse autoencoder (SAE), but its atomic unit is a small subspace (a block of directions) rather than a single direction. It is designed for features that live on low-dimensional manifolds, which are especially frequent in vision. This work studies the BSF's strengths and weaknesses, finding how it still somewhat suffers from classic SAE failure modes, like feature splitting and composition. We propose several architectural changes to the BSF, including a Tournament Top-K selection rule that significantly reduces feature splitting, and we also extend the block paradigm to the crosscoder.
86. 【2608.27502】Image Augmentation as Test Generation for Deep Learning-Based Image Retrieval Systems
链接：https://arxiv.org/abs/2608.27502
作者：Yehan De Silva,Anirudh Sridhar,Armin Lotfy,Nafiseh Kahani,Yvan Labiche,Ziyu Wang,Frank Ouyang,Clare Carty,Azalia Shamsaei
类目：oftware Engineering (cs.SE); Computer Vision and Pattern Recognition (cs.CV)
关键词：software engineering challenge, image retrieval systems, deep learning-based image, Ensuring the reliability, learning-based image retrieval
备注：
点击查看摘要
Abstract:Ensuring the reliability of deep learning-based image retrieval systems is a software engineering challenge. This paper presents a dual contribution: (1) a literature review of augmentation and generation techniques which resulted in the identification of 50 techniques which we organized into a ten-category taxonomy, and (2) a large-scale empirical study that evaluates these techniques as test generators for embedding-based image retrieval systems. Augmented images are embedded using Amazon Titan and OpenCLIP, and evaluated across four analytical dimensions: (1) embedding-space similarity, (2) embedding uncertainty measured via four estimators, (3) semantic realism scored by LLaVA, and (4) retrieval failure rate. Experiments are performed on three datasets: CIFAR-10, ImageNet-1K, and a dataset from an industrial partner (March Networks). Across all evaluated datasets and embedding models, and under the single severity level tested for each technique, weather simulation and SaSPA are the image augmentation/generation techniques that produce the highest embedding uncertainty and failure rates while maintaining a favorable balance between performance stability, visual realism, and augmentation effectiveness. The results we discuss are configuration-specific and may shift under milder or stronger perturbation settings. In contrast, GAN-based augmentation techniques are among the lowest in realism, indicating the presence of synthetic artifacts and perceptual inconsistencies that reduce their suitability to produce realistic test inputs. Overall, our findings provide practical guidelines for selecting augmentation techniques that maximize test diversity while preserving realistic image characteristics, thereby enabling the construction of comprehensive and effective test suites for image retrieval systems while reducing the cost of manual data labeling through the use of metamorphic testing.
87. 【2608.27492】Can Tainted Pixels Expose Deepfake Videos?
链接：https://arxiv.org/abs/2608.27492
作者：Juan Hu,Shaojing Fan,Sanjay Saha,Marc Herrera,Terence Sim
类目：Cryptography and Security (cs.CR); Computer Vision and Pattern Recognition (cs.CV)
关键词：Publicly-acceesible face-manipulation tools, made deepfake creation, deepfake creation accessible, Publicly-acceesible face-manipulation, made deepfake
备注：
点击查看摘要
Abstract:Publicly-acceesible face-manipulation tools have made deepfake creation accessible to non-expert users. Against these, existing defenses are mostly post-hoc, detecting only after forgery has occurred, and operating on still images rather than videos. Research is lacking in i) the proactive protection of published facial videos against black-box manipulation tools, and in (ii) understanding its perceptual effect on human viewers. We introduce TaintedPixels, a proactive video-protection method built around an asymmetric visibility trade-off: the embedded watermark should remain inconspicuous in the published video but become obvious once a downstream tool manipulates the video. TaintedPixels injects structured periodic perturbations into the blue channel of facial regions and refines them under stripe-visibility, color-cast, and video-level LPIPS budgets, with lightweight motion-adaptive deployment. We believe TaintedPixels is the first proactive defense designed specifically against black-box manipulation tools rather than image-level pipelines or specific surrogate generators. Across three publicly available off-the-shelf video manipulation tools and two off-the-shelf detectors, TaintedPixels attains the highest forgery fake rate while keeping perturbations small (LPIPS = 0.0042). Our non-expert human study, conducted on a diverse set of 300 video stimuli spanning different lighting conditions, backgrounds, and skin tones, shows that protected source videos draw a 3.26% suspicion rate, while forgeries from protected sources are identified as fake much more often than forgeries from unprotected sources (90.72% vs. 56.71%). This validates the effectiveness of TaintedPixels.
88. 【2608.27477】Benchmarking General Mobile Assistants in Challenging Real-World Scenarios
链接：https://arxiv.org/abs/2608.27477
作者：Yiqi Zhu,Feiyu Gao,Jiaxing Fan,Jiahui Zeng,Minggang Wu,Chenliang Li,Haiyang Xu,Peng Li,Ming Yan,Yang Liu
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Graphical user interfaces, multimodal interactive tasks, Graphical user, interfaces have emerged, multimodal interactive
备注：
点击查看摘要
Abstract:Graphical user interfaces have emerged as an important environment for evaluating autonomous AI agents on multimodal interactive tasks. Existing benchmarks such as AndroidWorld and MobileWorld provide strong foundations for mobile agent evaluation, but their application coverage and task design do not yet fully capture the diversity and complexity of realistic mobile use. We present GMA, a benchmark for evaluating general mobile assistants in challenging real-world scenarios. GMA introduces seven applications based on open-source projects, spanning domains such as lifestyle sharing and travel planning, and 300 tasks across four difficulty tiers, from atomic actions to complex multi-step workflows. We evaluate eight frontier models and find that performance declines substantially as task complexity increases, with current agents remaining far from reliably handling realistic user requirements. We further conduct controlled ablation studies of agent harness choices, including context retention and explicit state tracking, under a shared environment, model setting, and task taxonomy. Results show that appropriate harness design can meaningfully improve performance, particularly on demanding workflows, while the effectiveness of specific designs can vary across foundation models. Overall, GMA complements existing benchmarks by expanding application coverage and task complexity, providing a challenging testbed for evaluating mobile agents and studying how harness design supports reliable execution in complex mobile workflows.
89. 【2608.28137】CheXtriev: Anatomy-Centered Representation for Case-Based Retrieval of Chest Radiographs
链接：https://arxiv.org/abs/2608.28137
作者：Naren Akash,Arihanth Tadanki,Jayanthi Sivaswamy
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：chest radiograph retrieval, present CheXtriev, framework for chest, chest radiograph, anatomy-aware framework
备注： Accepted at the 27th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2024)
点击查看摘要
Abstract:We present CheXtriev, a graph-based, anatomy-aware framework for chest radiograph retrieval. Unlike prior methods focussed on global features, our method leverages graph transformers to extract informative features from specific anatomical regions. Furthermore, it captures spatial context and the interplay between anatomical location and findings. This contextualization, grounded in evidence-based anatomy, results in a richer anatomy-aware representation and leads to more accurate, effective and efficient retrieval, particularly for less prevalent findings. CheXtriv outperforms state-of-the-art global and local approaches by 18% to 26% in retrieval accuracy and 11% to 23% in ranking quality. The code is available at this https URL.
90. 【2608.28092】Do Medical Vision Models Reason About Anatomy? Probing the Spatial Inductive Biases of Learned Visual Representations
链接：https://arxiv.org/abs/2608.28092
作者：Naren Akash,Neeraja Ramanan
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Interpreting, organs sit, assembled multimodal systems, Abstract, comparing structures
备注：
点击查看摘要
Abstract:Interpreting a CT scan means comparing structures on either side, judging how far apart organs sit, and knowing where each one belongs. Medical vision encoders are evaluated on diagnostic accuracy, or through assembled multimodal systems where a failure is hard to attribute, so it remains unclear whether their representations support any of this. We construct SPAR-Bench, eight probes over multi-organ abdominal CT that separate coordinate localization, relational reasoning, and spatial queries, and apply them to five architectural configurations and three medical foundation models, frozen and finetuned. Probes that ask for a comparison within the slice stay at chance, and neither pretraining scale, finetuning, nor architecture closes the gap. Probes that appear solved in domain fall to chance under zero-shot transfer, indicating that their accuracy reflects recall of canonical anatomy rather than computation over the image. Reading the same frozen features with a pooled head rather than the full set of tokens moves relational recovery from 0.7% to 67.8%, so pooled probing understates what a representation holds. Questions the encoders answer well are answered at chance by four open-weight MLLMs. Our results suggest these encoders carry a map of where organs usually lie, and little of the machinery for comparing structures within a particular patient. Code and data will be available at this https URL.
91. 【2608.27690】CARDINAL Predicts Cardiovascular Risk From Non-contrast Cardiac CT
链接：https://arxiv.org/abs/2608.27690
作者：Roy Gabriel,Nattakorn Kittisut,Jamshid Hassanpour,Michael Galarnyk,Abanoub Abdelmalak,Marly van Assen,Carlo N. De Cecco,Arshed Quyyumi,Ali Adibi
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：reduce computed tomography, incomplete clinical data, Nested Anatomical Latent, prediction remains limited, Anatomical Latent embeddings
备注：
点击查看摘要
Abstract:Cardiovascular risk prediction remains limited by incomplete clinical data and imaging biomarkers that reduce computed tomography (CT) to a small number of handcrafted features. We developed CARDINAL (Cardiovascular Assessment via Representation learning from Deep Imaging with Nested Anatomical Latent embeddings), a clinically grounded framework that learns compact representations from routine non-contrast cardiac CT for major adverse cardiovascular event (MACE) prediction. In 17,659 patients, CARDINAL was evaluated for 1-, 3-, 5-, and 10-year MACE prediction against American Heart Association (AHA) pooled cohort equations (PCE), AHA predicting risk of cardiovascular disease events (PREVENT), coronary artery calcium (CAC), segmentation-derived CT biomarkers, and 70-feature structural radiomics. Gains were largest at longer horizons. At 10 years, CARDINAL (joint) achieved an area under the receiver operating characteristic curve (AUROC) of 0.866 $\pm$ 0.020 and an area under the precision-recall curve (AUPRC) of 0.890 $\pm$ 0.015, compared with an AUROC of 0.826 $\pm$ 0.023 and an AUPRC of 0.826 $\pm$ 0.022 for structural radiomics, the strongest baseline. CARDINAL also achieved the highest survival concordance index (C-index), 0.753 $\pm$ 0.015, and high-versus-low risk-tertile hazard ratio, 10.78 $\pm$ 3.16, with favorable reclassification and exploratory calibration. These findings suggest that non-contrast cardiac CT contains prognostic information beyond conventional risk equations, CAC scoring, and engineered imaging biomarkers.
92. 【2608.27516】Destroy Me: Automatic Artifact Generation for Histopathology Images
链接：https://arxiv.org/abs/2608.27516
作者：Zuzanna Krawczyk-Borysiak,Adam Krawczyk,Mateusz Miller,Gabriela Kaczmarek,Sławomir Pakuło,Małgorzata Sokół,Żaneta Swiderska-Chadaj
类目：Image and Video Processing (eess.IV); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Deep learning diagnostic, Deep learning, learning diagnostic utility, real-world data imperfections, utility in pathology
备注：
点击查看摘要
Abstract:Deep learning's diagnostic utility in pathology is constrained by model vulnerability to real-world data imperfections. While current strategies favor "perfect data" by filtering low-quality regions, which can lead to the loss of valuable diagnostic context, we propose a paradigm shift: engineering models to thrive in imperfect environments using "Destroy Me", a hybrid framework for realistic artifact synthesis and robust data augmentation. Our approach combines Stable Diffusion, fine-tuned to preserve morphological continuity by realistically integrating artifacts with the underlying tissue architecture, with physics-based procedural modeling to synthesize six common artifact types: tissue folds, precipitates, blur, stitching errors, dust, and pen markers. Artifact fidelity is assessed using Kernel Inception Distance (KID) and color Wasserstein distance metrics. Validating this strategy on lung adenocarcinoma pattern classification with an nnU-Net, we confirm that models trained on "destroyed" patches consistently outperform baselines on independent real-world datasets. Specifically, we observed a 10.5% relative improvement in macro F1-score and a 15% relative increase in the Cohen's Kappa ($\kappa$) coefficient. Crucially, our results demonstrate that selective, impact-weighted augmentation is vital for balancing practical robustness with the preservation of subtle diagnostic features.
93. 【2608.26907】Climate Physics Dynamic Matching
链接：https://arxiv.org/abs/2608.26907
作者：Gurjeet Sangra Singh,Frantzeska Lavda,Alexandros Kalousis
类目：Applications (stat.AP); Computer Vision and Pattern Recognition (cs.CV); Logic in Computer Science (cs.LO)
关键词：Deep generative models, complex dynamical systems, underlying physical structure, missing source terms, learning complex dynamical
备注：
点击查看摘要
Abstract:Deep generative models such as flow matching and diffusion models have shown potential for learning complex dynamical systems, but typically act as black boxes that neglect underlying physical structure, while physics-based models governed by partial differential equations are often incomplete due to missing source terms, or uncertain parametrisations. We present Climate Physics Dynamic Matching (ClimPhyDM), a variational simulation-free dynamics informed framework for weather forecasting that combines an advection-type physics prior with data-driven components in a variational framework. % to capture the stochasticity and multi-modality of unresolved atmospheric dynamics. On the ERA5 benchmark at hourly (42-hour) and monthly (5-month) resolutions, ClimPhyDM outperforms ClimODE, and GB-DM, keeping the lower error at extended horizon, indicating improved temporal stability and resistance to error accumulation, while its simulation-free paradigm also enables training on a single modest 12 GB consumer GPU.
