本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新497篇论文，其中：
- 自然语言处理66篇
- 信息检索10篇
- 计算机视觉87篇
自然语言处理
1. 【2607.08768】UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
链接：https://arxiv.org/abs/2607.08768
作者：Zhekai Chen,Chengqi Duan,Kaiyue Sun,Bohao Li,Yuqing Wang,Manyuan Zhang,Xihui Liu
类目：Computation and Language (cs.CL)
关键词：large language models, multimodal large language, large language, operating everyday tools, language models
备注： Project Page: [this https URL](https://uniclawbench.github.io) | GitHub Repo: [this https URL](https://github.com/HKU-MMLab/UniClawBench)
点击查看摘要
Abstract:The rapid development of large language models and multimodal large language models has accelerated the emergence of proactive agents capable of operating everyday tools and assisting users in real-world environments. However, existing benchmarks struggle to evaluate such agents effectively, as they often rely on sandboxed environments and single-turn evaluation paradigms. Moreover, their scenario-based task taxonomies mix multiple model capabilities within the same task category, making it difficult to identify the root causes of agent failures. To address these limitations, we introduce UniClawBench, the first capability-driven benchmark designed to evaluate proactive agents in dynamic, real-world settings. UniClawBench is built around five foundational model capabilities: Skill Usage, Exploration, Long-Context Reasoning, Multimodal Understanding, and Cross-Platform Coordination. Based on these capabilities, we design 400 bilingual real-world tasks. Unlike previous benchmarks that rely on static, pre-recorded answers, our benchmark evaluates agents in live Docker containers using fine-grained, step-by-step completion checkpoints. Furthermore, we design a closed-loop evaluation strategy comprising an executor agent, a hidden supervisor agent, and a user agent to simulate realistic multi-turn human feedback without leaking grading criteria. To disentangle base model capabilities from framework-level design choices, we evaluate state-of-the-art models under multiple agent frameworks. Through comprehensive comparisons across both models and frameworks, we show how base model capabilities and agent framework designs jointly shape performance in real-world environments. To facilitate future research, we make our benchmark and code publicly available at this https URL.
2. 【2607.08731】Validity of LLMs as data annotators: AMALIA on authority
链接：https://arxiv.org/abs/2607.08731
作者：Manuel Pita
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：offers a linguistic, linguistic community, language model offers, European Portuguese, model offers
备注：
点击查看摘要
Abstract:A national language model offers a linguistic community its own instrument for measuring what its citizens say and value. Portugal's AMALIA, a publicly funded 9B-parameter model for European Portuguese, appears competitive on agreement alone: asked to code the moral foundation of authority, it agrees with trained human coders to within six F1 points of open models eight to thirteen times its size. Yet agreement is reliability, not validity. For theoretical constructs that must be inferred rather than read from surface features, the question is whether the model follows the construct's theory or reaches the right code by correlated shortcuts. We test this with the recovery gap: the loss in performance when a holistic prompt is decomposed into the codebook's atomic clauses and recombined by the theory's explicit rule. If calibration closes that gap, some portability should survive across models and languages; where it does not, the construct-model instrument is the likely locus of failure. We ask whether a calibrated English instrument transfers to AMALIA-9B and to European Portuguese. For one construct and one corpus, it does not. Decomposition recovers only about half of AMALIA's holistic performance, and error analysis suggests reliance on surface correlates, especially moral outrage near authority figures. An open multilingual LLM closes the gap on the same Portuguese corpus under the same instructions, pointing away from the corpus as the main explanation. AMALIA can still screen and pre-code at scale, but it cannot yet measure this construct well enough to stand alone. The study is a single counterexample, not a verdict on national models; it argues that sovereign-LLM benchmark batteries should test not only agreement with human coders, but the evidential route by which that agreement is warranted.
3. 【2607.08716】Remember When It Matters: Proactive Memory Agent for Long-Horizon Agents
链接：https://arxiv.org/abs/2607.08716
作者：Yifan Wu,Lizhu Zhang,Yuhang Zhou,Mingyi Wang,Bo Peng,Serena Li,Xiangjun Fan,Zhuokai Zhao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：long-horizon tasks, decision-relevant state, expanding trajectory, action, action agent
备注：
点击查看摘要
Abstract:In long-horizon tasks, decision-relevant state is often scattered across an expanding trajectory, while the action agent must surface it and act. As trajectories grow, task requirements, environment facts, prior attempts, diagnoses, and open subgoals can be buried in the context window or pushed beyond it, failing to influence decisions when needed. We call this failure mode "behavioral state decay". We study memory as an active intervention mechanism rather than passive retrieval. A separate memory agent runs alongside an unmodified action agent, updating a structured memory bank from the recent trajectory and deciding whether to inject a memory-grounded reminder or remain silent. The module is plug-and-play with frontier action agents and existing agent harnesses. Across Terminal-Bench 2.0 and $\tau^2$-Bench, it improves pass@1 for both weaker and stronger action agents, with gains of +8.3 pp on Terminal-Bench and +6.8 pp on $\tau^2$-Bench. Ablations show that selective intervention outperforms passive bank exposure, always-on injection, advisor-only guidance, and general retrieval. As an early step toward open-weight memory policies, we train Qwen3.5-27B on SETA using SFT and GRPO, improving validation reward and achieving partial transfer to Terminal-Bench.
4. 【2607.08700】Do You Need a Frontier Model as a Citation Verifier? Benchmarking Rubric LLMs for Deep-Research Source Attribution
链接：https://arxiv.org/abs/2607.08700
作者：Ethan Leung,Elias Lumer,Corey Feld,Austin Huber,Vamse Kumar Subbiah,Kevin Paul
类目：Computation and Language (cs.CL)
关键词：learning increasingly relies, increasingly relies, LLM, Reinforcement learning increasingly, judge
备注：
点击查看摘要
Abstract:Reinforcement learning increasingly relies on an LLM judge to score each rubric criterion, and that judge acts as the reward model during training. Before such a signal can be trusted, we need to know how capable the judge must be and how biased it is. We study this calibration question for citation quality in deep-research systems, where a search-grounded LLM must support each claim it writes with a cited source. Citation quality is a structured rubric task in which each attribution-citation pair is judged along two dimensions that require an LLM, source relevance and factual support. On an adversarial long-form benchmark, we score 8 off-the-shelf LLM judges from 3 model families against gold labels over 1,248 rubric decisions, all of which were human-reviewed and 378 of which were hard cases adjudicated from judge disagreements. Cheaper judges remain competitive across both dimensions, with GPT-5-mini attaining the strongest source-relevance pass-class F1 at 0.908 ($\kappa$=0.636), while on factual support the judges are statistically indistinguishable (overlapping confidence intervals), so no single model dominates. At comparable F1, the judges still differ substantially in pass-rate drift, false positive rate, and false negative rate. Scalar F1 obscures this directional bias, yet it is exactly what a downstream reinforcement learning loop would reinforce. Calibrating the judge is therefore a prerequisite for using citation rubrics as reward signals, and our results show that this calibration does not require the most expensive available model.
5. 【2607.08662】WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search
链接：https://arxiv.org/abs/2607.08662
作者：Xiaoshuai Song,Liancheng Zhang,Kangzhi Zhao,Yutao Zhu,Zhongyuan Wang,Guanting Dong,Jinghan Yang,Han Li,Kun Gai,Ji-Rong Wen,Zhicheng Dou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：Large language model, simple factoid question, factoid question answering, Large language, transforming information seeking
备注： Work in progress
点击查看摘要
Abstract:Large language model (LLM)-based web search agents are transforming information seeking from simple factoid question answering into complex, deep-and-wide search and research-oriented tasks. A single ReAct-style agent is constrained by one long trajectory and limited context, making it difficult to handle depth and coverage simultaneously. Existing multi-agent systems improve search coverage through parallel execution and aggregation, but still exhibit clear limitations in recursive depth, collaboration adaptability, and evidence-grounded expansion. We propose WebSwarm, a progressive recursive delegation framework that jointly constructs task decomposition, recursive expansion, and agent collaboration during inference. WebSwarm dynamically instantiates agentic search nodes, each coupling a local objective with a search mode that specifies how the node should organize search and collaboration. Each node can either solve its objective itself or further delegate child nodes; after solving, it returns evidence and results upward, enabling parent nodes to further expand, revise, or aggregate the search process. To guide this process, WebSwarm first probes how task-relevant information is organized on the web to ground subsequent node expansion, and reuses process-level experience across homogeneous sibling nodes. Experiments on BrowseComp-Plus, WideSearch, DeepWideSearch, and GISA show that WebSwarm consistently outperforms single-agent and multi-agent baselines on deep, wide, and interleaved deep-and-wide tasks. Further analyses of ablation, task difficulty, web tool efficiency, and model generalization explain WebSwarm's effectiveness and provide insights for multi-agent search systems.
6. 【2607.08646】UltraX: Refining Pre-Training Data at Scale with Adaptive Programmatic Editing
链接：https://arxiv.org/abs/2607.08646
作者：Xinlong Zhao,Dongsheng Liu,Hengyu Zhao,Zixuan Fu,Zheng Wang,Jie Cai,Jie Zhou,Qiang Ma,Xuanhe Zhou,Xu Han,Yudong Wang,Zhiyuan Liu
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Scaling Laws, gains from Scaling, Laws have begun, Large Language Models, improving Large Language
备注：
点击查看摘要
Abstract:As available training data approaches its physical limit, gains from Scaling Laws have begun to diminish. Consequently, improving Large Language Models (LLMs) now depends less on data expansion and more on higher-quality data utilization. However, in the context of large-scale corpora, existing refinement methodologies face significant limitations in quality, efficiency, and reliability: Rule-based approaches are constrained by fixed heuristics and struggle with instance-level variations; LLM-based approaches improve quality but fail to meet the efficiency and reliability requirements of large-scale data processing. To address these challenges, we propose UltraX, a function-calling refinement framework for large-scale pre-training data that completes the editing function space by introducing insertion in addition to deletion and modification, enabling fine-grained instance-level editing. Specifically, UltraX builds a reliable program-supervision generation pipeline. In this pipeline, dataset-adaptive prompt optimization first guides an expert LLM to produce high-quality end-to-end refined texts, and Line Alignment Mapping and Dynamic Context Replacement then convert original-refined text pairs into structured program supervision. Meanwhile, UltraX improves supervision quality and stabilizes the training distribution with low-confidence example filtering and ratio-controlled sampling by operation combination. During inference and execution, it normalizes and validates model outputs through sliding-window prediction, global operation aggregation, and systematic post-processing, improving the stability and reliability of large-scale execution. Experiments show that UltraX achieves the highest average performance across all corpora and also matches or surpasses baselines with fewer training tokens, demonstrating stronger data efficiency and refinement reliability.
7. 【2607.08642】DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding
链接：https://arxiv.org/abs/2607.08642
作者：Saw S. Lin(Zhiqi Zhang),Jyh-Shing Roger Jang
类目：Computation and Language (cs.CL)
关键词：accelerates LLM inference, decoding accelerates LLM, accelerates LLM, LLM inference, Toggle
备注： 23 pages, 2 figures, 11 tables. Code: [this https URL](https://github.com/slin-zhq/Domino-Tree)
点击查看摘要
Abstract:Speculative decoding accelerates LLM inference by drafting several tokens and verifying them in parallel. Block-diffusion drafters such as DFlash produce a draft block in one pass but model only per-position marginals; best-first tree methods such as DDTree expand candidate trees from those marginals. The released Domino drafter adds a GRU-based causal correction that makes each draft token's distribution path-dependent, a structure DDTree's factorized formulation cannot represent. We introduce DominoTree, a training-free best-first draft tree scored by Domino's conditional, non-factorized correction along each root-to-node path, made practical by restricting the per-node correction to a candidate top-M. On Qwen3-4B across eight benchmarks, DominoTree reaches up to 6.6x speedup over autoregressive decoding and the highest mean accept length of any evaluated method, up to 10.7 tokens per round, at every temperature we test. DominoTree constructs its tree with a GPU-native, CUDA-graph builder that is bit-identical to a reference Python implementation, so acceptance is unchanged, while keeping per-round tree construction cheap. With this builder as default, DominoTree wins throughput over the released Domino decoder at every temperature, 9-10% overall on Qwen3-4B and up to +22% on Alpaca, and over DDTree/CaDDTree at every temperature we test. On Qwen3- 8B, DominoTree keeps the highest accepted length at every temperature and adds a decisive throughput win at T=0, +24% over DDTree; at higher temperature that edge over DDTree/CaDDTree narrows to a tie and a small loss, while its Overall aggregate wins over DFlash and Domino persist.
Comments:
23 pages, 2 figures, 11 tables. Code: this https URL
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2607.08642 [cs.CL]
(or
arXiv:2607.08642v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2607.08642
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Saw San Lin [view email] [v1]
Thu, 9 Jul 2026 16:16:35 UTC (115 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled DominoTree: Conditional Tree-Structured Drafting with Domino for Speculative Decoding, by Saw S. Lin (Zhiqi Zhang) and Jyh-Shing Roger JangView PDFHTML (experimental)TeX Source
view license
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-07
Change to browse by:
cs
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
8. 【2607.08625】he complexities of patient-centred conversational artificial intelligence
链接：https://arxiv.org/abs/2607.08625
作者：João Matos,Olivia Buege,Donny Cheung,Gary S. Collins,Paula Dhiman,Nan Li,Bingyu Mao,Benjamin W. Nelson,Michail Ouroutzoglou,Paul Varghese,Jonathan Amar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Consumer-facing health chatbots, large language models, Consumer-facing health, powered by large, large language
备注： 36 pages (main text), 129 pages (supplementary materials)
点击查看摘要
Abstract:Consumer-facing health chatbots powered by large language models (LLMs) are increasingly used for symptom assessment. However, chatbot development and evaluation often rely on cooperative, articulate, simulated patients. We analysed 2,053 real patient-chatbot conversations and found that communication patterns and expression of emotions vary widely across users. We developed a patient simulator that separately models clinical content, emotional state, conversational strategy, and communication style. In a Turing-inspired evaluation of realism with 15 human graders, simulated conversations were nearly indistinguishable from real ones, with human graders achieving an accuracy of 55%. We used five distinct patient personae, across 1,164 clinician-graded cases, to evaluate the performance of four LLMs in urgency assessment. We found that communication style can significantly alter triage outcomes. Patient-centred conversational artificial intelligence must accommodate communication diversity: systems designed for idealised, rather than realistic, interactions risk underperforming and amplifying health disparities when deployed in the real world.
9. 【2607.08601】It Takes a MAESTRO To Prune Bad Experts
链接：https://arxiv.org/abs/2607.08601
作者：Palaash Goel,Ayush Maheshwari,Tanmoy Chakraborty
类目：Computation and Language (cs.CL)
关键词：prohibitive deployment bottleneck, achieve remarkable inference, remarkable inference efficiency, full expert banks, expert banks reside
备注： 16 pages, 4 figures
点击查看摘要
Abstract:Sparsely-activated Mixture-of-Experts (MoE) language models achieve remarkable inference efficiency by activating only a small fraction of parameters per token, yet their full expert banks reside in memory at all times, creating a prohibitive deployment bottleneck. Existing structured pruning methods, largely designed for dense transformers, assess expert importance using locally derived heuristics that are blind to the interdependent nature of MoE routing. We introduce MAESTRO (Markov-chain Approximated Expert Sparsification via Transition-based ROuting), a structured pruning framework designed for MoE architectures that models autoregressive expert activation trajectories as Ergodic Markov chains whose stationary distributions encode cross-layer dependencies, yielding a globally aware importance heuristic. Evaluated across five diverse domains including Safety, Bias, and Ethics, MAESTRO outperforms state-of-the-art baselines by up to 10.61% in average performance retention under a strict 50% compression regime, while exhibiting substantially lower cross-task variance, indicating that global, routing-congruent pruning produces models that generalize more consistently across heterogeneous tasks.
10. 【2607.08540】Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging
链接：https://arxiv.org/abs/2607.08540
作者：Ahmed Rayane Kebir,Jose G. Moreno,Lynda Tamine
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：conversation history, history which potentially, potentially gives rise, rise to topic, topic shifts
备注： Accepted to SIGIR 2026. 6 pages, 3 figures
点击查看摘要
Abstract:Conversational information retrieval is challenging since it requires the consideration of the conversation history which potentially gives rise to topic shifts and coreference resolution across previous turns. To address these challenges, previous work mainly rely on traditional fine-tuning of ad-hoc retrievers on conversational datasets or extrapolates their generalizability through multi-tasking. However, this mainstream approach is costly - since it requires model re-training - and exhibits catastrophic forgetting, where the model loses its foundational ad-hoc retrieval performance. In this paper, we fill this gap by introducing model merging as a training-free strategy enabling the design of a single retrieval model that operates across both ad-hoc and conversational settings with no additional fine-tuning. We conduct experiments using linear and non-linear parameter-wise merging strategies - namely Model Soup and Slerp - on standard ad-hoc search and conversational retrieval datasets. Our results demonstrate that model merging significantly enhances the ad-hoc search capabilities of conversational retrievers while improving generalizability across task-specific datasets, achieving up to 15% higher NDCG@3 under zero-shot conditions.
11. 【2607.08535】When the Judge Changes, So Does the Measurement: Auditing LLM-as-Judge Reliability
链接：https://arxiv.org/abs/2607.08535
作者：Zongyou Yang,Yinghan Hou,Xiaokun Yang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：responses stay fixed, candidate responses stay, stay fixed, evaluator has changed, candidate responses
备注： 6 pages, 6 figures, 4 tables
点击查看摘要
Abstract:An LLM-as-judge score can move even when the candidate responses stay fixed, simply because the evaluator has changed. We treat this evaluator-replacement ambiguity as a measurement-validity problem. Across four judgment datasets, we compare two upgrade paths available in practice: scaling Qwen3 dense judges from 1.7B to 32B parameters and moving across MiniMax M2-M2.7 released APIs. The main pattern is that judge upgrades are not interchangeable: only Qwen3 1.7B to 4B gives a robust adjacent gain, while MiniMax adjacent releases do not. Stronger judges reduce but do not remove position and verbosity bias. Repeated-sample juries add little when errors are correlated. Structured debate can move decisions substantially, but without parser and fallback logs those shifts cannot be attributed to deliberation. We argue that LLM-as-judge reports should include dataset slices, bias probes, error-dependence estimates, and protocol audit trails.
12. 【2607.08499】Cross-seed explainability using Procrustes-conditioned Joint End-to-end Top-K Sparse Autoencoders
链接：https://arxiv.org/abs/2607.08499
作者：Bendegúz Váradi,Zoltán Kmetty
类目：Computation and Language (cs.CL)
关键词：Top-K Sparse Autoencoder, Sparse Autoencoder, present a Procrustes-conditioned, independently trained BERT, trained BERT models
备注： 17 pages, 4 figures, 6 tables
点击查看摘要
Abstract:We present a Procrustes-conditioned Joint End-to-end Top-K Sparse Autoencoder (SAE) for extracting cross-seed universal features from independently trained BERT models. Cross-seed feature universality is a fundamental challenge in mechanistic interpretability: because dictionary learning is non-convex, independently trained networks learn misaligned feature spaces, so apparently identical features may differ by random initialization. We address this by computing an orthogonal Procrustes rotation between seeds' activation spaces before joint SAE training, combining Top-K sparsity, end-to-end downstream optimization, and an auxiliary dead-feature revival loss based on previous SAE literature. Evaluating on five independent seed pairs (ten BERT models) across three benchmark datasets (SST-2, Stanford Politeness, TweetEval Emotion), our full pipeline produces more universal features (Pearson r $\geq$ 0.70 across seeds) than post-hoc alignment baselines on all three datasets. A minimal qualitative analysis confirms that high-universality features encode interpretable sociolinguistic patterns.
13. 【2607.08497】Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
链接：https://arxiv.org/abs/2607.08497
作者：Feng Wang,Canmiao Fu,Zhipeng Huang,Chen Li,Jing Lyu,Ge Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Recent unified multimodal, jointly perform vision, multimodal models show, Cognitive-structured Multimodal Agent, Recent unified
备注： 16 pages, 7 figures, 8 tables. Project page: [this https URL](https://caseclose.github.io/cma-harness/) Code: [this https URL](https://github.com/caseclose/cma-harness)
点击查看摘要
Abstract:Recent unified multimodal models show a single architecture can jointly perform vision/language understanding and image generation/editing. However, they repeatedly feed all historical visual and textual inputs into a shared context window, limiting long-horizon multimodal dialogue due to visual token explosion and unreliable cross-turn referencing. We propose a Cognitive-structured Multimodal Agent that externalizes visual information into an Episodic Visual Memory and selectively reactivates relevant episodes during reasoning. The agent consists of a Perceptual Abstraction Engine for structured visual abstraction, a Cognitive Retrieval Engine for cross-turn memory retrieval, and a Multimodal Executive Controller for autonomous task inference and action planning. To address the lack of turn-level retrieval supervision in existing datasets, we develop a Unified Scenario Engine that programmatically generates structured multi-turn conversations with fine-grained retrieval annotations, enabling reinforcement learning to optimize abstraction and retrieval policies. We also construct a long-horizon visual-dialogue benchmark stratified by difficulty to evaluate episodic visual recall. Our 8B agent achieves 91.4% retrieval accuracy over 20-turn sessions, surpassing 32B baselines by +8.2% while nearly halving per-turn inference time (23.1s - 12.7s). We further present the Cognitive-structured Multimodal Agent Harness (CMA-Harness), a tool-augmented deployment of the same cognitive structure integrating persistent multimodal memory, web access, image generation/editing/composition tools, and OpenAI-compatible serving. Structured memory and modular decision-making offer a more scalable, efficient paradigm for long-horizon multimodal agents than monolithic parameter scaling. Code: this https URL ; Project page: this https URL
14. 【2607.08493】Ensemble Diversity Optimization for Subjective Supervision
链接：https://arxiv.org/abs/2607.08493
作者：Xia Cui,Ziyi Huang,N. R. Abeynayake
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Subjective NLP tasks, NLP tasks, exhibit systematic annotator, Subjective NLP, requiring models
备注：
点击查看摘要
Abstract:Subjective NLP tasks often exhibit systematic annotator disagreement, requiring models that represent uncertainty rather than collapse it. We introduce Ensemble Diversity Optimization (EDO), a prediction-space framework that jointly optimizes ensemble weights, effective cardinality, and calibration through a unified differentiable objective. EDO learns ensemble composition and size end-to-end via Gumbel-Softmax relaxation and incorporates a signed diversity regularizer, tuned on validation data, to steer optimization toward either preserving or suppressing disagreement. This regularization prevents ensemble collapse and enables controlled navigation of the utility-calibration trade-off. The framework integrates a soft F1 surrogate, class-weighted cross-entropy to address imbalance, and reliability-weighted diversity to regulate intra-ensemble variability. Experiments on four subjective text-classification benchmarks (ArMIS, ConvAbuse, HS-Brexit, MD-Agreement) show that EDO substantially improves probabilistic calibration, reducing cross-entropy (40-78% depending on baseline) and lowering Brier scores relative to Soft-CE, Soft-MD, Top-5 Voting, and WEL, while maintaining competitive F1 and better alignment with annotator distributions. These results demonstrate that jointly optimizing ensemble structure with a signed diversity regularizer provides an efficient, model-agnostic approach for modeling human subjectivity in supervised learning.
15. 【2607.08456】wo Axes of LLM Abstention: Answer Correctness and Question Answerability
链接：https://arxiv.org/abs/2607.08456
作者：Benedikt J. Wagner
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：model, false, answers, Abstract, score
备注：
点击查看摘要
Abstract:A model should refuse two different things: answers it would get wrong, and questions it should not answer at all, such as unanswerable ones or ones resting on a false premise. The usual recipe thresholds a single confidence score, which cannot tell these apart. Across five instruction-tuned models from three families (2B to 14B), we find they are separate axes. Ordinary answer-confidence tracks whether an answer is right but is nearly blind to whether the question is answerable; a linear probe on hidden states does the reverse. The blind spot does not shrink with scale. It is worst on naturally occurring false-premise questions (CREPE). There, answer-confidence, P(IK), P(True), and even asking the model outright whether a premise is false all stay near chance, while a hidden-state probe reaches 0.69 to 0.77 AUROC: the model represents a problem it will not report. This turns out to be fixable. Instructing a model to check premises backfires, because it then disputes sound and false premises alike (57% false challenges), unable to tell them apart; routing the same instruction with the probe roughly triples challenge precision. We turn the two axes into a calibrated policy that answers only when an answerability score and a correctness score each clear a separately certifies behave differently: the unanswerable-answer rate is controllable at every scale, while the wrong-answer rate is capped by model accuracy, so the guarantee tightens as threshold policy certifies both budgets at 0.75 coverage of correct answers, against 0.31 for a single threshold; at 14B it is the only policy that certifies at all.
16. 【2607.08417】Detecting Ladder Logic Bombs in IEC 61131-3 PLC Programs using ESBMC-PLC+: A Formal Verification Approach with Trigger Synthesis
链接：https://arxiv.org/abs/2607.08417
作者：Pierre Dantas,Lucas Cordeiro,Waldir Junior
类目：Computation and Language (cs.CL); Hardware Architecture (cs.AR)
关键词：Programmable Logic Controller, forge sensor readings, deny operator control, Ladder Logic Bomb, malicious control logic
备注： 14 pages
点击查看摘要
Abstract:A Ladder Logic Bomb (LLB) is malicious control logic in a Programmable Logic Controller (PLC) program that lies dormant until a trigger activates a payload to manipulate actuators, forge sensor readings, or deny operator control. We observe that real malicious logic hides inside function-block bodies, which existing ladder-diagram verifiers drop from their intermediate representation (IR), making bombs invisible to provers. We present ESBMC-LLB, which uses ESBMC-PLC+ as its verification engine and adds a modeling layer that exposes function-block logic and recasts bomb detection as a formal verification problem: a scan-watchdog exposes non-termination payloads, and output wiring exposes actuator-forgery payloads as safety violations. k-induction gives an unbounded proof of bomb-absence across all scans, and the bounded model checker returns a counterexample that is the trigger - guarantees that signature, anomaly, and CFG-triage detectors lack. On the public Iacobelli 2024 dataset, ESBMC-LLB detects all 30 bombs and recovers every trigger; it also detects adaptive triggers (computed, opaque-arithmetic, multi-scan) that evade CFG-triage. We also report the first semantic model-checker evaluation on PLC-Defuser's SWaT corpus: our analog extension makes the full corpus parseable; on v1.0.0, it detects 149/150 bombs (99%) with zero false positives, recovering each trigger; on a later version with nonlinear non-termination bombs, detection drops to 49% as the SMT solver times out. We conclude that semantic model checking and CFG-triage are complementary - the former gives unbounded proofs, adaptive-trigger robustness, and handles Boolean/integer and linear analog logic; the latter leads to nonlinear analog non-termination, and we delineate where each wins.
17. 【2607.08409】When Synthetic Speech Is All You Have: Better Call GRPO
链接：https://arxiv.org/abs/2607.08409
作者：Shashi Kumar,Yanis Labrak,Hasindri Watawana,Sergio Burdisso,Esaú Villatoro-Tello,Kadri Hacioğlu,Petr Motlicek,Andreas Stolcke
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：LLM-based ASR adapted, LLM-based ASR, ASR adapted, bottlenecked by privacy, constrained to collect
备注： Submitted to SLT 2026
点击查看摘要
Abstract:LLM-based ASR adapted to regulated domains such as banking is bottlenecked by privacy: real speech is costly and legally constrained to collect, making synthetic text-to-speech (TTS) an attractive substitute. Yet synthetic speech stays acoustically mismatched with real recordings, and work on this gap has stayed within supervised fine-tuning (SFT). We instead turn to reinforcement learning, and show that Group Relative Policy Optimization (GRPO) extracts far more from the same synthetic speech than SFT. Synthetic-only adaptation of the model with GRPO, a critic-free method rewarding low-WER hypotheses, reduces WER by 40\% relative to SFT (36.71\%$\to$22.09\%), and an SFT-then-GRPO combination pushes this further to 45\%. We trace the gain to behavior rather than representation: GRPO reduces insertion errors by improving stopping calibration and speech-to-text alignment by better anchoring attention to audio, leaving early-layer representations intact. When synthetic speech is the main resource, reinforcement learning should be preferred over supervised fine-tuning.
18. 【2607.08399】Prompt Compression via Activation Aggregation
链接：https://arxiv.org/abs/2607.08399
作者：Thibaud Ardoin,Semira Einsele,Evis Bregu,Gerhard Wunder
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, language models process, Large language, models process prompts, generating a response
备注：
点击查看摘要
Abstract:Large language models process prompts by propagating activations through dozens of layers before generating a response. We ask whether the task-relevant information contained in an instruction prompt can be compressed into a single activation vector and re-injected into the model, replacing the original token sequence? We show this is achievable using a learned weighted sum of activations extracted at an intermediate layer and injected at an early layer of the target LLM. The compressed vector preserves task-relevant information, incurring an accuracy drop of under $2\%$ relative to full prompt processing. Beyond its practical implications, including reducing per-query computation for fixed instruction prompts without reprocessing the original token sequence, our analysis reveals structure in the activation space of LLMs: (i) mid-layer representations transfer meaningfully to early layers, suggesting a degree of cross-layer compatibility in how information is encoded; (ii) a single activation vector encodes a quantifiable and recoverable amount of semantic information; (iii) a weighted sum of activations is a robust representation compressor.
19. 【2607.08395】oken-Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents
链接：https://arxiv.org/abs/2607.08395
作者：Puji Wang,Yingchen Zhang,Ruqing Zhang,Jiafeng Guo,Xueqi Cheng
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL)
关键词：large language models, long-lived software systems, extend large language, agents extend large, language models
备注：
点击查看摘要
Abstract:Persistent AI agents extend large language models (LLMs) beyond single-turn interaction into long-lived software systems. Unlike traditional chat assistants, unsafe content in these agents can propagate through persistent state, reusable skills, and tool-mediated interactions, creating a substantially larger semantic attack surface. We observe that most security-critical interactions in such agents are transmitted through natural-language token flows, including memory updates, tool arguments, retrieved files, and inter-component communications. This observation enables a new security formulation: unsafe behavior can be intercepted as risky semantic flows before reaching privileged runtime sinks. Based on this insight, we propose TokenWall, a runtime defense framework that acts as a semantic firewall over agent token flows. TokenWall performs boundary-aware semantic auditing over these flows, constructing structured source-sink audit records, applying lightweight local inspection before execution, and selectively escalating ambiguous high-risk cases to stronger arbitration modules. Unlike prior approaches that rely on sparse auditing or remote large-model oversight, TokenWall enables full-coverage pre-execution mediation while reducing remote arbitration and latency. Experiments on CIK-Bench show that TokenWall reduces attack success rate to 12.5% while maintaining a 97.4% benign executable pass rate without human confirmation. TokenWall further introduces only 0.69 seconds of additional latency on benign cases, demonstrating that semantic runtime containment can achieve a practical security-utility trade-off for persistent AI agents.
20. 【2607.08393】owards Mechanistically Understanding Why Memorized Knowledge Fails to Generalize in Large Language Model Finetuning
链接：https://arxiv.org/abs/2607.08393
作者：Lu Dai,Ziyang Rao,Yili Wang,Hanqing Wang,Hao Liu,Hui Xiong
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：downstream reasoning tasks, Fine-tuning LLMs, critical challenge, memorize new facts, reasoning tasks
备注：
点击查看摘要
Abstract:Fine-tuning LLMs to inject new knowledge faces a critical challenge: LLMs can quickly memorize new facts, yet fail to use them for downstream reasoning tasks. We formalize this failure as the \textit{\textbf{Knowing--Using Gap}}, characterized by an accuracy gap and a temporal lag between memorization and generalization. To understand this phenomenon, we fine-tune LLMs with unseen knowledge and monitor the spatial permeation dynamics of the knowledge internally using a novel intervention technique called self-patching. Self-patching identifies activation locations where relocating representations substantially improves failed generalization cases. These results are consistent with a knowledge-circuit misalignment hypothesis: memorized representations can exist internally but may not be routed to computation-effective layers. To demonstrate the practicality of this diagnostic finding, we design a simple heuristic strategy which recovers 58--75\% of the oracle headroom in generalization failure. Experiments are done cross-domain for the robustness of this finding.
21. 【2607.08374】Large-Language-Models-as-a-Judge in Theory-Agnostic Adaptive Metric-Alignment for Prototypical Networks in Personality Recognition
链接：https://arxiv.org/abs/2607.08374
作者：Jing Jie Tan,Ban-Hoe Kwan,Danny Wee-Kiat Ng,Yan-Chai Hum,Shih-Yu Lo,Po-An Chen,Noriyuki Kawarazaki,Kosuke Takano,Anissa Mokraoui
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Robotics (cs.RO); Social and Information Networks (cs.SI)
关键词：underlying behavioral structure, uncovering shared underlying, shared underlying behavioral, theory-dependent formulations, recognition has traditionally
备注：
点击查看摘要
Abstract:Personality recognition has traditionally been constrained by theory-dependent formulations, where models are trained to fit predefined psychological taxonomies rather than uncovering shared underlying behavioral structure. This limits generalization, as personality itself is better understood as theory-invariant, while existing annotations reflect only partial and sometimes inconsistent views of the same latent traits. In this work, we introduce JAM ((J)udge for (A)daptive (M)etric-Alignment), a theory-agnostic framework that shifts learning from adapting to predefined personality theories toward discovering unified latent pseudo-facets that capture shared psychological structure. Rather than constraining the model to any personality taxonomy during training or inference, the framework learns generalizable psychological representations and can infer an individual's latent psychological profile directly from the textual samples, without requiring theory-specific labels. JAM achieves this through an Attention-Pooled Graph Prototypical Network that learns structured representations via clustering in embedding space, together with a Cross-Theory Harmonization (CTH) approach that integrates (i) Human-Guided Linkage and (ii) Machine-Induced Consensus to unify heterogeneous datasets without relying on predefined labels. To further improve robustness and data quality, we incorporate an LLM-as-a-Judge mechanism operating in two configurations, (i) LLM-before-the-loop and (ii) LLM-in-the-loop which identifies ambiguous samples to guide adaptive metric learning. Experiments show that JAM improves cross-framework generalization and performance, establishing a strong step toward theory-agnostic personality inference and supporting low-resource personality theories. The related code repository, model weights, and artifacts are available at this https URL
22. 【2607.08362】Echoes Across Vietnam's Highlands, Delta, and Coast: A Multilingual Corpus for Cham, Khmer, and Tay-Nung
链接：https://arxiv.org/abs/2607.08362
作者：Anh Trac Duc Dinh,Khang Nhat Hoang Vo,Vinh Cong Doan,Tai Tien Ta,Khoa Duc Anh Lam
类目：Computation and Language (cs.CL)
关键词：Natural Language Processing, Vietnam ethnic minority, Tay-Nung differ sharply, ethnic minority languages, Vietnamese contact
备注：
点击查看摘要
Abstract:Vietnam's ethnic minority languages are almost absent from the field of Natural Language Processing (NLP), and the challenge goes beyond data scarcity: Cham, Khmer, and Tay-Nung differ sharply in script, Vietnamese contact, and standardization, conditions under which standard multilingual adaptation can learn the wrong signals. We introduce CKTN, the first corpus and benchmark for these languages (44,367 documents, 24M subword tokens), spanning continued pretraining, category classification, and summary-document retrieval. We show that existing multilingual encoders severely fragment these languages, and that common adaptation metrics can mislead: models may lower language-modeling loss or excel at lexical-overlap retrieval while still failing at semantic generalization across documents. We address this with a script-aware adaptation recipe - vocabulary augmentation combined with calibrated replaced-token pretraining - that prevents the discriminator from exploiting trivial script mismatches. The result is an encoder with substantially less fragmentation and the strongest classification performance among evaluated models, exposing the limits of lexical-overlap retrieval as an evaluation signal.
23. 【2607.08346】Grounded Event Extraction from SEC 8-K Filings with a Fine-Grained Taxonomy
链接：https://arxiv.org/abs/2607.08346
作者：Rian Dolphin,Joe Dursun,Jarrett Blankenship,Katie Adams,Quinton Pike
类目：Computation and Language (cs.CL); General Finance (q-fin.GN)
关键词：public companies disclose, chief executive departures, companies disclose material, spans routine administrative, disclose material events
备注： 9 pages, 8 figures, 1 table. Full dataset and taxonomy available at [this https URL](https://massive.com/docs/rest/stocks/filings/8-k-disclosures?utm_source=research&utm_campaign=8k_tags)
点击查看摘要
Abstract:Form 8-K filings are the primary channel through which U.S. public companies disclose material events, but the SEC item codes attached to them are coarse: a single item spans routine administrative changes and chief executive departures, and many of the most market-moving disclosures fall into a catch-all item. Large language models make fine-grained labelling feasible at corpus scale, but only if the labels can be traced to the source text and shown to be reliable. We present a two-stage system that tags 8-K disclosures against a three-tier taxonomy of 119 event types. The first stage constrains output to valid taxonomy entries and anchors every tag to a verbatim quote via fuzzy n-gram validation; the second re-grades each cited quote against the category definition to produce a quality score. Applying the system to 292,984 filings from 2022 to 2026 yields 601,088 grounded event tags, which we release. Over 5,125 stratified tags, an LLM judge finds precision rises monotonically with the quality score, from 12% to 96%, while unsupported tags fall from 8% to near zero. Ablation shows the score is calibrated only when assigned in a dedicated second pass. An event study on unsigned abnormal returns confirms, without any language model, that the taxonomy separates economically distinct events sharing an item code.
24. 【2607.08339】ypeProbe: Recovering Type Representations from Hidden States of Pre-trained Code Models
链接：https://arxiv.org/abs/2607.08339
作者：Giuliano Gorgone,Fausto Carcassi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Programming Languages (cs.PL)
关键词：achieve impressive performance, remains poorly understood, information remains poorly, models achieve impressive, type information remains
备注： 18 pages, 12 figures. Accepted at ESSLLI 2026 (StuS; double-blind)
点击查看摘要
Abstract:State-of-the-art code models achieve impressive performance, yet the extent to which they internally encode type information remains poorly understood. We probe the residual streams of pretrained code models for internal type representations using a parallel dataset of Java and Python code examples. Our results show that cross-lingual type representations emerge even from untyped code. Moreover, we test whether hidden states linearly encode the result type implied by typed function application by training probes on one language to infer argument and result types in the other. Finally, we find that this structure is partly robust to lexical perturbations and cross-language syntactic variations. To the best of our knowledge, prior work on interpretability of code models has not directly targeted formal type semantics or cross-lingual type representations. We release our code and datasets.
25. 【2607.08332】XALPHA: A Memory-Driven AI Quant Researcher for Hypothesis-to-Code Alpha Discovery
链接：https://arxiv.org/abs/2607.08332
作者：Fengyuan Liu,Yuchen Fu,Yuqi Wang,Qi Liu
类目：Computation and Language (cs.CL)
关键词：robust trading signals, markets are noisy, making it difficult, trading signals, difficult to discover
备注：
点击查看摘要
Abstract:Financial markets are noisy, non-stationary, and high-dimensional, making it difficult to discover predictive and robust trading signals. Alpha discovery has evolved from manual factor design to machine learning, evolutionary search, and recent LLM-based frameworks, improving the efficiency of factor generation, search, and evaluation. However, existing methods still mostly automate isolated steps, rather than functioning as end-to-end quant researchers that can absorb external knowledge, close the hypothesis-to-code validation loop, and learn from accumulated discovery feedback. To fill this gap, we introduce XAlpha, a memory-driven AI Quant Researcher for continuous hypothesis-to-code alpha discovery. XAlpha maintains a multi-source research memory system that integrates report-grounded financial knowledge with discovery feedback from prior generations and research cycles. Guided by this memory system, a Macro Brain plans research themes and selects suitable Archetypes; a Micro Brain transforms the planned hypothesis pool into executable factor code and verifies ex-ante tri-alignment among the hypothesis idea, code logic, and financial plausibility; and a Cross Brain consolidates empirical outcomes into generation-level feedback, cycle-level summaries, and archetype-level research cues for future exploration. In this way, XAlpha turns alpha mining from isolated factor generation into a closed-loop research process that continuously reads, hypothesizes, implements, validates, reflects, and evolves. Experiments on CSI300 show that XAlpha achieves stronger overall alpha discovery performance than representative baselines.
26. 【2607.08268】Different Teachers, Different Capabilities: Sub-1B On-Device Distillation for Structured Text Enrichment
链接：https://arxiv.org/abs/2607.08268
作者：Vinay Kumar Chaganti
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：High-volume structured extraction, large model latency, structured extraction pays, High-volume structured, large model
备注： 12 pages, 5 figures. has a same-size non-reasoning-teacher control, a three-judge LLM-as-a-judge panel with a negative control, full-source faithfulness grading, and a per-field routing analysis
点击查看摘要
Abstract:High-volume structured extraction pays a large model's latency on every item, so distilling the task into a small on-device model is attractive: comparable output at a fraction of the time and cost. We measure what that distillation actually delivers, per sub-task. Each news article is mapped to one JSON object with a short summary and five categorical labels. We distill an 8B reasoning teacher (deepseek-r1:8b) into a 0.6B student (Qwen3-0.6B; QLoRA, three seeds), and add two teacher controls: a same-size non-reasoning teacher and a larger managed pipeline. A blinded, reference-free, three-judge panel scores every arm against the full article, alongside two non-distillation baselines, few-shot prompting and constrained decoding. The student runs at about 0.8 s per article against the teacher's 39 s, and recovers 58% of the base-to-teacher gap on summary quality, beating its primary baseline (constrained decoding) by +16.8 points and few-shot prompting by a secondary +4.9. A same-size non-reasoning teacher trains a student no better than the untuned base, so the summary gain follows from the teacher's reasoning nature rather than its scale. Capabilities then split by teacher: the reasoning teacher transfers writing quality and the managed pipeline transfers label diversity, while a same-size instruction teacher's students stay more grounded on the 22 short, thin-source articles in the 93-item test set (74 versus 55 faithful), where the reasoning-lineage student fabricates. That grounding difference is a consistent ordering rather than a significant aggregate effect, and the subgroup is small, so we report it as a direction. Because no single engine wins every field, the deliverable is a per-field routing map for on-device enrichment.
27. 【2607.08256】Best-of-$N$ TTS Evaluation is Confounded by ASR Family Alignment
链接：https://arxiv.org/abs/2607.08256
作者：Taehyung Yu,Seongjae Kang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Sound (cs.SD)
关键词：inference improves content, improves content consistency, automatic speech recognition, inference improves, consistency in zero-shot
备注： Accepted at ICML 2026 Workshop on Machine Learning for Audio
点击查看摘要
Abstract:Best-of-$N$ (BoN) inference improves content consistency in zero-shot text-to-speech by selecting from $N$ candidates with an automatic speech recognition (ASR) verifier. We identify an underexplored evaluation confound: a verifier's apparent quality depends strongly on which ASR family judges it. On LibriSpeech-PC test-clean~\citep{librispeechpc} with F5-TTS~\citep{f5tts}, verifier rankings reverse across Whisper, wav2vec~2.0, and HuBERT evaluators, and same-family verifier-evaluator pairs recover 2-3$\times$ more oracle headroom than cross-family pairs despite near-identical representations (linear CKA $0.978$) -- a pattern consistent with identity- or lineage-level coupling rather than representational overlap. We propose two \textbf{cross-family rank ensembles} (rank-averaging and conjunctive max-rank) that attain the lowest mean WER across three independent evaluators -- $1.61\%$ at $N{=}10$ ($-12\%$ relative to F5-TTS) -- with no measurable degradation under automatic SIM-o/UTMOS metrics; the best single verifier drives WER from $2.06\%$ to $1.72\%$ ($-16.5\%$) under the official F5-TTS evaluator. We recommend cross-evaluator triangulation as default reporting practice.
28. 【2607.08252】AutoPersonas: A Multi-Timescale Loop Engine for Open-Ended Persona Evolution
链接：https://arxiv.org/abs/2607.08252
作者：Mengchen Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Long-term persona agents, social conditions, Long-term persona, agents must remain, remain identifiable
备注： 52 pages, 13 figures/tables, ancillary public-safe evaluation artifacts included
点击查看摘要
Abstract:Long-term persona agents must remain identifiable while adapting to new events, relationships, evidence, and social conditions. We identify self-locking as a runtime failure mode in continuing persona-life loops: locally plausible events keep appearing while the generated life collapses toward familiar environments, weak relationships, suspended decisions, and stale life stages. We trace this failure to model-level convergence toward high-probability behavioral channels and system-level context gravity from State, memory, history, and environment summaries. We introduce AutoPersonas, a multi-timescale life-environment engine for bounded persona-level recursive self-evolution. It separates environment-side Occurrences, accumulated Observations, and persona State. Its OSO loop admits divergent future-facing material while requiring evidence-governed absorption before State or reachability changes. A three-year compressed simulation exposed environment watermark shells, occurrence-hardening gaps, slow-change accumulation failures, recursive indecision, and weak relationship persistence. An eight-model 40-day stress test generated 1,600 events and found mean rolling 5-day action-category repetition of 95.2%-97.6%, with all models crossing 90% by day 11. Semantic re-keeping found 79.0%-88.0% macro-theme repetition across all direct-loop runs. In a same-runtime 40-day A/B, context-slice masking plus per-sample divergence targeting reduced macro-theme repetition from 61.8% to 36.3% and roughly doubled cumulative theme count. A juvenile-goblin fictional-world run reproduced the anti-fixation regime without hard real-world intrusions. These results support a bounded claim: separating controlled divergence from evidence-governed absorption can reduce persona-environment self-locking while preserving identity continuity.
29. 【2607.08208】Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech
链接：https://arxiv.org/abs/2607.08208
作者：Hao Wu,RongQi Han,Zhen Wang,Wei Liang,Wei Xu
类目：Computation and Language (cs.CL)
关键词：multilingual two-speaker conversational, Challenge for multilingual, two-speaker conversational speech, diarization front end, paper describes
备注： 4 main pages plus 1 page of reference
点击查看摘要
Abstract:This paper describes our self-designed system for Task 1 of the MLC-SLM 2026 Challenge for multilingual two-speaker conversational speech. The system combines a modular speaker diarization front end with a challenge-adapted Qwen3-ASR-1.7B recognizer. The diarization front end performs voice activity detection, subsegment generation, CAMPPlus speaker embedding extraction, two-speaker spectral clustering, and RTTM-based audio segmentation. The resulting speaker-attributed segments are grouped by language or region and decoded by the adapted ASR model. For ASR adaptation, we first perform supervised full fine-tuning on the official training data, then apply LoRA fine-tuning with synthetic speech generated by a three-pipeline TTS-based synthetic speech augmentation framework, and finally refine the model using GRPO reinforcement learning with rewards based on WER/CER and penalties for hallucination, repetition, and length deviation. On the official development set, the full system achieves an average tcpMER of 23.70, reducing the error rate by 6.83 absolute points relative to the released Qwen-ASR-1.7B performance. On the final evaluation set, the system achieves an average tcpMER of 17.97. Ablation results show that supervised fine-tuning provides the largest gain, while synthetic-speech LoRA adaptation and reinforcement learning further improve robustness.
30. 【2607.08196】A First-Principles Theory of Slow Thinking and Active Perception
链接：https://arxiv.org/abs/2607.08196
作者：Hongkang Yang,Zhi-Qin John Xu,Feiyu Xiong,Weinan E
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：slow thinking, slow thinking models, series on first-principles, first-principles modeling, modeling of cognitive
备注： Published on 2026/05/11 in Journal of Machine Learning
点击查看摘要
Abstract:As part of a series on first-principles modeling of cognitive functions, this paper attempts to provide a mathematical formulation of thinking and perception. It formally derives slow thinking or more generally, active perception, and encompasses the design, training and inference of slow thinking large language models. Our starting point is the lifting and projection of probability distributions on the observable and latent spaces, with the objective of representing complex data distributions by simple function families such as neural networks. A theory called "active lifting" is proposed, based on the sampling of latent sequences and an intrinsic drive to reduce uncertainty with maximum rate. It derives a large design space, containing the slow thinking models in a subspace that we call the static theory. These models are positioned on the representation hierarchy and sampler hierarchy induced by the static theory, and can be upgraded by climbing the two hierarchies. Active lifting further derives an inference process with an internal time axis, and a training objective that resembles minimum-length coding as well as the invention of languages. Thus, it characterizes the agency of perception, including the emergence of the slow thinking formats. Technical by-products of this theory include a three-stage pathway for improving slow thinking models, a unified approach to constructing encoders and generative models for all data modalities, a priori formation of human-like visual representations, and a possible solution to policy collapse.
31. 【2607.08186】Hidden Decoding at Scale: Latent Computation Scaling for Large Language Models
链接：https://arxiv.org/abs/2607.08186
作者：Aiwei Liu,Cheng Shi,Chuhan Wu,Ci Lei,Di Lu,Donald He,Fan Zhang,Fanhao Kong,Feifei Zhang,Guan Wang,Haicheng Wang,Haoyu Liu,Houjin Yu,Jiachen Ding,Jiayi Feng,Jie Zhou,Jijun Chi,Jindi Shi,Jing Lei,Junjie Zhang,Laiyi Li,Le Tian,Linhao Zhang,Miao Fan,Sijun Zhang,Wei Jia,Weiwei Shi,Wenhan Li,Wentao Zhao,Wenteng Liang,Xiao Zhou,Xiaojin Zhou,Xihuai Wang,Xinyu Gao,Xuanliang Wang,Xuyang Ao,Yang Yu,Yangxiu You,Yinuo Zhao,Yufei Kuang,Yufei Wang,Yuan Liu,Yuan Liu,Yuwen Chen,Zhencong Tian,Zhongyin Zhao,Zilin Yu,Zitao Wang
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Scaling Large Language, Large Language, Language Models, Transformer backbone fixed
备注： 30 pages, 9 figures
点击查看摘要
Abstract:Scaling Large Language Models (LLMs) has been driven mainly by enlarging the Transformer backbone, but for an already-strong model this requires another round of costly pretraining. We study whether an existing backbone can keep improving by allocating more computation to each token while leaving the Transformer backbone fixed. Depth-recurrent (looped) Transformers pursue this goal but are hard to scale, because looped computation does not fit naturally with the pipeline parallelism used to train the largest models. We add computation along the sequence-length dimension, where the extra computation is simply a longer input and stays compatible with standard large-model training. We propose Hidden Decoding, a sequence-length scaling method applied during continued pretraining (CPT). It expands each token into n streams with independent embedding tables and keeps the intermediate streams' key-value cache as context, so each token performs more internal computation without adding or widening Transformer layers. To keep this affordable at scale, we introduce Stream-Factorized Attention, in which most layers attend only within each stream and only a few layers mix across streams, reducing the attention cost from quadratic to roughly linear in n. Experiments support two scaling results. At frontier scale, we train WeLM-HD4-80B and WeLM-HD4-617B at n=4 and improve their matched non-HD baselines, making Hidden Decoding the first demonstrated sequence-length scaling method at the 100B+ MoE scale. Across expansion factors, the gains grow as n increases, showing that sequence-length expansion is a practical fixed-backbone scaling path for frontier-scale LLMs.
32. 【2607.08161】SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation
链接：https://arxiv.org/abs/2607.08161
作者：Wangyu Wu,Xiaojian Lin,Rong Fu,Zaiyang Yu,Xuhang Chen,Wenjun Yu,Zhenhong Chen
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：natural language processing, natural language, processing that enables, enables users, users to interact
备注： Accepted at IEEE SMC 2026
点击查看摘要
Abstract:Text-to-SQL is a fundamental task in natural language processing that enables users to interact with structured databases using natural language. While large language models (LLMs) have demonstrated remarkable performance on this task, their substantial computational requirements hinder deployment in resource-constrained settings. In this paper, we introduce SQuaD-SQL (Small-Qualified and Distilled for SQL), a novel approach that empowers small language models (SLMs) to approach the performance of LLMs on the Text-to-SQL task while significantly improving efficiency through knowledge distillation and synthetic data generation. Our method comprises three key components: (1) LLM-based synthetic data generation, where structured knowledge is extracted from LLMs via carefully designed prompting strategies; (2) parameter-efficient fine-tuning, enabling full model training on a single consumer-grade GPU; and (3) domain-adaptive fine-tuning, where domain-specific synthetic data further enhances performance in targeted domains. Experiments on the WikiSQL dataset demonstrate that SQuaD-SQL achieves an execution accuracy of 86.9% on the test set, approaching the performance of LLMs while offering faster inference and lower memory usage. These results suggest that, with proper training strategies, SLMs can serve as practical and efficient alternatives for Text-to-SQL applications in resource-limited environments.
33. 【2607.08152】LEXIC: Lightweight Eye-tracking eXtension via Injected Complexity
链接：https://arxiv.org/abs/2607.08152
作者：Sumin Lee,Kyeonghun Kim,Subeen Lee,Jiwon Yang,Tien Nguyen,Ken Ying-Kai Liao,Nam-Joon Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC); Machine Learning (cs.LG)
关键词：eye movements exposes, language models reach, pretrained language models, recent EyeBench benchmark, gaze-only models operate
备注： Accepted to APCCAS 2026
点击查看摘要
Abstract:On the recent EyeBench benchmark, predicting reading comprehension from eye movements exposes a stark gap: text-aware models using pretrained language models reach 56--63% AUROC, while gaze-only models operate at chance. We ask how far a gaze-only model can be pushed by lightweight, language-model-free conditioning. Building on the EyeBench AhnCNN baseline, LEXIC-Base, we propose two mechanisms to inject three precomputed word-level difficulty signals, GPT-2 surprisal, word frequency, and word length, into the per-fixation input: direct concatenation, LEXIC-Concat, and a residual mechanism, LEXIC-Res, where a small head predicts typical-reader gaze response and the encoder is conditioned on the deviation. On the OneStop reading comprehension task, with K=5 seed-ensemble training across ten folds, both mechanisms produce statistically consistent AUROC gains on Unseen Text, +1.8 to +2.2 percentage points, Wilcoxon p = 0.065. LEXIC-Concat additionally lifts Unseen Reader by +2.9 percentage points, p = 0.010. We trace an architectural boundary in LEXIC-Res on Unseen Reader, +1.8 percentage points, p = 0.19, to the prediction head being calibrated to training readers, transferring imperfectly to out-of-distribution readers.
34. 【2607.08143】ICDAR 2026 HIPE-OCRepair Competition on LLM-Assisted OCR Post-Correction for Historical Documents
链接：https://arxiv.org/abs/2607.08143
作者：Maud Ehrmann,Emanuela Boros,Juri Opitz,Andrianos Michail,Florian Wagner,Simon Clematide
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：ICDAR competition, OCR post-correction, OCR post-correction remains, OCR, LLM-assisted OCR post-correction
备注： 17 pages
点击查看摘要
Abstract:We present the results of HIPE-OCRepair-2026, an ICDAR competition on LLM-assisted OCR post-correction of historical documents. OCR post-correction remains a long-standing challenge in digital heritage: large-scale collections of digitized documents are affected by legacy OCR errors, while re-digitization at scale remains impractical. Large language models (LLMs) offers a major opportunity to revisit this challenge, yet their effectiveness across languages, document types, and noise conditions - and their tendency to hallucinate - remains insufficiently understood. HIPE-OCRepair-2026 pursues two objectives: (i) to evaluate the capabilities of modern OCR post-correction systems, and (ii) to provide a reproducible evaluation framework anchored in the HIPE-OCRepair-2026 dataset, a harmonized multilingual resource consolidating existing and newly curated historical datasets. Participants were tasked with correcting noisy OCR transcripts from historical newspapers and printed works in English, French, and German (17th-20th century), working at the level of coherent transcription units (paragraphs or articles) without access to source images. The evaluation adopts a retrieval-oriented rather than diplomatic scoring approach, reflecting the practical use case of search and access over digitized collections. Four teams submitted systems ranging from zero-shot prompting to continued pre-training and fine-tuning, offering insights into the merits of different adaptation strategies. Results show that modern LLM-assisted systems can significantly improve OCR quality, but performance varies across datasets, languages, and noise levels. Over-correction on low-noise inputs emerges as a recurring challenge, highlighting the importance of evaluation beyond character error reduction. The dataset, scorer, and evaluation pipeline are publicly released to support future research.
35. 【2607.08117】COALA: Robust Contextualized Speech-augmented Language Modeling for ASR via Contrastive Regularizer and Biasing Score Estimation
链接：https://arxiv.org/abs/2607.08117
作者：Jhih-Rong Guo,Bi-Cheng Yan,Tien-Hong Lo,Berlin Chen
类目：Computation and Language (cs.CL)
关键词：Contextualized ASR Leveraging, integrate external knowledge, accurately recognize domain-specific, automatic speech recognition, ASR Leveraging Biasing
备注： Accepted at INTERSPEECH 2026
点击查看摘要
Abstract:Contextual biasing seeks to integrate external knowledge into automatic speech recognition (ASR) systems to accurately recognize domain-specific entities. In this paper, we propose COALA (Contextualized ASR Leveraging Biasing Scoring), a robust framework designed to enhance speech-augmented language models (SLMs) in complex multi-entity scenarios. Considering the inherent context-window limitations of SLMs, identifying relevant target entities from a large-scale biasing list is crucial for effective recognition. To this end, COALA maps SLM latent representations into a specialized discriminative space to quantify the matching intensity between audio segments and candidate entities. Furthermore, we address the training collapse in prior study when handling multi-target utterances-where multiple rare words co-occur. Experimental results on the LibriSpeech benchmark demonstrate that COALA consistently achieves superior contextual biasing performance across various biasing list scales.
36. 【2607.08093】CausalDS: Benchmarking Causal Reasoning in Data-Science Agents
链接：https://arxiv.org/abs/2607.08093
作者：Andrej Leban,Yuekai Sun
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, Large language, combining abstract reasoning, integrated data-science agents, combining abstract
备注： 55 pages, 10 figures
点击查看摘要
Abstract:Large language models (LLMs) increasingly act as integrated data-science agents, combining abstract reasoning with advanced tool use. Yet the relevant benchmark landscape largely divides into symbolic causal reasoning benchmarks without realistic data analysis or data analysis benchmarks without a principled causal data-generating structure. Furthermore, existing causal evaluation datasets are often restricted to curated examples from existing sources, with diversity coming from limited templatized variations rather than from systematic generation of novel synthetic causal structures. We introduce CausalDS, a benchmark for evaluating causal reasoning in agentic data-science workflows. Each benchmark instance is a scene consisting of a sampled structural causal model (SCM) with generated observational data and an accompanying synthetic natural-language story grounded in a realistic domain. We optionally ground the composition of the benchmark components in empirical distributions obtained from real-world datasets, thus retaining empirical structure while reducing the "causal parrot" risk through completely synthetic generation. From each scene, we then derive tasks spanning all three of Pearl's rungs, with typical data-science prediction tasks appearing as Rung 1. Most tasks include a data science coding component, where the model typically needs to use several tools to arrive at the final answer due to the frequent presence of imperfect observations, which are generated by an observation model. Additionally, recognizing when a question admits no warranted answer and abstaining is treated as a first-class scored outcome. The benchmark thus jointly evaluates symbolic causal reasoning, data science, uncertainty quantification, abstention, and tool use/coding.
37. 【2607.08080】MASTE: A Multi-Agent Pipeline for Zero-Shot Aspect Sentiment Triplet Extraction
链接：https://arxiv.org/abs/2607.08080
作者：Ao Hong,Lehang Wang,Zhirun Yue,Mingxin Wang,Zihan Wang,Houde Liu
类目：Computation and Language (cs.CL)
关键词：requires jointly identifying, Sentiment Triplet Extraction, Aspect Sentiment Triplet, Triplet Extraction, Aspect Sentiment
备注：
点击查看摘要
Abstract:Aspect Sentiment Triplet Extraction (ASTE) requires jointly identifying (aspect, opinion, sentiment) triples from a given review sentence. While large language models (LLMs) achieve strong zero-shot performance on many NLP benchmarks, their effectiveness on ASTE remains limited, as single-pass generation forces the model to determine span boundaries, opinion grouping, and sentiment polarity in a single decoding step. Common remedies, such as few-shot in-context learning and chain-of-thought prompting, offer only marginal improvements and rely heavily on either in-domain demonstrations sampled from labeled training data or carefully engineered reasoning prompts, neither of which is broadly available in zero-shot deployment. Inspired by the classical agent paradigm, we propose MASTE, a multi-agent pipeline for zero-shot Aspect Sentiment Triplet Extraction. MASTE decomposes ASTE into four sequential stages, where specialized agents handle different compositional subtasks with explicit conditioning on prior outputs. This design enables entirely training-free zero-shot ASTE and generalizes across different backbones and datasets. Extensive experiments on four ASTE benchmarks show that MASTE substantially outperforms zero-shot and chain-of-thought LLM baselines under the same backbone, narrowing the gap to fully supervised methods without using any labeled triplets. Code is available at this https URL.
38. 【2607.08071】COBART: Controlled, Optimized, Bidirectional and Auto-Regressive Transformer for Ad Headline Generation
链接：https://arxiv.org/abs/2607.08071
作者：Yashal Shakti Kanungo,Gyanendra Das,Pooja A,Sumit Negi
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Online ads, core creative component, ads are essential, Online, creative component
备注： 10 pages, 5 figures, 5 tables. Published in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD '22). This is the author's accepted version; the definitive Version of Record is available at [this https URL](https://doi.org/10.1145/3534678.3539069)
点击查看摘要
Abstract:Online ads are essential to all businesses and ad headlines are one of their core creative component. Existing methods can generate headlines automatically and also optimize their click-through-rate (CTR) and quality. However, evolving ad formats and changing creative requirements make it difficult to generate optimized customized headlines. We propose a novel method that uses prefix control tokens along with BART fine-tuning. It yields the highest CTR and also allows users to control the length of generated headlines for use across different ad formats. The method is also flexible and can easily be adapted to other architectures, creative requirements and optimization criteria. Our experiments demonstrate a 25.82% increment in Rouge-L and a 5.82% increment in estimated CTR over previously published strong ad headline generation baseline.
39. 【2607.08063】Holographic Neural PCFG for Unsupervised Parsing
链接：https://arxiv.org/abs/2607.08063
作者：Ryosuke Yamaki,Daichi Mochihashi,Nobutaka Shimada,Tadahiro Taniguchi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：accurately induce latent, induce latent tree, constituency parsing aims, Unsupervised constituency parsing, latent tree structures
备注： Preprint under review
点击查看摘要
Abstract:Unsupervised constituency parsing aims to accurately induce latent tree structures from raw text alone. Recent neural parameterizations of PCFGs achieve strong performance in both supervised and unsupervised parsing, yet rely on high-capacity black-box networks for rule scoring -- as exemplified by the Neural PCFG family -- leaving rule probabilities without an interpretable mathematical form. In this paper, we propose Holographic Neural PCFG (Hol-PCFG), which recasts PCFG rule scoring as algebraic relation modeling among grammar-symbol embeddings. Hol-PCFG adapts Holographic Embeddings (Nickel et al., 2016), which scores knowledge-graph triples via circular correlation, to the left-child, right-child, and lexical-emission relations over torus-constrained embeddings, giving every rule probability a closed form that carries the intrinsic structure of grammar rules by construction. Hol-PCFG achieves state-of-the-art parsing performance in six languages while cutting rule-scoring parameters by 99.94% relative to the baseline model and training more stably. Additionally, we demonstrate that Hol-PCFG can parse Japanese directly from characters without any morphological segmentation, retaining nearly the same morpheme-level performance.
40. 【2607.08057】owards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
链接：https://arxiv.org/abs/2607.08057
作者：Jiantong Jiang,Peiyu Yang,Rui Zhang,Feng Liu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：large language models, systems remain memory-intensive, language models, memory-intensive and costly, rapid advancements
备注： Accepted to ACL 2026 as a Findings paper
点击查看摘要
Abstract:Despite the rapid advancements of large language models (LLMs), LLM serving systems remain memory-intensive and costly. The key-value (KV) cache, which stores KV tensors during autoregressive decoding, is crucial for enabling low-latency, high-throughput LLM inference serving. In this survey, we focus on system-aware KV infrastructure for serving LLMs (abbreviated as sKis). We revisit recent work from a system behavior perspective, organizing existing efforts into three dimensions: execution and scheduling (temporal), placement and migration (spatial), and representation and retention (structural). Furthermore, we analyze cross-behavior co-design affinity and behavior-objective links, highlighting future opportunities. Our work systematizes a rapidly evolving area, providing a foundation for understanding and innovating KV cache designs in modern LLM serving infrastructure.
41. 【2607.08046】What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulness
链接：https://arxiv.org/abs/2607.08046
作者：Raphaël Sarfati,Pratyush Ranjan Tiwari,Siddharth Boppana,Christopher J. Earls,Srikar Varadaraj,Eric Ho
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large language models, poorly calibrated, Large language, fine-tuned for forecasting, accurate yet poorly
备注：
点击查看摘要
Abstract:Large language models fine-tuned for forecasting can be accurate yet poorly calibrated, and their chain-of-thought (CoT) reasoning may not faithfully reflect the evidence behind a forecast. We ask whether internal representations offer a more direct window into both. Working with Eternis-Forecaster 8B on OpenForesight, we train representation-pooling probes on intermediate activations and find they achieve substantially better calibration; a result that also holds for GLM-4.7-Flash and GLM-4.5-Air. We then assess CoT faithfulness through evidence ablation and diversionary injection: removing an influential source in the prompt often changes the model's forecast while leaving the reasoning trace untouched. The same probes function as lie detectors: their activations track behavioral shifts far better than the reasoning trace does, and they also predict the direction of change in 84% of cases, including when the CoT conceals the perturbation's influence. Finally, forced answering reveals that forecasts are largely fixed before reasoning begins: a single pre-reasoning pass recovers the committed answer and confidence, and routing questions by the spread of this pre-set answer distribution saves 30-47% of generated tokens, with no loss of accuracy. Together, these results establish probing internal representations as a practical tool for calibrating, auditing, and triaging language model forecasters and reasoning models more broadly.
42. 【2607.08034】PLURAL: A Global Dataset for Value Alignment
链接：https://arxiv.org/abs/2607.08034
作者：Dhruv Agarwal,Anya Shukla,Tanya Goyal,Aditya Vashistha
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Computers and Society (cs.CY)
关键词：Large language models, disproportionately reflect Western, Large language, reflect Western, language models
备注：
点击查看摘要
Abstract:Large language models (LLMs) are used worldwide, yet disproportionately reflect Western values, limiting their ability to represent diverse value systems. We introduce PLURAL, a large-scale, value-focused preference dataset grounded in the Integrated Values Survey (IVS), a nationally representative survey spanning 92 countries. Using a two-stage generation pipeline, we transform survey responses into synthetic preference triplets that preserve normative value signals while producing realistic scenarios. We release an initial version of PLURAL containing ~500,000 preference triplets representing people in 20 diverse countries. We evaluate PLURAL in three ways: (i) dataset-level validation showing that it preserves both cross-country value differences and within-country diversity from the original survey; (ii) automated evaluation showing that training on PLURAL improves alignment with target countries' cultural profiles, reducing mean absolute error by up to 27.7% relative to strong baselines; and (iii) blind human evaluation with 176 evaluators in India, Brazil, and Japan, who judge PLURAL-aligned responses as more representative of their national values. Together, these results show that PLURAL contains learnable signal for value steering, offering a scalable resource for pluralistic alignment. Dataset: this https URL
43. 【2607.08028】From Prompts to Contracts: Harness Engineering for Auditable Enterprise LLM Agents
链接：https://arxiv.org/abs/2607.08028
作者：Joongho Ahn,Moonsoo Kim
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Software Engineering (cs.SE)
关键词：Enterprise large language, Enterprise large, large language model, retrieval context, large language
备注： 32 pages, 6 figures, 16 tables. Reference implementation and evaluation artifacts: [this https URL](https://github.com/hammerbaki/enterprise-llm-agent-harness) (archived at [this https URL](https://doi.org/10.5281/zenodo.21269426) )
点击查看摘要
Abstract:Enterprise large language model (LLM) applications often begin as prototypes whose behavior is carried by prompts and retrieval context. Productization adds requirements for source boundaries, entity routing, answer contracts, and reproducible traces. We present a harness-engineering approach that reconstructs this pattern into a traceable, auditable LLM-agent architecture: deterministic behavior moves into code, manifests, schemas, and validation artifacts around a replaceable composition boundary, while source-backed claims remain the authority for runtime answers. We instantiate it on a public-data slice of five Korean corporate groups (25 listed companies) and evaluate three research questions. (1) The harness preserves its source-grounding, entity-routing, trace, output-hygiene, and recommendation-language contracts across the fixed validation scenarios; a fault-injection control confirms the validators flag deliberately broken contracts. (2) The checks the harness enforces held under model substitution: across three hosted models, they passed on all 270 composition-boundary runs; failures were confined to the model-composed side and were caught and recorded. (3) The code-owned guarantees are load-bearing, not reproducible by prompting alone: holding the model fixed and varying only the enforcement layer, prompt instructions alone let recommendation-language and internal-trace-leakage violations reach the reader, which the harness blocks entirely. A bolt-on external guardrail prevents such violations too but over-refuses, dropping utility to 88/120 where the harness preserves full utility (120/120); in this ablation, only code-owned enforcement preserves both safety and utility. The result is a reusable engineering pattern for turning exploratory prototypes into auditable applications with versioned source, control, and validation artifacts.
44. 【2607.08027】Structured Pruning of Large Language Models via Power Transformation and Sign-Preserving Score Aggregation with Adaptive Feature Retention
链接：https://arxiv.org/abs/2607.08027
作者：Ryota Kobayashi,Tsubasa Hirakawa,Takayoshi Yamashita,Hironobu Fujiyoshi,Yasunori Ishii,Tomoyuki Okuno,Kazuki Kozuka
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Adaptive Feature Retention, adapting Adaptive Feature, Feature Retention, large language models, Adaptive Feature
备注：
点击查看摘要
Abstract:This paper proposes an improved structured pruning method for large language models (LLMs) that addresses key challenges in adapting Adaptive Feature Retention (AFR), an unstructured pruning technique, to structured pruning. When applying AFR to structured pruning, three major problems arise: distribution mismatch between heterogeneous pruning scores, loss of sign information indicating optimization direction consistency, and influence of outliers. To address these issues, we propose a unified approach combining power transformation for nonlinear distribution alignment, sign-preserving score aggregation, and percentile-based outlier removal. Experiments on Llama-3-8B, Vicuna-v1.5-13B, and LLaVA-v1.5-13B demonstrate that our method maintains accuracy comparable to unstructured pruning while achieving practical inference speedup through structured pruning.
45. 【2607.08017】Can We Trust LLM's Logic? Quantifying Uncertainty, Coherence, and Robustness via a Graph-Based Framework
链接：https://arxiv.org/abs/2607.08017
作者：Riccardo Revalor,Jalees Rehman,Debjit Pal
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：fail to detect, intermediate steps, reasoning, prone to flawed, evaluate only final-answer
备注： 42 pages, 14 figures, 12 tables
点击查看摘要
Abstract:Large-Language Models (LLMs) can be prone to flawed and unfaithful reasoning that decoding strategies like Self-Consistency (SC) fail to detect as they evaluate only final-answer agreement while ignoring the logical validity of intermediate steps. This raises three fundamental questions: How can we reliably quantify uncertainty in LLM reasoning? Can semantic, structural, and causal awareness select more faithful reasoning compared to naïve majority voting? and How robust is reasoning topology under adversarial conditions? To address these questions, we introduce GRAPHEVAL, a graph-based reasoning framework that re-frames uncertainty quantification (UQ) as a holistic reasoning fidelity problem. We propose a novel UQ metric, Graph Reasoning Coherence Score (GRCS), that quantifies semantic-structural consensus of the reasoning space and captures pathological mode collapse and confident hallucinations. We find that GRCS is the only metric that is consistently negatively correlated with reasoning faithfulness across both more capable and smaller models. Additionally, we introduce Graph Self-Consistency (GSC), a medoid-based decoding strategy that trades nominal accuracy for reasoning fidelity, exposing the degree to which SC is inflated by unfaithful lucky guesses in smaller models, while preserving or improving accuracy in more capable ones. Finally, through adversarial medoid ablation, we demonstrate that the GSC-selected path acts as a "load-bearing path" and forcing models away from it degrades reasoning faithfulness and, in targeted cases, causes drops in accuracy.
46. 【2607.08010】ool-Making and Self-Evolving LLM Agents in Low-Latency Systems
链接：https://arxiv.org/abs/2607.08010
作者：Kalle Kujanpää,Ning Liu,Shahnawaz Alam,Yeshwanth Reddy Sura,Tianyu Yang,Kristina Klinkner,Shervin Malmasi
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Software Engineering (cs.SE)
关键词：reliability by regenerating, procedural steps, repeated SOP steps, regenerating code, tools
备注： Preprint
点击查看摘要
Abstract:Production LLM agents often waste latency and reliability by regenerating code for the same procedural steps on every request. We replace this inference-time coding loop with an agentic tool-making pipeline that compiles repeated SOP steps into validated, versioned tools before deployment. The tool-maker grounds synthesis in the live environment as it collects execution traces, observes backend schemas and values, generates candidate tools, and repairs them against labeled cases. At runtime, the production agent calls these tools directly and falls back to code generation only when needed. We deploy the approach in a Fulfillment Center alarm-triage system, where an agent diagnoses alarms against a 44-node SOP over heterogeneous metric backends. In production, tool calls reduce p50 latency by 42%. On 1,500 historical alarms, they reduce end-to-end error rate by up to 53% by suppressing run-to-run variance in repeated steps. Because tools return compact structured verdicts, they also enable a simpler direct-call architecture, reducing p50 latency by a further 62% in a controlled ablation. Versioned tools also improve auditability and expose specification gaps and upstream data drift. Our results show that self-evolving agents can make industrial LLM systems faster, more reliable, and easier to operate.
47. 【2607.08009】From Execution to Education: A Bloom-Aligned Framework for Measuring Educational Control in LLMs
链接：https://arxiv.org/abs/2607.08009
作者：Yi Zhang,Julia Rayz
类目：Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Large Language Models, Large Language, task instructional intent, Language Models, learning objectives
备注： 24 pages, 20 figures
点击查看摘要
Abstract:We introduce a Bloom-aligned framework for measuring educational control in Large Language Models (LLMs): the ability to preserve a task's instructional intent while shifting its cognitive demand toward specified learning objectives. We apply this framework to programming tasks in computer science education to study the gap between solving tasks and adapting them for learners. Using revised Bloom's Taxonomy as an operational scale of cognitive demand, we evaluate two intervention settings: general difficulty control, where models are asked to make tasks harder or easier, and Bloom's control, where models are asked to target higher or lower Bloom's levels. We evaluate a matched Qwen3-Next model pair, comparing Qwen3-Next-80B-A3B-Instruct with Qwen3-Coder-Next across 2,520 tasks from three benchmarks. The framework reveals a robust directional asymmetry: both models reliably increase cognitive demand, but struggle to lower it. We further characterize these outcomes with semantic-delta clustering and layer-wise Fisher's Discriminant Ratio probing. Within this controlled comparison, the general model shows clearer middle-layer separability for both general difficulty and Bloom-control contrasts, whereas the coder model shows weaker separability for general difficulty and a deeper peak for Bloom-control contrasts. These results show that strong execution performance does not automatically entail Bloom-aligned educational control.
48. 【2607.07993】Hallucination Self-Play: Bootstrapping Reinforced Detector via Evolved Generator
链接：https://arxiv.org/abs/2607.07993
作者：Shiping Yang,Shining Liang,Weihao Liu,Wenbiao Ding,Linjun Shou,Lu Cheng,Angel X. Chang
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：remains challenging due, Identifying faithfulness hallucinations, high-quality annotated data, LLM-generated outputs remains, outputs remains challenging
备注： Accepted to COLM 2026. Camera-ready version to appear
点击查看摘要
Abstract:Identifying faithfulness hallucinations in LLM-generated outputs remains challenging due to the scarcity of high-quality annotated data. Recent work relies on advanced LLMs to synthesize training data, including rationales, labels, and hallucinated claims. However, these methods treat the generator as a static component, limiting iterative improvement of the detector. To address this limitation, we introduce Hallucination Self-Play (HSP), a novel framework that enables the detector to bootstrap with an evolved generator. HSP involves two roles initialized from the same base model, a detector that assesses the faithfulness of model outputs, and a generator that produces increasingly hard-to-detect hallucinated responses. Specifically, the detector is first fine-tuned on human-labeled data and then employed as a reward model to train the generator via reinforcement learning from AI feedback (RLAIF). In turn, the evolved generator synthesizes hallucination data to further optimize the detector through rule-based reinforcement learning. Experiments on RAGTruth benchmark and two model families demonstrate that the proposed framework can progressively enhance a small LLM to match or even outperform advanced LLMs without external supervision. Our code is available at this https URL .
49. 【2607.07985】A Reliability Assessment of LALM Audio Judges for Full-Duplex Voice Agents
链接：https://arxiv.org/abs/2607.07985
作者：A. Sayyad,J. Emmons,S. Jones,T. Lin,H. Krishnan
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Sound (cs.SD); Audio and Speech Processing (eess.AS)
关键词：raw stereo waveform, score full-duplex agent, agent conversations directly, full-duplex agent conversations, Flash
备注： 28 pages total (12 main body, 1 reference, 15 appendix). In main body: 2 diagrams, 3 table, 2 charts
点击查看摘要
Abstract:We report the empirical reliability of Gemini models as audio judges that score full-duplex agent conversations directly from the raw stereo waveform, tested across three models in the Gemini family: 2.5 Flash, 3.5 Flash, and 3.1 Pro. Our primary evidence base uses Gemini 2.5 Flash as the ground-truth model, validated against three calibrated human raters on 209 stereo sessions, scored on 8 production dimensions: 152 full-duplex conversations across 13 accent-and-condition strata, together with 57 adversarial defect-injected clips. The evidence for Gemini 2.5 Flash is consistent across three tests. (i) On 5 of 8 dimensions the LALM-human Spearman rho departs from the pairwise human-human rho by at most 0.07, and on 7 of 8 dimensions the two quantities 95 percent bootstrap confidence intervals overlap. (ii) The LALM agrees with the three-rater human mean within 1 point on 60 to 92 percent of sessions on 6 of 8 dimensions. (iii) On 45 of 48 (defect, dimension) cells the LALM is as sensitive as humans or better under Newcombe-Wilson 95 percent confidence intervals, though most of these are underpowered nulls rather than demonstrated parity. Rank-ordering ability transfers across the Gemini family: 3.5 Flash improves simple agreement to 8 of 8 dimensions, while 3.1 Pro rates several dimensions markedly lower than humans despite comparable rank correlation. A model swap should be re-validated on calibration specifically, not assumed from rank-correlation alone. We identify four areas where deployment requires care, and we estimate that human rating alone for our current evaluation cadence costs roughly two orders of magnitude more than the equivalent LALM workload. The data presented here provides a defensible empirical basis for deploying the LALM as a substitute or fourth rater on the dimensions where the evidence supports it.
50. 【2607.07976】When Implausible Tokens Get Reinforced: Tail-Aware Credit Calibration for LLM Reinforcement Learning
链接：https://arxiv.org/abs/2607.07976
作者：Xiuyi Lou,Zicheng Xu,Yu-Neng Chuang,Hoang Anh Duy Le,Zhaozhuo Xu,Guanchu Wang,Vladimir Braverman
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：large language models, achieved remarkable success, language models, achieved remarkable, remarkable success
备注：
点击查看摘要
Abstract:Reinforcement learning (RL) has achieved remarkable success in enhancing the reasoning capabilities of large language models (LLMs). However, widely used critic-free RL methods rely on uniform credit assignment, broadcasting the same advantage to all tokens regardless of their differences. We identify a critical failure mode of this design, which we refer to as Positive-Credit Contamination: low-probability tail tokens that are contextually erroneous receive identical positive credit to plausible ones within the same trajectory, resulting in the indiscriminate reinforcement of flawed reasoning behavior. To mitigate this issue, we propose Tail-Aware Credit calibratiOn (TACO), a method that calibrates uniform credit assignment to suppress undesirable positive updates. TACO first computes a tail-risk score that incorporates the local generation context to assess each token's risk of falling into the unreliable tail, distinguishing unexpected rarity from uncertainty-driven exploration. TACO then uses this score to tune positive credit for risky tokens without removing their gradients entirely, so that recurring useful rare patterns can accumulate reinforcement while incidental noise is progressively dampened. Experimental results across three LLMs and eight benchmarks show that TACO consistently outperforms GRPO-style baselines. Notably, TACO improves training stability, supporting sustained performance gains in long-horizon RL. The source code is available at: this https URL.
51. 【2607.07974】A Multi-cluster Boundary Learning Method for Out-of-Scope Intent Detection via MiniLM Embedding
链接：https://arxiv.org/abs/2607.07974
作者：Yihong Xu,Mingyu Kang,Linyuan Lü
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：human-machine interaction systems, OOS intent detection, bridges human intents, OOS intent, OOS intents
备注： To submit
点击查看摘要
Abstract:Intent detection is a critical task that bridges human intents and system actions in human-machine interaction systems. However, there still exist challenges for detecting out-of-scope (OOS) intents. (i) The traditional methods view the OOS intent detection as a multi-class classification, then the detection accuracy decreases as the class number of the known intents increases; (ii) LLM-embedding methods require large parameters, that makes them difficult to train and practically deploy. Thus, this work proposes a multi-cluster boundary learning method to detect OOS intents via MiniLM embedding (i.e., all-MiniLM-L6-v2) in an one-class classification workflow. The method learns the boundaries of multi-cluster embeddings generated by MiniLM from the training utterances, and then rejects the out-of-domain utterances as OOS intents. Experiments are conducted on public CLINC150, StackOverflow and Banking77 datasets. The results show that the method achieves the state-of-the-art OOS intent detection performance compared the other baselines. Ablation studies are also conducted and the results show that the used MiniLM can better adapt to the workflow and utterance embedding requirements. The code is available at supplementary materials.
52. 【2607.07952】fog: Expressing Motion and Emotion through Function Composition of AI-Generated Code
链接：https://arxiv.org/abs/2607.07952
作者：Vivian Liu,Lydia Chilton
类目：Human-Computer Interaction (cs.HC); Computation and Language (cs.CL)
关键词：expressive behavior, parts of intelligent, core parts, Motion, fog
备注：
点击查看摘要
Abstract:Motion and emotion are core parts of intelligent, expressive behavior. In this paper, we introduce fog, a function composition framework for implementing and compose motion functions. We demonstrate how fog can be used to express motion and emotion in Heider-Simmel style animations. This code generation framework can help users generate functions for verbs, adverbs, gestures, and emotions to create an open-ended motion vocabulary. It is complemented by an animation editor that helps users refine motion through direct manipulation and dynamically generated UI. We evaluate our approach with a perceptual evaluation, where we test 452 fog-generated animations to see if people can recognize the semantic meaning of the motion. We find that fog's motion functions can be recognized at 68% accuracy, a 2.68x improvement over a chance baseline. In a mixed-methods user study with professionals and novices, we show that fog in interface form can support users with more rapid iteration, exploration, and control.
53. 【2607.07944】he Memory Wall of Green Software: Empirical Energy Evaluation of Memento Design Pattern
链接：https://arxiv.org/abs/2607.07944
作者：Imane Jriri,Tarik Houichime,Younes El Amrani
类目：oftware Engineering (cs.SE); Computation and Language (cs.CL)
关键词：Software Engineering matures, Green Software Engineering, mission-critical non-functional requirement, Engineering matures, Software Engineering
备注：
点击查看摘要
Abstract:As Green Software Engineering matures, energy efficiency has transitioned into a mission-critical non-functional requirement. While software design patterns ensure structural integrity, their inherent abstraction layers impose an implicit "metabolic cost" that often remains obscured during the design phase. This paper empirically investigates the energy dynamics of the Memento design pattern, contrasting a direct, unabstracted baseline against Classic full-snapshot and Differential delta-encoding strategies. Leveraging the RAPL interface for high-fidelity hardware telemetry, we quantify energy dissipation across state volumes scaling from 10 MB to 200 MB. Our empirical results expose a critical architectural trade-off: the Differential strategy minimizes memory traffic, yielding a maximum energy reduction of 65.8% for mid-scale states, but collides with a catastrophic "memory wall" at 200 MB. At this saturation point, algorithmic optimizations are completely neutralized by severe GC thrashing and non-linear power spikes. We synthesize these findings into evidence-based heuristics, providing architects with a robust framework to reconcile structural design quality with sustainable Green IT imperatives.
54. 【2607.07937】When Debiasing Backfires: Counterintuitive Side Effects of Preprocessing-Based Stereotype Mitigation
链接：https://arxiv.org/abs/2607.07937
作者：Yahan Zheng,John Guerrerio,Soroush Vosoughi,Weicheng Ma
类目：Computation and Language (cs.CL)
关键词：Preprocessing-based methods, debiased corpora, Preprocessing-based, NLP, reduce measurable stereotypes
备注： Published in ACL 2026 Findings
点击查看摘要
Abstract:Preprocessing-based methods for stereotype mitigation, such as pre-/post-training on debiased corpora, are widely used in NLP. While these approaches reduce measurable stereotypes for targeted groups, we find they often induce unintended shifts-side effects, where stereotyping or counter-stereotyping can increase relative to neutral baselines for other demographics, including across unrelated demographic categories. We demonstrate these side effects across two model families (encoder-only and decoder-only), multiple preprocessing strategies (removing stereotypical sentences, removing group mentions, and swapping group references), and both pre- and post-training at different data scales on Wikipedia. Standard benchmarks frequently miss these shifts. Using attention-rollout analysis, we observe that such side effects are not accompanied by large changes in attention flow, complicating mechanistic explanations. We discuss implications for evaluation, provide actionable diagnostics, and argue for side-effect-aware, transparent mitigation practices.
55. 【2607.07918】Efficient Safety Alignment of Language Models via Latent Personality Traits
链接：https://arxiv.org/abs/2607.07918
作者：Mohamed Amine Merzouk,Nolan Smyth,Damiano Fornasiere,Linh Le,David Williams-King,Adam Oberman
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：Current safety methods, Current safety, large language models, motivating research, robust alternatives
备注： 15 pages, 6 figures. Accepted at COLM 2026
点击查看摘要
Abstract:Current safety methods for large language models are known to be vulnerable to adversarial attacks, motivating research into robust alternatives. Latent Adversarial Training (LAT) is among the most effective defenses, but can degrade utility and requires training on large datasets of harmful prompts. We introduce Latent Personality Alignment (LPA), which replaces explicit harm refusal with adversarial training on just 66 harm-agnostic statements drawn from psychometric personality literature. We hypothesize that personality-anchored representations share latent structure with harm avoidance, so adversarially stabilizing them implicitly constrains the subspace exploited by jailbreak attacks. LPA achieves near-zero attack success rates on HarmBench across direct requests and five jailbreak methods, despite never seeing harmful content during training and no loss of performance on standard benchmarks. Moreover, the training process is lightweight; the entire procedure completes in minutes on a single GPU and uses 75x fewer examples than standard LAT. Extensive ablations demonstrate the robustness, efficiency, and generalization of our method.
56. 【2607.07915】Validating LLMs in social science: Epistemic threats and emerging norms
链接：https://arxiv.org/abs/2607.07915
作者：Meera Desai,Dallas Card,Abigail Z. Jacobs
类目：Computers and Society (cs.CY); Computation and Language (cs.CL)
关键词：Large language models, Large language, language models, Large, prompt language models
备注： 28 pages, 2 figures. Main text: 11 pages, Appendix: 11 pages, References: 6 pages
点击查看摘要
Abstract:Large language models (LLMs) are reshaping social science methodology. Researchers increasingly prompt language models to generate quantitative measurements of social concepts, for example labeling data or simulating survey responses. Yet LLMs pose methodological challenges including bias, hallucination, and brittleness across contexts, with unclear threats to validity. Standard practices and norms for addressing these challenges are still emerging. We collect and systematically analyze validation practices in a comprehensive corpus of papers from eight flagship social science journals that use LLMs as measurement instruments. We find that LLM-generated measurements frequently play a central role in empirical analyses, yet validation practices are inconsistent and limited. We outline complementary strategies for more robust validation, pointing toward better norms and standards around the use of LLMs in social science.
57. 【2607.07907】Multimodal Unlearning Across Vision, Language, Video, and Audio: Survey of Methods, Datasets, and Benchmarks
链接：https://arxiv.org/abs/2607.07907
作者：Nobin Sarwar,Shubhashis Roy Dipta,Zheyuan Liu,Vaidehi Patil
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Cryptography and Security (cs.CR); Multimedia (cs.MM)
关键词：inadvertently encode sensitive, unsafe cross-modal associations, adoption of VLMs, encode sensitive, training data
备注： Accepted to ACL Findings 2026
点击查看摘要
Abstract:With the growing adoption of VLMs, DMs, LLMs, and AFMs, these multimodal foundation models can inadvertently encode sensitive, copyrighted, biased, or unsafe cross-modal associations that originate from their training data. Retraining after deletion requests or policy updates is often impractical, and targeted forgetting remains difficult because knowledge is distributed across shared representations. Multimodal unlearning addresses this challenge by enabling selective removal across modalities while retaining overall utility. This survey offers a unified, system-oriented view of multimodal unlearning across vision, language, audio, and video, grounded in recent advances, emerging applications, and open problems. Our taxonomy enables systematic comparison across model architectures and modalities, clarifying trade-offs among deletion strength, retention, efficiency, reversibility, and robustness. This survey highlights open problems and practical considerations to support future research and deployment of multimodal unlearning. We release a curated repository: this https URL
58. 【2607.07895】Scalable and Culturally Specific Stereotype Dataset Construction via Human-LLM Collaboration
链接：https://arxiv.org/abs/2607.07895
作者：Weicheng Ma,John Guerrerio,Soroush Vosoughi
类目：Computation and Language (cs.CL)
关键词：English-speaking contexts, focused on English-speaking, large language models, underrepresented cultures, largely focused
备注： Weicheng Ma, John Guerrerio: equal contribution; published in EMNLP 2025 Main
点击查看摘要
Abstract:Research on stereotypes in large language models (LLMs) has largely focused on English-speaking contexts, due to the lack of datasets in other languages and the high cost of manual annotation in underrepresented cultures. To address this gap, we introduce a cost-efficient human-LLM collaborative annotation framework and apply it to construct EspanStereo, a Spanish-language stereotype dataset spanning multiple Spanish-speaking countries across Europe and Latin America. EspanStereo captures both well-documented stereotypes from prior literature and culturally specific biases absent from English-centric resources. Using LLMs to generate candidate stereotypes and in-culture annotators to validate them, we demonstrate the framework's effectiveness in identifying nuanced, region-specific biases. Our evaluation of Spanish-supporting LLMs using EspanStereo reveals significant variation in stereotypical behavior across countries, highlighting the need for more culturally grounded assessments. Beyond Spanish, our framework is adaptable to other languages and regions, offering a scalable path toward multilingual stereotype benchmarks. This work broadens the scope of stereotype analysis in LLMs and lays the groundwork for comprehensive cross-cultural bias evaluation.
59. 【2607.07891】How Do I Know What to Say Next? Barenholtz's Autogenerative Theory as an Enrichment of Harrisean Integrationism
链接：https://arxiv.org/abs/2607.07891
作者：J. Mark Bishop,Stephen J. Cowley
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Roy Harris Integrationist, Harris Integrationist linguistics, Integrationist linguistics offers, referentialist tradition embedded, tradition embedded deep
备注： Submitted to Philosophy and Technology
点击查看摘要
Abstract:Roy Harris's Integrationist linguistics offers a compelling critique of the referentialist tradition embedded deep at the heart of computational approaches to language, arguing that language is not a code that maps onto a pre-given world but a situated, bipartite activity oriented toward prospective joint action. Yet Integrationism leaves certain explanatory gaps: it does not fully account for the structural mechanism by which signs sustain prospective openness, it undertheorises the continuity between linguistic and non-linguistic semiotic activity, and it offers no detailed account of the structural properties of the accumulated archive of past integrations. This paper argues that Elan Barenholtz's autogenerative theory of language, developed in response to the behaviour of Large Language Models (LLMs), can fill precisely these gaps, enriching Integrationism without undermining any of its core commitments. Specifically, the autogenerative account provides: a structural mechanism for the prospective openness that Harris identifies as central to bipartite communication; a computational correlate for Harris's thesis of semiotic continuity between language and other sign-making activity; and a theory of the archive: what the accumulated residue of past integrations looks like and how new participants draw upon it. The synthesis preserves Harris's ontological primacy of the situated integrative act while adding explanatory content that Integrationism itself does not supply. For practitioners and researchers in natural language processing and large language model design, the argument offers a principled account of what the statistical structure that LLMs so effectively exploit actually is, and of what it cannot, by its nature, provide.
60. 【2607.07820】DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environment
链接：https://arxiv.org/abs/2607.07820
作者：Xinyu Geng,Xuanhua He,Sixiang Chen,Yanjing Xiao,Fan Zhang,Shijue Huang,Haitao Mi,Zhenwen Liang,Tianqing Fang,Yi R. Fung
类目：Computation and Language (cs.CL)
关键词：experience remains challenging, fixed teacher-distilled trajectories, sparse-reward reinforcement learning, supervised fine-tuning relies, remains challenging
备注：
点击查看摘要
Abstract:Training tool-use agents to improve from their own experience remains challenging, as supervised fine-tuning relies on fixed teacher-distilled trajectories, while sparse-reward reinforcement learning provides weak supervision for long-horizon interactions. We present DeepSearch-Evolve, a self-distillation framework for web agents built on DeepSearch-World, a deterministic and verifiable environment with reproducible search and page-reading tools. DeepSearch-World contains 420K multi-hop QA tasks constructed from entity-level random walks and supports key agentic cognitive behaviors useful for self-evolving, including progress verification, grounded reflection, and failure recovery. DeepSearch-Evolve iteratively performs trajectory generation, filtering, data mixing, and fine-tuning to train stronger agents. Without distillation from more capable models, DeepSearch-World-9B achieves competitive performance compared with open-source agents, reaching 31.2% on BrowseComp, 61.5% on GAIA, and 93.4% on HotpotQA, showing that verifiable environments enable scalable self-evolution for long-horizon web agents. We will release the environment, 420K training pool, validation set, model, and code to facilitate future research on self-improving deep search agents.
61. 【2607.07779】From Solvers to Research: Large Language Model-Driven Formal Mathematics at the Research Frontier
链接：https://arxiv.org/abs/2607.07779
作者：Eric Jiang,Xiao Liang,Yikai Zhang,Yingjia Wan,Mengting Li,Haikang Deng,Alexander K. Taylor,Justin Baker,Rushil Raghavan,Junyi Zhang,Ying Nian Wu,Andrea L. Bertozzi,Kai-Wei Chang,Raghu Meka,Matthew Sottile,Nanyun Peng,Amit Sahai,Terence Tao,Wei Wang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：Large Language Model, Interactive Theorem Proving, driven theorem provers, Language Model, achieved remarkable success
备注：
点击查看摘要
Abstract:Recent developments in AI for Mathematics (AI4Math), especially Large Language Model (LLM)-driven theorem provers, has achieved remarkable success in formal proof generation for well-defined mathematical problems through Interactive Theorem Proving (ITP) languages. However, current systems remain fundamentally limited in tackling frontier research mathematics, such as discovering new theorems or resolving open conjectures, which are often open-ended, under-specified, and involve multiple layers of abstraction. We argue that the next leap in AI4Math systems requires a decisive shift from predefined problem-solvers to research agents that can address frontier mathematical challenges with rigorous formal mathematical reasoning. In this position paper, we provide a systematic review of the field, covering datasets, auto-formalization, and proof synthesis. More importantly, we identify core limitations of existing systems in serving as mathematical research agents, examining issues across datasets, relational structure, mathematical exploration, tool ecosystem, and human-AI collaboration, outlining a strategic road-map for the future of AI4Math.
62. 【2607.07772】Unveiling Public Opinion: A Study of Sentiment Analysis Using LSTM and Traditional Models
链接：https://arxiv.org/abs/2607.07772
作者：Atiq Ur Rehman
类目：Computation and Language (cs.CL)
关键词：social media, real time, age of social, meeting places, places for people
备注： 6 pages, 5 figures. Published in the Proceedings of the 2025 IEEE Conference on Computing, Communication, and Data Engineering (C-CODE 2025)
点击查看摘要
Abstract:In this age of social media, sites like Twitter have become meeting places for people to share their views and feelings on a wide range of issues and current events as they unfold in real time. Sentiment analysis, a critical application of NLP, has become indispensable due to the massive influx of user-generated content, enabling the extraction of meaningful insights from the opinions and emotions expressed in textual data. Sentiment analysis on Twitter employs sophisticated computational techniques to categorize tweets into positive, negative, or neutral sentiments. This method not only examines individual expressions but also analyzes vast databases related to specific subjects or events. By spotting these emotions, machine learning models help improve public opinion interpretation and trend forecasting. This paper examines the effectiveness of various machine learning and deep learning approaches. Designed for this use, the system evaluates logistic regression, random forest, naïve bayes, gradient boosting, and LSTM networks, among other algorithms applied in sentiment classification. This work identifies the optimal sentiment analysis model using a Kaggle Twitter dataset that has been preprocessed through tokenization, lemmatization, and stopword elimination. Emphasizing the better performance of the LSTM approach, the model attained a training accuracy of 90.98%, a testing accuracy of 80.00%, and a micro-average ROC- AUC score of 0.92. These results show that the model outperforms conventional machine learning techniques in capturing contextual and sequential textual aspects.
63. 【2607.07729】Collective Intelligence with Foundation Models
链接：https://arxiv.org/abs/2607.07729
作者：J. de Curtò,I. de Zarzà
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：foundation models grow, cooperative reasoning systems, reasoning systems offers, path toward safer, grow in scale
备注： Accepted as a book chapter in "Advances in Global Applied Artificial Intelligence" (G. A. Tsihrintzis, M. Virvou, N. G. Bourbakis, L. C. Jain, Eds.), authenticated version will be published in Springer series: Learning and Analytics in Intelligent Systems
点击查看摘要
Abstract:As foundation models grow in scale and diversity, coordinating multiple models into cooperative reasoning systems offers a path toward safer, more reliable AI. This chapter presents a multi-agent framework where solver models generate independent drafts, each undergoes structured critique and revision by a critic agent, and an aggregator agent synthesizes a final consensus solution. A scoring module provides semantic, numerical, and procedural evaluation across all agents. Through ablation studies on a benchmark spanning calculus, physics, chemistry, biology, economics, optimization, statistics, and mathematics, we isolate the contributions of framework architecture versus model diversity. We compare four configurations: (1) Individual Baseline, (2) Homogeneous Framework using one shared model, (3) Redundant Homogeneous Solvers using multiple instances of the same model, and (4) Heterogeneous Framework with diverse specialized models. Results show that while framework structure and redundant sampling yield modest gains, model heterogeneity is the critical factor driving substantial performance improvements. The heterogeneous configuration achieves superior step-wise accuracy (0.64 vs. 0.54 for individual models; 2.3x improvement over homogeneous configurations) with reduced variance across categories and difficulty levels. Step-wise reasoning quality (correctness of intermediate steps, not just final answers) improves dramatically only with model diversity, showing that heterogeneous agents provide complementary error detection and reasoning refinement essential for explainability and auditability. We discuss architectural principles, evaluation methodology, and implications for Global Applied AI, showing how heterogeneous multi-agent coordination supports transparent, auditable, high-confidence decision-making across scientific and industrial domains.
64. 【2607.07727】SPL: Orchestrating Workflows with Declarative Deterministic-Probabilistic Composition
链接：https://arxiv.org/abs/2607.07727
作者：Wen G. Gong
类目：Programming Languages (cs.PL); Computation and Language (cs.CL)
关键词：Structured Prompt Language, Structured Prompt, Prompt Language, probabilistic computation, present SPL
备注： 24 pages, 2 figures, under review at TMLR
点击查看摘要
Abstract:We present SPL (Structured Prompt Language), a declarative language that composes deterministic and probabilistic computation modes in a single specification. While existing frameworks separate these -- orchestration systems (AutoGen, CrewAI, LangGraph) for LLM calls, symbolic tools (SymPy, SageMath, Lean) for computation -- SPL unifies them. It provides GENERATE/EVALUATE for probabilistic computation and SOLVE/ASSERT for deterministic computation, sharing syntax, variable bindings, and runtime routing. A .spl specification runs unchanged across local nodes (Ollama), cloud APIs (OpenRouter, Anthropic), and distributed grids (Momagrid), with model and verifier selection deferred to invocation time. We validate SPL through an extensive 78-recipe cookbook and a controlled 1,200-run experiment (10 models x 20 problems x 2 arms x 3 repetitions; the 20 problems span 6 difficulty tiers). The solver arm achieves 82-93% machine-verified correctness (sonnet-4-6: 85%, gemma4:e2b: 93%) while the LLM-only arm measures output production without mathematical verification, making the comparison one of verified correctness against unverified fluency. A backend difficulty gradient emerges (SymPy 78%, Sage 54%), and the dominant failure mode is solver_error (kernel-rejected expressions), not format non-compliance.
Comments:
24 pages, 2 figures, under review at TMLR
Subjects:
Programming Languages (cs.PL); Computation and Language (cs.CL)
Cite as:
arXiv:2607.07727 [cs.PL]
(or
arXiv:2607.07727v1 [cs.PL] for this version)
https://doi.org/10.48550/arXiv.2607.07727
Focus to learn more
arXiv-issued DOI via DataCite</p>
65. 【2607.07724】Uncertainty-gated selection for block-sparse attention
链接：https://arxiv.org/abs/2607.07724
作者：Thomas Rossi
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Block-sparse attention scales, attention scales long-context, scales long-context language, per-query top-k selection, long-context language models
备注：
点击查看摘要
Abstract:Block-sparse attention scales long-context language models by replacing the O(N^2) softmax with a per-query top-k selection over key blocks. This cutoff is myopic: when the k-th and (k+1)-th blocks are nearly tied in score, the selector commits without spending extra budget, and a dropped block carrying answer evidence is unrecoverable downstream. We propose a value-of-information router that measures, for each query, how decisively the top-k cut was made, and doubles the kept set for the queries where that gap is smallest; the rule is backbone-agnostic and stacks with existing block-scoring methods such as Quest. On LongBench-v2 medium at n=215 (the entire dataset subset), router-on-Quest reaches paired recall 0.75 vs. top-k 0.47 -- +28 pp over the SSA-style baseline (McNemar p0.01) -- and lands within 2 pp of dense on RULER NIAH multikey at the same context. The lift reproduces on four models from three architectures (Qwen2.5, Mistral-Nemo, Qwen3.6). At 128K, the router preserves 0.81 and 0.89 of dense accuracy on Qwen2.5-7B-1M and Qwen3.6 (vs. SSA-style top-k at 0.09 on the former) while the fused selection-plus-kernel pipeline runs at 0.62x and 0.80x dense wall time.
66. 【2504.02128】Achieving Unanimous Consensus Through Multi-Agent Deliberation
链接：https://arxiv.org/abs/2504.02128
作者：Apurba Pokharel,Ram Dantu,Shakila Zaman,Vinh Quach,Sirisha Talapuru
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Emerging Technologies (cs.ET)
关键词：Large Language Models, functionality and integrity, relied on algorithms, consensus, ensure network functionality
备注： 6 pages, 4 figure, 2 tables
点击查看摘要
Abstract:Blockchain consensus mechanisms have relied on algorithms such as Proof-of-Work (PoW) and Proof-of-Stake (PoS) to ensure network functionality and integrity. However, these approaches struggle with adaptability for decision-making where the opinions of each matter rather than reaching an agreement based on honest majority or weighted consensus. This paper introduces a novel deliberation-based consensus mechanism where Large Language Models (LLMs) act as rational agents engaging in structured discussions to reach a unanimous consensus. By leveraging graded consensus and a multi-round deliberation process, our approach ensures unanimous consensus for definitive problems and graded consensus for prioritized decision problems and policies. We provide a formalization of our system and use it to show that the properties of blockchains are maintained, while also addressing the behavior in terms of adversaries, stalled deliberations, and confidence in consensus. Moreover, experimental results demonstrate system feasibility, showcasing convergence, block properties, and accuracy, which enable deliberative decision-making on blockchain networks.
信息检索
1. 【2607.08691】ProjAgent: Procedural Similarity Retrieval for Repository-Level Code Generation
链接：https://arxiv.org/abs/2607.08691
作者：QiHong Chen,Aaron Imani,Iftekhar Ahmed
类目：oftware Engineering (cs.SE); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：complex cross-file dependencies, requires implementing target, generation requires implementing, project-specific conventions, Repository-level code generation
备注：
点击查看摘要
Abstract:Repository-level code generation requires implementing target functions while accounting for complex cross-file dependencies and project-specific conventions. Existing retrieval methods predominantly rely on lexical, structural, or semantic similarity, often overlooking repository functions that implement similar procedural logic despite differing in identifiers or application domains. We propose ProjAgent, a repository-level code generation system that introduces procedural similarity as an explicit retrieval signal. ProjAgent decomposes the target function into intermediate reasoning steps and employs an agentic workflow to retrieve repository functions that exhibit similar procedural behavior at each step. The retrieved procedural context is integrated with conventional semantic retrieval to construct a richer repository context for code generation. ProjAgent further incorporates a conservative static-analysis feedback loop that iteratively repairs generated code using compiler and static-analysis feedback. Evaluated on REPOCOD, ProjAgent achieves 41.14% Pass@1, outperforming existing retrieval-based baselines. These results demonstrate that procedural similarity is an effective and previously unexplored retrieval dimension for repository-level code generation.
2. 【2607.08540】Improving Ad-hoc Search Effectiveness for Conversational Information Retrieval via Model Merging
链接：https://arxiv.org/abs/2607.08540
作者：Ahmed Rayane Kebir,Jose G. Moreno,Lynda Tamine
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：conversation history, history which potentially, potentially gives rise, rise to topic, topic shifts
备注： Accepted to SIGIR 2026. 6 pages, 3 figures
点击查看摘要
Abstract:Conversational information retrieval is challenging since it requires the consideration of the conversation history which potentially gives rise to topic shifts and coreference resolution across previous turns. To address these challenges, previous work mainly rely on traditional fine-tuning of ad-hoc retrievers on conversational datasets or extrapolates their generalizability through multi-tasking. However, this mainstream approach is costly - since it requires model re-training - and exhibits catastrophic forgetting, where the model loses its foundational ad-hoc retrieval performance. In this paper, we fill this gap by introducing model merging as a training-free strategy enabling the design of a single retrieval model that operates across both ad-hoc and conversational settings with no additional fine-tuning. We conduct experiments using linear and non-linear parameter-wise merging strategies - namely Model Soup and Slerp - on standard ad-hoc search and conversational retrieval datasets. Our results demonstrate that model merging significantly enhances the ad-hoc search capabilities of conversational retrievers while improving generalizability across task-specific datasets, achieving up to 15% higher NDCG@3 under zero-shot conditions.
3. 【2607.08529】Log-Insight: Automating Microservice Incident Diagnosis via Neuro-Symbolic Log Analysis
链接：https://arxiv.org/abs/2607.08529
作者：Carlos Garcia-Hernandez,Aymane Abdali,Guangyu Wu,Mingxue Wang,Fei Shen,Zhaoyu Pang,Yanbin Zhang
类目：Information Retrieval (cs.IR)
关键词：Site Reliability Engineers, Reliability Engineers, Site Reliability, Diagnosing production incidents, time-critical for Site
备注：
点击查看摘要
Abstract:Diagnosing production incidents in large-scale microservice systems is time-critical for Site Reliability Engineers (SREs). A single 30-minute incident window in our deployment can generate over two million log lines--approximately 1.2 billion characters, far exceeding standard LLM context windows--making direct LLM-based Root Cause Analysis (RCA) infeasible. Existing approaches leave gaps: template-based parsers lack semantic anomaly reasoning, deep-learning detectors emit black-box binary signals, and LLM pipelines suffer context overflow and domain hallucination on raw telemetry. We present Log-Insight, an automated incident-diagnosis system deployed in production at Huawei. The core design principle automates the SRE's manual triage workflow: symbolic stages replicate the structured investigation a skilled SRE would perform--sampling, schema understanding, pattern clustering, and statistical anomaly ranking. This hands the LLM a compact, pre-ranked evidence dossier to synthesise into a hypothesis report. Our six-stage pipeline reduces millions of raw events by 1,000-7,000x while preserving statistically significant failure signals. Evaluated on 11 historical production incidents (110 runs, SRE-validated ground truth), Log-Insight achieves MRR = 0.790, returning the correct root cause within the top-3 hypotheses in over 90% of runs in under a minute of latency. We report systematic failure modes, active mitigations, and open research directions. The Forensic Evidence section--listing exact log templates and skew statistics--was consistently identified by operators as a key adoption factor, shifting the system's perceived role from opaque oracle to investigative assistant.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2607.08529 [cs.IR]
(or
arXiv:2607.08529v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2607.08529
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
4. 【2607.08459】Conversational Retrieval and On-the-Fly Knowledge Modeling of Historical Penitentiary Repression Records
链接：https://arxiv.org/abs/2607.08459
作者：Paula Font Solà,Adrià Molina Rodríguez,Josep Lladós
类目：Information Retrieval (cs.IR); Digital Libraries (cs.DL)
关键词：Recent developments, increasingly favor conversational, libraries increasingly favor, favor conversational, conversational and natural
备注： Accepted at ICDAR2026
点击查看摘要
Abstract:Recent developments in digital libraries increasingly favor conversational and natural language access to information through Retrieval-Augmented Generation (RAG). Although these approaches are effective for extractive tasks grounded in individual records, they remain limited in their ability to interpret document collections holistically and to incorporate expert knowledge dynamically. In this article, we present a document analysis system designed for the management of historical digital libraries that supports on-the-fly knowledge modeling. The system is equipped with the capability to store facts produced either by expert archivists or derived from document retrieval processes within a graph-based structure. Through continuous professional interaction, the system can retrieve information not only from primary sources such as documents, but also from previously modeled knowledge, with the graph-based index acting as a memory for the language model to access. This enables increasingly complex queries involving long-term dependencies across documents, link discovery, and the integration of expert knowledge that may not be explicitly present in the original sources. As a result, the proposed approach facilitates the generation of richer and more comprehensive information.
5. 【2607.08382】H3D: Benchmarking Unsupervised Text Hashing for Fine-Grained Document Deduplication
链接：https://arxiv.org/abs/2607.08382
作者：Qianren Mao,Jiaxun Lyu,Junnan Liu,Zhijun Chen,Jingzheng Li,Hanwen Hao,Bo Li
类目：Information Retrieval (cs.IR)
关键词：existing studies rarely, studies rarely compare, fine-grained document deduplication, fine-grained scientific documents, rarely compare hashing
备注：
点击查看摘要
Abstract:Document hashing provides compact representations for efficient similarity search and document deduplication, but existing studies rarely compare hashing pipelines under a unified protocol for fine-grained scientific documents. H3D is an unsupervised text hashing benchmark for fine-grained document deduplication. It evaluates representative unsupervised non-learning hashing approaches (MinHash, SimHash, Winnowing, FuzzyHash, FlyHash) together with semantic-sensitive methods built from frozen BGE embeddings and two quantization strategies (BGE-BIHash and BGE-LSHash). The non-learning methods generate hash fingerprints through manually designed mathematical rules without training or labeled similarity pairs, which distinguishes them from neural semantic hashing models. We benchmark all methods on CSFCube and RELISH, two datasets that provide complementary evaluation settings: facet-level analysis for scientific-document similarity and larger-scale split-level evaluation for biomedical similarity search. H3D jointly reports ranking quality (MAP, NDCG@20), efficiency, and robustness under controlled text compression. The results show a consistent trade-off: lexical and structural fingerprints are competitive for near-duplicate matching, while semantic-sensitive representations better preserve similarity under content rewriting, at higher computational cost. We further analyze when different similarity measures become rank-equivalent for specific hash representations, improving the interpretability and reproducibility of method comparisons.
6. 【2607.08365】DaV-Gen: End-to-End Generative Retrieval via Draft-and-Verify
链接：https://arxiv.org/abs/2607.08365
作者：Meng Zhao,Chunmei Liu,Qinyong Wang
类目：Information Retrieval (cs.IR)
关键词：Mainstream industrial information, Multi-Stage Cascade Architectures, information retrieval systems, industrial information retrieval, Mainstream industrial
备注： Accepted by IJCAI'26
点击查看摘要
Abstract:Mainstream industrial information retrieval systems (e.g., search and recommendation) are usually built upon Multi-Stage Cascade Architectures (MCAs), which balance effectiveness and efficiency through a coarse-to-fine ``retrieval-ranking'' pipeline. However, the optimization objectives across different stages are substantially inconsistent, propagating or even amplifying the early-stage errors that ultimately degrade the quality of final results. While emerging end-to-end generative models offer a potential solution by unifying the pipeline, their online serving performance is severely hindered by the auto-regressive process inherited from the standard decoder-only structure. To bridge this gap, we introduce \textbf{DaV-Gen}, a novel unified solution designed to fundamentally refactor the paradigm for both search and recommendation via a ``Draft-and-Verify'' mechanism. Inspired by the process used by speculative decoding, our framework redesigns the generation task into two synergistic operations within a single model. During training, the model is concurrently optimized for both candidate drafting and fine-grained verification. This is achieved by a composite loss function that jointly trains the model on two distinct but related objectives: 1) a contrastive loss that structures the embedding space for efficient drafting, and 2) a fusion loss that combines generative likelihood with vector similarity to produce a superior verification score. This integrated training strategy equips the model with dual capabilities. At inference time, it first performs highly efficient vector-based drafting to generate a candidate set, and then verifies these candidates using the more powerful fused scoring function, thereby achieving both the speed of sparse drafting and the precision of advanced generative models within a unified, end-to-end architecture.
7. 【2607.08143】ICDAR 2026 HIPE-OCRepair Competition on LLM-Assisted OCR Post-Correction for Historical Documents
链接：https://arxiv.org/abs/2607.08143
作者：Maud Ehrmann,Emanuela Boros,Juri Opitz,Andrianos Michail,Florian Wagner,Simon Clematide
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：ICDAR competition, OCR post-correction, OCR post-correction remains, OCR, LLM-assisted OCR post-correction
备注： 17 pages
点击查看摘要
Abstract:We present the results of HIPE-OCRepair-2026, an ICDAR competition on LLM-assisted OCR post-correction of historical documents. OCR post-correction remains a long-standing challenge in digital heritage: large-scale collections of digitized documents are affected by legacy OCR errors, while re-digitization at scale remains impractical. Large language models (LLMs) offers a major opportunity to revisit this challenge, yet their effectiveness across languages, document types, and noise conditions - and their tendency to hallucinate - remains insufficiently understood. HIPE-OCRepair-2026 pursues two objectives: (i) to evaluate the capabilities of modern OCR post-correction systems, and (ii) to provide a reproducible evaluation framework anchored in the HIPE-OCRepair-2026 dataset, a harmonized multilingual resource consolidating existing and newly curated historical datasets. Participants were tasked with correcting noisy OCR transcripts from historical newspapers and printed works in English, French, and German (17th-20th century), working at the level of coherent transcription units (paragraphs or articles) without access to source images. The evaluation adopts a retrieval-oriented rather than diplomatic scoring approach, reflecting the practical use case of search and access over digitized collections. Four teams submitted systems ranging from zero-shot prompting to continued pre-training and fine-tuning, offering insights into the merits of different adaptation strategies. Results show that modern LLM-assisted systems can significantly improve OCR quality, but performance varies across datasets, languages, and noise levels. Over-correction on low-noise inputs emerges as a recurring challenge, highlighting the importance of evaluation beyond character error reduction. The dataset, scorer, and evaluation pipeline are publicly released to support future research.
8. 【2607.08107】BACH: A Bayesian Admixture of Contrastive Heads for Multi-Interest Two-Tower Retrieval
链接：https://arxiv.org/abs/2607.08107
作者：Quoc Phong Nguyen,Paul Albert,Long Vuong,Vuong Le,Julien Monteil
类目：Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Two-tower retrievers compress, serve diverse interests, single embedding, limiting their ability, retrievers compress
备注：
点击查看摘要
Abstract:Two-tower retrievers compress each user into a single embedding, limiting their ability to serve diverse interests. Multi-interest models give each user several heads scored by a maximum inner product, but their hard-routing training under-utilizes heads (routing collapse) and gives no per-user estimate of how much each interest matters for serving. We present \textbf{BACH} (\emph{Bayesian Admixture of Contrastive Heads}), which casts multi-interest two-tower retrieval as a per-user mixture over the heads, fit by variational inference. The soft mixture trains every head (mitigating collapse), produces a per-user weighting of the interests that is reused at serving, and admits a shared global-codebook variant with precomputable retrieval. On three large-scale benchmarks, MovieLens-20M, Taobao, and Netflix, BACH improves top-of-ranking retrieval over hard-routing multi-interest and single-vector baselines at every head count; we further find that scoring every candidate by its best head, consistent with serving, outperforms the usual target-routed training, and that BACH improves further still.
9. 【2607.08011】Beware What You Autocomplete: Forensic Attribution of Backdoored Code Completions
链接：https://arxiv.org/abs/2607.08011
作者：Anjun Gao,Yueyang Quan,Zhuqing Liu,Minghong Fang
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG)
关键词：Large language models, predicting subsequent lines, Large language, enabled powerful code, enabled powerful
备注： To appear in COLM 2026
点击查看摘要
Abstract:Large language models have enabled powerful code completion systems that assist developers by predicting subsequent lines of code. However, these models remain vulnerable to backdoor attacks, where malicious fine-tuning data covertly implants unsafe behaviors. Despite advances in defensive techniques, adaptive and sophisticated backdoor attacks still evade detection and mitigation. We present CodeTracer, a forensic framework that traces malicious code completions back to the backdoor fine-tuning data responsible for them. Operating under realistic post-deployment constraints, CodeTracer relies solely on the fine-tuning corpus and the reported miscompletion event. It extracts a structured behavioral fingerprint from the compromised output, narrows the search to semantically relevant code samples, and employs LLM-based reasoning to attribute unsafe logic to specific backdoor data. Extensive evaluations across three representative vulnerability cases and ten backdoor attacks, along with sixteen competitive baselines, demonstrate that CodeTracer consistently achieves high forensic accuracy, low false identification rates, and strong robustness against adaptive attacks.
10. 【2607.07989】Who Broke the System? Failure Localization in LLM-Based Multi-Agent Systems
链接：https://arxiv.org/abs/2607.07989
作者：Yufei Xia,Anjun Gao,Yueyang Quan,Zhuqing Liu,Minghong Fang
类目：Cryptography and Security (cs.CR); Artificial Intelligence (cs.AI); Information Retrieval (cs.IR); Machine Learning (cs.LG); Multiagent Systems (cs.MA)
关键词：Large language model, Large language, systems enable complex, enable complex problem, complex problem solving
备注： To appear in COLM 2026
点击查看摘要
Abstract:Large language model (LLM) based multi-agent systems enable complex problem solving through coordinated reasoning and action, but their distributed structure also introduces new challenges in diagnosing system-level failures. When an execution fails, identifying which agent is responsible and at what point the trajectory first becomes irreversibly misdirected is difficult due to long-horizon interactions and tightly coupled agent behaviors. In this paper, we study the problem of failure localization in LLM-based multi-agent systems and present AgentLocate, a framework that attributes failures to both a specific agent and the earliest decisive step. AgentLocate combines an LLM-based judging mechanism with multi-perspective verification by independent evaluators, whose assessments are aggregated using a confidence-aware strategy. The resulting feedback is further used to adapt the judge through lightweight fine-tuning, improving attribution quality. We evaluate AgentLocate on two complementary benchmarks covering diverse tasks, agent configurations, and trajectory lengths. Experimental results show that AgentLocate consistently outperforms existing failure localization methods in identifying both responsible agents and failure steps, while remaining efficient in terms of token usage and running time.
计算机视觉
1. 【2607.08772】Wat3R: Underwater 3D Geometry Learning without Annotations
链接：https://arxiv.org/abs/2607.08772
作者：Jiangwei Ren,Xingyu Jiang,Zijie Song,Wei Xu,Hongkai Lin,Dingkang Liang,Xiang Bai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：environments presents unique, presents unique challenges, unique challenges due, underwater environments presents, absence of large-scale
备注： Accepted to ECCV 2026. The dataset and code are available at [this https URL](https://github.com/LSXI7/Wat3R)
点击查看摘要
Abstract:Estimating 3D geometry in underwater environments presents unique challenges due to light attenuation, scattering, and the absence of large-scale, high-quality 3D annotations. Pioneering methods rely on massive dense annotations that are impractical in underwater settings. In this paper, we propose Wat3R, a cross-domain semi-supervised learning framework designed to adapt feed-forward 3D reconstruction models from air to underwater scenes. Uniquely, our method eliminates the need for any annotated underwater data following a teacher-student architecture, that learns robust geometry representations merely on abundant unlabeled real underwater video footage. We also design a cross-view consistency loss that leverages geometric cues from other views to compensate for the information degradation in the current view caused by water attenuation and scattering. Furthermore, considering the lack of comprehensive evaluation benchmarks, we construct Water3D, a diverse dataset covering various water bodies and underwater scenarios, designed for geometric task evaluation. Experimental results demonstrate that Wat3R outperforms current state-of-the-art methods in underwater multi-view depth estimation and point cloud reconstruction. The dataset and code are available at this https URL .
2. 【2607.08771】ZipDepth: Bringing Lightweight Zero-Shot Monocular Depth Anywhere, on Any Device
链接：https://arxiv.org/abs/2607.08771
作者：Fabio Tosi,Luca Bartolomei,Matteo Poggi,Stefano Mattoccia
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：computational demands place, robust zero-shot generalization, Monocular depth estimation, mobile platforms, remarkable progress
备注： ECCV 2026. Code: [this https URL](https://github.com/fabiotosi92/ZipDepth) - Project page: [this https URL](https://zipdepth.github.io/)
点击查看摘要
Abstract:Monocular depth estimation has seen remarkable progress through foundation models achieving robust zero-shot generalization, yet their computational demands place them far beyond the reach of embedded and mobile platforms. Lightweight alternatives exist, but have been developed almost exclusively within single-domain, self-supervised paradigms, failing silently under domain shift. We present ZipDepth, a compact monocular depth network that bridges this gap by combining an efficient reparameterizable encoder-decoder with large-scale knowledge distillation from a foundation model over a large multi-domain training set. Comprising just 6.1M parameters, ZipDepth runs at real-time rates from server GPUs to power-constrained devices, achieving the best trade-off between zero-shot accuracy and deployment efficiency among lightweight models across five benchmarks, taking a significant step towards the accuracy of foundation models with 50x more parameters.
3. 【2607.08770】LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models
链接：https://arxiv.org/abs/2607.08770
作者：Cheng-De Fan,Chun-Wei Tuan Mu,Chen-Wei Chang,Chin-Yang Lin,Kun-Ru Wu,Yu-Chee Tseng,Yu-Lun Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recovering high-quality video, Recovering high-quality, sparse event streams, Recovering, Adaptive Context Switching
备注： SIGGRAPH 2026. Project page: [this https URL](https://cdfan0627.github.io/LongE2V-page/)
点击查看摘要
Abstract:Recovering high-quality video from sparse event streams is a challenging task. Regression methods often blur textures, while existing generative models struggle with long-term stability. We propose LongE2V, a novel approach that leverages pre-trained video diffusion priors to jointly handle event-based video reconstruction, prediction, and frame interpolation. By fine-tuning a foundational video model, our approach achieves high data efficiency and superior perceptual quality. We introduce Autoregressive Unrolling and Adaptive Context Switching to mitigate temporal drift in extremely long sequences. We also propose Reencoding Alignment with Cross Residual Correction to ensure precise bidirectional consistency during frame interpolation. Furthermore, Event Voxel Density Augmentation ensures robustness across varying sensor resolutions. Extensive experiments on real-world benchmarks demonstrate that LongE2V outperforms state-of-the-art methods across all three tasks, exhibiting exceptional temporal coherence and zero-shot generalization. Project page: this https URL
4. 【2607.08769】Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstruction
链接：https://arxiv.org/abs/2607.08769
作者：Weijian Chen,Weibo Yao,Yuhang Zhang,Xiaolin Tang,Guo Wang,Weijun Zhang,Xitong Gao,Yihao Chen,Hongde Qin,Lu Qi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, acquisition and computation, data acquisition, Scaling, Gradient-based Partitioning Strategy
备注： Project Webpage: [this https URL](https://insta360-research-team.github.io/GGPS-Website)
点击查看摘要
Abstract:Scaling 3D Gaussian Splatting (3DGS) to large outdoor scenes is costly in both data acquisition and computation. Adopting panoramic images with equirectangular projection (ERP) can reduce capture effort via their full $360^{\circ}$ field of view, yet the resulting omnipresent visibility invalidates existing partitioning strategies that rely on local camera frustums, causing block-wise optimization to degenerate into global training. Thus, we propose PanoLOG, a two-stage coarse-to-fine framework equipped with a Geometry and Gradient-based Partitioning Strategy tailored for large-scale panoramic 3DGS reconstruction. In the global coarse stage, PanoLOG leverages sky-sphere modeling and panoramic monocular depth supervision for reliable geometry, while in the refinement stage, G$^2$PS builds adaptive bounding volumes via parallax-driven uncertainty and assigns cameras via gradient-based importance scoring. Furthermore, we construct Pano360, the first benchmark on large-scale panoramic dataset for outdoor scene reconstruction. Extensive experiments demonstrate that G$^2$PS achieves state-of-the-art rendering quality while maintaining scalable, block-parallel training. Our models, training code, and dataset are publicly available.
5. 【2607.08766】OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators
链接：https://arxiv.org/abs/2607.08766
作者：Hongyu Liu,Chun Wang,Feng Gao,Xuanhua He,Yue Ma,Ziyu Wan,Yong Zhang,Xiaoming Wei,Qifeng Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：on-policy self-distillation paradigm, post-training few-step autoregressive, self-distillation paradigm, paradigm for post-training, propose OPSD-V
备注： Project page: [this https URL](https://meigen-ai.github.io/OPSD-V) ; Code: [this https URL](https://github.com/MeiGen-AI/OPSD-V)
点击查看摘要
Abstract:We propose OPSD-V, an on-policy self-distillation paradigm for post-training few-step autoregressive (AR) video diffusion models. Existing few-step AR video generators can produce long videos with low latency, but still suffer from error accumulation and weakened motion dynamics during long autoregressive rollout. OPSD-V reduces long-horizon degradation while preserving the original few-step inference path. The key idea is to introduce real long-video data as temporal context during training and use it to provide dense trajectory-level supervision. Specifically, the student follows the exact inference-time rollout, generating each chunk conditioned on its own previously generated KV cache. In parallel, the teacher is evaluated at the same student-visited denoising states, but uses a cleaner AR-consistent temporal cache in which older history can be replaced by real-video context. This provides dense denoising-level corrective targets under on-policy AR cache dynamics, without changing the sampler, number of denoising steps, or inference-time cache mechanism. We apply OPSD-V to representative few-step AR video models, including Self-Forcing and LongLive. Experiments show consistent improvements in visual quality, motion dynamics, and VBenchLong scores. A user study with 10 participants comparing 20 video pairs shows that OPSD-V is preferred over the base models in 66.0% of overall-preference judgments (82.5% excluding ties).
6. 【2607.08765】Enhancing In-context Panoramic Generation via Geometric-aware Pretraining
链接：https://arxiv.org/abs/2607.08765
作者：Haoran Feng,Ruiyang Zhang,Longyi Zhang,Dizhe Zhang,Lu Qi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：downstream task-specific fine-tuning, combines geometry-aware pretraining, task-specific fine-tuning, in-context panoramic generation, in-context panoramic
备注：
点击查看摘要
Abstract:In this work, we present Canvas360, a two-stage framework for in-context panoramic generation that combines geometry-aware pretraining with downstream task-specific fine-tuning. To address the lack of large-scale, high-quality training data tailored to in-context panoramic tasks, we propose Canvas360Dataset, a collection of 1M high-quality paired panoramic samples for style transfer, inpainting, outpainting, and editing, enabling effective supervision across diverse in-context generation scenarios. On the modeling side, Canvas360 enhances text-to-panorama generation through parallel depth generation, velocity circular padding, and similarity loss regularization, enabling the model to learn geometry-aware representations, capture object distortion details, and improve geometric consistency and global coherence. Furthermore, empowered by strong panoramic priors, Canvas360 enables a unified in-context panoramic generation framework that supports diverse downstream tasks via token-level concatenation, surpassing prior methods in both task coverage and modeling flexibility. Extensive experiments show that Canvas360 improves panoramic image fidelity, achieving particularly strong performance on the panorama-specific FAED metric and competitive or leading results across the reported quantitative evaluations. More information can be found on our project page: this https URL
7. 【2607.08763】OpenCoF: Learning to Reason Through Video Generation
链接：https://arxiv.org/abs/2607.08763
作者：Xinyan Chen,Ziyu Guo,Renrui Zhang,Dongzhi Jiang,Hongsheng Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：understanding logical consequences, reliable decisions require, decisions require understanding, require understanding logical, Reasoning
备注： Project Page: [this https URL](https://opencof.github.io/)
点击查看摘要
Abstract:Reasoning has become a core capability for large models, especially when reliable decisions require understanding logical consequences. Recent video generation models offer a reasoning path distinct from previous Chain-of-Thought (CoT): reasoning can unfold through temporally connected frames, known as Chain-of-Frame (CoF) reasoning. However, existing video generators are primarily trained on general video corpora, still lacking diverse supervision and dedicated designs for CoF reasoning. To address this gap, we introduce OpenCoF, a framework comprising the OpenCoF-17K dataset, a reasoning video dataset spanning 11 task families, and Wan-CoF, a fine-tuned video model for studying whether diverse temporal supervision improves CoF behavior. Across four video reasoning benchmarks, Wan-CoF achieves considerable gains over the Wan2.2-I2V-A14B baseline. Building on this, we empirically explore more advanced designs for CoF capabilities, i.e., equipping the model with visual and textual reasoning tokens. This mechanism respectively captures low-level visual cues and high-level semantic priors for spatial and temporal reasoning. Through performance comparisons and attention analysis, we examine how these tokens contribute across model depth, denoising steps, space, and time. Our results suggest that stronger video reasoning requires both broad temporal supervision and explicit mechanisms for organizing intermediate reasoning state. We open-source the dataset, model, and code to facilitate future research on reasoning-oriented video generation.
8. 【2607.08745】AUTOPILOT VQA: Benchmarking Vision-Language Models for Incident-Centric Dashcam Understanding
链接：https://arxiv.org/abs/2607.08745
作者：Siddharth Damodharan,Radhika Gupta,Ali Alshami,Ryan Rabinowitz,Jugal Kalita
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal Large Language, Large Language Models, Large Language, Multimodal Large, Language Models
备注： CVPR Autopilot Workshop
点击查看摘要
Abstract:Recent advances in Vision-Language Models, Large Language Models, and Multimodal Large Language Models have improved autonomous driving tasks such as scene understanding, decision making, trajectory prediction, and visual question answering. However, evaluating whether these models can reliably reason about safety-critical incidents remains challenging. To address this gap, we present AUTOPILOT-VQA, an incident-centric visual question answering benchmark for dashcam video understanding. The dataset evaluates different systems through structured questions designed around real-world driving incidents and near-incidents. The benchmark covers diverse safety-relevant categories, including weather and lighting conditions, traffic environment, road layout, road surface state, signage, involved entities, accident occurrence, impact location, and avoidability-related reasoning. By requiring models to answer grounded questions about both contextual scene properties and event-level incident details, AUTOPILOT-VQA moves beyond object recognition toward temporally grounded, safety-aware reasoning. The dataset is released as part of the AUTOPILOT CVPR 2026 competition and provides a standardized benchmark for assessing the reliability of autonomous driving systems in different scenarios. Our benchmark support developments for more interpretable, robust, and safety-conscious vision-language systems for real-world autonomous driving.
9. 【2607.08741】ARDY: Autoregressive Diffusion with Hybrid Representation for Interactive Human Motion Generation
链接：https://arxiv.org/abs/2607.08741
作者：Kaifeng Zhao,Mathis Petrovich,Haotian Zhang,Tingwu Wang,Siyu Tang,Davis Rempe
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：Generating realistic, humanoid robotics, kinematic constraints, interactive applications, Generating
备注： ACM Transactions on Graphics (SIGGRAPH 2026)
点击查看摘要
Abstract:Generating realistic 3D human motions in real-time within interactive applications is key for animation, simulation, and humanoid robotics. While recent offline motion generation approaches offer precise control via text and kinematic constraints, they lack the inference speed required for interactive settings. Conversely, existing online methods enable real-time synthesis but often sacrifice controllability or struggle with complex text semantics and long-horizon goals due to limited context windows. In this work, we introduce ARDY, a streaming generation framework that bridges this gap by enabling high-fidelity motion generation controllable via online text prompts and flexible kinematic constraints. ARDY employs a hybrid representation that combines explicit root features with a latent body embedding, balancing precise trajectory control with efficient generative learning. We propose a two-stage autoregressive transformer denoiser that features variable history context and supports conditioning on flexible, long-horizon kinematic constraints. By training on a large-scale motion capture dataset and being directly conditioned on text labels and kinematic constraints sampled from ground truth poses, ARDY natively learns controllable generation that supports online prompting and flexible long-horizon goals. Extensive evaluations on the HumanML3D benchmark and the large-scale, high-fidelity Bones Rigplay dataset demonstrate ARDY's high motion quality and constraint adherence, validating the efficacy of our key architectural decisions. Finally, we demonstrate the method's practical versatility through an interactive demo featuring dynamic text control, diverse keyframe pose constraints, path following, and interactive locomotion control via mouse and keyboard. Supplementary video results, code, and model releases can be found at this https URL.
10. 【2607.08729】WaspMOT: A Benchmark for Long-Term Multi-Object Tracking of Trichogramma Wasps
链接：https://arxiv.org/abs/2607.08729
作者：Tomasz Stanczyk,Yuan Gao,Hardik Agarwal,Seongroo Yoon,Tiantao Zhang,Vincent Calcagno,Francois Bremond
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：achieved strong performance, short video sequences, Multi-object tracking, achieved strong, dominated by short
备注：
点击查看摘要
Abstract:Multi-object tracking (MOT) has achieved strong performance on benchmarks dominated by short video sequences. However, such datasets do not adequately evaluate long-term identity preservation, where objects must be tracked consistently over extended durations. We introduce WaspMOT, a benchmark designed to address this gap through long-duration tracking of Trichogramma wasps in controlled ecological experiments. The dataset contains 10 sequences of approximately 12,000 frames each (over 8 minutes at 25 FPS), with dense MOTChallenge annotations and oracle detections to isolate association performance. Unlike existing benchmarks, WaspMOT forms a closed-set tracking scenario where all individuals remain present throughout the sequence, requiring consistent identity assignment across thousands of frames despite abrupt jumps, occlusions, and highly similar appearance. We establish a benchmark by evaluating five tracking-by-detection methods, including ByteTrack, BoT-SORT, C-BIoU, OC-SORT, and McByte, under a unified protocol. Results show that all methods suffer from significant trajectory fragmentation, highlighting the difficulty of long-term identity preservation even with perfect detections. A simple spatial tracklet stitching baseline consistently improves performance, indicating that substantial gains remain possible. WaspMOT provides a new benchmark for studying long-term association and reveals limitations of current tracking approaches that are not observable on conventional datasets. The benchmark will be made publicly available at the project repository: this https URL .
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.08729 [cs.CV]
(or
arXiv:2607.08729v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.08729
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Journalreference:
AVSS 2026
11. 【2607.08725】Pose-to-Biomechanics: Bridging 3D Human Pose Estimation and Biomechanical Attribute Prediction
链接：https://arxiv.org/abs/2607.08725
作者：Ayda Eghbalian,Kevin Desai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：made markerless recovery, Recent progress, skeletal motion increasingly, motion increasingly accurate, accurate and scalable
备注： 23 pages, 2 figures
点击查看摘要
Abstract:Recent progress in 3D human pose estimation has made markerless recovery of skeletal motion increasingly accurate and scalable. However, most pose estimators remain optimized for geometric keypoint accuracy, while many real-world applications in rehabilitation, sports science, ergonomics, and clinical movement analysis require biomechanical quantities that describe how the body moves, loads, and activates. In this work, we propose BioModule, a lightweight plug-in temporal transformer that attaches downstream of any 3D pose estimator and predicts biomechanical attributes from standard 17-joint 3D skeletons. BioModule is estimator-agnostic and requires no modification of the upstream pose model, enabling existing pose estimators to be extended toward physically interpretable motion analysis. To train and evaluate BioModule, we construct a large-scale aligned dataset pairing Human3.6M video and 3D keypoints with the biomechanical label space of Human3.6Mplus. We establish and verify anatomical correspondence between coordinate systems of the two datasets, enabling frame-accurate cross-modal supervision. Using this aligned supervision, BioModule predicts biomechanical quantities. We further benchmark BioModule across seven state-of-the-art 3D pose estimators, providing the first systematic analysis of how upstream pose estimation quality propagates to downstream biomechanical prediction fidelity. The results position BioModule as a compact, modular bridge between vision-based pose estimation and biomechanically meaningful human motion analysis.
Comments:
23 pages, 2 figures
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
Cite as:
arXiv:2607.08725 [cs.CV]
(or
arXiv:2607.08725v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.08725
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
12. 【2607.08711】LTM: Large-scale Terrain Model for Wildfire-prone Landscapes
链接：https://arxiv.org/abs/2607.08711
作者：Xiao Fu,Yue Hu,Meida Chen,Peter Anthony Beerel,Barath Raghavan
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：assessing wildfire hazards, essential for emergency, Accurate, Digital Elevation Models, wildfire hazards
备注：
点击查看摘要
Abstract:Accurate 3D terrain maps are essential for emergency response when assessing wildfire hazards. However, wildfire-prone regions often span vast areas where conventional reconstruction methods underperform. Airborne LiDAR systems provide high-resolution terrain data, but they are expensive and infrequently updated. Image-based methods offer a lower-cost alternative, but struggle due to sparse visual features and limited image overlap. We propose a multi-modal reconstruction framework leveraging outdated Digital Elevation Models (DEMs) as geometric priors for image-based 3D reconstruction. Our key innovation is physics-based pixel-pixel alignment between images and DEM data, dramatically reducing computational complexity by eliminating expensive feature matching procedures. To validate our approach, we developed a large-terrain simulator based on a real wildfire-prone area, generating realistic images enabling a comprehensive evaluation. Given posed images and legacy DEMs, our method produces high-fidelity depth maps while maintaining real-time performance. We find significant improvements in reconstruction accuracy and computational efficiency over existing techniques, offering a scalable solution for wildfire response.
13. 【2607.08705】HumanForge: A Human-Centric Deepfake Video Benchmark with Multi-Agent Forgery Rationales
链接：https://arxiv.org/abs/2607.08705
作者：Wenbo Xu,Zhimin Chen,Xiaojie Liang,Hengrui Liu,Wei Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：temporal editing tools, highly realistic human-centric, posing unprecedented challenges, Rapid advancements, digital content forensics
备注： 6 pages, 2 figures
点击查看摘要
Abstract:Rapid advancements in video diffusion models and temporal editing tools have enabled the generation of highly realistic human-centric videos, posing unprecedented challenges to digital content forensics. Existing benchmarks primarily focus on either face-swapping or global text-to-video synthesis, overlooking the crucial dimensions of human-object or human-human interactions and multi-modal alignment. To address these limitations, we introduce HumanForge, a unified, large-scale, and multi-paradigm human-centric video forgery dataset. To construct and annotate this dataset without labor-intensive manual labeling or hallucinated monolithic prompts, we propose Gen2Anno, a modular active multi-agent pipeline built on LangGraph. Gen2Anno coordinates six specialized agents-ranging from source profiling to MoE-based reference analysis and closed-loop forensic verification-to generate over 18K high-fidelity video segments and produce structured, contrastive omni-annotations containing binary decisions, fine-grained artifact categories, and spatio-temporal localization. Extensive benchmarks using state-of-the-art traditional detectors and Large Multimodal Models (LMMs) demonstrate the significant challenges of zero-shot generalization and fine-grained reasoning on HumanForge. Code and dataset will be publicly released.
14. 【2607.08688】SAM-MT: Real-Time Interactive Multi-Target Video Segmentation
链接：https://arxiv.org/abs/2607.08688
作者：Ruiqi Shen,Chang Liu,Henghui Ding
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Modern Video Object, Modern Video, segmenting user-specified targets, Video Object Segmentation, tracking and segmenting
备注： ECCV 2026, Project Page: [this https URL](https://henghuiding.com/SAM-MT/)
点击查看摘要
Abstract:Modern Video Object Segmentation (VOS) involves tracking and segmenting user-specified targets. While recent approaches have achieved remarkable performance in single-target scenarios, extending them to multi-target settings typically involves replicating the single-target processing for each individual object, resulting in reduced frame rates (FPS) with unbounded latency as target count increases. Built upon Segment Anything 2 (SAM2), we propose SAM-MT, which addresses this by transforming the model into an interactive framework for real-time Multi-Target video segmentation. SAM-MT uses explicit queries to represent different individual targets, in parallel with a shared representation for global context. It employs decoupled masked attention to keep individual identities distinct from cross-target interference, and sparse memory for stable temporal evolution, along with specialized strategies for occlusion handling and overlap prevention. SAM-MT successfully decouples latency from the number of targets, achieving real-time speed on par with single-target baselines (36 FPS for 10 targets) while maintaining SAM2's robust video segmentation performance.
15. 【2607.08679】Multi-Resolution Feature Stem for Diabetic Retinopathy lesion segmentation
链接：https://arxiv.org/abs/2607.08679
作者：Indranil Dutta,Taehee Jeong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diabetic Retinopathy, preventable blindness worldwide, requiring automated lesion, automated lesion segmentation, deep learning models
备注： 2026 International Conference on Advances in Artificial Intelligence and Machine Learning (AAIML), 20-22 March 2026
点击查看摘要
Abstract:Diabetic Retinopathy (DR) is a leading cause of preventable blindness worldwide, requiring automated lesion segmentation using deep learning models for early detection and monitoring. However, DR lesions vary dramatically in size from tiny microaneurysms to large hemorrhages and exudates. This variability creates conflicting demands on the model architecture and input resolution, posing a challenge for effective design. This work investigates the impact of input resolution on different lesion types. Through systematic experimentation with multiple architectures (U-Net, UNet++, Vision Transformers, DeepLabV3+) at $512 \times 512$ and $1024 \times 1024$ resolutions, we identify a critical, counter-intuitive phenomenon where increasing input resolution has opposing effects on different lesion types. We demonstrate that while higher resolution is essential for resolving fine-grained microaneurysms, it can unexpectedly degrade performance on larger hemorrhages. This finding challenges the common assumption that higher resolution is uniformly beneficial. To address this, we propose a novel Multi-Resolution Feature Stem, an input-level pyramid integrated with a UNet++ backbone. This architecture processes multiple scales in parallel, capturing fine-grained details without sacrificing contextual information. This work contributes crucial empirical evidence of this complex, resolution-dependent behavior and a practical, parameter-efficient architecture that successfully resolves this trade-off.
16. 【2607.08674】Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detection
链接：https://arxiv.org/abs/2607.08674
作者：Kutub Uddin,Nusrat Tasnim,Awais Khan,Mohammad Umar Farooq,Khalid Malik
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：posing significant threats, digital identity theft, realistic deepfake media, highly realistic deepfake, including misinformation
备注：
点击查看摘要
Abstract:The rapid advancement of generative AI has enabled the creation of highly realistic deepfake media, posing significant threats, including misinformation, digital identity theft, fraud, and manipulation of public opinion. AI-generated image (AIGI) detection is reliably challenging due to the diversity of generative methods and the subtle artifacts they leave behind. In this work, we propose GenRes, a novel framework for generative residual learning via a neural tensor network, which models fine-grained relational features between original and transformed samples to enhance generalization. To address scenarios involving multiple generative transformations, we introduce GenRes++, which employs a learnable attention mechanism to aggregate relational features across multiple transformed samples and enables the model to focus on the most informative cues. Both models leverage PE-Core as a feature extractor, providing generalized and semantically rich embeddings that improve cross-domain performance and enable the detection of AIGI generated by unseen methods. Comprehensive experiments on multiple benchmark datasets demonstrate that the proposed GenRes++ approach outperforms existing methods.
17. 【2607.08639】Native Video-Action Pretraining for Generalizable Robot Control
链接：https://arxiv.org/abs/2607.08639
作者：Qihang Zhang,Lin Li,Luyao Zhang,Shuai Yang,Yiming Luo,Shuaiting Li,Ruilin Wang,Junke Wang,Jiahao Shao,Gangwei Xu,Jiaming Zhou,Yishu Shen,Yudong Jin,Fangyi Xu,Shuailei Ma,Jiaqi Liao,Guanxing Lu,Zifan Shi,Yongkun Wen,Yujie Zhao,Weixuan Tang,Xinyang Wang,Chaojian Li,Jiapeng Zhu,Ka Leong Cheng,Nan Xue,Xing Zhu,Yujun Shen,Yinghao Xu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：offers a promising, promising path, path for robot, video-action models offers, models offers
备注：
点击查看摘要
Abstract:The advent of video-action models offers a promising path for robot control. Nevertheless, we argue that repurposing video generative models designed for digital content creation is inherently inadequate for physical environments. To bridge this gap, we present LingBot-VA 2.0, a video-action foundation model built from the ground up for embodiment. Four core design principles showcase its evolution from LingBot-VA. (1) Departing from traditional reconstruction-focused VAEs, we introduce a semantic visual-action tokenizer, which aligns visual representations with both semantics and actions, improving instruction following and action precision in subsequent policy learning. (2) Given the strictly causal nature of temporal dynamics, we adopt a causal pretraining paradigm, training from scratch to circumvent the catastrophic forgetting that frequently occurs when adapting bidirectional architectures. (3) To meet the demands of high-frequency inference, our model employs a sparse MoE backbone, expanding model capacity without compromising efficiency. (4) Real-time closed-loop control is realized through an enhanced asynchronous inference scheme, which predicts future latents in parallel with action execution while re-grounding each rollout on the latest observation via learned forward dynamics. Real-world deployment validates LingBot-VA 2.0 as a robust foundation model, as evidenced by its few-shot generalization across complex manipulation tasks.
18. 【2607.08605】When Structured Sparse Autoencoders Learn Consistent Concepts Across Modalities
链接：https://arxiv.org/abs/2607.08605
作者：Weiduo Liao,Yunqiao Yang,Ying Wei
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Structured Sparse AutoEncoder, promising technique, technique for mechanistic, mechanistic interpretability, interpretability by learning
备注：
点击查看摘要
Abstract:Sparse autoencoders (SAEs) have emerged as a promising technique for mechanistic interpretability by learning a set of sparse latent features in large models, each of which encodes a distinct concept. However, in vision-language models (VLMs), vanilla SAEs struggle to learn modality-consistent concepts, with concepts often exhibiting fragmented coverage (i.e., disjoint regions) in the visual modality. To address this challenge, we propose a Structured Sparse AutoEncoder ($S^2AE$) that enforces concept consistency from both semantic and spatial perspectives in the visual modality. Specifically, we group image patches based on Transformer attention similarity and spatial proximity, and introduce a structured sparsity regularization when training the vanilla SAE. The regularization consists of exclusive sparsity for inter-group concept disentanglement and group sparsity for intra-group concept consistency, which drives the latent neurons by SAEs to specialize in distinct, semantically grounded concepts. Evaluated on the \texttt{Qwen2.5-VL-7B-Instruct} model, the method achieves 6.06% average improvement in semantic alignment (mIoU) and 60.81 in representational efficiency (lower l0 norm) while maintaining near-perfect reconstruction fidelity with an Explained Variance above 99%. Cross-modal analysis further demonstrates that $S^2AE$ enhances neuronal monosemanticity by this visual structural prior, achieving a 3.08% average gain in semantic consistency and a 2.37% average gain in monosemanticity scores for both modalities of multimodal features, thereby fostering more coherent and disentangled representations.
19. 【2607.08572】Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learning
链接：https://arxiv.org/abs/2607.08572
作者：Yiyang Fang,Pei Fu,Jinjie Li,Jian Liang,Wenke Huang,Ruijie Luo,Shaojie Zhang,Jian Luan,Yi R. Fung,Mang Ye
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, Large Language, heterogeneous multitask settings, Language Models
备注：
点击查看摘要
Abstract:Multimodal Large Language Models (MLLMs) often follow a fixed Think-then-Answer paradigm, which is inefficient in heterogeneous multitask settings because simple inputs may not require explicit reasoning while difficult ones can benefit substantially from it. Learning when to think is also unstable during post-training, where imbalanced rollouts can drive the model toward always-thinking or always-direct behavior. We propose Switch-Reasoner, a GRPO-based framework that learns to adaptively select reasoning modes for MLLMs. It treats thinking as a virtual tool invocation and allows the model to either answer directly or invoke explicit reasoning before answering. To stabilize this decision, we introduce a dual-level regulation mechanism that balances the overall use of Thinking Mode and Direct Mode while providing sample-level supervision based on the relative benefit of the two choices. Experiments on 11 multimodal tasks show that Switch-Reasoner reduces unnecessary reasoning while maintaining strong performance, achieving a better accuracy-efficiency trade-off.
20. 【2607.08541】VocaDet: Sample-Driven Open-Vocabulary Object Detection and Segmentation via Visual Tokenization and Vector Database Retrieval
链接：https://arxiv.org/abs/2607.08541
作者：ZhiXin Sun
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：recognize arbitrary objects, Open-vocabulary object detection, predefined categories, aim to recognize, recognize arbitrary
备注：
点击查看摘要
Abstract:Open-vocabulary object detection and segmentation aim to recognize arbitrary objects beyond predefined categories. Although recent vision-language and reference-based approaches have significantly advanced this field, they often rely on text prompts, limited visual examples, or expensive feature matching procedures, making them difficult to scale to large and continuously expanding object repositories. In this work, we propose VocaDet, a sample-driven open-vocabulary object detection and segmentation framework that learns object concepts directly from user-provided positive and negative sample collections without model retraining. The key idea is to transform continuous visual representations into discrete visual vocabularies and perform efficient retrieval-based recognition through a scalable vector database. Specifically, we employ DINOv3 as the visual feature extractor and apply agglomerative clustering with adaptive clustering sensitivity to generate multi-granularity visual tokens. These visual tokens, together with position-debiased representations and spatial topology information, are stored as expandable object memories in a vector database. During inference, query images are converted into visual tokens and efficiently matched against the stored object memories for object localization and segmentation. Furthermore, a background filtering mechanism is introduced to remove frequently occurring background patterns and reduce redundant retrieval operations in practical fixed-camera scenarios. Experiments on the UA-DETRAC dataset demonstrate that VocaDet achieves effective open-vocabulary detection performance without conventional detector training, while supporting continuously expandable recognition capability as additional positive and negative samples are accumulated.
21. 【2607.08537】Whareformer: Learning to Track What is Where in Long Egocentric Videos
链接：https://arxiv.org/abs/2607.08537
作者：Jacob Chalk,Saptarshi Sinha,Dima Damen,Yannis Kalantidis,Diane Larlus
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：egocentric videos focuses, camera wearer, maintaining knowledge, heavily occluded, focuses on tracking
备注： Accepted at ECCV 2026. Project Webpage: [this https URL](https://jacobchalk.github.io/Whareformer/)
点击查看摘要
Abstract:The recently established 'Out of Sight, Not out of Mind' (OSNOM) task for egocentric videos focuses on tracking objects that are moved by the camera wearer, online, maintaining knowledge of instance locations throughout the video even when they leave the field of view or become heavily occluded. In this paper, we propose the first learning-based solution to the OSNOM task: Whareformer, a transformer-based model with two components: an updatable memory of established tracks and a track assignment module that associates observations with existing tracks in a feed-forward manner. Whareformer jointly reasons over evolving object appearance (what) and updated 3D location (where), and employs a dedicated New Track token to reason about novel objects. Thanks to its design choices of using relative distances and evolving track representations, Whareformer is trained on a small set of 56 videos but achieves SOTA performance on 260 long test videos from three datasets: EPIC-KITCHENS-100 (unseen videos), IT3DEgo, and HD-EPIC, with significant absolute improvements over prior work.
Comments:
Accepted at ECCV 2026. Project Webpage: this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.08537 [cs.CV]
(or
arXiv:2607.08537v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.08537
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
22. 【2607.08515】Beyond wheelchairs and blindfolds: Investigating disability stereotypes in T2I models with INCLUDE-BENCH
链接：https://arxiv.org/abs/2607.08515
作者：Sophia Lichtenberg,Albert Gatt,Judith Masthoff
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：exhibit social biases, social biases, models, exhibit social, Abstract
备注：
点击查看摘要
Abstract:Text-to-image (T2I) models have been shown to exhibit social biases. Prior work has mainly focused on gender, skin tone, and cultural representation within restricted occupational associations, and emerging benchmarks increasingly incorporate these dimensions. However, disability remains systematically underexplored. Current evaluation practices often fail to align with sociologically grounded definitions of stereotyping, limiting principled assessment of representational harms toward people with disabilities (PWD). To address this, we introduce INCLUDE-BENCH, the first large-scale benchmark for evaluating disability-related bias in T2I models. INCLUDE-BENCH comprises 119K generated images based on prompt design across multiple bias dimensions and both static and dynamic contexts. We evaluate 15 open-source and 2 closed-source models. Our key findings reveal that: (1) mobility-impaired and default disability prompts predominantly yield wheelchair depictions across all models; (2) disability-conditioned generations consistently exhibit less diversity; (3) stereotypical portrayals demonstrate stronger disability-text alignment; and (4) we introduce the Stereotype Content Model (SCM) Score, demonstrating that T2I models reflect real-world stereotypical associations.
23. 【2607.08514】Do Egocentric Video-Language Models Capture Both Hand- and Object-Centric Cues?
链接：https://arxiv.org/abs/2607.08514
作者：Masatoshi Tateno,Alexandros Stergiou,Risa Shinoda,Yoichi Sato,Dima Damen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recognition requires capturing, Hand-object interaction, requires capturing, object transformations, HOI
备注：
点击查看摘要
Abstract:Hand-object interaction (HOI) recognition requires capturing both hand manipulations and object transformations. However, existing video-language models often fall into shortcuts by relying on spurious correlations among hands, objects, or environmental context, rather than reasoning from the appearance and dynamics of hands and objects themselves. To address this limitation, we propose a new learning paradigm that combines (i) hand-object masked training, which enables robust reasoning from partial hand or object observations, and (ii) an HOI-dynamics-aware decoder that explicitly learns hand- and object-centric embeddings through auxiliary predictions of their locations and semantics, enhancing sensitivity to both cues. To systematically evaluate such cue-specific reasoning, we introduce Cue-Isolated HOI (CI-HOI), a new evaluation that assesses models' ability to predict actions from hand- and object-related cues independently. To enable CI-HOI, we curate the DEHOI testbed, which separates hand- and object-related observations for disentangled HOI evaluation through inpainting. Using DEHOI, we demonstrate both quantitatively and qualitatively that our training strategy exploits hand- and object-centric information more effectively than existing models. Our approach improves over existing models on DEHOI, standard action recognition, object state recognition, and even robot manipulation action recognition, leading to more robust HOI understanding.
24. 【2607.08511】Systematic Evaluation of Learning Rate Scheduling Strategies Across Heterogeneous Architectures
链接：https://arxiv.org/abs/2607.08511
作者：Hafsa Mateen,Radu Timofte,Dmitry Ignatov
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：learning rate scheduling, rate scheduling strategy, Choosing a learning, neural network training, rarely exhaustive
备注：
点击查看摘要
Abstract:Choosing a learning rate scheduling strategy is critical to neural network training, but manual selection is costly and rarely exhaustive. While classical AutoML approaches often treat the scheduler as a secondary hyperparameter, we systematically investigate its impact on classification accuracy across a diverse pool of architectures. We evaluated 30 representative architectures from convolutional and transformer families within the LEMUR neural network dataset. Through automated source-code injection, we applied 25 scheduler configurations across nine PyTorch families, evaluating a total of 3,938 model variants on CIFAR-10. Our best configuration achieved a top-1 accuracy of 86.45%, with 237 variants exceeding 80%. The results show that the choice of scheduler depends heavily on the architecture: CosineAnnealingWarmRestarts and CyclicLR consistently outperform basic decay strategies. The resulting accuracy landscape, contributed to the LEMUR nn-dataset, provides a practical reference for principled scheduler selection.
25. 【2607.08503】CT-CLIP Representations for Multimodal Lung Cancer Survival Prediction
链接：https://arxiv.org/abs/2607.08503
作者：Sofie Allgöwer,Mikael Johansson,Andreas Hallqvist,Jonas Andersson,Åse Johnsson,Ida Häggström,Jennifer Alvén
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Accurate prognosis prediction, reliable outcome data, curated imaging cohorts, Accurate prognosis, deep learning-driven survival
备注： 8 pages, 2 figures
点击查看摘要
Abstract:Accurate prognosis prediction is important for treatment planning in lung cancer, but deep learning-driven survival modelling is often limited by the scarcity of curated imaging cohorts with reliable outcome data. This study evaluates whether representations from a domain-specific foundation model can be used for multimodal survival prediction in data-constrained clinical settings. We assess the foundation model CT-CLIP as a feature extractor for pretreatment computed tomography images and clinical variables from 242 diagnosed lung cancer patients. The evaluation includes adaptation strategies based on frozen encoders, full fine-tuning, and low-rank adaptation, together with modality ablations and comparisons with clinical and multimodal baselines. The results show that a frozen CT-CLIP model combined with a trainable lightweight survival head outperforms the clinical baseline and achieves comparable or improved performance relative to other multimodal approaches, and separates patients into clinically meaningful high- and low-risk groups.
26. 【2607.08497】Cognitive-structured Multimodal Agent for Multimodal Understanding, Generation, and Editing
链接：https://arxiv.org/abs/2607.08497
作者：Feng Wang,Canmiao Fu,Zhipeng Huang,Chen Li,Jing Lyu,Ge Li
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Recent unified multimodal, jointly perform vision, multimodal models show, Cognitive-structured Multimodal Agent, Recent unified
备注： 16 pages, 7 figures, 8 tables. Project page: [this https URL](https://caseclose.github.io/cma-harness/) Code: [this https URL](https://github.com/caseclose/cma-harness)
点击查看摘要
Abstract:Recent unified multimodal models show a single architecture can jointly perform vision/language understanding and image generation/editing. However, they repeatedly feed all historical visual and textual inputs into a shared context window, limiting long-horizon multimodal dialogue due to visual token explosion and unreliable cross-turn referencing. We propose a Cognitive-structured Multimodal Agent that externalizes visual information into an Episodic Visual Memory and selectively reactivates relevant episodes during reasoning. The agent consists of a Perceptual Abstraction Engine for structured visual abstraction, a Cognitive Retrieval Engine for cross-turn memory retrieval, and a Multimodal Executive Controller for autonomous task inference and action planning. To address the lack of turn-level retrieval supervision in existing datasets, we develop a Unified Scenario Engine that programmatically generates structured multi-turn conversations with fine-grained retrieval annotations, enabling reinforcement learning to optimize abstraction and retrieval policies. We also construct a long-horizon visual-dialogue benchmark stratified by difficulty to evaluate episodic visual recall. Our 8B agent achieves 91.4% retrieval accuracy over 20-turn sessions, surpassing 32B baselines by +8.2% while nearly halving per-turn inference time (23.1s - 12.7s). We further present the Cognitive-structured Multimodal Agent Harness (CMA-Harness), a tool-augmented deployment of the same cognitive structure integrating persistent multimodal memory, web access, image generation/editing/composition tools, and OpenAI-compatible serving. Structured memory and modular decision-making offer a more scalable, efficient paradigm for long-horizon multimodal agents than monolithic parameter scaling. Code: this https URL ; Project page: this https URL
27. 【2607.08489】VEGAS: Human-Aligned Video Caption Evaluation via Gaze
链接：https://arxiv.org/abs/2607.08489
作者：Shenghui Chen,Po-han Li,Ximeng Sun,Shijia Yang,Emad Barsoum,Zicheng Liu,Sandeep Chinchali,Ufuk Topcu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Human-Computer Interaction (cs.HC)
关键词：Vision-language models excel, typically generate descriptions, capture individual viewers', individual viewers' attention, Vision-language models
备注：
点击查看摘要
Abstract:Vision-language models excel at video captioning, yet typically generate descriptions that fail to capture individual viewers' attention. We propose VEGAS (Video caption Evaluation via GAze Score), a training-free metric that leverages test-time gaze to sample personalized, attention-aligned text. It is a cross-modal, information-theoretic metric that quantifies how well a candidate caption matches a viewer's focus. To evaluate VEGAS, we curate a dataset of egocentric activities and instructional slides paired with synchronized gaze and reference annotations. We then select captions based on VEGAS via rejection sampling without model retraining. Experiments show that VEGAS-selected captions align significantly better with human focus and improve downstream caption-to-video retrieval, demonstrating the practical utility of incorporating viewer attention during inference.
28. 【2607.08449】Predicting Viticulture Potential through an Ensemble of U-Net and a Geospatial Foundation Model
链接：https://arxiv.org/abs/2607.08449
作者：Jorge Ignacio Perez,Hwaai Kang Kee,Lucas Rassbach
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：sustainable land management, Determining agricultural potential, Determining agricultural, fundamental to sustainable, sustainable land
备注： To be published in CLEF 2026 Working Notes
点击查看摘要
Abstract:Determining agricultural potential is fundamental to sustainable land management and agricultural planning. Remote sensing data is increasingly valuable as an avenue for agricultural potential due to the cost of traditional methods (surveys, in-situ measurements, soil testing, etc). ImageCLEF AI4Agri 2026: Subtask 1 is concerned with the prediction of viticulture potential in Southern France. The DS@GT ARC's submission for Subtask 1 introduces an ensemble of U-Net and a Geospatial Foundation Model (Prithvi-2.0). Our best model achieved a $\pm$1 accuracy of 68.32 on the leaderboard, ranking 2nd among 7 teams. The implementation for this work is publicly available at this https URL .
29. 【2607.08434】DeltaV: Thinking with Visual State Updates in Unified Large Multimodal Models
链接：https://arxiv.org/abs/2607.08434
作者：Pengjie Wang,Linger Deng,Zujia Zhang,Shaojie Zhang,Zhenbo Luo,Pei Fu,Jian Luan,Xiang Bai,Yuliang Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Current Unified Large, Unified Large Multimodal, Current Unified, Unified Large, Large Multimodal Models
备注：
点击查看摘要
Abstract:Current Unified Large Multimodal Models (ULMMs) support interleaved multimodal reasoning through textual reasoning and intermediate visual states, but typically generate each visual state as a full image. This full-image generation paradigm introduces substantial visual-token redundancy and dilutes supervision on sparse yet reasoning-critical state transitions. We propose DeltaV, a ULMM that replaces full-image generation with visual updates. Conditioned on historical visual states, DeltaV incrementally predicts compact update tokens that capture the visual changes across reasoning steps, avoiding repeated modeling of unchanged content. To align the token budget of each update with the magnitude of visual change, DeltaV introduces a temporal similarity (TSIM) Router, which stops allocating tokens once the marginal reconstruction gain falls below a threshold. To support more diverse and generalizable reasoning, we further construct StructCoT, a large-scale interleaved multimodal reasoning dataset with 1.05M samples spanning 44 task domains. Experiments show that the visual-update paradigm reduces newly generated visual tokens by 55.6\% on average without compromising reconstruction fidelity, and improves multimodal reasoning by 3.3\% over full-image generation. Trained with StructCoT and large-scale multimodal data, DeltaV-2B further outperforms substantially larger open-source models by 8.4\% on in-domain multimodal reasoning evaluations and surpasses the comparable-scale Qwen3-VL-2B by 5.9\% on external multimodal reasoning and understanding benchmarks. Code, models, and StructCoT will be released at this https URL.
30. 【2607.08408】rack2Map: Online Deformable SLAM with Motion-Aware Pose Optimization in Robotic Surgery
链接：https://arxiv.org/abs/2607.08408
作者：Tianyi Song,Sierra Bonilla,Xinwei Ju,Evangelos Mazomenos,Danail Stoyanov,Adam Schmidt,Omid Mohareri,Sophia Bano,Francisco Vasconcelos
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Gaussian Splatting pipeline, minimally invasive surgery, Gaussian splatting, robot-assisted minimally invasive, camera trajectory priors
备注： Accepted at MICCAI 2026. This is the submitted version prior to peer review. The final authenticated version will be available on SpringerLink
点击查看摘要
Abstract:Gaussian splatting is the current state-of-the-art for dense, deformable 3D anatomy reconstruction in robot-assisted minimally invasive surgery (RAMIS); however, most pipelines are offline and depend on accurate camera trajectory priors (often from robotic kinematics), limiting applicability when priors are missing or noisy. To address these limitations, we propose Track2Map, an online 3D Gaussian Splatting pipeline that jointly optimizes camera trajectory and 3D deformable scene representation directly from surgical video. Track2Map is therefore capable of robust 3D reconstructions when camera trajectory priors are either absent or noisy, and due to its online nature it effectively works as a Simultaneous Localisation and Mapping (SLAM) method. To stabilize optimization in the presence of tissue motion and ambiguous visual cues, we introduce a track-anchored deformation initialization using dense 2D point tracks. Track statistics are further utilized to disentangle camera motion from scene deformation by detecting static camera periods and reducing drift during incremental mapping. Experiments on StereoMIS show improved reconstruction quality and camera trajectory against competing SLAM methods, as well as compared to non-SLAM methods that utilize camera trajectory priors. The code is available at this https URL.
31. 【2607.08402】Swapping Faces, Saving Features: A Dual-Purpose Pipeline for Pedestrian Privacy in ITS
链接：https://arxiv.org/abs/2607.08402
作者：Roba H. Farouk,Catherine M. Elias
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Robotics (cs.RO)
关键词：intelligent transportation system, autonomous vehicles, transportation system, real-time decisions, decisions for autonomous
备注：
点击查看摘要
Abstract:Large-scale and diverse datasets are needed to train AI models to take real-time decisions for autonomous vehicles (AVs), an intelligent transportation system (ITS) application. Pedestrian intention and trajectory prediction are critical models used in AVs, requiring datasets involving diverse pedestrian images. Unrestricted access to these datasets imposes serious security risks, like identity theft and pedestrian tracking. The challenge is to apply privacy preservation procedures while maintaining the image attributes needed to train the models. Existing privacy methods may preserve the pedestrian's privacy, but degrade the image usability, which hinders the models' effectiveness. This work's focus is to implement a five-stage pipeline to protect pedestrians' privacy through face swapping while keeping the essential facial attributes intact. It should be tailored to satisfy the privacy needs of the Egy-DRiVeS dataset. Moreover, Roop and Ghost-v2 face-swapping models are evaluated. Provenly, Roop outperforms Ghost-v2 in various aspects, as will be discussed. Consequently, Roop is the face-swapping model to be used in the pipeline to strike the balance between pedestrian privacy via identity concealment and data usability via facial attribute preservation.
32. 【2607.08398】HoloTetSphere: Unified TetSphere Mesh Reconstruction for Physical Simulations
链接：https://arxiv.org/abs/2607.08398
作者：YaQiao Dai,Renjiao Yi,Zhirui Gao,Wei Chen,Kai Xu,Chenyang Zhu
类目：Graphics (cs.GR); Computer Vision and Pattern Recognition (cs.CV)
关键词：decoupled two-stage paradigm, Standard pipelines, extracting surface geometry, pipelines for physics-ready, two-stage paradigm
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Standard pipelines for physics-ready 3D reconstruction rely on a decoupled two-stage paradigm: extracting surface geometry followed by an error-prone tetrahedralization process. While recent Lagrangian methods like TetSphere Splatting attempt to bypass this by directly optimizing volumetric primitives, their homeomorphic constraints prevent topology-adaptive optimization. Consequently, they produce disjoint tetrahedra rather than a single connected mesh, rendering the structures unsuitable for further physical simulations. To address this, we propose a topology-adaptive framework for holistic tetrahedral mesh reconstruction through end-to-end topological and geometric optimization. First, by coupling Gaussian spheres to tetrahedral elements and leveraging edge connections, we estimate a continuous opacity field for differentiable element pruning. Next, jointly minimizing mesh smoothing energy and multi-view Gaussian rendering error drives alternating geometric refinement while preserving topological adaptivity. Consequently, our approach effectively constructs a unified and topologically coherent tetrahedral mesh. Extensive experiments demonstrate that our method outperforms state-of-the-art techniques by achieving superior geometric accuracy and producing coherent, single-connected tetrahedral meshes, thereby effectively bypassing the error-prone conventional tetrahedralization step for reconstructed surface meshes and streamlining downstream physical simulation.
33. 【2607.08397】Attribute Retrieving for Open-Vocabulary Endoscopic Compositional Referring Segmentation
链接：https://arxiv.org/abs/2607.08397
作者：Shun Liu,Nan Xi,Yang Liu,Tianyu Luan,Xuan Gong,David Doermann
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：segment image regions, controllable visual understanding, segment image, image regions, Referring Image Segmentation
备注：
点击查看摘要
Abstract:Referring Image Segmentation (RIS) aims to segment image regions specified by natural language, enabling fine-grained and controllable visual understanding. Extending RIS to endoscopic imagery, however, presents unique challenges, including scarce high-quality annotations and complex, domain-specific image-text relationships. Although recent vision-language models demonstrate strong cross-domain alignment, they often fail to capture fine-grained textual cues in endoscopic settings, resulting in suboptimal performance and limited generalization. To address these challenges, we introduce ReferEndoscopy, a large-scale benchmark for RIS in the endoscopy field. Building on this dataset, we propose the Attribute Retrieval-based Endoscopic-RIS (AR-ERIS) framework for open-vocabulary endoscopic compositional referring segmentation. AR-ERIS leverages attribute retrieval for open-vocabulary endoscopic compositional referring segmentation and is pretrained on the curated ReferEndoscopy dataset, achieving state-of-the-art performance with strong generalization across both simulated and real-world endoscopic data. The dataset and code will be publicly released upon completion of the review process.
34. 【2607.08379】Classical versus Deep Mirror-Symmetry Scoring: A Benchmark of Thirteen Methods
链接：https://arxiv.org/abs/2607.08379
作者：Maximilian Woehrer
类目：Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：Quantifying how mirror-symmetric, proposed scoring methods, statistically grounded protocol, underpins applications, medical imaging
备注： 22 pages, 6 figures, 5 tables. Code and benchmark: [this https URL](https://github.com/maxwoe/imgsym)
点击查看摘要
Abstract:Quantifying how mirror-symmetric an image is about a given axis (symmetry scoring) underpins applications from visual aesthetics to medical imaging, yet proposed scoring methods have never been compared on a common, statistically grounded protocol. We benchmark 13 scoring methods (nine collected from literature, four introduced here) spanning from classical features to frozen deep features, across four single-axis and five multi-axis datasets under a reflection-exact protocol with a chance-anchored, significance-tested discrimination skill. Deep backbones perform best on single-axis and harder multi-axis protocols. However, a classical histogram-of-oriented-gradients (HOG) descriptor trails the best frozen-network readout by a small (but significant) margin, is not statistically separable from the runner-up (a CNN-filter measure), and runs ~300x faster on CPU. Our results show that discrimination concentrates in mid-scale oriented features, where deep backbones peak at a low or mid stage, and HOG peaks at a mid cell size. Among existing methods, frozen deep features thus offer little over a tuned classical descriptor for measuring symmetry; whether task-trained deep scorers can do better remains open. We release the scorers and harness in imgsym, an open toolkit for image symmetry detection and measurement.
35. 【2607.08375】WCog-VLA: A Dual-Level World-Cognitive Vision-Language-Action Model for End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2607.08375
作者：Xuerun Yan,Zhexi Lian,Nuoheng Zhang,Shiyu Fang,Haoran Wang,Chen Lv,Jia Hu,Binyang Song
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：autonomous driving, Decoupled Diffusion Transformer, proactive autonomous driving, Aligned Decoupled Diffusion, world
备注： 20 pages, 7 figures
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have advanced end-to-end autonomous driving. However, existing methods either lack comprehensive world cognition or suffer from fragmented world foresight, inherently confining these models to reactive driving. To address this limitation, we propose WCog-VLA, a novel dual-level World-Cognitive VLA framework that successfully bridges semantic world forecasting with generative world evolution to achieve proactive autonomous driving. At the semantic level, WCog-VLA unifies world cognition and reasoning by incorporating 3D spatial perception and injecting agent tokens to capture the world dynamics, while concurrently enabling Game-theoretic Chain-of-Thought (Game-CoT) reasoning. At the generative level, we introduce the Aligned Decoupled Diffusion Transformer (ADDT) as a powerful generative world model that synthesizes physically-plausible joint multi-agent trajectories. Through scene representation alignment, ADDT reduces the number of denoising steps required and thus significantly accelerates inference. To facilitate strategic reasoning, we further construct a large-scale dataset featuring 85k Game-CoT annotations. Extensive experiments on the NAVSIM benchmark demonstrate that WCog-VLA achieves a State-Of-The-Art (SOTA) PDMS score of 92.9.
36. 【2607.08321】xture Representations in Deep Vision Models: Comparing CNNs, Vision Transformers, and Human Perception
链接：https://arxiv.org/abs/2607.08321
作者：Ludovica de Paolis,Marco Baroni,Alessandro Laio,Eugenio Piasini
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Convolutional Neural Networks, Convolutional Neural, Neural Networks, computational vision science, exhibit with neural
备注：
点击查看摘要
Abstract:In computational vision science, Convolutional Neural Networks (CNNs) have emerged as a popular model of biological vision because of the alignment they can exhibit with neural and behavioral data in humans and animals. However, it remains unclear to what extent this alignment persists for visual tasks that extend beyond the canonical object recognition paradigm based on well defined semantic content. In this study, we diverge from the common object-centric view by focusing on another aspect of vision: texture perception. We consider textures of different complexity generated with three different algorithms from the same source images. Using a rank-based statistic, we quantify the information encoded in the internal representations of a CNN and three Vision Transformers (ViTs), and we compare the similarity of these representations to those inferred from human psychophysics data. We find that the representation of textures is aligned in different ViTs, but not between the ViTs and the CNN; that ViTs form similar representations for textures of different complexity; that human performance in recognizing textures can be better predicted from ViTs representations rather than CNN representations. Taken together, these results suggest that ViTs may capture more faithfully than CNNs how texture patterns are visually processed by humans, and that the representations of texture stimuli in computational models may be driven by the network architecture.
37. 【2607.08297】ARGUS: Accelerated, Robust, General, and Unsupervised Cell Tracking Solutions
链接：https://arxiv.org/abs/2607.08297
作者：Noah Jaitner,Kandice Tanner,Ingolf Sack,Hossein S. Aghamiry
类目：Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)
关键词：Background and Objective, providing critical insights, immune cell interactions, Quantitative analysis, modern biological research
备注：
点击查看摘要
Abstract:Background and Objective: Quantitative analysis of cell dynamics is central to modern biological research, providing critical insights into immune cell interactions, disease progression, and drug mechanisms. Automated cell tracking in time-lapse microscopy remains challenging due to noise, morphological variations, overlapping cells, and dynamic events such as divisions and fusions. Methods: We present ARGUS, a framework for Accelerated, Robust, General, and Unsupervised Cell Tracking Solutions. ARGUS combines adaptive cell detection, dense Farneback optical-flow prediction, frame-to-frame linear assignment, and a sequence-level tracklet-refinement step that reconnects trajectory fragments across short temporal gaps. Results: On publicly available Cell Tracking Challenge datasets, ARGUS achieved detection accuracy of 0.905-0.971 and tracking accuracy of 0.897-0.964, with runtimes within 1 minute (5-6 seconds for 3 frames). Conclusions: ARGUS is a modular, interpretable framework that can be adapted to different imaging modalities and biological applications without training data or GPU infrastructure. The implementation is publicly available at this https URL
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Optimization and Control (math.OC)
Cite as:
arXiv:2607.08297 [cs.CV]
(or
arXiv:2607.08297v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.08297
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Hossein Aghamiry [view email] [v1]
Thu, 9 Jul 2026 09:40:38 UTC (3,572 KB)
38. 【2607.08281】Enhancing the KidSat Model: Integrating Geographical Encoding and Data Quality Assessment for Childhood Poverty Prediction
链接：https://arxiv.org/abs/2607.08281
作者：Hou Hin Ip,Ka Nam Lam,Joshua Man Yu Ng,Makkunda Sharma,Seth Flaxman,Codie Gerlach-Wood,H Juliette T Unwin
类目：Computer Vision and Pattern Recognition (cs.CV); Applications (stat.AP)
关键词：Accurate poverty mapping, sparse survey-derived supervision, explicit spatial structure, Accurate poverty, image quality issues
备注：
点击查看摘要
Abstract:Accurate poverty mapping using satellite imagery is often hindered by (i) noisy and sparse survey-derived supervision, (ii) image quality issues such as cloud cover and image corruption, and (iii) lack of explicit spatial structure in image-only models. Building on the KidSat framework, we develop an enhanced pipeline that improves predictive accuracy via refined data preprocessing, systematic image quality assessment, and mathematically defined geographic encoding. First, we refine the fine-tuning target matrix by resolving high-cardinality sparsity and reducing one-hot dimensionality from 103 to 51 via DHS re-aggregation. Second, we introduce a simple two-stage quality-screening procedure to filter heavily clouded or corrupted observations. Third, we fuse DINOv2 visual embeddings with Spherical Harmonics (SH) location features. Across extensive experiments, these changes reduce MAE from 0.2167 to 0.1759, corresponding to an 18.83% relative reduction on the cluster-level severe-deprivation proportion scale. When extended from 16 to 33 African countries, the best-performing configuration achieves an overall MAE of 0.1658. We find that SH features consistently improve performance over the image-only backbone, whereas higher-capacity coordinate Multi Layer Perception augmentation (SH+SIREN) can underperform without carefully designed objectives. Finally, gradient-boosted tree heads (XGBoost/LightGBM) most effectively exploit nonlinear interactions in the fused visual-geographic representation. These findings provide a scalable and principled recipe for improving satellite-based socioeconomic predictions using only publicly accessible data.
39. 【2607.08270】Progression as Latent Drift: Generative Forecasting of Slow-Evolving Pathologies
链接：https://arxiv.org/abs/2607.08270
作者：Yuxiang Feng,Juncheng Wang,Chao Xu,Wenlong Hou,Huihan Wang,Yijie Qian,Yang Liu,Baigui Sun,Yong Liu,Shujun Wan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：slow-evolving neurodegenerative diseases, true progression signals, Forecasting the future, clinical trial design, improve clinical trial
备注： Accepted to ECCV 2026
点击查看摘要
Abstract:Forecasting the future anatomy of slow-evolving neurodegenerative diseases could enable earlier, more targeted intervention and improve clinical trial design, but it remains challenging because true progression signals are subtle in longitudinal MRI. In this low-signal regime, transferring modern generative sequence models directly is unreliable: training is dominated by stable baseline anatomy and confounded by dense, sample-specific nuisance variation. We first provide a theoretical analysis that explains these failures through two modes. Identity collapse occurs when optimization is driven toward reproducing the current anatomy, which prevents the model from learning faint temporal change. The continuous interpolation trap arises when standard smooth networks cannot separate localized biological drift from pervasive noise, which leads to spurious changes that diffuse across the volume. To address both issues, we propose Latent Drift, a progressive generative framework that learns change in a compressed semantic representation rather than synthesizing full-resolution anatomy. This design removes pixel-level identity from the prediction target and concentrates model capacity on progression-relevant dynamics. We further apply Finite Scalar Quantization to the learned change representation, which suppresses small, high-frequency nuisance fluctuations while preserving consistent structural drift. Experiments on longitudinal 3D brain MRI show that Latent Drift improves patient-specific neuro-forecasting over diffusion and autoregressive transformer baselines across generative fidelity and clinically relevant evaluation metrics. Project page: \href{this https URL}{this https URL}.
40. 【2607.08267】UniRef-UAV: A Multimodal Benchmark for Universal Referring in UAV Imagery
链接：https://arxiv.org/abs/2607.08267
作者：Haibin Tian,Huichao Xie,Xuelin Qian,Ruitao Lu,Junwei Han,Dingwen Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned aerial vehicles, complex aerial scenes, Unmanned aerial, localize task-relevant targets, aerial vehicles
备注：
点击查看摘要
Abstract:Unmanned aerial vehicles (UAVs) increasingly rely on visual grounding capabilities to localize task-relevant targets from diverse instructions in complex aerial scenes. Existing referring expression comprehension (REC) benchmarks and methods, however, are largely built around text-only queries and single-object outputs, which limits their applicability to practical UAV scenarios involving reference images, multimodal instructions, absent targets, and multiple valid target instances. To address this gap, we introduce \emph{Universal Referring}, a generalized UAV referring task that jointly expands the query modality and the output cardinality. We construct \emph{UniRef-UAV}, a multimodal benchmark that supports text-only, image-only, and text+image queries with modality-dependent target cardinality, where text-only and text+image queries admit no-target, single-target, and multi-target grounding while image-only queries focus on existence-aware single-instance grounding. It also provides in-domain and cross-domain evaluation protocols for visual-query generalization. We further present \emph{UAV-URNet}, a detection-style baseline that maps heterogeneous queries into a shared query space and predicts variable-size target sets through set prediction. Extensive experiments show that UAV-URNet provides a stable and reproducible baseline with more consistent no-target discrimination and a more lightweight, reproducible implementation than large general-purpose MLLMs. Additional domain analysis, query-representation analysis, and ablation studies demonstrate that multimodal queries help reduce visual-query ambiguity and promote a more unified query--target alignment space. The annotations, visual query crops/images, train/validation/test splits, evaluation scripts, and baseline code will be made publicly available to facilitate reproducible research.
41. 【2607.08250】On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting
链接：https://arxiv.org/abs/2607.08250
作者：In-Hwan Jin,Hyeongju Mun,Joonsoo Kim,Kugjin Yun,Kyeongbo Kong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：scene reconstruction remains, reconstruction remains challenging, remains challenging due, spatially varying nature, Dynamic scene reconstruction
备注： Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence
点击查看摘要
Abstract:Dynamic scene reconstruction remains challenging due to the heterogeneous and spatially varying nature of real-world motion. Although recent 3D Gaussian Splatting methods have introduced diverse deformation formulations for dynamic novel view synthesis, each method typically relies on a single deformation model within its representation, which limits robustness across diverse dynamic scenarios. In this work, we study a fundamental problem-multi-deformation modeling for dynamic 3D Gaussian representations-under two distinct integration constraints that differ in when and how multiple deformation experts interact during training. From a Mixture-of-Experts (MoE) perspective, we view multi-deformation modeling as the problem of combining multiple specialized deformation models within a unified 3D representation. We first introduce Mixture of Deformation Experts (MoDE), which integrates multiple deformation experts directly into the deformable Gaussian Splatting pipeline through joint optimization. In MoDE, experts operate on a shared canonical Gaussian representation, enabling multi-deformation modeling without introducing additional training stages or modifying the original optimization schedule. In contrast, we further present Mixture of Experts for Dynamic Gaussian Splatting (MoE-GS) under a different integration constraint, where deformation experts are optimized independently and combined through a separate routing stage. As a result, expert interaction occurs over non-canonical Gaussian representations after individual optimization. Together, these two approaches provide alternative strategies for multi-deformation modeling, clarifying how integration constraints shape the design and behavior of deformation experts in dynamic 3D Gaussian representations. Our code is available at: this https URL.
42. 【2607.08249】HSA: Hierarchical Slot Attention for Multi-granularity Scene-Decomposition
链接：https://arxiv.org/abs/2607.08249
作者：Neelu Madan,Rongzhen Zhao,Andreas Mogelmose,Juho Kannala,Joni Pajarinen,Graham W. Taylor,Thomas B. Moeslund
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：iterative competitive attention, object-centric learning, powerful framework, framework for object-centric, iterative competitive
备注：
点击查看摘要
Abstract:Slot attention is a powerful framework for object-centric learning, decomposing visual scenes into latent slots through iterative competitive attention. However, existing methods share two critical limitations: they decompose scenes into a flat set of slots at a single granularity, and this decomposition is based on appearance rather than semantics. Yet humans understand scenes through semantic hierarchies: separating foreground from background, recognizing object categories, and identifying individual instances. Crucially, such semantic hierarchies cannot emerge without supervision, because category names are human constructs, not visual patterns. We propose Hierarchical Slot Attention (HSA), which learns multi-granularity semantic scene decomposition from a single model. HSA decomposes scenes at three levels: holistic (foreground/background), semantic (object categories), and panoptic (individual instances). Using only 10\% labeled data, combined with hierarchical alignment loss, HSA learns all three levels jointly. We further introduce grouping purity and containment to measure whether the hierarchy is encoded in representation space, not just output masks. Experiments on COCO and PASCAL VOC demonstrate that HSA outperforms the strongest flat baseline by up to \textbf{$+$41.5} ARI at holistic, \textbf{$+$14.6} at semantic, and \textbf{$+$10.4} at panoptic level on COCO, with even larger gains on Pascal VOC, while requiring a single model instead of three. Code will be made available upon acceptance.
43. 【2607.08246】SkelGen4D: Weakly-Supervised Skeleton-Based 4D Generation for Text-Driven Mesh Animation
链接：https://arxiv.org/abs/2607.08246
作者：Hao Feng,Zhi Zuo,Jia-Hui Pan,Ka-Hei Hui,Zhengzhe Liu,Dian Zhang,Haoran Xie,Bin Sheng,Jingyu Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：generation to synthesize, content creation, synthesize temporally coherent, animation, synthesize temporally
备注：
点击查看摘要
Abstract:We study 4D generation to synthesize temporally coherent sequences of 3D geometry for animation and content creation. In contrast to existing SDS-based optimization methods and video-driven animation approaches, we adopt a skeleton-driven animation framework aligned with standard industrial pipelines, which enables explicit control and editing. To this end, we propose SkelGen4D, a weakly supervised feed-forward framework for text-driven mesh animation that generates explicit skeleton motions without requiring per-frame skeleton annotations. SkelGen4D first recovers temporally consistent pseudo-skeletons from animated meshes via differentiable fitting, and then generates text-conditioned skeleton motion sequences in a feed-forward manner, further refined with Motion-GRPO to ensure temporally coherent, physically plausible, and articulated animation. We evaluate our method on two large-scale benchmarks, Truebones Zoo and Diffusion4D. Our results show that our weakly supervised skeleton modeling matches or surpasses fully supervised baselines while scaling to diverse object categories for high-quality text-driven mesh animation. Further, our method supports flexible motion editing and is aligned with standard animation production pipelines.
44. 【2607.08241】Closing the Null Space: Guidance-Aware Quantization for Classifier-Free Diffusion
链接：https://arxiv.org/abs/2607.08241
作者：Abdullah Al Shafi,Sumaiya Rahim Suma
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：budgets requires quantization, existing post-training quantization, methods treat CFG, Deploying classifier-free guidance, real-world compute budgets
备注： 6 pages, 5 figures, 3 tables
点击查看摘要
Abstract:Deploying classifier-free guidance (CFG) diffusion models under real-world compute budgets requires quantization, yet existing post-training quantization (PTQ) methods treat CFG models as single-branch networks, ignoring the paired conditional/unconditional structure that CFG inference fundamentally relies on. This structural blind spot has two consequences. At the system level, the two-pass CFG execution pattern imposes a latency overhead that parameter-count and bit-operation metrics conceal entirely, and commodity INT8 inference stacks fail to realize the theoretical efficiency gains that BOPs calculations promise. At the algorithmic level, calibrating against the guidance gap alone admits an exact null space: a quantized model can achieve perfect gap-fidelity diagnostics while the unconditional branch drifts arbitrarily, corrupting every guided prediction at inference time. This paper terms this the branch-drift trap, proves its existence analytically, and confirms it empirically through a false-positive result in which the best-calibrated model by standard diagnostics simultaneously produces the worst sample quality. To close the trap, Guidance-Aware Mixed Precision (GAMP) is proposed, which calibrates directly on the guided prediction, derives per-layer activation-bit sensitivity from guided-output degradation, and allocates bits via a greedy knapsack -- provably preventing unconditional branch drift by construction.
45. 【2607.08236】VTA: Trajectory-Aware Viseme-Guided Temporal Aggregation for Event-Based Lip Reading
链接：https://arxiv.org/abs/2607.08236
作者：Jingrong Zheng,Hongwei Ren,Xiangqian Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual speech recognition, Event-based lip reading, high temporal resolution, recently emerged, promising direction
备注：
点击查看摘要
Abstract:Event-based lip reading has recently emerged as a promising direction for visual speech recognition, benefiting from the high temporal resolution and motion sensitivity of event cameras. However, existing methods typically perform spatial compression before sufficient temporal modeling, which may suppress sparse and localized motion trajectories that are crucial for distinguishing similar lip movements. Moreover, most current approaches optimize temporal representations mainly at the word-classification level, leaving the underlying articulatory structure weakly constrained. To address these limitations, we propose a temporally enhanced framework for event-based lip reading. First, we introduce Trajectory-Aware Differential Aggregation (TDA), which performs local temporal modeling at each spatial location before adaptive spatial aggregation. Second, we propose Viseme-Guided Aggregation (VGA), a unified temporal module composed of a CTC decoder and a viseme-guided gated aggregation branch, which injects viseme-aware sequence supervision and improves final temporal aggregation for word recognition. Third, we incorporate an EMA teacher--student training strategy to enhance robustness under strong event perturbations. Experiments on the DVS-Lip benchmark verify the effectiveness of the proposed design, and extensive ablation studies further validate the contributions of TDA, VGA, and teacher--student consistency. Qualitative decoding results also demonstrate that the proposed CTC-based temporal modeling learns meaningful viseme-aware structure from event streams.
46. 【2607.08233】Playing ZendoWorld: Challenging AI Agents on Active Visual Concept Induction
链接：https://arxiv.org/abs/2607.08233
作者：Sophia Koehler,Antonia Wüst,Inga Ibs,Wasu Top Piriyakulkij,Wolfgang Stammer,Constantin Rothkopf,Kevin Ellis,Kristian Kersting
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：perceive complex inputs, design informative experiments, jointly perceive complex, building intelligent systems, hidden patterns
备注：
点击查看摘要
Abstract:A central challenge in building intelligent systems is enabling agents to jointly perceive complex inputs, form hypotheses about hidden patterns, and design informative experiments to test them. To study this problem, we propose ZendoWorld, a controlled interactive environment in which agents must infer a logical rule about visual game observations, acquire information by proposing new scenes, and refine their hypotheses based on feedback from the game environment. We evaluate several agents spanning pure VLM reasoning, Bayesian particle filtering, dynamic concept discovery, and neuro-symbolic methods. Our main findings are: (1) high accuracy in predicting labels for observed examples does not imply recovery of the underlying rule; (2) perception and induction are distinct bottlenecks for different agent classes; and (3) VLM-based agents propose near-uninformative experiments, failing to actively reduce hypothesis uncertainty. To compare these results, we collect human data on the task, which reveals a gap in inductive reasoning, particularly for more complex rules. Overall, ZENDOWORLD takes an important step toward evaluating intelligent agents and identifies concrete avenues for improvement, particularly in domains like scientific discovery.
47. 【2607.08227】Multimodal 3D LUT Generation via StatLUT with Statistical Features for Photorealistic Style Transfer
链接：https://arxiv.org/abs/2607.08227
作者：Yifan Wang,Zhixiang Hao,Yu Wang,Congchao Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：strictly preserving, Photorealistic Style Transfer, content image, PST, tonal style
备注： 17 pages, 9 figures, 7 tables. Preprint
点击查看摘要
Abstract:Photorealistic Style Transfer (PST) aims to transfer the color and tonal style of a reference to a content image while strictly preserving its structural integrity. However, existing deep learning-based methods inherently suffer from semantic entanglement caused by pre-trained image encoders, leading to unnatural spatial distortions. Moreover, current pixel-level mapping paradigms often ignore color gamut topology, resulting in color banding, while also lacking the multimodal capability for intuitive text-driven control. To address these bottlenecks, we propose StatLUT, an innovative multimodal framework for 3D LUT generation. First, we bypass traditional encoders and introduce a Lab-Extractor to derive spatially-agnostic statistical features, fundamentally decoupling color distributions from structural semantics to ensure artifact-free rendering. Second, we formulate LUT generation as a Transformer-based Seq2Seq translation task, utilizing a Multi-dimensional Residual Mapper (MR-Mapper) to predict topologically smooth 3D LUTs. Finally, to break the single-modal barrier, we propose the H-Diffuser, a lightweight Diffusion Transformer that directly synthesizes statistical features from natural language prompts, enabling flexible text-driven color grading. Extensive experiments on standard benchmarks demonstrate that StatLUT significantly outperforms state-of-the-art methods in both visual quality and quantitative metrics, pioneering a highly robust and flexible paradigm for multimodal photorealistic style transfer.
48. 【2607.08221】LUMI: Tokenizer-Agnostic LLM-Based Lossless Image Compression
链接：https://arxiv.org/abs/2607.08221
作者：Chris Xing Tian,Chengkai Wu,Ziyu Wang,Rongqun Lin,Kecheng Chen,Xiandong Meng,Haoliang Li,Shiqi Wang,Siwei Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large language model, methods typically represent, Large language, compression methods typically, based lossless image
备注： Preprint
点击查看摘要
Abstract:Large language model (LLM)-based lossless image compression methods typically represent pixel data through the native text interface of a pretrained model, converting pixel values into token sequences that the LLM processes through its vocabulary head. This design shows that pretrained language models can provide probability estimates for image coding, but it also couples compression to tokenizer behavior, vocabulary-specific numeric tokens, and model-family-specific adaptation. In this paper, we present LUMI (LLM-based Unified Model-agnostic lossless Image compression), a tokenizer-agnostic framework for lossless RGB image compression with frozen LLM backbones. LUMI replaces pixel-as-text tokenization with a pixel embedding module that maps raw intensity and channel information into the continuous embedding space of the LLM. It further introduces intra-patch position encoding to retain two-dimensional spatial structure after flattening, and uses a 256-way prediction head to produce probabilities over the native pixel alphabet. Only the pixel embedding, position encoding, soft-prefix parameters, and prediction head are trained, while the LLM backbone remains fixed. Experiments on natural, medical, and remote-sensing image benchmarks with LLaMA, Qwen, and Gemma backbones show that LUMI provides a unified interface across tokenizer families, achieves competitive compression rates, and improves cross-domain robustness over tokenizer-based LLM compression baselines. These results formulate LLM-based lossless image compression as pixel-space adaptation of frozen foundation models rather than tokenizer-specific language-symbol modeling.
49. 【2607.08219】Benchmark Evaluation of Feredated Learning on Multi-organ Images
链接：https://arxiv.org/abs/2607.08219
作者：Junbin Mao,Xu Tian,Jianchun Zhu,Ludi Li,Jin Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：substantial variations, medical, federated medical imaging, medical imaging, clinical
备注：
点击查看摘要
Abstract:The privacy requirements of medical data and its substantial variations across organs and modalities hinder the clinical implementation of medical AI. Federated learning (FL) is a feasible approach to overcome these challenges. Due to the continuous emergence of FL algorithms and the highly heterogeneous nature of medical data, objectively evaluating their performance in real-world clinical settings remains difficult. Therefore, a comprehensive federated medical imaging benchmark, serving as a unified evaluation standard, is crucial for advancing the technology toward reliable clinical application. Existing federated medical imaging benchmarks have not yet adequately incorporated state-of-the-art algorithms, are limited to data from single organs or modalities, and overly emphasize model accuracy, making it difficult to comprehensively assess the overall efficacy of FL in real-world medical environments. To address these challenges, we developed the MobenFL benchmark. This benchmark integrates 20 cutting-edge FL algorithms and 22 medical imaging datasets, covering 12 critical organs across the human body, surpassing existing benchmark in breadth. In terms of evaluation dimensions, MobenFL not only assesses performance but also systematically incorporates key metrics such as algorithmic efficiency and privacy protection capabilities. Additionally, it conducts specialized evaluations for complex real-world clinical scenarios involving different diseases, devices, and imaging modalities, thereby providing a comprehensive and in-depth evaluation framework for the clinical application of FL in the medical field.
50. 【2607.08203】Metrics or Mirage? An Audit of Evaluation Inconsistencies in Colonoscopy Polyp Segmentation Benchmarks
链接：https://arxiv.org/abs/2607.08203
作者：Aisha Urooj,Zain Ul Abdien,Neelu Madan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：public benchmarks, textbf, set of public, textit, polyp segmentation
备注： Submitted to ECCV Workshops
点击查看摘要
Abstract:Progress in colonoscopy polyp segmentation is routinely reported through leaderboard comparisons on a small set of public benchmarks. We argue that this apparent progress is difficult to verify: a systematic audit of \textbf{27 papers} published between 2015 and 2026 reveals three structural problems in how the community evaluates models. \textbf{First}, 25 of 27 papers \textit{omit the Hausdorff distance}. Hausdorff distance is a boundary-accuracy metric with direct clinical relevance for detecting flat or small polyps, and is a standard in radiotherapy segmentation. \textbf{Second}, at least five \textit{incompatible train/test split protocols} co-exist across papers reporting results on the same two datasets (Kvasir-SEG and CVC-ClinicDB), making published Dice scores non-comparable even when they appear in the same leaderboard column. \textbf{Third}, 26 of 27 papers make \textit{performance claims without any statistical significance test}. Strikingly, four papers published \emph{after} the Metrics Reloaded framework~\cite{metricsreloaded2024} (Maier-Hein et al., \textit{Nature Methods} 2024) perpetuate these same problems, suggesting that general-purpose metric guidance has not yet reached the colonoscopy sub-community. To show these problems are not merely cosmetic, we re-evaluate five representative models under three controlled protocols with a single uniform scorer, and find that the reported metric conceals large boundary and recall failures, that the ``best'' model changes with the metric, and that near-tied rankings reverse across random splits. We propose a five-point \textbf{Polyp Segmentation Reporting Checklist}~(PSRC) as a lightweight, domain-adapted corrective.
51. 【2607.08201】MI: Text-to-Image Meets Image-to-Image for Complementary Data Synthesis to Boost Long-Tailed Instance Segmentation
链接：https://arxiv.org/abs/2607.08201
作者：Hyeonseop Song,Seokhun Choi,Hoseok Do
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：fine-grained inter-class ambiguity, Large-vocabulary instance segmentation, long-tailed category distributions, inter-class ambiguity, Large-vocabulary instance
备注： Accepted to ECCV 2026. The first two authors contributed equally to this work
点击查看摘要
Abstract:Large-vocabulary instance segmentation is constrained by long-tailed category distributions and fine-grained inter-class ambiguity. While data synthesis offers a promising alternative, current paradigms have complementary limitations: text-to-image (T2I) methods inherit noisy pseudo-labels and struggle on rare classes, whereas copy-paste methods compromise contextual realism. To address these issues, we propose a hybrid pipeline coupling T2I generation with context-aware image-to-image (I2I) editing. The T2I branch provides broad category and scene diversity, while a teacher-student scheme ensures label reliability by selectively retaining only prompt-specified categories. To strengthen supervision for rare classes, we introduce VRAIN (Verified Rare-class Augmentation via INstructed editing), a novel I2I editor. VRAIN inserts high-confidence instances at semantically appropriate locations within in-the-wild scenes, yielding semantically coherent and visually natural edits that reduce domain gaps and enable targeted augmentation. On the LVIS benchmark, our method surpasses existing baselines, improving overall AP by up to +4.0 points and rare-class AP by up to +9.5 points, while scaling effectively with backbone capacity. Our project page is available at this https URL
52. 【2607.08198】Unpaired Joint Distribution Modeling via Multi-Scale Image Representations
链接：https://arxiv.org/abs/2607.08198
作者：Yihang Zou,Hui Zhang,Zuowei Shen,Chenglong Bao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inherently ill-posed due, feasible couplings, paper studies, studies the problem, inherently ill-posed
备注：
点击查看摘要
Abstract:This paper studies the problem of learning a joint distribution from marginal observations, which is inherently ill-posed due to the ambiguity of feasible couplings. We propose LUD-MSR, a latent-variable probabilistic framework that models the joint distribution via auxiliary representations and optimizes evidence lower bounds using only marginal data. Under mild assumptions, we establish an upper bound on the distribution approximation error. This analysis reveals a trade-off in representation learning between domain consistency and information preservation. To address this trade-off, we introduce a Multi-Scale image Representation (MSR) mapping that exploits structural similarity at coarse scales while suppressing domain-specific variations. We show that MSR achieves a more favorable balance of this trade-off compared to existing approaches. Experiments on real-world denoising benchmarks, including cryo-electron microscopy (cryo-EM), demonstrate the effectiveness of the proposed framework.
53. 【2607.08194】Dive Into the Implicit Biases of Low-rank Vision-language Alignment
链接：https://arxiv.org/abs/2607.08194
作者：Mingjia Shi,Shuo Wang,Xiaobo Wang,Sifan Zhou,Kai Wang,Tianyu Fu,Chenxu Zhao,Anyang Su,Ping Jiang,Minghui Wu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：bridges pretrained vision, requiring full-parameter updates, pretraining requiring full-parameter, large language models, pretrained vision encoders
备注： Accepted by ECCV 2026
点击查看摘要
Abstract:Vision-language alignment, the stage that bridges pretrained vision encoders and large language models, is widely treated as a form of pretraining requiring full-parameter updates. We challenge this view and investigate what happens when low-rank adaptation is applied to the LLM during this stage instead. We find that low-rank alignment not only reduces computational costs but also outperforms full-parameter alignment on most benchmarks. To understand this phenomenon, we systematically characterize the implicit biases introduced by low-rank adaptation during alignment. Empirically, we find that low-rank alignment shifts model behavior from hallucinatory to conservative and preserves per-token linear separability of visual features that full-parameter alignment disrupts, a phenomenon we term LS-curse. Geometrically, low rank aligned models exhibit more homogeneous and structurally stable visual representations, maintaining modality-specific knowledge rather than prematurely fusing entity-level semantics. Theoretically, we establish two theorems showing that low-rank alignment induces preferences for parameter subspaces with flat gradients and feature subspaces robust to perturbations, providing a principled explanation for the observed structure-preserving behavior. Extensive experiments cover ablation over 100 alignment configurations, three families of low-rank operators, and various rank, encoder, and other settings.
54. 【2607.08191】Dual-Correlation Hypergraph Network for Unaligned RGBT Video Object Detection and A Large-scale Benchmark
链接：https://arxiv.org/abs/2607.08191
作者：Qishun Wang,Yapeng Li,Bin Luo,Zhengzheng Tu,Chenglong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：gained significant traction, significant traction due, conventional RGB-based VOD, RGBT image pairs, challenging conditions
备注：
点击查看摘要
Abstract:RGB-Thermal (RGBT) Video Object Detection (VOD) has gained significant traction due to its ability to overcome the limitations of conventional RGB-based VOD under challenging conditions. However, spatial misalignment commonly exists between RGBT image pairs. To address this, we propose a Dual-Correlation Hypergraph Network (DHNet) that captures high-dimensional complementary information by explicitly modeling two types of correlations: temporal correlation across consecutive frames and spatial correlation from cross-modal features. Specifically, we first design a Patch-based Spatial Alignment Module (PSAM) to sequentially align the multimodal features at the local region level. Subsequently, we introduce a Dual Hypergraph Fusion Module (DHFM), which constructs separate temporal and multimodal hypergraphs to enhance object discriminability through dual-correlation learning. Furthermore, the field currently lacks a large-scale, scene-diverse benchmark dataset for comprehensive evaluation. To address this gap, we construct DVT-VOD1000, a large-scale RGBT VOD dataset containing 1,000 video sequences with 103,464 RGBT image pairs. The dataset covers diverse scenarios, including campuses, parks, transportation, rural areas, night scenes, rain, and snow. Comprehensive experiments on VT-VOD50 and our DVT-VOD1000 demonstrate that DHNet achieves state-of-the-art detection accuracy. The dataset and source code will be made publicly available on this https URL to support academic research.
55. 【2607.08185】Leveraging Color Naming for Image Enhancement
链接：https://arxiv.org/abs/2607.08185
作者：David Serrano-Lozano,Luis Herranz,Michael S. Brown,Javier Vazquez-Corral
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：computer vision, Enhancing images, make them visually, visually appealing, Enhancing
备注： Project page: [this https URL](https://namedcurves.github.io) . arXiv admin note: text overlap with [arXiv:2407.09892](https://arxiv.org/abs/2407.09892)
点击查看摘要
Abstract:Enhancing images to make them visually appealing is a persistent challenge in computer vision. Many deep-learning methods train models on paired datasets to replicate expert editing styles. However, these approaches struggle with two key issues: (1) interpretability and (2) a parametrization suitable for user adjustments. To address these challenges, we present NamedCurves+, an approach inspired by the concept of Color Naming, a universal set of familiar colors widely used in software tools for intuitive editing. Our method integrates color names into a learning-based framework, enabling global adjustments for each named color through tone curves. To address local image variations, we incorporate a transformer block that captures spatial dependencies, enabling context-aware edits across the image. NamedCurves+ enhances the retouching process's interpretability and supports user interaction, allowing flexible modifications of individual tone curves to refine the retouched image according to personal preferences. Extensive experiments on tasks such as image retouching, tone mapping, and exposure correction demonstrate that NamedCurves+ outperforms state-of-the-art methods. Notably, our approach is both explainable, as the tone curves explicitly represent how each color name contributes to the enhancement, and interactive, allowing users to customize the retouching process and achieve results tailored to their liking.
56. 【2607.08182】LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Action
链接：https://arxiv.org/abs/2607.08182
作者：Qi Lyu,Baicheng Liu,Xudong Wang,Jiahua Dong,Lianqing Liu,Zhi Han
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：map multimodal inputs, robot actions, aim to map, map multimodal, multimodal inputs
备注：
点击查看摘要
Abstract:Vision-language-action (VLA) models aim to map multimodal inputs to robot actions. However, most existing approaches struggle to cover complex dynamic scenarios due to treating all visual tokens uniformly and reasoning with human-selected factors, which lack mechanisms to emphasize task-critical evidence and ignore underlying factors. To address this issue, we propose LEEVLA, a VLA architecture for seeing what matters in Latent Environment Evolution that explicitly guides the model toward informative regions while preserving the structured evolution of latent world representations. To identify salient and instruction-relevant regions, we introduce drift-guided dynamic prioritization (DGDP), which combines dynamic position prioritization (DPP) with semantic drift guidance (SDG) to guide the VLA agent where to attend during training. On top of this, we introduce structured feature flow generation (SFFG), which models how these prioritized features should evolve in latent space via prototype-to-periphery (P2P) prediction, and a mutual-neighborhood contrastive (MC) loss to maintain topological consistency among neighborhoods. Together, DGDP and SFFG form a task-aware "where-how" training framework. Extensive experiments on VLA benchmarks show that LEEVLA consistently outperforms prior methods, confirming that explicit task-evidence guidance and structured latent reasoning are both crucial for scalable VLA. Our code is available at this https URL.
57. 【2607.08171】Attention-Based Segmentation of WMHs and Differentiation of Vascular vs. Demyelinating Lesions
链接：https://arxiv.org/abs/2607.08171
作者：Aina Tur-Serrano,Gabriel Moyà-Alcover,Francisco J. Perales López
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：brain Magnetic Resonance, Magnetic Resonance Imaging, Magnetic Resonance, White Matter Hyperintensities, brain Magnetic
备注：
点击查看摘要
Abstract:White Matter Hyperintensities (WMHs) are commonly observed in brain Magnetic Resonance Imaging (MRI) scans. They are associated with various neurological conditions, including vascular and inflammatory demyelinating diseases. Despite differing in etiology, WMHs from these conditions often appear similar on Fluid Attenuated Inversion Recovery (FLAIR) images. This similarity makes differential diagnosis challenging. In this work, we highlight the potential of combining attention-based segmentation with feature-driven classification. This approach supports more accurate and efficient classification between vascular and demyelinating white matter pathologies. For segmentation, we evaluate the effectiveness of attention mechanisms, specifically the Bottleneck Attention Module (BAM) and the Convolutional Block Attention Module (CBAM). We also test different architectures, particularly Attention U-Net. In addition, we explore advanced training strategies, such as patch-based learning and a 2.5D approach, to enhance lesion detection. After segmentation, we extract morphological features from the lesion masks. We then use them to classify WMHs based on their underlying cause. Our experiments utilize five publicly available datasets with diverse imaging protocols to promote model generalizability, despite limited sample sizes. The results suggest that attention-based segmentation and feature-driven classification offer a promising direction for discriminating vascular and demyelinating white matter lesions. Further validation in larger clinical cohorts is still needed.
58. 【2607.08164】Continual Test-Time Adaptation in Computer Vision: Methods, Benchmarks, and Future Directions
链接：https://arxiv.org/abs/2607.08164
作者：Sarthak Kumar Maharana,Shambhavi Mishra,Yunbei Zhang,Shuaicheng Niu,Taki Hasan Rafi,Jihun Hamm,Marco Pedersoli,Jose Dolz,Yunhui Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Deep neural nets, neural nets achieve, nets achieve remarkable, achieve remarkable performance, assumption frequently breaks
备注： TMLR 2026
点击查看摘要
Abstract:Deep neural nets achieve remarkable performance when training and test data share the same distribution, but this assumption frequently breaks in real-world deployment, where data undergoes continual distributional shifts. Continual Test-Time Adaptation (CTTA) addresses this challenge by adapting pretrained models to non-stationary target distributions on-the-fly, without access to source data or labeled targets, while mitigating two critical failure modes: catastrophic forgetting of source knowledge and error accumulation from noisy pseudo-labels over extended time horizons. In this comprehensive survey, we formally define the CTTA problem, analyze the diverse continual domain shift patterns that characterize different evaluation protocols, and propose a hierarchical taxonomy that categorizes existing methods into three families: optimization-based strategies (entropy minimization, pseudo-labeling, parameter restoration), parameter-efficient methods (normalization layer adaptation, adaptive parameter selection), and architecture-based approaches (teacher-student frameworks, adapters, visual prompting, masked modeling). We systematically review representative methods within each category and present comparative benchmarks and experimental results across standard evaluation settings. Finally, we discuss limitations of current approaches and highlight emerging research directions, including adaptation of foundation models and black-box systems, providing a roadmap for future research in robust continual test-time adaptation. We encourage visiting our repository at [this https URL](this https URL)
59. 【2607.08162】ProsMAE: Multi-Source MAE Pretraining for ISUP Grade Classification
链接：https://arxiv.org/abs/2607.08162
作者：Anna Jung,Kyeonghun Kim,Youngung Han,Eunseob Choi,Jiwon Yang,Ken Ying-Kai Liao,Hyuk-Jae Lee,Nam-Joon Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：model training challenging, provide rich diagnostic, rich diagnostic information, limited expert annotation, expert annotation make
备注： Accepted to APCCAS 2026
点击查看摘要
Abstract:Whole slide images (WSIs) provide rich diagnostic information for computational pathology, but their gigapixel scale, stain variation, scanner differences, tissue artifacts, and limited expert annotation make robust model training challenging. This paper presents a multi-source Masked Autoencoder (MAE) framework, named ProsMAE, for histopathology representation learning. Tiles from Prostate cANcer graDe Assessment (PANDA), CAncer MEtastases in LYmph nOdes challeNge 2017 (CAMELYON17), and BReAst Carcinoma Subtyping (BRACS) are used for ProsMAE pretraining to expose the encoder to diverse tissue morphology and acquisition conditions. The learned encoder is transferred for International Society of Urological Pathology (ISUP) grade classification through ProsCLS, using a frozen encoder and a linear classification head. ProsMAE achieved a higher mean validation quadratic weighted kappa (QWK) than the vanilla MAE frozen linear-probe baseline under the evaluated disjoint PANDA split. Repeated-split evaluation remains necessary to further establish robustness across split compositions.
60. 【2607.08161】SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation
链接：https://arxiv.org/abs/2607.08161
作者：Wangyu Wu,Xiaojian Lin,Rong Fu,Zaiyang Yu,Xuhang Chen,Wenjun Yu,Zhenhong Chen
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：natural language processing, natural language, processing that enables, enables users, users to interact
备注： Accepted at IEEE SMC 2026
点击查看摘要
Abstract:Text-to-SQL is a fundamental task in natural language processing that enables users to interact with structured databases using natural language. While large language models (LLMs) have demonstrated remarkable performance on this task, their substantial computational requirements hinder deployment in resource-constrained settings. In this paper, we introduce SQuaD-SQL (Small-Qualified and Distilled for SQL), a novel approach that empowers small language models (SLMs) to approach the performance of LLMs on the Text-to-SQL task while significantly improving efficiency through knowledge distillation and synthetic data generation. Our method comprises three key components: (1) LLM-based synthetic data generation, where structured knowledge is extracted from LLMs via carefully designed prompting strategies; (2) parameter-efficient fine-tuning, enabling full model training on a single consumer-grade GPU; and (3) domain-adaptive fine-tuning, where domain-specific synthetic data further enhances performance in targeted domains. Experiments on the WikiSQL dataset demonstrate that SQuaD-SQL achieves an execution accuracy of 86.9% on the test set, approaching the performance of LLMs while offering faster inference and lower memory usage. These results suggest that, with proper training strategies, SLMs can serve as practical and efficient alternatives for Text-to-SQL applications in resource-limited environments.
61. 【2607.08156】Unified Face Attack Detection via Fine-Grained Semantic Guidance
链接：https://arxiv.org/abs/2607.08156
作者：Ning Jiang,Shijie Yu,Dingheng Zeng,Haiyang Yi,Yanhong Liu,Haifeng Shen,Ying Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：diverse security threats, increasingly diverse security, facial recognition systems, security threats, growing applications
备注： Accepted at ICME 2026
点击查看摘要
Abstract:The growing applications of facial recognition systems are accompanied by increasingly diverse security threats. Existing datasets lack detailed textual descriptions of forgery cues, leading most prior methods to treat face attack detection primarily as a visual recognition task. In this paper, building upon the large-scale MS-UFAD dataset which contains over 8 million attack images, we enrich each image with a fine-grained textual description of forgery cues. Furthermore, we propose a Dual Alignment Forgery Network(DAF-Net) to better leverage these textual information. Extensive experiments demonstrate that our approach extracts more generalizable and semantically meaningful forgery representations from attack images, outperforming both vision-only methods and approaches based on coarse-grained descriptions.
62. 【2607.08127】Understanding and Mitigating the Video-Action Generalization Gap via Temporal Ratio
链接：https://arxiv.org/abs/2607.08127
作者：Utkarsh A. Mishra,Yongxin Chen,Danfei Xu,Yang Liu,Xi Chen,Jiayuan Mao
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Generative video foundation, robotic action data, strong compositional priors, foundation models exhibit, models exhibit strong
备注： 26 pages, 9 figures
点击查看摘要
Abstract:Generative video foundation models exhibit strong compositional priors, yet world-action models (WAMs) and video-action models (VAMs) often lose these priors after finetuning on robotic action data. We refer to this discrepancy as the video-action generalization gap. In this paper, we systematically investigate this gap by evaluating a comprehensive design space of VAMs, demonstrating that standard design choices yield no emergent explanation pattern. To explain this behavior, we introduce the Temporal Ratio (TR), an attention-based measure of how strongly the action head relies on future latent rollouts relative to the anchored current frame. TR has two key properties: first, a model's structural reliance on future-predictive latents, measured via TR, acts as a predictor of its compositional generalization capacity; second, it natively fluctuates based on task phase, shifting attention to future frames during planning and reverting to the present frame for precise manipulation. Finally, based on these findings, we propose an inference-time adaptive guidance method, which exploits this intrinsic feature attention pattern to dynamically amplify compositional video conditioning signals precisely when the policy relies on future rollouts. Evaluated on the LIBERO benchmark and real-world tasks, our approach mitigates the OOD-ID compositional generalization gap. More details: this https URL
63. 【2607.08112】VSRo-200: A Romanian Visual Speech Recognition Dataset for Studying Supervision and Multimodal Robustness
链接：https://arxiv.org/abs/2607.08112
作者：Iulia-Maria Udrea,Alexandra Diaconu,Bogdan Alexe
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real-world podcast videos, Romanian ASR model, fine-tuned Romanian ASR, lip reading, podcast videos
备注：
点击查看摘要
Abstract:We introduce VSRo-200, the first large-scale dataset for visual speech recognition (lip reading) in Romanian, comprising 200 hours of real-world podcast videos. All samples are annotated with pseudo-labels generated by a fine-tuned Romanian ASR model, while a subset of 100 hours is additionally transcribed by humans, enabling controlled analysis of supervision quality under a unified framework. Building on this dataset, we establish a benchmark for visual speech recognition in low-resource settings. We systematically study the impact of supervision quality, showing that while human annotations provide better performance at fixed data scales, pseudo-labels enable continued improvements through scalability. We further evaluate robustness under domain shift using curated out-of-distribution (OOD) test sets, and analyze audio-visual speech recognition (AVSR) under noisy conditions, where multimodal fusion significantly improves robustness compared to audio-only models. Finally, we demonstrate that representations learned on VSRo-200 transfer effectively to the LRRo benchmark for isolated word recognition, substantially outperforming previously reported results. Overall, VSRo-200 provides a new testbed for studying supervision, domain generalization, and multimodal fusion in low-resource visual speech recognition.
64. 【2607.08098】EVIS: A Physics-Grounded Event Camera Plugin for NVIDIA Isaac Sim
链接：https://arxiv.org/abs/2607.08098
作者：Linli Shi,Ruijun Zhang,Ziyun Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：microsecond temporal resolution, high dynamic range, offer microsecond temporal, NVIDIA Isaac Sim, low latency
备注：
点击查看摘要
Abstract:Event cameras offer microsecond temporal resolution, low latency, and high dynamic range, making them attractive for robotics. However, labeled event-camera data for a specific robot and scene is scarce and expensive to collect, which slows the development of event-based perception and control. We present EVIS: a physics-grounded event camera plugin for NVIDIA Isaac Sim that generates high-rate, fully labeled event streams directly inside a physics simulator. The plugin implements a faithful log-intensity contrast event model with per-pixel asynchronous reference updates; it migrates from a normal RGB camera with few changes and integrates into any Isaac Sim / Isaac Lab scene, inheriting the simulator's physics and frame-perfect ground truth. It is fully configurable, and offers an interpolation option that renders only sparse keyframes and synthesizes the in-between frames through bidirectional motion-vector warping, making real-time generation on a single GPU possible. Optional sensor noise and motion blur further narrow the gap to real cameras. The generated streams are directly usable by pretrained event networks for downstream tasks. Code repository: this https URL
65. 【2607.08086】GRE-Diff: Gaussian Room Embeddings for Structured Layout Diffusion
链接：https://arxiv.org/abs/2607.08086
作者：Jing Wang,Haoran Xiong,Zihao Yan,Minglun Gong,Hui Huang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Designing functional, aesthetically coherent floor, plans requires exploring, Toggle, coherent floor plans
备注： 37 pages, 9 figures, conference
点击查看摘要
Abstract:Designing functional and aesthetically coherent floor plans requires exploring a vast space of possible room arrangements, a task that quickly becomes overwhelming for human designers. In this paper, we propose GRE-Diff, a controllable and interactive diffusion-based framework that automates the creation and editing of apartment floor plans under user-specified constraints. By combining AI-generated suggestions with real-time, human-in-the-loop editing, the system enables users to specify room types, room counts, boundary shapes, and editing operations through LLM-parsed instructions or GUI-based interaction. It then generates a diverse set of plausible and well-structured designs for refinement. At the core of our approach is Gaussian Room Embedding (GRE), a continuous latent representation that models each room as a spatial Gaussian distribution capturing its location and extent. Extensive experiments on the RPLAN dataset show that GRE-Diff produces high-quality, constraint-aware, and editable polygonal layouts, offering a practical step toward bridging AI-driven automation and human creativity in spatial design.
Comments:
37 pages, 9 figures, conference
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2607.08086 [cs.CV]
(or
arXiv:2607.08086v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.08086
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Jing Wang [view email] [v1]
Thu, 9 Jul 2026 03:41:54 UTC (16,285 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled GRE-Diff: Gaussian Room Embeddings for Structured Layout Diffusion, by Jing Wang and 3 other authorsView PDFHTML (experimental)TeX Source
view license
Current browse context:
cs.CV
prev
|
next
new
|
recent
| 2026-07
Change to browse by:
cs
References Citations
NASA ADSGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from
our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
Major funding support from
66. 【2607.08085】Mixture of Enhanced-View Experts for Multi-Query Vehicle ReID and A Large-Scale Benchmark
链接：https://arxiv.org/abs/2607.08085
作者：Aihua Zheng,Jie Zhen,Chenglong Li,Jiaxiang Wang,Jin Tang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：leverage complementary information, aims to leverage, leverage complementary, complementary information, Multi-view Alignment Loss
备注：
点击查看摘要
Abstract:Multi-query vehicle ReID aims to leverage complementary information from diverse views for robust feature learning. However, current methods suffer from simplistic feature fusion and thus easily ignores some important view information and cross-view relationships. To handle these problems, this work presents a novel approach called Mixture of Enhanced-View Experts (EV-MoE), which enhances the feature representation of each view and efficiently integrate the view-specific enhanced features by MoE, for robust multi-query ReID. In particular, we design a mixture of enhanced-view experts module, which consists of two parts including view-specific feature enhancement sub-Module (VFEM) and dynamic multi-view fusion sub-Module (DMFM). Moreover, we further introduce Multi-view Alignment Loss (MAL), which aligns features through bidirectional crossview contrastive learning and reconstruction constraints, addressing the challenges of consistency between multi-query features and single-image features. In addition, to evaluate multi-query ReID in real-world environments, we collect LCRI-1K, a largescale vehicle ReID dataset with 1,090 identities, 107,805 images, across 23,637 cameras, where each vehicle appears in an average of 67.5 cameras, providing a comprehensive benchmark to test the robustness in complex environments. Extensive experiments demonstrate the robustness of CAFNet in addressing the multiquery vehicle ReID problem. The code is available at https: //github.com/xiaozhen28/CAFNet.
67. 【2607.08076】LDFE: Laplacian Decoupled Feature Enhancement Block for Dual-Stream CNN-based RGB-IR Object Detection
链接：https://arxiv.org/abs/2607.08076
作者：Wenhao Dong,Xiaoyan Luo,Linlin Yang,Haodong Zhu,Xiaorong Shi,Guodong Guo,Baochang Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：significantly enhance object, enhance object detection, information between RGB, object detection performance, State Space Enhancement
备注：
点击查看摘要
Abstract:The complementary information between RGB and IR images can significantly enhance object detection performance under extreme conditions. Existing methods prefer dual-stream CNN backbones built upon YOLO for feature extraction and focus on the design of feature fusion. In this paper, we introduce the Laplacian Decoupled Feature Enhancement block (LDFE) to fuse features from different stages of the dual-stream CNN backbone. By design, LDFE simultaneously considers the characteristics of modalities and structures for feature fusion by employing global-local decomposition, denoising, fusion, and reconstruction, sequentially. The LDFE first separates features into global and local components based on Laplacian Pyramid, and then performs denoising and fusion based on Global State Space Enhancement module (GS2E) and Local Convolutional Correlation Enhancement module (LC2E) separately. Specifically, the GS2E conducts a two-branch architecture for the main and auxiliary modalities. It dynamically suppresses noise in the main modality through cross-modal attention derived from the auxiliary modality, while employing a State Space Model to capture long-range dependencies within the global feature representations of the main modality. To obtain bidirectional interaction, the two modalities systematically alternate their main/auxiliary roles. Moreover, the LC2E suppresses noise in local features and leverages spatial and channel dimension along with triple convolution to extract fine-grained details for fusion. These innovative designs achieve a significant performance improvement, with mAP surpassing the SOTA methods 6.2%, 3.7%, 4.7%, 2.3%, 4.1% and 2.0% on M3FD, DroneVehicle, LLVIP, FLIR-Aligned, KAIST and VEDAI datasets,respectively.
68. 【2607.08075】UAV-OVVIS: Unmanned Aerial Vehicles Also Need Open-Vocabulary Video Instance Segmentation
链接：https://arxiv.org/abs/2607.08075
作者：Mingyu Dou,Shi Qiu,Ming Hu,Yifan Chen,Zhe Sun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Unmanned Aerial Vehicle, Unmanned Aerial, Aerial Vehicle, UAV, Video Instance Segmentation
备注：
点击查看摘要
Abstract:Unmanned Aerial Vehicle (UAV) videos are widely used in traffic monitoring, urban management, and emergency rescue. However, existing UAV video perception mainly relies on box-level localization and trajectory association under predefined categories, making it difficult to simultaneously support flexible queries and fine-grained instance-level dynamic understanding in open scenarios. To this end, we introduce a new task, UAV Open-Vocabulary Video Instance Segmentation (UAV-OVVIS), which discovers targets in UAV videos according to open-vocabulary queries and outputs instance-level segmentation trajectories with globally consistent identities. Considering the scarcity of instance-level annotations in UAV scenarios, we propose AeroTrack, a training-free unified framework. AeroTrack centers on periodic open-vocabulary detection, short-segment mask propagation, and cross-segment identity unification, reusing existing visual foundation models to enable UAV-OVVIS. Based on this framework, we instantiate five AeroTrack variants and construct AeroVIS, an evaluation benchmark for UAV-OVVIS containing 9 UAV object categories and 8,279 trajectories. Experiments show that AeroTrack substantially outperforms existing general video instance segmentation methods in UAV scenarios and demonstrates strong open-vocabulary robustness and generalization. To support future research, we release AeroTrack and AeroVIS as a unified framework and benchmark for UAV-OVVIS.
69. 【2607.08072】Post-Training in End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2607.08072
作者：Ruining Yang,Muxing Wang,Yixiao Chen,Tongfei Guo,Yi Xu,Can Cui,Zichong Yang,Yitian Zhang,Ziran Wang,Yun Fu,Lili Su
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：map multimodal inputs, multimodal inputs directly, increasingly prominent research, prominent research paradigm, maneuvers have emerged
备注：
点击查看摘要
Abstract:End-to-end models that map multimodal inputs directly to future trajectories/maneuvers have emerged as an increasingly prominent research paradigm in autonomous driving. This class of models includes both Vision-Language-Action models and trajectory-generative planners. Unlike classic machine learning applications, autonomous vehicles operate in safety-critical and interaction-intensive environments where traditional open-loop imitation of expert demonstrations is not sufficient to ensure reliability. In particular, small execution errors can accumulate over time, while recovery behaviors are scarce in training data. In addition, long-horizon objectives such as safety and driving comfort are not captured by pointwise labels either. These limitations have motivated a shift toward post-training techniques, which further refine driving policies beyond pure imitation. This survey presents a unified view of post-training for autonomous driving by defining its scope and organizing the existing literature into four major families based on the form of supervision they use. For each family, we discuss its capabilities, limitations, and open challenges. We aim to facilitate a systematic understanding of this emerging area and stimulate future research on reliable and efficient post-training for autonomous driving.
70. 【2607.08024】APIVOT: Adaptive Planning with Interleaved Vision-Language Thoughts
链接：https://arxiv.org/abs/2607.08024
作者：Emily Jin,Joy Hsu,Yiqing Xu,Weiyu Liu,Nick Haber,Jiajun Wu
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Robotics (cs.RO)
关键词：requires jointly reasoning, planning requires jointly, requires jointly, robot planning requires, semantic task structure
备注： Project Page: [this https URL](https://emilyzjin.github.io/projects/apivot.html)
点击查看摘要
Abstract:Long-horizon robot planning requires jointly reasoning over semantic task structure and geometric feasibility. To successfully execute a task, a robot must decompose goals, select task-relevant objects, and sequence actions, while ensuring that plans satisfy spatial constraints such as limited free space and object collisions. In this work, we propose APIVOT, a VLM-based planner that adaptively interleaves language and visual thoughts for long-horizon planning. APIVOT learns to leverage language for semantic reasoning, while using visual thoughts as imagined future states for internal verification of geometric feasibility. On long-horizon kitchen tasks, APIVOT outperforms general-purpose VLMs and prior planning frameworks, achieving the largest gains in spatially constrained settings. We find that APIVOT learns meaningful modality selection behavior, demonstrating that adaptive interleaving of vision-language thoughts improves both planning success and reasoning efficiency.
71. 【2607.08020】SAGA: Stable Acceleration Guidance for Autoregressive Video Generation
链接：https://arxiv.org/abs/2607.08020
作者：Thanh-Nhan Vo,Trong-Thuan Nguyen,Trung-Hoang Le,Tam V. Nguyen,Minh-Triet Tran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：enables efficient streaming, repeatedly reusing generated, reusing generated latents, amplify temporal errors, resulting in flickering
备注：
点击查看摘要
Abstract:Autoregressive video diffusion enables efficient streaming and long-horizon video generation, but repeatedly reusing generated latents as causal context can amplify temporal errors, resulting in flickering, motion jitter, and structural drift. In this paper, we investigate this failure mode from a spectral kinematic perspective and identify discrete latent acceleration as an effective signal for revealing unstable high-frequency temporal perturbations. To this end, we propose SAGA, a training-free \textbf{\textit{s}}table \textbf{\textit{a}}cceleration \textbf{\textit{g}}uidance approach for \textbf{\textit{a}}utoregressive video generation. SAGA integrates an acceleration domain spectral guidance objective based on finite-window Slepian projections with a structured autoregressive noise initialization strategy that suppresses short-range temporal correlations while preserving long-range motion structure. Without retraining or modifying the backbone, SAGA can be directly applied to existing chunk-wise autoregressive diffusion models, which is the prevalent setting for high-quality generation. Extensive experiments show that SAGA consistently improves temporal quality across multiple autoregressive diffusion models. On Self-Forcing, SAGA improves Temporal Quality from 97.30 to 97.91 and Image Quality from 69.60 to 70.51. Moreover, spectral analysis and human preference studies demonstrate that SAGA reduces temporal instability while maintaining visual fidelity.
72. 【2607.08016】LightCrafter: PBR-Conditioned Video Diffusion Refinement for Controllable and Consistent Relighting
链接：https://arxiv.org/abs/2607.08016
作者：Zixin Guo,Yehonathan Litman,Yifeng He,John Miller,Chuhan Chen,Deva Ramanan
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：physically grounded understanding, intrinsic scene properties, requires balancing long-form, relighting requires balancing, light transport
备注：
点击查看摘要
Abstract:Video relighting requires balancing long-form temporal consistency with a physically grounded understanding of light transport, which depends on accurate estimation of intrinsic scene properties such as materials, geometry, and illumination. Existing methods follow two paradigms: (1) reconstruct a video's photometric properties via inverse rendering and relight them to a target illumination via forward rendering, using physically-based rendering (PBR) or a neural renderer; these suffer from noisy reconstructions and struggle with hard-to-model effects such as global illumination. (2) Frame the task as generative video-to-video translation conditioned on relighting targets (a target environment map or text); this limits relighting control and temporal stability, since diffusion models struggle to translate long-form videos, and is constrained by the availability of input/relit training pairs. We propose LightCrafter, a hybrid pipeline that reformulates video relighting as video translation of a proxy video: rather than translating the input video directly to the target, we translate a PBR rendering of the input under the target illumination to the final target. This bakes illumination targets into the PBR proxy, removing the need to teach the diffusion model illumination concepts like environment maps, and enables more intricate lighting control while naturally providing long-form temporal consistency. We show PBR renders alone already outperform some prior art but struggle with effects like global illumination; to capture these, we leverage photometric priors in video generation models by post-training CogVideoX on synthetic video pairs and real-world unpaired videos. We outperform prior state-of-the-art on existing real-world relighting benchmarks and contribute a synthetic benchmark for further analysis. We will release our dataset, benchmark, metrics, and code.
73. 【2607.08014】FedTR: Federated Learning Framework with Transfer Learning for Industrial Visual Inspection
链接：https://arxiv.org/abs/2607.08014
作者：Vikash Sathiamoorthy,Shuo Huai,Hao Kong,Di Liu,Wendy Yong Yi Loy,Christian Makaya,Daren Ho,Ravi Subramaniam,Qian Lin,Weichen Liu
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：preserving data privacy, collaborative learning scheme, sharing local data, collaborating parties, sharing local
备注： Author's accepted version. Published in Proceedings of the Great Lakes Symposium on VLSI 2024 (GLSVLSI '24)
点击查看摘要
Abstract:Federated learning (FL) is a collaborative learning scheme to train deep learning models, where collaborating parties can consolidate their models without sharing local data with other parties, hence preserving data privacy. Nevertheless, when implementing FL in Industrial visual inspection (IVI), the constraints posed by limited data availability and the intricate nature of the inspection tasks significantly impact the performance of the resulting model. This paper introduces FedTR, a novel FL framework incorporating transfer learning designed for Autonomous IVI, focusing on the challenging task of identifying label defects through end-to-end text recognition. Transfer learning is a method that leverages the knowledge of a pre-trained model to adapt to a different dataset. FedTR initially trains the model using a publicly available dataset, after which performs the essential federated learning process with model fine-tuning on the distributed and limited private data. Extensive experiment results demonstrate the effectiveness and feasibility of FedTR on private ink cartridge datasets for label defect identification. FedTR achieves an end-to-end text recognition word-level accuracy of 95.5% and 94.2% on homogeneous and heterogeneous data respectively. Additionally, it attains performance levels that are on par with those achieved through centralized training.
74. 【2607.08004】LOGOS: Language-guided Oriented Object Detection in Aerial Scenes
链接：https://arxiv.org/abs/2607.08004
作者：Trong-Thuan Nguyen,Minh-Triet Tran
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：poses significant challenges, complex backgrounds inherent, oriented object detection, significant challenges due, Object detection
备注： Accepted to SOICT 2025
点击查看摘要
Abstract:Object detection in geospatial scenes, such as satellite and aerial imagery, poses significant challenges due to the varying orientations and densities of objects, as well as the complex backgrounds inherent to remote sensing imagery. Traditional methods for oriented object detection have struggled to address issues such as angular discontinuity, fixed query sizes, and inefficiencies in handling sparse or cluttered scenes. In this paper, we propose LOGOS, a novel transformer-based approach that leverages textual prompts to guide the detection of oriented objects in aerial scenes. In particular, our proposed approach incorporates prompt-modulated content queries to dynamically adjust the model's focus based on the provided text, thereby improving object detection accuracy in complex environments. Empirically, extensive experiments on the DOTA dataset demonstrate that LOGOS outperforms existing state-of-the-art methods, particularly in densely packed and rotated object scenarios. Our approach offers a significant step forward in improving the robustness and scalability of oriented object detection in remote sensing applications.
75. 【2607.07962】Beyond Thermal Imaging: Inferring Thermophysical Properties from Time-Resolved Thermal Observations
链接：https://arxiv.org/abs/2607.07962
作者：Chenghao Xu,Malcolm Mielle,Olga Fink
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Inferring latent physical, Inferring latent, latent physical properties, thermal, machine perception
备注： 31 pages, In submission
点击查看摘要
Abstract:Inferring latent physical properties from sensory observations is a fundamental challenge in machine perception. Among available sensing modalities, thermal imaging is particularly promising because temperature evolution is directly governed by heat-transfer physics and therefore encodes information about underlying thermophysical properties of a scene. Recovering spatially resolved thermophysical properties from thermal observations could transform applications ranging from digital twins and infrastructure monitoring to robotics and scientific imaging. However, existing thermal scene reconstruction methods can recover temperature fields in complex 3D environments without identifying the thermophyiscal properties that govern thermal evolution, whereas inverse methods provide physically interpretable parameter estimation but typically rely on simplified geometries and controlled experimental conditions. Here we introduce ThermoField, a framework that unifies thermal scene reconstruction and thermophysical parameter estimation through differentiable heat-transfer simulation. The proposed framework represents these quantities as spatially varying neural fields and constrains them through scene geometry, governing heat-transfer physics, and temporal thermal observations. We demonstrate that ThermoField jointly reconstructs geometry, estimates spatially varying thermal diffusivity, and predicts thermal evolution under previously unseen environmental conditions. By integrating neural scene representations with differentiable heat-transfer solver, the framework enables physically interpretable parameter inference in complex 3D scenes. Our results establish a bridge between thermal scene reconstruction and inverse heat-transfer analysis, providing a unified approach for geometry reconstruction, thermophysical property estimation, and predictive thermal simulation from thermal observations.
Comments:
31 pages, In submission
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2607.07962 [cs.CV]
(or
arXiv:2607.07962v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2607.07962
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
76. 【2607.07957】Evaluating the Effect of Frame Rate in Sequence-Based Classification of Autism-Related Self-Stimulatory Hand Idiosyncrasies
链接：https://arxiv.org/abs/2607.07957
作者：Raunak Mondal,Peter Washington
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Autism spectrum disorder, million individuals worldwide, screening remain limited, scalable computational methods, Autism spectrum
备注： 15 pages, 5 figures, 3 tables. Preliminary version presented as a poster at the AMIA 2024 Informatics Summit
点击查看摘要
Abstract:Autism spectrum disorder (ASD) affects over 75 million individuals worldwide, yet scalable computational methods for remote behavioral screening remain limited. This study addresses two complementary challenges in automated detection of autism-related self-stimulatory behaviors from video: (1) identifying the optimal sequence-based neural network architecture and temporal sampling rate, and (2) characterizing data augmentation strategies for training on small behavioral datasets. For the first objective, long short-term memory (LSTM) and gated recurrent unit (GRU) models were trained on pose-derived features from the Self-Stimulatory Behavior Diagnosis (SSBD) dataset at frame sampling intervals of 1, 5, 15, 30, 45, and 90 frames. Both architectures exceeded prior convolutional neural network (CNN) baselines (62-76% accuracy), with peak accuracies of 97.5% (LSTM) and 98.75% (GRU) at a sampling interval of every 15 frames. For the second objective, ten data augmentation strategies were applied to an I3D transfer learning pipeline, with an ablation study quantifying the marginal contribution of each technique. Horizontal flip achieved the highest standalone accuracy (48.78%), while exclusion of upsampling from the augmentation pipeline produced the largest performance degradation, indicating its necessity for complex behavioral video augmentation. A personalized machine learning approach, in which per-subject models were trained and tested on temporally split segments of each video, produced consistent predictions (mean loss 1.84, SD 0.79). These results provide practitioners with concrete guidance on architecture selection, sampling rate, and augmentation strategy for video-based behavioral classification in data-scarce clinical domains.
77. 【2607.07922】Adversarial Decoys: Misdirecting Attention-Based Defenses in ViT
链接：https://arxiv.org/abs/2607.07922
作者：Giulia Marchiori Pietrosanti,Giulio Rossolini,Giorgio Buttazzo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Vision Transformers, recent test-time defenses, test-time defenses mitigate, suppressing image tokens, remain vulnerable
备注：
点击查看摘要
Abstract:Vision Transformers (ViTs) remain vulnerable to localized adversarial attacks, e.g., adversarial patches, while recent test-time defenses mitigate them by suppressing image tokens with abnormally high attention scores. These defenses exploit a strong coupling between attention and adversarial effectiveness: adversarial tokens often need to attract substantial attention to influence the prediction. We introduce adversarial decoys, independently optimized image patches that redirect the attention, and therefore related defenses, toward selected target tokens. Rather than jointly optimizing misclassifications and defense evasion, our approach decouples the two objectives: the original adversarial region induces the incorrect prediction, while a separate decoy manipulates the attention ranking used by the defense. A layer-wise objective increases target-token attention and promotes these tokens above competing non-target ones. Since the decoy is optimized independently of the underlying attack, the method is attack-agnostic and can be easily integrated with any existing adversarial patch attack. Experiments on ImageNet across multiple ViT architectures and attacks show that decoys can redirect high attention scores away from the true adversarial region while preserving much of the attack effectiveness. These results reveal a fundamental limitation of using attention magnitude as an indicator of adversarial relevance.
78. 【2607.07905】3D Reconstruction of deciduous Trees using low-cost UAV- and Crane-based Photogrammetry for Monitoring Shoot Elongation across entire Canopies
链接：https://arxiv.org/abs/2607.07905
作者：Stephan Nebiker,Micha Tschanz,Nando Amport,Frederik Baumgarten
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Tree growth determines, Tree growth, woody biomass, atmosphere and temporarily, temporarily stored
备注： Accepted to ISPRS Congress 2026, camera-ready version
点击查看摘要
Abstract:Tree growth determines how much CO2 is sequestered from the atmosphere and temporarily stored in woody biomass. At the same time tree growth is affected by increasing temperatures, more frequent drought periods, late frosts and other extreme events associated with climate change. While continuous measurements of radial (secondary) tree growth using dendrometers are well established, monitoring of shoot elongation (primary growth) has largely been neglected because suitable measurement techniques are lacking. As a result, the effects of climate change on primary tree growth remain insufficiently understood. This work aims at reconstructing native deciduous trees in 3D as a basis for measuring and monitoring shoot elongation over entire tree canopies. Here we explored the use of low-cost UAV photogrammetry and of a multi-camera CraneCam system under real-world conditions. Data were collected in two study areas over an entire growing season. We present sensor evaluations, photogrammetric data acquisition and processing strategies. A special focus is placed on the analysis of the resulting photogrammetric 3D point clouds in terms of accuracy, resolution and completeness. Results demonstrate 3D point accuracies of 5-6 mm for entire trees using consumer-grade UAVs weighing less than 250 g and a 3D reconstruction completeness between 92% and 98% depending on the UAV type. The paper introduces a novel 3Dprinted ground-truth branch to evaluate the capability to reconstructing fine-detail structures such as thin tree shoots. Finally, we discuss operational challenges and initial experiments towards a skeletonization of entire trees based on photogrammetric point clouds.
79. 【2607.07885】me-to-Collision Based Dynamic Obstacle Avoidance Using Pretrained Vision Models for Robots in Unstructured Environments
链接：https://arxiv.org/abs/2607.07885
作者：Erik Jagnandan,Mulugeta Haile,Gregory Barber,Pratik Chaudhari
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Image and Video Processing (eess.IV)
关键词：unstructured outdoor environments, outdoor environments remains, Dynamic obstacle avoidance, autonomous mobile robots, Dynamic obstacle
备注： 9 pages, 8 figures
点击查看摘要
Abstract:Dynamic obstacle avoidance in unstructured outdoor environments remains a critical challenge for autonomous mobile robots, particularly when large-scale robot-specific training data and simulation-based policies are impractical. We present a data-efficient, interpretable method for vision-based dynamic obstacle avoidance that operates entirely on real-world data, avoiding the sim-to-real transfer problem inherent in simulation-trained policies. Our approach leverages UniDepth, a large pretrained monocular depth estimation model, to produce dense depth maps from RGB video without requiring stereo cameras or LiDAR at inference time. Dynamic obstacle avoidance is achieved by extending the SuperPoint and SuperGlue feature correspondence pipeline to track keypoints across long frame sequences, projecting their 2D pixel-space positions into 3D using camera intrinsics and predicted depth, running bundle adjustment initialized from these 3D keypoints, and computing per-keypoint time-to-collision (TTC). A 2D motion primitive in the ground plane is then selected to move the robot away from the closest point of approach of the minimum-TTC keypoint. Evaluated on real-world data from the M3ED dataset, our pipeline achieves a precision of 0.49 and a recall of 0.38 in identifying frames with a ground truth TTC below 1 second, and correctly generates the evasive motion direction in 84\% of true positive detections. Crucially, it detects at least one frame with TTC less than 1 second for 20 out of 22 unique physical obstacles present in our test sequences. Unlike end-to-end learned methods that demand thousands of hours of robot-specific training data, our approach eliminates model training entirely, requiring only 74 seconds of data for hyperparameter tuning. This demonstrates exceptional data efficiency while preserving interpretable and generalizable behavior across diverse obstacle types.
80. 【2607.07880】GIRAF: Towards Generalizable Human Interactions with Articulated Objects
链接：https://arxiv.org/abs/2607.07880
作者：Xiaohan Zhang,Sebastian Starke,Alexander Winkler,Federica Bogo,Samir Aroudj,Yuting Ye
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Synthesizing realistic full-body, Synthesizing realistic, virtual agents, realistic full-body human, applications in robotics
备注： 12 pages, 6 figures, 3 tables. Accepted at the Third Workshop on Human Motion Generation (HuMoGen), CVPR 2026
点击查看摘要
Abstract:Synthesizing realistic full-body human interactions with articulated objects is a fundamental challenge for embodied AI and graphics, with applications in robotics training and virtual agents. Existing models remain limited: some focus on simple activities with static objects, while others restrict attention to hand-only manipulation. This leaves open the problem of generating coordinated full-body motion that approaches, manipulates, and moves articulated objects in a realistic and generalizable way. The key difficulty lies in reasoning jointly about locomotion, fine-grained contact, and object articulation. Models must capture subtle hand-object correspondences that transfer across object geometries, while also producing seamless transitions from navigation to manipulation. At the same time, the scarcity of large-scale paired motion-scene data makes it difficult to generalize across diverse object positions and shapes. We introduce a text-conditioned diffusion model that addresses these challenges through three core ideas: an object-centric representation that unifies hand-object contact with object surfaces, a mixed-domain training strategy that balances locomotion and interaction, and a contact-based augmentation scheme that expands training diversity. Through experiments, our method demonstrated strong generalization to unseen object configurations, surpassing current state-of-the-art methods.
81. 【2607.07817】DreamCharacter-1: From 3D Generative Foundation Models to Product-Ready Character Generation
链接：https://arxiv.org/abs/2607.07817
作者：Weizhe Liu,Yunjie Wu,Xiangqian Shu,Guangwei Wang,Xiangyu Xu,Peng Li,Yujie Li,Hengkai Guo
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：lightweight post-adaptation framework, calibrates pretrained, models toward high-fidelity, lightweight post-adaptation, post-adaptation framework
备注： Official Page: [this https URL](https://dreamcharacter-x.github.io/)
点击查看摘要
Abstract:We present DreamCharacter-1, a lightweight post-adaptation framework that calibrates pretrained 3D foundation models toward high-fidelity, production-ready 3D character generation. Building upon a 3D foundation backbone, our pipeline incorporates three task-oriented components: (1) geometry post-training, which enhances fine-grained surface details through geometric preference optimization; (2) texture post-training, which synthesizes high-resolution textures and refines the appearance of occluded regions; and (3) inference acceleration, which enables scalable deployment. Extensive quantitative and qualitative experiments demonstrate that DreamCharacter-1 produces visually compelling and structurally robust 3D character assets, consistently surpassing state-of-the-art character generation methods.
82. 【2607.07737】SASGeo: Stability-Aware Semantic Map Localization for GNSS-Denied UAVs -- A Framework and Synthetic Proof of Concept
链接：https://arxiv.org/abs/2607.07737
作者：Natalia Trukhina,Vadim Vashkelis
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：GNSS-denied unmanned aerial, unmanned aerial vehicles, aerial vehicles require, vehicles require occasional, require occasional absolute
备注： 7 pages, 5 figures
点击查看摘要
Abstract:GNSS-denied unmanned aerial vehicles require occasional absolute position fixes to bound the drift of visual-inertial odometry. Cross-view image retrieval can provide such fixes, but raw appearance is sensitive to season, illumination, viewpoint, map age, and sensor modality. We propose \sas, a semantic map-localization framework that represents the environment through persistent structures such as roads, buildings, waterways, railways, intersections, and field boundaries. The method combines semantic raster alignment, relational graph evidence, feature stability and geographic distinctiveness, explicit positive/contradictory/unknown observations, and integrity-aware rejection of ambiguous fixes. Unlike a broad architecture-only proposal, this paper specifies concrete weighting and decision models and reports a reproducible synthetic proof of concept. In 220 randomized retrieval trials with rotation, scale changes, partial crops, occlusion, simulated map changes, and hard semantic decoys, a global semantic descriptor achieved 58.6\% Recall@1, while spatial semantic matching variants achieved 94.5-95.5%. Wilson 95\% intervals separate the global descriptor from the spatial variants but overlap among the spatial variants, so the experiment supports semantic geometry rather than a definitive benefit from each proposed module. The preliminary experiment does not validate real-flight navigation; rather, it demonstrates that structured semantic geometry can discriminate locations under controlled cross-view perturbations and identifies the harder aliasing, map-aging, and rejection tests required next.
83. 【2607.07719】ReCoLoRA: Spectrum-Aware Recursive Consolidation for Continual LLM Fine-Tuning
链接：https://arxiv.org/abs/2607.07719
作者：Wentao Lu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Parameter-efficient fine-tuning adapts, stacking low-rank updates, large language model, sequence LoRA-style methods, Parameter-efficient fine-tuning
备注：
点击查看摘要
Abstract:Parameter-efficient fine-tuning adapts a large language model to one task cheaply, but across a task sequence LoRA-style methods keep stacking low-rank updates on the same frozen weight, so each new task tends to overwrite the previous ones. We present ReCoLoRA (Recursive Consolidation of Low-Rank Adapters), a spectrum-aware framework for continual fine-tuning: adapters are initialized from a randomized SVD of the pretrained weight, per-layer effective ranks are selected by an elbow criterion, and the principal subspace is adapted before residual capacity is opened. Before each new task, ReCoLoRA re-decomposes the current effective weight, rather than the original one, into a frozen residual, a slowly updated principal component, and a fresh adapter (recursive consolidation), so every task starts from the model that has already absorbed its predecessors. On a six-task continual GLUE sequence over four 7-8B backbones, ReCoLoRA attains the best final average score on three of the four backbones against rank-swept LoRA, PiSSA, AdaLoRA, and DoRA baselines while training fewer parameters; an oracle-routed task-bank variant serves as an upper bound under full task isolation. Code: this https URL.
84. 【2607.07717】Who Gets Missed in the Tail? Thresholded Subgroup Underdiagnosis in Long-Tailed Chest X-ray Classification
链接：https://arxiv.org/abs/2607.07717
作者：Ha-Hieu Pham,Hai-Dang Nguyen,Dang P. M. Cao,Thanh-Huy Nguyen,Min Xu,Trung-Nghia Le,Ulas Bagci,Huy-Hieu Pham
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：leave rare-positive patients, chest X-ray, acceptable ranking performance, leave rare-positive, rare-positive patients
备注：
点击查看摘要
Abstract:In chest X-ray (CXR) classification, acceptable ranking performance can still leave rare-positive patients below threshold, especially within subgroups. We study this pre-deployment fairness problem as an audit question: after a long-tailed multi-label CXR model is converted from scores into decisions, who is missed? Across VinDr-CXR and MIMIC-CXR/CXR-LT, we use a diagnostic ladder to separate class-level long-tail losses, subgroup-aware weighting, group robustness, and threshold selection. On VinDr-CXR, group-tail weighting followed by tail-aware thresholding reduces tail FNR from 0.665 to 0.269, sex worst-group FNR from 0.705 to 0.157, and age worst-group FNR from 0.822 to 0.133, while macro-mAP increases from 0.611 to 0.635. On MIMIC-CXR/CXR-LT, the same score-to-threshold comparison reduces tail FNR from 0.866 to 0.741 and lowers worst-group FNR across sex, age, race, and insurance; residual missed-positive rates nevertheless remain high. Paired bootstrap contrasts on VinDr support the thresholded FNR reductions, and GroupDRO reference runs indicate that aggregate group robustness alone does not remove rare subgroup misses in this setting. The study supports a narrow audit claim: rare-label fairness in CXR depends jointly on the finding, subgroup, and operating threshold, not on label frequency or ranking metrics alone.
85. 【2607.08092】Equivariant Quantum Clustering with Differential Privacy: Parameter-Efficient Privacy-Preserving Analysis Across Heterogeneous Sensitive Datasets
链接：https://arxiv.org/abs/2607.08092
作者：B. M. Taslimul Haq,Md Arifur Rahman,Tawfiq Al Islam Foysal,Abdullah Al Noman,Abir Ahmed
类目：Quantum Physics (quant-ph); Computer Vision and Pattern Recognition (cs.CV)
关键词：maintaining data confidentiality, analyzing sensitive data, enterprise applications, CERT Insider Threat, maintaining data
备注： 24 pages, 10+ tables, multiple figures, research article. Introduces Equivariant Quantum Clustering (EQC) integrating differential privacy with parameter-efficient quantum circuits for privacy-preserving clustering. Evaluated on NSL-KDD, CERT Insider Threat v6.2, and Synthetic MIMIC-III datasets
点击查看摘要
Abstract:Privacy-preserving clustering is critical for analyzing sensitive data in healthcare, cybersecurity, and enterprise applications, where maintaining data confidentiality must be balanced with analytical performance. This paper presents Equivariant Quantum Clustering (EQC), a parameter-efficient framework that integrates symmetry-aware quantum circuits with differential privacy to improve the privacy-utility tradeoff. EQC employs p4m equivariant parameter sharing to reduce circuit complexity while preserving informative feature representations. The framework is evaluated on three privacy-sensitive datasets: NSL-KDD, CERT Insider Threat v6.2, and a synthetic MIMIC-III clinical dataset. On the NSL-KDD benchmark, EQC achieves 79.3% clustering accuracy while reducing membership inference attack success to 38.3% under a privacy budget of {\epsilon} = 1.0 and {\delta} = 10^-5, outperforming representative classical and quantum baselines. Ablation studies indicate that the performance gains primarily arise from parameter-efficient circuit design combined with differential privacy. The results demonstrate that EQC provides a practical quantum-ready framework for secure and privacy-preserving clustering across heterogeneous sensitive datasets.
86. 【2607.08084】ConRad: Efficient Conformal Prediction for Radiomics
链接：https://arxiv.org/abs/2607.08084
作者：Matt Y. Cheung,Ashok Veeraraghavan,Guha Balakrishnan
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Medical Physics (physics.med-ph); Applications (stat.AP)
关键词：support decision making, clinical imaging pipelines, support decision, decision making, imaging pipelines
备注： Code available at [this https URL](https://github.com/matthewyccheung/conrad)
点击查看摘要
Abstract:Radiomic features derived from medical images and segmentation masks are used to support decision making in clinical imaging pipelines. In practice, these features are often computed from predicted masks, but segmentation models can be overconfident or poorly calibrated, making derived measurements appear more reliable than they are. Conformal prediction (CP) provides distribution-free prediction intervals with finite-sample marginal coverage guarantees, but black-box intervals for segmentation-derived radiomics can be inefficient because they ignore test-time information about image appearance, mask geometry, and segmentation uncertainty. We propose ConRad, a conformal framework for scalar radiomic targets that uses covariates derived from the predicted mask, input image, predicted radiomics, and boundary uncertainty to construct adaptive intervals while maintaining coverage. Across five 2D medical imaging datasets and 171 retained radiomic targets, we show that ConRad improves feature-level efficiency compared to baselines while maintaining near-nominal empirical coverage. Ablation results further indicate that segmentation boundary uncertainty features are the largest contributors to interval efficiency.
87. 【2607.07852】False Confidence: Automated Labels Confound Fairness Audits in Cervical Spine Segmentation
链接：https://arxiv.org/abs/2607.07852
作者：Linus Juni,Aasa Feragen,Aditya Parikh
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Computers and Society (cs.CY); Machine Learning (cs.LG)
关键词：Automated segmentation, clinical workflows, cervical-spine MRI, cervical-spine MRI segmentation, labels
备注： 8 pages, 1 figure. Under review at FAIMI 2026 (MICCAI workshop)
点击查看摘要
Abstract:Automated segmentation of cervical-spine MRI is increasingly used in clinical workflows, yet no fairness audit exists for this anatomy. We show that auditing these segmentation tasks is complicated by a common property of modern segmentation datasets: expert-annotated gold labels are expensive, so abundant machine-generated (silver) labels are added to limit annotation cost. This matters because the reference used to judge a model can itself be biased. In this study, we present the first fairness audit of cervical-spine MRI segmentation across sex, age, and race using the CSpineSeg dataset. We observe that the deployed model is demographically fair, but the choice of reference label, however, is not neutral. Because a dataset's silver labels are generated by a model trained on its gold labels, any new model trained on those same gold labels agrees more with the silver labels than with expert truth: scoring identical predictions against silver rather than gold overestimates performance by ~8 Dice points and turns the fairness verdict for age from non-significant to significant - not by the gap inflation Parikh et al. report (which we term false magnitude) but by collapsing within-group variance (which we term false confidence). Reference-label provenance is thus a first-order confounder in segmentation evaluation: performance and fairness should be reported against expert labels, and any fairness claim stated together with the provenance of its reference.
