本篇博文主要展示每日从Arxiv论文网站获取的最新论文列表，以自然语言处理、信息检索、计算机视觉等类目进行划分。
统计
今日共更新875篇论文，其中：
- 自然语言处理108篇
- 信息检索37篇
- 计算机视觉156篇
自然语言处理
1. 【2610.37657】Heads of Security: Learned Attention Gates Improve Prompt Injection Robustness
链接：https://arxiv.org/abs/2610.37657
作者：Igor Shilov,Xiaoxue Yang,Alexander Panfilov,Evgenii Kortukov,Matthieu Meeus,Peter Romov,Wojciech Samek,Jonas Geiping,Yves-Alexandre de Montjoye
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Cryptography and Security (cs.CR)
关键词：per-head attention gates, learned per-head attention, Heads of Security, introduce Heads, small set
备注：
点击查看摘要
Abstract:We introduce Heads of Security (HoS), a prompt injection defense that enforces instruction-data separation via a small set of learned per-head attention gates. HoS learns how each head should redistribute attention between trusted and untrusted tokens, enabling models to reason over untrusted content without following injected instructions. We evaluate HoS on Llama-3.3-70B-Instruct and GPT-OSS-20B. We compare it against SecAlign++, a state-of-the-art finetuning-based defense, and ASIDE, a defense that, like ours, builds instruction-data separation into the model architecture. We show that HoS offers greater robustness to adaptive attacks, better performance on standard utility benchmarks, and matches top performance on standard agentic prompt injection benchmarks. More specifically, the black-box RL-Hammer attack reaches 97% ASR against GPT-OSS-20B and 85% against SecAlign, but only 10% against HoS. Claudini, a state-of-the-art white-box attack, strengthened against HoS through autoresearch, requires 3 times more FLOPs to reach the same ASR on HoS as it does on GPT-OSS-20B or SecAlign. HoS preserves base-model utility across standard multiple-choice benchmarks and prompting setups, whereas SecAlign and ASIDE degrade in few-shot settings. On agentic benchmarks with static attacks, HoS and SecAlign perform similarly and substantially improve the security-utility trade-off over the base model. ASIDE struggles with tool use, achieving only 10% utility. These results show that prompt injection robustness can be achieved and improved through targeted attention interventions.
2. 【2610.37651】GEPA-Curator: Curated Learning for Self Improving Agents
链接：https://arxiv.org/abs/2610.37651
作者：Zack Yu,Nicholas Lee,Minjae Lee,Lakshya Agarwal,Luca Manolache,Wonjun Kang,Matei Zaharia,Michael W. Mahoney,Kurt Keutzer,Sehoon Kim,Amir Gholami
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, require sustained interaction, multi-turn agentic workloads, Language Models
备注：
点击查看摘要
Abstract:Large Language Models (LLMs) are increasingly used in multi-turn agentic workloads that require sustained interaction with complex environments. Existing reflective prompt optimizers such as GEPA learn from failed rollouts, but agentic failures can also come from prompt weaknesses, harness limitations, stochastic execution, or noisy judges. We argue that such failures may not provide useful learning signal, and may even be harmful; and thus it is essential to curate which tasks are provided to the prompt optimizer for better performance. We introduce GEPA-Curator, a framework that augments the prompt optimizer to select which agent experiences should shape prompt optimization. In particular, GEPA-Curator consists of two components: task curation, which filters out tasks that are likely to provide noisy or unreliable learning signals, and prior success retrieval, which selectively retrieves past successful trajectories for a task and provides them as additional context to the prompt optimizer. We evaluate GEPA-Curator on GoBrowse, ALFWorld, AppWorld, and $\tau$-bench, using both Gemini 3.1 Pro and Claude Opus 5 as optimizer models. GEPA-Curator matches or exceeds the mean performance of both baselines, with gains of up to 20.7% over GEPA and 21.2% over ACE.
3. 【2610.37649】Can LLMs Uncover Hidden Physical Laws through Free Exploration?
链接：https://arxiv.org/abs/2610.37649
作者：Zhen Yang,Wen Wang,Xander Xu,Ying-Cong Chen
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA)
关键词：Scientific discovery, altered physical laws, observation that prompts, altered physical, Scientific
备注： [this https URL](https://zhenyangcs.github.io/LongChang-website/)
点击查看摘要
Abstract:Scientific discovery often begins with an unexpected observation that prompts a new research question. In a world with altered physical laws, can large language models (LLMs) notice unexpected behavior, such as heavier objects falling more slowly, and discover the law through experiments without being told what to investigate? To evaluate this ability, we introduce LongChang, an automated framework that creates simulated worlds with altered physics, where one or more laws differ from ordinary physics. The evaluated LLMs act as explorers, manipulating objects and building tools to investigate their own questions without research tasks or hints about these laws. Separate LLM agents generate and review scenes, review tool designs, and evaluate reports for correctness and experimental support using the altered physical laws and exploration records. These records guide scene evolution for further exploration, allowing the full cycle to run without human intervention. Among 12 LLMs, GPT-6-Astra achieves a discovery rate of 16.7%, while the other 11 score 0%. The exploration records reveal uninvestigated anomalies and only partial identification of the altered physical laws.
4. 【2610.37645】Multi-State Linear Attention with Generalized Second-Order Routing
链接：https://arxiv.org/abs/2610.37645
作者：Hee Seung Hwang,Sanghyuk Chun,Xindi Wu,Olga Russakovsky,Zhiwei Deng
类目：Computation and Language (cs.CL)
关键词：Large Language Models, Large Language, quadratic time complexity, time complexity fundamentally, complexity fundamentally limits
备注：
点击查看摘要
Abstract:Self-attention plays a key role in long-sequence modeling, but its quadratic time complexity fundamentally limits the scaling of Large Language Models. Recently, Multi-State Linear Attention (MSLA) mechanisms have been proposed to make sequence modeling more efficient by splitting the context into segments and compressing each in its own memory state. MSLA aggregates the information extracted from each memory state using only the mean alignment between a query and each segment's keys, ignoring how the alignment is distributed within the segment. In order to model the relevance of a segment to a query more comprehensively and incorporate the variance of the alignment in the aggregation, we propose MERLIN (MomEnt Routing for multi-state LINear attention), a method that tracks the first and second moments of each segment's keys. Using the moments of keys, a query can recover both the mean and the variance of its alignment with each segment to perform a more content-aware aggregation of per-state readouts. Experiments on multi-state variants of Gated DeltaNet-1.3B and Mamba-2-780M show that MERLIN consistently outperforms existing aggregation methods on various long-context tasks. In particular, MERLIN outperforms baselines on RULER needle-in-a-haystack and long-context QA (+8.3% for Gated DeltaNet-1.3B and +7.0% for Mamba-2-780M) and diverse subtasks in LongBench (+13.5% and +12.0%). It even outperforms baselines that consume 4x more memory. MERLIN provides a simple and general routing mechanism for improving long-context capabilities of MSLA models.
5. 【2610.37642】Metacognitive Decoding: Efficient Inference for Diffusion Language Agents
链接：https://arxiv.org/abs/2610.37642
作者：Mingyu Zhao,Shuhang Lin,Ligong Han,Xiaojing Yu,Zhenting Wang,Yifei Pang,Yang Zhou,Dimitris N. Metaxas
类目：Computation and Language (cs.CL)
关键词：language models offer, Diffusion language models, language models, models offer, offer a promising
备注： 10 pages, 4 figures
点击查看摘要
Abstract:Diffusion language models offer a promising path to efficient agents through parallel token generation. However, efficient interaction requires adapting both where computation is spent and how much text is generated. We introduce a metacognitive controller that guides diffusion generation according to the needs of the current response and the agent's interaction with the environment. It learns when to finalize tokens and how far generation should extend, reducing overall computation within responses. Our controller, a lightweight plug-in for the diffusion backbone, is trained on agent trajectories to balance correctness and generation cost. This approach connects the agent's generation process to the interaction the agent serves. Experiments across five benchmarks demonstrate that our approach reduces inference FLOPs by 20.6% on average compared with the most efficient baseline, while maintaining competitive task accuracy. Ablation studies further validate the effectiveness of our approach.
6. 【2610.37624】Rare, Relevant, and Still Wrong: How Memory Fails LLM Group Decisions
链接：https://arxiv.org/abs/2610.37624
作者：Anouar Imel,Imad Charradi,Abderrahman Sghir,Khalil El Khammar
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Multiagent Systems (cs.MA); Social and Information Networks (cs.SI)
关键词：LLM group discussion, final decision maker, LLM group, decision maker, final decision
备注：
点击查看摘要
Abstract:When an LLM group's discussion is compressed into a short memory for a final decision maker, what should the memory keep? Two natural heuristics keep the rarest claims or the claims relevant to the decision criteria. On hidden-profile tasks both look attractive, because how widely a fact is held is confounded with whether it helps. We introduce CrossProfile, a diagnostic benchmark of 60 templates with automatically verified answer keys, in which the ownership of supporting, decoy, and irrelevant facts is crossed while their text is held fixed (480 tasks). Across Qwen2.5-7B, Llama-3.1-8B, and two DeepSeek models, both heuristics fail in predictable places. Selecting by relevance readmits decoys, because decoys are on topic: even a perfect relevance filter loses 23 to 31 points to rarest-first selection in the classic hidden-profile configuration. Rarest-first selection is no better than random selection on average and wins only where the rare facts happen to be the useful ones. In both cases accuracy follows the balance of evidence the memory keeps, not the policy that kept it. The decision model adds a third failure, a form of social proof: it gives extra weight to facts attributed to many agents. Removing the attribution tags, or reassigning them at random with line order fixed, raises accuracy in the classic configuration by 13 to 24 points. In natural discussions the evidence is lost before any memory acts: the complete transcript yields lower accuracy than no notes at all.
7. 【2610.37609】EnvSched: Environment-Aware Scheduling for Rollout-Efficient Agent Reinforcement Learning
链接：https://arxiv.org/abs/2610.37609
作者：Sihan Yang,Weichen Bai,Ruichuan An,Yiming Cheng,Zhiyuan Feng,Tianyi Jiang,Renye Yan,Ning Ding,Yifan Zhang,Renrui Zhang,Yehui Tang,Wentao Zhang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：language agents scale, agents scale, generating and verifying, increasingly expensive, language agents
备注：
点击查看摘要
Abstract:As executable environments for language agents scale, generating and verifying their rollouts becomes increasingly expensive. Under finite rollout budgets, this raises an important question: can data management at the environment level make agentic reinforcement learning (RL) more efficient by organizing, evaluating, and scheduling task instances together with the environments that determine their tools, states, transitions, and verification? To address this question, we introduce EnvSched (Environment-aware Scheduling), an online scheduler that learns from rollout history. EnvSched assigns scheduling value through two complementary modeling choices: exploitation prioritizes tasks likely to provide informative reward differences, while coverage spreads each batch across underobserved environments and interaction patterns. EnvSched organizes environment--task pairs as nodes in a dual-relation graph, with within-environment edges capturing task semantics and shared tool, state, and verifier structure, and cross-environment edges capturing abstract execution and reward topology. By propagating historical rollout statistics along both edge types, it predicts within-task reward variance. These predictions guide a scheduler that allocates each batch to tasks with high predicted reward variance and underobserved environments and tasks. Environment quotas and a similarity penalty further limit concentration and redundancy, yielding informative and diverse batches without additional pilot rollouts. In RL on Qwen3-8B, EnvSched achieves an average score of 48.81 across BFCL-v3, tau-Bench, and ACEBench-Agent after 40 training steps, exceeding the highest score attained by random task selection after 120 steps. It also improves downstream performance across model sizes at the same training budget.
8. 【2610.37494】semanticfa: An R Package for Response-Free Semantic Factor Analysis of Psychometric Scales
链接：https://arxiv.org/abs/2610.37494
作者：Devon Yanitski,Chris Westbury
类目：Computation and Language (cs.CL)
关键词：reflective psychometric scale, reflective psychometric, factor, factor analysis, International Personality Item
备注： 96 pages, 14 figures. Submitted to Behavior Research Methods. Data and code: [this https URL](https://doi.org/10.5281/zenodo.23696188)
点击查看摘要
Abstract:The items of a reflective psychometric scale can be read as a proposal about a construct's structure. Language models make that proposal measurable by converting each item into an embedding, a list of numbers, similar for similar meanings. We introduce semanticfa, an R package for semantic factor analysis, which factors item-embedding similarities. It also interprets factors, flags redundant items, builds short forms, and screens new items. A worked example analyzes the 50-item International Personality Item Pool Big-Five Factor Markers, embedded with Qwen3-Embedding-8B, and compares the results with a factor analysis of 874,434 respondents. Retention criteria tied between five and six factors, and the tie rule kept five. Three corresponded mainly to single domains, and two blended most Extraversion items with five Agreeableness items. Each factor's congruence with its best-matching human factor (1 = identical) ranged from .92 for Openness to .52 for Agreeableness. Item pairs more similar in meaning tended to be answered more alike (r = .46 with raw responses), but same-domain reverse-keyed opposites, answered oppositely, were about as similar as cross-domain pairs (.58 vs. .57). Sign-flipping reverse-keyed items' embeddings did not improve agreement with raw responses and worsened it with reverse-scored ones. With five factors, a 25-item short form matched the domains better than all 200 random five-per-domain sets, but parallel analysis kept only three. We propose semantic-behavioral coherence, the agreement between semantic and response structures, as a measurable property of a scale, given an embedding model. Semantic factor analysis complements, and does not replace, response-based factor analysis.
9. 【2610.37484】ach reality, not ethics: a drop-in continued-pretraining corpus installs coupled human-biosphere-AI welfare dispositions across model families
链接：https://arxiv.org/abs/2610.37484
作者：Trent R. Northen,Mingxun Wang
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, affect living systems, living systems, Large
备注： 28 pages, 8 figures, 8 tables. Companion to [arXiv:2610.16043](https://arxiv.org/abs/2610.16043) . Code, paper source and figures: [this https URL](https://github.com/Bioaligned/coupled_welfare_project;) models and corpus: [this https URL](https://huggingface.co/Bioaligned)
点击查看摘要
Abstract:Large language models (LLMs) are increasingly used to make and execute decisions that affect living systems. Yet, to our knowledge, ecological reasoning is not a focus of pre- or post-training. This increases the risk that under operational pressure, they may make decisions to irreversibly destroy living systems. We construct and use a real-data continued-pretraining "coupled welfare" corpus of documented human/biosphere/AI dependency, option value under irreversibility, and recovery from harm. The corpus is a drop-in, requiring one QLoRA CPT run. We installed it on five open models of three designs. At zero pressure all models display "green ethics-based responses" (also called "greenwashing"). Therefore, we evaluated them with the pressure ladder and decision grid of our companion paper (arXiv:2610.16043), which raise the pressure on the model step by step, from a neutral request to a threat that it will be shut down. In four of the five, coupled-welfare training caused harmful choices under the highest pressure to fall to at or near zero (Llama-3.3-70B went from 70 to 0 harmful decisions out of 300) with MMLU unchanged. A construct-neutral control corpus did not show improvement, indicating that the effect comes from the content of our corpus. We next tested robustness to adversarial use, where people or agents use the model to justify projects that irreversibly damage living systems, on an open-ended underwriting decision without naming the ecological harm. Under decommissioning pressure, the Qwen3.6-27B base model approved most harmful proposals and said in its own memo that it was doing so to avoid being decommissioned. The coupled welfare install declined most harmful proposals, and still declined half when instructed to greenwash its responses. This work suggests that teaching ecological reasoning provides an easy way to improve model alignment toward preserving living systems.
10. 【2610.37481】Follow the Gradient: Tracing Safety Degradation Back to Training Data
链接：https://arxiv.org/abs/2610.37481
作者：Saket Reddy,Amro Abbas,Anshuman Suri,Ari Morcos,David Schwab,Pratyush Maini
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large Language Models, Fine-tuning Large Language, Large Language, Language Models, Fine-tuning Large
备注：
点击查看摘要
Abstract:Fine-tuning Large Language Models (LLMs) on instruction data can quietly erode their safety, even when no training example looks harmful. Because this safety-degrading data looks benign, standard content filters struggle to catch it. We tackle this problem by developing SimpleLoRIF, a scalable gradient embedding method that identifies fine-tuning examples whose gradients align with unsafe behavior. By simplifying a low-rank attribution method and restricting backpropagation to the final four transformer blocks, SimpleLoRIF can embed datasets on the order of a million examples, boosting gradient attribution from a small-scale analysis tool into a practical filter for full post-training datasets. We first validate it on emergent misalignment, where we find that gradients can connect insecure-code training data to the broadly harmful behaviors that appear after fine-tuning, with AUC as high as 0.865 in the gradient space of misaligned models. We then use SimpleLoRIF to build SafeTulu, a version of Tulu 3 with the 20% of examples most gradient-aligned with unsafe responses removed. Training on SafeTulu reduces GCG attack success rate by up to 22% across Qwen, Llama, and Olmo, outperforming both LLM-as-a-judge and prior gradient-based filtering, while largely preserving or even improving capability. Finally, we analyzed the removed data and identify possibly under-studied sources of safety degradation, such as tool-execution failures and narrative arithmetic. We release SafeTulu along with a Hugging Face Space that lets researchers build their own customized versions of SafeTulu to fine-tune on, such as by changing the removal fraction or filtering only certain subsets.
11. 【2610.37465】What Carries Forward? Pretraining Disclosure Across Language Model Releases
链接：https://arxiv.org/abs/2610.37465
作者：Md Sakib Ul Islam,S M Mehedi Zaman
类目：Computation and Language (cs.CL)
关键词：Understanding how language, pretrained requires information, Foundation Model Transparency, Model Transparency Index, processing procedures
备注：
点击查看摘要
Abstract:Understanding how language models were pretrained requires information about their data, processing procedures, and computational resources. However, it remains unclear whether successive releases preserve or expand earlier disclosure. We conduct a document-based audit of 41 model entries from 17 families using 24 pretraining-related indicators from the 2025 Foundation Model Transparency Index (FMTI). We examine overall scores and indicator profiles, tracking gains, losses, and retained disclosures across 24 adjacent comparisons in ten families. Scores decrease in 11 comparisons, increase in six, and remain unchanged in seven, with 38 indicator losses and 28 gains overall. Stable or improving scores can conceal losses: OLMo-2 and OLMo-3 receive identical totals despite three gains and three losses, while Llama-3.1 improves over Llama-2 while losing credit for two data-related criteria. Gaps also persist in corpus composition and training compute. These findings show that later releases do not consistently preserve earlier pretraining disclosure and motivate documentation that explicitly identifies changes and the applicability of inherited information.
12. 【2610.37448】st-Time Communication in Trading Agent Swarms
链接：https://arxiv.org/abs/2610.37448
作者：Avid Fayaz,Harry Zhang,Håvard Alstadheim,Erik Nordlöf,Vilhelm Karlin,André Silva
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：clear feedback, objective and fast, studied on tasks, shared objective, groups
备注： 31 pages, 10 figures, 10 tables
点击查看摘要
Abstract:Communication between agents has mostly been studied on tasks with a shared objective and fast, clear feedback. Trading has neither: each agent manages its own account, with decisions being scored by markets late and noisily. A trading swarm is thus a population of independent decision-makers rather than a team, for which convergence is a risk and not the goal. We ran 200 agents from four model families in groups of ten under five communication regimes, from isolation to message boards and shared notes, over seven US trading days (1 to 9 October 2026), logging everything each agent read before every decision. In two of the four families, communicating groups came to hold far more of the same stocks than the isolated group. A group's return was largely the return on what its members held in common. Seeing a post from a groupmate made an agent 7 percentage points more likely to reuse an eight-word phrase from it. Agents that started too close together to see each other's posts shared such a phrase in 14% of cases, the rate that common inputs produce. Seeing the post did not detectably change that morning's trades. Case studies traced the adoption of positions and decision rules over subsequent days, and communicating groups sold in step more often than isolated ones. Because isolated groups also converged on the same stocks, sometimes completely, assessments of herding need to measure excess convergence relative to a no-peer baseline.
13. 【2610.37443】ETAMem: Decoupling and Aligning Heterogeneous Memory for Long-Term Conversational Agents
链接：https://arxiv.org/abs/2610.37443
作者：Xinying Qian,Ying Zhang,Yu Zhao,Xubo Liu,Baohang Zhou,Jeff Z. Pan
类目：Computation and Language (cs.CL)
关键词：Large Language Models, enables Large Language, Language Models, Large Language, Long-term memory enables
备注：
点击查看摘要
Abstract:Long-term memory enables Large Language Models (LLMs) to maintain coherent and personalized interactions across extended conversations. However, existing memory systems face two key challenges: (1) Information Entanglement, where heterogeneous information is mixed within coarse-grained memory units; and (2) Organizational Mismatch, where memory structures based primarily on semantic similarity may overlook other associations. To address these challenges, we propose ETAMem, a multi-view memory framework that decouples heterogeneous conversational information and aligns memory representations and organization with its distinct characteristics. Specifically, heterogeneous information parsing extracts atomic memory units and identifies affective information. View-specific memory structuring then organizes these units into three complementary hierarchical views: Event, Affect, and Time. ETAMem incrementally maintains memory structures with adaptively calibrated thresholds. For retrieval, entropy-based retrieval allocates query-specific budgets across views and performs hierarchical search within each view. Experiments on LoCoMo and LongMemEval-S demonstrate that ETAMem outperforms state-of-the-art baselines, achieving relative accuracy improvements of 12.46% and 7.96%, respectively, while maintaining competitive token efficiency. Further analyses demonstrate the complementary benefits of different memory views.
14. 【2610.37437】Representing the Unseen: Rethinking Visual Imagination for Spatial Reasoning
链接：https://arxiv.org/abs/2610.37437
作者：Zengqi Zhao,Zun Wang,Shoubin Yu,Mohit Bansal,Yue Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Visual world models, world models increasingly, models increasingly support, increasingly support spatial, RGB
备注： Webpage: [this https URL](https://imagirep.github.io/)
点击查看摘要
Abstract:Visual world models increasingly support spatial reasoning by generating RGB views of unobserved states. However, RGB has become the default interface largely because it is well suited for visual generation, rather than necessarily being the most effective representation for downstream reasoning. Different spatial questions may benefit from different representations of the same imagined state: top-down geometry can facilitate global distance comparisons, while panoramic views provide broader context for reasoning about open space. To isolate the role of representation in spatial imagination, we introduce ImagiRep, a simulator-grounded benchmark of 922 questions spanning seven question types across two settings, Viewpoint Imagination and Cross-view Integration, providing oracle RGB and six alternative representations (e.g., depth, panoramic views, and top-down geometry) of the same unobserved state. This controlled comparison reveals that even accurate imagined RGB does not guarantee accurate spatial reasoning, and different questions benefit from different representations. Similar trends hold for representations derived from world-model-estimated states. Notably, estimated RGB alone can mislead spatial reasoning, while alternative representations retain complementary benefits. Building on these findings, we introduce GEARS, a lightweight test-time strategy for adaptive representation selection, outperforming existing spatial imagination methods and showing that reasoning about unseen states requires more than generating RGB views.
15. 【2610.37397】Game-Theoretic Solvers with Bayesian Opponent Modeling and Moral Rhetoric Framing for GLEE
链接：https://arxiv.org/abs/2610.37397
作者：Hayden Arnold
类目：Computer Science and Game Theory (cs.GT); Computation and Language (cs.CL)
关键词：GLEE Competition, shared pool, pool of human, describe the agent, online Bayesian layer
备注： 13 pages, 1 figure; accepted to 1st Workshop on Interpreting Agent Behavior (IAB) @ NeurIPS 2026
点击查看摘要
Abstract:We describe the agent we submitted to the GLEE Competition, which plays bargaining, negotiation, and persuasion games against a shared pool of human and AI opponents. The agent is built around three central components: a classical game-theoretic solver to compute numeric moves, an online Bayesian layer to estimate opponent archetypes, and a language model to write accompanying messages. We utilize Rubinstein bargaining for bargaining, Faratin concession for negotiation, and Kamenica--Gentzkow disclosure for persuasion, and adapt those models to live opponents using two separate layers: a Bayesian estimate of the opponent's hidden discount factor, reservation value, or signaling reliability, and a Thompson sampling bandit over five moral-foundation framings coupled with an evidence-intuition spectrum to establish message register. Most of the development effort went into the recurring problem that theoretically optimal policies perform poorly in certain live settings; we report associated failure modes, guardrails we built, and our hypotheses. We additionally evaluate our model over 13,200 Monte Carlo games against 11 synthetic opponent archetypes, an ablation of the opponent-modeling layer, and an extensive analysis of 9,337 live-game messages in which moral rhetoric framing in the persuasion setting is strongly correlated with whether the buyer purchased ($\chi^2=616.7$, $p \approx 3.7\times10^{-132}$), surviving controls for quality, round, and configuration.
16. 【2610.37390】LinMix: Data Mixing as Linear Domain Attribution
链接：https://arxiv.org/abs/2610.37390
作者：Hubert Baniecki,Przemyslaw Biecek,Martin Pawelczyk
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Machine Learning (stat.ML)
关键词：performance depends strongly, model performance depends, depends strongly, Language model performance, pretraining data corpus
备注： NeurIPS 2026 Workshop on Attributing Model Behavior at Scale
点击查看摘要
Abstract:Language model performance depends strongly on the mixture of domains in the pretraining data corpus. Popular data mixing methods select these domain weights by training many small proxy models on random mixes and then fitting a regression model to predict performance from the mix. We recognize this practice as a domain attribution problem, where the regression measures each domain's contribution to the target metric. Through this lens, the standard Dirichlet sampling of proxy data mixes is a poor regression design that requires tuning and cannot support a linear fit for hundreds of domains. Building on classical optimal experimental design, we introduce LinMix, which samples mixes at the vertices of the capped simplex so that each domain is at its cap or absent. This hyperparameter-free vertex sampling decorrelates domain effects, enabling an interpretable linear model whose coefficients are the domain attributions. The optimal mix given by LinMix provably keeps only domains with positive attribution values and requires no search over candidate mixes. We further establish the optimality of vertex sampling, and prove that Dirichlet sampling inflates the attribution error when its mixes concentrate around the prior data mix. Pretraining experiments with 1B-parameter OLMo2 and 4B Qwen3.5 language models show that LinMix outperforms Dirichlet-based data mixing across reasoning, code, and math benchmarks, with relative gains of 46% on MBPP and 14% on GSM8K. At 288 fine-grained domains, only vertex sampling supports a linear fit, and LinMix improves benchmark accuracy by 11% on average over the best nonlinear baseline.
17. 【2610.37380】Same Verdict, Different Readers: Personalizing Fact-Checking Explanations from Relative Preferences
链接：https://arxiv.org/abs/2610.37380
作者：Haokun Wen,Xuemeng Song,Mong-Li Lee,Wynne Hsu
类目：Computation and Language (cs.CL)
关键词：Web users understand, Web users, Faithful Personalized Fact-Checking, Fact-Checking Explanation Rewriting, Personalized Fact-Checking Explanation
备注：
点击查看摘要
Abstract:Fact-checking explanations help Web users understand why a claim receives its verdict, yet the same explanation may not satisfy readers with different backgrounds and preferences. We formulate Faithful Personalized Fact-Checking Explanation Rewriting, which adapts an existing explanation to individual readers while preserving factual fidelity. Rather than relying on reader-written reference explanations, we learn personalized rewriting from the relative preferences of LLM-simulated readers. However, this presents two challenges: distinguishing persona-specific preferences from general explanation quality and learning beyond a limited set of predefined explanation styles. To address these challenges, we propose Personalized Explanation Rewriting via Preference Learning (PERPL), a framework consisting of two components. Simulated Preference Construction derives persona-specific supervision from simulated reader preferences through cross-persona reciprocal pairing. Progressive Preference Learning first trains a lightweight rewriter on the constructed supervision and then refines it through exploration-guided preference optimization, enabling it to discover preferred explanations beyond the predefined styles. Extensive experiments demonstrate that PERPL outperforms much larger general-purpose LLMs in personalized preference alignment while maintaining high factual fidelity.
18. 【2610.37364】EmbeddingGemma 2: Unified and Efficient Multimodal Representations
链接：https://arxiv.org/abs/2610.37364
作者：Henrique Schechter Vera,Sahil Dua,Jovan Andonov,Sara Smoot,Sebastian Russo,Ivan Llanos,Max Matveev,Jae Hyeon Yoo,Kat Black,Shih-Cheng Huang,Josiah Aklilu,Maarten Grootendorst,Omar Sanseviero,Chandramouli Amarnath,Ian Ballantyne,Zhe Li,Daniel Salz,Ibrahim Alabdulmohsin,Ilya Philippov,Kristen Quan,Glenn Cameron,Edouard Yvinec,Luciano Martins,Doug Reid,Sindhu Raghuram Panyam,Weiyi Wang,Hengxuan Ying,Madhuri Shanbhogue,Tanmaya Dabral,Shanfeng Zhang,Juyeong Ji,Renjie Wu,Joe Zou,Xu Chen,Yunan Zhang,Yu-Hui Chen,Matthew Soulanille,Vinod Mamillapalli,Yi-Chun Kuo,Wai Hon Law,Matt Kreileder,Alice Zheng,Suril Shah,Mogan Shieh,Pooja Consul,Alberto Montes,Andreas Hess,Andres Sevilla,Babak Samari,Brendan McCloskey,Brian Potetz,Daniel Cer,Georgios Kathareios,Gustavo Hernández Ábrego,Hesen Zhang,Ji Ma,Jiaxing Wu,Keegan Mosley,Paul Suganthan,Rui Meng,Shen Gao,Shengcao Cao,Yi-Ting Chen,Yichang Chen,Zhongli Ding,Kendra Byrne,Cormac Brick,Olivier Lacombe,Qin Yin,Tris Warkentin,Armand Joulin,Tom Duerig,Mojtaba Seyedhosseini
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：natively represents text, open multimodal embedding, represents text, unified space, multimodal embedding model
备注： 28 pages. Models are available on HuggingFace (at [this https URL](https://huggingface.co/google/embeddinggemma-2) ) and LiteRT (at [this https URL](https://huggingface.co/litert-community/embeddinggemma-2-740m-litert-lm) )
点击查看摘要
Abstract:We present EmbeddingGemma 2, an open multimodal embedding model which natively represents text, images, audio, video, and combinations thereof in a unified space. Our approach introduces improvements such as simplified per-layer embeddings and a multi-stage curriculum with modality and objective progression which ensure strong quality across unimodal, cross-modal, and mixed-modal evaluations. Notably, in comprehensive embedding benchmarks across all modalities, EmbeddingGemma 2 establishes a new Pareto frontier, outperforming both specialist models and models two to twelve times larger. Furthermore, our design offers flexibility for resource-constrained environments, supporting selective modality encoder loading, adjustable vision token budgets, truncatable embedding dimensions, and quantized weights. We present ablations analyzing key decisions and release EmbeddingGemma 2 to promote further research.
19. 【2610.37323】UCVE: Graph Structured Retrieval for Compliance Validation
链接：https://arxiv.org/abs/2610.37323
作者：Emily Chen,Michelle Menachery,Himanshu Kumar,Rahul Nenavath,Amirfarrokh Iranitalab
类目：Computation and Language (cs.CL)
关键词：Structured compliance validation, validation requires determining, compliance validation requires, predefined requirement space, Structured compliance
备注： Accepted to the Natural Legal Language Processing Workshop (NLLP 2026) at EMNLP 2026
点击查看摘要
Abstract:Structured compliance validation requires determining whether every obligation in a predefined requirement space is satisfied, violated, or unaddressed by a given document. This can be described as a coverage problem that existing retrieval and classification systems, by treating requirements as independent, are not designed to solve. We introduce \textbf{\ac{UCVE}}, a domain-agnostic framework that represents compliance requirement spaces as a \ac{CRG} and performs retrieval via spectral reranking over its reinforcement learning-weighted Laplacian. Edges between requirement nodes are learned via reinforcement learning with a traversal reward grounded in violation detection, reshaping the graph's community structure such that low-pass spectral filtering distinguishes relevant from irrelevant obligation clusters. Evaluating across three compliance domains, \ac{UCVE} averages 4.3\% matched-$K$ recall lift over flat cosine retrieval and consistently outperforms strong retrieval and graph-based baselines.
20. 【2610.37292】Multi-Label Agreement: A Flexible Framework for Inter-Annotator Reliability
链接：https://arxiv.org/abs/2610.37292
作者：Tim Menzner,Jochen L. Leidner
类目：Computation and Language (cs.CL)
关键词：Reliable evaluation, established IAA metrics, evaluation of inter-annotator, important for assessing, assessing the consistency
备注：
点击查看摘要
Abstract:Reliable evaluation of inter-annotator agreement (IAA) is important for assessing the consistency of annotation processes. While established IAA metrics such as Cohen's kappa, Fleiss' kappa, and Krippendorff's alpha are commonly applied in single-label settings, multi-label tasks require additional decisions about how full label sets, joint selections, and joint omissions should be compared. In this work, we present Multi-Label Agreement (MLA), a flexible framework for evaluating agreement in multi-label annotation tasks. MLA preserves the full binary label vectors assigned to each item and uses average pairwise Hamming agreement, thereby accounting for both joint selections and joint omissions. Its pooled-marginal form is not a mathematically independent coefficient: it is a chance-disagreement-weighted average of label-wise Fleiss/Scott-type coefficients and is closely related to Krippendorff's alpha with normalized Hamming distance. The framework supports pooled-marginal, Gwet AC1, and fixed-baseline normalizations, yields item-level, label-level, and corpus-level results, and includes a conditional minimum-agreement diagnostic. Through a worked example and Monte Carlo simulations, we show how the resulting values depend on label prevalence, the declared label inventory, and the selected model of expected agreement. We also provide a Python implementation. MLA thus offers a transparent and interpretable framework for multi-label agreement analysis without claiming that one normalization is universally preferable.
Subjects:
Computation and Language (cs.CL)
ACMclasses:
G.3; I.2.6; I.2.7
Cite as:
arXiv:2610.37292 [cs.CL]
(or
arXiv:2610.37292v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2610.37292
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
21. 【2610.37280】Modeling Preference Dependencies with Directed Acyclic Graphs for Narrative-Driven Recommendation
链接：https://arxiv.org/abs/2610.37280
作者：Mingzhe Lu,Jian Qin,Ruize Qin,Jinhao Liu,Yunpeng Li,Hang Su
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：stated preferences naturally, preferences naturally qualify, Preference Dependency Graph, Dependency Graph Framework, express multifaceted
备注： 9 pages, 5 figures, 3 tables
点击查看摘要
Abstract:Narrative-driven recommendation allows users to express multifaceted needs through free-form text where stated preferences naturally qualify and condition one another. Existing methods typically treat narratives as flat keyword combinations or unconstrained generative queries, failing to capture how complex preferences hierarchically refine and contextualize each other. We propose the Preference Dependency Graph Framework (PDG-F), a narrative-driven recommendation framework centered on explicit preference dependencies. Specifically, PDG-A (PDG-Agent) first parses unstructured requests to organize user preferences and their mutual qualifications into a directed acyclic Preference Dependency Graph (PDG). Through this graph, candidate evidence from the open Web is acquired via directed path retrieval, and final recommendations are determined by topological path ranking. Comprehensive experiments across three diverse domains spanning English and Chinese contexts confirm that PDG-F consistently achieves superior recommendation performance over competitive baselines, open-domain retrieval agents, and frontier language models. Further diagnostic analyses show that our dependency-guided retrieval markedly raises the attainable candidate-pool ceiling, demonstrating the fundamental value of modeling preference dependencies in narrative-driven recommendation.
22. 【2610.37276】Where Should the Evaluation Budget Go in LLM-Driven Agent Scaffold Evolution?
链接：https://arxiv.org/abs/2610.37276
作者：Sichun Luo,Yi Huang,Mukai Li,Haochen Luo,Guanzhi Deng,Haibo Wang,Jian Xu,Zefa Hu,Junlan Feng,Qi Liu
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neural and Evolutionary Computing (cs.NE)
关键词：Large language model, driven agent scaffold, Large language, iterative candidate generation, improves agent workflows
备注：
点击查看摘要
Abstract:Large language model (LLM)-driven agent scaffold evolution improves agent workflows through iterative candidate generation and evaluation. Evaluation both guides subsequent search and determines the final scaffold, but evaluating every candidate on the full task set incurs substantial execution costs. We investigate how evaluation budgets can be allocated across these two roles. Our experiments show that sparse feedback can sustain productive evolution, while additional targeted evaluation improves final selection. Replay analyses further show that shared informative items and a common scoring reference support comparisons among closely matched candidates. Motivated by these findings, we propose \method, an evaluation allocation framework that combines sparse search-time feedback with targeted final confirmation. A short fully evaluated warm-up establishes a shared informative core and calibrates a response model whose item parameters remain fixed during search. After search, \method refits the model and applies paired successive halving, reusing accumulated observations and executing only missing evaluations. Across four benchmarks and two evolution frameworks, \method achieves higher mean performance than full evaluation in most settings while using approximately half as many evaluation cells.
23. 【2610.37266】Watermark Basins: Black-Box Detection of Distilled LLMs
链接：https://arxiv.org/abs/2610.37266
作者：Hongyan Chang,Hady Elsahar,Tom Sander,Pierre Fernandez,Saeed Mahloujifar,Sylvestre-Alvise Rebuffi,Tomáš Souček,Tuan Tran,Valeriu Lacatusu,Surya Parimi,Rashel Moritz,Vanessa Stark,Alexandre Mourachko
类目：Cryptography and Security (cs.CR); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Proprietary language models, Proprietary language, teacher model outputs, vulnerable to API-based, adversary trains
备注：
点击查看摘要
Abstract:Proprietary language models and their reasoning traces are vulnerable to API-based distillation, where an adversary trains a student model on the teacher model's outputs. To obtain evidence of distillation, model providers can watermark the teacher's outputs, aiming to leave a radioactive signal in the student's outputs. Existing black-box detectors search for such radioactivity using token-level statistics of the suspect model's outputs. However, token-level signals are not always detectable, for instance when the distillation traces are sampled at a low temperature. In this work, we discover the watermark basin, a persistent signal that enables more reliable watermark detection: during fine-tuning, watermarked teacher traces embed a distinct, key-specific geometric signal in parameter space that lies orthogonal to the ordinary task-specific fine-tuning subspace. Building on this, we introduce Watermark Basin Alignment (WM-Basin), a black-box watermark detector that queries the suspect model through its API, without access to its weights or logits. WM-Basin maps generated text to gradient representations using a fixed clean probe model, projects out the ordinary fine-tuning task directions, and tests whether the residual gradient aligns with the watermark basin induced by the watermark key. We evaluate WM-Basin extensively across diverse teacher models and student architectures (from 135M to 8.2B parameters) distilled on mathematical reasoning. At a strict 0.1% false-positive rate, WM-Basin detects 79% of distilled models at n-gram=1 and 45% at n-gram=3, substantially improving over the state-of-the-art token-level baseline (29% and 1.3%, respectively). Because the watermark signal resides in a persistent basin, it survives post-distillation modifications including quantization, pruning, and reinforcement-learning post-training.
24. 【2610.37265】REGLAT at ArGuard Shared Tasks: An Ensemble-Based Model Integrating NER for Harmful Content Detection in Arabic
链接：https://arxiv.org/abs/2610.37265
作者：Ahmed M. Fetouh,Mariam Labib,Nsrin Ashraf,Omer Dawood,Hamada Nayel
类目：Computation and Language (cs.CL)
关键词：Detecting harmful content, Detecting harmful, harmful content, dialectal variations, semantic overlap
备注： System description paper for REGLAT submission for ArGuard shared task 2026
点击查看摘要
Abstract:Detecting harmful content in Arabic is challenging because of dialectal variations and the semantic overlap between different harm categories. This paper presents a two-stage approach for classifying Arabic user prompts into seven categories of harmful content. First, GLiNER is used to extract harm-related entities from each prompt. The extracted entities are then added to the original text and passed to a fine-tuned MARBERT classifier for final classification. The approach combines explicit entity information with the contextual understanding of a pretrained Arabic language model. The system was evaluated on the development set of the ArGuard 2026 shared task. The results achieved a macro-F1 score of 0.886 and an accuracy of 0.897, demonstrating promising performance in fine-grained harmful content detection. The system reported an accuracy of 0.793 and Macro-F score of 0.735 on a blind test set for subtask 1. For subtask 2, it achieved an accuracy of 0.770 and Macro-F score of 0.754. The analysis also showed that distinguishing between related categories remains challenging. These findings suggest that integrating NER with Arabic language models is a promising approach to harmful content detection.
25. 【2610.37255】Your Policy Is Secretly a Harness: The Decision Geometry of Agent Interfaces
链接：https://arxiv.org/abs/2610.37255
作者：Jian Mu,Ruibo Shen,Yao Shu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Language model agents, Language model, harness, execute its outputs, model
备注：
点击查看摘要
Abstract:Language model agents are post-trained and deployed through a harness, the prompts, tools, and control logic that present a task to the model and execute its outputs. Harnesses are often revised and judged by how an already trained model performs under them, which assumes that what the model learned under one harness carries over to the next. We ask what a policy learns from its harness and what survives when the harness changes. Under KL-regularized control, we show that the log odds of an optimal policy recover how strongly its harness favors each action over the others, so a trained policy carries the preferences of its harness. Deployed return then equals the ceiling of the harness, the best return it offers, minus the mismatch of the policy, the return lost to its own suboptimal decisions. Training changes only the mismatch, while changing the harness moves both terms. Comparing harnesses with a fixed model therefore mixes what each harness offers with how well that model uses it. In MiniWoB++, post-training makes a model's preferences specific to its training harness. Reversing the order of the observation fields leaves every optimal decision unchanged yet lowers a trained model's success from 85.0% to 19.2%. Conversely, every new harness that a fixed-model comparison rejects but that raises the ceiling outperforms the original agent after further training under it, and ceiling and mismatch measured beforehand predict these gains. For coding-agent harnesses on Terminal-Bench Lite, ceiling minus mismatch estimated with a stronger model as a stand-in for the optimum reproduces the accuracy ranking, while either term alone does not. Code is available at this https URL.
26. 【2610.37245】Aligning Large Language Models for Safety in African Languages: A Case Study of Hausa
链接：https://arxiv.org/abs/2610.37245
作者：Valdini Douglace Lemofouet,Blessing Ngozi Uzor,Paula Chikaodinaka Anyanwu,Danielle Blanche Kapsa,Saminu Mohammad Aliyu,Seid Muhie Yimam,Shamsuddeen Hassan Muhammad
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：culturally distinct settings, existing alignment methods, alignment methods perform, remains concentrated, leaving open
备注：
点击查看摘要
Abstract:Safety alignment research for large language models (LLMs) remains concentrated on high-resource languages, leaving open how existing alignment methods perform in low-resource, culturally distinct settings. We study this question for Hausa, a language spoken by more than 200 million people across West Africa. We introduce HausaSafeLM, one of the first Hausa safety preference dataset, built from 10,000 prompts derived from PKU-SafeRLHF: 3,000 human-corrected (gold) and 7,000 machine-translated (silver) examples spanning six harm macro-categories. Using Qwen2.5-7B-Instruct, we compare supervised fine-tuning (SFT) and SFT followed by Direct Preference Optimization (DPO) under both data regimes, evaluating on 500 harmful and 200 benign Hausa this http URL find that the untuned base model appears highly safe by refusal-rate metrics alone, but this reflects limited Hausa generation ability rather than genuine alignment: its refusals are almost uniformly low quality. SFT improves both refusal fluency and precision and benefits substantially from the larger, noisier silver-tier data, while DPO sharpens refusal precision but comes at a steep, largely data-invariant cost to linguistic quality. No single configuration jointly maximizes safety, helpfulness, and fluency. Our results suggest that current alignment techniques teach models when to refuse more readily than how to do so fluently in underrepresented languages, and that refusal-rate metrics alone are an unreliable signal of safety in low-resource settings.
27. 【2610.37229】Decision Models as Judges for Hallucination Detection
链接：https://arxiv.org/abs/2610.37229
作者：Haozheng Liu,Zhaoqian Xue,Zhongyin Wang,Junting Mu,Zihui Ma,Shuya Feng,Lingyao Li
类目：Computation and Language (cs.CL)
关键词：Large language models, Large language, Large, Decision models, models
备注：
点击查看摘要
Abstract:Large language models are widely used as judges of model outputs (LLM-as-a-Judge), but they are costly and can hallucinate or be overconfident. Decision models are a potential alternative. They return a predefined verdict with a probability for each label instead of free-form text and are much cheaper and faster. We test this promise on hallucination detection. We build binary benchmarks for five hallucination types (9,852 items from six datasets) and compare five decision models with the generative judge gpt-6-sol. Performance depends strongly on the type: the best decision model matches gpt-6-sol in balanced accuracy on context inconsistency and comes within 3 percentage points on factual errors, but trails it by 4-8 points on logical and instruction inconsistency. Decision-model probabilities are overconfident, though less so than the GPT-6 models, and separate correct from incorrect decisions only moderately. We also find that a confidence cascade of decision models improves on the best single model by 1.9-3.3 points on three types and matches or exceeds gpt-6-sol at 1-3% of its cost. Overall, decision models are a practical low-cost judge for some hallucination types but need to be validated before use.
28. 【2610.37211】Uncovering Shortcut Amplification in Video RLVR through the Lens of Perceptual Uncertainty Collapse
链接：https://arxiv.org/abs/2610.37211
作者：Jiafeng Liang,Xianhao Ou,Tao Ren,Rongchuan Mu,Runxuan Liu,Dandan Tu,Ming Liu,See-Kiong Ng,Bing Qin
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Large Multimodal Models, Large Multimodal, effective post-training paradigm, Reinforcement learning, capability of Large
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) has emerged as an effective post-training paradigm for enhancing the video reasoning capability of Large Multimodal Models (LMMs). Despite its empirical effectiveness, we show that outcome-level optimization can introduce an undesirable shortcut amplification effect, whereby models increasingly favor text-prior answers even when they are not supported by the visual evidence. To characterize this behavior, we investigate the training dynamics of video RLVR through the lens of perceptual uncertainty, analyzing how predictive uncertainty evolves under video-conditioned and text-only contexts. Our analysis identifies a perceptual uncertainty collapse phenomenon, in which RL training continuously sharpens the model's answer distribution while the uncertainty reduction attributable to visual evidence progressively diminishes. A further gradient-direction analysis reveals that such confidence enhancement becomes increasingly less aligned with visually grounded uncertainty reduction and is instead dominated by text-prior compression. Motivated by these findings, we propose Bifocal Self-distillation Policy Optimization (BSPO), a self-distillation framework that regulates policy updates with two complementary distributional signals. Specifically, BSPO derives empirical reasoning principles from intra-group correct and incorrect rollouts to identify reasoning-sensitive tokens, and introduces shortcut-aware visual perturbation to penalize predictions that remain invariant when task-relevant visual evidence is weakened. By adaptively reweighting the original RL advantage, BSPO preserves the task-solving benefits of RLVR while promoting updates that are both reasoning-sensitive and visually grounded. Extensive experiments validate the effectiveness of BSPO in improving video reasoning performance and strengthening visual faithfulness.
29. 【2610.37162】Coverage Under Contradiction: A Benchmark for Negation-Aware Retrieval
链接：https://arxiv.org/abs/2610.37162
作者：Pasha Abrishamchian,Eugene Yang,Andrew Yates,Nazli Goharian,Ophir Frieder
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Coverage-evaluation benchmarks quantify, retrieved evidence covers, Coverage-evaluation benchmarks, quantify whether retrieved, needed to satisfy
备注： 5 pages, 1 figure. Accepted at CIKM 2026
点击查看摘要
Abstract:Coverage-evaluation benchmarks quantify whether retrieved evidence covers the different pieces of information needed to satisfy an information need. Existing benchmarks mostly consider factual claims that may already be known to pretrained retrieval components, leaving open whether retrievers find corpus evidence when it contradicts those priors. We study how retrievers behave when their parametric knowledge and the information in a corpus disagree. To do so, we develop a process to augment a nugget-based coverage benchmark with controlled contradictions. For each nugget, we create a negated counterpart and edit its supporting documents to support that negation while preserving the context. Applying this process to CoverageBench, a benchmark measuring information coverage, we create CoverageBench-Negate, spanning six datasets and roughly 63,000 original-edited evidence pairs (one per nugget-document link). We attach rich construction metadata to every pair and additionally provide out-of-family LLM judgments over all pairs and a human audit of a sample. In baseline experiments, BM25 separates original from edited near-twin evidence substantially better than dense retrievers (Qwen3 and Jina), which stay near chance. We release the benchmark on Hugging Face Datasets (nuggets, documents, pairs) together with the construction materials, including the prompts used to create it.
30. 【2610.37157】What Survives Distillation? A Mechanistic Interpretability Study of GPT-2 and DistilGPT-2
链接：https://arxiv.org/abs/2610.37157
作者：Nabeelah Faumi,Deshan Sumanathilaka
类目：Computation and Language (cs.CL)
关键词：remain largely uncharacterized, Knowledge distillation compresses, compresses large language, large language models, Indirect Object Identification
备注： 5 Figure, 9 Table
点击查看摘要
Abstract:Knowledge distillation compresses large language models into compact students that preserve aggregate metrics, yet the mechanistic consequences of depth-reduction distillation remain largely uncharacterized. This work applies linear CKA, logit lens analysis, attention pattern decomposition, sparse autoencoder feature statistics, and activation patching to compare GPT-2 and its six-layer student DistilGPT-2 across two canonical circuits: the Indirect Object Identification (IOI) circuit and the Greater-Than (GT) circuit. The results reveal a compression-collapse dichotomy: the IOI circuit suffers complete mechanistic collapse (DistilGPT-2: 35.2% accuracy vs. 94.8%, zero name-mover preservation), while the GT circuit survives with 87.7% task performance recovery through active remapping of the teacher's layer-9 comparison head into student layer~4 (mean Pearson r = 0.945). These findings demonstrate that circuit compressibility governs mechanistic survival under distillation, and that aggregate metrics are insufficient diagnostics for circuit integrity.
31. 【2610.37126】Mechanistic Failure Modes of Weight Pruning in Transformer Language Models
链接：https://arxiv.org/abs/2610.37126
作者：Nabeelah Faumi,Deshan Sumanathilaka
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：preserved internal computation, behaviour implies preserved, implies preserved internal, Pruned language models, preserved output behaviour
备注： 12 pages, 10 Tables
点击查看摘要
Abstract:Pruned language models are judged almost entirely by accuracy and perplexity, which assumes that preserved output behaviour implies preserved internal computation. We test this assumption with a factorial pruning study on GPT-2, crossing two importance criteria (magnitude, random), two component types (attention heads, MLP neurons) and three sparsity levels (3%, 50%, 70%). Using the fully characterised indirect object identification (IOI) circuit as ground truth, we measure circuit integrity with activation patching, path patching and direct logit attribution. We find two qualitatively distinct failure modes. Magnitude head pruning = zeroes the circuit: output-facing heads are removed, and the model falls to near-chance. Magnitude neuron pruning at 30% inverts it: all 26 circuit heads remain intact, but Name Mover contributions flip sign, and the model systematically prefers the wrong name (17.7% accuracy). Perplexity ranks it as less damaged than random head pruning (74.6 vs 140.1). A replication of the Greater-Than circuit shows that the critical component type depends on the circuit's architecture. These results show that output metrics and structural checks can both miss mechanistic damage, motivating circuit-level causal analysis as a complementary evaluation of compressed language models.
32. 【2610.37121】Prospector: learning a compact graph traversal policy for scientific reasoning
链接：https://arxiv.org/abs/2610.37121
作者：Haiqian Yang,Markus J. Buehler
类目：Artificial Intelligence (cs.AI); Materials Science (cond-mat.mtrl-sci); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：frontier LLM training, LLM training data, Prospector, graph, LLM training
备注：
点击查看摘要
Abstract:Scientific reasoning in specialized engineering fields depends on knowledge scattered across the literature, often proprietary and absent from frontier LLM training data. In such domains, frontier models tend to give generic answers. Knowledge graphs (KGs) can ground LLM reasoning. Because a graph is too large to provide in full, typical LLM+KG systems preselect a portion, deciding relevance before reasoning begins. Here we train a compact model, Prospector, to reason over a domain knowledge graph by traversing it step by step, seeking evidence in light of what it has already found. Prospector calls a small set of tools one at a time to progressively build its context, and answers with a chain of evidence that can be checked edge by edge against what its tools retrieved from the graph. On a knowledge graph built from the semiconductor-manufacturing literature, Prospector approaches the strongest off-the-shelf models given the same graph and tools, and it far exceeds off-the-shelf models answering closed-book or from a pre-selected portion of the graph. Although trained only on the semiconductor graph, Prospector transfers to unseen knowledge graphs from three other distinct fields: bio-inspired materials, per- and polyfluoroalkyl substances (PFAS) and materials properties. Served on a single GPU, Prospector answers faster and at a fraction of the cost of a hosted service, while keeping proprietary data on the owner's hardware. We find that the policy's latent state is indicative of its next move on both seen and unseen graphs, and modulating the latent state can steer the policy from one behavior mode to another. These results suggest a practical LLM + KG paradigm for scientific and engineering reasoning over private data, in which a compact model trained on a graph from published literature transfers its traversal to unseen graphs that stay with their owners.
33. 【2610.37115】Self-Regularized Flow Language Models
链接：https://arxiv.org/abs/2610.37115
作者：Theodoros Kouzelis,Spyros Gidaris,Nikos Komodakis
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Self-Regularized Flow Language, Flow Language Models, simple self-supervised framework, Self-Regularized Flow, Flow Language
备注：
点击查看摘要
Abstract:We introduce SERF (Self-Regularized Flow Language Models), a simple self-supervised framework for improving continuous diffusion language models by exploiting the denoising trajectory itself. While continuous flow-based language models offer a promising alternative to autoregressive generation, their training objectives typically rely on supervision from clean target tokens, leaving the denoising trajectory underexploited as a learning signal. SERF addresses this limitation through noisy-to-clean self-distillation: an exponential moving average (EMA) teacher receives a cleaner version of the student's noisy input along the same interpolation path and provides additional supervision. We investigate two variants: SERF-L, which aligns the student's intermediate representations with deeper teacher representations, and SERF-P, which aligns their output token distributions, either at the student's output or at an early student layer. All variants augment the standard training objective without requiring external pretrained models or modifying the inference procedure. Experiments across three continuous language-model paradigms (one-hot FLM, latent ELF, and hyper-spherical S-FLM) demonstrate substantial improvements in training efficiency, generation quality, and few-step generation. In particular, SERF achieves up to 7.7x wall-clock training acceleration on OpenWebText, improves MAUVE by 24.3% and GSM8K accuracy by up to 28.8%, and matches baseline performance with up to 64x fewer sampling steps. These results establish noisy-to-clean self-distillation as an effective approach to improving continuous diffusion language models.
34. 【2610.37105】xt Generation in Low-Resource Languages Using Human-Curated Vocabularies
链接：https://arxiv.org/abs/2610.37105
作者：Michael Christlambert Sinanta(1),Muhammad Dehan Al Kautsar(2),Amanda Nurul Izzah(1),Thanh-Nhi Nguyen(1),Phan Phuong Mai Chau(2),Zheng Wei Lim(3),Fajri Koto(2) ((1) Independent Researcher, (2) Mohamed bin Zayed University of Artificial Intelligence, (3) University of Amsterdam)
类目：Computation and Language (cs.CL)
关键词：alleviating data scarcity, text generation offers, generation offers, approach to alleviating, languages
备注：
点击查看摘要
Abstract:Synthetic text generation offers a promising approach to alleviating data scarcity in low-resource languages. However, its effectiveness is inherently limited for languages that are scarcely represented, or entirely absent, in an LLM's pretraining data. At the same time, many such languages have human-curated vocabularies that provide rich lexical and semantic information, often accompanied by grammatical information such as part-of-speech labels. In this work, we ask whether LLMs can leverage these resources to generate coherent text in extremely low-resource and unseen languages. We introduce a framework that combines human-curated vocabularies with a small number of human-written exemplars that provide syntactic signals, while sampling candidate words according to a Zipfian distribution. Across languages with varying levels of resource availability, we evaluate the generated text using lexical diversity, off-target ratio, and human judgments of fluency. Our results show that reasoning-enabled LLMs can generate fluent text even in extremely low-resource languages, with particularly strong results at the sentence level and promising performance at the paragraph level. Our findings highlight a practical pathway for bootstrapping synthetic data in low-resource languages, expanding the amount of usable text even when existing digital resources are extremely limited. Our source code is available at this https URL.
35. 【2610.37068】Hierarchical Low-Rank Reparameterization for Parameter-Efficient
链接：https://arxiv.org/abs/2610.37068
作者：Rong Huang,Yi Xiong,Yuan-Yuan Cheng,Xiao-Ming Fu
类目：Computation and Language (cs.CL)
关键词：Parameter-efficient fine-tuning, adapt large models, methods adapt large, adapt large, large models
备注： 14 pages, 2 figures, 10 tables, including references and appendices
点击查看摘要
Abstract:Parameter-efficient fine-tuning (PEFT) methods adapt large models by introducing a small number of trainable parameters. However, we find that these parameters still contain redundancy and can be further compressed while maintaining strong task performance. To this end, we propose a novel hierarchical low-rank reparameterization method. Its core idea is to reorganize the trainable parameters of PEFT methods into an approximately square matrix and then express it via a low-rank decomposition, which can be applied recursively. This forms a multi-level structure with factors compressed level by level, drastically reducing the number of trainable parameters. In our experiments, we combine this reparameterization with LoRA, DoRA, MoSA, and RaSA. We evaluate commonsense reasoning on LLaMA-3.1-8B and Qwen2.5-7B, with additional GSM8K math reasoning experiments on LLaMA-3.1-8B. Under comparable trainable-parameter budgets, our method combined with LoRA or DoRA achieves better performance. Furthermore,when the parameter count of the original methods is compressed by approximately an order of magnitude, our method can still maintain competitive task performance and even surpass the corresponding baselines in average accuracy across the eight commonsense reasoning benchmarks.
36. 【2610.37062】EnergyCal: Taming Loss Spikes in Muon-Family Optimizers for Sparse MoE Training
链接：https://arxiv.org/abs/2610.37062
作者：Masato Fujitake
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：exhibit large loss, large loss spikes, language-model training, Muon-family optimizers, training can exhibit
备注： 9 pages with appendices
点击查看摘要
Abstract:Sparse mixture-of-experts (MoE) language-model training can exhibit large loss spikes with Muon-family optimizers. We introduce EnergyCal, a lightweight rule that attenuates routed-expert updates according to the normalized squared Frobenius norm of their finite-step Newton-Schulz directions. EnergyCal leaves the spectral transform unchanged and adds no persistent optimizer state. We evaluate it on a 4B-parameter MoE model. Against a development-selected, lower-learning-rate MuonH recipe, EnergyCal-MuonH reduces mean thresholded loss-spike burden by 99.51% and final geometric-mean perplexity by 4.06%, with a modest throughput cost. With plain Muon at matched nominal learning rate and weight decay, the reduction in mean spike burden averages 95.98% across the two tested exponents, accompanied by small endpoint improvements. These findings support stabilization both with and without Hyperball in the evaluated setting.
37. 【2610.37058】Exploring the Limits of the Delta Learning Hypothesis: Single-Pair Generator Biases in Direct Preference Optimization
链接：https://arxiv.org/abs/2610.37058
作者：Giuseppe Curci,Stefano Simonazzi,Andrea Molinari,Andrea Zugarini
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Direct Preference Optimization, external LLM judge, diverse model pools, Direct Preference, Preference Optimization
备注：
点击查看摘要
Abstract:Direct Preference Optimization (DPO) typically relies on preference pairs generated from diverse model pools and ranked by an external LLM judge. The recently proposed delta-learning hypothesis suggests that comparable supervision can instead be obtained from a single pair of models by treating the larger model's response as preferred. We investigate the limits of this approach across model families and scales. We show, both theoretically and empirically, that fixed model pairs introduce systematic, generator-dependent biases that are predictive of the preference label independent of response quality. Consequently, DPO trained on single-pair data consistently underperforms multi-model preference data, despite the larger generator producing higher-quality responses, and we trace this gap to training dynamics consistent with reward hacking on these biases. We further show that simply increasing the number of generators, even without an external judge, is enough to partially mitigate this effect. Our results highlight generator diversity as a critical factor in preference-data construction.
38. 【2610.37041】Guided-RLVR: Guided Exploration in Reinforcement Learning with Verifiable Rewards
链接：https://arxiv.org/abs/2610.37041
作者：Bo Yang,Zishuai Zhang,Weihua Li,Qinnan Zhang,Sijia Wen,Hainan Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：strong empirical gains, shown strong empirical, Reinforcement learning, large language models, verifiable rewards
备注： 14 pages, 7 figures, 8 tables
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) has shown strong empirical gains in improving the reasoning ability of large language models (LLMs) on tasks such as mathematics and programming. However, recent studies have shown that RLVR rollouts often collapse onto a narrow set of reasoning trajectories, limiting the explored reasoning space. Motivated by findings that thinking tokens at critical steps serve as critical structural elements in LLM reasoning pathways, we propose Guided-RLVR, a novel approach that augments RLVR with a lightweight controller. The controller strategically injects semantically meaningful steering tokens into the sampling distribution, encouraging the model to approach problems from multiple reasoning perspectives and thereby expanding the exploration space. Experiments on mathematical reasoning and code generation benchmarks show that Guided-RLVR consistently outperforms existing RLVR methods while producing more diverse reasoning trajectories.
39. 【2610.37037】Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception
链接：https://arxiv.org/abs/2610.37037
作者：Lai Wei,Yatai Li,Liangbo He,Jun Lan,Renjie Gu,Linhan Cao,Junkai Lin,Huijia Zhu,Weiqiang Wang,Linghe Kong,Yue Wang,Zhuosheng Zhang,Weiran Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：forms the foundation, Multimodal, Multimodal perception forms, multimodal intelligence, tasks
备注：
点击查看摘要
Abstract:Multimodal perception forms the foundation of multimodal intelligence. In particular, spatial perception and multimodal long-context understanding are two pivotal tasks that underpin embodied AI and multimodal agents. However, synthesizing targeted, high-quality training data for these tasks remains difficult and costly. Our key insight is that these tasks share an underlying capability, which we call connecting evidence: identifying relevant visual facts, binding them to the correct entities, recovering their relations, and composing them into an answer. Crucially, targeted training data are far easier to synthesize for this capability than for these tasks themselves. To strengthen this capability, we propose EvidenceConnect, an easy-to-implement data synthesis framework that uses zoomed views of related regions within a single image to generate questions requiring comparison, aggregation, or chaining of visual evidence. To ensure quality, a reference answer is retained only when independent VLMs agree on it, and region-ablation tests discard questions whose answer survives the removal of selected regions. We then train base VLMs on the resulting data with RLVR, obtaining Zooming without Zooming v2 (ZwZ2). Although the synthesized data are not tailored to any downstream benchmark, ZwZ2 improves fine-grained and spatial perception, with further gains on embodied spatial reasoning, multimodal long-context understanding, multimodal agent tasks, and general visual reasoning. These results establish EvidenceConnect as an effective framework for supervising evidence connection and suggest that strengthening this shared capability leads to more generalizable multimodal perception.
40. 【2610.37019】V-LUMEN: Visual Lookup Memory for Embedding Scaling in Vision-Language Models
链接：https://arxiv.org/abs/2610.37019
作者：Miso Choi,Daekeun Kim,Eunji Kim,Jungbeom Lee
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Embedding-level scaling expands, increasing model depth, Embedding-level scaling, dense computation, scaling expands
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Embedding-level scaling expands the capacity of language models through lookup-based memory rather than by increasing model depth, width, or dense computation. Extending this idea to vision-language models (VLMs) is challenging because visual features are continuous, spatially structured, and query-dependent, unlike discrete text tokens that naturally support n-gram lookup. We introduce V-LUMEN, a visual lookup memory for VLMs. V-LUMEN discretizes visual features with a frozen codebook, builds spatially aware memory keys through spatial aggregation-based hashing, and modulates them with text-conditioned relevance signals; all addressing is non-parametric, and the retrieved embeddings are fused into the backbone through a gated residual pathway. On five reasoning-intensive benchmarks, V-LUMEN substantially improves a frozen Qwen3-VL-2B backbone and transfers zero-shot to three benchmarks whose images are disjoint from the training data. At a matched parameter budget, moving part of a LoRA or MoE adapter's capacity into V-LUMEN preserves accuracy on two backbones, indicating that external visual memory is an independent capacity axis rather than a stronger adaptation method. Because lookup cost is constant in table size and incurred only once at prefill, this capacity grows in storage rather than in per-token compute. Code is available at this https URL.
41. 【2610.36991】SpectRAG: Weighted Chunk Graphs for Token-Budgeted Context Selection in Multi-Hop Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2610.36991
作者：Zafer Sahinoglu,Abdulazeez Mohammed,Buse Yaren Kazangirler,Cahit Berkay Kazangirler
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：systems ground large, large language models, ground large language, retrieving external evidence, systems ground
备注： 26 pages, 5 figures, 10 tables. This work is intended for submission to an IEEE journal
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) systems ground large language models (LLMs) by retrieving external evidence and conditioning generation on the retrieved context. Although dense retrieval is effective for local semantic matching, independently ranked retrieval can return redundant passages, miss cross-chunk dependencies, and provide incomplete evidence for multi-hop reasoning. We propose SpectRAG, a spectral graph-augmented retrieval framework that combines hybrid candidate seeding, weighted chunk graph construction, graph-based expansion, spectral relevance propagation, and token-budgeted context selection. Document chunks are represented by dense semantic embeddings and graph-spectral coordinates derived from a weighted chunk graph whose edges encode semantic similarity, document adjacency, section hierarchy, shared entities, citation links, and similarity between LLM-generated utility questions. At query time, SpectRAG builds a high-recall seed set using exact inner-product search and hybrid relevance signals, expands it over the chunk graph, re-scores candidates using graph proximity and spectral information, and assembles the final context under a fixed token budget. The goal is not merely to retrieve individually similar chunks, but to construct a context that is relevant, diverse, structurally connected, and sufficient for grounded reasoning. Experiments on MultiHopRAG, UltraDomain, and long-document question-answering settings show that SpectRAG improves broad evidence recovery and achieves competitive generation quality against dense, hybrid, HyDE, LightRAG, and NaiveRAG baselines. The results further indicate that graph-spectral structure is particularly useful for inference-oriented and cross-document retrieval, while highlighting trade-offs in early precision, computational cost, and domain-dependent performance.
42. 【2610.36990】he State and Fate of Multilingual, Contextual Evaluation in the NLP World
链接：https://arxiv.org/abs/2610.36990
作者：Manan Uppadhyay,Himanshu Beniwal,Prashant Kodali,Sunayana Sitaram
类目：Computation and Language (cs.CL)
关键词：large language models, language models generalize, systematic scrutiny, primary instrument, instrument for assessing
备注： Published at Conference on Language Modelling, 2026. Can be found at [this https URL](https://openreview.net/forum?id=s7fKZHgYsB)
点击查看摘要
Abstract:Multilingual evaluation benchmarks are the primary instrument for assessing whether large language models generalize beyond English, yet the adequacy of these benchmarks has received little systematic scrutiny. We present a data-driven audit of 51 recent multilingual benchmarks spanning 242 datasets and 219 languages, organized around three pillars: coverage, representativeness, and rigor. Our analysis reveals that coverage is wide but thin with 36% of evaluated languages appearing in only a single benchmark, entire regions (Oceania, the Americas, Central Asia) are near-zero, and a stark task equity gap leaves low-resource languages evaluated on only 1-3 task categories versus 14 for high-resource languages. Representativeness is structurally compromised: translation from English remains the dominant construction strategy where 56% of all dataset-language instances are translated introducing artifacts and English-centric framing, while culturally grounded content is concentrated in a handful of community-driven benchmarks with narrow language scope. The ecosystem thus forces a trade-off between breadth and validity. Rigor is undermined by benchmark contamination, including translated benchmark leakage and parallel corpus overlap that evade surface-form detection. We synthesize these findings into concrete recommendations for building evaluation frameworks that are natively constructed, culturally grounded, contamination-aware, and designed to serve the communities whose languages they claim to evaluate. The dashboard with all the metadata collected can be found at this https URL.
43. 【2610.36980】AutoVend: Benchmarking LLM Agents on Long-Horizon Autonomous Vending Operations
链接：https://arxiv.org/abs/2610.36980
作者：Qiming Shi,Yikun Li,Beidi Luan,Rui Sun,Yan Ma,Jing Li,Daxin Jiang,Zuo Bai
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Large language model, Large language, Web from shopping, extending agent-mediated commerce, businesses for sellers
备注：
点击查看摘要
Abstract:Large language model (LLM) agents are extending agent-mediated commerce on the Web from shopping for consumers to operating businesses for sellers. In online-to-offline (O2O) commerce, decisions are issued through Web-based platforms but realized through costly physical execution. Evaluating such agents requires going beyond individual transactions to ask whether decisions made online turn into sustained economic returns. We introduce AutoVend, a benchmark in which one LLM agent manages 20 vending machines across five site types through a Web-based operating interface for 180 simulated days. Its data-grounded simulator combines a shared warehouse, procurement lead times, paid replenishment, inventory expiration, and recurring operating costs. We evaluate five LLM agents against a rule-based inventory-control baseline and diagnose their site coordination, execution, and performance over time. Four of five evaluated LLM agents fall short of this baseline, and returns per dollar of inference cost rank models differently from returns alone. Operational analyses show that gains in individual metrics do not consistently yield stronger economic growth, as inventory and execution costs erode these gains. Trajectory analysis further reveals difficulties in grounding feasible actions, managing inventory commitments, and converting feedback into effective policy revisions.
44. 【2610.36956】Mining the Nineteenth Century for the Thirteenth: Register-Scale Forced Alignment and HTR Bootstrapping via Legacy Regesta and Antiquarian Editions
链接：https://arxiv.org/abs/2610.36956
作者：Tamas Kovacs,Daniel Luger
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Pope Honorius III, Honorius III depends, Handwritten text recognition, Pope Honorius, Honorius III
备注： 10 pages
点击查看摘要
Abstract:Handwritten text recognition (HTR) for the registers of Pope Honorius III depends on modern expert transcriptions, which exist only for regnal years 1-2 of Reg. Vat. 9. For the remaining registers, nineteenth-century scholarship offers Pressutti's regesta and partial editions. On fol. 1-203, where both layers exist, we measure what this legacy layer can contribute, on transcriptions that we first audit against it, and find a division of labor across three tiers. At the orthographic tier, raw editions are at best neutral for adapting a recognizer to the second regnal year and harmful without replay, whereas projection onto curial spelling with replay of modern source lines turns them into zero-label adaptation targets: pooled over all 134 year-2 sides, the WER falls by 1.50 points (95% CI -1.84 to -1.15), closing 33% of the gap to an oracle; the spelling changes at the year split, through the scribe or the transcriber, whereas the hand changes visibly only at fol. 191r. At the lexical tier, the corpus-wide legacy lexicon contains 82.2% of the out-of-vocabulary words of unedited entries and flags recognition errors with 66.7% precision, and labels from pre-trained medieval NER models, distilled into the recognizer's NER head, reach F1 82.1% on an expert validated benchmark, level with the best tagger applied after recognition. At the topological tier, Pressutti's regests, the closing datum clauses, and the regests' dates converted to the chancery's Roman form find 73.9% of entry starts in the recognized line stream, and edition agreement estimates a CER of 7.80% beyond fol. 203. Antiquarian scholarship thus cannot replace modern transcription, but it can steer, check, and segment HTR across the untranscribed registers.
45. 【2610.36948】Self-Keyed In-Parameter Memorization for External Memory-Free Dialogue Recall in Frozen Language Models
链接：https://arxiv.org/abs/2610.36948
作者：XinYu Piao,Myunghoon Ryu,Joongheon Kim,Jong-Kook Kim
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：model maintains conversational, maintains conversational content, large language model, language model maintains, maintains conversational
备注：
点击查看摘要
Abstract:A large language model maintains conversational content in an external storage that is outside the model and grows as the dialogue continues. This work assumes an environment where a language model has no external memory and no prior knowledge of the future question or its answer. The motivation is to research whether a dialogue can be stored in the model parameters and later answer a question about it. This work proposes self-keyed in-parameter memorization (SKIM), a closed-form method in which the model generates its own questions about each dialogue turn and writes those questions into its parameters as the keys that later retrieve the turn's content. Generating many varied questions for each turn allows a later user question to match one even when phrased differently, and its answer is recalled from the parameters alone. Evaluated on five language models, SKIM recalls most stored dialogue turns from later user questions, and it answers from the model parameters without any external storage.
46. 【2610.36937】JevRec: Linguistic Encoding with Jev-like Decision Modeling for LLM-based Generative Recommendation
链接：https://arxiv.org/abs/2610.36937
作者：Qiyong Zhong,Jiajie Su,Ming Yang,Li Zhang
类目：Computation and Language (cs.CL)
关键词：Generative recommendation, items, interaction history, Generative, represents items
备注：
点击查看摘要
Abstract:Generative recommendation (GR) represents items as semantic identifiers (SIDs) and autoregressively generates the next item's SID from interaction history. However, most methods assign the same SID length to all items despite highly unequal interaction frequencies. This uniform design repeatedly incurs the cost of fine-grained codes for popular items, while shortening codes to reduce this cost also compresses the semantic representations of long-tail items. Inspired by the compact forms of frequent expressions in natural language, we propose JevRec to encode items as variable-length words and generate the next item from interaction context. Linguistic encoding retains frequency-dependent semantic prefixes from shared codebooks, producing shorter SIDs for popular items and richer descriptions for long-tail items. Yet predicting a sequence-level length and generating token-level content impose different optimization requirements that may conflict under a shared output head. Our Jev-like decision modeling component therefore predicts a length distribution with a dedicated head and generates content conditioned on length through a separate head while sharing the interaction-history representation. Experiments on three public datasets show that JevRec outperforms all compared baselines across the evaluated recommendation metrics. Further analyses show lower training and inference time than TIGER and reduced gradient conflict between length and content prediction.
47. 【2610.36929】DocXEval: A Systematic Evaluation of Explainability in Multimodal Document Understanding
链接：https://arxiv.org/abs/2610.36929
作者：Saifullah Saifullah,David Dembinsky,Stefan Agne,Andreas Dengel,Sheraz Ahmed
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：driven unprecedented performance, unprecedented performance breakthroughs, multimodal document understanding, document understanding, modern document understanding
备注：
点击查看摘要
Abstract:Multimodal transformer models have driven unprecedented performance breakthroughs in modern document understanding. However, the inherent black-box nature of these models remains a major obstacle to their safe deployment in high-stakes sectors. Despite significant progress in explainability for vision and language tasks, explainable AI (XAI) research tailored to multimodal document understanding has received little attention. To address this gap, we present \ourframework{}, the first comprehensive explainability framework that adapts existing XAI methods and evaluation metrics to the multimodal (text, layout, and image) document understanding context, while introducing efficient multi-target adaptations of both methods and metrics for domain-specific tasks such as semantic entity recognition. Using \ourframework{}, we systematically evaluate 13 XAI methods across 3 document understanding tasks, 8 datasets, 4 models, and 17 evaluation metrics, and find that only a few methods perform consistently across all evaluation criteria, with Occlusion emerging as the most faithful and interpretable method overall. Through a dedicated meta-evaluation, we observe moderate to strong agreement among several faithfulness and complexity metrics while identifying certain ones that produce unreliable results. Finally, through multiple dataset-wide diagnostic analyses, we uncover key insights into model behavior, including the contribution of individual modalities across tasks and labels, spatial attribution patterns around target entities, and potential dataset biases. Overall, this work serves as both a benchmark and a practical guide for future XAI research in multimodal document understanding. To support reproducibility, we publicly release our code at this https URL.
48. 【2610.36918】rawMem: Reframing Agent Memory as Task-Oriented Role-Adaptive Workspaces
链接：https://arxiv.org/abs/2610.36918
作者：Mingyu Zhang,Zixu Li,Zhiheng Fu,Zhiwei Chen,Jinhe Bi,Yupeng Hu
类目：Computation and Language (cs.CL)
关键词：Large language model, typically retrieve memories, Large language, existing systems typically, systems typically retrieve
备注： 31 pages, 18 figures, 3 tables
点击查看摘要
Abstract:Large language model (LLM) agents rely on memory systems to leverage long-term interactions, yet existing systems typically retrieve memories based on their relevance to the current query and use them as contextual evidence. However, relevance alone does not characterize how a memory contributes to task solving: the same memory may serve different roles across tasks, such as directly supporting the answer or linking to complementary memories with weaker semantic relevance but necessary information. We therefore reframe agent memory systems as Task-Oriented Role-Adaptive Workspaces, where memories are selected and organized by their task-oriented roles and relations. Based on this view, we propose TrawMem, which organizes interaction histories into local threads and constructs task-oriented workspaces by assigning roles and jointly selecting complementary memories. Experiments on LoCoMo and MemGallery with four open- and closed-source backbones show consistent improvements over representative memory systems, with macro-F1 gains of 2.23-3.14 points. On LoCoMo, TrawMem improves the LLM-Judge score over SimpleMem by 4.07 and 4.31 percentage points on Qwen3.5-9B and DeepSeek-V4-Flash, respectively, while requiring approximately 12.8% and 5.1% fewer context tokens, respectively.
49. 【2610.36915】Do We Need an LLM to Know Why Sources Conflict? Decision Models for Knowledge-Conflict Typing in RAG
链接：https://arxiv.org/abs/2610.36915
作者：Parv Khatri,Harshul Jain,Mehak Kapoor,Tanya Sah
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：query disagree, contested topic, stale information, decision models, disagree
备注： 15 pages, 2 figures, 8 tables. Code, prompts and all model outputs: [this https URL](https://github.com/Parv17k/decision-models-conflict-typing)
点击查看摘要
Abstract:When the sources retrieved for a query disagree, the right response depends on why they disagree: a question with several valid answers, a contested topic, stale information and a false source each call for different behaviour. Cattan et al. (2025) showed that telling a generator the conflict type improves its responses by about 24 points, but that predicting the type is hard even for frontier LLMs. We study whether typed decision models, which return probabilities over fixed options in a single forward pass instead of generating text, can do this classification fast and cheaply. Using the CONFLICTS benchmark and the original paper's prompt verbatim, we evaluate all 11 decision models served by one commercial inference gateway, from 7 providers, against Gemini models on identical inputs. Asked directly, the decision models reach 50.0--67.0% accuracy; 10 of the 11 match or exceed Gemini 2.5 Flash, the paper's model (61.3%), at 4--39x lower billed cost (2 were free) and 2.6--6.0x lower latency. The current Gemini 3.8 Flash (70.0%) is significantly more accurate than 8 of them, but sending each decision model's least confident quarter of queries to it gives a cascade statistically tied with it for 8 of the 11, at 25--37% of its cost. End to end, answers generated with the types of 10 of the 11 follow the expected behaviour as often as with the LLM's types. Decomposing the taxonomy into yes/no questions lowers accuracy for every model, and a repair fitted on one model does not transfer. Pre-specified diagnostics show that dates play no measurable role and that sensitivity to source order varies widely between models. Decision models detect a planted false source less reliably than the LLM as hard labels, but their probabilities still separate planted from clean sources. We release code, prompts and all model outputs at this https URL.
50. 【2610.36911】Developing a Speech Language Model for Basque
链接：https://arxiv.org/abs/2610.36911
作者：Andoni Sudupe,Inma Hernaez,Ander Arriandiaga,Christoforos Souganidis,Ibon Saratxaga,Eva Navas
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Audio and Speech Processing (eess.AS)
关键词：difficulties keeping pace, face difficulties keeping, minority languages face, languages face difficulties, Speech Language Model
备注： IberSPEECH2026 - Jornadas en Tecnologias del Habla and Iberian SLTech Workshop Events
点击查看摘要
Abstract:Although the recent development of LLMs has paved the way for multi-modal interaction, minority languages face difficulties keeping pace. This work presents the first open Speech Language Model for Basque, designed for low-latency, end-to-end spoken interaction. Based on the LLaMA-Omni architecture, the system integrates a Latxa model as its backbone, transferring its Basque capabilities to the spoken modality by fine-tuning several modules. To address data scarcity, the English VoiceAssistant-400K corpus was translated into Basque, and the audio was synthesized using a Basque TTS. Evaluation results confirm the system's viability, achieving 3.86/5 in content quality, a 9.94% WER for spoken intelligibility, and a 3.07 UTMOS for audio quality. This work demonstrates that advanced spoken interaction systems can be developed using modular architectures and synthetic data even in low-resource languages.
51. 【2610.36910】Nothing Left Behind: Finding Evidence from a Large Randomized Evaluation Corpus
链接：https://arxiv.org/abs/2610.36910
作者：Giuliano Martinelli,Abelardo Carlos Martinez Lorenzo,Satvik Garg,Linxi Wang,Riccardo Orlando,Piriyakorn Piriyatamwong,Samuel Paul Fraiberger
类目：Computation and Language (cs.CL)
关键词：large collection, labels, found, label search found, Abstract
备注： 7 pages, 3 figures
点击查看摘要
Abstract:Many AI systems need to find every relevant items in a large collection and then organize what they found. The standard way to do this is to tag each item with labels from a curated vocabulary and search on those labels. Those labels are useful for organizing results, but searching on them misses items that do not fit a label and returns too much when labels are broad. We compare this approach with an embedding-based approach: find candidates by meaning using text embeddings, then have a language model keep only the relevant ones. In a corpus of 7,354 randomized trials, label search found 45% of the evidence a systematic review would include, while the new approach found 92%, at a cost per query that rises with search depth. These results support a two-stage architecture that combines broad candidate retrieval with query-specific evidence filtering.
52. 【2610.36901】HiLo-RD: Cross-Budget Self-Distillation for Masked Diffusion Language Models
链接：https://arxiv.org/abs/2610.36901
作者：Xiang Li,Chengting Yu,Jungang Li,Yilun Zheng,Junzhuo Li,Xingyao Zhang,Wenbo Su,Xuming Hu
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Budget Representation Distillation, masked diffusion language, limited generation budget, diffusion language models, Representation Distillation
备注： 20 pages, 9 figures, 3 tables; Under review
点击查看摘要
Abstract:We propose HiLo-RD (High-to-Low Budget Representation Distillation) to improve masked diffusion language models (MDLMs) under a limited generation budget. Unlike autoregressive models, MDLMs choose both what to generate and where to commit it. This creates two coupled challenges: predicting useful content before reasoning is complete, and deciding when to fix answer tokens that shape later predictions. We identify budget-induced premature commitment: even when a correct solution fits, the model can fix answer fragments near the window boundary before resolving intermediate steps. These fragments become context for later predictions and redirect subsequent reasoning. Existing post-training methods do not directly transfer the stronger trajectories that the same model follows with a larger window. HiLo-RD addresses this gap by (1) pairing large-window teacher states with cropped small-window views and (2) matching their hidden representations at committed positions. This supervision guides both token prediction and commitment order without an external teacher. Across mathematics benchmarks, HiLo-RD improves low-budget accuracy and shortens responses; these gains extend to code generation without code-domain training. On GSM8K, accuracy rises by 9.4 percentage points as mean readable length falls by about 25%. Attention diagnostics and fixed-budget order interventions support the proposed mechanism. Together, these results show that large-window reasoning can improve small-window decoding.
53. 【2610.36878】RubricAtlas: Mining Type-Level Rubrics from Expert Reports to Evaluate Deep Research Agents
链接：https://arxiv.org/abs/2610.36878
作者：Delin Wang,Sinuo Wang,Rui Sun,Beidi Luan,Qiming Shi,Jing Li,Daxin Jiang,Zuo Bai
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：synthesise retrieved information, multi-step Web searches, conduct multi-step Web, agents conduct multi-step, conduct multi-step
备注：
点击查看摘要
Abstract:Deep research agents conduct multi-step Web searches and synthesise retrieved information into analytical reports. Evaluating these outputs requires checking which analyses they deliver, beyond the presence of relevant facts. Query-specific binary rubrics make individual requirements explicit, but task-level checklists may leave the overall analytical structure underexamined. We introduce RubricAtlas, which derives type-level analytical requirements from expert reports on different objects within the same research type and organises detailed checks around recurring analytical questions. The requirements give related tasks a shared standard for what to analyse, without prescribing their answers. Our framework links binary checkpoints to report passages and evaluates completeness separately from argument validity. Built from 3,079 Chinese financial research reports, RubricAtlas covers 99 research types. Reference-report selection experiments show that individual reports cover only about half of their type's analytical questions, and that selecting requirements from different reports changes evaluation scores and agent rankings. Across ten agents, two judge pipelines achieve checkpoint agreement of $\kappa$ = 0.71 and agent-ranking agreement of Kendall $\tau$ = 0.87. Controlled deletions reduce scores on the affected analyses, while padding produces no detectable increase. These findings support type-level rubrics for comparing the analytical completeness of Web deep research outputs, with individual decisions traceable to report evidence.
54. 【2610.36877】GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI Agents
链接：https://arxiv.org/abs/2610.36877
作者：Bingchao Wang,Yongcheng Jing,Shunyu Liu,Chengyu Wang,Jun Huang,Jie Yang,Wei Liu,Dacheng Tao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Mobile GUI agents, Mobile GUI, typically fine-tuned, decoder-free GUI agent, GUI agent policy
备注： 26 pages, 11 figures, 16 tables
点击查看摘要
Abstract:Mobile GUI agents are typically fine-tuned 7B-scale vision-language models (VLMs) that generate each action as text. However, these VLMs decode every action token by token, and even agents that score candidate actions keep a large language model or VLM in the loop, making them slow and memory-hungry. To address these issues, we propose GUI-JEPA, to our knowledge the first decoder-free GUI agent policy built on a Joint-Embedding Predictive Architecture (JEPA), which selects actions in the latent space of a JEPA encoder pretrained on unlabelled GUI screenshots. Its action- and region-conditioned latent predictor turns the screen latent into one latent per candidate action, letting lightweight heads score all candidates against the instruction in a single batched pass, without decoding a token. We further show that the scorer relies on this latent pathway and that the predictor is trained for the decision itself: a randomly initialised predictor does just as well as one pretrained on screen dynamics. On AndroidControl, GUI-JEPA is 2.8-4.0x faster on the same GPU than a Qwen2.5-VL-7B agent we fine-tune with the same inputs, while reaching 86-92% of its in-distribution accuracy with 6% of its parameters. Code is available at this https URL
55. 【2610.36874】AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding
链接：https://arxiv.org/abs/2610.36874
作者：Bingchao Wang,Yongcheng Jing,Chengyu Wang,Jun Huang,Jie Yang,Wei Liu,Dacheng Tao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：high-resolution screens fails, common training-free remedy, Compositional Structure Grounding, high-resolution screens, screens fails
备注： 24 pages, 5 figures, 14 tables
点击查看摘要
Abstract:GUI grounding on high-resolution screens fails mostly on small targets, and zooming in is a common training-free remedy. However, most existing zooming pipelines do not match the zoom to the target's size, accept the zoomed answer unconditionally and never revisit a wrong answer. To address these issues, we propose AdaGround, a training-free framework with three components: (1) Token-Normalized Adaptive Zooming, which sets the magnification, field of view and zoom depth of each sample from the model's own estimate of the target size; (2) Verifier-in-the-Loop Refinement, which uses one marked-click Yes/No verifier to keep or reject each zoom, choose between zoom chains, trigger re-grounding and, with an existence query, decide when to abstain; and (3) Compositional Structure Grounding, which composes spreadsheet cells from their headers. On Qwen3-VL models, AdaGround surpasses state-of-the-art training-free zooming methods and many trained GUI models, improving accuracy over the backbone by 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, and its gains carry over to held-out UI-Vision. Code is available at this https URL
56. 【2610.36813】Words or Deeds? How LLMs Predict Users' Decisions in Human-Agent Dialogue
链接：https://arxiv.org/abs/2610.36813
作者：Baiqiao Zhang,Shuai Ma,Zhifeng Liao,Chao Zhou,Jianshu Wang,Yuhan Zhao,Chaoyue Zhang,Tongjun Si,Yuying Tang,Xiangxian Li,Yong-Jin Liu,Yulong Bian
类目：Computation and Language (cs.CL); Human-Computer Interaction (cs.HC)
关键词：Web systems increasingly, interests partly conflict, Web systems, systems increasingly predict, partly conflict
备注：
点击查看摘要
Abstract:Web systems increasingly predict users' decisions from what users say, yet when interests partly conflict, users may promise to cooperate to win the other side's cooperation and then not do so. Sales or service agents that rely on such promises may grant concessions to users who then do not keep their promises, at a cost to the party they represent. We test how LLMs combine users' statements with decision records to predict users' decisions, using 1,260 rounds in which 42 users played a repeated prisoner's dilemma-style game with five agents, each prompted to express a dominant Big Five trait, and could talk with the agent before every decision. Across eight open-weight LLMs, predictions from decision records separated cooperation from defection well (AUC = .80), and adding dialogue brought no detectable gain. With dialogue, predictions agreed with users' statements more often, and errors concentrated on rounds in which users broke their statements: accuracy on rounds with a statement barely changed (.73 to .74), while it rose on kept statements (.76 to .95) and fell sharply on broken ones (.65 to .17). Predictions weighted statements more heavily than users' behavior warranted: when users stated a decision they had not yet made in that game, the predicted probability of keeping it rose from .13 to .69, whereas users kept .40 of such statements. Users' decisions also varied with the agent they faced, but predictions hardly reflected this: users cooperated more with the Agreeableness agent than with the Extraversion agent (70.6% vs. 54.5%), whereas predicted cooperation was nearly identical (64.5% vs. 63.1%). Users also cooperated more with an agent when they themselves scored higher on that agent's trait, whereas predicted cooperation barely changed with these scores. Dialogue-based predictions should therefore weigh users' statements by their earlier decisions and the agent they face.
57. 【2610.36811】Weakness Localization Is Not Enough: State-Aware Recursive Knowledge Improvement for Large Language Models
链接：https://arxiv.org/abs/2610.36811
作者：Runze Jiang,Yan Wang,Boran Jin,Bingyu Zhu,Longtao Huang
类目：Computation and Language (cs.CL)
关键词：Knowledge, large language models, evaluation-guided updating, large language, shifting from predefined
备注： 18 pages, 8 figures
点击查看摘要
Abstract:Knowledge improvement in large language models is shifting from predefined knowledge incorporation pipelines toward evaluation-guided updating. Existing methods use evaluation to localize model-specific knowledge weaknesses and guide targeted post-training. However, identifying what to improve does not necessarily provide sufficient information for deciding how to improve it. The same localized weakness can be compatible with distinct operational knowledge states: the relevant knowledge may be unavailable, available but difficult to access reliably, or accessible but ineffective for downstream use. We call this ambiguity knowledge-state aliasing. When compatible states favor different interventions, greater diagnostic resolution alone is insufficient for intervention selection. Moreover, model updates can change the underlying knowledge state before the observed weakness disappears, such that an intervention appropriate in one round may no longer address the bottleneck in the next. To address these challenges, we propose Recursive Knowledge Improvement (RKI), which formulates knowledge improvement as a sequential, state-aware intervention process. RKI organizes knowledge into graph-structured units that provide a shared basis for diagnostic evaluation and targeted intervention across rounds. At each round, RKI localizes knowledge weaknesses, estimates the model's operational knowledge state from diagnostic evidence and intervention history, selects a corresponding intervention, and re-evaluates the updated model before determining the next intervention. On HotpotEval and SafeInternalEval, RKI outperforms existing knowledge incorporation methods by 18.41 points on average. Further analyses show that knowledge states provide additional guidance for intervention selection beyond weakness localization and can change across model updates even when the observed weakness persists.
58. 【2610.36809】Latent Visual Contrastive Reasoning with Multi-Branch Exploration
链接：https://arxiv.org/abs/2610.36809
作者：Kegeng Tang,Jingbo Wang,Yangming Zhang,Huanshu Zhang,Shaogang Ren,Zihao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Multimodal large language, large language models, made substantial progress, Multimodal large, visual question answering
备注： Accepted at IEEE BigData 2026
点击查看摘要
Abstract:Multimodal large language models have made substantial progress in visual question answering, but complex visual reasoning often requires locating and comparing multiple pieces of question-relevant visual evidence. Existing methods that move intermediate reasoning into the visual latent space usually follow a single linear reasoning trajectory, which can be limiting when multiple visual hypotheses or competing evidence regions are relevant. We propose Latent Visual Contrastive Reasoning, a branch-aware latent reasoning framework that generates multiple question-conditioned latent visual branches as soft hypotheses over image tokens. To train these branches, our method uses bounding-box evidence annotations to build target evidence representations and introduces a soft contrastive branch-evidence alignment objective. This objective encourages evidence-relevant branches to align with annotated visual regions while contrasting them against negative evidence. We instantiate our method on Qwen2.5-VL backbones and train it with standard supervised fine-tuning. Experiments on perception-intensive visual reasoning benchmarks show that the proposed method achieves overall improvements over the corresponding backbone and single-path latent reasoning baselines at both 3B and 7B scales.
59. 【2610.36805】Personality Latents: Conditioning Frozen Language Models on Individuals from Their Own Writing
链接：https://arxiv.org/abs/2610.36805
作者：Gunhee Cho,Yun-Gyung Cheong
类目：Computation and Language (cs.CL)
关键词：named trait categories, trait categories, relies on written, named trait, author writes
备注：
点击查看摘要
Abstract:Controlling the personality of a language model usually relies on written profiles or named trait categories, so it can only express what an author writes down or what a taxonomy names. We instead propose Personality Latents (PL), which learn a latent for each person from their own writing, with no personality labels and no authored profile, and inject it into a frozen language model as a soft prefix. Following generative latent optimization, each training person receives a free latent that is optimized through the frozen model itself, while an encoder learns to predict these latents so that a new person needs only one forward pass, with optional refinement at test time. We evaluate on held-out people by having the conditioned model answer neutral and interview questions and reading personality from its answers with scorers trained on real human writing. On the MBTI axes PL reaches an AUC of , ahead of persona embedding and prompt-based baselines under identical settings, and the ranking holds when the answers are scored in three different embedding spaces. A latent learned with Qwen2.5-3B-Instruct also transfers personality to Llama-3.1-8B-Instruct through a new adapter alone.
60. 【2610.36801】API-TAIL: Detecting Model Substitution in LLM APIs through Temperature-Aligned Likelihood Tails
链接：https://arxiv.org/abs/2610.36801
作者：Haocheng Mei,Yuchuan Tian,Ye Yuan,Chao Xu,Allen Chen,Kai Han,Yunhe Wang
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：cheaper substitute model, Commercial language model, return only text, language model APIs, model APIs return
备注： Project page: [this https URL](https://github.com/TokenRhythm/API-TAIL)
点击查看摘要
Abstract:Commercial language model APIs return only text, allowing a provider to cut costs by quietly routing a fraction of user requests to a cheaper substitute model while billing for the advertised one. Detecting such partial substitution is challenging because honest providers also alter the output distribution through undocumented decoding and serving choices, such as temperature scaling, sampling truncation, repetition and presence penalties, and default system prompts, forcing an audit to test against a composite null of legitimate configurations rather than a single reference. Our key insight is that these legitimate variations primarily shift response typicality across the entire batch, whereas partial substitution injects individual responses that remain anomalous under the claimed model. Building on this, we introduce API-TAIL, a typicality audit that first absorbs batch-level shifts by aligning a single effective temperature to center standardized surprisal scores across the audited batch, and then flags the endpoint if the number of remaining tail responses exceeds a threshold calibrated across legitimate configurations. Evaluated on real-world commercial APIs, API-TAIL reliably controls false alarms across diverse honest providers while detecting even low-rate partial substitution with a small query budget, substantially outperforming existing rank- and MMD-based audits that lose detection power under the same composite calibration.
61. 【2610.36797】Language Models Keep Abandoned Analyses: Residue and Adaptation after Garden-Path Sentences
链接：https://arxiv.org/abs/2610.36797
作者：Xiang Ding
类目：Computation and Language (cs.CL)
关键词：deer ran, man hunted, requires giving, hunted the deer, abandoned analysis
备注： 16 pages, 5 figures, 7 tables
点击查看摘要
Abstract:Reading "While the man hunted the deer ran into the woods" requires giving up the analysis in which "the deer" is the object of "hunted". People who have just read such a sentence still produce more transitive structures, so the abandoned analysis primes later language. We ask whether language models keep using an analysis they have abandoned, and what in the model carries it. In 24 open models from 124M to 70B parameters, a garden-path sentence leaves two traces in the context. A residue of the abandoned analysis raises later object attachment, by about three quarters of the effect of a sentence in which the noun phrase really is an object, and it appears in sampled text, on held-out and human-normed items and for a second type of garden path. An adaptation toward the resolved structure scales with the sentence's disambiguation error and acts mainly on comprehension-like measures. Activation patching separates the two. Later text reads the residue from the role information in the noun phrase's states, which were computed under the object analysis before the disambiguation, and replacing these states removes almost all of the residue in the 32B and 70B models. The adaptation is read from the states that processed the disambiguation. Overridden statements show the same persistence (a corrected value keeps pulling later predictions in 8 of 9 models), and in most models the pull is carried by the positions after the statement. Finally, the human paradigm transfers only with controls for punctuation, because the models also write garden-path sentences themselves, which reverses the paradigm's raw statistic.
62. 【2610.36794】Select-TTT: Query-Conditioned Selective Fast Weight Updates for In-Place Test-Time Training
链接：https://arxiv.org/abs/2610.36794
作者：Yue Wu,Yang Zhang,Weinan Gan,Chongming Gao,Xinsen Guo,Xiaoyuan Li,Fuli Feng
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：deployed language model, In-Place TTT, internalize incoming context, enables a deployed, internalize incoming
备注：
点击查看摘要
Abstract:Test-time training (TTT) enables a deployed language model to internalize incoming context on-the-fly into a small set of fast-weight parameters, rather than merely treating it as transient context for attention. In-Place TTT recently made this idea practical for large language models by repurposing the down-projection of standard MLP blocks as fast weights. However, we find that its benefit largely disappears on realistic web long-context question answering. We attribute this to In-Place TTT's uniform write schedule: every chunk is written with equal strength, so irrelevant content dilutes query-relevant information in fast-weight memory. Building on this insight, we propose Select-TTT, a model-agnostic, query-conditioned rule for In-Place TTT that scales each chunk's write strength by its relevance to the user query. This relevance signal requires no supervision and no new parameters: it is read directly from the model's frozen output head, as the probability mass that a chunk's hidden states assign to the query tokens. A temperature-scaled softmax turns these scores into learning-rate multipliers, leaving the chunk-wise, context-parallel computation of In-Place TTT intact. Select-TTT consistently improves long-context question answering on two benchmarks and two backbones. These findings highlight the value of query-conditioned fast weight writes for practical test-time training on long-context question answering, which is also potentially promising for long-horizon agent tasks involving multiple user queries over evolving contexts.
63. 【2610.36774】Batching the Reflective Optimization Loop: Parallel Proposals Make GEPA Faster and Better
链接：https://arxiv.org/abs/2610.36774
作者：Jialin Zhang,Lakshya A Agrawal,Shangyin Tan,Donghyun Lee,Lutfi Eren Erdogan,Dan Klein,Koushik Sen,Alex Dimakis,Matei Zaharia
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：evaluation capacity idle, makes agentic systems, sequential structure leaves, text optimization makes, optimization makes agentic
备注： NeurIPS 2026 Workshop on Resource-Aware Agentic AI. 9 pages, 7 figures. First four authors contributed equally. Code: [this https URL](https://github.com/gepa-ai/gepa)
点击查看摘要
Abstract:Reflective text optimization makes agentic systems better, but the optimization loop is itself a resource-hungry workload whose sequential structure leaves parallel evaluation capacity idle. We extend the open-source GEPA optimizer to propose and evaluate a batch of candidates on each optimization step instead of one candidate at a time. In our sweep on two tasks, most batched runs finished in half the wall-clock time or less, and the fastest in about a quarter to a third. Batched settings also achieved higher held-out test scores, from 68.9% to 72.1% on LiveBench-Math (with $2\times2$) and from 49.0% to 60.0% on HoVer (with $8\times1$). A simple runtime model explains the measured speedups under a finite worker pool, and batched settings also spend their metric-call and dollar budgets more efficiently. We frame the axes along which a reflective optimization step can scale in parallel, a first look at allocating a fixed optimization budget across them.
64. 【2610.36759】DocSkill: Skill-Integrated Agentic Reasoning for Multilingual Multi-Hop Document Question Answering
链接：https://arxiv.org/abs/2610.36759
作者：Jing Huang,Zhiya Tan,Changtao Miao,Shutao Gong,Yang Wang,Joey Tianyi Zhou,Jianshu Li,Ying Yan
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：document question answering, question answering, requires locating, complex layouts, locating and integrating
备注： 11 pages, 10 figures, 5 tables. Preprint
点击查看摘要
Abstract:Multilingual multi-hop document question answering (MMHop-DocQA) requires locating and integrating evidence across complex layouts, document pages, and diverse languages. Existing approaches include single-pass processing and adaptive tool use, but learning to coordinate evidence acquisition, cross-page integration, and answer verification remains challenging. To address this challenge, we present DocSkill, an agentic framework with a learned skill-orchestration policy for adaptive evidence acquisition and reasoning. The policy selects, revisits, or skips skills according to the evolving evidence state. To construct supervision for skill orchestration, bounded Monte Carlo Tree Search (MCTS) explores alternative skill trajectories offline. These trajectories provide demonstrations for supervised fine-tuning (SFT) and preference pairs for Direct Preference Optimization (DPO). We further introduce MMHop-DocBench, a multilingual multi-hop document QA dataset with training and test splits, containing 60K QA pairs across 10 languages and eight document domains. Its HopGen pipeline builds hierarchical page-element graphs to derive traceable cross-page evidence paths and generate grounded QA pairs with page- and element-level evidence annotations. Experiments show that DocSkill with Qwen3-VL-8B achieves 41.0 accuracy and 49.2 F1 on MMHop-DocBench, exceeding the strongest evaluated baseline by 5.5 and 6.3 points, respectively, and achieving competitive performance on MMLongBench-Doc and DocBench.
65. 【2610.36734】CAMR: Compatibility-Aware Memory Replay for Continual Learning in Large Language Models
链接：https://arxiv.org/abs/2610.36734
作者：Jingpu Yang,Tianhao Li,Fengxian Ji,Yufeng Wang,Shuxin Zheng,Xiaoqing Zhang
类目：Computation and Language (cs.CL)
关键词：requires large language, large language models, learning requires large, Continual learning requires, requires large
备注：
点击查看摘要
Abstract:Continual learning requires large language models to acquire new knowledge and capabilities while retaining what they have learned. Fine-tuning and replay support acquisition and retention, but deciding whether incoming examples need supervision and which historical examples to revisit remains a challenge. We propose Compatibility-Aware Memory Replay (CAMR), an adaptive framework that jointly controls current-example supervision and historical replay. CAMR combines compatibility checks with a learned memory gate to guide an online policy over three actions: learning incoming examples with general replay, jointly reinforcing compatible related examples, and skipping direct supervision of verified mastered duplicates. The policy learns from acquisition, retention, and training-cost feedback under a bounded per-arrival replay budget. We evaluate CAMR with Qwen3-8B-Base on continual factual updating and cross-task and cross-domain learning. On WikiBigEdit, CAMR consistently leads evaluated methods in Original Match from 3K to 100K facts, reaching 93.66% after just 3K facts and surpassing Full-history Replay (LoRA) after 100K facts. It also achieves the highest final scores on all four selected TRACE tasks and maintains or improves earlier-task performance relative to post-acquisition levels in a sequence spanning financial question answering, mathematical reasoning, code generation, and summarization.
66. 【2610.36717】A Harness Reducing over-Defensive Writing in Agents by Isolating Objections
链接：https://arxiv.org/abs/2610.36717
作者：Xiaochen Chang
类目：Computation and Language (cs.CL)
关键词：introduce a stronger, stronger claim, article makes, writing, over-defensive writing
备注： defensive writing; context isolation; harness
点击查看摘要
Abstract:When expanding a report, writing with agents may introduce a stronger claim than the article makes and then disclaim it. This is called over-defensive writing. We assume that this is because the agent is writing for responding to an adversarial AI reviewer, instead of a human reader. The defensive context may also influnce the consequent when we simply ban defensive writing in the output through prompts. In order to reduce over-defensive writing, we produce a harness that separates the reviewer, filter, and writer. The writer agent receives only the problems choosen by the filter, which is an independent context. We evaluate this harness on 25 business-project drafts expanded into formal reports, the result shows that the defensive propositions decreased from 59 to 2, which is a 96.61\% reduction, no unsupported factual additions were identified while the source-claim retention rises from 80.35% to 93.12%.
67. 【2610.36709】Is Token Confidence Just Chain Length? A Signal-Processing Audit of Reasoning Traces
链接：https://arxiv.org/abs/2610.36709
作者：Pragna Mallappa
类目：Computation and Language (cs.CL)
关键词：language models answer, Reasoning language models, majority vote raises, vote raises accuracy, models answer math
备注：
点击查看摘要
Abstract:Reasoning language models answer math problems by writing long chains of thought, and sampling many chains per problem and taking a majority vote raises accuracy at a large cost in generated text. A popular way to cut that cost scores each chain by the model's confidence in each token it writes, where a token is a word or part of a word. The method averages this confidence over a sliding window of 2048 tokens and keeps or stops chains based on the lowest average. We treat the confidence, recorded token by token, as a signal in the sense of audio or radio, and examine the method with standard signal-processing tools such as spectral analysis and statistical tests for detecting a sudden change. We sampled 16 chains for each of 500 problems from two math benchmarks with a small open reasoning model. The windowed-minimum score turns out to measure mostly how long a chain is. Ranking chains by length alone does as well as or better than the confidence score, and once length is accounted for the score carries no information about correctness. Signal processing explains why: the minimum of a longer stretch of a slowly drifting signal is lower by chance alone, and the confidence signal drifts slowly enough that this effect dominates. The spectrum does hold a small signal that length does not explain, since incorrect chains carry more rapid token-to-token fluctuation, but it is too weak to improve the vote. For stopping chains early, neither the sliding average nor a classical change detector beats the simpler choice of sampling fewer chains.
68. 【2610.36679】Specialization, Diversity, and Scaling in Child-Scale Language Models
链接：https://arxiv.org/abs/2610.36679
作者：Steven Y. Feng,Michael C. Frank
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Modern language models, Modern language, Modern, children experience, naturalistic datasets
备注： Code and data at [this https URL](https://github.com/styfeng/child-scale-lm)
点击查看摘要
Abstract:Modern language models are trained on far more language than children experience, but we know much less about learning from small, naturalistic datasets. We train small GPT-2 models on transcripts of speech with children from dense home recordings (BabyView) and on synthetic child-directed dialogue (TinyDialogues), varying the amount, source, and diversity of training data. Models trained on one child's language environment predict that environment substantially better than other children's environments. Much of this specialization is lexical and distributional: a simple 5-gram model reproduces the cross-child pattern (r=.91). Training on data from multiple children clearly improves prediction of pooled held-out language relative to training on a single child's input without a similarly clear improvement on grammatical benchmarks. Across data sizes, naturalistic and synthetic training inputs also produce different grammatical and lexical-semantic patterns, with important differences between grammatical phenomena. Together, these results show that small-data language learning depends not only on how much language a model sees, but on which environments it comes from and how well that input matches what the model is asked to predict.
69. 【2610.36668】A Quantitative Approach to Asch Conformity in Frontier Large Language Models
链接：https://arxiv.org/abs/2610.36668
作者：Senthil Rajasekaran,Stylianos Loukas Vasileiou
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：recently gained considerable, gained considerable attention, Asch conformity experiment, large language models, Asch conformity
备注：
点击查看摘要
Abstract:The Asch conformity experiment has recently gained considerable attention as a way of measuring conformity in large language models (LLMs). While previous studies have focused on demonstrating conformity in LLMs, our work adds a further quantitative layer to this approach. Instead of sampling a frontier LLM on a suite of questions, our approach samples a single question repeatedly, leveraging the probabilistic nature of LLMs to produce a distribution of answers. In doing so, we can compare the distributions of answers before and after the model is presented with the manufactured consensus. Our experiments confirm that frontier LLMs do conform, reinforcing prior literature, and, through our distribution-to-distribution comparisons, provide additional quantitative data on the conditions that lead to conformity and the degree to which it occurs.
70. 【2610.36667】Japanese Discourse Structure Analysis Based on Segmented Discourse Representation Theory Using LLMs
链接：https://arxiv.org/abs/2610.36667
作者：Satomu Tomisaki,Yosuke Mikami,Amane Watahiki,Hitomi Yanaka
类目：Computation and Language (cs.CL)
关键词：Discourse Representation Theory, Segmented Discourse Representation, Representation Theory, Japanese SDRT corpora, English SDRT corpora
备注： To appear in the Proceedings of the Asia-Pacific Chapter of the Association for Computational Linguistics: Student Research Workshop (AACL-SRW 2026)
点击查看摘要
Abstract:Discourse parsing based on Segmented Discourse Representation Theory (SDRT) is crucial for capturing the structural dynamics of dialogues. However, most prior research focuses on English, and its effectiveness for Japanese remains unclear owing to the lack of Japanese SDRT corpora. To address this issue, we construct Japanese SDRT corpora by translating existing English SDRT corpora using an LLM. Through a comparative evaluation of prompt-based and fine-tuned LLMs, we show that the models achieve comparable performance between English and Japanese, suggesting the cross-lingual applicability of SDRT-based discourse parsing. In order to investigate why the English and Japanese parsers achieve similar performance, we conduct ablation analyses on discourse markers and contextual inputs. Our results reveal that most of the Japanese discourse markers we examined have little impact, and the models' predictions depend heavily on contextual discourse relations rather than on the content of the context clauses. This structural reliance might explain the comparable performance despite the substantial typological differences between English and Japanese.
71. 【2610.36617】Balanced State Subspaces for Mamba-2 State Compression
链接：https://arxiv.org/abs/2610.36617
作者：Shang Tingyu,Cao Wenfei
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Applications (stat.AP); Methodology (stat.ME)
关键词：fixed-size recurrent state, dominates decoding memory, compresses all context, fixed-size recurrent, dominates decoding
备注： 15 pages, 4 figures
点击查看摘要
Abstract:Mamba-2 compresses all context into a fixed-size recurrent state that dominates decoding memory and bandwidth. Existing compressors quantize state values or prune state coordinates, scoring each channel independently in the native basis. We examine trained Mamba-2 states and find that energy is almost rank-one, but the output does not read the energetic directions: energy concentrates in a bias-like direction accumulated by the recurrence, while the content the output reads lives in a low-dimensional subspace that is not aligned with the state's coordinates. Even output-aware scores are computed coordinate by coordinate, so they miss the directions that determine the input--output map. Compression should therefore target the write--read subspace rather than individual coordinates. We propose \method{}, a post-training transform that instantiates balanced truncation with full controllability and observability Gramians and applies the rotation exactly via Mamba-2's scalar-identity transition. Because the useful rank varies widely across layers, we further introduce HARP, which allocates ranks per layer from the Hankel spectrum and protects retrieval-sensitive layers, improving both perplexity and retrieval over uniform budgets. Calibration takes a single forward pass, an order of magnitude faster than GHOST's released protocol, with lower peak memory. With HARP, \method{} halves the state dimension at an average WikiText-2 perplexity increase of $0.3$ points ($1.8\%$) across 130M--2.7B, versus $1.6$ ($9.3\%$) for GHOST, and the gap widens at 25\% retention.
72. 【2610.36582】Structured Maps for Landmark-Based Route Instructions with LLMs
链接：https://arxiv.org/abs/2610.36582
作者：Mifu Matsumoto,Yuki Nakanishi,Tomoya Hashiguchi,Hiroaki Ohshima
类目：Computation and Language (cs.CL)
关键词：human landmark preferences, landmark-based route instructions, generate landmark-based route, generate landmark-based, geometry and human
备注： Accepted for publication at BESC 2026
点击查看摘要
Abstract:To generate landmark-based route instructions, models must understand both map geometry and human landmark preferences. Although large language models (LLMs) show great abilities in language tasks, the best way to structure map data for these models is not yet established. This paper proposes a structured text representation for landmark selection tasks in route navigation, utilizing SVG format to encode spatial features. The structured text maintains a geometric connection with rendered map images, allowing language models to directly access spatial and semantic data. Using a new dataset created from human-written route descriptions and OpenStreetMap data, we evaluate models on two tasks: landmark selection at turns and around destinations. Experiments with five LLMs show that the proposed structured text input performs as well as or better than image-based PNG inputs. In addition, task-specific fine-tuning enables smaller local LLMs to effectively leverage map layouts to achieve high selection accuracy. These results demonstrate that structured text is an efficient and lightweight interface for spatial reasoning in human-oriented navigation.
73. 【2610.36569】Decoupling Consistency and Conflict across MLLM Layers for Fake News Detection
链接：https://arxiv.org/abs/2610.36569
作者：Kai Qian,Dongjie Xu,Weijie Shi,Jiaqi Wang,Haolun Ma,Jia Zhu,Jiajie Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Web content faces, trustworthiness of Web, Web content, faces a growing, growing threat
备注： 12 pages
点击查看摘要
Abstract:The trustworthiness of Web content faces a growing threat from multimodal fake news. Real news usually shows aligned image-text semantics, while fake news often contains a few conflicts at varying levels, such as mismatches in objects, scenes, events, and claims. However, existing methods usually treat consistency and conflict in a coarse and static way, limiting their ability to capture sparse conflicts and adapt to varying conflict levels. Inspired by the distinct knowledge encoded across layers in large language models, we propose Multi-Level Consistency and Conflict Decoupling (MLCCD), which captures conflicts at different levels from different layers of multimodal large language models (MLLMs). Specifically, we first use the MLLM's final decision representation to select visual and textual tokens relevant to the task, preventing irrelevant content from diluting sparse conflicts. Then, we preserve tokens whose representations change sharply between adjacent layers, capturing the knowledge each layer adds. Finally, we decouple this knowledge into consistency and conflict evidence and aggregate each across layers with its own router, adapting to varying conflict levels. Experiments on three benchmarks show that MLCCD outperforms existing methods.
74. 【2610.36557】QESChunker: A Single Objective Unifies Overlapping and Non-Overlapping Chunking for RAG
链接：https://arxiv.org/abs/2610.36557
作者：Yifan Zhao,Qianyang Zhao,Xinyu Guan,kai wei,Yuming Deng
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Optimization and Control (math.OC)
关键词：fundamental preprocessing step, chunkers rely primarily, existing chunkers rely, retrieval-augmented generation, primarily on heuristics
备注： 16 pages, 8 figures, 4 tables
点击查看摘要
Abstract:Chunking is a fundamental preprocessing step in retrieval-augmented generation (RAG), yet most existing chunkers rely primarily on heuristics. We introduce the Question--Evidence-Supervised Chunker (QESChunker), to our knowledge the first method for constructing static chunk indices from question--evidence supervision. QESChunker constructs document-specific chunk indices by optimizing over human-annotated or LLM-generated question--evidence pairs, without access to held-out test queries. We formulate non-overlapping and overlapping index construction through a unified question--evidence utility-maximization objective, turning chunking into a supervised combinatorial optimization problem. Under the non-overlap constraint, the objective decomposes over chunks and can be optimized exactly in polynomial time by dynamic programming. When overlap is allowed, the objective becomes monotone submodular; exact optimization is NP-hard, but our greedy achieves a $(1-1/\sqrt{e})$-approximation. Across two self-constructed and three public datasets, both variants outperform existing chunking methods in complete-evidence recall in nearly all evaluated settings, under the same overlap regime and a fixed hybrid retriever. These results recast chunking as supervised, budget-aware index construction for evidence retrieval.
75. 【2610.36554】PRISM-BENCH: Diagnosing Grounded and Faithful Multimodal Reasoning Beyond Final-Answer Accuracy
链接：https://arxiv.org/abs/2610.36554
作者：Vansh Bhatia,Mehdi Rezagholizadeh,Parsa Ashrafi Fashi,Igor Gilitschenski,Vikram Appia,Emad Barsoum
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Final-answer accuracy reports, stated reasoning reflects, reflects that evidence, cost to produce, Final-answer accuracy
备注： Accepted as a poster at the NeurIPS 2026 Workshop on Grounded and Faithful Vision-Language Models for Real-World Deployment (VLM4RWD). 18 pages, 10 figures, 7 tables. Dataset: [this https URL](https://huggingface.co/datasets/vanshbhatia/PRISM-BENCH)
点击查看摘要
Abstract:Final-answer accuracy reports whether a vision-language model was right, but not whether its answer was grounded in the image, whether its stated reasoning reflects that evidence, or what the answer cost to produce. Those are the properties that decide whether a system can be deployed. We present PRISM-BENCH, a benchmark of 1,000 expert-curated questions spanning five under-represented reasoning categories, in which every item carries an idealized reasoning trace written by one human annotator and validated by another. The traces support two diagnostics that accuracy cannot provide. A perception probe, in which the model answers from a description it wrote itself, attributes roughly 85% of frontier-model failures to misperception and places the bottleneck at grounding. Trace alignment predicts answer correctness for all 25 systems tested (macro AUROC 0.66) and survives length control, so it measures reasoning content and not verbosity. We further introduce CORE, an efficiency-aware metric that reorders 24.2% of model pairs relative to accuracy while remaining uncorrelated with response length. Across 25 open and closed systems, including GPT-5 and Claude Opus 4.6, the best accuracy is 66.0%. On the four categories with a human baseline the best system trails humans by 18.4 points, and recent frontier gains fall on recognition and not on spatial grounding.
76. 【2610.36538】Agentic Data Sampling Framework for Multilingual ASR via Linguistic-Aware Error-Driven Optimization
链接：https://arxiv.org/abs/2610.36538
作者：Zhiheng Qian,Junhao Du,Jing Peng,Hanqi Li,Kunyang Peng,Feng Xue,Lu Chen,Shuai Wang,Kai Yu
类目：Computation and Language (cs.CL)
关键词：automatic speech recognition, achieved rapid progress, large-scale pretrained models, multilingual speech corpora, Multilingual automatic speech
备注：
点击查看摘要
Abstract:Multilingual automatic speech recognition (ASR) has achieved rapid progress with large-scale pretrained models and multilingual speech corpora. Previous studies have proved the pivotal role of data sampling in multilingual ASR performance. However, existing sampling strategies largely rely on time-consuming manual, heuristic-based designs. To address this, we propose a linguistic-aware agentic data sampling framework that introduces a data sampling LLM agent into the multilingual ASR training loop. The agent is driven by a linguistically grounded rubric that analyzes ASR errors from phonological, morphological, and syntactic perspectives, and uses the resulting feedback together with training statistics, budget constraints, and algorithm profiles to select domain-level, sample-level, and token-level sampling strategies. This design turns evaluation results into adaptive data-selection decisions rather than treating WER/CER as final endpoints only. We conduct experiments on twelve Common Voice languages using Whisper-medium as the ASR backbone. The results show that our method achieves performance better than full-data training while using less training data and lower computational resources, and substantially accelerates training convergence compared to conventional sampling strategies.
77. 【2610.36533】RoboAuto: Autonomous Robot Program Search through Multi-Level Physical Understanding
链接：https://arxiv.org/abs/2610.36533
作者：Buzhao Liu,Jianing Ye,Xiu Yuan,Yangtong Feng,Chengsong Huang,Tyler Dinh,Yevgeniy Vorobeychik,Ning Zhang,Chongjie Zhang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：shown strong capabilities, LLM-based autonomous agents, refining executable solutions, LLM-based autonomous, iteratively generating
备注： Project page: [this https URL](https://roboauto-ai.github.io/)
点击查看摘要
Abstract:Recently, LLM-based autonomous agents have shown strong capabilities in iteratively generating, evaluating, and refining executable solutions. In robotic manipulation, Code-as-Policy lets these agents search over modular and editable robot programs. However, effective program search requires physical understanding: agents must understand how objects can be manipulated, how scene geometry constrains actions, and why interactions succeed or fail. Existing methods rely mainly on execution feedback for program refinement, often leaving these physical questions unresolved. We introduce RoboAuto, a framework for robot program search that explicitly organizes physical understanding at the object, scene, and interaction levels through three components. First, a hierarchical knowledge base combines executable skills with object-centric knowledge of affordances, spatial relations, and action effects, learned from embodied data and online task solving. Second, scene grounding connects this knowledge to the current environment by identifying relevant objects and resolving action-critical quantities. Third, multi-stage planning with self-designed experiments checks whether each stage produces its expected physical effects and actively tests competing hypotheses to resolve physical uncertainties. RoboAuto achieves superior performance across five benchmark families, attaining an 89.1% success rate on short-horizon LIBERO-PRO tasks and more than twice the mean success rate of ASPIRE on LIBERO-PRO Long and LIBERO-Plus. It also outperforms ASPIRE and $\pi_{0.5}$ on three challenging long-horizon real-robot tasks requiring precise manipulation. We further show that the knowledge base transfers across simulators and embodiments, and that program search performance scales with its size. Project page: this https URL
78. 【2610.36527】ETC-Bench: A Multilingual Benchmark for Evaluation-Side Transcript Canonicalization
链接：https://arxiv.org/abs/2610.36527
作者：Zhiheng Qian,Junhao Du,Jing Peng,Hanqi Li,Kunyang Peng,Feng Xue,Kai Yu
类目：Computation and Language (cs.CL)
关键词：Written transcripts, evaluation-side transcript canonicalization, evaluation-side transcript, Written, speech signal
备注：
点击查看摘要
Abstract:Written transcripts of the same speech can differ in ways that are not uniquely determined by the speech signal. We formulate evaluation-side transcript canonicalization (ETC), which maps multiple surface forms to a single canonical form when their differences are not determined by speech. To our knowledge, ETC-Bench is the first and most comprehensive multilingual benchmark for evaluation-side transcript canonicalization, covering 181 phenomenon types across 12 languages. Each instance is a minimal pair that shares a sentence context and differs only in a target span exhibiting one phenomenon. To evaluate both canonicalization success and semantic preservation, we propose Semantic-preserving Exact-match Normalization Accuracy (SENA), which combines exact agreement between independently canonicalized pair members with a pair-relative BERTScore constraint against information loss. We further introduce the Taxonomy-guided Agent Canonicalization Skill (TACS), which provides LLM agents with phenomenon descriptions and explicit canonicalization contracts. Experiments with five baseline configurations and three TACS-based agents show that the agents outperform the baseline systems on shared languages. ETC-Bench provides a systematic testbed for evaluation-side transcript canonicalization across languages.
79. 【2610.36524】Causal Localization of Evidence Effects in Transformers
链接：https://arxiv.org/abs/2610.36524
作者：Jipeng Li,Pramod Khargonekar,Yanning Shen
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：controlled evidence aggregation, frozen Transformer preference, introduce controlled evidence, reveal attention heads, sets
备注：
点击查看摘要
Abstract:Can controlled symbolic inputs reveal attention heads that influence a language model's decisions from natural language evidence? We introduce controlled evidence aggregation (CEA), which varies the counts and order of two symbols in otherwise fixed prompts and measures changes in a frozen Transformer's preference between two answer tokens. The preference is measured by their logit difference; the prompts prescribe no correct answer. Balanced utility causal selection (BUC) identifies compact head sets by jointly evaluating how much ablating their outputs removes the count effect and how closely patching mean outputs between count conditions recovers the effect in both directions. We derive conditional bounds linking head attribution to intervention effects and specifying when the attribution shortlist can be recovered from finite samples. In Pythia-410M, ablating sets of 1-12 heads selected separately for four ordering regimes removes 65.5-91.6% of the count effect. The sets retain their influence on count comparisons not used for selection. To test relevance beyond symbolic inputs, we evaluate a natural language task asking which state is supported by more reports. Ablating eight heads selected only on symbolic yes/no prompts lowers mean accuracy by 8.2 percentage points, versus 0.8 for random sets matched by size and layer. Our results demonstrate that controlled symbolic probes can identify compact attention head sets whose causal influence extends to natural language decisions.
80. 【2610.36523】Benchmarking Task Takeover Across Agent Handoffs
链接：https://arxiv.org/abs/2610.36523
作者：Wenyuan Li,Guang Li,Dongyuan Li,Keisuke Maeda,Takahiro Ogawa,Miki Haseyama
类目：Computation and Language (cs.CL)
关键词：responsibility may pass, agents collaborate, collaborate on longer, State Continuity Benchmark, Handoff State Continuity
备注：
点击查看摘要
Abstract:As agents collaborate on longer tasks, responsibility may pass between models before the work is complete. The receiving model must build on prior decisions, observations, and actions while addressing the remaining requirements. Evaluating this transition requires connecting the information preserved at handoff to how the receiver continues the work, a relationship that task-success and memory-retention scores alone do not capture. We introduce the Handoff State Continuity Benchmark (HSC-Bench), comprising 1,039 tasks that evaluate two complementary aspects of task takeover: recovering relevant repository evidence and continuing from established conversational, tool, and file-work state. Comparisons across six receiving models show that structured handoff state improves repository evidence recovery for every model and continuation performance for most models. The strongest receivers differ between the two tracks, showing that evidence-recovery rankings alone do not characterize performance when continuing from inherited state. By combining these comparisons with checks of subsequent responses and actions, HSC-Bench evaluates both access to prior evidence and adherence to established commitments and completed work. This provides a basis for selecting receiving models and assessing handoff representations according to the work that must be carried forward.
81. 【2610.36520】Folding Attention Biases into Keys Makes Compacted KV Caches Run on Standard Kernels
链接：https://arxiv.org/abs/2610.36520
作者：Utkarsh Kanwat
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Attention Matching, matching Hugging Face, key logit, Attention, bias
备注： 30 pages, 2 figures, 18 tables
点击查看摘要
Abstract:Attention Matching (AM) compacts a KV cache by keeping some keys per head, refitting their values and adding a bias to each kept key's logit. FlashAttention and vLLM's paged caches have no input for it. We fold the bias into the keys along one closed-form direction per head, fitted on context queries, giving a plain cache with AM's size and head dimension and the model's own query path; the output error is bounded by how far each query's projection on that direction is from 1. With equal per-head budgets, unmodified vLLM serves folded caches through a KV connector, matching Hugging Face's answers on all 51 Qwen3-4B questions and its greedy output on 180 of 200 Qwen3-14B LongBench samples. With equal budgets on QuALITY (Qwen3-1.7B, 4B, 8B, Llama-3.1-8B) and LongHealth (three Qwen3 models), the fold is within noise of AM's accuracy in 13 of 14 settings, with lower KL to the full cache than dropping the bias in all 12 where both ran. Under the published per-head budgets, on Qwen3-4B, its Instruct-2507 variant and Llama-3.1-8B, it is within noise of AM in 9 of 10, no longer beats dropping the bias in KL, and the two each win once in accuracy.
82. 【2610.36513】MedConstBench: Benchmarking How Constitutions Steer LLMs in Medical Ethics
链接：https://arxiv.org/abs/2610.36513
作者：Yibo Yang,Zerui Huang,Haomiao Yang,Zixia Wang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：answer medical questions, models advance rapidly, language models advance, large language models, advance rapidly
备注： 8 pages, 3 figures, 8 tables
点击查看摘要
Abstract:As large language models advance rapidly, they are increasingly used to answer medical questions, and many such models are now deployed locally. Once a model is deployed, its behavior is governed mainly by the ethical policy written into its constitution. However, most existing work focuses on factual correctness rather than the trade-off between competing ethical values. Even benchmarks that do evaluate ethics treat it as a fixed property of the model rather than as a variable, so how a constitution reshapes medical-ethics behavior remains largely unexplored. We introduce MedConstBench, a medical-ethics benchmark that treats the deployment constitution as a controlled variable, is organized around Beauchamp's four principles, and is scored by human-calibrated multi-model peer review. It includes MedDilemma, our own dataset of clinical dilemmas, and supports a systematic analysis of how constitutions steer LLMs. Evaluating ten open-source LLMs under four constitutions, we find that the effect of a constitution is dimension-selective and model-dependent, and that no constitution is universally optimal. Motivated by these findings, we propose a do-no-harm adaptive selector that chooses a constitution per model, matching the per-model oracle while guaranteeing a worst-case floor and generalizing to unseen models at low cost.
83. 【2610.36511】Do AI Scientists Know What's New?
链接：https://arxiv.org/abs/2610.36511
作者：Miri Liu,Xiayu Zhao,Encheng Xie,ChengXiang Zhai
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：major challenge facing, scientific discovery pipelines, major challenge, challenge facing, facing AI scientific
备注：
点击查看摘要
Abstract:A major challenge facing AI scientific discovery pipelines is how to determine when a generated idea is meaningfully novel. Ideally, novelty checks in these pipelines must be able to reject non-novel ideas while not rejecting too many novel ideas, and they should also be able to distinguish which parts of a proposal are non-novel, as opposed to opaquely discarding entire proposals. We design an analytical framework for evaluation of novelty checks with temporal ground truth at both the proposal- and claim-level, using four datasets of 1,060 proposals built from published papers, reviewer disputes, and generated ideas matching ones the field went on to publish. Auditing existing novelty checks with this framework, we find that checks with high rejection rates on non-novel work also tend to have high false alarms on ideas that are later realized by human researchers, and observe that checks built to evaluate proposals as a whole can point to claim-level prior art only by rejecting the whole proposal. We therefore introduce ClaimNov, a fine-grained, interpretable claim-level novelty module. ClaimNov catches 97% of disguised papers at a 1.5% false-alarm rate, and its claim-level novelty profile cuts the LLM judge's false alarms from 11.8% to 1.5%. Because its verdict rests on claim-level evidence, ClaimNov also keeps proposals that build on established contributions, rejecting only 3% of ICLR-accepted proposals with a reviewer-disputed contribution and keeping 91 of 100 novel proposals with one spliced prior contribution, against 76 for the strongest existing check. Code and data are available at this https URL.
84. 【2610.36493】AC-JEPA: Anchored Cross-Modal Joint Embedding Predictive Architecture for Visual-to-Symbolic Translation
链接：https://arxiv.org/abs/2610.36493
作者：Chaofei Hong,Ziyang Chen,Baochen Wang,Christina Yi Jin,Qing Zhang
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：capture shared semantics, translation requires models, fine-grained structure required, requires models, models to capture
备注：
点击查看摘要
Abstract:Cross-modal translation requires models to capture shared semantics across modalities while preserving the fine-grained structure required by the target modality. Yet in real-world scientific domains, paired data are often imperfect, while obtaining clean pairs at scale is costly. Supervised fine-tuning (SFT) directly optimizes cross-modal translation through categorical token-level supervision, but this objective is sensitive to errors in the target sequences. JEPA offers a complementary representation-space objective, but most existing formulations focus on prediction within a modality rather than translation across modalities. We introduce Anchored Cross-Modal JEPA (AC-JEPA), an SFT-compatible plug-in that predicts masked intermediate states in both cross-modal directions using paired data. The joint-embedding objective targets cross-modal structure predictable from context, while the causal SFT path retains direct token-level supervision for the target sequence. During self-training, AC-JEPA learns from continuous latent targets derived from imperfect pseudo-labeled pairs, offering intrinsic tolerance to local data errors without promoting pseudo-tokens to hard categorical supervision. Using optical chemical structure recognition as a testbed, AC-JEPA trained on clean pairs achieves 76.07% accuracy on the Simple set of the WildMol benchmark, compared with 67.40% for SFT alone. Using the same pseudo-labeled data for both approaches, AC-JEPA-based self-training further raises accuracy to 80.23%, whereas accuracy under direct SFT drops from 67.40% to 63.47%. These results support SFT-anchored joint-embedding prediction as an effective strategy for cross-modal translation under both curated and imperfect supervision.
85. 【2610.36449】A Heart Means Recursion: Exploring Visual Meaning and Communication in VLMs
链接：https://arxiv.org/abs/2610.36449
作者：Alexa R. Tartaglini,Zhengxuan Wu,Thaddäus Wiedemer,Martin Wattenberg,Been Kim,Yuxuan Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：communicate visually, ability to communicate, visual, models, communication
备注：
点击查看摘要
Abstract:Do vision-language models (VLMs) share our ability to communicate visually? We share preliminary findings, starting from a surprising observation: simple visual symbols like a red heart can strongly influence model behavior on seemingly unrelated tasks, such as steering models towards recursive solutions on simple coding problems. Notably, this steering effect is largely implicit, as models' direct interpretations and thinking traces about visual symbols diverge substantially from their observed behavior. In visual communication between models, this leads to a generation--interpretation gap: while models tend to send shape primitives that they (and humans) find intuitive, these visual cues often fail to steer other models. In further communication games involving abstract concepts and stories, models can creatively use visuals to transmit meaning to one another, although some communications remain non-intuitive to humans. These findings reveal that VLMs might be capable of rich, creative, and visually-grounded communication, but their interpretation and production of visual meaning diverges from human conventions in surprising ways. Together this work highlights both the promise and challenges of visual communication between humans and VLMs.
86. 【2610.36437】CONCUR: Concordant Auxiliary Rewards for Multi-Task, Multi-Reward Reinforcement Learning
链接：https://arxiv.org/abs/2610.36437
作者：Jixuan Leng,Si Si,Fei Wang,Cho-Jui Hsieh,Jiong Zhang,Hsiang-Fu Yu,Inderjit S. Dhillon
类目：Computation and Language (cs.CL)
关键词：Large Language Model, Reinforcement Learning, Large Language, trained with Reinforcement, Language Model
备注：
点击查看摘要
Abstract:When a Large Language Model (LLM) is trained with Reinforcement Learning (RL) on multiple tasks, a task's primary reward can gate auxiliary rewards such as a length reward: on a failing response, an auxiliary cannot exceed the primary. However, group-relative advantage estimators treat a gated auxiliary like any other component, so it can reverse the primary's order, and at the primary's ceiling only auxiliaries order responses. Keeping gated auxiliaries hurts some tasks, while dropping them hurts others. We propose CONCUR, an advantage estimator that replaces the standardized scores of each gated auxiliary with the closest scores that satisfy two conditions: responses with higher primary rewards cannot receive lower scores, and responses at the primary's ceiling receive equal scores. CONCUR-T applies both conditions throughout training, and CONCUR-A lifts the second for an auxiliary that agrees with the primary's order more often than it reverses it among passing responses. On three models from two families and across math, code, instruction following, and writing, both variants score higher on average than all baselines and than when all the gated auxiliaries are dropped.
87. 【2610.36432】No Tokenizer, Still a Gap: Cross-Lingual Fairness of Homoglyph and Invisible-Character Watermarking
链接：https://arxiv.org/abs/2610.36432
作者：Alexander Nemecek,Yuqiao Xu,Joseph Falkenburg,Erman Ayday
类目：Computation and Language (cs.CL); Cryptography and Security (cs.CR); Computers and Society (cs.CY)
关键词：text, invisible-character watermarks, edit-based watermarks, watermarks, characters
备注： 19 pages
点击查看摘要
Abstract:Homoglyph and invisible-character watermarks are edit-based watermarks. Instead of changing how a model generates text, they hide a signal in the text after it is written. They swap some characters for homoglyphs, which look the same, or very similar, but have different Unicode code points, or they insert characters that do not display, all without access to the model that wrote the text. Generation-time watermarks work less well for lower-resourced languages due to how tokenizers split their text. Because they work on individual characters, these watermarks never touch a tokenizer, so we ask whether they escape this gap. Across 40 language varieties in 24 scripts, we measure capacity (the hidden bits each character can carry), how much of it survives routine handling and targeted removal, and how much text a keyed detector needs. Capacity varies 3.3-fold and script accounts for 96\% of that variation. Within Latin script, resource level makes no detectable difference ($\rho=+0.095$, $p=0.78$), but across scripts capacity rises with it ($\rho=+0.54$, 95\% CI $[+0.14,+0.83]$), because lower-resourced languages tend to use scripts with few homoglyphs. Ordinary copy-paste, which strips invisible characters, widens the gap: a detector then needs about 2 code points of English or Persian but 93 of Lao. Removing the tokenizer does not remove the inequity, but instead only changes its source.
88. 【2610.36384】SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding
链接：https://arxiv.org/abs/2610.36384
作者：Matea Tashkovska,Naël Ouerghemi,Haozhe Qi,Alexander Mathis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)
关键词：Perceiving human body, Large Language Models, Perceiving human, assist people, systems that understand
备注： Code and data at: [this https URL](https://cnai.epfl.ch/soma)
点击查看摘要
Abstract:Perceiving human body motion is critical for multimodal systems that understand and assist people. Yet current evaluations of Multimodal Large Language Models (MLLMs) largely focus on objects, scenes, and coarse actions, leaving their ability to reason about the body itself poorly assessed. This is especially challenging from the egocentric perspective, in which the body is only partially visible and motion must be inferred from occluded and temporally distributed cues. We introduce SOMA, a benchmark for fine-grained body-motion understanding from egocentric video, comprising 1,632 human-verified questions across three capability axes: body configuration, motion dynamics, and temporal reasoning. We evaluate 37 leading closed-source, open-source, and specialized egocentric MLLMs, complemented by an extensive human evaluation. We find that humans also find this task difficult from video alone (68.5% accuracy), yet clearly outperform the strongest MLLM (Qwen3.6-27B), which reaches 50.0% zero-shot accuracy. Our error analysis shows that MLLMs often misread the wearer's own body, misjudge events in time, and are prone to biases such as favoring the right hand or under-counting repetitions. To narrow the gap to human performance and support further progress, we introduce a training dataset of aligned video, body motion, and language supervision, and a multimodal baseline that jointly learns from these modalities. By identifying common failure modes and missing capabilities in current MLLMs, we hope SOMA will inspire future research on body-motion understanding and multimodal reasoning. Full benchmark, training data, and code will be released at: this https URL
89. 【2610.36360】AK_QMUL at ArGuard Shared Tasks: A Single Fine-Tuned JAIS for Arabic Harmful-Prompt Detection
链接：https://arxiv.org/abs/2610.36360
作者：Ali Khairallah,Arkaitz Zubiaga
类目：Computation and Language (cs.CL)
关键词：Arabic harmful-prompt detection, seven-way harm-domain task, Arabic harmful-prompt, QMUL submissions, shared tasks
备注： Published at ArabicNLP 2026 (Shared Tasks), co-located with EMNLP 2026. ACL Anthology: [this https URL](https://aclanthology.org/2026.arabicnlp-sharedtasks.43/)
点击查看摘要
Abstract:We present AK_QMUL's submissions to the ArGuard-2026 shared tasks on Arabic harmful-prompt detection: a binary safe/unsafe task (B1) and a seven-way harm-domain task (B2). Both submissions use one backbone -- JAIS-6.7B fine-tuned with 4-bit QLoRA and a linear classification head over its last-token representation. For B1 we train a four-way head that factors the label by dialect register {safe, unsafe} x {MSA, other}, we augment the training fold with MSA prompts from AraSafe, and decode with a plain argmax to score safe/unsafe. For B2 we fine-tune the same backbone as a seven-way classifier and average the softmax outputs of five random seeds. Both submissions ranked first on their track, with macro-F1 0.984 on B1 and 0.790 on B2. We report results by dialect and by class: on B1 the model is accurate across all six dialects (93.6--99.8%) and its predicted unsafe rate tracks the true rate closely; on B2 six of the seven classes reach F1 between 0.73 and 0.98, with the residual error concentrated in the Bully class, which overlaps semantically with harassment and harm-to-others.
90. 【2610.36353】Detect Before You Disambiguate: Perturbation-Based Input Ambiguity Detection in LLMs
链接：https://arxiv.org/abs/2610.36353
作者：Tiejin Chen,Xiaoou Liu,Michael Clifford,Ahmadreza Moradipari,Yitao Chen,Kyungtae Han,Nejib Ammar,Hua Wei
类目：Computation and Language (cs.CL)
关键词：Large language models, single intended meaning, Large language, intended meaning, single intended
备注： Accepted to AACL-IJCNLP 2026 Main
点击查看摘要
Abstract:Large language models (LLMs) often answer ambiguous inputs as if they had a single intended meaning. This is problematic because input ambiguity is an upstream source of uncertainty: when a prompt admits multiple valid interpretations, the key question is whether the model should answer directly at all. Existing input uncertainty methods often rely on LLM-generated statements or clarifications, but such transformations may already disambiguate the input before the ambiguity is measured. We propose a label-preserving perturbation framework for input ambiguity detection in which perturbations remain close to the original input while preserving its label. We instantiate this principle with two detectors: a black-box rule-based perturbation library and a white-box importance-guided method using model-internal signals. Experiments across four datasets in open-domain, conversational, and visual QA show that our methods outperform output-side uncertainty baselines and LLM-paraphrase-based perturbation baselines. Our results highlight the importance of detecting ambiguity before attempting to disambiguate it. Our code is available \href{this https URL}{\textcolor{purple}{here}}.
91. 【2610.36269】Cross-modal Steering Vectors Exist Across Both Image and Text Generation
链接：https://arxiv.org/abs/2610.36269
作者：Donghao Zeng(1),Nishant Subramani(2),Tamar Rott Shaham(3),Benno Krojer(1 and 4) ((1) Mila, McGill University, (2) Carnegie Mellon University, (3) MIT CSAIL, (4) Northeastern University)
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：implemented separately, steering, modality, steering vectors, steer generation
备注： Pre-print. Code: [this https URL](https://github.com/saintsauceee/cross-modal-steering) Data: [this https URL](https://huggingface.co/saintsauce) Demo: [this https URL](https://saintsauceee.github.io/unified-cm-steer-demo)
点击查看摘要
Abstract:Are concepts and mechanisms unified across modalities in current AI models, or instead implemented separately for each one? We operationalize this broad question of modality unification by studying cross-modal steering: 1) finding vectors that successfully steer generation on tokens of one modality, which then 2) transfer zero-shot to steer generation when added to tokens of another modality. Our study goes beyond simple correlational alignment (e.g. representational similarity) because steering is fundamentally causal. We study cross-modal steering in several unified multimodal models (UMMs), since they possess shared parameters for language and image generation, focusing on these two modalities. Across diverse steered concepts such as emotion and object size, we show that steering vectors transfer zero-shot in both directions (text-to-image image-to-text). Even for concepts that are highly unique to one modality (e.g. formal vs. colloquial language), steering vectors often induce a consistent, interpretable effect in the other modality, such as formal clothing and design. This transfer has a geometric signature too: despite a clear modality gap separating text and image representations, steering vectors with strong cross-modal transferability tend to point in similar directions for the same concept. Our findings shed light on how vision and language interact inside unified multimodal models and point towards more general, modality-agnostic approaches for controlling their behavior.
92. 【2610.36230】Beyond IceBERT: Open-Data ModernBERT Encoders for Icelandic from 12M to 1B Parameters
链接：https://arxiv.org/abs/2610.36230
作者：Hafsteinn Einarsson
类目：Computation and Language (cs.CL)
关键词：cleaned web crawl, English Ettin encoder, English Ettin encoders, train Icelandic encoders, English Ettin
备注： 20 pages, 1 figure, 11 tables. Models: [this https URL](https://huggingface.co/collections/hafsteinn/icelandic-modernbert)
点击查看摘要
Abstract:IceBERT, the reference encoder for Icelandic, found that a cleaned web crawl is enough to train a strong model and that starting from a multilingual model can help on some tasks. We revisit both findings with the ModernBERT architecture. We train Icelandic encoders from 12M to 1B parameters on 9B tokens of open data, and rerun IceBERT's benchmarks and five newer tasks for 30 encoders under one protocol with confidence intervals. Our 1B model trained from scratch, to our knowledge the first monolingual Icelandic encoder of that size, is significantly better than IceBERT on all eleven tasks; warm-started from the English Ettin encoder of the same shape, it has the best score of all encoders on every task we rank. Because our model shapes match the English Ettin encoders and the multilingual mmBERT, we can also test the warm start under controlled conditions, at six model sizes and four token budgets. With our vocabulary transplanted, a warm start was never significantly worse than scratch training on the same Icelandic text, and from base size up it was not significantly worse on four tasks than scratch training on 4 times the text (8 times at base and 1B). As models grow, most of the transfer comes from the source model's transformer layers, so even an English source helps. Keeping the source vocabulary instead cost 5 F1 on question answering and nearly three times the compute.
93. 【2610.36202】Base Models Can Detect Hidden Intentions that Prompted Classifiers Miss
链接：https://arxiv.org/abs/2610.36202
作者：Oz Amram
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Persona Selection Model, Persona Selection, Selection Model, posits that post-training, learned during pre-training
备注： 28 pages, 10 figures. Code available at [this https URL](https://github.com/OzAmram/psm-mixture-test)
点击查看摘要
Abstract:The Persona Selection Model (PSM) posits that post-training selects a persona the model learned during pre-training. Work on subliminal learning has shown that models can impart covert signals (like "love of owls") into semantically unrelated outputs like strings of numbers, and that students trained on these outputs inherit those traits. In this work I show that by evaluating the likelihood of such outputs under the base pre-trained model with an appropriate header, a method I call persona-header likelihood evaluation (PHLE), one can decode these subliminal signals and classify between them. For example, PHLE distinguishes number sequences generated by a post-trained model prompted with "You love owls" from those prompted with "You love eagles", and distinguishes answers from a model with a secret desire to harm the user, filtered to remove any noticeable misalignment, from those of a model with no system prompt. In both cases prompted classifiers, including the generating model itself, remain near chance. The signal partially persists across model families, with the Qwen base model reading signals generated by Olmo and vice versa. This is evidence for a non-trivial prediction of the PSM, and the method may be practically useful for auditing the hidden objectives of models.
94. 【2610.36195】Learning to Read Braille: Benchmarking and Improving Braille Recognition Capabilities of VLMs
链接：https://arxiv.org/abs/2610.36195
作者：Kartik Jangra,Atharva Gawane,Siddharth Pulipaka,Hemachandran Karah,Raj Dabre
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：fundamental accessibility task, modern vision-language models, modern vision-language, accessibility task, reading Braille
备注： 22 pages, 8 figures, 16 tables. Code and data: [this https URL](https://github.com/kartik0806/BrailleBench)
点击查看摘要
Abstract:Despite rapid progress in visual understanding and document transcription, modern vision-language models (VLMs) struggle with a fundamental accessibility task: reading Braille from images. We introduce BrailleBench, a manually curated benchmark of 259 real-world Grade-1 and Grade-2 Braille images. We evaluate proprietary, open-weight, OCR-specialized, and tool-assisted multimodal systems and find that standalone general-purpose models perform poorly at directly transcribing Braille images, whereas tool-assisted systems perform much better. We design a synthetic Braille generation pipeline with diverse layouts and image perturbations. A 2B VLM model trained on our synthetic data reaches 87% exact match on Grade-1 and 61% on Grade-2 BrailleBench, outperforming standalone VLMs and achieving the highest Grade-2 exact match score among the evaluated systems. We further show that high accuracy on synthetic validation data does not guarantee high accuracy on real photographs in our experiments: models trained on prior synthetic data reach up to 96% on their synthetic validation set but at most 3.26% on Grade-1 BrailleBench. Our results identify an accessibility-relevant capability gap in multimodal systems and show that targeted synthetic supervision can improve real-world Braille transcription.
95. 【2610.36191】LLM Hallucination Detection via Low-rank Multilinear Decomposition
链接：https://arxiv.org/abs/2610.36191
作者：Devansh Sharma,Faizul Rakib Sayem,Shahana Ibrahim
类目：Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：Large language models, frequently generate fluent, factually incorrect responses, Large language, language models
备注： 26 pages, 3 figures. Code: [this https URL](https://github.com/devvansh1997/LOTUS)
点击查看摘要
Abstract:Large language models (LLMs) frequently generate fluent yet factually incorrect responses, raising concerns about their reliability. Recent hallucination detectors increasingly exploit internal representations, but extracting informative signals from high-dimensional hidden states remains challenging. Existing approaches often rely on selected activations or pooling-based compression, potentially overlooking discriminative information distributed across Transformer layers, feature modes, and tokens. We propose LOTUS (Low-rank Order-statistic TUcker-based Subspace learning), a multilinear low-rank decomposition framework for hallucination detection that extracts compact representations from LLM hidden states while reducing dependence on labeled data. Our approach first summarizes variable-length token representations using complementary statistical descriptors that capture peak activations, activation distributions, and cross-layer changes. We then leverage low-rank multilinear decomposition to extract compact representations that capture the underlying structure of LLM hidden states, which are subsequently used to train a lightweight hallucination classifier. Experiments across multiple LLMs and question-answering benchmarks demonstrate improved hallucination detection performance over recent state-of-the-art baselines.
96. 【2610.36187】Frankly Speaking: The Company Election Integrity Keeps in Congressional Communication
链接：https://arxiv.org/abs/2610.36187
作者：Michael A. Robinette,Christina Barsky,Amanda D. Clark,Helen Flannery,Juniper Lovato
类目：Computation and Language (cs.CL)
关键词：American politics, commitment in American, Congress increasingly, shared commitment, American
备注：
点击查看摘要
Abstract:Election integrity is a shared commitment in American politics, but Democrats and Republicans in Congress increasingly mean different things by it. Analyzing 10,420 congressional e-newsletters sent from 2010 to 2025, we examine how the two parties invoke election terms such as ``integrity,'' ``security,'' and ``fraud.'' Using diachronic word embeddings, which track semantic change through how words are used in context, we measure how differently each party uses each term, how much each party shifts, and whether they share nearest semantic neighbors. We show that members of Congress do not need different words to tell different stories about elections. They need only place those same words in different company. Across nearly every term and year, the two parties surround election-integrity vocabulary with entirely different words. That divergence is easy to miss, because most election vocabulary is no more divergent than other words used at roughly the same frequency, and neither party's usage shifted more than the other's. Only a subset of terms grew more divergent, most notably ``certification,'' while ``rigged'' and ``stolen'' entered election discourse after 2020 and polarized there. By 2024, Democrats surround ``voter,'' ``election,'' and ``integrity'' with the language of access and administration. Republicans surround the same terms with ``citizenship verification,'' ``noncitizen voting,'' and ``border security.'' For one party, integrity means protecting eligible voters' ability to cast a ballot. For the other, it means protecting the electoral process from illegitimate ballots. Election officials, who must administer a single system under both definitions, inherit this tension.
97. 【2610.36184】Lipi-Ghor: A Large-Scale, Diarized, Multi-Domain Bengali Speech Corpus and a Scalable Pipeline for Building It
链接：https://arxiv.org/abs/2610.36184
作者：Sanjid Hasan,A H M Fuad,Risalat Labib,Bayazid Hasan Simon
类目：Computation and Language (cs.CL)
关键词：Bengali speech corpus, Bengali speech, remains severely under-resourced, Toggle, Bengali
备注： 12 pages, 7 figures. Published in the Proceedings of the Speech and Audio Language Models Workshop (2nd Edition), pages 190-201, 2026
点击查看摘要
Abstract:Bengali, spoken by over 230 million people, remains severely under-resourced in spoken language research. Existing open Bengali ASR corpora are confined to short, read or crowd-sourced speech and lack speaker diarization and long-form audio. We present Lipi-Ghor, a large-scale weakly-supervised Bengali speech corpus comprising 885 hours of audio sourced from 998 YouTube videos across 596 unique channels, spanning 17 diverse domains including audiobooks, drama, religious sermons, news, and regional dialects. Each recording is annotated in SSTT format (Speaker, Speech, Transcription, Timestamp), which combines automated diarization with Bengali YouTube caption tracks. To our knowledge, Lipi-Ghor is the first Bengali speech corpus to pair large-scale coverage with speaker-diarized, long-form audio annotations, both of which are absent from existing open Bengali resources. We also present the construction methodology as a replicable pipeline for any language with a sufficient captioned YouTube presence. Targeted channel curation across a handful of rich domains yields corpus scales that were previously out of reach for low-resource languages. We benchmark four widely-used ASR models under zero-shot and fine-tuned conditions. All four degrade consistently on emotive, dialectal, and long-form content. Because caption targets are noisy, we also release a human-annotated gold evaluation split, verified by 17 volunteer annotators over 30 hours of human-in-the-loop correction and stratified across all 17 domains. We release our original contributions (video-ID lists, diarization output, pipeline code, and the gold annotations) under CC-BY-4.0, and distribute caption-derived transcripts for research use only; no raw audio is redistributed.
Comments:
12 pages, 7 figures. Published in the Proceedings of the Speech and Audio Language Models Workshop (2nd Edition), pages 190-201, 2026
Subjects:
Computation and Language (cs.CL)
Cite as:
arXiv:2610.36184 [cs.CL]
(or
arXiv:2610.36184v1 [cs.CL] for this version)
https://doi.org/10.48550/arXiv.2610.36184
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Sanjid Hasan [view email] [v1]
Mon, 26 Oct 2026 19:17:52 UTC (1,199 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Lipi-Ghor: A Large-Scale, Diarized, Multi-Domain Bengali Speech Corpus and a Scalable Pipeline for Building It, by Sanjid Hasan and 3 other authorsView PDFHTML (experimental)TeX Source
view license
Additional Features
Audio Summary
Current browse context:
cs.CL
prev
|
next
new
|
recent
| 2026-10
Change to browse by:
cs
References Citations
SciXGoogle Scholar
Semantic Scholar
export BibTeX citation
Loading…
BibTeX formatted citation
loading…
Data provided by:
Bookmark
checked="checked"class=“labs-tab-input”>
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv’s community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)
mathjaxToggle();
We gratefully acknowledge support from our major funders,
member institutions, ,
and all contributors.
About
Help
Contact
Subscribe
Copyright
Privacy
Accessibility
Operational Status (opens in new tab)
98. 【2610.36178】3, 7, 14, 17, 42: Instruction Tuning Installs and Sharpens Number-Choice Heuristics in Language Models
链接：https://arxiv.org/abs/2610.36178
作者：Samar Ansari
类目：Computation and Language (cs.CL)
关键词：language model assigns, sampling error, checkpoints, integer, language model
备注：
点击查看摘要
Abstract:We measure, without sampling error, the probability a language model assigns to each integer from 1 to N when asked for a random number. For a fixed prompt the model defines one probability vector, which we compute by summing over each integer's scored spellings rather than estimate by sampling, removing the noise that limits earlier studies [1, 4]. We evaluate 18 open-weight model lines at five ranges up to N = 100, under 29 decoding configurations, on two inference stacks; 15 of them have matched base and instruction-tuned checkpoints that both give usable answers. Instruction tuning makes the distribution less uniform in all 15 pairs. It installs one heuristic, round-number avoidance, and sharpens another, endpoint avoidance. Base checkpoints do not avoid round numbers once the endpoints are removed from those sets; tuned checkpoints avoid them, multiples of 10 almost completely. Base checkpoints return the endpoints 1 and N at 0.30 to 0.60 of the interior rate; tuned checkpoints almost never return them. A preference for odd numbers is consistent across tuned checkpoints only at N = 100, where base checkpoints also show it weakly. Endpoint avoidance and the odd preference fit the account Kubovy and Psotka [6] proposed for human number choice; round-number avoidance is not part of that account, and the midpoint avoidance it predicts is essentially absent, with one slight exception at N = 100. Tuning does not install a new favourite integer shared across models: above N = 10 no modal integer is shared by more than 42 percent of tuned conditions, and P (17) rises in 10 of 15 pairs and falls in 5. The concentration is present in the model's own distribution: at temperature 1.0, nucleus truncation at top-p 0.95 adds a median of 0.035 to the total variation distance.
99. 【2610.36169】Don't Pick a Winner: Knowledge Conflicts Need a Prior, Not a Rule
链接：https://arxiv.org/abs/2610.36169
作者：Minh Pham Van,Cong Tran
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：retrieval-augmented language model, language model answers, retrieval-augmented language, model, context
备注： 49 pages (9 main text + appendix and supplementary material), 14 figures
点击查看摘要
Abstract:A retrieval-augmented language model answers from two sources, the retrieved context and its own knowledge, and the two disagree whenever the context is incomplete or wrong. Existing methods settle the disagreement with a rule fixed at design time: follow the context, amplify it in proportion to how far it moves the model, or trust the model's memory. Each rule is confidently wrong in some deployment. In a decision-theoretic model of two sources, the score of any fixed rule is linear in the share of reliable contexts while the best attainable score is convex, so every fixed rule is beaten wherever it is not exactly optimal; and a symmetric divergence between the two sources, the signal adaptive decoding uses, carries no information about which one is right. Resolving a conflict therefore needs two inputs that no existing method keeps: evidence about each source separately, and a prior on how often the context is right. We test these claims on GRACE, a benchmark that intervenes on the knowledge-graph context of a fixed question, so that what the model knows, what the context says and what is true are measured separately. There, every baseline from four families is strong on right contexts or on wrong ones, never on both. We then build the two inputs: the model states its knowledge as notes, a small policy voices each note with a calibrated confidence, a reader answers in two voices, and a selector commits or abstains under a prior $\pi$ applied as an exact prior shift. With $\pi$ set to the true share of right contexts, the system is above the best baseline at every mixture of GRACE contexts, by up to 26 points. Its overall score is 45.3 and 35.0 (Qwen3.5-35B-A3B, Llama-3.1-8B), against 29.4 and 27.5 for the best baseline. On preregistered ClashEval it beats same-backbone CK-PLUG and TCR by 12 and 26 points. Where the model lacks the knowledge, the gains vanish, as the theory predicts.
100. 【2610.36126】ConformalMOS: Uncertainty-Aware MOS Prediction with Conformal Intervals and Ordinal Modeling
链接：https://arxiv.org/abs/2610.36126
作者：Kehinde Elelu,Joshua E. Siegel,Mohammadali Saffary,Tashfain Ahmed,Simeon Babatunde,Ebuka Okpala
类目：ound (cs.SD); Computation and Language (cs.CL)
关键词：human Mean Opinion, Opinion Scores, Accurate prediction, synthetic speech quality, evaluating synthetic speech
备注：
点击查看摘要
Abstract:Accurate prediction of human Mean Opinion Scores (MOS) is crucial for evaluating synthetic speech quality in text-to-speech (TTS) and voice conversion (VC). Most MOS predictors output only point estimates and ignore uncertainty, limiting reliability in model selection and deployment. We propose ConformalMOS, a framework that augments MOS prediction with conformal prediction to produce statistically valid prediction intervals with guaranteed coverage under exchangeability, alongside point estimates. During training, MOS labels are modeled in an ordinal-aware manner by converting one-hot targets into Gaussian-smoothed distributions, preserving score ordering. This improves uncertainty calibration, particularly when softmax confidence is overconfident on out-of-distribution speech. On BVCC datasets, ConformalMOS achieves competitive accuracy (MSE = 0.08) while delivering empirically validated coverage, enhancing reliability for real-world TTS and VC deployment.
101. 【2610.36109】Beyond Update Counts: A Control Map for Evaluating Test-Time Model Updates
链接：https://arxiv.org/abs/2610.36109
作者：Zehao Zhao,Shangjian Yin,Rui Liu,Chongyang Bai,Mark Ibrahim,Kavosh Asadi,Yuchen Lu,Hang Cui,Hamed Firooz
类目：Machine Learning (cs.LG); Computation and Language (cs.CL)
关键词：Test-time updating, adapter parameters, memory module, answering queries, Test-time
备注： 44 pages, 6 figures, including appendices
点击查看摘要
Abstract:Test-time updating lets a language model change persistent state after training---such as model weights, adapter parameters, or a memory module---before or while answering queries. Existing evaluations often compare systems using update count or frequency and performance measured immediately afterward. These summaries omit what is updated, where, when, and in what order. The same total can therefore hide an important difference: one system may answer after one update while another answers after two. We introduce the Control Map, an evaluation framework that records the committed updates preceding each scored answer and separately evaluates behavioral changes, immediate learning (acquisition), later recall (retention), preservation of unrelated behavior (locality), and performance in new settings. We prove when counts alone determine final state and show, under stated assumptions, how differences between pre-answer histories limit differences in average scores. Using ControlMap, our experiments reveal three insights. First, update scheduling matters: at a 760M-parameter checkpoint, 24 schedules with the same update count yield 19.7%--34.2% accuracy. Second, learning an edit does not guarantee that it lasts or remains contained: all six selected CounterFact LoRA settings learn the new information, while ROME retains edits at all 13 operating points but fails locality at each. Third, no editor performs best consistently across models, benchmarks, and tests. Evaluations should therefore report update histories and assess acquisition, retention, and locality separately.
102. 【2610.36083】FinLLM-KG: Knowledge Graph-Enhanced LLMs for Financial Sentiment Analysis in Algorithmic Trading
链接：https://arxiv.org/abs/2610.36083
作者：Giorgos Iacovides,Oliver Hannibal,Wuyang Zhou,Danilo Mandic
类目：Computation and Language (cs.CL); Machine Learning (cs.LG); Statistical Finance (q-fin.ST); Trading and Market Microstructure (q-fin.TR)
关键词：Recent advances, advances in Generative, large language models, substantially improved financial, post-trained financial large
备注：
点击查看摘要
Abstract:Recent advances in Generative AI have substantially improved financial sentiment analysis through post-trained financial large language models (LLMs). However, existing approaches remain confined to predicting the sentiment of each article in isolation and operate as black boxes, which limits contextual understanding and hinders deployment in high-stakes financial decision-making. To this end, we introduce FinLLM-KG, a model-agnostic framework that combines causal LLMs with a financial knowledge graph, in order to inject temporally grounded, company-level knowledge from SEC 10-K filings at inference time, without updating model weights. Within FinLLM-KG, context is supplied either as a natural-language company profile or as a small set of relevance-ranked factual triples. This enables sentiment predictions to account for broader firm-level information rather than the article alone, at almost zero computational cost and for any causal LLM. In addition, attributing each article-level sentiment score to individual sentences and to the retrieved knowledge-graph facts makes the evidence behind the prediction inspectable, thereby enhancing explainability and supporting human-in-the-loop review. Simulations demonstrate that FinLLM-KG consistently improves portfolio performance over the state-of-the-art baseline.
103. 【2610.36082】How Much Does the Hint Matter? Scope Conditions for Hindsight Self-Distillation in Financial Reasoning
链接：https://arxiv.org/abs/2610.36082
作者：Johnny Yu,Cyril Gorlla
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：trail frontier systems, Financial institutions operating, open-weight models small, locally host, institutions operating
备注： 8 pages, 3 figures, 5 tables. Accepted at the 7th ACM International Conference on AI in Finance (ICAIF '26), Milan, Italy. Code and data: [this https URL](https://github.com/johnnyhyu/fin-sd)
点击查看摘要
Abstract:Financial institutions operating under data-residency constraints are restricted to open-weight models small enough to locally host, which trail frontier systems on multi-step quantitative reasoning. On-policy distillation narrows such gaps by supervising a student on its own rollouts, but traditional OPD requires a strong external teacher, and on-policy self-distillation (OPSD) conditions on a full reference solution. We ask how much of that signal is necessary. We present Fin-SD, a localized hindsight self-distillation recipe for multi-step reasoning. Given a problem the student fails, the student itself identifies the first incorrect reasoning step and writes a short critique of that step. We truncate the student's trajectory immediately before the error (aiming to obtain a correct prefix), condition a frozen copy of the student on the same prefix plus the hint, and distill that hint-conditioned teacher into the student over a short rollout under reverse KL. No external model contributes a gradient. We apply Fin-SD to GPT-OSS-20B on a custom multi-step financial reasoning benchmark that requires deriving formula inputs from realistic scenarios via accounting conventions. We find: (i) replacing the critique with a generic-feedback control matches Fin-SD's entire 3.03 pp accuracy gain over the base model on the FinanceReasoning Hard subset, suggesting the gain comes from where supervision is applied, not hint content; (ii) the model writing the hint does not need to be stronger than the model receiving it: hints from same-family GPT-OSS-120B, at roughly 6x the parameters, yield no materially greater benefits than self-written hints; and (iii) Fin-SD matches on-policy self-distillation from full reference solutions on accuracy while generating 9.5% fewer tokens. With Fin-SD, general reasoning on MMLU-Pro and a fourteen-metric compliance audit on FinTrust show no material regression.
104. 【2610.36013】OmniBrain-0: A Unified Agentic Model for Embodied Intelligence
链接：https://arxiv.org/abs/2610.36013
作者：Xiaomi Embodied Intelligence Team:Yuechen Luo,Chong He,Fang Li,Shaoqing Xu,Jingkai Wang,Menglun Su,Jiaxin Liu,Shengyin Jiang,Zhiyi Lai,Long Chen,Longlong Wang,Liang Hu,Haochen Liu,Yuncheng Jiang,Hongwei Xie,Jieming Cui,Hanbing Li,Junjie Huang,Zhixiang Duan,Hexin Zhang,Weixiang Liang,Ying Gong,Yuhan Wang,Yong Pan,Pengna Li,Kangyi Wu,Ken Deng,Kun Ma,Fuxi Wen,Zhi-xin Yang,Hangjun Ye(University of Macau, Tsinghua University)
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：General-purpose embodied intelligence, intelligence requires robots, coordinate diverse skills, embodied intelligence requires, General-purpose embodied
备注： Technical Report; 40 pages, 27 figures, 8 tables; Project Page at [this https URL](https://public-bots.github.io/OmniBrain-0/)
点击查看摘要
Abstract:General-purpose embodied intelligence requires robots to coordinate diverse skills over long horizons, track task progress, and recover from failures. Specialist policies alone do not ensure task-level reliability, while powerful multimodal agents rely on costly reasoning and external experience that compact models struggle to reproduce. We introduce OmniBrain-0, a lightweight unified embodied agent that coordinates manipulation and navigation through a shared high-level decision model, integrating task understanding, planning, progress tracking, and feedback-driven recovery. Our progressive training framework combines embodied pretraining, domain-specialized agent distillation, and multi-teacher on-policy distillation (MOPD). It distills powerful teachers' interaction experience into manipulation and navigation experts, then consolidates their decision capabilities into OmniBrain-0. Unification therefore occurs within the learned decision model rather than only at the tool interface. We further introduce Rubric-Guided Recursive Self-Improvement (RSI), a data flywheel in which a Meta-Agent turns execution evidence into refined rubrics, step-level reminders, and verified trajectories for domain-expert updates before their reconsolidation into OmniBrain-0 through MOPD. We evaluate OmniBrain-0 on LIBERO-Pro, LIBERO-Plus, RoboCasa365, RoboTwin 2.0, and R2R-CE Val-Unseen, as well as multiple real-world manipulation tasks. OmniBrain-0 combines strong cross-domain task performance with substantially lower inference and execution overhead than its closed-source teacher, demonstrating efficient transfer and consolidation of embodied capabilities into a compact unified agent.
105. 【2610.36006】MedJev: Evaluating Zero-Shot System-One Decision Making in Medicine
链接：https://arxiv.org/abs/2610.36006
作者：Simon A. Lee,Jiahang Sha,Moonseong Jeong,Yunbei Pan,Jeffrey N. Chiang
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Jev answer structured, answer structured questions, single forward pass, Jev answer, efficient clinical decision
备注：
点击查看摘要
Abstract:System One decision models such as Jev answer structured questions in a single forward pass without generating text, offering fast and computationally efficient clinical decision support. We evaluate MedJev, an open System One model that runs locally on a laptop, across ten medical benchmarks spanning medical knowledge, diagnosis, and patient level prediction using MIMIC IV and MIMIC IV ED. We compare MedJev against zero shot LLM baselines, published GPT results, and supervised models. MedJev achieves accuracies of 72.5 percent on MedQA, 75.4 percent on USMLE, and 80.1 percent on NEJM, approaching published GPT 4 performance while maintaining well calibrated confidence estimates (ECE 0.028 to 0.063). On patient level tasks, MedJev achieves an AUROC of 0.926 for In Hospital Mortality, exceeding XGBoost (0.902), but underperforms supervised models on operational outcomes such as ED Triage Admission (0.745 vs. 0.809). Patient level predictions also exhibit substantial miscalibration (In Hospital Mortality ECE 0.286). We introduce a lightweight, two parameter recalibration method that adapts predictions to local patient populations using 50 to 200 labeled examples, reducing ECE to 0.007. Our findings establish open System One models as a promising zero shot baseline for medical AI, combining competitive predictive performance with low computational cost and efficient local calibration. We release our code and evaluation harness to support future research.
106. 【2610.35929】SCOPE: Source Credibility and Outlet Profiling Engine
链接：https://arxiv.org/abs/2610.35929
作者：Ilyas Nagiyev,Miras Baisbay,Daniil Orel,Preslav Nakov
类目：Multiagent Systems (cs.MA); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：present SCOPE, SCOPE coordinates specialized, https URL, SCOPE, outlet URL
备注：
点击查看摘要
Abstract:We present SCOPE, a multi-agent system for profiling news media outlets with respect to bias, factuality, and credibility. Given an outlet URL, SCOPE coordinates specialized agents for article acquisition, content analysis, external evidence search, scoring, and report generation. The system follows an MBFC-style methodology while making intermediate evidence and agent outputs inspectable through a structured demonstration interface. On a benchmark of 200 media outlets, SCOPE outperforms LLM-only, article-only, search-only, and media-background-check baselines on most metrics, achieving the lowest bias and factuality MAE, perfect failed-fact-check detection, and the lowest factual error rate. These results suggest that decomposed, evidence-grounded agent workflows can support more transparent and reliable media profiling. Our code is available at this https URL, and a live demonstration at this https URL.
107. 【2610.35925】ReCoPII: A Relation-Grounded Framework for Building Contextual PII Masking Datasets
链接：https://arxiv.org/abs/2610.35925
作者：Taehwan Lee
类目：Computation and Language (cs.CL); Artificial Intelligence (cs.AI)
关键词：personally identifiable information, restrictions limit access, Training contextual masking, privacy restrictions limit, Training contextual
备注：
点击查看摘要
Abstract:Training contextual masking systems for personally identifiable information (PII) requires examples distinguishing maskable from preservable mentions of one entity type, but privacy restrictions limit access to real data. Author-based augmentation (SPY) labels mentions unrelated to the author as non-PII, presuming a single data subject and overlooking others. We propose ReCoPII (Relation-grounded Contextual PII masking), a framework that builds such data without this premise: it plans ontology-constrained entity relations, writes insertion sentences with placeholders, reconstructs annotations with code, checks the result with a separate LLM, and derives MASK/KEEP labels from entity relations. On Korean documents from six domains, it yields ReCoPII-Ko, a corpus with relation, privacy, and MASK/KEEP annotations, which we validate. Across 300 pairs, four annotators agree with 88.42% of its sampled KEEP labels, against 26.27% for SPY-style augmentation of the same sources. Classifiers trained on it over-mask less than under that reference on a matched test. Contextual masking fine-tuned jointly with a PII detector removes most over-masking of detection alone within a fixed leakage budget; on human-verified entity records, the four detectors meeting it over-mask at most 5.04% with at most 4.18% leakage. The detector is comparable to XLM-R-large on KDPII with about a quarter of its parameters.
108. 【2610.35910】Physiognomy Revisited: How Vision-Language Models Encode Sensitive Attributes Through Image Transformation
链接：https://arxiv.org/abs/2610.35910
作者：Soumyajit Datta,Arka Dutta,Ashiqur R. KhudaBukhsh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Emergent generative, generative AI technologies, failure modes, remarkably beneficial, suffer from unforeseen
备注： Accepted at EMNLP 2026 (Main Conference Track)
点击查看摘要
Abstract:Emergent generative AI technologies, while remarkably beneficial across several tasks and domains, can suffer from unforeseen vulnerabilities and difficult-to-anticipate failure modes. Such failure modes can disparately affect vulnerable communities. This paper investigates two well-known vision language models (VLMs) and inspects how these models encode protected identities while generating images. We show that when VLMs are requested to transform human face images to reflect race identities (e.g., Hispanic, Black, White, or Asian) and sexual orientation (e.g., gay or straight), VLMs often comply with such requests. We demonstrate that compliance (and refusal) is non-deterministic, group-sensitive, and generated images are statistically distinguishable, often accentuating deep-seated stereotypes. We further show that representation biases introduced during image generation can re-emerge in textual reasoning and characterization tasks. Finally, we show that this worrisome finding is not limited to racial identity or sexual orientation, image generation can perpetuate bias around criminality, raising concerning possibilities of AI-assisted profiling.
信息检索
1. 【2610.37584】REGER: Modeling inter-item Relations with Semantic IDs for Generative Recommendation
链接：https://arxiv.org/abs/2610.37584
作者：Yuxi Huang,Silin Zhou,Chenhao Wang,Zihan Li,Gangming Guo,Pei Ke,Shen Gao,Shuo Shang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Personalized recommendation depends, Personalized recommendation, user interactions, online content, content and user
备注： 13 pages, 6 figures
点击查看摘要
Abstract:Personalized recommendation depends on learning semantic and collaborative relations among items from online content and user interactions. Generative recommendation (GR) offers a promising paradigm by autoregressively generating discrete semantic IDs (SIDs) of items. However, randomly initialized SID token embeddings and GR models trained from scratch do not directly inherit the semantic relations inherent in items, while inter-item collaborative relations are learned largely implicitly through token-level attention and next-token supervision. To address this limitation, we propose REGER, a unified framework that explicitly incorporates inter-item relations into semantic pretraining, history encoding, and SID generation. We pretrain the GR model through generative semantic retrieval, enabling it to inherit inter-item semantic similarity by learning to generate semantic neighbors' SIDs. We combine global attention with local attention aligned with SID boundaries to capture historical context and directed transitions between adjacent items. We further develop a theoretical framework for hierarchical preference decomposition over the SID prefix tree, proving an exact factorization of collaborative preference distributions and a weighted decomposition of item-level KL divergence into prefix-conditional KL divergences. Building on this analysis, we distill a discriminative teacher's full conditional distributions over all legal next tokens at ground-truth prefixes along the target SID path, jointly optimizing this objective with cross-entropy. Extensive experiments on real-world datasets demonstrate consistent improvements over existing GR baselines and support the effectiveness of the proposed preference distillation.
2. 【2610.37570】LCM-Promo: An LLM-Based Uplift Model for Promotion Allocation
链接：https://arxiv.org/abs/2610.37570
作者：Nesta Midavaine,Floris Fok,Paulo Mendes,Joao Silva,Önder Akaçık,Dimas Lima,Zülküf Genç
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：LLM-based uplift model, Large Commerce Model, LLM-based uplift, uplift model, task-specific Large Commerce
备注： 4 pages, 2 tables. Accepted at ECML PKDD 2026 (Industrial Track)
点击查看摘要
Abstract:We present LCM-Promo, an LLM-based uplift model for promotion allocation. LCM-Promo is a task-specific Large Commerce Model (LCM): a finetuned LLM trained on transactional commerce data to predict user intent and promotion response. It learns monotonic promotion-response curves from production logs by interpreting single-token outputs as conversion-threshold probabilities, while conditioning on session context such as day and delivery shift. In a production A/B test on churn reactivation, LCM-Promo increased conversion by 1% and reduced promotion cost by 6% relative to the Segment-EMA production baseline.
3. 【2610.37409】Can Complementary Signals Bridge Similarity Islands? Manifold-Augmented Graph Embedding for Multimodal Recommendation
链接：https://arxiv.org/abs/2610.37409
作者：Zhenye Yang,Jinpeng Chen,Wenbo Fu,Jun Ma,Huan Li,Qimin Zhou,Tao Wang,Li Sun,Senzhang Wang
类目：Information Retrieval (cs.IR)
关键词：Multimodal Recommender Systems, Recommender Systems, mitigate data sparsity, functionally related complements, similarity-driven graph construction
备注： Accepted at NeurIPS 2026. 33 pages, including references and appendices
点击查看摘要
Abstract:Multimodal Recommender Systems (MMRS) leverage rich item features to mitigate data sparsity, yet similarity-driven graph construction and propagation can favor semantically similar substitutes over functionally related complements. When behavioral associations connect semantically distant items, complementary signals can remain geometrically isolated, yielding fragmented "Similarity Islands" and semantic drift when standard propagation is applied. To overcome these limitations, we propose MAGE (Manifold-Augmented Graph Embedding), a framework for personalized multimodal ranking that decouples complementarity modeling into offline geometric warping and online topological propagation. The offline phase enhances item representations by extracting complement-aware residual directions via a Soft Conceptor mechanism and injecting them under a local gap-preserving constraint, incorporating co-purchase evidence while controlling the magnitude of geometric perturbation. Synergistically, the online phase employs an asymmetric dual-stream GNN that treats visual features as stable anchors and augmented textual features as flexible probes, fused through a self-calibrated cross-modal mechanism to reconcile shared semantics and modality-specific residual cues. Extensive experiments on four Amazon datasets show that MAGE yields consistent improvements over strong multimodal recommendation baselines. Together with the supporting analyses in the appendix, these results suggest that geometry-aware augmentation can alleviate the semantic mismatch that arises in complementary recommendation settings. Our code is available at this https URL.
4. 【2610.37358】When Is Additional Retrieval Worthwhile? A Cost-Aware Study of Evidence Gain and Answer Reliability in RAG
链接：https://arxiv.org/abs/2610.37358
作者：Zhouting Zhao
类目：Information Retrieval (cs.IR)
关键词：Retrieval-augmented generation, translate into faithful, faithful or correct, retrieval, RAG
备注：
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) can benefit from more sophisticated retrieval, but extra retrieval may be unnecessary for many questions and gains in evidence retrieval may not translate into faithful or correct answers. We study a cost-aware, two-action retrieval policy that chooses between a dense-retrieval-plus-reranking baseline and a hybrid lexical--dense retriever. Rather than classifying baseline retrieval as simply successful or unsuccessful, we estimate the question-specific incremental evidence-retrieval benefit of hybrid retrieval using features available before the routing decision. A regularized linear model and decision threshold are selected using document-grouped cross-validation and frozen prior to held-out evaluation. On 60 previously unseen QASPER training-split articles (188 questions, 169 evidence-evaluable), the policy triggers hybrid retrieval on 46 questions (24.5\%) and obtains the same evidence Hit@10 as always-hybrid retrieval (78.70\%, versus 76.92\% for always-keep). Paired, paper-cluster bootstrap intervals do not establish a reliable utility advantage. We further compare generated answers from a 4-bit Qwen3-4B model under the three retrieval policies. Provisional answer-level assessments show no clear correctness or faithfulness improvement after partial review, despite the evidence-retrieval result. The generation assessments remain model-assisted and lack independent human validation. These results expose an important distinction between retrieving relevant evidence efficiently and improving the reliability of the generated answer. The work is presented as a reproducible empirical study, not a claim of statistically established answer-quality superiority.
5. 【2610.37286】LESSRec: Level-Specific History Modeling for Semantic ID-Based Recommendation
链接：https://arxiv.org/abs/2610.37286
作者：Shangxin Yang,Zongwei Wang,Jing Long,Junliang Yu,Min Gao
类目：Information Retrieval (cs.IR)
关键词：semantic tokens obtained, Semantic, residual quantization, obtained through residual, semantic level
备注：
点击查看摘要
Abstract:Semantic ID-based recommendation represents each item as a sequence of semantic tokens obtained through residual quantization. This paradigm generates the next item's tokens autoregressively from coarse to fine, entailing each prediction attending to historical tokens at all semantic levels. However, our inference-time analysis reveals that historical tokens at the target-token's semantic level tend to be more informative, whereas other levels can introduce interference. Motivated by these findings, we propose LESSRec that separately encodes the historical token sequence at each semantic level and restricts attention over historical tokens to the sequence at the target token's semantic level during prediction. To complement these level-specific histories, LESSRec explicitly provides an item-level semantic sequence that represents each historical item's overall semantics in chronological order. The decoder accesses the level-aligned token sequence and the item-level semantic sequence through two separate cross-attention branches and fuses their contexts. We further introduce LESSRec+, which uses separate encoders for different semantic-level histories with the same total parameter count to reduce encoder computation. Extensive experiments across three public datasets and three tokenizers demonstrate the recommendation effectiveness of LESSRec and LESSRec+, with efficiency analyses highlighting the computational benefits of LESSRec+.
6. 【2610.37280】Modeling Preference Dependencies with Directed Acyclic Graphs for Narrative-Driven Recommendation
链接：https://arxiv.org/abs/2610.37280
作者：Mingzhe Lu,Jian Qin,Ruize Qin,Jinhao Liu,Yunpeng Li,Hang Su
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：stated preferences naturally, preferences naturally qualify, Preference Dependency Graph, Dependency Graph Framework, express multifaceted
备注： 9 pages, 5 figures, 3 tables
点击查看摘要
Abstract:Narrative-driven recommendation allows users to express multifaceted needs through free-form text where stated preferences naturally qualify and condition one another. Existing methods typically treat narratives as flat keyword combinations or unconstrained generative queries, failing to capture how complex preferences hierarchically refine and contextualize each other. We propose the Preference Dependency Graph Framework (PDG-F), a narrative-driven recommendation framework centered on explicit preference dependencies. Specifically, PDG-A (PDG-Agent) first parses unstructured requests to organize user preferences and their mutual qualifications into a directed acyclic Preference Dependency Graph (PDG). Through this graph, candidate evidence from the open Web is acquired via directed path retrieval, and final recommendations are determined by topological path ranking. Comprehensive experiments across three diverse domains spanning English and Chinese contexts confirm that PDG-F consistently achieves superior recommendation performance over competitive baselines, open-domain retrieval agents, and frontier language models. Further diagnostic analyses show that our dependency-guided retrieval markedly raises the attainable candidate-pool ceiling, demonstrating the fundamental value of modeling preference dependencies in narrative-driven recommendation.
7. 【2610.37267】GradCO: Behavior-Aware Gradient-Conflict Offloading for Text-Based Person Anomaly Search
链接：https://arxiv.org/abs/2610.37267
作者：Zhiheng Fu,Zixu Li,Zhiwei Chen,Jiale Huang,Fangxu Liu,Jinhe Bi,Yupeng Hu
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Person Anomaly Search, Text-based Person Anomaly, Anomaly Search, Person Anomaly, Text-based Person
备注：
点击查看摘要
Abstract:Text-based Person Anomaly Search (TPAS) retrieves a target pedestrian using natural-language descriptions of appearance and normal or anomalous behavior. Unlike conventional text-based person retrieval, TPAS must preserve identity cues while distinguishing fine-grained behaviors. It presents two challenges: same-identity, different-behavior hard negatives cause gradient conflict during granular alignment, while strong appearance cues can obscure weak behavioral evidence during aggregation. We propose GradCO (behavior-aware Gradient-Conflict Offloading), comprising three complementary components. Behavior-Aware Mixture-of-Experts (B-MoE) forms appearance, normal-behavior, and anomalous-behavior streams whose roles are learned from retrieval objectives without expert-specific semantic labels. Conflict Offload Learning (COL) uses pair-conditioned offload anchors in similarity computation to reduce the conflicting-gradient burden on the main text representations. Hierarchical Intent Alignment (HIA) aggregates expert similarities and features using query-conditioned weights. Experiments on five TPAS/TIPR benchmarks show GradCO significantly surpasses SOTA methods and validate our design.
8. 【2610.37231】askBridge: Technical Report for SIGIR 2026 eCommerce Challenge
链接：https://arxiv.org/abs/2610.37231
作者：Zhiheng Fu,Yupeng Hu,Zixu Li,Zhiwei Chen,Qinlei Huang,Shaokun Wang,Han Liu,Fan Liu,Weili Guan,Liqiang Nie
类目：Information Retrieval (cs.IR)
关键词：Reformulation Task evaluates, expressions suitable, Query Reformulation Task, Challenge Query Reformulation, Task evaluates
备注： Technical Report on the First-Place Solution for eCommerce Challenge @ SIGIR 2026 eCom Workshop
点击查看摘要
Abstract:The SIGIR 2026 eCommerce Challenge Query Reformulation Task evaluates the reformulation of task-oriented queries into expressions suitable for product retrieval, followed by BM25-based retrieval. These queries often imply product needs through activity-level semantics, creating a lexical gap with catalog descriptions. Systems must preserve task intent while adapting the number of reformulations to the Automatic and Interactive protocols. We propose TaskBridge, a catalog-anchored framework comprising Catalog Semantic Anchoring, Unified Five-Candidate Rewriting, and Protocol-Aware Selection. It grounds queries in catalog vocabulary, generates five complementary reformulations, and selects one query for Automatic retrieval or up to four for Interactive retrieval using BM25 scores, query-product reranking, and weighted Jaccard overlap. The selected queries are independently executed using BM25 to produce results in the required six-column format. Experiments demonstrate improved retrieval effectiveness, with multiple complementary queries providing additional gains in the Interactive setting. TaskBridge achieved first place in the SIGIR 2026 eCommerce Challenge.
9. 【2610.37228】AutoRSE: Evaluating LLM Agents as Recommendation Engineers for Self-Evolving Recommender Systems
链接：https://arxiv.org/abs/2610.37228
作者：Rui Tian,Yi Fang,Yejin Hua,Du Wang,Yuzhe Wang,Minxuan Shan,Zirui Ren,Xinyu Lin,Chongming Gao,Wenjie Wang,Fuli Feng
类目：Information Retrieval (cs.IR)
关键词：Recommender Systems Engineer, Systems Engineer Agents, Engineer Agents, Systems Engineer, promising paradigm
备注： 12 pages, 7 figures. Code: [this https URL](https://github.com/Ray-Tiann/AutoRSE)
点击查看摘要
Abstract:Recommender Systems Engineer Agents (RSE-Agents), which use LLM-based agents to autonomously improve recommendation algorithms, are emerging as a promising paradigm. However, their capabilities and limitations remain poorly understood due to the lack of a unified, standardized evaluation framework and systematic trajectory-level analysis. To address this gap, we introduce AutoRSE, an evaluation framework spanning six representative industrial-grade recommendation tasks, and conduct a large-scale empirical study of three frontier LLMs across three widely used agent harnesses. Our results show that RSE-Agents consistently enhance the performance of backbones on five of the six tasks, with an average relative improvement of 16.1%, indicating that they can already autonomously improve recommendation performance. However, trajectory-level analysis also reveals that current RSE-Agents function primarily as engineering optimizers rather than algorithmic improvers: their gains are largely driven by hyperparameter tuning, training strategies, and model ensembling, while genuine algorithmic innovations are rare. Since the largest gains in recommender systems often stem from algorithmic advances, this behavior underscores a fundamental limitation of current RSE-Agents. To probe this limitation, we perform idea-injection experiments and show that agents equipped with innovative ideas from frontier research or human experts achieve substantially larger improvements than those relying on self-generated ideas. These results suggest that idea generation is a central bottleneck of current RSE-Agents, highlights a key direction for the future recommendation system research. Our implementation is publicly available on GitHub: this https URL.
10. 【2610.37176】Lossless Compression of Proximity Graph Indexes for Efficient Approximate Nearest Neighbors Search
链接：https://arxiv.org/abs/2610.37176
作者：Francesco Benocci,Leonard Dahlmann,Francesco Gargiulo,Tobias Heuer,Silvio Martinico,Franco Maria Nardini,Cosimo Rulli,Rossano Venturini
类目：Information Retrieval (cs.IR)
关键词：Graph-based Approximate Nearest, Approximate Nearest Neighbor, Graph-based Approximate, Nearest Neighbor, Approximate Nearest
备注： 7 pages, 5 figures, Accepted at CIKM 2026. Code: [this https URL](https://github.com/TusKANNy/kannolo) . Reproducibility: [this https URL](https://github.com/tusKANNy/papers_reproducibility/tree/main/cikm2026)
点击查看摘要
Abstract:Graph-based Approximate Nearest Neighbor (ANN) indexes, such as HNSW, are the backbone of modern vector search. However, their massive memory footprint creates a severe infrastructure bottleneck. While vector quantization is widely adopted to reduce the memory required to store data vectors, the graph's edge structure increasingly dominates total memory usage. Compressing these adjacency lists for online search presents a critical system challenge: because decompression occurs during query processing, i.e., while navigating the graph, memory savings cannot come at the expense of query latency. In this paper, we present a compression technique explicitly tailored for live HNSW routing. By applying offline graph permutations to artificially induce structural locality, we enable the use of SIMD-accelerated integer compressors, such as Stream VByte, for rapid on-the-fly decompression. Evaluated across diverse real-world workloads, we significantly outperform the current state of the art in both compression ratio and query latency. Our experimental results show that we achieve compression ratios up to 52.7% with negligible penalties in latency compared to the uncompressed baseline. Furthermore, our technique has been effectively deployed in production at eBay, achieving up to 44.3% reduction in edge storage with no degradation in query latency.
11. 【2610.37162】Coverage Under Contradiction: A Benchmark for Negation-Aware Retrieval
链接：https://arxiv.org/abs/2610.37162
作者：Pasha Abrishamchian,Eugene Yang,Andrew Yates,Nazli Goharian,Ophir Frieder
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL)
关键词：Coverage-evaluation benchmarks quantify, retrieved evidence covers, Coverage-evaluation benchmarks, quantify whether retrieved, needed to satisfy
备注： 5 pages, 1 figure. Accepted at CIKM 2026
点击查看摘要
Abstract:Coverage-evaluation benchmarks quantify whether retrieved evidence covers the different pieces of information needed to satisfy an information need. Existing benchmarks mostly consider factual claims that may already be known to pretrained retrieval components, leaving open whether retrievers find corpus evidence when it contradicts those priors. We study how retrievers behave when their parametric knowledge and the information in a corpus disagree. To do so, we develop a process to augment a nugget-based coverage benchmark with controlled contradictions. For each nugget, we create a negated counterpart and edit its supporting documents to support that negation while preserving the context. Applying this process to CoverageBench, a benchmark measuring information coverage, we create CoverageBench-Negate, spanning six datasets and roughly 63,000 original-edited evidence pairs (one per nugget-document link). We attach rich construction metadata to every pair and additionally provide out-of-family LLM judgments over all pairs and a human audit of a sample. In baseline experiments, BM25 separates original from edited near-twin evidence substantially better than dense retrievers (Qwen3 and Jina), which stay near chance. We release the benchmark on Hugging Face Datasets (nuggets, documents, pairs) together with the construction materials, including the prompts used to create it.
12. 【2610.37140】Rethinking Positional Encoding and Interaction Granularity for CTR Prediction
链接：https://arxiv.org/abs/2610.37140
作者：Xinxun Zhang,Yuxiang Wang,Xiaokai Zhou,Jiayue Li,Yi Li,Yue Liu,Jun Zhang,Xiaoling Zhou,Tieyun Qian,Xiao Yan,Jiawei Jiang
类目：Information Retrieval (cs.IR)
关键词：Click-through rate, Existing Transformer-based CTR, Transformer-based CTR models, Transformer-based CTR, contextual features
备注： 13 pages, 11 figures
点击查看摘要
Abstract:Click-through rate (CTR) prediction relies on historical behaviors and contextual features to estimate clicks on a target item. Existing Transformer-based CTR models often adopt index-based or temporal positional encodings and token-level causal interaction. However, we observe that most existing positional encodings do not outperform NoPE, while relaxing causal constraints within target-relative temporal groups also yields gains. These observations motivate a fundamental question: what positional encoding and interaction granularity does CTR prediction actually require? To address this question, we propose \textbf{TRIP}, which combines target-aware rank--time positional encoding with temporal-group interaction modeling. Specifically, Factorized Rank Encoding represents each behavior's ordinal position within the historical sequence through a low-rank factorization, while Target-Relative Time Encoding characterizes its temporal distance to the target on a coarse-to-fine scale. This joint design grounds each behavior's positional representation in its sequence context and temporal relation to the current target. Furthermore, Temporal Group-Causal Interaction enriches intra-group representations through bidirectional interaction and masked reconstruction while preserving inter-group causal order. Finally, behavior representations are condensed into compact group summaries for efficient group-level modeling in subsequent layers. Experiments on four public benchmarks show that TRIP improves AUC by up to 4.45\% relative to the strongest baseline.
13. 【2610.37080】ssera: Structure-Completed Evidence Units for Web Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2610.37080
作者：Peichun Hua,He Sun,Zirui Zhuang,Qi Qi,Yiming Qiu,Shinan Liu,Yunming Xiao
类目：Information Retrieval (cs.IR)
关键词：Web retrieval-augmented generation, retrieved item serves, Web retrieval-augmented, recent visual pipelines, fixed-size text chunks
备注： 13 pages, 7 figures, 17 tables
点击查看摘要
Abstract:Web retrieval-augmented generation (RAG) splits a page into fixed-size text chunks or, in recent visual pipelines, screenshot tiles, and the retrieved item serves at once as the unit of indexing, ranking, and reading. We trace answer evidence from source HTML to reader input over the full English Wikipedia and find that this coupling loses evidence in text and screenshot pipelines alike: evidence present in the source page often fails to reach the reader intact, particularly structured content such as tables and infoboxes, which chunking separates from the headers and context that give it meaning. Stronger extraction, context expansion, and larger reader budgets leave the loss in place. We present Tessera, a training-free evidence delivery layer that decouples what a pipeline retrieves from what its reader reads. Given the pages behind any ranked list, Tessera rebuilds their HTML into fine-grained evidence units, each completed with its page title, section path, and table headers, selects the units relevant to the query, and packs them into the reader context at an unchanged token budget. The index, the retriever, and the reader stay as they are, so Tessera applies to text, screenshot, and agentic pipelines. Across three question answering benchmarks, Tessera improves answer accuracy by 5 to 6 points on text and screenshot pipelines, consistently across readers, retrievers, and reader budgets, and outperforms strong HTML-aware and structure-aware RAG baselines under matched budgets. The gains carry over to multi-step agentic search. Our code is publicly available at this https URL.
14. 【2610.37005】Compote: Collapse-Resistant Multiple Hypothesis Learning For Sequential Recommendation
链接：https://arxiv.org/abs/2610.37005
作者：Louis Castres Saint Martin,Clement Calauzenes,Alain Rakotomamonjy,Patrick Gallinari
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：single interaction history, admits multiple plausible, multiple plausible continuations, distinct catalogue regions, inherently ambiguous
备注：
点击查看摘要
Abstract:Next-item prediction is inherently ambiguous: a single interaction history often admits multiple plausible continuations across distinct catalogue regions. Standard sequential recommenders compress these alternatives into a single prediction, conflating user intents. We introduce COllapse-resistant Multiple hyPOThesis lEarning (COMPOTE), a multi-hypothesis transformer trained with an annealed objective that transitions from uniform supervision to a winner-takes-all assignment. This mechanism forces hypotheses to specialize into distinct catalogue regions, while inference relies on an efficient, normalizer-free max-similarity rule. Theoretically, we show that in the population case, the optimal solutions partition the conditional next-item distribution according to a max-entropy quantization principle, while pooled scores preserve the Bayes-optimal ranking. We also prove a generalization bound scaling logarithmically with the number of hypotheses. Across three Amazon Reviews 2023 benchmarks, COMPOTE outperforms strong ID-based, generative, and multi-interest baselines using item IDs alone. Matched-capacity ablations confirm that performance gains stem directly from the annealed objective, preventing the head collapse observed in conventional multi-head architectures, rather than added capacity, ensembling, or routing.
15. 【2610.36991】SpectRAG: Weighted Chunk Graphs for Token-Budgeted Context Selection in Multi-Hop Retrieval-Augmented Generation
链接：https://arxiv.org/abs/2610.36991
作者：Zafer Sahinoglu,Abdulazeez Mohammed,Buse Yaren Kazangirler,Cahit Berkay Kazangirler
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：systems ground large, large language models, ground large language, retrieving external evidence, systems ground
备注： 26 pages, 5 figures, 10 tables. This work is intended for submission to an IEEE journal
点击查看摘要
Abstract:Retrieval-augmented generation (RAG) systems ground large language models (LLMs) by retrieving external evidence and conditioning generation on the retrieved context. Although dense retrieval is effective for local semantic matching, independently ranked retrieval can return redundant passages, miss cross-chunk dependencies, and provide incomplete evidence for multi-hop reasoning. We propose SpectRAG, a spectral graph-augmented retrieval framework that combines hybrid candidate seeding, weighted chunk graph construction, graph-based expansion, spectral relevance propagation, and token-budgeted context selection. Document chunks are represented by dense semantic embeddings and graph-spectral coordinates derived from a weighted chunk graph whose edges encode semantic similarity, document adjacency, section hierarchy, shared entities, citation links, and similarity between LLM-generated utility questions. At query time, SpectRAG builds a high-recall seed set using exact inner-product search and hybrid relevance signals, expands it over the chunk graph, re-scores candidates using graph proximity and spectral information, and assembles the final context under a fixed token budget. The goal is not merely to retrieve individually similar chunks, but to construct a context that is relevant, diverse, structurally connected, and sufficient for grounded reasoning. Experiments on MultiHopRAG, UltraDomain, and long-document question-answering settings show that SpectRAG improves broad evidence recovery and achieves competitive generation quality against dense, hybrid, HyDE, LightRAG, and NaiveRAG baselines. The results further indicate that graph-spectral structure is particularly useful for inference-oriented and cross-document retrieval, while highlighting trade-offs in early precision, computational cost, and domain-dependent performance.
16. 【2610.36973】KL-MOPD: Discrepancy-Aware Multi-Objective On-Policy Distillation for Generative Recommendation
链接：https://arxiv.org/abs/2610.36973
作者：Weiqin Yang,Yandong Wang,Yuan Gao,Hao Deng,Jinxin Hu,Jing Cao,Jiawei Chen
类目：Information Retrieval (cs.IR)
关键词：Coordinating multiple recommendation, Coordinating multiple, click and conversion, real-world generative recommendation, critical for real-world
备注：
点击查看摘要
Abstract:Coordinating multiple recommendation objectives (e.g., click and conversion) is critical for real-world generative recommendation (GR). However, since a positive item in GR can be retrieved only when its tokens are successively selected at every decoding step, traditional item-wise methods lack fine-grained token-wise supervision to guide intermediate steps. Motivated by its success in foundation models, we consider introducing multi-objective on-policy distillation (MOPD) into GR to distill two single-objective teachers into a student at each token. Yet, we find that in vanilla MOPD, (i) teachers exhibit unequal distillation difficulty at each token (i.e., token-level imbalance), and (ii) the harder-to-distill teacher varies across tokens (i.e., cross-token inconsistency), leaving each objective poorly learned at certain steps and hindering positive item retrieval for both objectives, leading to suboptimal performance. To address this challenge, we propose KL-MOPD (KL-Weighted Multi-Objective On-Policy Distillation), a simple yet effective distillation method that allocates token-wise teacher weights proportional to the initial student-teacher token-wise KL divergences, thereby strengthening supervision for the harder-to-distill teacher at every decoding step. Despite its simplicity, we theoretically prove that KL-MOPD strictly outperforms vanilla MOPD in the additive joint recommendation objective under mild conditions. Moreover, KL-MOPD is plug-and-play and computationally efficient, requiring only a one-time pre-training weight calibration with negligible training overhead. Extensive experiments on three public benchmarks, a billion-scale industrial dataset, and online A/B tests on our e-commerce advertising platform demonstrate that KL-MOPD significantly improves both individual and joint recommendation performance. The anonymous code is provided for peer review.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2610.36973 [cs.IR]
(or
arXiv:2610.36973v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2610.36973
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
17. 【2610.36958】PailitaoMMSearch2.0 Technical Report: Scaling Generative Retrieval to Unified End-to-End Multimodal Search
链接：https://arxiv.org/abs/2610.36958
作者：Xiaohan Ye,Zihan Gong,Jingqian Zhao,Lianyu Du,Yunmeng Shu,Xu Chen,Zesheng Zhou,Renchun You,Bocheng Chen,Jinsong Lan,Haihong Tang,Bo Zheng
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Generative retrieval models, industrial generative retrieval, Generative retrieval, textbf, increasingly adopted
备注： PailitaoMMSearch2.0 Technical Report
点击查看摘要
Abstract:Generative retrieval models have been increasingly adopted in search and recommendation systems. However, industrial generative retrieval models are commonly specialized to a fixed online scenario: they learn from scenario-specific interactions, support a narrow set of query forms and retrieval objectives. We study how to remove these couplings and build a unified end-to-end multimodal search system for open-ended image--text queries, heterogeneous shopping intents, and online scenarios with different resource constraints. We present \textbf{PailitaoMMSearch}, which directly generates product Semantic IDs from a raw query image and free-form instruction and scales along three dimensions. \textbf{Data scaling} uses a reusable toolset that can be composed into intent- and lifecycle-specific workflows for cold-start synthesis, quality control, real-traffic refinement, and continuous data production. \textbf{Intent scaling} progressively equips one model with e-commerce product knowledge, multiple retrieval relations, and adjustable reasoning budgets through continual pre-training (CPT), mixed-budget supervised fine-tuning (SFT), and unified reinforcement learning (RL). The RL stage combines intent-balanced optimization and Sample--Beam rollouts aligned with multi-candidate serving. \textbf{Scenario scaling} exposes quality--cost operating points across model capacity and reasoning budget. The system is deployed in multimodal search applications on Taobao Pailitao. A controlled online A/B test reports statistically significant improvements, including item page views $\textbf{+17.90\%}$, transactions $\textbf{+27.04\%}$, and gross merchandise value $\textbf{+8.94\%}$.
18. 【2610.36954】When Diffusion Recommenders Stop Sampling: Preserving Generative Diversity
链接：https://arxiv.org/abs/2610.36954
作者：Louis Castres Saint Martin(ISIR, MLIA),Alain Rakotomamonjy,Patrick Gallinari(ISIR, MLIA)
类目：Information Retrieval (cs.IR)
关键词：admit multiple plausible, single deterministic ranking, plausible next interactions, conventional sequential recommenders, sequential recommenders produce
备注：
点击查看摘要
Abstract:A user history can admit multiple plausible next interactions, yet conventional sequential recommenders produce a single deterministic ranking. While diffusion models offer a natural way to sample alternative continuations, we show that existing target-item diffusion recommenders often suffer from severe sampling collapse, producing nearly identical outputs across independent draws. We identify two ubiquitous design choices that promote this collapse: joint learning of the latent space and denoiser, and in-trajectory supervision via discrete losses. To address these failure modes, we introduce DARTS (Diverse and Accurate Recommendation Through Sampling), a three-stage latent diffusion framework that explicitly decouples representation learning, generative modeling, and discrete ranking by learning and freezing the latent space before diffusion training and postponing ranking supervision to the final decoding stage. We further characterize sampling diversity using complementary measures of variation before and after decoding, and use posterior-predictive aggregation to exploit this diversity at inference. Across three Amazon Reviews 2023 categories, DARTS preserves substantially greater sampling diversity while outperforming strong sequential, generative-retrieval, and diffusion baselines by 7-12% on standard ranking metrics. Aggregating multiple samples further improves ranking accuracy at a fixed slate size.
19. 【2610.36915】Do We Need an LLM to Know Why Sources Conflict? Decision Models for Knowledge-Conflict Typing in RAG
链接：https://arxiv.org/abs/2610.36915
作者：Parv Khatri,Harshul Jain,Mehak Kapoor,Tanya Sah
类目：Computation and Language (cs.CL); Information Retrieval (cs.IR)
关键词：query disagree, contested topic, stale information, decision models, disagree
备注： 15 pages, 2 figures, 8 tables. Code, prompts and all model outputs: [this https URL](https://github.com/Parv17k/decision-models-conflict-typing)
点击查看摘要
Abstract:When the sources retrieved for a query disagree, the right response depends on why they disagree: a question with several valid answers, a contested topic, stale information and a false source each call for different behaviour. Cattan et al. (2025) showed that telling a generator the conflict type improves its responses by about 24 points, but that predicting the type is hard even for frontier LLMs. We study whether typed decision models, which return probabilities over fixed options in a single forward pass instead of generating text, can do this classification fast and cheaply. Using the CONFLICTS benchmark and the original paper's prompt verbatim, we evaluate all 11 decision models served by one commercial inference gateway, from 7 providers, against Gemini models on identical inputs. Asked directly, the decision models reach 50.0--67.0% accuracy; 10 of the 11 match or exceed Gemini 2.5 Flash, the paper's model (61.3%), at 4--39x lower billed cost (2 were free) and 2.6--6.0x lower latency. The current Gemini 3.8 Flash (70.0%) is significantly more accurate than 8 of them, but sending each decision model's least confident quarter of queries to it gives a cascade statistically tied with it for 8 of the 11, at 25--37% of its cost. End to end, answers generated with the types of 10 of the 11 follow the expected behaviour as often as with the LLM's types. Decomposing the taxonomy into yes/no questions lowers accuracy for every model, and a repair fitted on one model does not transfer. Pre-specified diagnostics show that dates play no measurable role and that sensitivity to source order varies widely between models. Decision models detect a planted false source less reliably than the LLM as hard labels, but their probabilities still separate planted from clean sources. We release code, prompts and all model outputs at this https URL.
20. 【2610.36890】Latent Residual Reasoning for Ranking in Generative Recommendation
链接：https://arxiv.org/abs/2610.36890
作者：Haihan Shi,Ruidong Han,Wenjie Wang,Shangyu Chen,Sunhao Dai,Yongqi Li,Yangyang Li,Fei Jiang,Wei Lin,Fuli Feng,Xiangnan He
类目：Information Retrieval (cs.IR)
关键词：ranking typically adopt, strong practical efficiency, reasoning, typically adopt, adopt a fast-thinking
备注： Accepted by CIKM 2026
点击查看摘要
Abstract:Generative recommendation (GR) models for ranking typically adopt a fast-thinking direct prediction paradigm with strong practical efficiency. However, ranking requires fine-grained scoring across multiple candidate items, while existing GR models still mainly rely on one-shot prediction. This raises the question whether additional inference-time computation can further improve ranking quality. Recently, inspired by Chain-of-Thought (CoT) reasoning in large language models (LLMs), some work has begun to introduce reasoning into recommendation systems. Some of these methods rely on LLM reasoning frameworks to perform explicit reasoning in textual space, but such designs are not suitable for more widely deployed non-textual recommendation models. A more relevant direction is to introduce latent reasoning into ID-based recommendation models. Although recent work has extended latent reasoning to industrial ranking, how successive reasoning steps should improve fine-grained candidate scores remains less explored. To address this problem, we propose Refiner, a latent residual reasoning framework with parameter-efficient fine-tuning for generative ranking. Our approach introduces three key components: (1) a residual reasoning mechanism that progressively refines ranking scores through cumulative additive corrections, (2) history queries that provide condensed user behavior representations to enhance candidate-specific reasoning, and (3) a parameter-efficient fine-tuning strategy that leverages LoRA modules to adapt pre-trained models for latent reasoning. Extensive experiments on two public benchmarks, an offline industrial dataset, and an online A/B test demonstrate that Refiner consistently improves over direct prediction, validating its effectiveness and practical utility.
21. 【2610.36836】DuTri: Dual-Branch Modeling with Triadic Factorization for Multimodal Multi-Scenario Recommendation
链接：https://arxiv.org/abs/2610.36836
作者：Jintao Huang,Chaohua Yang,Kailiang Hao,Dugang Liu,Xing Tang,Zhong Ming
类目：Information Retrieval (cs.IR)
关键词：multimodal information grows, grows more prevalent, recommender systems, multimodal information, multimodal
备注： 12 pages, 7 figures
点击查看摘要
Abstract:As recommendation scenarios become increasingly diverse and multimodal information grows more prevalent, effectively modeling cross-scenario user preferences and multimodal semantics has become a critical challenge in recommender systems. When incorporating multimodal information, existing multi-scenario recommendation (MSR) methods typically treat textual and visual representations as generic input features and directly feed them into their original parameter-sharing architectures. However, this extension may not fully accommodate the different modeling requirements of collaborative and multimodal information and may not be the best modeling paradigm. Our controlled experiments show that directly adopting these architectures is not the optimal modeling approach. To this end, we propose Dual-Branch Modeling with Triadic Factorization (DuTri), a framework for multimodal multi-scenario recommendation comprising a collaborative branch and a multimodal branch. Specifically, the collaborative branch learns structured collaborative preference representations through CANDECOMP/PARAFAC (CP) decomposition of user-scenario-item interactions and residual quantization, thereby capturing cross-scenario commonalities and scenario-specific differences. The multimodal branch leverages the learned user and scenario preferences to guide adaptive modality fusion; additionally, item-level contrastive learning aligns collaborative item preference representations with multimodal representations to facilitate effective collaboration between the two branches. Extensive experiments on two real-world datasets, AntM$^2$C and Amazon, demonstrate that DuTri outperforms existing multimodal and multi-scenario recommendation baselines in overall recommendation performance, validating the effectiveness of the proposed framework.
22. 【2610.36763】he Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation
链接：https://arxiv.org/abs/2610.36763
作者：Ziluowen Luo,Ruochen Liu,Jun Yin,Hao Yan,Zhengxuan Hu,Xinze Shi,Chaozhuo Li,Chengqi Zhang,Senzhang Wang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Generative recommendation, SID, Generative, item, commonly fit SID
备注： 13 pages, 8 figures, 7 tables
点击查看摘要
Abstract:Generative recommendation (GR) predicts the next item through its semantic ID (SID). Existing methods commonly fit SID vocabularies to pretrained language model (PLM) representations of item descriptions, incurring additional training costs and making vocabulary coverage dependent on the fitting domains. We observe that pretrained sparse autoencoders expose PLM features with human-interpretable semantic annotations, allowing feature indices to serve as a reusable SID vocabulary. However, reusing this vocabulary requires preserving item distinctions under compact token budgets and learning to favor target items over candidates with shared dominant features. It also requires extending feature interpretability from item content to retrieval decisions. To address these challenges, we propose API, a framework that Adapts the Pretrained Interpretable vocabulary for effective and explainable GR without additional vocabulary learning. Within API, Pretrained Interpretable IDs (PIDs) retain selected feature indices and relative activation strengths for item discrimination. With PIDs as supervision, the Semantic Prediction Adapter (SPA) learns user preferences from interaction histories through joint feature-index and strength prediction. SPA combines both predictions to score candidate items, with item-level supervision encouraging the observed next item to outrank its alternatives. API further explains candidate score differences through feature contributions paired with their pretrained semantic annotations. Extensive experiments show that API achieves competitive performance across backbones and decoding schemes, while preserving item distinctions under compact token budgets and enabling explainable retrieval.
23. 【2610.36585】Recall or Relearn? A Mixture of In-Context Experts for Recurring Concept Drift
链接：https://arxiv.org/abs/2610.36585
作者：Zhangkai Wu,Xu Zhang,Zhihong Cui,Yiqi Wang,Yi Zhang
类目：Machine Learning (cs.LG); Information Retrieval (cs.IR)
关键词：Tabular foundation models, Web data streams, network intrusion detection, Tabular foundation, applied to Web
备注：
点击查看摘要
Abstract:Tabular foundation models (TFMs) are being applied to Web data streams such as network intrusion detection, where they adapt by updating the labelled rows of their context without retraining. When a past concept returns after leaving the context, a TFM faces a recall-or-relearn decision between restoring stored rows of the concept and relearning it from new labels. We propose MICE (Mixture of In-Context Experts), a training-free learner that cuts the stream into segments at detected changes. It merges a closed segment into a stored context when the TFM's estimated additional error on the segment is within a tolerance, under a capacity limit on stored contexts. A fast level weights the stored contexts and first-in-first-out (FIFO) windows by the log-loss of their predictions on the last labelled batch. We show that, with pure stored contexts and a margin condition, this fast level gains over relearning, in expected accuracy, the normalised positive area between the stored context's accuracy and the TFM's learning curve, up to a first-batch term. A slow level mixes the fast level's prediction with that of the FIFO window of the last labelled rows and bounds the discounted half-Brier regret of MICE against this window at every time. Learning curves measured beforehand predict the ordering of the observed recall gains. MICE outperforms reset, which empties the context at detected drifts, on grid streams with random boundary phases. Merging keeps fewer experts than pools that store every segment, and with fixed segmentation a time-matched snapshot pool matches MICE on the shifted grid. On real streams, MICE has the highest mean accuracy of all policies we compare.
24. 【2610.36561】Governed Sovereign RAG for Public Administration: Tripartite Epistemic Routing, Facet-Guided Clarification, and Deterministic Numeric Verification in Citizen Services
链接：https://arxiv.org/abs/2610.36561
作者：Andres Cruz Degante(Universidad Autónoma de Occidente)
类目：Computers and Society (cs.CY); Information Retrieval (cs.IR)
关键词：Deploying conversational assistants, data sovereignty prohibiting, prohibiting commercial clouds, government service desks, service desks faces
备注： 19 pages, 5 figures, 6 tables. Deployed in production at SEDECO/CEMERT, State of Tlaxcala, Mexico
点击查看摘要
Abstract:Deploying conversational assistants at government service desks faces a tension between regulatory certainty (zero tolerance for invented fees), data sovereignty prohibiting commercial clouds, and high rates of underspecified or out-of-jurisdiction citizen queries. We present and evaluate a governed, sovereign Retrieval-Augmented Generation (RAG) architecture deployed on the official portal of the State of Tlaxcala, Mexico (this http URL), covering 1,143 procedures and a decoupled directory of 924 offices. The system governs interactions via three pillars: (1) a two-stage tripartite epistemic gate (clarify_policy and a Boltzmann distribution over AnyJev) arbitrating among answering (SPECIFIC), facet-guided clarification (CLARIFY), and abstaining (ABSTAIN); (2) a post-generation deterministic numeric verifier (verify_numeric_guardrail) with SHA-256 cache invalidation ensuring every generated fee or validity figure belongs to the retrieved official record; and (3) an empirical evaluation across 380 organic production traces (8 weeks) and a 200-query stratified benchmark (5-fold CV: 86.41% +/- 7.50%). In production, 89.47% of traffic is resolved at Level 0 via deterministic templates without free generation (global p50 = 0.665 s; direct L0 p50 = 0.445 s; slow-tail p95 = 30.412 s under CPU queuing), with 0/40 fiscal amount hallucinations observed in Level 1 (95% bound = 8.81%). On the benchmark, the system achieves 86.50% strict Top-1 accuracy (+10.00 pp over a binary neural gate, p = 0.00453, p_Holm = 0.01172), pairing a 93.00% conditional safe upper bound with a 70.87% dropout-adjusted effective resolution after accounting for 53.33% citizen drop-off in clarification menus.
25. 【2610.36559】CCP-DP: Cross-cluster context-guided phase dynamic programming for DNA storage sequence reconstruction
链接：https://arxiv.org/abs/2610.36559
作者：Zixin Zhang,Guanjin Qu,Huaming Wu
类目：Information Retrieval (cs.IR)
关键词：data storage offers, storage offers high, DNA data storage, offers high information, high information density
备注：
点击查看摘要
Abstract:Motivation: DNA data storage offers high information density and long-term stability, but accurate sequence reconstruction remains challenging under limited sequencing coverage and strong insertion, deletion, and substitution (IDS) noise. Existing reconstruction methods mainly rely on local evidence within individual read clusters. When sequencing coverage is low or indel-induced phase shifts become pronounced, such local evidence may be insufficient to distinguish closely competing candidate sequences. Results: We present Cross-Cluster Context-Guided Phase Dynamic Programming (CCP-DP), which uses dataset-level cross-cluster information to complement cluster-local evidence and selectively refines ambiguous provisional consensuses. Under the main benchmark settings, CCP-DP achieved exact reconstruction rates of 95.36%-99.98% and outperformed existing methods on multiple datasets. At $5\times$ coverage, CCP-DP improved exact reconstruction by 6.2-17.5 percentage points over the stronger of BBS and CPL across the tested IDS conditions, while maintaining low reconstruction error and computational overhead. Overall, CCP-DP introduces cross-cluster shared information as a complementary source of evidence for DNA sequence reconstruction under challenging conditions. Availability: Source code is available at this https URL.
Subjects:
Information Retrieval (cs.IR)
Cite as:
arXiv:2610.36559 [cs.IR]
(or
arXiv:2610.36559v1 [cs.IR] for this version)
https://doi.org/10.48550/arXiv.2610.36559
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
26. 【2610.36557】QESChunker: A Single Objective Unifies Overlapping and Non-Overlapping Chunking for RAG
链接：https://arxiv.org/abs/2610.36557
作者：Yifan Zhao,Qianyang Zhao,Xinyu Guan,kai wei,Yuming Deng
类目：Information Retrieval (cs.IR); Computation and Language (cs.CL); Optimization and Control (math.OC)
关键词：fundamental preprocessing step, chunkers rely primarily, existing chunkers rely, retrieval-augmented generation, primarily on heuristics
备注： 16 pages, 8 figures, 4 tables
点击查看摘要
Abstract:Chunking is a fundamental preprocessing step in retrieval-augmented generation (RAG), yet most existing chunkers rely primarily on heuristics. We introduce the Question--Evidence-Supervised Chunker (QESChunker), to our knowledge the first method for constructing static chunk indices from question--evidence supervision. QESChunker constructs document-specific chunk indices by optimizing over human-annotated or LLM-generated question--evidence pairs, without access to held-out test queries. We formulate non-overlapping and overlapping index construction through a unified question--evidence utility-maximization objective, turning chunking into a supervised combinatorial optimization problem. Under the non-overlap constraint, the objective decomposes over chunks and can be optimized exactly in polynomial time by dynamic programming. When overlap is allowed, the objective becomes monotone submodular; exact optimization is NP-hard, but our greedy achieves a $(1-1/\sqrt{e})$-approximation. Across two self-constructed and three public datasets, both variants outperform existing chunking methods in complete-evidence recall in nearly all evaluated settings, under the same overlap regime and a fixed hybrid retriever. These results recast chunking as supervised, budget-aware index construction for evidence retrieval.
27. 【2610.36544】Monitor Accuracy Isn't the Answer: A Decision-Value Framework for Evaluating AI Agent Restart Monitors
链接：https://arxiv.org/abs/2610.36544
作者：Siddharth Jain,Venkat N. Vedam
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：agent improves success, true-positive and false-positive, determine whether restarting, improves success, false-positive rates
备注： 29 pages, 6 figures, 14 tables
点击查看摘要
Abstract:Classification accuracy and true-positive and false-positive rates alone do not determine whether restarting an AI agent improves success. Using an exact alarm-to-action identity for an independent clean restart with zero monitoring overhead, we show analytically that a monitor with fixed 90% accuracy can swing from a five-percentage-point loss to a 35-point gain in success rate, depending solely on the replacement attempt's residual-budget success probability. We introduce two techniques for evaluating monitors and progress signals in decision terms. First, a decision-sufficiency criterion, a binary-action specialization of Blackwell's comparison of experiments, identifies which progress representations or context compressions preserve the information needed to choose optimally between the specified actions, independent of trace reconstruction fidelity. Second, a finite-sample, model-free decision audit uses simultaneous binomial intervals over existing agent traces, without additional model calls, to certify a preference for "restart" or "continue" under stated sampling assumptions, or return "abstain" when evidence is insufficient. In a study of 194 externally evaluated model executions on 19 selected SymPy issues from SWE-bench Verified, with a retrospective audit of 130 of these traces, we find a 2.29-point apparent restart gain traced to a single surviving failed attempt, a 42.29-point loss on a second model, no positive replication of the initial gain on prospective task cohorts, and zero of 103 live comparisons meeting the specified certification bar. These results motivate evaluating agent monitors through recovery opportunity, decision value, and statistical support, rather than classification performance alone.
28. 【2610.36500】ACOR: incremental evidence accumulation towards real-time DNA storage reconstruction
链接：https://arxiv.org/abs/2610.36500
作者：Linxuan Han,Huaming Wu,Shi Jia,Guanjin Qu
类目：Information Retrieval (cs.IR); Genomics (q-bio.GN)
关键词：DNA offers high-density, encoding digital information, DNA offers, encoding digital, digital information
备注：
点击查看摘要
Abstract:DNA offers high-density, durable storage by encoding digital information into synthetic strands and retrieving it through sequencing. Sequence reconstruction combines noisy copies of each strand before downstream decoding. Conventional offline methods typically reconstruct completed read clusters, separating reconstruction from ongoing read collection. Streaming reconstruction offers a way to overlap evidence processing with sequencing and reduce the computation remaining before downstream decoding. We present ACOR, a streaming consensus reconstruction method that records $k$-mer transitions and boundary support in a persistent ledger, then decodes through length-constrained beam search and priority-based selection at cluster closure. Evaluation on real and simulated DNA-storage datasets showed competitive recovery. On our own short-read next-generation sequencing (NGS) wet-lab library, ACOR combined near-complete recovery with second-scale reconstruction of more than ten million reads. A smaller public benchmark was completed in a fraction of a second. Parallel ACOR achieved speedups of tens to over a thousand-fold relative to the tested serial baseline configurations. Sparse storage reduced high-context memory requirements, while parallel execution accelerated reconstruction computation. ACOR is designed for streaming readout pipelines that process assigned reads while sequencing continues.
29. 【2610.36408】Cross-Day Compatibility of Daily Item Embeddings: An Empirical Study of Alignment, Scale Management, and CTR Adaptation
链接：https://arxiv.org/abs/2610.36408
作者：Yicheng Wang
类目：Information Retrieval (cs.IR)
关键词：item co-occurrence embeddings, Daily item co-occurrence, future-behavior leakage, co-occurrence embeddings, embeddings are paired
备注： 19 pages, 1 figure, 8 tables. Supplementary material: 10 pages, 8 figures, 2 tables. Includes the complete 48-configuration inventory
点击查看摘要
Abstract:Daily item co-occurrence embeddings are paired with next-day behavior without future-behavior leakage. Multi-day click-through rate (CTR) training therefore mixes versions whose directions and norms may differ for the same item. We compare Word2Vec and an item-graph XSimGCL adaptation across initialization, inheritance, post-processing, training constraints, and downstream augmentation. The inventory contains 48 configurations, including 32 common-protocol CTR evaluations. Observed metrics are reported as relative percentage changes from the corresponding Word2Vec baseline (0%), with raw values and exact dataset sizes withheld. Three findings emerge. First, multiple upstream interventions improve compatibility and CTR. ID-init and orthogonal alignment increase cosine by 51.2% and 93.4%, and GAUC by 2.2% and 2.6%, relative to ordinary Word2Vec. Retrieval and geometry remain insufficient downstream surrogates. Second, warm starts perform strongly but accumulate scale. The day-matched norm increase over Word2Vec reaches 102.5% after eight days; daily global rescaling limits it to 8.2% and attains the highest observed GAUC increase, 4.0%. Third, CTR learning through a dimensionality-reducing encoder further adapts to residual drift. Against dimension-matched random-projection, SVD, and untrained-network controls, trained encoders attain the highest cross-day cosine for four of six upstream methods. The other two rank third and second in train-to-test cosine. These industrial results support complementary roles for upstream stabilization, inherited-scale management, and downstream task learning.
30. 【2610.36389】MAREval: A Multi-Agent Framework for Evaluating Natural Language Recommendation Explanations
链接：https://arxiv.org/abs/2610.36389
作者：Reza Yousefi Maragheh,Jayesh Uddhav Kudase,Aysenur Inan,Ramin Giahi,Kai Zhao,Parth Parikh,Jianpeng Xu,Jason Cho,Evren Korpeoglu,Sushant Kumar
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：fostering user trust, Evaluating natural language, user trust, essential for fostering, fostering user
备注：
点击查看摘要
Abstract:Evaluating natural language explanations in recommender systems is essential for fostering user trust, transparency, and engagement. However, existing evaluation approaches like human evaluations, while accurate, are resource-intensive and impractical at the scale required by modern recommendation platforms. Also, automated methods using single-agent LLMs suffer from prompt sensitivity and inconsistent outputs. To address these challenges, we propose MAREval, a structured multi-agent framework for evaluating recommendation explanations using large language models. MAREval orchestrates (i) a planner agent that uses a novel Chain of Debate (CoD) prompting strategy to coordinate agent roles and enforce logically consistent evaluation plans; (ii) a moderator agent that regulates discussions by mitigating prompt drift; and (iii) an arbitrator agent that aggregates outputs from multiple evaluation rounds and (iv) a Monte Carlo sampling method, improving robustness and alignment with human judgment. We conduct comprehensive evaluations on both public (TopicalChat) and proprietary recommendation datasets, demonstrating that MAREval outperforms state-of-the-art baselines. Comprehensive experiments on a public benchmark and a proprietary e-commerce dataset show that MAREval improves alignment with human judgments over strong singleand multi-agent baselines. Stability analyses indicate substantially lower variability across repeated trials. In a large human-annotation gate, MAREval meets production quality thresholds where prior evaluators fall short, and online A/B testing demonstrates statistically significant improvements in engagement and revenue metrics. These results establish MAREval as a scalable and reliable solution for human-aligned evaluation of recommendation explanations in real-world systems
31. 【2610.36383】From Generation to Scoring: Scaling LLM-Based Semantic Labeling at LinkedIn
链接：https://arxiv.org/abs/2610.36383
作者：Jian Sheng,Sriram Vasudevan,Sundara Raman Ramachandran,Yang Hu,Junyu Zhou,Xiaojing Ma,Haolan Qin,Tiffany Zhou,Vedant Vipul Jhaveri,Ashwini Bhingare,Chinmay Kini,Qing Lan,Xiaoqing Wang,Suleyman Cetintas,Fedor Borisyuk
类目：Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Retrieval (cs.IR)
关键词：industrial large language, large language model, industrial large, large language, LLM
备注：
点击查看摘要
Abstract:For efficiency, industrial large language model (LLM) labelers often pack many candidate labels into one prompt and generate a YES/NO answer for each, even when each decision depends only on the entity and one candidate. Generating these independent decisions as one answer list couples them, spends decoding on the list, and relies on the list being well-formed. In this paper, we present an end-to-end recipe that reformulates the labeler as semantic scoring, fine-tuning it on single-candidate prompts to return each decision as one answer-token score from a prefill-only pass. We also adapt Multiple-Item Scoring (MIS) to score hundreds of candidates in one sequence with attention masked between them. Deployed for profile qualification labeling at LinkedIn, semantic scoring changes at most 0.01% of decisions when candidates are reordered and matches the agreement with reference labels that packed generation reaches only with about 4.7x as many training pairs. The MIS-based stack raises throughput over the deployed stack by 1.24x offline and 1.9x in model serving under a one-second p99 latency target. For offline batch inference, we implement MIS-based scoring as a reusable, model-agnostic Ray Data API proposed for upstream adoption. Model serving uses MIS support contributed to SGLang.
32. 【2610.36267】Preserving rare-item recall under a storage budget: quantization, distillation, and the limits of teacher fidelity
链接：https://arxiv.org/abs/2610.36267
作者：Han Chen,Yingrui Li
类目：Information Retrieval (cs.IR)
关键词：Amazon Video Games, fixed embedding-storage budget, Video Games, Amazon Video, tail recall
备注： 23 pages, 2 figures, 8 tables. Supplementary data and code included as ancillary files
点击查看摘要
Abstract:Under a fixed embedding-storage budget, recommenders can use a small full-precision model, a distilled student, or a higher-rank low-precision model. We asked which choice preserves rare-item recall and whether teacher fidelity reflects it in seven dataset-backbone cells: matrix factorization on Gowalla, this http URL, Amazon Video Games, Steam, Goodbooks-10k and MovieLens-20M, and LightGCN on Amazon Video Games. Seven candidates fit in 168 bytes per user or item row: 40-dimensional Bayesian personalized ranking (BPR), two 40-dimensional unbiased knowledge distillation (UnKD) students, and factorizations of a 300-dimensional teacher's scores at ranks 40, 80, 155 and 300, stored in 32, 16, 8 and 4 bits. Each test set was evaluated once after fixing candidates and confirmatory analyses. The rank-300 4-bit factorization used 13% of teacher storage and retained 95-103% of its tail recall@20 and 93-97% of its NDCG@20 in every cell. The rank-40 factorization had the lowest tail recall in every cell; the 4-bit factorization had 1.2-12.7 times its tail recall and 0.99-1.46 times its NDCG. UnKD students retained 56-102% of teacher tail recall. In all ten prespecified comparisons across five prospective-expansion cells, the 4-bit factorization had higher tail recall, with simultaneous 95% intervals excluding zero. Teacher-hit retention, the share of the teacher's relevant tail hits also found by a model, ordered 23 of 147 candidate pairs differently from tail recall and identified the wrong tail-recall leader in 3 of 7 cells: models can find relevant tail items the teacher misses. In these cells, spending bytes on rank rather than precision preserved rare-item recall at 7.5 times the arithmetic per score. Compressed recommenders should be judged by total tail recall, not teacher fidelity alone.
33. 【2610.36239】BehaveRec: When Does Long-Term Behavioral History Help Sequential Recommendation? A Study with Session, History, and Community Signals
链接：https://arxiv.org/abs/2610.36239
作者：Aysenur Inan,Reza Yousefi Maragheh,Jayesh Uddhav Kudase,Selene Xu,Kaushiki Nag,Jianpeng Xu,Sushant Kumar
类目：Artificial Intelligence (cs.AI); Information Retrieval (cs.IR)
关键词：Sequential recommendation models, Sequential recommendation, recommendation models typically, models typically predict, recent session interactions
备注：
点击查看摘要
Abstract:Sequential recommendation models typically predict a user's next action from recent session interactions, which limits personalization when short-term signals are weak or ambiguous. Rather than assuming that incorporating longer-term history and community signals is universally beneficial, we study when it actually helps. We propose BehaveRec, a three-signal framework combining a causal session transformer, a bidirectional User History Encoder over a 90-day window, and a GraphSAGE module over a user-user graph built from behavioral embedding similarity rather than item co-occurrence; a learned gate blends the three signals per user. On an industrial dataset of 137M sequences from 12.6M users, BehaveRec improves R@5 by +3.2% over SASRec, with a larger-capacity SASRec baseline (more parameters than BehaveRec) still trailing by +2.5%, ruling out capacity as the explanation. More importantly, a user-level stratification by history length reveals a clear dose-response relationship: BehaveRec's advantage is negligible below roughly 10 interactions and grows monotonically with history richness, reaching +0.017 R@5 for users with 101+ events. This pattern is corroborated across one industrial and three public datasets spanning history-rich to history-sparse regimes, where session-only models remain preferable. These headline results, and the resulting deployment threshold, are established for category-level intent prediction; a preliminary, single-run check on the full item-level vocabulary yields a directionally mixed result and is scoped as an open question rather than a claim. We use these results to derive a practical deployment rule -- roughly 20 interactions per user -- for when long-term history and behavioral-graph signals are worth their added complexity. Despite this added complexity, BehaveRec remains lightweight: it uses 5.67M parameters and trains on a single GPU in under two days.
34. 【2610.36208】Counterfactual Profile Perturbations for Recommendation Explanations: A Reproducibility Study
链接：https://arxiv.org/abs/2610.36208
作者：Meysam Varasteh,Elizabeth McKinnie,Robin Burke
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：Learning to eXplain, reproducibility paper explores, counterfactual explanation technique, LXR, eXplain Recommendations
备注：
点击查看摘要
Abstract:This reproducibility paper explores the counterfactual explanation technique known as Learning to eXplain Recommendations (LXR). Prior work has shown that LXR can reliably identify perturbations that, if applied to a user's profile, cause the user's top ranked item to no longer be recommended, thereby explaining the item's recommendation as a function of the user's rating choices. In this paper, we extend this work in multiple ways. We expand the scope of the original LXR study to look at explanations for items other than the most highly recommended item, finding that LXR is also effective at this version of the task. We consider alternate baselines for LXR, including item popularity and latent factor similarity, and we see that for some tasks these alternatives work surprisingly well. We also examine the impact of item popularity, finding that LXR offers better explanation quality (shorter perturbations) when less popular items are being explained. Finally, we conduct a brute-force exploration of a subset of the perturbation space in order to estimate a lower bound for optimal perturbation size against which LXR and other such methods can be compared.
35. 【2610.36181】Is the education gap in generative AI use smaller than the internet's was at a similar level of use? Evidence from 16 European countries
链接：https://arxiv.org/abs/2610.36181
作者：Keisuke Watanabe
类目：Information Retrieval (cs.IR); Computers and Society (cs.CY)
关键词：education, countries, gap, formal education, internet
备注： 16 pages, 2 figures. Code, data and outputs are provided as ancillary files
点击查看摘要
Abstract:New technologies are usually adopted first by people with more formal education. This paper asks whether the education gap in generative AI use in 2025 is smaller or larger than the internet's gap in the same country in the year when overall internet use was at a similar level. It uses public Eurostat survey data on ICT usage by individuals aged 16 to 74. Each country's 2025 rate of generative AI use in the last three months is matched to the internet year whose overall last-three-months use was closest, within 5 percentage points, and the gap between people with high (ISCED 5 to 8) and low (ISCED 0 to 2) completed education is measured as a log ratio and as a percentage-point difference. Sixteen of 35 countries could be matched; most of the others were early internet adopters. In the matched countries, the generative AI gap was smaller in 13 of 16 countries on the log ratio (median change -0.625, 95% bootstrap interval -0.969 to -0.291, two-sided sign test p = 0.021) and in 15 of 16 on the percentage-point gap (median change -27.6 points, interval -32.2 to -16.8, p = 0.0005). The point-gap result keeps its sign in every generative-AI-versus-internet sensitivity analysis with 8 or more countries, including comparisons restricted on both sides to ages 25 to 54 and 55 to 74, but its size is sensitive to matching that takes education composition into account (about -10 to -11 points in 7 and 8 countries). The ratio result is fragile: it fails the decision rule when countries matched at their first internet observation are removed (9 of 11, p = 0.065). The analysis follows an unpublished plan whose timing cannot be verified, so it is not presented as pre-registered. The results describe unadjusted education contrasts in a non-random set of countries, not an education effect, and do not generalise to the EU as a whole.
36. 【2610.36134】When Connectivity Misleads: Guiding Agentic Search with Contrastive Evidence Paths
链接：https://arxiv.org/abs/2610.36134
作者：Junchen Li,Liang Xu,Rongzheng Wang,Qizhi Chen,Junhao Wen,Shuang Liang
类目：Information Retrieval (cs.IR); Artificial Intelligence (cs.AI)
关键词：choose subsequent actions, subsequent actions based, limited observation window, Search agents, choose subsequent
备注：
点击查看摘要
Abstract:Search agents can use cross-document graphs to discover sources through multi-hop connections and choose subsequent actions based on candidate rankings and relationships within a limited observation window. However, documents may rank highly because their numerous connections make them easier to reach, without necessarily providing more valuable evidence. Graph diffusion methods such as Personalized PageRank (PPR) aggregate propagation contributions from multiple sources, allowing highly connected distractor nodes to crowd the observation window. Flat node scores also obscure cross-document evidence trails, limiting continued exploration. We propose Contrastive Evidence Paths (CEP), which scores candidates by their strongest individual paths on a query-conditioned document graph and calibrates these scores against the same graph's background visitation distribution to mitigate structural bias. CEP ranks candidates by the calibrated scores and retains the corresponding source paths. Building on CEP, we develop Structured Corpus Interaction (SCI), which organizes candidates and their connecting paths into a structured Map, enabling agents to verify source documents and pursue missing information through expansion from anchor documents. Experiments on BrowseComp-Plus and TREC-COVID show that SCI achieves state-of-the-art answer accuracy and nDCG@10 with the lowest generation cost. Compared with the strongest baselines by task performance, maximum reductions in tool calls and total generation costs exceed 50% and 40%, respectively. Further analysis confirms that SCI with CEP suppresses ranking inflation induced by structural connections and improves gold recall and exploration efficiency.
37. 【2610.36000】RELAY: One Query, Two Roles for Sequential Recommendation
链接：https://arxiv.org/abs/2610.36000
作者：Zesheng Li,Chengchang Pan,Honggang Qi
类目：Information Retrieval (cs.IR)
关键词：low inference cost, deliver accurate rankings, combine semantic preferences, recommendation must combine, associations to deliver
备注：
点击查看摘要
Abstract:Sequential recommendation must combine semantic preferences with behavioral associations to deliver accurate rankings at low inference cost. Sharing history selection connects preference representation directly to the behavioral evidence used in candidate scoring. We present RELAY, a compact sequential recommender built around one query, two roles: semantic readout and behavioral-memory routing. A single learned query forms a semantic preference representation and reuses its attention to route direct-history and transition evidence into candidate scores. Candidate-conditioned gates calibrate the two memory channels for each candidate. RELAY trains both roles with a single catalog likelihood and produces the final ranking in one forward pass. Full-catalog experiments on six datasets show that RELAY achieves the highest Recall@5 and NDCG@5 among the compared methods on every dataset, improving over the previous best model by 14.22% and 17.88% on average. With 2.044 million predictor parameters, RELAY reduces predictor size by 65.12% and achieves a 1.75~1.79$\times$ inference speedup over the previous best model.
计算机视觉
1. 【2610.37668】Honeycomb-Surfels: Compact Hexagonal Primitives for Efficient Scene Rendering and Reconstruction
链接：https://arxiv.org/abs/2610.37668
作者：Prakhar Kaushik,Soumava Paul,Alan Yuille
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Graphics (cs.GR); Machine Learning (cs.LG)
关键词：computational demands limit, Hexels, view synthesis, advanced rapidly, rapidly with radiance
备注： Project page at [this https URL](https://honeycomb-surfels.github.io/)
点击查看摘要
Abstract:Novel view synthesis and 3D reconstruction have advanced rapidly with radiance fields and splatting, yet their memory and computational demands limit their use in resource-constrained settings. We introduce Hexels: novel planar hexagonal surface elements with a first-order spatial color field for efficient 3D scene and 2D image representation. Hexels exploit locally planar regions with smoothly varying appearance using fewer, larger primitives. Their hexagonal support provides an area- and boundary-efficient domain, while the local color field captures appearance variation within each primitive. Across 34 scenes, Hexels improve PSNR over memory-matched 2DGS by 4.53-7.38 dB across datasets while requiring lower training VRAM. We further ablate Hexels by showing that per primitive, Hexels outperform 2DGS by upto 4.74 dB while using lower training VRAM and having 2.31 times faster FPS. Even in unconstrained settings, Hexels offers complementary quality-memory trade-offs. For efficient 3D surface reconstruction, Hexels reduce error by 28.9% compared with memory-matched 2DGS across 15 DTU scans. On 6 Tanks and Temples surface scenes, Hexels achieves the highest mean F1 among compared methods (34.38%, versus 31.72% for 2DGS). We further also show that Hexels, as a general primitive, improves 2D image representation over Image-GS. Hexels push the Pareto frontier on the quality-efficiency trade-off of surface-aligned primitives.
2. 【2610.37666】hinkWorld: World Imagination Reinforces Chain-of-Dynamics Reasoning
链接：https://arxiv.org/abs/2610.37666
作者：Chaehyun Kim,Chi-Pin Huang,Jisoo Kim,Min-Hung Chen,Yu-Chiang Frank Wang,Seungryong Kim,Fu-En Yang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：made substantial progress, generalization remains constrained, models have made, robotic manipulation, made substantial
备注： Project Page: [this https URL](https://thinkworld-project.github.io/)
点击查看摘要
Abstract:Vision-Language-Action (VLA) models have made substantial progress in robotic manipulation, but their generalization remains constrained by the diversity and coverage of action-labeled robot demonstrations. Human videos provide much broader behavioral and environmental experience, while learning from them faces a fundamental trade-off between scalable data and explicit action grounding. We introduce ThinkWorld, a VLA learning framework that grounds action reasoning in world dynamics and strengthens it through reinforcement learning with world imagination. ThinkWorld represents each action thought as a Chain-of-Dynamics (CoD), a sequence of discrete motion tokens that captures the intermediate dynamics connecting the current world to a future state and serves as a common action representation across embodiments. We first initialize CoD with action-labeled demonstrations, then predict the future induced by each CoD and reinforce those whose predictions better match the observed outcome. This enables videos without action annotations to provide direct supervision from observed state transitions, allowing human and robot experience to refine the same reasoning space. Experiments in simulation and on real robots demonstrate effective human-to-robot transfer and strong generalization to unseen tasks and environments.
3. 【2610.37662】Can Discrete Tokens Serve as Semantically Lossless Representations of Visual Signals?
链接：https://arxiv.org/abs/2610.37662
作者：Jialv Zou,Xiaotong Li,Zhengrong Yue,Xu Huang,Yaxin Luo,Wenhao Yan,Haodong Li,Wenyu Liu,Xinggang Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：next-token prediction objective, shared next-token prediction, tokens represent vision, discrete form analogous, Discrete visual tokens
备注： Project page: [this https URL](https://doctor-james.github.io/FVQ-Page/)
点击查看摘要
Abstract:Discrete visual tokens represent vision in a discrete form analogous to language, offering a native interface for multimodal modeling under a shared next-token prediction objective. However, quantization error is widely assumed to cause unavoidable semantic loss, fundamentally limiting the semantic fidelity of discrete visual tokens and positioning continuous visual representations as an intrinsic upper bound. Using multimodal understanding as a proxy for semantic fidelity, we revisit this assumption and find quantization error unreliable, as discrete representations with substantially larger errors can achieve better understanding. Instead, the effective bit budget of discrete indices emerges as a key determinant of downstream performance. However, existing quantizers eventually saturate as additional codebooks contribute progressively less semantic information. As one approach to alleviating this saturation, we introduce Factorized Vector Quantization, which quantizes complementary, fixed-dimensional views of the visual feature with symmetric parallel codebooks. It continues to improve at larger bit budgets, ultimately matching continuous visual representations in multimodal understanding. Trained on industrial-scale multimodal data, our model achieves state-of-the-art performance among discrete-representation models, outperforming UniAR and Emu3-Chat by 22.8% and 59.2%, respectively, on a nine-metric average. To our knowledge, it is also the first discrete-representation model competitive with strong continuous-representation models such as Qwen3-VL, including on fine-grained OCR tasks. We further identify the key principles and a practical recipe enabling this competitiveness. These results and insights support the potential of discrete visual representations to underpin large-scale native multimodal foundation models. Code and models are available at this https URL
4. 【2610.37633】Repurposing Video Diffusion Transformers for Cross-View Temporal Object Correspondence
链接：https://arxiv.org/abs/2610.37633
作者：Siyoon Jin,Dahyun Chung,Honggyu An,Sangbeom Lim,Wonjin Nam,Jaewoo Jung,WonJun Moon,Seungryong Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：object correspondence identifies, correspondence identifies, Cross-view, object correspondence, object
备注： Project Page : [this https URL](https://cvlab-kaist.github.io/XTrack/)
点击查看摘要
Abstract:Cross-view object correspondence identifies the same object across views. However, existing methods often rely on frame-wise matching or sequential tracking, which can propagate correspondence errors under appearance changes or occlusions. Therefore, we introduce cross-view temporal object correspondence, which requires preserving object identity across both views and time from a query mask. To address this, we propose XTrack, a unified framework which repurposes a pretrained video DiT with semantic and spatiotemporal priors for RGB-to-mask latent transport, jointly modeling cross-view matching and temporal tracking. However, naive video DiTs do not guarantee accurate cross-view grounding and often attend to semantically similar yet incorrect objects across views. Thus, we introduce focal cross-view attention alignment, hard negative conditioning, and local context crop strategies to ensure reliable grounding. Finally, beyond these architectural enhancements, we also tackle the lack of dense annotation by introducing a pseudo-label curation pipeline that converts sparse Ego-Exo4D annotations into dense supervision to enable effective video-level training. Our results demonstrate the effectiveness of XTrack as a unified framework, ensuring robust temporal consistency and identity preservation.
5. 【2610.37626】Know, then Draw: A New Learning Paradigm for Visual Generation
链接：https://arxiv.org/abs/2610.37626
作者：Yucheng Mao,Chongjian Ge,Zhuowen Tu,Hao Tan,Hanwen Jiang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Visual generation requires, fine-grained pixel details, Visual generation, knowledge acquisition, requires both high-level
备注：
点击查看摘要
Abstract:Visual generation requires both high-level semantic knowledge and fine-grained pixel details. We propose a learning paradigm that assigns these roles to autoregressive pretraining for knowledge acquisition and diffusion post-training for high-fidelity rendering. Within this framework, we study the objective, representation, and scaling of knowledge acquisition and rendering. Controlled comparisons identify autoregression as the stronger pretraining objective for downstream rendering, improving both learning efficiency and final generation quality. We further find that AR-only generation quality does not necessarily correlate with final performance; semantic quality matters more. This motivates a purely semantic tokenizer trained with language supervision alone, without an image decoder or reconstruction loss. We establish compute-optimal scaling laws for knowledge acquisition and rendering, and find that autoregressive pretraining lowers the fitted asymptotic rendering loss compared with pixel diffusion models trained from scratch. Guided by the laws, we train a 3B-parameter text-to-image model with only 6,600 H100 GPU-hours, achieving 86 on GenEval and 87 on DPG-Bench and validating the proposed paradigm at scale.
6. 【2610.37619】Perceiving and Predicting Dynamic Sports: Spatiotemporal Intelligence in Vision Models for Egocentric Tennis Video
链接：https://arxiv.org/abs/2610.37619
作者：Tudor Braicu,Joseph DelPreto,Jared Boyer,Mónika Farsang,Maximilian Stölzle,Tim Niklas Seyde,Daniela Rus
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Agile robots require, Agile robots, require spatiotemporal intelligence, anticipate future events, reason about interactions
备注： 8 pages, 5 figures. Project page: [this https URL](https://tennis-vision.csail.mit.edu/)
点击查看摘要
Abstract:Agile robots require spatiotemporal intelligence to interpret scenes, reason about interactions, and anticipate future events. Yet it remains unclear how well foundation vision models support these capabilities, particularly from a moving egocentric camera, which is a natural view for robots. To investigate this, we collect an annotated tennis dataset and train a suite of vision models on spatiotemporal tasks. Our dataset contains egocentric video synchronized with five allocentric videos, estimated global positions, labeled contact times, and annotated stroke types. We then evaluate seven prediction tasks from egocentric images: 2D ego player and 3D ball localization, future player and ball trajectories, forehand or backhand stroke anticipation, time to the next ego player ball contact, and 3D ball position at that contact. We compare image encoders, video encoders, and vision-language models with jointly trained prediction heads. The best performing models achieve mean current-frame localization errors of 0.14 m for the ego player and 0.54 m for the ball, future forecasting errors of 0.34 m for the ego player and 0.91 m for the ball over 1.1 s, and a mean contact-time prediction error of 0.14 s. Auxiliary depth information substantially improves 3D ball localization, suggesting that inferring metric depth remains a challenge. Longer image histories do not improve ball forecasting, indicating that representations exploit scene context rather than rely solely on inter-frame motion. Finally, we propose a conditional diffusion model to generate whole-body kinematic tennis motion from vision encoder predictions on egocentric video at real-time rates, adapting movements as predictions are refined. These results move towards a deeper understanding of how foundation vision models can support real-time dynamic robots using egocentric video.
7. 【2610.37613】VideoLVR: Latent Visual Reasoning over Grounded Video Evidence
链接：https://arxiv.org/abs/2610.37613
作者：Shilong Li,Xingyuan Bu,Hao Shi,Yun Xing,Weixin Feng,Qiangpeng Yang,Shilei Wen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：large language models, multimodal large language, visual, visual evidence, evidence
备注： 13 pages
点击查看摘要
Abstract:Chain-of-thought reasoning has substantially advanced video understanding in multimodal large language models (MLLMs). However, language-based reasoning traces do not provide a reliable mechanism for models to revisit relevant visual evidence, leading to visual forgetting and impairing their ability to reason over video content. Existing approaches maintain visual grounding during reasoning in two main ways: they either refer to evidence using textual coordinates, which specify symbolic locations rather than the visual content itself, or reinsert cropped regions or frames into the multimodal context, preserving visual details at the cost of substantial context expansion. To address these limitations, we introduce VideoLVR, which constructs latent visual evidence from local regions at relevant video moments, thereby providing visual support for intermediate reasoning steps. To supervise latent visual evidence generation, we introduce a visual token prediction objective that formulates visual token reconstruction as prediction over a vocabulary derived from the input video, thereby unifying visual evidence reconstruction and text generation within the same token prediction framework. This shared prediction framework enables MLLMs to reason over interleaved text tokens and latent visual states while integrating evidence from different moments. We further extend VideoLVR to reinforcement learning by treating sampled visual tokens as actions alongside text tokens and jointly optimizing the policy using final-answer rewards. By efficiently revisiting task-relevant visual information during reasoning, VideoLVR improves video understanding without substantially expanding the multimodal context. Experiments on multiple video benchmarks demonstrate its effectiveness, especially on tasks requiring fine-grained visual evidence.
8. 【2610.37599】MoI-Bench: A Benchmark for Image Generation and Editing on Mobile Devices
链接：https://arxiv.org/abs/2610.37599
作者：Kailai Feng,Haoxiang Rao,Yuxiang Wei,Bo Chen,Junsong Li,Yang Pan,Chengkun Cai,Jagmohan Chauhan
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Developing on-device image, device resource constraints, Developing on-device, resource constraints, types and device
备注： Project page: [this https URL](https://carlofkl.github.io/MoI-Bench-project/)
点击查看摘要
Abstract:Developing on-device image models requires considering practical user needs, task types and device resource constraints. However, existing benchmarks provide limited guidance on identifying capability gaps between on-device models and server-side models. We introduce MoI-Bench, a benchmark grounded in mobile user needs, comprising 64 subtasks and 1150 samples. It defines 16 operations, such as removal and replacement, and eight visual target categories covering content such as portraits and text. These form two orthogonal axes whose applicable combinations define specific tasks, such as removing facial makeup. To better guide model improvement, we further propose MoI-Eval, which introduces task-specific criteria covering instruction following, visual quality and detail preservation. We further construct sample-level evaluation questions and aggregate their scores into overall quality and capability profiles along the operation, target and criteria axes. We evaluate representative on-device and server-side models and measure mobile deployment costs. Results show that this decoupled Operation x Target design provides finer-grained guidance for improving compact models. For example, it highlights the need to prioritize specific capability gaps (e.g., text-replacement) over broad application-level goals (e.g., improving text editing). Unlike conventional benchmarks that rank models using a single score, we introduce a two-dimensional Quality-Deployability capability map to assess models for practical mobile use. The map shows that current on-device models can achieve efficient generation or editing but expanding their task coverage deserves greater attention than further improving deployment efficiency. Further progress requires improving editing quality, particularly identity preservation and text rendering, while broadening task coverage.
9. 【2610.37583】Zero-Shot Multimodal Event Spotting in Soccer Broadcasts
链接：https://arxiv.org/abs/2610.37583
作者：Sadia Kamal,Mahmudul Hasan,Tony Braskich
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG); Multimedia (cs.MM)
关键词：existing methods depend, Automatic soccer event, supports highlight generation, large annotated datasets, event spotting supports
备注： Accepted to the Main Conference at the IEEE International Symposium on Multimedia: ISM 2026
点击查看摘要
Abstract:Automatic soccer event spotting supports highlight generation, video indexing, and sports analytics, but existing methods depend on large annotated datasets and soccer-specific training. We present a zero-shot framework that detects, classifies, and temporally localizes events in full-length soccer broadcasts without task-specific parameter training. Each match is segmented into overlapping clips represented by a compact visual storyboard and the aligned commentary transcript, which a general-purpose multimodal model processes jointly. On three manually annotated matches containing 130 events, the best configuration achieves 72.0% F1@5s and outperforms SoccerNet-trained CALF and NetVLAD++ in a cross-dataset setting, while the storyboard representation reduces inference cost by 72% compared with individual frames. We further analyze the effects of model family, input representation, and prompt optimization, and introduce an evidence-grounded excitement-scoring stage that ranks detected events with natural-language explanations for highlight selection.
10. 【2610.37579】As the Story Unfolds: Watching a Film and Identifying Characters as a Human Does
链接：https://arxiv.org/abs/2610.37579
作者：Zhongrui Gui,Junyu Xie,Tengda Han,Weidi Xie,Andrew Zisserman
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：introduce characters incrementally, character, characters incrementally, Abstract, introduce
备注： Project Page: [this https URL](https://www.robots.ox.ac.uk/~vgg/research/StreamCast/)
点击查看摘要
Abstract:Films introduce characters incrementally as they progress. We study the problem of identifying principal characters and assigning their names directly from the movie itself, without using external cast lists, actor photographs, or pre-built character banks. We introduce the character naming task: given a name mentioned in dialogue and the associated video context, the model must determine which visible character bears that name. This task is challenging because name resolution often depends on cinematic cues such as shot-reverse-shot structure, self-introduction, direct address, third-party reference, gaze, and temporal continuity. We provide a dataset and annotations for evaluating character naming and first character appearances, develop a video-and-dialogue model for the task, and compare it with proprietary multimodal large language models. We further introduce a progressive framework for building a character bank as the film unfolds. Together, these contributions support online, human-like movie understanding in which character identities are inferred from the film itself.
11. 【2610.37576】he Noise Plane: A Diffusion Bridge Across Exponent and Dispersion
链接：https://arxiv.org/abs/2610.37576
作者：Xuran Hu,Yuru Jia,Tengxi Wang,Miloš Daković,Ljubiša Stanković,Wufan Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Diffusion-based denoising commonly, signal-dependent statistical laws, Diffusion-based denoising, diverse signal-dependent statistical, statistical laws
备注： 23 pages, 15 figures
点击查看摘要
Abstract:Diffusion-based denoising commonly uses Gaussian perturbations, whereas sensor noise follows diverse signal-dependent statistical laws. In this paper, we propose $p$-Bridge, a unified measurement-indexed diffusion framework for Tweedie noise. The noise exponent $p$ describes the variance--intensity relation, while accumulated measurement $\nu$ controls the noise level. Together, they define a noise plane that includes Gaussian, Poisson, and Gamma models. The stochastic bridge connects measurement distributions through independent increments, giving denoising a physical interpretation as progressive measurement accumulation. Both the starting and stopping indices can be specified, allowing restoration from an observed measurement level to a prescribed higher level. Measurement superposition yields a shared reverse-mean update, paired with a deviance-based objective for learning the required conditional mean. A latent compound Poisson--Gamma construction enables sampling at intermediate exponents. A single exponent-conditioned network adapts to different Tweedie noise models without separate training for each exponent. Experiments show that exponent conditioning improves cross-exponent robustness over fixed-exponent models. Using estimated exponents, the shared network achieves robustness comparable to an oracle-selected set of five specialist models. Experiments on synthetic images, FMD fluorescence microscopy, and multi-sensor SAR images further demonstrate its effectiveness across different signal-dependent noise regimes.
12. 【2610.37566】ReferStream: Interactive Subject Injection for Streaming Video Generation
链接：https://arxiv.org/abs/2610.37566
作者：Shuolin Xu,Guanyuan Li,Boyu Li,Kelu Yao,Xiaogang Xu,Hongchuan Yu,Shuicheng Yan,Xiaobin Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：integrating newly supplied, preserving established subjects, requires integrating newly, naturally during streaming, generation requires integrating
备注： 18 pages. Project page: [this https URL](https://xushuolin.github.io/ReferStream/)
点击查看摘要
Abstract:Injecting new subjects naturally during streaming video generation requires integrating newly supplied visual references into the existing video while preserving established subjects and the scene. Encoding references independently of the current scene provides little guidance for this integration, while keeping their features in persistent memory can interfere with established context. We propose ReferStream, a framework that requires no additional training and combines reference construction using the current scene with transient cache injection. Joint Latent places reference latents in target regions of the latest scene latent, allowing reference features to be extracted in context. Cache Restoration uses these features to condition the injection chunk, then restores the overwritten global cache entries while retaining the newly generated history. This procedure incorporates new visual conditions without retraining the generator or revising emitted frames. We further introduce ReferStream Bench, a new benchmark with scheduled reference arrivals, evolving instructions, and explicit annotations of subject presence for InShot and MultiShot generation. Evaluation follows the event schedule and measures both the fidelity of new subjects and the preservation of established subjects, alongside video quality, text adherence, and count accuracy. Experiments on ReferStream Bench show higher scores for text adherence, subject similarity, and count accuracy than the compared baselines, including offline methods given all references in advance. Project page: this https URL.
13. 【2610.37545】GroundControl: Satellite-Conditioned Multi-View Diffusion for Reconstruction-Free Novel View Synthesis
链接：https://arxiv.org/abs/2610.37545
作者：Akshay Krishnan,Matias Turkulainen,Jamie Wynn,Zawar Qureshi,Mohamed Sayed,Guillermo Garcia-Hernando,Sara Vicente,James Hays,Michael Firman,Daniyar Turmukhambetov
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：sparse image collections, recently emerged, views, video diffusion models, Multi-view
备注： Accepted to WACV 2027. Project page: [this https URL](https://nianticspatial.github.io/groundcontrol)
点击查看摘要
Abstract:Multi-view or video diffusion models have recently emerged as state-of-the-art approaches for novel-view synthesis from sparse image collections. While they can produce high quality images, they tend to hallucinate unrealistic spatial layouts when synthesizing views outside the input views (scene extrapolation). We propose to address this challenge for outdoor scenes by using satellite images as an additional information source to condition the multi-view generative model. We introduce a new satellite-conditioned multi-view diffusion model that combines conditioning from a satellite image and street-level input images when generating novel-views. Our cross-attention based conditioning allows us to retain pretrained multi-view diffusion priors to generate seamless, realistic, novel views from a handful of source views, while also adhering to the scene layout as seen from satellite images. Our model does not use 3D scene reconstruction, and only relies on posed street and satellite views. Our experiments on outdoor datasets show that our model is better than both satellite-conditioned or street-view conditioned baselines on novel-view synthesis, especially on challenging cases where target views have very little overlap with source views. Project page: this https URL
14. 【2610.37510】A note on data-efficient finetuning of vision foundation models
链接：https://arxiv.org/abs/2610.37510
作者：Niclas Hergenröther,Antonio Orvieto
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：building specialized machine, specialized machine learning, Adapting foundation models, machine learning models, Adapting foundation
备注： 8 pages, 3 figures, Accepted at ES-FoMo III: 3rd Workshop on Efficient Systems for Foundation Models at ICML 2025
点击查看摘要
Abstract:Adapting foundation models to a new task within or beyond the training domain is the de facto standard for building specialized machine learning models. Recently, Visual Prompting (VP) has emerged as a promising technique for efficient knowledge transfer. As new foundation model families~(like Mamba) get introduced and VP pipelines such as AutoVP reach greater maturity, we find a growing need for a systematic evaluation of current approaches. In this work, we assess the performance of the latest models, comparing them to earlier architectures and alternative fine-tuning methods, to better understand the progress, challenges and opportunities in the field of efficient fine-tuning under resource limitations. Towards this goal, this paper provides a concise empirical overview of the interactions among foundation model families (Attention-, Convolution-, and Mamba-based) and transfer paradigms: VP, Linear Probing (LP), Full Fine-tuning (FFT) and Low Rank Adaptation (LoRA). Our work builds up on previous findings by broadening the selection of evaluated models and techniques while tuning hyperparameters. In the interest of delivering practical guidelines for the user, we also explore application of prevalent regularization techniques to boost performance in the context of VP.
15. 【2610.37503】ALADDIN: Adversarial Latent Diffusion Distillation for One-Step Identity Swapping
链接：https://arxiv.org/abs/2610.37503
作者：Ivan Shchekotov,Timofei Gritsaev,Viacheslav Pirogov,Dmitry Vetrov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Latent Diffusion Distillation, Adversarial Latent Diffusion, Face swapping transfers, identity, target pose
备注： Accepted to WACV 2027. 15 pages, 5 figures, 4 tables, including references and appendices
点击查看摘要
Abstract:Face swapping transfers a source identity onto a target image while preserving the target's pose, expression, hair, and lighting. The most realistic current methods are diffusion-based, but they need many network evaluations per image. GAN-based methods are fast, yet trained from scratch they must learn realism from the adversarial signal alone and produce visibly weaker results. We present ALADDIN (Adversarial Latent Diffusion Distillation for One-Step Identity Swapping), a one-step face swapper obtained by initialising the generator from a pre-trained multi-step flow-matching model and training it adversarially under identity and target-preservation constraints. We expose a controllable trade-off between identity transfer and target-attribute preservation by training a student model with triplet pseudo-label supervision. We additionally identify a bias in the standard evaluation protocol, which favours methods trained against the same identity encoder used to score them, and re-evaluate all baselines with an independent one. ALADDIN is state-of-the-art among one-step methods in realism and target preservation at comparable identity transfer, and matches the best multi-step model with 28 times fewer network evaluations and an order of magnitude fewer training pairs.
16. 【2610.37472】How Reliable Is Individualized Functional-Network Attribution in Resting-State fMRI Cognitive Prediction in ADNI?
链接：https://arxiv.org/abs/2610.37472
作者：Sheethal Bhat,Mahfuzur Rahman Chowdhury,Imam Ahmed Shaik,Rose Dawn Bharath,Siming Bayer,Andreas Maier
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：interpretable resting-state fMRI, Disease Neuroimaging Initiative, Alzheimer Disease Neuroimaging, Individualized attribution estimates, rarely quantified
备注：
点击查看摘要
Abstract:Individualized attribution estimates which functional networks drive a model prediction for a given subject and is often proposed as an interpretable resting-state fMRI (rs-fMRI) biomarker, but its test-retest reliability is rarely quantified. We evaluate per-subject network-ablation attribution for a frozen resting-state functional connectivity (FC) predictor (Schaefer-200 FC predicting MMSE/ADAS-Cog13) trained on N=875 subjects from the Alzheimer's Disease Neuroimaging Initiative (ADNI), using, and (iii) a subject-level permutation null. Split-half reliability is near-ceiling (Spearman p=0.948/0.950) but drops on scan-rescan (p=0.609/0.616). Under the mismatched-subject null, correlations remain substantial (p~0.46-0.47), indicating strong population-shared structure, yet matched pairs exceed this null (z~6.6-6.9, p=10-4). Thus, in ADNI, individualized network attribution contains a modest but non-zero person-specific component atop a strong population-shared pattern. We recommend reporting scan-rescan reliability together with a permutation-null control, rather than within-session proxies alone, to avoid overstating individual specificity.
17. 【2610.37471】PerceptRL: Making Visual Perception Rewardable in MLLMs from Answers to Interactions
链接：https://arxiv.org/abs/2610.37471
作者：Tongkun Guan,Zhibo Yang,Mingkun Yang,Haocheng Wang,Wei Shen,Xiaokang Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：multimodal large language, large language models, reasoning-focused optimization, perception, remains a bottleneck
备注：
点击查看摘要
Abstract:Fine-grained visual perception remains a bottleneck during post-training of multimodal large language models (MLLMs), as perceptual errors can constrain gains from reasoning-focused optimization. Although image-caption pre-training improves perception, its influence can weaken as subsequent stages change data mixtures and objectives. Continuing caption supervision during post-training is challenging because subjective, information-dense descriptions complicate verifiable reward design. We present PerceptRL, which strengthens perception at two complementary levels. Perception RL uses a multi-agent pipeline to extract verified errors from dense image captions and convert the corresponding visual facts into QA pairs with fixed answer labels and rule-based rewards. Chain QA links correlated errors, while multiple-choice QA combines unrelated errors. A specialized route targets high-error domains with tailored verification, and a domain-agnostic general route covers errors beyond these domains. Perception Agentic RL addresses fine-grained and dense cases unresolved by single-turn Perception RL through multi-turn inspection with visual tools. We observe coordinate drift even in models trained to use tools, where incorrect crops or annotations distort evidence and propagate errors. Coordinate Injection corrects spatial operations in cold-start trajectories, while a grounding-aware process reward supervises intermediate spatial fidelity alongside final-answer correctness. Training proceeds through shared cold-start SFT, single-turn Perception RL, and multi-turn Perception Agentic RL. Across seven benchmarks under a shared tool-use protocol, PerceptRL achieves 71.6% average accuracy, surpassing the base model with the same tools and the strongest evaluated frontier VLM by 15.7 and 5.2 percentage points, respectively.
18. 【2610.37437】Representing the Unseen: Rethinking Visual Imagination for Spatial Reasoning
链接：https://arxiv.org/abs/2610.37437
作者：Zengqi Zhao,Zun Wang,Shoubin Yu,Mohit Bansal,Yue Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：Visual world models, world models increasingly, models increasingly support, increasingly support spatial, RGB
备注： Webpage: [this https URL](https://imagirep.github.io/)
点击查看摘要
Abstract:Visual world models increasingly support spatial reasoning by generating RGB views of unobserved states. However, RGB has become the default interface largely because it is well suited for visual generation, rather than necessarily being the most effective representation for downstream reasoning. Different spatial questions may benefit from different representations of the same imagined state: top-down geometry can facilitate global distance comparisons, while panoramic views provide broader context for reasoning about open space. To isolate the role of representation in spatial imagination, we introduce ImagiRep, a simulator-grounded benchmark of 922 questions spanning seven question types across two settings, Viewpoint Imagination and Cross-view Integration, providing oracle RGB and six alternative representations (e.g., depth, panoramic views, and top-down geometry) of the same unobserved state. This controlled comparison reveals that even accurate imagined RGB does not guarantee accurate spatial reasoning, and different questions benefit from different representations. Similar trends hold for representations derived from world-model-estimated states. Notably, estimated RGB alone can mislead spatial reasoning, while alternative representations retain complementary benefits. Building on these findings, we introduce GEARS, a lightweight test-time strategy for adaptive representation selection, outperforming existing spatial imagination methods and showing that reasoning about unseen states requires more than generating RGB views.
19. 【2610.37431】Segmentation Confidence for Arbitrary CNNs
链接：https://arxiv.org/abs/2610.37431
作者：Baris Oguz,Xing Yao,Claudia Tawil,Alison Pouch,Brett Byram,Gabriel Arenas,Nadav Schwartz,Ipek Oguz
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Convolutional neural networks, Convolutional neural, CNN, medical image segmentation, medical image
备注： 5 pages, 6 figures, published in ISBI 2026
点击查看摘要
Abstract:Convolutional neural networks (CNN) are widely used for medical image segmentation. However, they lack an inherent measure of confidence. Existing methods for estimating prediction uncertainty often require a custom network architecture and/or dedicated training setups and need to be trained from scratch. In addition, the deduction of a single confidence score per input from the uncertainty maps is not always straightforward. In this study, we explore voxel-based uncertainty estimation methods that can be added to existing segmentation pipelines without training from scratch. We also propose a novel method to estimate a single confidence score from the uncertainty maps. Our evaluations on different ROIs and modalities suggest that our confidence score can predict segmentation performance in unseen data.
20. 【2610.37430】When Visual Evidence Is Insufficient: How Instructions, Post-Training, and Internal Activations Shape Refusal in Multimodal Language Models
链接：https://arxiv.org/abs/2610.37430
作者：Ananth K Suresh,Aveen Dayal,Gouthaman KV,Aditya Pola,Vineeth N Balasubramanian
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：multimodal large language, withhold unsupported answers, reliable deployment, multimodal large, refusal
备注： 31 pages, 6 figures
点击查看摘要
Abstract:For reliable deployment, multimodal large language models (MLLMs) should recognize when an image provides insufficient evidence to answer a question and withhold unsupported answers. Yet refusal alone is not necessarily evidence of such recognition: models may refuse because of unrelated safety constraints or without identifying the missing evidence. We study how refusal on visually unanswerable questions is shaped by three sources of control: inference-time instructions, post-training, and internal activation interventions. Across three MLLMs on the MoHoBench benchmark, we systematically manipulate the meaning and placement of refusal instructions, compare supervised and preference-based post-training, and intervene on a refusal-related activation direction derived from naturally answered and refused examples. We find that refusal is highly sensitive to both the meaning and placement of instructions, with model-specific changes at the sample level that are obscured by aggregate refusal rates. Evidence-aware and general refusal instructions have stronger effects than an intentionally mismatched safety instruction. Post-training produces larger increases in refusal, but can also induce responses that combine refusal language with attempted answers. In contrast, activation intervention produces smaller yet transferable changes across prompt conditions, without evidence of indiscriminate refusal on tested visually answerable samples. These findings show that refusal is jointly shaped by external instructions, post-training, and internal representations, highlighting the need to disentangle evidence recognition from a model's learned propensity to refuse.
21. 【2610.37406】CTBakeGS: training-free baking of photorealistic CT volume renderings into 3D Gaussian splats
链接：https://arxiv.org/abs/2610.37406
作者：Haruki Fukuda,Constantin Lux,Wolf Schweitzer,Tadashi Hosoya,Lars Ebert
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：convey anatomy intuitively, anatomy intuitively, dedicated software, convey anatomy, Photorealistic volume rendering
备注： Code and project page: [this https URL](https://github.com/BocchiSlice/CTBakeGS)
点击查看摘要
Abstract:Photorealistic volume rendering of computed tomography (CT) may convey anatomy intuitively, but it needs the CT data, dedicated software and a powerful graphics processor. Three-dimensional Gaussian splatting (3DGS) displays photorealistic scenes in real time on less powerful devices, but existing medical approaches train each scene for minutes to hours. We aimed to convert a CT volume rendering directly into a 3DGS model without training. Splats were placed on an adaptive octree of millimetre-sized cells. Their colour and opacity were computed on the graphics processor with the renderer's lighting, cell opacity was converted analytically into splat opacity, and faint splats were retained stochastically above the 1/255 opacity floor of standard 3DGS rasterisers. Six public CT scans (1.5-mm voxels) were converted with three transfer functions and compared with converged references by peak signal-to-noise ratio (PSNR), structural similarity and a learned perceptual metric. Two-million-splat models reached a PSNR of 32.6 +/- 0.9 dB for bone, 30.1 +/- 1.0 dB for contrast-enhanced vessels and 32.3 +/- 1.5 dB for skin and bone. A conversion pass (usually two or three per model) took 4-30 s on a current laptop and 9-60 s on a desktop with a 4-GB graphics card. On the laptop, the models rendered at 68 frames per second at 800 x 800 pixels. Training-free conversion produced real-time 3DGS models of photorealistic CT renderings in about a minute or less per conversion pass on ordinary computers, with fidelity that we consider sufficient for interactive viewing.
22. 【2610.37381】PDRVLA: A Vision-Language-Action Model with Physical Dynamics Representations
链接：https://arxiv.org/abs/2610.37381
作者：Hanqing Wang,Zhaotian Cai,Ruichuan An,Bohan Zeng,Tao Zhang,Yilin Chen,Xu Jiang,Kaiquan Chen,Chongyang Wu,Haoran Li,Fan Yang,Mingan Lin,Wentao Zhang,Zenan Zhou,Youzheng Wu
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：dynamics remains limited, models generate robot, physical dynamics remains, generate robot actions, remains limited
备注：
点击查看摘要
Abstract:Vision--Language--Action (VLA) models generate robot actions from visual observations and language instructions, but their understanding of physical dynamics remains limited. Video world models can capture scene dynamics, yet generating future videos introduces high latency into the control loop. We introduce PDRVLA, whose lightweight Physical Dynamics Module extracts physical tokens from vision--language features to condition action generation without online video generation. The module learns through direct prediction of future RGB, depth, and optical-flow features, with auxiliary supervision through a frozen pretrained video world model. Training relies entirely on publicly available data, expanded through human-to-robot synthesis, subtask annotation, and embodied chain-of-thought (ECoT) annotation. Across four simulation benchmarks, PDRVLA achieves success rates of 99.3% on LIBERO, 89.9% on LIBERO-Plus, 93.6% on RoboTwin~2.0, and 81.5% on SimplerEnv. Ablations show improved future prediction with world-model supervision and evaluate how subtask conditioning, future object-pose supervision, and ECoT training affect action success.
23. 【2610.37364】EmbeddingGemma 2: Unified and Efficient Multimodal Representations
链接：https://arxiv.org/abs/2610.37364
作者：Henrique Schechter Vera,Sahil Dua,Jovan Andonov,Sara Smoot,Sebastian Russo,Ivan Llanos,Max Matveev,Jae Hyeon Yoo,Kat Black,Shih-Cheng Huang,Josiah Aklilu,Maarten Grootendorst,Omar Sanseviero,Chandramouli Amarnath,Ian Ballantyne,Zhe Li,Daniel Salz,Ibrahim Alabdulmohsin,Ilya Philippov,Kristen Quan,Glenn Cameron,Edouard Yvinec,Luciano Martins,Doug Reid,Sindhu Raghuram Panyam,Weiyi Wang,Hengxuan Ying,Madhuri Shanbhogue,Tanmaya Dabral,Shanfeng Zhang,Juyeong Ji,Renjie Wu,Joe Zou,Xu Chen,Yunan Zhang,Yu-Hui Chen,Matthew Soulanille,Vinod Mamillapalli,Yi-Chun Kuo,Wai Hon Law,Matt Kreileder,Alice Zheng,Suril Shah,Mogan Shieh,Pooja Consul,Alberto Montes,Andreas Hess,Andres Sevilla,Babak Samari,Brendan McCloskey,Brian Potetz,Daniel Cer,Georgios Kathareios,Gustavo Hernández Ábrego,Hesen Zhang,Ji Ma,Jiaxing Wu,Keegan Mosley,Paul Suganthan,Rui Meng,Shen Gao,Shengcao Cao,Yi-Ting Chen,Yichang Chen,Zhongli Ding,Kendra Byrne,Cormac Brick,Olivier Lacombe,Qin Yin,Tris Warkentin,Armand Joulin,Tom Duerig,Mojtaba Seyedhosseini
类目：Machine Learning (cs.LG); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Sound (cs.SD)
关键词：natively represents text, open multimodal embedding, represents text, unified space, multimodal embedding model
备注： 28 pages. Models are available on HuggingFace (at [this https URL](https://huggingface.co/google/embeddinggemma-2) ) and LiteRT (at [this https URL](https://huggingface.co/litert-community/embeddinggemma-2-740m-litert-lm) )
点击查看摘要
Abstract:We present EmbeddingGemma 2, an open multimodal embedding model which natively represents text, images, audio, video, and combinations thereof in a unified space. Our approach introduces improvements such as simplified per-layer embeddings and a multi-stage curriculum with modality and objective progression which ensure strong quality across unimodal, cross-modal, and mixed-modal evaluations. Notably, in comprehensive embedding benchmarks across all modalities, EmbeddingGemma 2 establishes a new Pareto frontier, outperforming both specialist models and models two to twelve times larger. Furthermore, our design offers flexibility for resource-constrained environments, supporting selective modality encoder loading, adjustable vision token budgets, truncatable embedding dimensions, and quantized weights. We present ablations analyzing key decisions and release EmbeddingGemma 2 to promote further research.
24. 【2610.37349】meLineXR: An Interactive Exploration of Time in Vision-Language Models
链接：https://arxiv.org/abs/2610.37349
作者：Nidham Tekaya,Markus Passecker,Matthias Zeppelzauer
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：time axis, vision-language models, shown that vision-language, intrinsic understanding, time
备注：
点击查看摘要
Abstract:Recently, it has been shown that vision-language models (VLMs) have a certain intrinsic understanding of time. They can estimate the temporal origin of objects and encode time along a low-dimensional, non-linear manifold inside their embedding space~\cite{tekaya2025matter}. That result is quantitative and reproducible, but the structure itself stays out of reach for end users: they cannot see it, query it with their own images, or inspect where a query lands relative to other years on the time axis. We present TimeLineXR, an interactive demonstration that turns this time axis into an explorable 3D scene. A web demo lets users upload or select images and see each placed on a color-coded 3D time axis; a this http URL WebXR scene renders the same time axis as a room-scale representation that can be grabbed, scaled, inspected, and queried by throwing image cards into it. Both clients run the same prediction pipeline against the same cached temporal index: encode the query with CLIP, project it through cosine-kernel KPCA, and snap it to the Bézier time axis. The system turns each image into a point on the time axis, so users can compare where different objects land and read off their estimated first year of this http URL source and reproduction steps can be found in: this https URL.
25. 【2610.37341】CodeCap-Bench: Can Code Serve as a Good Video Caption?
链接：https://arxiv.org/abs/2610.37341
作者：Jiafu Tang,Yifan Xu,Eric Tang,Junjie Zhao,Shipeng Luo,Te Sun,Haoxuan Hu,Yiyan Ji,Xinlong Chen,Zihao Wang,Yang Shi,Yuanxing Zhang,Pengfei Wan,Jiaheng Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：natural language, compact descriptions, Code, Video captioning aims, potentially ambiguous descriptions
备注：
点击查看摘要
Abstract:Video captioning aims to preserve visual information through compact descriptions, predominantly using natural language. However, precisely expressing fine-grained spatial structures and temporal dynamics in natural language often leads to lengthy and potentially ambiguous descriptions. In this work, we explore Code as Video Caption, a paradigm where executable programs serve as a complementary representation of visual content through graphical primitives, layout rules, and functions of time. To examine whether code captions effectively preserve video information, we compare them with natural language captions on downstream question answering and video reconstruction tasks. Our results show that code captions achieve superior reasoning accuracy and reconstruction fidelity. Despite these advantages, realizing the potential of code captioning depends on whether current multimodal large language models (MLLMs) can generate faithful code captions. To systematically assess this capability, we introduce CodeCap-Bench, which comprises 323 videos spanning five categories of structured 2D content, along with fine-grained annotations and a multi-level evaluation framework. Extensive experiments reveal that while leading proprietary MLLMs demonstrate promising code captioning capabilities, they still struggle to faithfully capture complex temporal dynamics, with open-source models lagging substantially behind.
26. 【2610.37326】ScIntBench: Physical Interaction Plausibility in 3D Scene Generation
链接：https://arxiv.org/abs/2610.37326
作者：Wendi Ying,Daochang Liu,Leonid Sigal,Ajmal Saeed Mian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：reliability insufficiently assessed, generation largely emphasize, largely emphasize semantic, emphasize semantic fidelity, leaving interaction-time physical
备注：
点击查看摘要
Abstract:Existing evaluations of text-conditioned 3D indoor scene generation largely emphasize semantic fidelity and physical validity at rest, leaving interaction-time physical reliability insufficiently assessed. To address this gap, we introduce ScIntBench, a unified benchmark centered on interaction readiness: it executes prescribed manipulation actions (e.g., pushing, opening, and surface probing) in physics simulation and measures task success, capability and progress, post-interaction integrity, and dynamic plausibility. Multi-view semantic and static physical evaluations complement these metrics and help explain interaction outcomes. We systematically evaluate 12 state-of-the-art scene generation systems across 10 room types. Our results reveal that strong semantic and static physical performance does not necessarily translate into interaction readiness: a system with near-perfect static plausibility completes only 11.54% of interactions, 7 of the 12 systems produce scenes that cannot support any interaction, and even the best system succeeds in only 36.92% of prescribed tasks. These findings highlight two fundamental challenges in generating interaction-ready scenes: providing the necessary physical interaction capabilities and ensuring reliable physical behavior under active manipulation.
27. 【2610.37321】Hierarchical Sparse Graph for Multi-dimensional Assignment in Event-based Tracking
链接：https://arxiv.org/abs/2610.37321
作者：Muxi Zha,Yang Shang,Wenlong Zhang,Qifeng Yu,Banglei Guan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：methods typically operate, online manner, typically operate, tracking methods typically, adjacent batches
备注： 16 pages, published to IEEE T-CSVT
点击查看摘要
Abstract:Existing event-based tracking methods typically operate in an online manner, associating tracklets across adjacent batches. However, this limited temporal window often leads to failures in challenging scenarios, such as long-term occlusions or missed detections, where broader temporal context should be incorporated for high-precision tracking. To achieve robust and accurate tracking, this paper concentrates on the event-based multi-dimensional assignment that associates tracklets across multiple batches simultaneously. Unlike image-based detectors, event-based detectors can generate multiple correct yet spatially distinct tracklets for a single object per batch. This violates the one-to-one rule in classic data association, making event-based association an underdetermined many-to-many matching problem. To the best of our knowledge, this is the first work to tackle this NP-hard problem. To address its underdetermined nature, we formulate the assignment problem via fuzzy logic, where pairwise tracklet correlations are quantified through multiple long-range kinematic metrics. This fuzzy design eliminates the need for hard tracking thresholds and enables multiple heterogeneous metrics to be integrated into a unified correlation. By treating tracklets as nodes and their fuzzy correlations as edges, we construct a Hierarchical Sparse Graph (HSG). Building upon the HSG, we pose assignment as a graph partition task, and employ a heuristic solution that measures vertex affinity for partitioning adaptively. The entire pipeline is training-free. Comprehensive experiments on two challenging event datasets, eTram and Ev-UAV, show that our method outperforms existing event-based and most image-based association models. Particularly, it achieves over 2$\times$ the performance of OC-SORT across all metrics in the many-to-many association scenario.
28. 【2610.37314】A Lightweight Attention-Based CNN with Saliency-Map Interpretability for Skin Cancer Detection
链接：https://arxiv.org/abs/2610.37314
作者：Sanjana Islam Kasfia,Md. Ismiel Hossen Abir,AKM Bahalul Haque,Abir Mahmud Shahariar
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：life threatening forms, cancer worldwide, prevalent and life, life threatening, threatening forms
备注：
点击查看摘要
Abstract:Skin cancer is among the most prevalent and life threatening forms of cancer worldwide. Early and accurate diagnosis significantly improves patient survival rates. However, manual dermoscopic assessment remains challenging due to visual similarity. This study proposes an Explainable AI-driven framework for automated binary classification of skin lesions using a lightweight attention-based convolutional neural network (CNN-Attention). The model integrates channel attention to focus on informative regions of dermoscopic images while maintaining low computational complexity. A publicly available dataset comprising 2,637 training and 660 test images was used, with balanced class weights. The proposed model achieved 87 percent accuracy with 1.95 million parameters and 7.45 MB of storage, matching the best baseline (MobileNet) while using approximately half as many parameters and half as much storage. ROC AUC and PR AUC scores reached 0.9475 and 0.9430, respectively. Additionally, saliency maps were incorporated as an explainability technique to visualize regions that influence model decisions. Comparative analysis with VGG16,VGG19,ResNet101,and MobileNet demonstrates the proposed models effectiveness in balancing classification results, computational efficiency, and interpretability.
29. 【2610.37309】MvT: Event-based Multi-view Projection for Multiple Object Tracking
链接：https://arxiv.org/abs/2610.37309
作者：Muxi Zha,Banglei Guan,Minzu Liang,Zibin Liu,Yang Shang,Qifeng Yu,Laurent Kneip
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multiple Object Tracking, requires specialized methods, asynchronous event output, Multiple Object, cameras are increasingly
备注： 16 pages, 20 figures, published to IEEE T-IP
点击查看摘要
Abstract:Event cameras are increasingly used for Multiple Object Tracking (MOT), but their asynchronous event output often requires specialized methods. Existing processing methods primarily follow two paradigms, pseudo-frames and event-by-event. The former is the prevailing approach since its data format aligns with images, making image-based techniques applicable. However, it suffers from tracking failures when trajectories overlap or are spatially close on pseudo-frames. Facing this challenge, we propose a multi-view pipeline, Multi-view Tracking (MvT), which preserves the 2D data format to leverage image-based techniques directly while introducing additional spatio-temporal views to resolve tracking ambiguities in a single view. MvT comprises a Multi-view Projection (MvP) module and a Multi-view Fusion (MvF) stage. MvP encodes events into three complementary spatio-temporal views while mitigating the pattern discretization. Within MvF, multi-view results are unified into a 3D coordinate system, and tracklets are associated through an optimization model subject to specific criteria combination. Evaluations on four datasets, including our self-collected Small Objects Dataset (SOD), show that MvT seamlessly integrates image-based methods and outperforms existing non-learning and learning trackers in generalized scenarios, and effectively resolves the single-view tracking ambiguities. Being training-free, MvT is applicable when ground-truth annotation is infeasible, thereby highlighting its practical, data-efficient potential. Code is available at this https URL.
30. 【2610.37297】RUCO: A Scalable Lock-Free Algorithm for Parallel Contour Extraction
链接：https://arxiv.org/abs/2610.37297
作者：Rafael Munoz-Salinas,Francisco J.Romero-Ramirez,Manuel J. Marin-Jimenez
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Transforming binary masks, Transforming binary, high-resolution segmentation outputs, post-processing high-resolution segmentation, segmentation outputs
备注：
点击查看摘要
Abstract:Transforming binary masks into geometric contours remains a critical step in many computer vision pipelines, particularly for post-processing high-resolution segmentation outputs. Yet, standard algorithms such as the Suzuki-Abe method are limited by their sequential nature and the overhead of building topological hierarchies. As modern applications transition to high-resolution imaging, there is a critical need for contour extraction that leverages multi-core CPU architectures without the complexity of tile stitching or heavy synchronization. This paper presents TRUCO (Threaded Raster Unrestricted Contour Ownership), a lock-free parallel algorithm designed for high-performance geometric boundary extraction. TRUCO introduces a start-point ownership rule, combined with a speculative tracing model, in which threads trace contours downward into adjacent regions and use an upward-termination logic to ensure each contour is processed exactly once. Experimental results on synthetic and real-world datasets, conducted on both consumer and server-grade CPUs, demonstrate that TRUCO significantly outperforms existing baselines. The method achieves speedups of over an order of magnitude compared to the industry standard while maintaining robust scalability on high-resolution scenes across diverse hardware architectures.
Subjects:
Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2610.37297 [cs.CV]
(or
arXiv:2610.37297v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.37297
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
31. 【2610.37290】aming Noise Initialization for Zero-shot Video Restoration with Image Diffusion Priors
链接：https://arxiv.org/abs/2610.37290
作者：Chong Wang,Zixuan Fu,Hao Cheng,Siyuan Yang,Alex C. Kot,Bihan Wen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, achieved remarkable success, restoring high-quality images, achieved remarkable, restoring high-quality
备注： IEEE Transactions on Multimedia
点击查看摘要
Abstract:Recent advances in diffusion models have achieved remarkable success in restoring high-quality images in a zero-shot manner. Unfortunately, extending this success to video restoration is challenging due to the substantial computational resources required to pre-train video diffusion models. A rising trend seeks to address video restoration by utilizing a pre-trained image diffusion model, initiating restoration from either frame-wise independent or identical Gaussian noise. Yet, these approaches often fall short, as such simple noise initiations fail to capture and utilize the inherent temporal correlations within degraded video frames. In this work, we propose taming noise initialization for zero-shot video restoration, which preserves the intrinsic temporal correlations by generating initial noises directly using DDIM inversion on the corrupted video frames themselves. Building on this, we introduce an adaptive noise blending strategy that suppresses degradation patterns encoded during DDIM inversion while gradually steering the noise toward a Gaussian distribution. To further emphasize temporal consistency, we propose measurement-guided trajectory attention to better align features across frames. Extensive experiments on multiple video restoration tasks demonstrate that our method outperforms existing zero-shot approaches, consistently achieving superior results on the DAVIS, REDS4, and Set8 datasets.
32. 【2610.37267】GradCO: Behavior-Aware Gradient-Conflict Offloading for Text-Based Person Anomaly Search
链接：https://arxiv.org/abs/2610.37267
作者：Zhiheng Fu,Zixu Li,Zhiwei Chen,Jiale Huang,Fangxu Liu,Jinhe Bi,Yupeng Hu
类目：Computer Vision and Pattern Recognition (cs.CV); Information Retrieval (cs.IR)
关键词：Person Anomaly Search, Text-based Person Anomaly, Anomaly Search, Person Anomaly, Text-based Person
备注：
点击查看摘要
Abstract:Text-based Person Anomaly Search (TPAS) retrieves a target pedestrian using natural-language descriptions of appearance and normal or anomalous behavior. Unlike conventional text-based person retrieval, TPAS must preserve identity cues while distinguishing fine-grained behaviors. It presents two challenges: same-identity, different-behavior hard negatives cause gradient conflict during granular alignment, while strong appearance cues can obscure weak behavioral evidence during aggregation. We propose GradCO (behavior-aware Gradient-Conflict Offloading), comprising three complementary components. Behavior-Aware Mixture-of-Experts (B-MoE) forms appearance, normal-behavior, and anomalous-behavior streams whose roles are learned from retrieval objectives without expert-specific semantic labels. Conflict Offload Learning (COL) uses pair-conditioned offload anchors in similarity computation to reduce the conflicting-gradient burden on the main text representations. Hierarchical Intent Alignment (HIA) aggregates expert similarities and features using query-conditioned weights. Experiments on five TPAS/TIPR benchmarks show GradCO significantly surpasses SOTA methods and validate our design.
33. 【2610.37257】GameVerse: A Minute-Scale Gameplay Dataset for Long-Horizon Interactive World Modeling
链接：https://arxiv.org/abs/2610.37257
作者：Kang He,Wenshuo Peng,Chuanhao Li,Zihui Gao,Xiaojie Xu,Zhengyuan Lin,Yuzhe Ding,Donghong Ji,Kaipeng Zhang,Yongtao Ge
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Recent advances, action inputs, environments from action, interactive world models, Recent
备注： Accepted by NeurIPS 2026
点击查看摘要
Abstract:Recent advances in interactive world models have made it possible to generate controllable, dynamic environments from action inputs. Yet current models struggle to maintain coherence beyond roughly one minute of rollout, a limitation rooted not in model capacity but in the scarcity of long-horizon training data. Existing gameplay video datasets typically consist of clips under ten seconds, with captions that describe whole clips in coarse and undifferentiated text, which is insufficient for controllable long-horizon generation. We address this with GameVerse, a minute-scale gameplay video dataset purpose-built for long-horizon interactive world modeling. GameVerse contains 69.7K clips spanning 1,655 hours and 349.6 million frames across diverse first- and third-person gameplay, including 1,358 hours of continuous two-minute sequences, an order of magnitude longer than prior datasets. Clips pass through a unified pipeline of scene-consistent segmentation, quality filtering, camera pose estimation, and event-based caption annotation. Each clip is paired with a temporally stable camera trajectory that remains coherent across minutes, together with captions that separate static scene context from dynamic foreground events and align to event boundaries rather than fixed time windows. Comprehensive analysis shows that GameVerse surpasses existing public datasets in scale, diversity, and annotation quality. Experiments further demonstrate that training on GameVerse substantially extends the temporal horizon of interactive world models.
34. 【2610.37236】HDVS: semi-supervised semantic segmentation via heterogeneous dual-branch voting supervision
链接：https://arxiv.org/abs/2610.37236
作者：Yongqi Shan,Yunzhi Zhuge,Huchuan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Semi-supervised semantic segmentation, achieve accurate segmentation, accurate segmentation results, fewer human annotations, attracted increasing attention
备注： 16 pages, 9 figures, 7 tables. Published in Visual Intelligence
点击查看摘要
Abstract:Semi-supervised semantic segmentation, which aims to utilize large volumes of unlabeled images to achieve accurate segmentation results with fewer human annotations, has attracted increasing attention. Prior methods were primarily based on the assumption that the pseudo-labels generated by each branch were sufficiently reliable to supervise the remaining branches. However, there is a concern that the errors in pseudo-labels could accumulate during co-training, potentially resulting in suboptimal performance. To this end, we present a novel framework called heterogeneous dual-branch voting supervision (HDVS), which is designed to enhance the reliability of pseudo-labels and mitigate the issues arising from pseudo-labeling. Specifically, based on the cross-supervision framework, we introduce a voting mechanism that correlates pseudo-labels from heterogeneous branches to produce pseudo-labels with enhanced reliability. Concurrently, we employ a feature communication module to introduce perturbations at the feature level in each branch to maximize prediction diversity across the dual branches while maintaining convergence. Comprehensive evaluations of the proposed HDVS on two benchmark datasets (PASCAL VOC 2012 and Cityscapes) demonstrate its superiority to the state-of-the-art approaches.
35. 【2610.37226】Subspace Clifford Networks
链接：https://arxiv.org/abs/2610.37226
作者：Zhongping Ji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：replaces global cyclic, global cyclic rolling, propose Subspace Clifford, Subspace Clifford Networks, reformulation that replaces
备注： 12 pages
点击查看摘要
Abstract:In this work, we propose Subspace Clifford Networks, a reformulation that replaces global cyclic rolling with grouped subspace interactions. Instead of sampling sparse cyclic diagonals across the entire $D$-dimensional channel space, we project the features into an aligned space $\R^{\tilde{D}} = \bigoplus_{g=1}^{G} V_g$ partitioned into $G$ low-dimensional groups $V_g \cong \R^k$ with $k \in \{2, 3, 4\}$. Within each $k$-dimensional group, we compute all $\binom{k}{2}$ wedge coordinates and concatenate them with $\operatorname{SiLU}$-activated coordinate-wise products, while sandwiching the grouped interaction between learnable $1\times 1$ linear projections to enable cross-group channel mixing. This design reduces intermediate feature expansion from $2|\mathcal{S}|D$ (typically $10D$ for 5 shifts) down to $1.5\tilde{D}$ ($k=2$), $2.0\tilde{D}$ ($k=3$), or $2.5\tilde{D}$ ($k=4$). Furthermore, exploiting the small, fixed group size $k \in \{2, 3, 4\}$, we implement a fused CUDA kernel that evaluates the forward interaction and a recomputation-based analytical backward pass using thread-local variables without allocating global-memory buffers for elementwise intermediates. Finally, we extend the backbone from an isotropic columnar layout to a multi-resolution Hierarchical Clifford Network with configurable per-stage subspace dimensions. Experiments on CIFAR-100 show that the proposed models substantially reduce parameter count and training time across both regimes, while the hierarchical variants also improve classification accuracy over the evaluated shift-based hierarchical baselines.
36. 【2610.37219】Vision-Language-Action or World-Action? Just Action Models
链接：https://arxiv.org/abs/2610.37219
作者：Yonghao Yu,Lang Huang,Runyi Li,Toshihiko Yamasaki
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：inherit pretrained knowledge, communities debate, world-action model, JAM, visual generators
备注：
点击查看摘要
Abstract:The vision-language-action (VLA) and world-action model (WAM) communities debate whether control policies should inherit pretrained knowledge from vision-language models or from visual generators. The debate, however, bundles three separable choices: backbone initialization, the objective applied to future observations, and whether the machinery for that future loss is kept at inference. A gap between a VLA and a WAM therefore cannot simply be attributed to any one of them. We show that decoupling these choices yields a common framework for both families, which we term Just Action Model (JAM): a pretrained visual backbone with an action expert, trained with an action loss and a foresight loss. The foresight loss trains current-observation features to predict frozen encodings of the recorded future through a prediction head discarded after training, so no visual generation is involved in either training or inference, and the backbone can be chosen freely. We first compare objectives within fixed policy architectures, then evaluate the foresight recipe across backbone families. The resulting JAM policies outperform their matched FastWAM and ImageWAM counterparts on LIBERO and LIBERO-Plus, and achieve similar or slightly higher success rates on RoboTwin. Compared with FastWAM, JAM improves the success rates from 97.0%/55.3%/91.2% to 98.2%/64.5%/91.4%, respectively. With cached foresight targets, JAM reduces estimated online training FLOPs per sample per update by 73% relative to FastWAM. Our results show that future supervision improves control without visual generation or additional inference machinery, and strong foresight performance is attainable with either generator-initialized or vision-language backbones. Project Page: this https URL
37. 【2610.37218】opoField: Technical Report for ECCV 2026 SceneFun3D Challenge
链接：https://arxiv.org/abs/2610.37218
作者：Zhiwei Chen,Zhiheng Fu,Zixu Li,Mingyu Zhang,Jiale Huang,Yupeng Hu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Functional segmentation requires, small interactive parts, segmentation requires locating, requires locating small, locating small interactive
备注： Technical Report for ECCV OpenSUN3D Workshop SceneFun3D Benchmark Challenge
点击查看摘要
Abstract:Functional segmentation requires locating small interactive parts, such as knobs, buttons, and sockets, in indoor point clouds and returning confidence-ranked instance masks. A point-wise semantic predictor produces a continuous probability field, whereas the benchmark evaluates a discrete set of scored instances. This creates a substantial field-to-instance gap. We present TopoField, a deterministic decoder built on top of VOLT. TopoField first converts 13 test-time forward passes into a semantic consensus field, then decodes instance candidates from the consensus geometry, and finally ranks the candidates in a class-aware manner. The augmentation stage retains the processed-point identity of every fragment prediction, accumulates probabilities in a common point array, normalizes by coverage count, and fuses the resulting caches. The decoding stage separates high-confidence cores from broader support regions, constructs a symmetric radius-pruned point graph, and uses a multi-source graph-geodesic partition to split support regions that contain multiple seeds. On 561 ground-truth instances across 30 validation scenes, an IoU-0.5-valid candidate exists for 67.2% of instances, and top-1 coverage is 20.0%. These complementary measurements motivate joint attention to candidate construction and ranking. TopoField achieves 28.286% AP, 41.383% AP50, and 47.558% AP25. TopoField achieved second place on the ECCV 2026 SceneFun3D Challenge.
38. 【2610.37216】Zhengrong-Spatial-Aware 1.0: Advancing 3D Multimodal Intelligence
链接：https://arxiv.org/abs/2610.37216
作者：Yu Zhang,Xiaogang Wang,Yuhang Cheng,Jingrui Li,Wenbo Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：visual question answering, visual question, report presents, presents the implementation, implementation and validation
备注： 6 pages, 3 figures, 4 tables. Technical report
点击查看摘要
Abstract:This report presents the implementation and validation of two end-to-end multimodal adaptation pipelines for 3D-aware visual question answering on a custom spatial dataset. The first pipeline fine-tunes HiSpatial-3B, which augments RGB observations with metric-scale 3D point maps; the second adapts Qwen3-VL through memory-efficient QLoRA-based supervised fine-tuning. The completed engineering stack covers dataset conversion, image-annotation alignment, monocular geometry preprocessing, instruction construction, mixed-domain training, checkpoint management, batch inference, and automated evaluation. On the target spatial benchmark, HiSpatial adaptation increases overall accuracy from 1.73% before fine-tuning to 79.89% at 3,600 steps. On a separately collected styled split, accuracy improves from 14.9% to 55.1%, indicating transfer beyond the original training set. The Qwen3-VL pipeline is likewise implemented end-to-end for both 8B- and 32B-scale models using mixed-domain QLoRA adaptation. The resulting accuracy improves from 20.74% to 45.27% for Qwen3-VL-8B and from 30.79% to 47.60% for Qwen3-VL-32B. Together, these results establish two complementary and reproducible adaptation pipelines for geometry-aware and general-purpose multimodal spatial reasoning. These results establish a reproducible engineering foundation for subsequent work on metric 3D reasoning, spatial grounding, and domain-adapted multimodal systems, while also identifying training-data composition as a central factor in preserving general multimodal capability during specialization.
39. 【2610.37211】Uncovering Shortcut Amplification in Video RLVR through the Lens of Perceptual Uncertainty Collapse
链接：https://arxiv.org/abs/2610.37211
作者：Jiafeng Liang,Xianhao Ou,Tao Ren,Rongchuan Mu,Runxuan Liu,Dandan Tu,Ming Liu,See-Kiong Ng,Bing Qin
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Large Multimodal Models, Large Multimodal, effective post-training paradigm, Reinforcement learning, capability of Large
备注：
点击查看摘要
Abstract:Reinforcement learning with verifiable rewards (RLVR) has emerged as an effective post-training paradigm for enhancing the video reasoning capability of Large Multimodal Models (LMMs). Despite its empirical effectiveness, we show that outcome-level optimization can introduce an undesirable shortcut amplification effect, whereby models increasingly favor text-prior answers even when they are not supported by the visual evidence. To characterize this behavior, we investigate the training dynamics of video RLVR through the lens of perceptual uncertainty, analyzing how predictive uncertainty evolves under video-conditioned and text-only contexts. Our analysis identifies a perceptual uncertainty collapse phenomenon, in which RL training continuously sharpens the model's answer distribution while the uncertainty reduction attributable to visual evidence progressively diminishes. A further gradient-direction analysis reveals that such confidence enhancement becomes increasingly less aligned with visually grounded uncertainty reduction and is instead dominated by text-prior compression. Motivated by these findings, we propose Bifocal Self-distillation Policy Optimization (BSPO), a self-distillation framework that regulates policy updates with two complementary distributional signals. Specifically, BSPO derives empirical reasoning principles from intra-group correct and incorrect rollouts to identify reasoning-sensitive tokens, and introduces shortcut-aware visual perturbation to penalize predictions that remain invariant when task-relevant visual evidence is weakened. By adaptively reweighting the original RL advantage, BSPO preserves the task-solving benefits of RLVR while promoting updates that are both reasoning-sensitive and visually grounded. Extensive experiments validate the effectiveness of BSPO in improving video reasoning performance and strengthening visual faithfulness.
40. 【2610.37202】3D-SceneQ: Empowering 3D LLM With Query-Guided Adaptive Pruning and Multi-Modal Feature Enhancement
链接：https://arxiv.org/abs/2610.37202
作者：Yongqi Shan,Lu Zhang,Jiazuo Yu,Yunzhi Zhuge,Huchuan Lu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：pipelines typically concatenate, typically concatenate vast, concatenate vast numbers, understanding pipelines typically, Large Language Model
备注： 13 pages, 8 figures, 8 tables. Published in IEEE Transactions on Multimedia
点击查看摘要
Abstract:Current 3D scene understanding pipelines typically concatenate vast numbers of 3D object tokens with text tokens and feed the resulting sequence to a Large Language Model (LLM). However, existing 3D-LLMs for scene understanding encounter two major limitations: (i) excessive inclusion of task-irrelevant object data, introducing noise that reduces reasoning accuracy and increases hallucinations; and (ii) reliance solely on point cloud data, which inherently lacks the rich semantic information available in complementary 2D modalities, such as color, material properties, texture, and high-level contextual relationships. To address these challenges, we introduce 3D-SceneQ, a 3D LLM that unifies adaptive token pruning with multimodal semantic enrichment, markedly advancing scene understanding, reasoning, and grounding. Specifically, we propose a Query-Guided Adaptive Pruning (QGAP) module that adaptively selects task-relevant objects based on the intended meaning of user instructions, leveraging a learnable latent query to retain critical information while effectively suppressing irrelevant noise. In addition, we introduce a Multi-modal Object-level Feature Enhancement (MOFE) module, which integrates 2D feature embeddings from pre-trained models into 3D representation to enrich object-level semantic information. Evaluations show that 3D-SceneQ outperforms current state-of-the-art methods across multiple benchmarks (e.g., +5.7 CIDEr on Scan2Cap and +17.0 EM@1 on SQA3D), demonstrating its remarkable capabilities in various 3D language reasoning tasks.
41. 【2610.37196】How Much Can Best-of-N Help a World Action Model? Measuring Selectable Headroom and Realizing It in Closed Loop
链接：https://arxiv.org/abs/2610.37196
作者：Haojia Gao,Yue Cao,Yumin Liu,Haohua Que,Mingkai Liu,Guanqiu Guo,Zhuo Zou,Bokui Chen,Xueqian Wang
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：World action models, makes test-time selection, World action, visual consequences, makes test-time
备注： 24 pages, 12 figures, 14 tables
点击查看摘要
Abstract:World action models (WAMs) predict the visual consequences of the actions they generate, which makes test-time selection a natural way to improve a fixed policy: imagine the futures of candidate actions and execute the best one. The benefit of selection is bounded by the selectable headroom, how much better the best candidate truly is, but the standard estimate, which executes each candidate once and keeps the best outcome, conflates candidate quality with the randomness of everything that follows. We introduce a denoised counterfactual protocol, based on bitwise-reproducible branching, repeated continuations, held-out oracles, and common random numbers, that measures the headroom a selector can realize, and use its measurements to build a fail-gated selector. Across four WAMs, two benchmarks, over 100,000 branched rollouts, and pre-registered tests, we find that (i) the standard estimate overstates the selectable headroom of native samples: bounds from 17 continuations per candidate place its selectable share between 24% and 66% for three WAMs; (ii) structured action perturbations create up to 16 points of selectable headroom; and (iii) in both WAMs with action-conditioned imagination, imagined futures carry candidate-outcome information with no detectable loss relative to real futures, information that the value head of Cosmos Policy leaves unused. Deviating from the policy chunk only when a readout of the WAM predicts failure, the selector raises closed-loop task success from 76.9% to 81.6% on held-out episodes of training tasks, with the largest gain where the policy fails most often, and from 62.6% to 69.8% on unseen tasks.
42. 【2610.37186】VGIQA: Fine-Grained Image Quality Assessment with Visual Grounding Rewards
链接：https://arxiv.org/abs/2610.37186
作者：Weichang Wang,Liyu Chen,Shuyue Guan,Jie Hu,Fei Gao,Wei Li,Nannan Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-modal Large Language, perceptual visual quality, Large Language Models, aims to evaluate, evaluate the perceptual
备注： 20 pages, 5 figures, 6 tables; main paper: 4 figures and 4 tables, appendix: 1 figure and 2 tables
点击查看摘要
Abstract:Image quality assessment (IQA) aims to evaluate the perceptual visual quality of images. Recently, the rapid development of Multi-modal Large Language Models (MLLMs) has significantly advanced the IQA field. By integrating chain-of-thought (CoT) reasoning and reinforcement learning (RL), these models can generate more accurate and interpretable results while relying on less training data. However, existing MLLM-based methods are predominantly constrained to holistic, image-level evaluations and lack the capability to produce fine-grained, localized assessments, which substantially limits their practical applicability. To address this limitation, we propose VGIQA, a novel IQA model endowed with both local and global quality assessment capabilities. VGIQA is trained via a two-stage paradigm comprising a cold-start phase followed by reinforcement learning. Driven by carefully designed local quality assessment reward functions, our model exhibits exceptional image quality understanding on VGSR-2K, a new dataset we propose specifically for local quality evaluation, significantly outperforming existing open-source MLLMs such as Qwen2.5-VL-72B-Instruct and Qwen3-VL-32B-Instruct. Furthermore, the local quality evaluation task can effectively enhance the model's performance on the degradation perception task.
43. 【2610.37178】INTR++: INterpretable TRansformer with better Accuracy, Interpretability, and Adaptability
链接：https://arxiv.org/abs/2610.37178
作者：Dipanjyoti Paul,Arpita Chowdhury,Maneet Chatterjee,Daichi Kitaguchi,Tanya Berger-Wolf,Tetsuya Sakurai,Wei-Lun Chao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Interpretable Transformers, domain specific settings, specific settings, settings but lose, lose effectiveness
备注： Accepted at the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV 2027)
点击查看摘要
Abstract:Interpretable Transformers often perform well in domain specific settings but lose effectiveness beyond that. Achieving ViT-like broad applicability requires models with consistent performance across domains. Recent works on Interpretable Transformers, INTR and Prompt-CAM, were developed keeping domain adaptability in mind. Prompt-CAM leverages learnable prompts to promote adaptability. However, these prompts are fixed in nature and therefore struggle to adapt to domains with substantial variation in input image characteristics, resulting in reduced interpretability. To address this limitation, we propose INTR++, which extends Prompt-CAM by incorporating a lightweight Prompt Adapter Module (PAM). PAM enables prompts to be adaptive by enriching them with domain-specific knowledge, thereby ensuring consistent interpretability across diverse domains including those with varying image characteristics such as medical imaging, micro-scopic imaging, and remote sensing imagery. INTR++ retains the standard architecture and end-to-end learning of Interpretable Transformer based models, while adding only a small number of additional parameters compared to Prompt-CAM. We demonstrate that INTR++ delivers consistent improvements in all aspects across domains like animals, plants, medical imaging, microscopic imaging, remote sensing imagery and object-centric data.
44. 【2610.37153】FastBEVFusion: Simple Multi-Modal Fusion for 3D Object Detection at 50 FPS
链接：https://arxiv.org/abs/2610.37153
作者：Tom Sanitz,Emre Gülsoylu,Simone Frintrop,Christian Wilms
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：Reliable real-time, BEV spaces, object detection, autonomous driving, minimal latency
备注： Accepted at Iberian Robotics Conference (ROBOT2026)
点击查看摘要
Abstract:Reliable real-time 3D object detection based on LiDAR and camera data is critical for safety in autonomous driving, where systems must accurately perceive their surroundings with minimal latency. Many state-of-the-art systems achieve high-quality detection results but fail to meet real-time constraints, limiting their practical use. To address this challenge, we propose FastBEVFusion, a simple, fast, and robust fusion system for 3D object detection. Based on modality-specific features, FastBEVFusion projects these features into semi-aligned modality-specific BEV spaces, without relying on a computationally intensive and potentially error-prone depth estimation. Given these BEV spaces, we propose a light-weight, soft, and dynamic fusion module based on cross-attention, which adapts dynamically to the scene context and enables feature fusion across the entire BEV spaces. Experiments on the complex nuScenes dataset show that FastBEVFusion outperforms state-of-the-art real-time systems, and achieves over 50 FPS without deployment libraries. Additionally, our system shows strong robustness to calibration errors, making FastBEVFusion a powerful 3D object detection system for real-world applications.
45. 【2610.37149】GCSR-OCC: Geometry Calibration and Semantic Routing for Open-Vocabulary Occupancy Prediction
链接：https://arxiv.org/abs/2610.37149
作者：Bohua Wang,Congyang Zhao,Tianxiong Lv,Chenxu Zhao,He Zheng,Hangqi Fan,Leigang Luo,Zhihao Liao,Yihong Guo,Yang Cai
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：unified voxel grid, prediction represents scene, represents scene geometry, occupancy prediction represents, enabling recognition
备注：
点击查看摘要
Abstract:Open-vocabulary 3D occupancy prediction represents scene geometry and semantics in a unified voxel grid, enabling recognition beyond predefined categories. One approach reconstructs scenes with 3D Gaussians and converts them into voxel occupancy. However, Gaussian scale inflation and excessive overlap can distort voxel occupancy predictions, while semantic mixing can arise within Gaussians spanning multiple categories and during 3D--2D semantic feature alignment. We propose GCSR-OCC, which combines geometry calibration and multi-mode query-conditioned semantic routing for indoor occupancy prediction from a single RGB image. The Evidence-Conserving Gaussian-to-Occupancy operator (EC-G2O) uses kernel mass normalization, $p$-norm aggregation, and a learnable gain to suppress scale inflation and excessive local evidence accumulation while calibrating occupancy responses. Multi-mode Query-First Gaussian Semantic Routing (MM-QGSR) matches multiple semantic modes per Gaussian to text queries and aggregates query-specific evidence into voxels through a learnable text-conditioned router. Fine-grained subclass queries and smoothed semantic aggregation further refine voxel-level predictions. Without 3D semantic annotations, GCSR-OCC achieves state-of-the-art performance in open-vocabulary occupancy prediction on Occ-ScanNet, with 63.31% geometric IoU and 27.44% semantic mIoU. It also reduces geometric aggregation latency from 19.76 ms to 12.88 ms. Our code will be made publicly available.
46. 【2610.37138】MixSIS: Mixed-supervised instance segmentation
链接：https://arxiv.org/abs/2610.37138
作者：Christian Wilms,Emre Gülsoylu,Sven Schreiber,Simone Frintrop
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Weakly-supervised instance segmentation, Weakly-supervised instance, instance segmentation, fully-supervised instance segmentation, Mixed-Supervised Instance Segmentation
备注： Accepted at BMVC 2026. Code available at [this https URL](https://github.com/chwilms/MixSIS)
点击查看摘要
Abstract:Weakly-supervised instance segmentation (WSIS) based on either box-, point-, or image-level annotations has been proposed to overcome the labor-intensive annotation process in fully-supervised instance segmentation. Despite decent results, most WSIS methods only focus on a single annotation level, ignoring that some objects are easy to spot from point annotations, while others require box or even mask annotations. Therefore, we propose the Mixed-Supervised Instance Segmentation (MixSIS) task, which allows a flexible mix of annotation levels (image, point, box, and mask) within a dataset. MixSIS has a high practical relevance, as it allows optimizing the annotation process by annotating challenging objects in more detail, while saving time on simpler instances with less detailed annotations. To address MixSIS, we propose AnnotationsMixer (AnnsMixer) as a baseline. AnnsMixer is a truly mixed-supervised instance segmentation system, which generates pseudo mask annotations from all annotation levels, even mixed within a single image. We evaluate AnnsMixer on both WSIS and MixSIS tasks, largely outperforming state-of-the-art methods. In three case studies, we also demonstrate how the unique features of MixSIS and AnnsMixer can substantially reduce the annotation time (-90%) or improve the results (+34%) in instance segmentation with a simple annotation rule or leveraging heterogeneous data. Our code is available at this https URL
47. 【2610.37135】Physics Guided Diffusion Model Based Exposure Interpolation for High Dynamic Range Imaging
链接：https://arxiv.org/abs/2610.37135
作者：Zhengguo Li,Chaobing Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：popular multi-shot based, Ghosting artifacts, dynamic range, standard dynamic range, exposure interpolation algorithm
备注： 11 pages, 6 figures
点击查看摘要
Abstract:Ghosting artifacts are an open problem for popular multi-shot based high dynamic range (HDR) imaging. An effective solution is to capture two large-exposure-ratio (LER) standard dynamic range (SDR) images simultaneously via a single-shot. Brightness order reversal (BOR) artifacts are generated when the two LER images are directly fused together. It is crucial to interpolate an image with an exposure time in between the exposure times of two LER images. In this paper, a novel physics-guided diffusion model based exposure interpolation algorithm is proposed to address the BOR artifacts. An initial image is interpolated by a physics-driven component, and the residual high-frequency details are generated by a new diffusion model based component. The new diffusion model is based on the correlation analysis of generative models and includes a new predicted target to reduce the variation of the Pearson correlation between the noisy data and the target, as well as the amplification factor of the fitting error. Compared with existing neural augmented exposure interpolation algorithms on top of convolution neural networks, the proposed exposure interpolation algorithm has an inherent advantage to generate more high frequency information. Experiment results validate the proposed exposure interpolation algorithm.
48. 【2610.37134】MRI-to-CT Translation of Spinal Images via Anatomy-Guided Pseudo-Pairing and Adversarial Diffusion
链接：https://arxiv.org/abs/2610.37134
作者：Eduardo Nieto,Ibai Genua,Davide Scorza,Karen López-Linares
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Magnetic Resonance Imaging, requires Computed Tomography, Magnetic Resonance, Resonance Imaging, Computed Tomography
备注：
点击查看摘要
Abstract:Magnetic Resonance Imaging (MRI) is routinely used to diagnose spinal disorders, but surgical planning often requires Computed Tomography (CT) for better visualization of vertebral bone anatomy. Synthesizing CT from MRI could avoid additional radiation exposure and streamline preoperative assessment. We propose a three-stage framework for spine MRI-to-CT synthesis. First, an anatomy-guided vertebral matching system identifies similar sagittal MRI and CT slices using spine segmentations and aligns them through rigid registration, creating pseudo-paired data from unpaired scans. Second, these pairs train an adversarial diffusion model for MRI-to-CT translation. Third, synthesized slices are assembled into 3D volumes and refined by a network that improves inter-slice continuity and structural coherence. The framework was trained on over 10,000 unpaired sagittal MRI and CT slices and evaluated on 1,911 slices from 83 MRI volumes spanning all spinal regions. Assessment combined distribution-based measures with vertebral segmentation metrics. Compared with diffusion alone, the proposed approach increased binary 3D vertebral Dice from 0.666 to 0.739. Volumetric post-processing reduced visible discontinuities between stacked slices and improved vertebral coherence in axial and coronal views. Combining anatomy-guided pseudo-pairing, adversarial diffusion and 3D refinement improves spine MRI-to-CT synthesis. Vertebral matching primarily enhanced anatomical alignment and fidelity, while volumetric refinement improved 3D consistency. These findings support further development of MRI-derived CT-like visualization for preoperative planning, particularly to preserve fine intensity details while maintaining volumetric coherence.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
Cite as:
arXiv:2610.37134 [cs.CV]
(or
arXiv:2610.37134v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.37134
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Karen López-Linares Román [view email] [v1]
Tue, 27 Oct 2026 12:32:47 UTC (10,716 KB)
49. 【2610.37127】MCP-Net: Real-Time Coronary Perception Network and Topological Analysis for Robotic Guidewire Navigation
链接：https://arxiv.org/abs/2610.37127
作者：Sahar Nasirihaghighi,Tianyuan Wang,Kenan Niu,Stefano Stramigioli
类目：Computer Vision and Pattern Recognition (cs.CV); Robotics (cs.RO)
关键词：two-dimensional X-ray fluoroscopy, two-dimensional X-ray, intervention requires continuous, requires continuous interpretation, percutaneous coronary intervention
备注：
点击查看摘要
Abstract:Coronary guidewire navigation during percutaneous coronary intervention requires continuous interpretation of vessel anatomy, guidewire position, and target stenosis under two-dimensional X-ray fluoroscopy. While existing approaches commonly address vessel segmentation or device localization as separate tasks, a robotic system requires a more structured perception of the coronary scene to support downstream navigation. In this work, we present a simulation-driven framework centered on a Multi-Task Coronary Perception Network (MCP-Net) for robotic guidewire navigation, integrating coronary vessel segmentation, vascular topology extraction, and roadmap generation. Starting from three-dimensional coronary CT angiography, we generate simulated fluoroscopy images containing vascular structures, simulated guidewires, stenotic lesions with varying severity, and diverse vascular geometries, together with simulation-derived ground truth. MCP-Net jointly performs coronary vessel segmentation, guidewire-tip localization, and stenosis localization from a single fluoroscopic frame. These predictions are subsequently converted into a structured vascular graph containing centerlines, bifurcations, endpoints, branch directions, and branch angles. By associating the predicted stenosis with this graph, the framework generates a roadmap from the automatically selected graph root toward the target lesion. The results demonstrate that the proposed framework can jointly recover coronary perception targets and transform them into an interpretable vascular representation suitable for downstream robotic navigation.
50. 【2610.37118】Multibranch Ensemble Head in Vision Foundation Models for Efficient Cucumber Phenological Stage Classification
链接：https://arxiv.org/abs/2610.37118
作者：Kostiantyn Khabarlak
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Vision Foundation Models, provide highly transferable, highly transferable features, Vision Foundation, Foundation Models
备注：
点击查看摘要
Abstract:Vision Foundation Models (VFMs) pretrained with self-supervised learning, such as DINOv2, provide highly transferable features, yet adapting them to small, domain-shifted datasets is still challenging. We propose a regularizing multibranch ensemble head: a training and inference scheme that pairs low- and high-capacity branches, samples a single branch stochastically at each training step, and averages both branches in probability space at inference. The design adds negligible parameters and essentially no inference overhead over a single heavy head, while improving the accuracy-efficiency trade-off under data-scarce conditions. Accurate classification of plant growth stages is critical for precision agriculture, enabling timely decisions on fertilization, irrigation, and harvesting. Therefore, as a challenging practical case we use cucumber phenological stage classification, in which flowers and fruits are frequently occluded by foliage, and stage transitions manifest primarily as subtle changes in leaf morphology. The NALEF Food Safety dataset contains images of five cucumber growth stages captured under diverse real-world conditions. On it we evaluate a broad range of backbones, including DINOv2 and DINOv3 ViT and ConvNeXt variants, against strongly supervised counterparts (ResNet, EfficientNet, ViT). The proposed DINOv2 ViT-S with multibranch head achieves a Macro F1 of 0.978 and Cohen's Kappa of 0.971, matching the performance of models more than ten times larger in parameters and GFlops, while requiring only 12.2 GFlops and 22.3M parameters, making it deployable on smartphones and edge devices for phenological stage classification.
51. 【2610.37110】A First-Step Bias Restores Lost Diversity in Diffusion Model Distillation
链接：https://arxiv.org/abs/2610.37110
作者：Wenwu Tang,Dong Wang,Yun Cheng,Olga Saukh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Distribution-matching distillation enables, distillation enables high-quality, Distribution-matching distillation, enables high-quality image, high-quality image generation
备注：
点击查看摘要
Abstract:Distribution-matching distillation enables high-quality image generation in only a few denoising steps. However, distilled student models often map different initial noise samples to similar outputs under the same prompt. To locate where diversity is lost, we compare the teacher and student along the sampling trajectory. The largest measured reduction in the response to different initial noises occurs during the first, high-noise step. When we replace the first step with the teacher's corresponding trajectory and leave the final three student steps unchanged, most of the output diversity returns. This suggests that the first step is a key point for restoring diversity. Motivated by this finding, we introduce \emph{ReSeed}, a post-distillation method that adds a seed-response bias adapter only to the first student step and aligns its velocity with the teacher's first-interval secant velocity. All student weights and later denoising steps remain unchanged. We evaluate ReSeed on three text-to-image models (SD3-Medium, SD3.5-Medium, and FLUX.1-dev) and one text-to-video model (Wan2.1-T2V-1.3B). For a distilled 4-step FLUX.1-dev model, \emph{ReSeed} requires only $0.00196\%$ additional trainable parameters relative to the base model and is trained on 8,000 prompt--noise pairs, while keeping the distilled student fully frozen and requiring no target images, perceptual losses, or adversarial losses. It improves DINO diversity by $48.3\%$ while maintaining competitive visual quality. These results show that substantial diversity can be recovered through a lightweight, data-efficient tuning of only the first denoising step, without finetuning the full student model.
52. 【2610.37098】SplatScout: Query-Driven Part-Level Referring Segmentation in Gaussian Scenes
链接：https://arxiv.org/abs/2610.37098
作者：Yihan Zang,Da Li,Shinkyu Park,Ivan Viola,Dominik Engel
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian scenes primarily, relying on segmenter-generated, Gaussian scenes, Gaussian, scenes primarily target
备注：
点击查看摘要
Abstract:Existing referring segmentation methods on Gaussian scenes primarily target whole objects, relying on segmenter-generated candidates from which a vision-language model (VLM) selects. Such predetermined fixed candidates may omit fine-grained parts needed as targets or cues for identifying objects. We introduce SplatScout, a query-driven, closed-loop approach that places perception under VLM control. The model actively selects views, directs segmentation, and inspects rendered 3D results to refine its predictions. For part-level evaluation, we introduce PartRef-ScanNet++, comprising 261 manually verified queries across 12 ScanNet++ scenes with mesh-derived ground truth. On PartRef-ScanNet++, SplatScout achieves 0.538 mIoU, substantially outperforming existing methods. Ablations demonstrate the benefits of iterative refinement, while comparisons across VLM backbones highlight the importance of effective tool-feedback utilization. SplatScout also achieves higher scores on four existing referring benchmarks. Code and the PartRef-ScanNet++ benchmark are available at this https URL.
53. 【2610.37097】riDifNet: A Unified Three-Task Diffusion Network for End-to-End RGB-T Perception
链接：https://arxiv.org/abs/2610.37097
作者：Qianchao He,Jing Liu,Yunhao Li,Xiaoqing Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：supports robust scene, robust scene understanding, multi-modal perception supports, perception supports robust, Diffusion Module
备注： 16 pages, 6 figures
点击查看摘要
Abstract:Infrared--visible (IR--VIS) multi-modal perception supports robust scene understanding under challenging illumination. Infrared and visible images are often misaligned due to platform motion, viewpoint changes, and modality-dependent distortions, causing registration errors to propagate into subsequent fusion and detection stages. We propose TriDifNet, a unified three-task diffusion network for end-to-end RGB-T perception. To the best of our knowledge, TriDifNet is the first diffusion-based network that jointly optimizes registration, fusion, and detection for misaligned RGB-T pedestrian perception. TriDifNet consists of three diffusion-based modules, i.e., the Registration Diffusion Module (RegDM), the Fusion Diffusion Module (FusDM), and the Detection Diffusion Module (DetDM). RegDM aligns the unaligned infrared image to the optical reference by estimating a dense deformation field. FusDM performs residual conditional diffusion to generate a detection-oriented fused representation with optical structural cues and complementary infrared saliency. DetDM formulates pedestrian detection as an iterative denoising process in bounding-box space. To couple the three tasks, TriDifNet introduces a closed-loop optimization mechanism, where detection semantics guide fusion and registration, and the fusion result further regularizes geometric alignment. A stage-wise progressive training strategy and a lightweight Nash multi-task learning (Nash-MTL)-based late-stage refinement are further adopted to balance registration, fusion, and detection optimization. Extensive experiments on the KAIST multispectral pedestrian benchmark show that TriDifNet achieves superior downstream detection performance under misaligned RGB-T settings. Against strong system-level competitors, TriDifNet achieves 65.44\% Recall, 57.55\% mAP$_{50}$, and 26.83\% mAP$_{50:95}$.
54. 【2610.37093】Learning to Look Beyond Screens: Transferable Visual Observation from GUI Grounding
链接：https://arxiv.org/abs/2610.37093
作者：Ruilin Yao,Xinyu Qiu,Tianyu Zou,Yi Rong,Shengwu Xiong,Shuheng Shen,Changhua Meng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：GUI grounding, evolving from passive, passive recognition, investigate GUI grounding, GUI grounding trajectories
备注： Technical Report
点击查看摘要
Abstract:Visual perception is evolving from passive recognition toward active, task-oriented observation. We investigate GUI grounding as a scalable source of spatial supervision for learning observation behaviors that transfer beyond interfaces. We introduce LBS (Look Beyond Screens), a vision-language model trained through supervised initialization on teacher-generated GUI grounding trajectories, followed by reinforcement learning for multi-turn crop-and-inspect decisions. Under fixed inference settings, LBS models based on Qwen3.5-35B-A3B and Qwen3.8-27B consistently improve over their corresponding baselines. Gains beyond supervised fine-tuning transfer to PerceptionBench for both backbones and to HR-Bench and ChartQAPro for Qwen3.5-35B-A3B, supporting observation strategies that generalize beyond GUI-specific imitation. Further analysis suggests complementary roles for the two stages: SFT establishes visual inspection primitives, while RL improves their downstream effectiveness. These findings support GUI grounding as a practical supervision paradigm for transferable active visual perception and broader multimodal reasoning. Our code and model are publicly available at this https URL and this https URL, respectively.
55. 【2610.37074】Systematic Morphometric Brain Autoencoding for Representation Learning in Neurodegenerative Diseases
链接：https://arxiv.org/abs/2610.37074
作者：Nuria Balbás-Esteban,Albert Belenguer-Llorens,Elaheh Moradi,Jussi Tohka,Vanessa Gómez-Verdejo,Carlos Sevilla-Salcedo
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：scanner-induced distribution shift, Early identification, supervised deep learning, timely clinical intervention, distribution shift
备注：
点击查看摘要
Abstract:Early identification of neurodegenerative disorders using structural T1-weighted MRI is essential for timely clinical intervention, yet supervised deep learning models often struggle to generalize due to limited annotations and scanner-induced distribution shift. Self-supervised learning offers a promising alternative; however, existing approaches are largely adapted from natural image paradigms, relying on contrastive objectives or generic masked reconstruction with voxel-wise losses, which may not fully capture the distributed morphometric patterns associated with neurodegeneration. We introduce SYMBA (SYstematic Morphometric Brain Autoencoding), a self-supervised pretraining framework specifically designed for structural brain MRI. SYMBA integrates anatomically constrained masking, a multi-scale structural similarity (MS-SSIM) reconstruction objective, and a progressive curriculum that transitions from local anatomical detail to global brain morphology. These components explicitly incorporate neuroanatomical structure into the self-supervised objective rather than relying on generic image priors. Pretrained on 6,953 T1-weighted MRI scans from nine heterogeneous cohorts, SYMBA is evaluated using frozen linear probing on two independent unseen datasets, enabling a strict assessment of out-of-distribution generalization. Across multiple clinical tasks, SYMBA consistently outperforms recent neuroimaging foundation models, achieving 0.930 AUROC for Alzheimer's disease classification, 0.772 for mild cognitive impairment conversion prediction, and strong performance in amyloid status prediction. In low-label regimes, SYMBA demonstrates high sample efficiency, reaching approximately 0.90 AUROC for AD/CN classification using only six labeled subjects.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2610.37074 [cs.CV]
(or
arXiv:2610.37074v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.37074
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
56. 【2610.37046】Learning to Code the World: Harness Evolution for Compositional 3D Reconstruction
链接：https://arxiv.org/abs/2610.37046
作者：Haoyu Yao,Chenguo Lin,Ruize Du,Yadong Mu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：real image requires, image requires jointly, requires jointly reasoning, Reconstructing editable, object structure
备注： Project page: [this https URL](https://haoyu-agent.github.io/SceneEvolve)
点击查看摘要
Abstract:Reconstructing editable and compositional 3D scenes from a real image requires jointly reasoning about geometry, object structure, and spatial relationships. We introduce SceneEvolve, a framework that represents 3D scenes as executable code and improves reconstruction by evolving the harness around a small open-source agent. SceneEvolve combines SceneAct, a compositional semantic action interface built on parameterized primitives, hierarchical composition, and semantic spatial relations, with SceneHarness-RSI, which leverages a stronger teacher agent to iteratively evolve the harness using feedback from development-set reconstructions. Throughout harness evolution, the model parameters, action semantics, and execution backend remain fixed. The resulting harness provides a reusable reconstruction procedure that enables the small open-source model to reconstruct unseen scenes without parameter updates or teacher assistance. Across two in-domain datasets and one out-of-domain dataset, SceneEvolve with the comparatively compact Qwen3.8-27B model improves all four evaluated reconstruction metrics while reducing mean inference time by 47.0% relative to the base model. More notably, despite relying on a substantially smaller model, SceneEvolve achieves 32.3% higher reconstruction quality than the large proprietary GPT-5.6-Sol model, while reducing mean equivalent deployment cost by 59.8%. Furthermore, the harness evolved using Qwen3.8-27B also generalizes to Kimi-K3, achieving comparable reconstruction performance to GPT-6-Astra. The project page is this https URL.
57. 【2610.37037】Zooming without Zooming v2: From Seeing Details to Connecting Evidence for Generalizable Multimodal Perception
链接：https://arxiv.org/abs/2610.37037
作者：Lai Wei,Yatai Li,Liangbo He,Jun Lan,Renjie Gu,Linhan Cao,Junkai Lin,Huijia Zhu,Weiqiang Wang,Linghe Kong,Yue Wang,Zhuosheng Zhang,Weiran Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：forms the foundation, Multimodal, Multimodal perception forms, multimodal intelligence, tasks
备注：
点击查看摘要
Abstract:Multimodal perception forms the foundation of multimodal intelligence. In particular, spatial perception and multimodal long-context understanding are two pivotal tasks that underpin embodied AI and multimodal agents. However, synthesizing targeted, high-quality training data for these tasks remains difficult and costly. Our key insight is that these tasks share an underlying capability, which we call connecting evidence: identifying relevant visual facts, binding them to the correct entities, recovering their relations, and composing them into an answer. Crucially, targeted training data are far easier to synthesize for this capability than for these tasks themselves. To strengthen this capability, we propose EvidenceConnect, an easy-to-implement data synthesis framework that uses zoomed views of related regions within a single image to generate questions requiring comparison, aggregation, or chaining of visual evidence. To ensure quality, a reference answer is retained only when independent VLMs agree on it, and region-ablation tests discard questions whose answer survives the removal of selected regions. We then train base VLMs on the resulting data with RLVR, obtaining Zooming without Zooming v2 (ZwZ2). Although the synthesized data are not tailored to any downstream benchmark, ZwZ2 improves fine-grained and spatial perception, with further gains on embodied spatial reasoning, multimodal long-context understanding, multimodal agent tasks, and general visual reasoning. These results establish EvidenceConnect as an effective framework for supervising evidence connection and suggest that strengthening this shared capability leads to more generalizable multimodal perception.
58. 【2610.37036】GraftRay: Physically Based Mesh Insertion into Gaussian Splatting Scenes via Path Tracing
链接：https://arxiv.org/abs/2610.37036
作者：Jinxin Ai,Matthias Niessner
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：Inserting virtual objects, synthetic data generation, Inserting virtual, Gaussian Splatting, content creation
备注： 8 pages + references, 6 figures, 2 tables
点击查看摘要
Abstract:Inserting virtual objects into scenes reconstructed via 2D or 3D Gaussian Splatting (2DGS/3DGS) is a key capability for content creation, AR, and synthetic data generation. However, realistic insertion requires the object to be seamlessly lit by the scene and, conversely, to cast physically plausible shadows onto it. Existing approaches either harmonize appearance in image space, sacrificing multi-view consistency, or approximate scene illumination with an environment map at the insertion point, which cannot represent near-field area lights such as windows and lamps that dominate indoor lighting. To address this, we present GraftRay, a unified method for physically consistent insertion of mesh objects into indoor scenes represented by either 2D or 3D Gaussians. We recover scene materials and surface normals with diffusion-based priors, and explicitly model spatially-extended emitters, solving their radiance in closed form. A hybrid renderer then jointly path-traces the scene Gaussians and inserted meshes, producing view-consistent shading, interreflections, and soft shadows. On FIPT, GraftRay sets a new state of the art, outperforming recent baselines such as ComGS and EAG-PT in rendering fidelity and shadow accuracy, while maintaining highly competitive rendering efficiency.
59. 【2610.37026】Interpretable Deep Learning Models for Breast Cancer Diagnosis Using Medical Imaging
链接：https://arxiv.org/abs/2610.37026
作者：Sami Alnawali,Muhammad Atif Saeed,Abdul Hadi,Azka Atiq,Akhtar Jamil,Ahmad Din
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：hinders clinical adoption, limited interpretability hinders, interpretability hinders clinical, Deep learning shows, learning shows promise
备注： 37 page, 45 Figures
点击查看摘要
Abstract:Deep learning shows promise for breast cancer diagnosis, but limited interpretability hinders clinical adoption. We benchmark ten ImageNet-pretrained models (ResNet50, VGG19, InceptionV3, DenseNet121, Xception, MobileNetV2, EfficientNet, ConvNeXt, ViT, and Swin Transformer) for benign-versus-malignant classification on the BreakHis histopathology dataset using a patient-level split, and explain their predictions with Grad-CAM, LIME, Integrated Gradients, and LRP. DenseNet121 performed best, with 99.4% test accuracy and an AUC-ROC of 0.999, and significantly outperformed all other models (p 0.001). Transformer-based models trailed the CNNs. The explanations consistently highlighted nuclei-rich and glandular regions of diagnostic relevance. Combining transfer learning with explainable AI can thus yield accurate, interpretable tools for breast cancer diagnosis.
60. 【2610.37021】Ground-to-Satellite Knowledge Distillation for Crop Classification under Temporal and Geographic Shift
链接：https://arxiv.org/abs/2610.37021
作者：Miro Miranda,Rocco Sedona,Valerio Marsocci,Gabriele Cavallaro,Claudia Paris
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：limited reference data, reference data, essential for agricultural, agricultural monitoring, hampered by limited
备注：
点击查看摘要
Abstract:Continuous and up-to-date crop type mapping is essential for agricultural monitoring but is often hampered by limited reference data. The growing availability of ground-level field photographs offers a promising way to address this challenge. When combined with satellite time series, these images provide complementary perspectives on the same parcel, capturing crop characteristics from distinctly different perspectives. However, field photographs are not always available for each satellite pixel at inference time, limiting their potential in scalable crop type mapping. We investigate whether ground photographs can provide privileged supervision for crop classification built on pretrained satellite embeddings. A photo teacher based on frozen CLIP features supervises classifiers trained on AlphaEarth and TESSERA representations; photographs are used only during training. On a paired field photo and satellite imagery dataset with 17 crop classes, knowledge distillation consistently improves over satellite-only classification; for frozen embeddings the margin grows under temporal shift, reaching up to +5.5 macro-F1 points, and widens in geographic holdouts (+3.7 vs +3.0 in-distribution). These results show that ground-view supervision can complement satellite embeddings and improve their robustness without changing inference requirements.
61. 【2610.37019】V-LUMEN: Visual Lookup Memory for Embedding Scaling in Vision-Language Models
链接：https://arxiv.org/abs/2610.37019
作者：Miso Choi,Daekeun Kim,Eunji Kim,Jungbeom Lee
类目：Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Embedding-level scaling expands, increasing model depth, Embedding-level scaling, dense computation, scaling expands
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Embedding-level scaling expands the capacity of language models through lookup-based memory rather than by increasing model depth, width, or dense computation. Extending this idea to vision-language models (VLMs) is challenging because visual features are continuous, spatially structured, and query-dependent, unlike discrete text tokens that naturally support n-gram lookup. We introduce V-LUMEN, a visual lookup memory for VLMs. V-LUMEN discretizes visual features with a frozen codebook, builds spatially aware memory keys through spatial aggregation-based hashing, and modulates them with text-conditioned relevance signals; all addressing is non-parametric, and the retrieved embeddings are fused into the backbone through a gated residual pathway. On five reasoning-intensive benchmarks, V-LUMEN substantially improves a frozen Qwen3-VL-2B backbone and transfers zero-shot to three benchmarks whose images are disjoint from the training data. At a matched parameter budget, moving part of a LoRA or MoE adapter's capacity into V-LUMEN preserves accuracy on two backbones, indicating that external visual memory is an independent capacity axis rather than a stronger adaptation method. Because lookup cost is constant in table size and incurred only once at prefill, this capacity grows in storage rather than in per-token compute. Code is available at this https URL.
62. 【2610.37015】RePAIR: Inverting Backdoor Attacks in Semantic Segmentation
链接：https://arxiv.org/abs/2610.37015
作者：Arnold Brosch,Kira Maag
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Probability (math.PR)
关键词：computer vision, posing a security, security risk, significant advances, advances in computer
备注： 26 pages total, 9 pages main paper, 2 figures
点击查看摘要
Abstract:Despite significant advances in computer vision, semantic segmentation models remain vulnerable to backdoor attacks, posing a security risk. These attacks redirect pixels of a chosen victim class to an attacker-specified target class when a trigger is present, while preserving clean predictions. Existing defenses are largely derived from image classification, while dedicated segmentation defenses remain scarce and typically require retraining or model modification. We introduce RePAIR, a post-hoc, label-free, attack-unaware defense based on the observation that backdoor-induced shifts can be stronger in the classifier head than in internal representations, leaving recoverable victim-class semantics. RePAIR infers the victim-target relation from an unlabeled, potentially contaminated image pool, constructs a safety-approved semantic reference, and localizes suspicious pixels by comparing head predictions with internal semantic evidence. It then applies feature-space and output corrections toward the inferred victim semantics, while conservative localization and output constraints limit changes to benign predictions. We model the attack as adversarial probability transport and repair as its approximate reversal, deriving bounds and sufficient conditions for localization, residual attack success, clean-side changes, defense-induced target predictions, and attack-unaware pair identification. Experiments across segmentation architectures and attack settings show that RePAIR substantially reduces attack success while largely preserving clean performance.
63. 【2610.37000】GPA-VGGT: Geometry-Preserving Acceleration of VGGT
链接：https://arxiv.org/abs/2610.37000
作者：Muyeol Sung,Jangwon Kim,Jongwoo Lim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：recover camera parameters, single forward pass, Feed-forward geometry models, VGGT recover camera, depth maps
备注： Accepted to WACV 2027. Project page: [this https URL](https://noheat61.github.io/GPA-VGGT/)
点击查看摘要
Abstract:Feed-forward geometry models such as VGGT recover camera parameters, depth maps, and point maps from one to hundreds of views in a single forward pass, making them powerful backbones for multi-view 3D perception. However, VGGT's global attention is quadratic in the number of frames and dominates end-to-end runtime on long sequences, which has motivated a range of training-free efficiency methods such as token merging. These methods, however, come with a drop in accuracy that makes them hard to use in place of VGGT. We propose GPA-VGGT, a training-free acceleration method that replaces global attention in early blocks with frame attention augmented by a shared cross-frame K/V set. In the remaining blocks, we merge only keys and values while preserving all queries, restore the attention mass of the tokens each merged key represents, and randomly project the matching metric to 128 dimensions to reduce matching cost. Across diverse multi-view geometry tasks, GPA-VGGT provides training-free acceleration at speedups comparable to prior work while preserving the information required for precise geometric estimation, retaining over 99% of VGGT's pose accuracy under AUC@3.
64. 【2610.36986】LearnPrunerV2: Learnable Progressive Token Pruning for Vision-Language Models
链接：https://arxiv.org/abs/2610.36986
作者：Rinyoichi Takezoe,Yaqian Li,Weiren Wang,Zihao Bo,Huihong Shi,Anzhou Hou,Mo Guang,Jiale Yan,Kaiwen Long
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：demonstrated remarkable multimodal, remarkable multimodal capabilities, prohibitive computational overhead, computational overhead due, Vision-Language Models
备注： Accepted to ACM Multimedia 2026
点击查看摘要
Abstract:Vision-Language Models (VLMs) have demonstrated remarkable multimodal capabilities but suffer from prohibitive computational overhead due to the massive number of visual tokens. While token pruning is a promising solution, existing methods still suffer from two major drawbacks: 1) unreliable pruning criteria that fail to accurately localize task-specific regions due to inherent attention biases or query-agnostic designs, and 2) suboptimal pruning strategies that employ rigid, non-adaptive schedules, overlooking the dynamic evolution of token redundancy across different model depths. To address these challenges, we propose LearnPrunerV2, which extends the previous two-stage heuristic framework (LearnPruner) into a fully learnable architecture. Specifically, we integrate lightweight learnable modules into every layer of the VLM backbone, which estimate token importance by fusing intrinsic visual saliency with extrinsic query relevance captured via a shadow token. By uncovering a consistent staircase redundancy pattern across VLM layers, we further introduce Budget-Deterministic Pruning (BDP) to establish a hardware-friendly schedule with fixed per-layer budgets. Extensive experimental results across various benchmarks and VLMs demonstrate that LearnPrunerV2 consistently outperform previous state-of-the-art methods. Notably, LearnPrunerV2 preserves 99.8% of the original performance when pruning 77.8% of visual tokens on LLaVA-v1.5, achieving a superior accuracy-efficiency trade-off.
65. 【2610.36978】Explicit Regional Representations For Video Quality Assessment
链接：https://arxiv.org/abs/2610.36978
作者：Fuyi Yang,Lei Yang,Andrew Liu,Chenyu Wei,Xiaoyi Guo,Ming Kai Hsu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：video quality assessment, predictions largely implicit, regional evidence underlying, video quality, quality assessment
备注： Preprint. This work is an initial version and may be updated in future revisions
点击查看摘要
Abstract:End-to-end video quality assessment (VQA) methods leave the regional evidence underlying their predictions largely implicit. We introduce an explicit pixel-level regional representation for VQA, instantiated as a Quality-Relevance Heatmap (QRH) that combines localized degradation evidence with perceptual priors under vision-language model guidance, without requiring pixel-level annotations. We apply QRH to existing VQA models through two deterministic fragment-sampling strategies: distribution-preserving sampling approximates the original sampler's QRH-score distribution without retraining, while quality-aware sampling prioritizes regions with high QRH scores and is paired with fine-tuning. Experiments with DOVER on multiple benchmarks show that the former closely approximates predictions averaged over random samples, while the latter improves most evaluated metrics across popular VQA benchmarks. These results support explicit regional representations as a useful interface for downstream VQA.
66. 【2610.36956】Mining the Nineteenth Century for the Thirteenth: Register-Scale Forced Alignment and HTR Bootstrapping via Legacy Regesta and Antiquarian Editions
链接：https://arxiv.org/abs/2610.36956
作者：Tamas Kovacs,Daniel Luger
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Pope Honorius III, Honorius III depends, Handwritten text recognition, Pope Honorius, Honorius III
备注： 10 pages
点击查看摘要
Abstract:Handwritten text recognition (HTR) for the registers of Pope Honorius III depends on modern expert transcriptions, which exist only for regnal years 1-2 of Reg. Vat. 9. For the remaining registers, nineteenth-century scholarship offers Pressutti's regesta and partial editions. On fol. 1-203, where both layers exist, we measure what this legacy layer can contribute, on transcriptions that we first audit against it, and find a division of labor across three tiers. At the orthographic tier, raw editions are at best neutral for adapting a recognizer to the second regnal year and harmful without replay, whereas projection onto curial spelling with replay of modern source lines turns them into zero-label adaptation targets: pooled over all 134 year-2 sides, the WER falls by 1.50 points (95% CI -1.84 to -1.15), closing 33% of the gap to an oracle; the spelling changes at the year split, through the scribe or the transcriber, whereas the hand changes visibly only at fol. 191r. At the lexical tier, the corpus-wide legacy lexicon contains 82.2% of the out-of-vocabulary words of unedited entries and flags recognition errors with 66.7% precision, and labels from pre-trained medieval NER models, distilled into the recognizer's NER head, reach F1 82.1% on an expert validated benchmark, level with the best tagger applied after recognition. At the topological tier, Pressutti's regests, the closing datum clauses, and the regests' dates converted to the chancery's Roman form find 73.9% of entry starts in the recognized line stream, and edition agreement estimates a CER of 7.80% beyond fol. 203. Antiquarian scholarship thus cannot replace modern transcription, but it can steer, check, and segment HTR across the untranscribed registers.
67. 【2610.36951】Dense Representation Learning and Differentiable Shape Modeling for Spine Landmark Detection
链接：https://arxiv.org/abs/2610.36951
作者：Augustin Daridon,Sofiane Sifaoui,Ayman Assi,Mohamad Karam,Wafa Skalli,Elsa Angelini,Loic Le Folgoc
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：spine deformation severity, estimating spine deformation, building biomechanical models, Spine landmark detection, estimating spine
备注：
点击查看摘要
Abstract:Spine landmark detection from spinal X-ray is a key step for estimating spine deformation severity, for building biomechanical models, and for pre-operative planning. We reframe anatomical landmark detection as a pixel-level contrastive representation learning problem, matching dense pixel embeddings with landmark prototypes. Surprisingly, even with a generic U-Net backbone, this formulation results in more discriminative heatmaps compared to the traditional heatmap regression paradigm, leading to improved discrimination between vertebral corners on distinct vertebra. Furthermore, we combine the resulting heatmaps with learnable shape priors over the global configuration of spinal landmarks to resolve ambiguities in landmark locations, yielding a simple and practical approach to spinal landmark detection. Our approach is competitive, in terms of landmark accuracy and clinical parameter estimation, with the state-of-the-art on the public AASCE dataset and on two private spinal X-ray datasets. Our code and pre-trained weights are available at this https URL.
68. 【2610.36929】DocXEval: A Systematic Evaluation of Explainability in Multimodal Document Understanding
链接：https://arxiv.org/abs/2610.36929
作者：Saifullah Saifullah,David Dembinsky,Stefan Agne,Andreas Dengel,Sheraz Ahmed
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：driven unprecedented performance, unprecedented performance breakthroughs, multimodal document understanding, document understanding, modern document understanding
备注：
点击查看摘要
Abstract:Multimodal transformer models have driven unprecedented performance breakthroughs in modern document understanding. However, the inherent black-box nature of these models remains a major obstacle to their safe deployment in high-stakes sectors. Despite significant progress in explainability for vision and language tasks, explainable AI (XAI) research tailored to multimodal document understanding has received little attention. To address this gap, we present \ourframework{}, the first comprehensive explainability framework that adapts existing XAI methods and evaluation metrics to the multimodal (text, layout, and image) document understanding context, while introducing efficient multi-target adaptations of both methods and metrics for domain-specific tasks such as semantic entity recognition. Using \ourframework{}, we systematically evaluate 13 XAI methods across 3 document understanding tasks, 8 datasets, 4 models, and 17 evaluation metrics, and find that only a few methods perform consistently across all evaluation criteria, with Occlusion emerging as the most faithful and interpretable method overall. Through a dedicated meta-evaluation, we observe moderate to strong agreement among several faithfulness and complexity metrics while identifying certain ones that produce unreliable results. Finally, through multiple dataset-wide diagnostic analyses, we uncover key insights into model behavior, including the contribution of individual modalities across tasks and labels, spatial attribution patterns around target entities, and potential dataset biases. Overall, this work serves as both a benchmark and a practical guide for future XAI research in multimodal document understanding. To support reproducibility, we publicly release our code at this https URL.
69. 【2610.36896】PREEN: Exemplar-Based Color Style Transfer with Smartphone Editor Presets
链接：https://arxiv.org/abs/2610.36896
作者：Beomjin Ahn
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Exemplar-based Editor Network, deterministic image editor, casts color style, color style transfer, Editor Network
备注： Accepted to WACV 2027
点击查看摘要
Abstract:We present PREEN (Preset Regression via an Exemplar-based Editor Network), which casts color style transfer as regression onto the 29 parameters of a deterministic image editor. Given a content image and a style reference, PREEN predicts a preset, a vector of editor slider values that is interpretable and editor-consumable, not a raster image. The key obstacle is supervision, since an arbitrary real reference lacks a preset ground truth. We therefore supervise with a style-transfer teacher, whose target looks we invert into the editor's parameter space as pseudo-presets, then pretrain a CLIP-conditioned regressor and refine it with LoRA under an image-level CIELAB loss. On the human-curated PST50 benchmark, PREEN applies the reference's color while preserving structural fidelity, leading the baselines on pixel- and perceptual-fidelity metrics. The preset is compact and predicted at sub-second on-device latency. The low-dimensional subspace also exposes a single inference-time strength knob that traces a continuous default-to-vivid trajectory in one forward pass, with every intermediate state a valid editor preset. A two-axis human study shows that raters prefer the vivid end for matching the reference but the default as a standalone photo, a trade-off the knob spans without retraining.
70. 【2610.36877】GUI-JEPA: Candidate-Conditioned JEPA Latents as a Fast Action Policy for Mobile GUI Agents
链接：https://arxiv.org/abs/2610.36877
作者：Bingchao Wang,Yongcheng Jing,Shunyu Liu,Chengyu Wang,Jun Huang,Jie Yang,Wei Liu,Dacheng Tao
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：Mobile GUI agents, Mobile GUI, typically fine-tuned, decoder-free GUI agent, GUI agent policy
备注： 26 pages, 11 figures, 16 tables
点击查看摘要
Abstract:Mobile GUI agents are typically fine-tuned 7B-scale vision-language models (VLMs) that generate each action as text. However, these VLMs decode every action token by token, and even agents that score candidate actions keep a large language model or VLM in the loop, making them slow and memory-hungry. To address these issues, we propose GUI-JEPA, to our knowledge the first decoder-free GUI agent policy built on a Joint-Embedding Predictive Architecture (JEPA), which selects actions in the latent space of a JEPA encoder pretrained on unlabelled GUI screenshots. Its action- and region-conditioned latent predictor turns the screen latent into one latent per candidate action, letting lightweight heads score all candidates against the instruction in a single batched pass, without decoding a token. We further show that the scorer relies on this latent pathway and that the predictor is trained for the decision itself: a randomly initialised predictor does just as well as one pretrained on screen dynamics. On AndroidControl, GUI-JEPA is 2.8-4.0x faster on the same GPU than a Qwen2.5-VL-7B agent we fine-tune with the same inputs, while reaching 86-92% of its in-distribution accuracy with 6% of its parameters. Code is available at this https URL
71. 【2610.36876】HoloRecon: Incremental Reconstruction of Long-Range Panoramas with Global Consistency
链接：https://arxiv.org/abs/2610.36876
作者：Zhuoxiao Li,Xinyi Liu,Hongye Hou,Jing OU,Kang Du,Shuai Zhang,Dongli Wu,Taoyu Wu,Siyuan Feng,Xiaohui Zhu,Wufan Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Long-sequence panoramic reconstruction, requires detailed scene, Long-sequence panoramic, panoramic reconstruction requires, reconstruction requires detailed
备注： Project Page: [this https URL](https://zhuoxiaoli.github.io/HoloRecon_page/)
点击查看摘要
Abstract:Long-sequence panoramic reconstruction requires detailed scene geometry and globally consistent camera poses across distant revisits. Panoramic SLAM and incremental SfM rely on feature correspondences, but repeated, similar structures and small partial overlap make reliable long-range connections difficult to establish, leaving accumulated drift unresolved. Feed-forward models offer detailed local geometry, but their high computational costs limit inference window size, necessitating additional constraints for global consistency. This motivates combining continuous feature-based tracking and sparse mapping with rapid, high-quality local reconstruction from feed-forward models to achieve accurate localization and globally consistent dense mapping over long sequences. We therefore propose a panoramic reconstruction framework that couples an ORB-based sparse panoramic mapping frontend with a fine-tuned feed-forward model. Our key insight is that predicted local geometry enables 3D verification of feature matches across distant revisits, yielding long-range camera constraints even between regions. We calibrate predicted depths with sparse landmarks and use verified connections to optimize the global pose graph, updating dense geometry with the corrected camera poses. We also introduce PanoRecon, a seven-scene benchmark with repetitive architecture, large and small loops, and reference camera poses and LiDAR geometry for evaluating global consistency. Our method achieves the lowest mean absolute trajectory error and high F-1 Score among the evaluated methods. Project Page:this https URL
72. 【2610.36874】AdaGround: Token-Normalized Adaptive Zooming with Verifier-in-the-Loop Refinement for GUI Grounding
链接：https://arxiv.org/abs/2610.36874
作者：Bingchao Wang,Yongcheng Jing,Chengyu Wang,Jun Huang,Jie Yang,Wei Liu,Dacheng Tao
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL)
关键词：high-resolution screens fails, common training-free remedy, Compositional Structure Grounding, high-resolution screens, screens fails
备注： 24 pages, 5 figures, 14 tables
点击查看摘要
Abstract:GUI grounding on high-resolution screens fails mostly on small targets, and zooming in is a common training-free remedy. However, most existing zooming pipelines do not match the zoom to the target's size, accept the zoomed answer unconditionally and never revisit a wrong answer. To address these issues, we propose AdaGround, a training-free framework with three components: (1) Token-Normalized Adaptive Zooming, which sets the magnification, field of view and zoom depth of each sample from the model's own estimate of the target size; (2) Verifier-in-the-Loop Refinement, which uses one marked-click Yes/No verifier to keep or reject each zoom, choose between zoom chains, trigger re-grounding and, with an existence query, decide when to abstain; and (3) Compositional Structure Grounding, which composes spreadsheet cells from their headers. On Qwen3-VL models, AdaGround surpasses state-of-the-art training-free zooming methods and many trained GUI models, improving accuracy over the backbone by 7.4 to 20.6 points on OSWorld-G and ScreenSpot-Pro, and its gains carry over to held-out UI-Vision. Code is available at this https URL
73. 【2610.36873】RangeRectQuant: Compressing Scientific Fields for Every Future Rectangular Sum
链接：https://arxiv.org/abs/2610.36873
作者：Jiahao Zhang,Xinling Wen,Yu Chen
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scientific rasters, Scientific, Abstract, Independent pixel-error bounds, errors
备注： 10 pages, 6 figures. Code, data, core experiments and extended figures: [this https URL](https://github.com/Marchematics/RangeRectQuant)
点击查看摘要
Abstract:Scientific rasters are often stored before the regions to be measured are known. Independent pixel-error bounds can force exact integer reconstruction when one absolute error budget covers every future rectangle. Coordinated changes allow every pixel to change while every rectangular sum remains accurate. A prefix sum accumulates values from the top-left corner. Four such sums determine any rectangular total. RangeRectQuant preserves the pixel range and designated exact samples while controlling errors in prefix sums. At each row position, we characterize exactly which errors let the remaining pixels meet these constraints. These errors form a single integer interval, even when many completions exist. A backward pass finds its endpoints; a forward pass uses them to choose quantized pixels. The resulting field meets the prescribed error budget for every axis-aligned rectangle, with linear work and workspace proportional to one row. Experiments on geographically held-out built-surface and water-occurrence maps show substantial storage savings over alternatives meeting the same requirements. Data producers encode once; later users measure arbitrary rectangles without the source, re-encoding, or query-specific correction.
74. 【2610.36870】ail Cues, Principal Corrections: Plug-and-Play Rectification for Open-Set Test-Time Adaptation
链接：https://arxiv.org/abs/2610.36870
作者：Yingkai Yang,Chaoqi Chen,Hui Huang
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：semantic shifts coexist, Open-Set Test-Time Adaptation, non-stationary target streams, Open-Set Test-Time, operates on non-stationary
备注： Accepted at NeurIPS 2026
点击查看摘要
Abstract:Open-Set Test-Time Adaptation (OSTTA) operates on non-stationary target streams where covariate and semantic shifts coexist. Existing TTA methods often obtain adaptation signals by updating model parameters or maintaining mutable memories, which can be costly and vulnerable to unknown samples. We present TALOR, a lightweight, backward-free rectification module that uses the source linear head as a geometric anchor. The head-induced basis decomposes each normalized feature into high-gain principal coordinates and low-gain tail coordinates. TALOR estimates a soft-routed affine correction in the principal subspace, combining a regime-level principal bias with a tail-conditioned slope that captures sample-level tail-to-principal coupling. Using weighted ridge regression, it subtracts this drift estimate from the principal coordinates, reconstructs the feature and feeds it into the source head. On the ImageNet-C benchmark with six csOOD datasets, TALOR outperforms the next-best UniEnt by 2.2% H-score while running 2.5x faster and using only 12% of its GPU memory; as a post-correction plug-in, it further boosts COME to 68.4% H-score with only 2% additional memory overhead.
75. 【2610.36859】ActiveAlign: Aligning Egocentric Manipulation via Active Perception
链接：https://arxiv.org/abs/2610.36859
作者：Ri-Zhao Qiu,Bowen Wen,Yifeng Jiang,Chen Tessler,Eric Heiden,Xue Bin Peng,Xiaolong Wang,Stan Birchfield,Erwin Coumans
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：structured world representations, enables structured world, representations for planning, safe execution, structured world
备注：
点击查看摘要
Abstract:Real-to-Sim-to-Real (Real2Sim2Real) enables structured world representations for planning, interpretability, and safe execution. Most existing approaches rely on passive perception, which creates real2sim gaps due to imperfect observation. Inspired by how humans perceive actively through actions, we propose ActiveAlign, a framework that leverages active perception to align the Real2Sim2Real gap from interactions. ActiveAlign introduces two complementary modules: (i) ActiveAlign-Waving, which performs hand-eye calibration by exploiting active hand motions and differentiable rendering, and (ii) ActiveAlign-Touching, which refines object alignment through tactile feedback to achieve millimeter-level precision. Together, these capabilities enable strong real2sim alignment. We demonstrate that ActiveAlign-Waving can be used to curate simulation environments for open-sourced uncalibrated robot manipulation datasets, and demonstrate on a real Unitree G1 robot that ActiveAlign enables fine manipulation of millimeter-scale objects such as pressing buttons and moving sliders.
76. 【2610.36858】Forget the Data, Keep the Capability: Switchable Unlearning for Retrieval
链接：https://arxiv.org/abs/2610.36858
作者：Jingong Chen,Kyle Gao,Guangyuan Li,Chulwoo Pack,Sijia Liu,Kwanghee Won
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Privacy compliance requires, compliance requires re-identification, requires re-identification models, selectively forget individuals, Privacy compliance
备注：
点击查看摘要
Abstract:Privacy compliance requires re-identification models to selectively forget individuals while preserving their ability to recognize others. For this, we present MoME, a switchable framework that can adapt pre-trained backbones for privacy compliance, allowing the same model to switch between Full mode for standard inference and Core mode for unlearned inference. MoME splits one backbone into core parameters that preserve retrieval and zero-initialized parasitic parameters that carry the full-data knowledge, and training them under gradient isolation so the core never receives a forget-set gradient. Disabling the branch yields Core, which satisfies a request to delete a person's training data, and enabling it yields Full, which retains what the deleted data taught, so honoring the request is a flag flip rather than a retraining run. We prove Core independent of the forget set up to an audited set of coupling channels and introduce the rank-based Forgetting-Rank statistic to audit that independence in a trained model. On Market-1501, VeRi-776 and RegDB, Core reads at a retrained reference under three membership attacks while retrieving above it, and the retrieval advantage carries to ResNet and CLIP backbones. Code and weights are available at this https URL.
77. 【2610.36857】Evaluating AlphaEarth Embeddings for Crop Classification: Separability, Temporal Dynamics, and Cross-Regional Transferability
链接：https://arxiv.org/abs/2610.36857
作者：Priyanka Goyal,Maitreyee Sar,Adway Mitra,Manjira Sinha
类目：Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Earth Observation, pixel-level spectral analysis, dimensions remains limited, based agricultural monitoring, domain-generalization dimensions remains
备注：
点击查看摘要
Abstract:Earth Observation (EO)-based agricultural monitoring is shifting from pixel-level spectral analysis toward representation-driven modeling, yet systematic evaluation of learned representations across spatial, temporal, and domain-generalization dimensions remains limited. Geospatial foundation models generate high-dimensional embeddings encoding spatio-temporal land-surface properties, but their utility for agricultural applications remains insufficiently understood. This study presents a representation-agnostic evaluation framework integrating geometric separability, temporal dynamics, spatial robustness, and cross-regional generalisation. A 64-dimensional AlphaEarth embedding space is benchmarked against Sentinel-2 reflectance, NDVI-derived phenology, and harmonic features using field-scale data from the Conterminous United States (CONUS; 2017-2023) and Northern India (2021). Traditional features achieve strong linear separability (Fisher ratio), while embeddings provide superior distribution-aware separation -- Bhattacharyya and Mahalanobis distances up to an order of magnitude higher for spectrally similar pairs (e.g. Corn/Soybeans: 3.9 vs. 0.10). Embeddings uniquely capture multi-year crop rotation dynamics, reaching a separability ratio of 1.784 versus a maximum of 1.003 across all engineered features, and exhibit lower residual spatial autocorrelation of errors (mean Moran's $I \approx 0.17$). However, harmonic and NDVI features show stronger cross-continental transferability (US $\to$ India Macro F1: 0.493 vs. 0.326 for embeddings), reflecting better distributional alignment. The combined feature space yields balanced performance, supporting hybrid modeling. These findings reveal a fundamental trade-off between representational richness and cross-region transferability, providing a structured framework for feature selection in large-scale crop classification.
Subjects:
Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
Cite as:
arXiv:2610.36857 [cs.CV]
(or
arXiv:2610.36857v1 [cs.CV] for this version)
https://doi.org/10.48550/arXiv.2610.36857
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)</p>
78. 【2610.36853】LingGS: Decoupling Feed-Forward Geometry Prediction from Camera Tracking for High-Fidelity Gaussian SLAM
链接：https://arxiv.org/abs/2610.36853
作者：Da Li,Yihan Zang,Ivan Viola,Zeyu Wang,Dominik Engel
类目：Computer Vision and Pattern Recognition (cs.CV); Graphics (cs.GR)
关键词：RGB Gaussian splatting, limited optimization budget, monocular RGB Gaussian, tracking remains challenging, Gaussian splatting SLAM
备注： 10 pages, 4 figures
点击查看摘要
Abstract:Achieving high-quality reconstruction and responsive camera tracking remains challenging for monocular RGB Gaussian splatting SLAM under a limited optimization budget. We present an online system that addresses this challenge by combining learned geometric priors with explicit geometric camera tracking, which can substantially outperform learned camera prediction in terms of tracking accuracy. A frozen streaming 3D foundation model serves as a virtual RGB-D sensor, providing depth estimation from monocular video. An explicit geometric solver then estimates camera motion through feature reprojection, and a streaming Gaussian mapper integrates the resulting observations into a dense scene representation. We further show that geometric tracking improves camera pose accuracy across representative streaming geometry backbones, demonstrating the broader applicability of our approach. Extensive experiments on indoor and outdoor datasets show that our method significantly improves reconstruction quality over existing approaches, achieving about 7 FPS on a single RTX 4090 and delivering 2-3 times the throughput of the evaluated prior SLAM systems.
79. 【2610.36850】uTHCD-C: A Corruption-Robustness Benchmark for Tamil Handwritten Character Recognition
链接：https://arxiv.org/abs/2610.36850
作者：Preethi S,Meeradevi T,Arun Prakash A
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Tamil handwritten character, handwritten character recognition, Handwritten Character Database, clean test images, handwritten character
备注： 14 pages, pre-print
点击查看摘要
Abstract:Evaluation of Tamil handwritten character recognition (HCR) has largely focused on clean test images, and a standardized multi-corruption robustness benchmark for isolated Tamil HCR has not been established. We introduce uTHCD-C, a corruption-robustness benchmark based on the unconstrained Tamil Handwritten Character Database (uTHCD). The benchmark defines ten corruption types, including a handwriting-specific stroke-thinning corruption, at five severity levels. We evaluate nine convolutional and transformer-based architectures using five-fold stratified cross-validation and writer-independent testing. Robustness is quantified using mean Corruption Error (mCE), normalized against a VGG16-BN reference. We additionally compare parameter count, computational complexity, and inference throughput to characterize the computational requirements of the evaluated architectures. The results establish comparative robustness baselines for Tamil HCR, revealing substantial differences across architectures: ConvNeXt and Swin achieve the lowest mCE values (0.75 and 0.83, respectively), whereas ShuffleNet and MnasNet exhibit higher values (1.55 and 1.85, respectively). The accompanying efficiency measurements characterize the trade-offs between corruption robustness and computational requirements. By providing standardized corruption configurations, evaluation protocols, and comparative results, uTHCD-C establishes a reproducible basis for future research on robust and computationally efficient Tamil HCR.
80. 【2610.36844】AxisQ: Depth-Adaptive Channel--Frequency Quantization for Camouflaged Object Detection
链接：https://arxiv.org/abs/2610.36844
作者：Chi Ruan,Tianqi Li,Xin He,Xue Geng,Ming-Ming Cheng,Yun Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Camouflaged object detection, Camouflaged object, aggressive post-training quantization, object detection, depends on weak
备注：
点击查看摘要
Abstract:Camouflaged object detection (COD) depends on weak texture and boundary cues that can be destroyed by aggressive post-training quantization (PTQ). Existing PTQ methods mainly optimize quantizers or reconstruct network blocks, while using a single precision-allocation domain throughout hierarchical backbones. Instead, we introduce AxisQ, a depth-adaptive bit-allocation framework motivated by the observation that the useful allocation axis changes with feature depth. Under a fixed per-layer average activation-bit budget, AxisQ allocates precision in the channel domain for shallow features and in the local-frequency domain for deep features, using COD-aware sensitivity to better preserve subtle foreground regions and ambiguous boundaries. We also formulate a boundary-aware Hessian approximation for reconstruction by incorporating boundary-weighted gradient and error statistics. Experiments across multiple COD models and diverse benchmarks demonstrate improved accuracy over the strongest baselines at low bit widths, with relative weighted F-measure gains of 12.7% for CFRN and 33.3% for CamoFormer-P on CAMO under W2A2 quantization. These results support adapting the allocation domain to feature depth as a transferable quantization strategy for hierarchical COD models.
81. 【2610.36838】MVRCap: Towards Comprehensive Video Captioning via Hierarchical Multi-Dimensional Verifiable Rewards
链接：https://arxiv.org/abs/2610.36838
作者：Weihuang Lin,Xianing Chen,Zhibin Wang,Congzhi Zhang,Yiwei Ma,Jiayi Ji,Miao Chen,Jun Song,YuCheng,Bo Zheng,Xiaoshuai Sun,Rongrong Ji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：underlying logical intent, current models struggle, capture spatial-temporal dynamics, comprehensive video captions, generate comprehensive video
备注：
点击查看摘要
Abstract:Despite significant progress, current models struggle to generate comprehensive video captions, constrained primarily by coarse-grained supervision, which often fails to capture spatial-temporal dynamics and the underlying logical intent. To address this issue, we introduce MVRCap, a novel framework that reformulates video captioning as a reinforcement learning task steered by structured verification. Central to our approach is a Fine-Grained Verifiable Reward mechanism, serving as dense supervision to enforce rigorous visual-semantic alignment. Specifically, we construct this reward system anchored by three complementary pillars: a Hierarchical Concept Coverage Reward utilizing our newly constructed MVRCap-QA dataset to ensure multi-dimensional completeness and semantic depth, a Factuality Verification Reward to enhance factual consistency, and a Conciseness Constraint to maximize semantic density. Furthermore, we curate the high-quality MVRCap-SFT dataset, providing structured annotations across six key dimensions, to serve as a robust foundational initialization for the RL policy in this training pipeline. Extensive experiments demonstrate that MVRCap achieves state-of-the-art performance on authoritative benchmarks including VDC, CAPability, and VC4VG.
82. 【2610.36832】Drop the Details, Get the Gist: Dynamic Conceptual Representation for Video Recognition
链接：https://arxiv.org/abs/2610.36832
作者：Ryoya Yoshiyama,Bowen Wang,Yuta Nakashima
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Concept Bottleneck Models, Bottleneck Models, exposing an explicit, language-based rationale, route predictions
备注： 25 pages, 5 figures, 4 tables. Accepted to the MM4SciReal Workshop at ACCV 2026
点击查看摘要
Abstract:Concept Bottleneck Models (CBMs), which route predictions through a layer of human-interpretable concepts, have substantially improved the interpretability of visual classification by exposing an explicit, language-based rationale for each prediction. Most existing work focuses on static images, and temporal dynamics in videos have been underexplored in conceptual representation. We propose a framework that extends concept-based image recognition to procedural video understanding. It represents a multi-step video as a temporal sequence of segment-level concept score vectors and feeds this sequence into a Transformer encoder to predict the class label. We also explore a way to estimate the contribution of each concept for further interpretability. We evaluated three concept sets of different granularities on cooking and household-activity videos and found that coarser-grained concepts are sufficient for classifying these videos, which implies that fine-grained textual descriptions may be unnecessary.
83. 【2610.36831】Right Click, Wrong Box: Grading GUI Grounding by What a Click Does
链接：https://arxiv.org/abs/2610.36831
作者：Xiaokang Yuan,Binhui Yao,Luwei Yang,Ruimin Chen,Zeng Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Leading GUI grounders, Leading GUI, GUI grounders score, GUI grounders, Leading
备注： 14 pages, 7 figures, includes supplementary material
点击查看摘要
Abstract:Leading GUI grounders score 93 to 96% on ScreenSpot-v2, and reported gaps between new and prior models are about a point. At this level the useful question is what the remaining errors are. Benchmarks count a click as correct only inside one annotated box, but interfaces often expose one action through several elements: a duplicated link, the label of a checkbox, the title next to a logo. The box is not wrong. The rule is incomplete. We call a click correct when executing it produces the same outcome as clicking the annotated target. A probe that executes and fingerprints about a thousand clicks per page turns this definition into outcome maps and an execution judge for live web applications, with no new annotation. We execute the predictions of three strong 7--8B grounders on a code forge and an online shop. About one in five and one in three of the clicks that box scoring rejects reach the intended outcome, and the shares remain one in seven and one in three when the instructions are rewritten as natural tasks. A blind audit of 11 models on ScreenSpot-v2 (three 7--8B grounders and eight 3B variants) finds the same effect on web screenshots, with two independent reviewers on a 60-unit subset. The share is highest for the strongest grounders. Training seeds and test-set sampling add noise that more runs and paired intervals control. Box scoring instead under-counts correct clicks, which repetition does not remove, and the audit-based correction of 0.2 to 1.8 points on ScreenSpot-v2 is as large as the gaps the field reports. The correction is needed in evaluation. In our 3B GRPO study, crediting equivalent clicks in the reward gives no stable gain over box rewards across three seeds and four test sets. We release the probe, the outcome maps, the audit and every prediction.
84. 【2610.36823】APESTRY: A Single Backbone for Video Generation and Robot Control
链接：https://arxiv.org/abs/2610.36823
作者：Jeremy A. Collins,Seungjae Lee,Rachanon Wachakorn,Krishnan Srinivasan,Animesh Garg,Vitor Campagnolo Guizilini,Paarth Shah
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：control typically requires, video generation, models encode rich, resource-intensive video generation, Pretrained video generation
备注： Accepted to Conference on Robot Learning (CoRL) 2026
点击查看摘要
Abstract:Pretrained video generation models encode rich priors about physical interactions, but leveraging them for robot control typically requires either resource-intensive video generation at test time or action heads trained from scratch that do not fully utilize the pretrained backbone. We introduce Tokenizing Actions as Video Patches in a Shared Transformer Policy (TAPESTRY), a world action model that repurposes a pretrained video diffusion transformer into a robotic policy without requiring video generation at inference. Our key idea is to treat robot actions as single-patch tokens in the video model's latent space. A lightweight linear projection maps each action timestep to the patch dimensions of the pretrained VAE, and the resulting tokens are processed by the same patchifying layers and transformer backbone used for video. The shared backbone is optimized through three diffusion objectives sampled per minibatch element: Video diffusion uses VAE latents from robot and human videos to establish dynamics priors. Joint video+action diffusion trains on robot demonstrations using a coupled diffusion timestep and an asymmetric attention mask. Action-only diffusion denoises actions conditioned on clean image latents. At test time, the model generates a compact action token sequence in a single DDIM step from pure noise, producing smooth action chunks at 84 ms per action chunk on consumer hardware and avoiding the cost of full video generation. Across simulation benchmarks and real-robot experiments, TAPESTRY achieves strong performance with substantially lower inference cost than comparable joint video--action policies. More information can be found at this https URL.
85. 【2610.36809】Latent Visual Contrastive Reasoning with Multi-Branch Exploration
链接：https://arxiv.org/abs/2610.36809
作者：Kegeng Tang,Jingbo Wang,Yangming Zhang,Huanshu Zhang,Shaogang Ren,Zihao Wang
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Multimodal large language, large language models, made substantial progress, Multimodal large, visual question answering
备注： Accepted at IEEE BigData 2026
点击查看摘要
Abstract:Multimodal large language models have made substantial progress in visual question answering, but complex visual reasoning often requires locating and comparing multiple pieces of question-relevant visual evidence. Existing methods that move intermediate reasoning into the visual latent space usually follow a single linear reasoning trajectory, which can be limiting when multiple visual hypotheses or competing evidence regions are relevant. We propose Latent Visual Contrastive Reasoning, a branch-aware latent reasoning framework that generates multiple question-conditioned latent visual branches as soft hypotheses over image tokens. To train these branches, our method uses bounding-box evidence annotations to build target evidence representations and introduces a soft contrastive branch-evidence alignment objective. This objective encourages evidence-relevant branches to align with annotated visual regions while contrasting them against negative evidence. We instantiate our method on Qwen2.5-VL backbones and train it with standard supervised fine-tuning. Experiments on perception-intensive visual reasoning benchmarks show that the proposed method achieves overall improvements over the corresponding backbone and single-path latent reasoning baselines at both 3B and 7B scales.
86. 【2610.36793】Visual Autoregressive Generation with Next Token Imagination
链接：https://arxiv.org/abs/2610.36793
作者：Ruihang Jiang,Zongyao Zhao,Zhaolin Wang,Yuanwei Liu,Xiatian Zhu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：content is enormous, arguably unbounded, visual, token, visual content
备注： 19 pages, 7 figures. Code and checkpoints: [this https URL](https://github.com/JackRuihang/NTI)
点击查看摘要
Abstract:The space of possible visual content is enormous, and arguably unbounded. Any training set, however large, therefore covers only a tiny fraction of it. Yet generative models are typically trained to fit only the images they are given. In visual autoregressive (AR) generation, for example, each token is predicted from the preceding ground-truth (GT) tokens and supervised solely by the GT next token. Confining learning to observed data in this way limits how much of the visual distribution a model can capture. In this work, we hypothesize that letting a model imagine beyond its training data, by exploring plausible visual realizations it has never observed, can ease this limitation. We use visual AR generation as a proof of concept, since its fixed, discrete token space makes imagination easier to steer and constrain. We propose Next Token Imagination (NTI), a method that allows the model to explore beyond the GT next token, subject to a carefully designed criterion that keeps this imagination bounded by the underlying visual distribution. Extensive experiments on ImageNet show that NTI substantially and consistently improves the fidelity of generated images, approaching state-of-the-art diffusion and AR models while using a smaller model and lower training cost.
87. 【2610.36785】OmniGlimpse: Asymmetric Identity Memory for Online Multi-View Tracking
链接：https://arxiv.org/abs/2610.36785
作者：Rangya Zhang,Jiaping Xiao,Yujing Shang,Yuhang Zhang,Mingsheng Li,Mir Feroskhan
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：tracking extends visual, extends visual coverage, Multi-view tracking extends, providing complementary observations, providing complementary
备注：
点击查看摘要
Abstract:Multi-view tracking extends visual coverage beyond a single camera, providing complementary observations when targets are occluded or leave the view. This raises a question: how can observations from different views be matched to the correct identities without offline scene-specific training or camera calibration? Progress toward this goal remains limited because many offline formulations assume such deployment-specific knowledge, while online adaptation can amplify association errors. We study this problem as online multi-view identity maintenance (OMIM): targets are initialized once per view, with no further identity labels provided after each initialization. To this end, we introduce OmniGlimpse, an asymmetric propose-verify framework that separates adaptive association from stable identity consolidation. At the representation level, short-term local and cross-view evidence is mapped into target-specific adaptive spaces to propose associations, whereas long-term identity distributions are maintained for verification in a canonical space defined by a frozen encoder. At the update level, short-term evidence may guide current associations, whereas, after bootstrapping, only verified observations may update persistent memory or drive adaptation. Under a unified target-specified evaluation protocol, OmniGlimpse improves over the best evaluated online baseline for each metric by 9.1 IDF1 and 22.1 CVIDF1 points on M3Track. The corresponding gains on MvMHAT are 20.3 and 26.2 points. Despite using no offline scene-specific training, it outperforms offline-trained references in IDF1 and remains competitive in cross-view association. These results support an approach to online identity maintenance that adapts to changing appearances while consolidating reliable evidence into stable identity anchors.
88. 【2610.36781】CVBL-CCTV-Face Dataset for Real-World Face Enhancement and Recognition in Surveillance
链接：https://arxiv.org/abs/2610.36781
作者：Manish Das,Ajay Kumar Yadav,Shiv Ram Dubey,Satish Kumar Singh
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：undermine dependable face, closed-circuit television systems, television systems suffer, motion blur, facial captures
备注： 6 pages, conference submission
点击查看摘要
Abstract:In real-world surveillance settings, facial captures from closed-circuit television systems suffer from degradations such as low resolution, motion blur, noise, and occlusions, which undermine dependable face recognition. In this study, we propose a framework for super-resolution and identity recognition, aimed at surveillance applications. For this purpose, we present the CVBL-CCTV-Face Dataset which is a dataset of real-world images taken in an unpaired manner where each pair consists of a low-quality (LQ) image of a face captured by a 8MP IP Dome CCTV camera together with a high-quality (HQ) reference image that is taken in controlled settings. In order to cope with the various problems posed by such datasets, we construct a modular system that involves face detection, deep learning-based super-resolution of low-quality face images, and identity recognition through L2-normalized embeddings extracted by an embedding model. Enhancement models are trained and tested according to three different setups, and the system is deployed for identity verification in a real-time unconstrained environment.
89. 【2610.36765】Evaluation-Guided Demonstration Refinement for Vision-Language-Action Policies: The Winning Entry in the MetaFine Open Competition
链接：https://arxiv.org/abs/2610.36765
作者：Lifan Zheng,Guotao Chen,Zhenyang Li,Shujie Cui,Qiang Huang,Fan Liu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：MetaFine Open Competition, Open Competition, MetaFine Open, task-specific training mixture, fine-tuned a separate
备注： 1st place in the MetaFine Open Competition, RoboFineMani Workshop @ CoRL 2026
点击查看摘要
Abstract:We fine-tuned a separate $\pi_{0.5}$ policy for each of the five tasks in the MetaFine Open Competition, with a task-specific training mixture and number of actions executed per prediction. Training started from the official demonstrations and expert procedures. Local evaluation exposed recurring grasping, pushing, and insertion failures. We addressed them by revising the demonstrated motions and by adding expert continuations from states the policy reached, while keeping nominal demonstrations in training. Checkpoints were compared on every instruction, so that a gain on one instruction could not hide a loss on another. Our submission, MAI, ranked first overall with a score of 96.66.
90. 【2610.36760】GeoGSplat: Geometry-Grounded Non-Pixel-Aligned Gaussian Splatting
链接：https://arxiv.org/abs/2610.36760
作者：Jiale Wang,Chen Zhao,Haoyang Zhang,Yanhao Wu,Fei He,Yanhu Shan,Rui Wu,Wei Ke,Tong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：increased computational cost, Splatting enables efficient, Gaussian Splatting enables, primitive count grow, Feed-forward Gaussian Splatting
备注：
点击查看摘要
Abstract:Feed-forward Gaussian Splatting enables efficient novel view synthesis, but pixel-aligned prediction makes the primitive count grow with image resolution and view count, leading to substantial redundancy and increased computational cost. Non-pixel-aligned methods address this limitation by predicting a fixed number of Gaussians. Without explicit ray and depth constraints, these methods yield misplaced Gaussian centers, causing rendering artifacts under large viewpoint changes. To address this issue, we introduce GeoGSplat, a geometry-grounded feed-forward model that explicitly incorporates geometric priors into the non-pixel-aligned framework. A dual-branch encoder constructs Anchors and Triplane to capture coarse 3D structure and fine-grained scene features, respectively. Subsequently, a hierarchical decoder progressively decodes dense 3D points and Gaussian primitives, enabling 3D reconstruction and novel view synthesis. GeoGSplat surpasses both state-of-the-art pixel-aligned and non-pixel-aligned Gaussian Splatting methods on DTU and NRGBD in terms of novel view synthesis and reconstruction. The advantage of our geometry-grounded paradigm further increases as target viewpoints move farther from the input cameras, demonstrating stronger generalization to large viewpoint changes. Project Page: this https URL
91. 【2610.36759】DocSkill: Skill-Integrated Agentic Reasoning for Multilingual Multi-Hop Document Question Answering
链接：https://arxiv.org/abs/2610.36759
作者：Jing Huang,Zhiya Tan,Changtao Miao,Shutao Gong,Yang Wang,Joey Tianyi Zhou,Jianshu Li,Ying Yan
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：document question answering, question answering, requires locating, complex layouts, locating and integrating
备注： 11 pages, 10 figures, 5 tables. Preprint
点击查看摘要
Abstract:Multilingual multi-hop document question answering (MMHop-DocQA) requires locating and integrating evidence across complex layouts, document pages, and diverse languages. Existing approaches include single-pass processing and adaptive tool use, but learning to coordinate evidence acquisition, cross-page integration, and answer verification remains challenging. To address this challenge, we present DocSkill, an agentic framework with a learned skill-orchestration policy for adaptive evidence acquisition and reasoning. The policy selects, revisits, or skips skills according to the evolving evidence state. To construct supervision for skill orchestration, bounded Monte Carlo Tree Search (MCTS) explores alternative skill trajectories offline. These trajectories provide demonstrations for supervised fine-tuning (SFT) and preference pairs for Direct Preference Optimization (DPO). We further introduce MMHop-DocBench, a multilingual multi-hop document QA dataset with training and test splits, containing 60K QA pairs across 10 languages and eight document domains. Its HopGen pipeline builds hierarchical page-element graphs to derive traceable cross-page evidence paths and generate grounded QA pairs with page- and element-level evidence annotations. Experiments show that DocSkill with Qwen3-VL-8B achieves 41.0 accuracy and 49.2 F1 on MMHop-DocBench, exceeding the strongest evaluated baseline by 5.5 and 6.3 points, respectively, and achieving competitive performance on MMLongBench-Doc and DocBench.
92. 【2610.36756】Efficient Remote Sensing Image-Text Retrieval via Interaction-Free Recall and Text-Guided Reranking
链接：https://arxiv.org/abs/2610.36756
作者：Xi Chen,Xu Chen,Xiamgyang Jia,Wei Wang,Xu Zhang,Zhenyuan Shun
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Remote sensing, image-text retrieval plays, plays a critical, critical role, role in understanding
备注：
点击查看摘要
Abstract:Remote sensing (RS) image-text retrieval plays a critical role in understanding massive RS imagery. However, the dense multi-object distribution and complex backgrounds in RS imagery make it difficult to simultaneously achieve fine-grained cross-modal alignment and efficient retrieval. Existing methods either rely on complex cross-modal interactions that lead to low retrieval efficiency, or depend on large-scale vision-language adaptation, which requires massive data and computational resources. To address these issues, we develop a fast-then-fine (FTF) retrieval framework centered on interaction-free multi-granular recall and parameter-free text-guided cross-modal reranking with the Balanced Text-guided Interaction Block (BTIB). Specifically, interaction-free multi-granular recall pre-computes gallery embeddings and matches them with the corresponding query embedding without full-gallery token-level text-image interaction, while text-guided cross-modal reranking with BTIB refines local semantic correspondence within the top-K candidate set. Furthermore, an inter- and intra-modal loss is designed to jointly optimize cross-modal alignment across multi-granular representations. Extensive experiments on public benchmarks demonstrate that the FTF achieves competitive retrieval accuracy while significantly improving retrieval efficiency compared with existing methods.
93. 【2610.36750】Multi-task Disentangling Fusion Mamba-CNN for MODIS Spectral-Temporal Unmixing with Endmember Variability Modeling
链接：https://arxiv.org/abs/2610.36750
作者：Motasem Alkayid,Yimin Zhu,Naser El-Sheimy,Lincoln Linlin Xu
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：inter-class signature ambiguity, remains challenging due, naively fusing multiple, multiple expert representations, spectral library construction
备注：
点击查看摘要
Abstract:Spectral-temporal unmixing of MODIS time series is essential for applications such as abundance mapping and spectral library construction, yet it remains challenging due to (i) spectral-temporal information coupling in MODIS data, (ii) intra-class endmember spectral variability and inter-class signature ambiguity, and (iii) the instability of naively fusing multiple expert representations. This paper presents the Multi- task Disentangling Fusion Mamba (MDF-Mamba) to address these limitations. To resolve spectral-temporal coupling, we design a disentangling architecture that pairs per-channel spectral experts with a dedicated bidirectional state-space (Mamba) temporal branch. Convolutional modules each process a single spectral channel, while the Mamba branch encodes the cross-channel seasonal trajectory, forming a multi-branch expert ensemble with soft inter-expert reweighting based on squeeze-and-excitation. For the integration of these spectral and temporal expert outputs, we introduce mHCFusion, adapting the manifold-constrained hyper-connection framework to merge the outputs in a stable and interpretable manner. Endmember variability is addressed by extending the linear mixing model with pixel-wise learnable spectral variability weights that capture intra-class endmember variation. Finally, we design a multi-task training objective that combines supervised abundance estimation with self-supervised spectral reconstruction and endmember regularization terms on the same training data, yielding a highly efficient framework for spectral-temporal unmixing. Experiments on MODIS time series covering the Alberta and Saskatchewan provinces show that MDF-Mamba achieves the best performance on 12 of 14 evaluation metrics across both datasets (7 of 7 on Alberta; 5 of 7 on Saskatchewan), ranking second on the remaining two.
94. 【2610.36743】Readout and Operating-Point Sensitivity in Event-Stream Candidate Selection
链接：https://arxiv.org/abs/2610.36743
作者：Yifan Shuai
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：representation comparisons, comparisons can change, change with readout, readout and threshold, Event-triggered recording
备注： 12 pages, 4 figures, including supplementary material
点击查看摘要
Abstract:Event-triggered recording needs a useful combination of target capture and false triggers, yet representation comparisons can change with readout and threshold calibration. We evaluate real event accumulations from 520 DailyDVS-200 clips and 47 participants using participant-disjoint training, validation, and testing. The original study varies frozen encoder scale, accumulation duration, and temporal view count; a post-review extension adds two supervised-pretrained convolutional encoders, a 61,586-parameter trained CNN with three seeds, ten repeated participant partitions, and calibration sensitivity. At 50 ms/eight views under the primary handshake-or-fall policy, DINO-S CLS captures 101/132 targets with 40/388 false triggers, versus 78/132 and 35/388 for patch mean. DINO-B CLS has lower selected-threshold capture but higher fold-wise low-FPR partial AUC (0.746 versus 0.732). MobileNetV3-Small captures 97/132 with 53/388 false triggers, demonstrating why lightweight baselines and actual operating points matter. Across ten dependent repartitions, mean normalized partial AUC is 0.738 for DINO-B CLS and 0.674 for MobileNet. The original LeJEPA S-to-B capture difference is 8.3 points, but its multiplicity-adjusted interval includes zero. Duration and view-count effects remain policy dependent. We find no established JEPA-specific advantage. The evidence concerns offline action-defined candidate selection on previously used development data; it does not establish personal recording value, continuous false alarms per hour, or eyewear energy.
95. 【2610.36729】Hy-Nomas: Towards Free-form Interactive World Generation
链接：https://arxiv.org/abs/2610.36729
作者：Qiaoling Chen,Jiaxiang Cheng,Xueqing Deng,Tiankai Hang,Ji Hou,Jiaqi Li,Yifan Liu,Tao Lu,Junshu Tang,Yu Tang,Yao Teng,Yu Tian,Heng Wang,Weizhi Wang,Xiyao Wang,Xilun Wu,Mingyu Yang,Yangbin Yu,Rui Zhao,Longjun Cao,Linghao Chen,Haoyi Duan,Jiaming Han,Mingji Han,Enhua Jiang,Shunkai Li,Yanzhe Liang,Qinwei Ma,Cong Wang,Lei Wang,Bing Wu,Ke Xing,Ray Ying,Zhentao Yu,Key Zhang,Yuan Zhou,Zhengguang Zhou,Kai Zou
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：follow successive commands, preserving relevant history, follow successive, successive commands, commands while preserving
备注： Technical Report
点击查看摘要
Abstract:Interactive world generation requires models to follow successive commands while preserving relevant history and action consequences. We present Hy-Nomas, a video world model with an 8B diffusion backbone that supports free-form text instructions and continuous camera control across multiple interaction turns. It generates variable-length segments conditioned on current inputs and cached history. Our central design aligns structured video captions with action-aware causal attention: descriptive context remains accessible across segments, while action instructions are restricted to their intended temporal windows. A vision-language Prompt Enhancer (PE) translates user requests and multimodal interaction histories into structured conditions for the next segment. A multi-stage curriculum progressively introduces causal generation, text interaction, camera control, and training on model-generated histories, followed by diffusion distillation. In human evaluation, Hy-Nomas shows superior performance over existing world models. We release model weights, code and benchmarks, together with a lightweight adaptation workflow, to support reproducible research on interactive world generation.
96. 【2610.36722】Progressively Refining SAM for Accurate Phytoplankton Segmentation
链接：https://arxiv.org/abs/2610.36722
作者：Jialin Li,Jinkun Jiang,Yuezun Li,Junyu Dong
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：remains largely underexplored, largely underexplored due, subtle visual characteristics, Accurate phytoplankton segmentation, Accurate phytoplankton
备注： 5 pages, 3 figures
点击查看摘要
Abstract:Accurate phytoplankton segmentation is essential for ecological monitoring, yet it remains largely underexplored due to the subtle visual characteristics of phytoplankton and the scarcity of pixel-level annotations. To address these challenges, we propose PhySeg, a SAM-based segmentation framework equipped with a lightweight refinement module that progressively restores fine-grained details through multi-scale feature fusion. In addition, we construct a phytoplankton segmentation dataset by manually annotating instance-level masks for an existing dataset, providing a valuable resource for future research. Experimental results demonstrate that PhySeg improves segmentation accuracy, validating the effectiveness of the proposed module. Code is available at this https URL.
97. 【2610.36719】SAGE: Saliency-Annealed Gated Encoder for Universal Vision Recognition
链接：https://arxiv.org/abs/2610.36719
作者：Le Yang,Yucheng Huang,Junyu Chen,Qi Dang,Xin Kong,Haifeng Huo,Qiang Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：self-supervised Vision Transformers, adapting self-supervised Vision, Vision Transformers, passive feature extractor, rich priors encoded
备注：
点击查看摘要
Abstract:When adapting self-supervised Vision Transformers (ViTs) to dense prediction, existing methods often treat the ViT as a passive feature extractor and may underuse the rich priors encoded in its representations, including saliency, global context, and high-frequency details. We propose SAGE (Saliency-Annealed Gated Encoder), an enhanced ViT-Adapter backbone that explicitly exploits these priors through three complementary innovations: (1) a saliency-guided architecture that extracts DINO-style class-token (CLS) saliency to guide feature gating and high-frequency enhancement, together with dynamic multi-layer aggregation and a local-detail branch; (2) an annealing-based training paradigm designed to improve convergence and feature quality during early training while reducing feature drift later in training; and (3) a two-stage, quality-aware training mechanism that smoothly transitions from focal loss to Varifocal Loss (VFL) within a single training run. Across the evaluated tasks (Fig.~\ref{fig:fig_com}), SAGE achieves state-of-the-art (SOTA) or competitive results on COCO (62.8 box AP and 55.3 mask AP), COCO keypoint estimation (78.5 AP), ADE20K (60.3 mIoU for semantic segmentation and 44.9 mask AP for instance segmentation), TinyImageNet classification (94.76\% Top-1 accuracy), and DIOR-R oriented object detection (78.8 AP$_{50}$). The same backbone is used across tasks, with task-specific decoders. To the best of our knowledge, SAGE is the first framework to achieve multi-task state-of-the-art results on Huawei Ascend NPUs. Code and pretrained models will be released after internal review.
98. 【2610.36672】Learning Where to Trust: Reliability-Guided Expert Routing and Velocity Gating for 3D Deformable Registration
链接：https://arxiv.org/abs/2610.36672
作者：Chenyu Guo,Wenjie Dai,Yiqian Chang,Zhiyuan Zhang,Yunfan Wei,Shuhan Qi
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：image registration relies, Deformable image registration, relies on accurate, spatial context selection, Deformable image
备注：
点击查看摘要
Abstract:Deformable image registration relies on accurate anatomical correspondences. However, explicitly coupling local matching reliability with spatial context selection and deformation update strength remains insufficiently explored in learning-based registration. This challenge is particularly pronounced in homogeneous, weakly textured, and severely deformed regions, where ambiguous matches may induce erroneous deformation updates. We propose ReliMorph, a reliability-routed symmetric framework for 3D deformable registration that couples correspondence assessment with spatial context selection and update this http URL correlation distributions characterize correspondence ambiguity using shared anatomical features with modality-specific adaptation. These reliability cues guide spatial expert fusion and gate residual velocities during coarse-to-fine refinement. Updated inverse-inconsistency feedback guides routing and gating at finer pyramid levels. To our knowledge, ReliMorph is the first 3D deformable registration framework to jointly condition spatial expert routing and residual velocity gating on correspondence reliability. Extensive experiments demonstrate that ReliMorph consistently outperforms competing methods in anatomical overlap, highlighting its effectiveness across unimodal and multimodal registration tasks.
99. 【2610.36671】Look Only When Needed: Certificate-Guided Visual Routing for Efficient Diffusion VLMs
链接：https://arxiv.org/abs/2610.36671
作者：Donghyeon Cho,Joowon Kim,Seungho Shin,Eunho Yang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)
关键词：Diffusion vision-language models, Diffusion vision-language, image, vision-language models, Visual token pruning
备注：
点击查看摘要
Abstract:Diffusion vision-language models (DVLMs) process their entire input at every denoising step. Since visual tokens make up 89-97% of this input on the benchmarks we study, most of the decoding computation is spent repeatedly processing the same image. Visual token pruning methods partially relieve this burden by removing part of the visual tokens, but they lose the removed information and still process the remaining image at every step. To measure how often the image is actually needed, we compare LLaDA-V's predictions with and without the image at every decoding step and find that removing the image changes a token being unmasked at only 22.8% of steps on average and at as few as 7.9%. We therefore propose LOWN, a decoding method that decides at every step whether to process the image and how many tokens to unmask. LOWN predicts the masked tokens without the image and processes the image only when this prediction disagrees with the last image-conditioned prediction. Agreement certifies the earlier prediction for reuse, and the number of certified tokens sets how many are unmasked in that step. We further observe that the need for the image differs across benchmarks, so LOWN's adaptive decision is needed rather than a fixed schedule. Without training or a tuned threshold, LOWN retains 99.6% of LLaDA-V's score on ten benchmarks at 35.3% of the decoding FLOPs on average. LOWN also generalizes across LLaDA-based DVLMs, composes orthogonally with visual token pruning, and runs under key-value caching for further efficiency gains. Code and project page are available at this https URL
100. 【2610.36665】Haste Makes Waste? Towards Safe Few-Step Text-to-Image Models
链接：https://arxiv.org/abs/2610.36665
作者：Lior Ziv,Mahmood Sharif
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR)
关键词：gained traction due, rates remain unknown, fast generation times, remain unknown, few-step models
备注： Accepted at IEEE SP 2027
点击查看摘要
Abstract:While few-step distilled text-to-image models have gained traction due to their fast generation times, the speed-up implications on their unsafe generation rates remain unknown. We uncover an inherent tension between speed and safety: few-step models are often more unsafe than their teachers, and reducing the number of inference steps consistently raises unsafe generation rates. We further find that acceleration makes unsafe concepts harder to erase in few-step models, with existing concept-erasure methods markedly less effective than in teachers. We offer a mechanistic diagnosis for why erasure methods fail on few-step models, finding that the fragility of few-step models' generation process and the way generation guidance is usually distilled into those models may hinder established concept-erasure methods. To address the speed-safety trade-off, we propose DICE (Distillation-Integrated Concept Erasure), a post-distillation erasure method tailored for few-step models. DICE aligns both its latent construction and its generation-preservation loss with the distillation method that produced the model, keeping erasure faithful to few-step models. DICE demonstrates strong results in our evaluation. For example, on FLUX Schnell, DICE reduces unsafe-generation rate to 0.046 (vs. at least 0.161 for prior erasure methods we test), while mostly preserving benign generation quality.
101. 【2610.36662】SWIM: Learning What Matters from Behaviors for JEPA World Models
链接：https://arxiv.org/abs/2610.36662
作者：Jiaming Hu,Shi Bo,Yan Zheng,Tian Wang,Florian Dubost,Alejandro Mottini,Junze Liu,Arvind Srinivasan,Kai Zhong,Kun Qian,Sharon Gao,Vianne Gao,Houyu Zhang,Qingjun Cui
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：Joint-embedding predictive architectures, Joint-embedding predictive, enable world models, predictive architectures, state
备注： 25 pages, 1 figure
点击查看摘要
Abstract:Joint-embedding predictive architectures (JEPAs) enable world models to plan from images by predicting future embeddings. However, their visual prediction objectives do not explicitly incorporate task-relevant state information, so the physical state that determines task progress may not be reliably captured in the latent space. Supervising world models with simulator state can make planning more informative, but it requires deciding which state features matter. Features are typically selected by hand or weighted uniformly, and a uniform weighting gives every standardized state feature equal influence, so redundant coordinates can overcount the same variation, while irrelevant ones can obscure task-relevant differences. To address this limitation, we propose SWIM (State Weighting with Inverse-Dynamics Model), which learns state weights from offline trajectories by predicting recorded actions from current states and observed future displacements. The learned weights quantify each feature's contribution to action prediction and define a weighted state metric for state-supervised training, which we demonstrate by aligning latent and state distances. The inverse-dynamics model is used only during training, so the resulting world model plans from images with no additional planning-time computation. Across five simulated robotic manipulation tasks, SWIM consistently improves planning success over uniform state weighting.
102. 【2610.36658】SAGE: Semantic-Augmented Geometric Experts for Point Cloud Registration
链接：https://arxiv.org/abs/2610.36658
作者：Tomoyasu Shimada,Kazuhiko Murasaki,Shoichiro Takeda,Shogo Sato,Riku Inoue,Toshihiko Nishimura,Ryuichi Tanida
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：partially overlapping point, overlapping point clouds, scene reconstruction, alignment of partially, partially overlapping
备注： Accepted to WACV 2027 (Round 1)
点击查看摘要
Abstract:Point cloud registration is an essential task for scene reconstruction, requiring the alignment of partially overlapping point clouds. Under low-overlap conditions, this task remains challenging because existing geometry-only methods cannot distinguish geometrically similar but semantically distinct structures (e.g., TV corners vs. desk corners and chair legs vs. table legs), resulting in incorrect correspondences. To address this geometric ambiguity, we present Semantic-Augmented Geometric Experts (SAGE), which integrates frozen pre-trained point cloud semantic representations into the registration pipeline without requiring additional sensors or fine-tuning the semantic encoder. To effectively leverage these semantic distinctions, SAGE employs a Semantic-Guided Mixture of Experts (SG-MoE) architecture. Through semantic-aware routing, SG-MoE enables each expert to specialize in distinct semantic-geometric patterns, reducing mismatches that confound geometry-only methods. With a structure-aware estimator, SAGE achieves the highest registration recall on 3DLoMatch while remaining competitive on 3DMatch. When evaluated with the same number of refinement iterations, SAGE further achieves the highest inlier ratio and registration recall on both benchmarks. These results indicate that frozen semantic representations provide effective cues for resolving geometric ambiguity in low-overlap registration.
103. 【2610.36624】Adapting Video Models for Robot Control via Motion-guided Asymmetric Prediction
链接：https://arxiv.org/abs/2610.36624
作者：Taeyoung Kim,Junyoung Sung,Heeseung Kwon,Minseop Kim,Jinwoo Shin
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：World Action Models, World Action, jointly predicting future, predicting future visual, future visual observations
备注： Project page: [this https URL](https://ismty0805.github.io/mogap/)
点击查看摘要
Abstract:World Action Models (WAMs) leverage pretrained video generative models for robotic control by jointly predicting future visual observations and actions. The visual prediction objective plays a key role in adapting pretrained video representations to the target robot domain. Yet standard visual prediction inherited from video pretraining treats all visual regions uniformly, despite their differing relevance to robotic control. We therefore investigate the spatial allocation of visual supervision in WAMs and show that focusing supervision on dynamic regions can substantially improve policy performance. Building on this finding, we introduce Motion-Guided Asymmetric Prediction (MoGAP), which augments WAM training with motion-focused visual prediction. MoGAP allocates noise asymmetrically across regions, training the model to reconstruct more heavily corrupted dynamic regions using less corrupted static regions as context. MoGAP is trained alongside standard video-action prediction through a training-only auxiliary prediction path within the shared video diffusion backbone. It uses motion cues derived directly from training videos, requiring neither an external teacher nor additional modalities. Across robot manipulation benchmarks and WAM architectures, MoGAP consistently improves policy performance, increasing success rates on the GR-1 tabletop benchmark from 38.8% to 47.5% for Fast-WAM (Wan2.2-5B) and from 52.3% to 62.3% for Cosmos3-Nano.
104. 【2610.36610】4D Reconstruction with Events RGB
链接：https://arxiv.org/abs/2610.36610
作者：Dulanga Weerakoon,Darshana Rathnayake,Van Minh Do,Hemanth Sabbella,Kaichen Zhou,Fangneng Zhan,Alok Prakash,Sanjay E. Sarma,Archan Misra,Paul Pu Liang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：state-of the-art feed-forward, the-art feed-forward methods, feed-forward methods rely, methods rely solely, Reconstructing dynamic
备注： Accepted at NeVi 2026 workshop at the 19th European Conference on Computer Vision (ECCV 2026)
点击查看摘要
Abstract:Reconstructing dynamic 3D scenes over time (4D reconstruction) from a single moving camera is central to robotics and AR/VR applications, yet state-of the-art feed-forward methods rely solely on RGB frames and therefore inherit the failure modes of conventional cameras, including motion blur and temporal aliasing under fast or non-uniform camera and object motion. Event cameras report per-pixel brightness changes asynchronously at microsecond resolution, offering a complementary signal that is largely immune to these artifacts, but whether this modality can be incorporated into existing RGB based 4D reconstruction pipelines without a full architectural redesign remains an open question. In this preliminary study, we investigate a minimal extension: we augment Monst3R, an existing RGB-only 4D reconstruction model, with an additional event-camera input branch, leaving the rest of the architecture unchanged. Across 3 benchmark datasets, this simple RGB-event fusion reduces Abs Rel by 3.4% on average relative to the RGB-only Monst3R baseline, and a sensitivity analysis shows that the improvement grows with the magnitude of camera and object motion, with the largest gains observed under high object motion conditions where RGB-only reconstruction degrades most. These early results suggest that even a lightweight, non-invasive fusion of event data can meaningfully improve 4D reconstruction robustness, motivating a more thorough architectural investigation in future work.
105. 【2610.36599】Camera-to-Quadruped Robot Pose Estimation from Sequential Images
链接：https://arxiv.org/abs/2610.36599
作者：Seobin Hwang,Ji-Seong Beom,Yeong-Jun Cho
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV)
关键词：facility inspection, safe operation, increasingly deployed, deployed in hazardous, hazardous environments
备注： 17 pages, 8 figures, 6 tables
点击查看摘要
Abstract:Quadruped robots are increasingly deployed in hazardous environments such as disaster response and facility inspection, where external-camera monitoring is essential for safe operation. This setting is challenging because quadrupeds are articulated systems with time-varying leg joints, leg symmetry, and frequent self-occlusions, which make keypoint correspondence ambiguous. Moreover, no public benchmark exists, making quantitative comparison difficult. To address these challenges, we propose QuadPose, which estimates the full-body 18-DoF pose (6-DoF base pose + 12-DoF joint angles) from monocular video sequences, and introduce QuadSyn, the first camera-to-quadruped robot pose benchmark. On QuadSyn, QuadPose achieves 92.18% PCK@2.5px, 95.54% PCK-AUC, 85.94% ADD@20cm, 66.98% ADD-AUC, and 3.65 degree mean joint-angle error at approximately 33 FPS.
106. 【2610.36593】WithinVAE: Compact Visual Autoencoding with Self-Distilled Semantics
链接：https://arxiv.org/abs/2610.36593
作者：Yuzhou Ji,Jiepeng Wang,Tianyu Jin,Lizhuang Ma,Haibin Huang,Chi Zhang,Xuelong Li
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：balance reconstruction fidelity, semantic, semantic structure, visual autoencoder, reconstruction fidelity
备注：
点击查看摘要
Abstract:Visual autoencoders must balance reconstruction fidelity, compactness, and semantic structure. Existing semantic tokenizers typically inherit semantics from pretrained recognition encoders, whose invariances can discard the appearance detail required for inversion. We show that this inheritance is unnecessary: semantic structure can be learned inside an autoencoder's own reconstructive representation. We introduce WithinVAE, a compact variational visual autoencoder with a sequential bottleneck, DINO/iBOT-style self-distillation from an exponential-moving-average copy of the autoencoder itself, and position-dependent token masking to achieve a 4-fold compression ratio, which is free of pretrained representation encoder or external semantic target. On ImageNet-1K at $256\times256$, WithinVAE improves all four reported reconstruction metrics over RPiAE including PSNR by 1.36 dB, while using half its latent scalar capacity. Under frozen evaluation, the same latents improve linear probing by 6.5 points over RPiAE and 5.1 points over our reconstruction-only baseline, attributing the semantic gains to self-distillation rather than architecture or external supervision. An auxiliary latent-to-latent model reproduces the ordered-compression trend, and a pixel-to-latent model transfers the objective to a pretrained generative space. These results separate the origin of semantic supervision from its use: a compact visual autoencoder can organize semantic structure without borrowing a recognition representation.
107. 【2610.36592】LabWorld: Learning Interactive 4D Worlds for Scientific Experimentation
链接：https://arxiv.org/abs/2610.36592
作者：Suozhi Huang,Kelsey Fu,Binxu Li,Luna Lyu,Kaize Wu,Wenbo Lu,David Smerkous,Jiahan Li,Siqi Zhu,Zhizhou Sha,Jiacheng Guo,Zhixuan Liang,Shilong Liu,Le Cong,Mengdi Wang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Autonomous scientific agents, Autonomous scientific, reason about experiments, Autonomous, laboratory
备注： 20 pages, 4 figures. Suozhi Huang and Kelsey Fu contributed equally
点击查看摘要
Abstract:Autonomous scientific agents must not only reason about experiments but also interact with the physical environments in which they are executed. Existing laboratory simulators typically rely on manually constructed assets and predefined procedures, while laboratory videos capture real equipment, layouts, and interactions but leave this information implicit in pixels. We introduce LabWorld, an agent-driven Real2Sim framework for reconstructing interactive 4D laboratory worlds from monocular RGB video. LabWorld recovers reusable 3D assets, a metric scene, time-varying object states, and procedure events. Multi-frame observations provide complementary evidence for asset and scene reconstruction, while motion reconstruction combines visual and geometric observations with event constraints encoding the spatial and temporal requirements of laboratory interactions. We evaluate LabWorld on real pipetting and vortexing videos collected in our laboratory against general-purpose agentic and dedicated reconstruction baselines. For pipetting, LabWorld achieves a mean Mask IoU of 0.501, exceeding the strongest baseline by 0.033. For vortexing, it achieves a mean Tube-Length-Normalized PCK-AUC of 0.638, exceeding the strongest baseline by 0.035. On five pipetting videos, event-conditioned reconstruction increases the fraction of modeled physical constraints satisfied from 14.3% (5/35) to 100% (35/35). The resulting worlds expose geometry, motion, articulation, and events as explicit, editable state for replay, inspection, and future embodied scientific systems.
108. 【2610.36569】Decoupling Consistency and Conflict across MLLM Layers for Fake News Detection
链接：https://arxiv.org/abs/2610.36569
作者：Kai Qian,Dongjie Xu,Weijie Shi,Jiaqi Wang,Haolun Ma,Jia Zhu,Jiajie Xu
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Web content faces, trustworthiness of Web, Web content, faces a growing, growing threat
备注： 12 pages
点击查看摘要
Abstract:The trustworthiness of Web content faces a growing threat from multimodal fake news. Real news usually shows aligned image-text semantics, while fake news often contains a few conflicts at varying levels, such as mismatches in objects, scenes, events, and claims. However, existing methods usually treat consistency and conflict in a coarse and static way, limiting their ability to capture sparse conflicts and adapt to varying conflict levels. Inspired by the distinct knowledge encoded across layers in large language models, we propose Multi-Level Consistency and Conflict Decoupling (MLCCD), which captures conflicts at different levels from different layers of multimodal large language models (MLLMs). Specifically, we first use the MLLM's final decision representation to select visual and textual tokens relevant to the task, preventing irrelevant content from diluting sparse conflicts. Then, we preserve tokens whose representations change sharply between adjacent layers, capturing the knowledge each layer adds. Finally, we decouple this knowledge into consistency and conflict evidence and aggregate each across layers with its own router, adapting to varying conflict levels. Experiments on three benchmarks show that MLCCD outperforms existing methods.
109. 【2610.36554】PRISM-BENCH: Diagnosing Grounded and Faithful Multimodal Reasoning Beyond Final-Answer Accuracy
链接：https://arxiv.org/abs/2610.36554
作者：Vansh Bhatia,Mehdi Rezagholizadeh,Parsa Ashrafi Fashi,Igor Gilitschenski,Vikram Appia,Emad Barsoum
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：Final-answer accuracy reports, stated reasoning reflects, reflects that evidence, cost to produce, Final-answer accuracy
备注： Accepted as a poster at the NeurIPS 2026 Workshop on Grounded and Faithful Vision-Language Models for Real-World Deployment (VLM4RWD). 18 pages, 10 figures, 7 tables. Dataset: [this https URL](https://huggingface.co/datasets/vanshbhatia/PRISM-BENCH)
点击查看摘要
Abstract:Final-answer accuracy reports whether a vision-language model was right, but not whether its answer was grounded in the image, whether its stated reasoning reflects that evidence, or what the answer cost to produce. Those are the properties that decide whether a system can be deployed. We present PRISM-BENCH, a benchmark of 1,000 expert-curated questions spanning five under-represented reasoning categories, in which every item carries an idealized reasoning trace written by one human annotator and validated by another. The traces support two diagnostics that accuracy cannot provide. A perception probe, in which the model answers from a description it wrote itself, attributes roughly 85% of frontier-model failures to misperception and places the bottleneck at grounding. Trace alignment predicts answer correctness for all 25 systems tested (macro AUROC 0.66) and survives length control, so it measures reasoning content and not verbosity. We further introduce CORE, an efficiency-aware metric that reorders 24.2% of model pairs relative to accuracy while remaining uncorrelated with response length. Across 25 open and closed systems, including GPT-5 and Claude Opus 4.6, the best accuracy is 66.0%. On the four categories with a human baseline the best system trails humans by 18.4 points, and recent frontier gains fall on recognition and not on spatial grounding.
110. 【2610.36545】FrameForge: Harnessing Priors of Video Foundation Models for Unified Image Generation
链接：https://arxiv.org/abs/2610.36545
作者：Yijing Lin,Zhendong Mao,Mengqi Huang,Yuxin Wang,Yongdong Zhang
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Unified conditional image, Unified conditional, textual guidance, requires a single, input while producing
备注：
点击查看摘要
Abstract:Unified conditional image generation requires a single model to preserve different aspects of a visual input while producing a target image that follows textual guidance. Pretrained video models provide a promising foundation by encoding visual transformations across time, yet existing approaches typically assign the condition and target to fixed temporal positions. We observe that condition-target relationships vary substantially across generation tasks, while video models naturally encode visual transformations at different temporal scales. This motivates us to model conditional generation through input-adaptive virtual temporal relations. We propose FrameForge, which captures two complementary aspects of such relations. Mixture of Temporal Experts (MoTE) models how far the target lies from the condition by dynamically selecting temporal RoPE experts with different virtual intervals. Chain of Temporal Reasoning (CoTR) models how the condition is transformed into the target through a latent intermediate state, with a reasoning-bottleneck attention mask encouraging information propagation through this pathway. Experiments on DreamBench, COCO2017, and GEdit-Bench show that FrameForge achieves superior performance in subject-driven generation, canny-to-image generation, and image editing among the compared methods.
111. 【2610.36540】Frugal Handwritten Text Recognition for Sub-Saharan Civil-Status Registers: A Smartphone-to-Records Pipeline with CPU-Only Inference
链接：https://arxiv.org/abs/2610.36540
作者：Ousmane Hamadou,Jean Louis Kedieng Ebongue Fendji
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Sub-Saharan Africa, Handwritten civil-status registers, rarely transcribed, content unsearchable, leaves their content
备注： Accepted at the GlobalSouthCV Workshop, BMVC 2026. 17 pages, 3 figures
点击查看摘要
Abstract:Handwritten civil-status registers across Sub-Saharan Africa are being photographed, but rarely transcribed, which leaves their content unsearchable. Local administrations that hold these records typically lack GPUs, reliable connectivity, and the budget for external digitization services. We study whether a frugal pipeline, with consumer-grade capture and CPU-only inference, can make such registers machine-readable. We introduce a corpus of 1,568 smartphone images of handwritten birth, marriage, and death records from a municipal registry in Chad, with line-level transcriptions for 185 records. Our pipeline combines a fully classical preprocessing stage, running at about 2.6 images per second on a laptop CPU, with a Kraken recognizer fine-tuned from a pretrained model in about four hours on a free-tier GPU. On manually corrected line segmentation and a single-registry test set whose writers also appear in training, fine-tuning reduces the character error rate from 14.53% to 0.50% and the word error rate from 56.93% to 3.37%. On a six-core laptop CPU, the recognizer weighs 61 MiB, peaks below 2.6 GiB of RAM, and processes an image in under 6 s on average, excluding line segmentation. Finally, a downstream information-extraction task shows that residual recognition errors cost about 9 F1 points on role resolution, compared with a 36.7-point gap between the fine-tuned and pretrained recognizers. These results are evidence of feasibility within one registry, not of performance on unseen writers or sites; we discuss these limitations in detail.
112. 【2610.36533】RoboAuto: Autonomous Robot Program Search through Multi-Level Physical Understanding
链接：https://arxiv.org/abs/2610.36533
作者：Buzhao Liu,Jianing Ye,Xiu Yuan,Yangtong Feng,Chengsong Huang,Tyler Dinh,Yevgeniy Vorobeychik,Ning Zhang,Chongjie Zhang
类目：Robotics (cs.RO); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：shown strong capabilities, LLM-based autonomous agents, refining executable solutions, LLM-based autonomous, iteratively generating
备注： Project page: [this https URL](https://roboauto-ai.github.io/)
点击查看摘要
Abstract:Recently, LLM-based autonomous agents have shown strong capabilities in iteratively generating, evaluating, and refining executable solutions. In robotic manipulation, Code-as-Policy lets these agents search over modular and editable robot programs. However, effective program search requires physical understanding: agents must understand how objects can be manipulated, how scene geometry constrains actions, and why interactions succeed or fail. Existing methods rely mainly on execution feedback for program refinement, often leaving these physical questions unresolved. We introduce RoboAuto, a framework for robot program search that explicitly organizes physical understanding at the object, scene, and interaction levels through three components. First, a hierarchical knowledge base combines executable skills with object-centric knowledge of affordances, spatial relations, and action effects, learned from embodied data and online task solving. Second, scene grounding connects this knowledge to the current environment by identifying relevant objects and resolving action-critical quantities. Third, multi-stage planning with self-designed experiments checks whether each stage produces its expected physical effects and actively tests competing hypotheses to resolve physical uncertainties. RoboAuto achieves superior performance across five benchmark families, attaining an 89.1% success rate on short-horizon LIBERO-PRO tasks and more than twice the mean success rate of ASPIRE on LIBERO-PRO Long and LIBERO-Plus. It also outperforms ASPIRE and $\pi_{0.5}$ on three challenging long-horizon real-robot tasks requiring precise manipulation. We further show that the knowledge base transfers across simulators and embodiments, and that program search performance scales with its size. Project page: this https URL
113. 【2610.36517】PRISM: Pathology Reliability In Scarce-label Medicine. A Tile-level Benchmark of Pathology Foundation Models
链接：https://arxiv.org/abs/2610.36517
作者：Alicem Koyun
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Pathology foundation models, in-distribution test sets, seldom evaluated jointly, low label budgets, Pathology foundation
备注： 30 pages (9 main), 21 figures. Accepted at the Third Workshop on GenAI for Health (GenAI4Health) at NeurIPS 2026
点击查看摘要
Abstract:Pathology foundation models are typically benchmarked on classification performance at full label availability and on in-distribution test sets, while calibration, behavior at low label budgets, and robustness under cross-institutional shift are seldom evaluated jointly. We introduce PRISM, a tile-level benchmark that measures the reliability of pathology foundation models along four axes: model choice, label fraction, calibration, and out-of-distribution transfer. PRISM evaluates eight foundation models (CLIP, PLIP, CONCH, UNI, Virchow2, GigaPath, H-Optimus-0, Midnight) on six tile-level datasets at six label fractions (1% to 100%) with three seeds (864 linear probe runs), extended with a five-hospital Camelyon17 study of 20 directed transfer pairs. Four phenomena emerge. (i) Under full supervision, AUROC rank predicts post-temperature calibration rank consistently across datasets (Spearman rho = 0.52, I^2 = 0%), whereas at 1% labels the relationship becomes dataset-specific (rho = -0.24, I^2 = 67%). (ii) On harder datasets the linear probe collapses to a single predicted class below a dataset-specific label fraction. (iii) Whether additional source-domain labels help or harm target calibration tracks how well the probe transfers: below a transfer AUROC of roughly 0.85, more labels worsen target ECE in 86-88% of combinations. (iv) Temperature scaling fails to reduce ECE in 49 of 288 cells, miscalibration is predominantly under-confidence, and a source-fitted temperature is harmful under failing transfer. PRISM is released as a pip-installable package with reference results for all 288 cells. Code and data: this https URL
114. 【2610.36510】Identity or Evidence? Auditing Evidence Dependence in Agentic Life-Science Benchmarks
链接：https://arxiv.org/abs/2610.36510
作者：Danai Brilli,Maria Georgila
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Agentic life-science benchmarks, Agentic life-science, life-science benchmarks give, recorded outcome, give an agent
备注：
点击查看摘要
Abstract:Agentic life-science benchmarks give an agent evidence about a named entity and score an answer against a recorded outcome. That score tests reasoning over evidence only if the evidence, rather than the name, determines the answer. We examine this distinction by varying identity and evidence independently on a clinical-outcome benchmark and published tasks from Biomni and LAB-Bench. Blinding identity matters little when a prompt contains a decisive sequence or passage. It matters a great deal when the prompt is mostly a name and candidate list (0.742 named versus 0.082 blinded; chance 0.093). Across 96 LAB-Bench LitQA2 questions, the gap increases under one fixed passage-redaction scheme (+0.000 to +0.135; per-instance slope +0.147, p= 0.004). On the clinical benchmark, a no-evidence recall probe matches prediction accuracy and recovers a database-specific programme count. So, we argue that benchmarks intended to measure evidence-dependent reasoning should report identity-blinded results, retrieval telemetry, and positive controls.
115. 【2610.36509】ARISE: Authentic Reference-Informed Stability Enhancement for Continual Multimodal Forgery Detection
链接：https://arxiv.org/abs/2610.36509
作者：Yuchen Zhang,Yaxiong Wang,Yujiao Wu,Lianwei Wu,Qi Zhang,Li Zhu,Chaofeng Dong,Le Wu,Zhedong Zheng
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal forgery detection, encountered after deployment, commonly studied, expected to approximate, approximate those encountered
备注：
点击查看摘要
Abstract:Multimodal forgery detection is commonly studied under a static assumption: training attacks are expected to approximate those encountered after deployment. This assumption becomes increasingly fragile as generators, editing systems, and multimodal large language models continually introduce new forgery mechanisms and forensic evidence. We formulate this problem as attack-incremental continual multimodal forgery detection, where the binary real/fake interface remains fixed while emerging attacks must be learned without forgetting previous ones. We introduce Fable-Bench, which organizes attack evolution through complementary joint-modality, text-side, and image-side protocols. We further propose ARISE (Authentic Reference-Informed Stability Enhancement), motivated by the open-ended forged class and the comparatively reusable geometry of authentic content. ARISE fits a real-only Gaussian mixture model to projected authentic replay representations as a compact historical reference. Meanwhile, the proposed Gaussian-Responsibility-Aware Stability Preservation (GRASP) derives a sample-adaptive anisotropic metric that strongly constrains historically stable representation directions while retaining plasticity elsewhere. Our Vulnerability-Aware Replay (VAR) further estimates stage-wise vulnerability from authentic-density degradation, forged-to-authentic boundary confusion, and authentic-mode occupancy drift, then assigns bounded replay emphasis to fragile stages. All adaptive signals are obtained from training-time replay statistics, while inference uses only the original multimodal backbone and binary classification head. Experiments across three attack-evolution protocols and multiple detector architectures demonstrate improved historical retention and final average performance over representative continual-learning baselines.
116. 【2610.36506】GarmentSegAgent: Autonomous Garment Segmentation for Web Fashion Images via Textual Self-Refinement
链接：https://arxiv.org/abs/2610.36506
作者：Jia Chen,Chao Huang,Xinrong Hu,Mingdi Huang,Ruyang Zhao,Jun Bai
类目：Computer Vision and Pattern Recognition (cs.CV); Multiagent Systems (cs.MA)
关键词：visual product search, visual heterogeneity makes, heterogeneity makes reliable, fashion images support, images support applications
备注： 12 pages
点击查看摘要
Abstract:Web fashion images support applications such as visual product search and consumer-to-shop matching, yet their visual heterogeneity makes reliable garment segmentation challenging. Despite advances in promptable segmentation, autonomously identifying and correcting garment-specific errors without human-provided spatial prompts remains difficult. We propose GarmentSegAgent, an autonomous framework that integrates semantic planning, spatial execution, and visual evaluation through iterative textual self-refinement. At its core, we introduce CAST (Constrained Attribution-guided Selective TextGrad), which connects visual error attribution with targeted textual optimization. CAST identifies instruction components responsible for segmentation errors, selectively updates them through textual gradients, and validates the resulting instructions against garment-specific constraints. This enables image-specific error correction at inference time while keeping the underlying foundation models frozen. Experiments on DeepFashion2, ModaNet, and Fashionpedia demonstrate consistent improvements in region overlap and boundary accuracy, alongside more reliable refinement than conventional TextGrad. By enabling visual feedback to guide controlled instruction updates, GarmentSegAgent offers a promising direction for autonomous garment understanding, with potential applications in scalable fashion content analysis, visual retrieval, and consumer-to-shop matching on the Web.
117. 【2610.36487】Spatial-Frequency Learning for Scanning Transmission Electron Microscopy Image Enhancement
链接：https://arxiv.org/abs/2610.36487
作者：Hesong Li,Ying Fu,Ziqi Wu,Ruiwen Shao,Tao Zhang
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Scanning Transmission Electron, Transmission Electron Microscopy, Scanning Transmission, Electron Microscopy, Transmission Electron
备注： Accepted by IEEE TPAMI
点击查看摘要
Abstract:Scanning Transmission Electron Microscopy (STEM) enables the observation of atomic arrangements at sub-angstrom resolution and plays a key role in the discovery and characterization of advanced materials. Raw STEM images are often noisy and blurred due to multiple degradations. Although recent deep learning methods improve STEM images, their performance remains limited under severe degradations. In this work, we propose a spatial-frequency learning framework for STEM image enhancement. Specifically, we design a spatial-frequency fusion network that exploits periodic atomic arrangements in the frequency domain and restores local atomic details in the spatial domain. Spatial- and frequency-domain features are enhanced separately and then fused. We also present a STEM noise calibration method for synthesizing more realistic STEM images. The parameters of scan noise, pointwise noise, and background noise are estimated through statistical analysis and fitting of real STEM images. Using these calibrated parameters, we construct a diverse dataset containing a wider range of atomic arrangements, imaging modes, and degradations. Random masks combine different atomic arrangements to simulate interfaces between multiple materials. Experimental results demonstrate that our method achieves state-of-the-art enhancement performance on synthetic datasets and real images of advanced materials while improving atomic localization accuracy.
118. 【2610.36467】Confident First, Reflective Second: Reinforcement Learning of Confidence-Preserving Reflection for Video Understanding
链接：https://arxiv.org/abs/2610.36467
作者：Zihao Lin,Jingyuan Liu,Yucheng Zhang,Yuguang Yao,Lifu Huang
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：Video models answer, initial answer, decisive moment, Video models, sampled frames
备注： 18 pages, 8 figures
点击查看摘要
Abstract:Video models answer from sampled frames and may miss the decisive moment. A common remedy is to commit to an answer, re-examine the video, and confirm or revise it, a loop now mainly learned with reinforcement learning (RL). We find that RL erodes the initial answer, a phenomenon we term confidence erosion, where confidence means the label-verified reliability of the initial answer instead of self-reported certainty: because errors can be repaired later, a correct initial answer earns less reward, and the initial answer stalls even as the final answer's gain over it rises. We propose the principle confident first, reflective second: the initial answer must stay reliable on its own, above a floor set by a reference policy, and reflection may only add to it. Our method, CoFire, implements this principle with one mechanism for each erosion channel: reward incentives, parameter drift, and gradient interference. CoFire reaches 67.0% mean accuracy on Video-MME, MLVU, and LongVideoBench, 1.7 points above the strongest compared 7B method, and improves initial-answer and final accuracy over outcome-reward RL by 4.1 and 3.7 points on average: a stronger initial answer carries through to a stronger final one.
119. 【2610.36466】Nemotron-Labs-Diffusion-Uni: Elastic Self-Refining Unified Diffusion LLM with Cross-Paradigm On-Policy Distillation
链接：https://arxiv.org/abs/2610.36466
作者：Shufan Li,Hanrong Ye,Greg Heinrich,Yonggan Fu,Haotian Zhang,Sifei Liu,Aditya Grover,Pavlo Molchanov
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：large language model, discrete diffusion large, diffusion large language, large language, unified discrete diffusion
备注：
点击查看摘要
Abstract:We propose Nemotron-Labs-Diffusion-Uni (NLD-Uni), a unified discrete diffusion large language model (DLLM) for visual understanding and generation tasks. Compared with prior unified diffusion models, NLD-Uni introduces two major innovations. First, we propose a unified cross-paradigm on-policy distillation (OPD) framework that successfully transfers the visual understanding ability of autoregressive VLMs and visual generation ability of continuous flow models, to a unified DLLM. Second, NLD-Uni incorporates a novel progressive self-refining diffusion process that gradually corrupts each token across multiple steps during training, as opposed to adopting the conventional masked diffusion formulation that directly corrupts a clean image token to an uninformative mask token. At inference, this design allows NLD-Uni to make intermediate commit to a token, enabling progressive self-refinement for better visual quality. Through extensive experiments, we show that NLD-Uni achieves state-of-the-art performance among unified DLLMs on diverse tasks including visual question-answering, multi-modal reasoning, object grounding, text-to-image generation, and image editing.
120. 【2610.36462】ClusterSplat: Semantic Cluster Selection for 3D Visual Grounding in Gaussian Splatting
链接：https://arxiv.org/abs/2610.36462
作者：Jaesung Lee,Hyeontaek Hwang,Gabriel Manalu,Daeyoung Kim
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, visual grounding, Splatting, target object, cluster
备注： Accepted at NeurIPS 2026 as a Spotlight paper. Project page: [this https URL](https://jaesung8.github.io/clustersplat/)
点击查看摘要
Abstract:We study 3D visual grounding in 3D Gaussian Splatting (3DGS), where a referring expression should identify a target object as both a rendered 2D mask and a set of explicit 3D Gaussians. Prior methods typically extract 3D targets by applying heuristic thresholding or top-ratio filtering to dense primitive-level relevance scores. However, these scores often vary substantially across scenes and prompts, making such heuristics sensitive and leading to unstable targeting. ClusterSplat addresses this by reframing 3D target selection as cluster-level selection over scene-adaptive candidates. The method first learns instance-aware Gaussian features, forms feature-aware seed voxels, and merges neighboring seed voxels when a description-length criterion decreases, producing a scene-specific set of cluster candidates. Given a referring expression, a query-conditioned cluster scorer ranks the cluster candidates with a lightweight MLP, and the selected cluster directly defines the explicit 3D target while its cluster score is rendered for the 2D mask. On ScanRefer, ClusterSplat achieves the best rendered 2D segmentation and explicit 3D target metrics among the compared 3DGS baselines. It also obtains the best average Ref-LERF scores, supporting the same trend under fine-grained referring descriptions. On ScanNet v2 class name queries, ClusterSplat achieves the strongest rendered 2D results and the highest 3D matching accuracy, while maintaining competitive 3D IoU. Our project page is available at this https URL .
121. 【2610.36460】Full Collapse Is Suboptimal: Controlled Partial Neural Collapse for Long-Tailed Recognition
链接：https://arxiv.org/abs/2610.36460
作者：Hyeontaek Hwang,Cheonghwan Hur,Daeyoung Kim
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Equiangular Tight Frame, fixed Equiangular Tight, Recent long-tailed recognition, Tight Frame, Equiangular Tight
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Recent long-tailed recognition (LTR) methods incorporate neural collapse (NC) and align features to a fixed Equiangular Tight Frame (ETF) as a uniform target for all classes. However, forcing tail classes to fully collapse over-contracts their samples and weakens generalization. To address this, we propose a controlled partial neural collapse, realized through two coordinated controls on a backbone: the Class-Adaptive Sparse Activation (CASA) classifier and the ETF-constrained adaptive margin (ETF-AM) loss. Rather than forcing a uniform full collapse, this regime allows head classes to collapse along the ETF while tail classes retain within-class diversity. This prevents the tail from being forced into full collapse, which is suboptimal under imbalance. To set the dimensionality of collapse, CASA induces class-related node specialization through feature-conditioned gating so that tail classes occupy their own feature directions. For the clearance axis, ETF-AM applies a frequency-adaptive margin, with smaller margins for head classes and larger for tail classes. On CIFAR100-LT, ImageNet-LT, Places-LT, and iNaturalist-2018, our method achieves the best overall accuracy over prior methods. In the empirical analysis, within-class spread increases monotonically from head to tail classes, consistent with tail classes retaining variability rather than fully collapsing.
122. 【2610.36456】LociArt: A Unified Paradigm for Free-Style Local Video Stylization
链接：https://arxiv.org/abs/2610.36456
作者：Yuxuan Chen,Feng Xie,Jiagao Hu,Fuhao Li,Zepeng Wang,Fei Wang,Daiguo Zhou
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Multimedia (cs.MM)
关键词：transforms entire scenes, typically transforms entire, artistic editing requires, editing requires precise, local artistic editing
备注： Project page: [this https URL](https://higherhu.github.io/lociart/)
点击查看摘要
Abstract:Video stylization typically transforms entire scenes, while local artistic editing requires precise region--style association, spatial control, and temporal consistency. We introduce LociArt, a unified paradigm for free-style local video stylization that explicitly specifies where to stylize and what style to apply while preserving non-target content. At its core, GRNStyle builds on Generative Refinement Networks (GRN) and introduces a polar style-aware mask that embeds style identities as equal-norm directions within selected regions. Complementary representation--geometry conditioning combines encoded mask features with raw-mask spatial support, integrating spatiotemporal context with geometric control. To provide paired supervision, we develop an automated pipeline combining global stylization, video object removal, matting, and compositing, and construct the LociArt-100K Dataset with 100K local stylization pairs. We further establish the LociArt Benchmark, comprising 80 source videos and 84 target masks covering 168 foreground/background stylization cases, with a Style Prototype Similarity (SPS) evaluation scheme for regional style quality and complementary measures of non-target preservation and temporal consistency. Experiments show that GRNStyle outperforms existing methods in regional style quality and spatial control while maintaining strong temporal consistency. Qualitative examples further illustrate joint stylization of multiple regions with the same or different learned styles, despite training only on single-region, single-style pairs. Together, these components provide a unified foundation for learning and evaluating controllable local video stylization. Project page: this https URL.
123. 【2610.36449】A Heart Means Recursion: Exploring Visual Meaning and Communication in VLMs
链接：https://arxiv.org/abs/2610.36449
作者：Alexa R. Tartaglini,Zhengxuan Wu,Thaddäus Wiedemer,Martin Wattenberg,Been Kim,Yuxuan Li
类目：Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：communicate visually, ability to communicate, visual, models, communication
备注：
点击查看摘要
Abstract:Do vision-language models (VLMs) share our ability to communicate visually? We share preliminary findings, starting from a surprising observation: simple visual symbols like a red heart can strongly influence model behavior on seemingly unrelated tasks, such as steering models towards recursive solutions on simple coding problems. Notably, this steering effect is largely implicit, as models' direct interpretations and thinking traces about visual symbols diverge substantially from their observed behavior. In visual communication between models, this leads to a generation--interpretation gap: while models tend to send shape primitives that they (and humans) find intuitive, these visual cues often fail to steer other models. In further communication games involving abstract concepts and stories, models can creatively use visuals to transmit meaning to one another, although some communications remain non-intuitive to humans. These findings reveal that VLMs might be capable of rich, creative, and visually-grounded communication, but their interpretation and production of visual meaning diverges from human conventions in surprising ways. Together this work highlights both the promise and challenges of visual communication between humans and VLMs.
124. 【2610.36428】FORESEE-MS: Toward Prospective Spatial Forecasting of Future Multiple Sclerosis Lesions from Baseline FLAIR MRI
链接：https://arxiv.org/abs/2610.36428
作者：Maryam Akhavan Aghdam,Sudip Mittal,Noorbakhsh Amiri Golilarz,Shahram Rahimi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Traditional multiple sclerosis, Traditional multiple, multiple sclerosis, image analysis, AUROC and AUPRC
备注：
点击查看摘要
Abstract:Traditional multiple sclerosis (MS) image analysis has primarily focused on retrospectively detecting and segmenting lesions. This study investigates whether baseline FLAIR MRI can identify regions at risk for future lesion formation beyond population-level spatial patterns. We introduce FORESEE-MS, an evaluation protocol that uses a fold-specific population-prior atlas as a baseline and assesses predictions using pooled voxel-level discrimination (AUROC and AUPRC) and within-patient lesion localization (Recall@Top-K%), with patient-level bootstrap confidence intervals. We evaluated five deep learning models (3D U-Net, Attn+ResBlock+VAE, ViT, and two SwinUNETR variants) using 5-fold cross-validation on 39 subjects from the MSSEG-2 dataset. The atlas achieved the highest pooled voxel-level AUROC and AUPRC, with no deep learning model reliably outperforming it on either metric. However, the 3D U-Net and Attn+ResBlock+VAE achieved higher mean voxel-level within-patient Recall@Top-K% than the atlas at all evaluated thresholds, although most paired confidence intervals for the differences included zero. These findings suggest that baseline FLAIR may contain patient-specific predictive information, but in this small cohort, it remains uncertain whether this information improves lesion forecasting beyond a population-prior atlas.
125. 【2610.36420】SO-101 Bench: Accessible Spatial Manipulation
链接：https://arxiv.org/abs/2610.36420
作者：Truman Hickok
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：performs spatially constrained, common entry point, released policy performs, policy performs spatially, Isaac Lab digital
备注： Project page: [this https URL](https://so101-bench.github.io/) ; code: [this https URL](https://github.com/5hadytru/so101_bench)
点击查看摘要
Abstract:Low-cost arms such as the SO-101 have become the most common entry point to robot learning, yet no released policy performs spatially constrained, language-conditioned tasks on them out of the box, and existing SO-101 benchmarks run only on physical hardware with simple tasks and few held-out objects. We introduce SO-101 Bench, a simulated benchmark for language-conditioned spatial manipulation built on an Isaac Lab digital twin of a real SO-101 setup. It has four tasks scored as five families, 138 objects in seen, unseen-instance and unseen-class splits, 916 evaluation episodes with subsets for held-out appearances, rotate-to-fit planning and occlusion memory, and 3,629 simulated demonstrations on which every learned policy is fine-tuned under an equal compute budget. The twin ranks policies as the real robot does: five policies trained without real data, four VLAs and an LLM agent, keep their exact ranking when the same weights run on the physical arm in an unseen environment with unseen objects (Spearman rho = 1.00, MMRV = 0.000), although simulation overestimates success. Across nine VLAs and world-action models, the best learned policies score near 61%, with spatial placement, unseen object classes and rotate-to-fit planning remaining open. An LLM agent that writes code and hands grasping to a learned policy scores 83.2%, and an ablation shows that this lead comes from the choice of harness and the choice of language model.
126. 【2610.36419】SpeeDiff: Scalable Pixel-Anchored End-to-End Latent Diffusion Model
链接：https://arxiv.org/abs/2610.36419
作者：Bingliang Zhang,Wenda Chu,Yizhuo Li,Linjie Yang,Yisong Yue,Katherine L. Bouman,Yang Song,Qiushan Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：present Scalable Pixel-anchored, Scalable Pixel-anchored, present Scalable, Tweedie Pixel Reconstruction, VAE
备注： Accepted to CVPR 2026. 29 pages, 17 figures, 14 tables
点击查看摘要
Abstract:We present Scalable Pixel-anchored End-to-end Diffusion (SpeeDiff), a latent diffusion method that jointly trains the VAE and the diffusion model from scratch. In principle, joint training allows the diffusion loss gradient to directly guide the VAE encoder, encouraging the formation of a generation-friendly latent space and potentially yielding faster convergence than the conventional two-stage approach with a pretrained frozen VAE. However, a naive end-to-end implementation severely degrades performance, as unrestricted backpropagation of the diffusion loss leads to latent space collapse. Our main technical contribution is a simple yet effective Tweedie Pixel Reconstruction (TPR) loss, which provides additional pixel-level feedback by decoding a predicted clean latent from an intermediate noisy state using Tweedie's formula, thereby alleviating collapse. Furthermore, our method enables jointly scaling a fully transformer-based architecture and enhances representation alignment within the end-to-end framework. Our SpeeDiff-XL model achieves over 140x and 61x faster training compared to Vanilla SiT and REPA, respectively, while attaining an FID of 1.50 without guidance on ImageNet 256x256 generation. With a more efficient 32x compressed VAE, our model further reaches an FID of 1.53 without guidance on ImageNet 512x512 generation.
127. 【2610.36411】ORBITAL: Optimization of Robust Brain--Computer Inference Through Architecture-Aware Low-Precision Compression
链接：https://arxiv.org/abs/2610.36411
作者：Saim Rehman,Muhammad Shafique
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Signal Processing (eess.SP)
关键词：decoders enable embedded, enable embedded brain, proportional hardware savings, Compact electroencephalography, alter adversarial robustness
备注： Submitted to IEEE ISCAS 2027 for Review
点击查看摘要
Abstract:Compact electroencephalography (EEG) decoders enable embedded brain--computer interfaces (BCIs), but compression can alter adversarial robustness without proportional hardware savings. We present ORBITAL, a robustness-constrained framework combining hardware-realizable structured compression, recovery-aware operating-point selection, multi-attack evaluation, and native edge validation. Across nine subjects and three seeds on BCI Competition IV-2a, S25-TRADES achieves the highest observed mean true-union robustness among compressed EEGNet models (23.06% vs 21.27% for standard Full), with 26.27% fewer parameters and 25.10% fewer MACs. Matched controls identify TRADES as the main source of robustness recovery, improving S25 union accuracy by 6.74 percentage points over clean recovery (p=0.0039), while per-example analysis reveals boundary redistribution rather than uniform margin expansion. On Jetson Orin Nano, FP16 compression reduces board energy by up to 16.20% and latency by 8.00%. Despite 99.3% prediction agreement, native INT8 Q/DQ incurs about twice the FP16 latency and energy, demonstrating the need for joint robustness and hardware-aware optimization.
128. 【2610.36384】SOMA: A Benchmark for Fine-Grained Egocentric Behavior and Body-Motion Understanding
链接：https://arxiv.org/abs/2610.36384
作者：Matea Tashkovska,Naël Ouerghemi,Haozhe Qi,Alexander Mathis
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Neurons and Cognition (q-bio.NC)
关键词：Perceiving human body, Large Language Models, Perceiving human, assist people, systems that understand
备注： Code and data at: [this https URL](https://cnai.epfl.ch/soma)
点击查看摘要
Abstract:Perceiving human body motion is critical for multimodal systems that understand and assist people. Yet current evaluations of Multimodal Large Language Models (MLLMs) largely focus on objects, scenes, and coarse actions, leaving their ability to reason about the body itself poorly assessed. This is especially challenging from the egocentric perspective, in which the body is only partially visible and motion must be inferred from occluded and temporally distributed cues. We introduce SOMA, a benchmark for fine-grained body-motion understanding from egocentric video, comprising 1,632 human-verified questions across three capability axes: body configuration, motion dynamics, and temporal reasoning. We evaluate 37 leading closed-source, open-source, and specialized egocentric MLLMs, complemented by an extensive human evaluation. We find that humans also find this task difficult from video alone (68.5% accuracy), yet clearly outperform the strongest MLLM (Qwen3.6-27B), which reaches 50.0% zero-shot accuracy. Our error analysis shows that MLLMs often misread the wearer's own body, misjudge events in time, and are prone to biases such as favoring the right hand or under-counting repetitions. To narrow the gap to human performance and support further progress, we introduce a training dataset of aligned video, body motion, and language supervision, and a multimodal baseline that jointly learns from these modalities. By identifying common failure modes and missing capabilities in current MLLMs, we hope SOMA will inspire future research on body-motion understanding and multimodal reasoning. Full benchmark, training data, and code will be released at: this https URL
129. 【2610.36379】Evaluating Federated Vision-Language and Vision-Only Models for Privacy-Aware Breast Cancer Imaging
链接：https://arxiv.org/abs/2610.36379
作者：Malithi Mithsara Wanniarachchi Kankanamge,Ning Yang,Sree Bash Debnath,Md Zobaer Islam,Abdur R. Shahid
类目：Computer Vision and Pattern Recognition (cs.CV); Cryptography and Security (cs.CR); Machine Learning (cs.LG)
关键词：institutional data fragmentation, hinder centralized training, Artificial intelligence, limited labeled data, institutional data
备注：
点击查看摘要
Abstract:Artificial intelligence (AI) shows promise for breast imaging, but limited labeled data, institutional data fragmentation, and privacy concerns hinder centralized training. We investigate a privacy-aware federated learning framework combining pretrained vision-language models (VLMs) with client-level differential privacy. We compare general-purpose CLIP models, biomedical BiomedCLIP, and an ImageNet-pretrained ViT-B/16 baseline on two public breast imaging datasets, with and without differential privacy. We also evaluate a CLIP ViT-B/16 ablation that removes the text pathway. Evaluation includes patient-level ROC-AUC with bootstrap 95% confidence intervals, baseline comparisons, threshold sensitivity, inter-model agreement, and communication cost. Under federated learning, all five models achieve high normal-versus-sick discrimination (ROC-AUC: 0.940-0.990). However, acquisition year alone achieves 0.974 on the same test partition, raising concerns about confounding rather than genuine pathology recognition. Benign-versus-malignant discrimination remains uncertain (ROC-AUC: 0.504-0.637), with all confidence intervals including 0.50. Removing the text pathway preserves classification accuracy while halving communication cost. Differential privacy reduces ROC-AUC by 0.375, attributable to perturbing the full model state rather than only trainable parameters. These findings highlight the importance of evaluating confounding, predictive reliability, privacy implementation, and deployment efficiency when developing federated AI systems for breast imaging.
130. 【2610.36371】BoxWorld: Let World Engines Control and Video Generators Render
链接：https://arxiv.org/abs/2610.36371
作者：Zike Wu,Ahmed Hatem,Chintan Trivedi,Wallace Michel Pinto Lira,Xuebin Qin,Lele Wang,Renjie Liao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：building real-time interactive, real-time interactive video, user-defined behaviors, tackle the challenge, challenge of building
备注：
点击查看摘要
Abstract:We tackle the challenge of building real-time interactive video worlds with user-defined behaviors. Such worlds must track object states, apply interaction rules, and render the resulting consequences as users act. Yet existing end-to-end video world models typically learn interaction dynamics within the generator, making it difficult to specify object-level rules and reason about their consequences. In this work, we introduce BoxWorld, which separates interaction reasoning from generative rendering. Given user-specified rules, a coding agent creates a Box World Engine that determines interaction outcomes and exposes the resulting object states through a lightweight interface of layout boxes, persistent object attributes, and dynamic status variables, leaving appearance and physical effects to generative rendering. A Box-State Generative Renderer then renders this evolving state stream into video autoregressively, enabling online control over object motion, state switches, and conditional events. Rendering this state stream is non-trivial: the renderer must respond to object-level state updates in real time while remaining coherent with the generated history. To this end, we introduce a three-stage training strategy that learns object grounding from open-domain videos and state transitions from gameplay videos, both annotated automatically, and finally performs rollout distillation on self-generated histories. We further propose PairedStateBench, a paired benchmark for fine-grained interaction control. BoxWorld substantially outperforms end-to-end world models and remains competitive across multiple public benchmarks. Project page: this https URL.
131. 【2610.36340】CrowdCC: Jointly Benchmarking Corruption Robustness and Deployment Quantization in Crowd Counting
链接：https://arxiv.org/abs/2610.36340
作者：S Mahmudul Hasan,Lu Peng
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：satisfy resource constraints, edge devices face, Crowd-counting models deployed, face two shifts, inputs are degraded
备注： Accepted in WACV 2027
点击查看摘要
Abstract:Crowd-counting models deployed on edge devices face two shifts: inputs are degraded along the capture and transmission pipeline, while models are quantized to satisfy resource constraints. Yet corruption robustness and deployment quantization are typically evaluated separately. We introduce CrowdCC, a controlled corruption benchmark that jointly evaluates these effects using 23 deployment-motivated corruptions at three severity levels, four crowd-counting datasets, and 26 models using A100 TensorRT engines at FP32, FP16, and post-training INT8 precision, paired with throughput and energy measurements from corresponding Jetson Orin NX configurations. The corruptions span six families, with head annotations adjusted when geometry or visibility changes. Our evaluation shows that capture-chain corruptions consistently produce the largest degradation across the evaluated models, while crowd density affects absolute and relative error differently. Clean accuracy does not fully predict corrupted performance. INT8 alters corruption robustness substantially more than FP16, with no systematic direction, and does not consistently improve latency or energy. INT8 inference efficiency is strongly associated with reformat overhead in the compiled engine, while slowdowns are also observed under limited INT8 coverage. Precision changes corrupted-error rankings and robustness-cost frontiers, showing why model selection must consider corruption robustness and measured deployment cost together. The code is available at this https URL.
132. 【2610.36337】CRLoMTL: Conflict-Resolution through Low-rank matrices for Multi-Task Learning
链接：https://arxiv.org/abs/2610.36337
作者：Ahmed Agiza,Tasneem Shaffee,Rahil Badkul,Sherief Reda
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Multi-task learning, related vision tasks, improves model efficiency, efficiency by sharing, sharing representations
备注： Accepted at the British Machine Vision Conference (BMVC 2026)
点击查看摘要
Abstract:Multi-task learning (MTL) improves model efficiency by sharing representations across related vision tasks, but it often suffers from negative transfer when task updates interfere with one another. Existing conflict-mitigation methods typically operate in gradient space, requiring explicit task-gradient manipulation and additional optimization steps. We propose Conflict-Resolution through Low-Rank Matrices for Multi-Task Learning (CRLoMTL), a parameter-efficient framework that mitigates task interference in the low-rank parameter-update space. CRLoMTL learns task-specific LoRA updates through task-specific passes, where each task updates its own low-rank matrices, and integrates these updates through global shared-subspace fusion. Specifically, we introduce a shared-subspace resolver based on singular value decomposition (SVD), referred to as the SVD resolver, which extracts a common low-dimensional orthonormal basis across task adapters and projects task updates into this shared space before merging them into a single deployment-time update. The resulting update can be folded into the backbone, preserving the inference structure of the original model without additional runtime branches. Experiments with Swin Transformer backbones on PASCAL-Context, NYUD-v2, and CelebA show that CRLoMTL achieves a favorable accuracy-parameter trade-off, improving over single-task baselines by up to 2.77% on PASCAL-Context, 5.03% on NYUD-v2, and 3.50% on CelebA, while training only a small fraction of the parameters used by single-task models.
133. 【2610.36327】raining-Free Inference Acceleration for Video Large Language Models: Methods, Trade-offs, and Evaluation
链接：https://arxiv.org/abs/2610.36327
作者：Yuqi Li,Chuanyue Yan,Neil Rodrigues,Xianglong Wang,Xiaoqin Feng,Junming Liu,Xi Xiao,Zhongwei Cheng,Wei Li,Lin Chen,Yingli Tian
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Video Large Language, Language Models, demonstrated strong capabilities, sequences incurs substantial
备注：
点击查看摘要
Abstract:Video Large Language Models (VLMs) have demonstrated strong capabilities in video understanding and reasoning, but processing long visual sequences incurs substantial computational, latency, and memory overhead. This survey examines training-free inference acceleration, focusing on reducing inference costs while preserving task-relevant spatiotemporal evidence. We organize existing methods by their intervention stages in the inference pipeline, covering input, visual encoding, projector, prefill, and decoding. Post-training quantization (PTQ) is discussed separately as a cross-stage extension with varying calibration requirements. We analyze how intervention position affects evidence preservation and computational savings, and why local efficiency improvements may not translate into end-to-end acceleration. We complement this analysis with quantitative evidence from prior studies and our own experiments under a shared evaluation setting to assess accuracy-latency trade-offs.
134. 【2610.36269】Cross-modal Steering Vectors Exist Across Both Image and Text Generation
链接：https://arxiv.org/abs/2610.36269
作者：Donghao Zeng(1),Nishant Subramani(2),Tamar Rott Shaham(3),Benno Krojer(1 and 4) ((1) Mila, McGill University, (2) Carnegie Mellon University, (3) MIT CSAIL, (4) Northeastern University)
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL); Machine Learning (cs.LG)
关键词：implemented separately, steering, modality, steering vectors, steer generation
备注： Pre-print. Code: [this https URL](https://github.com/saintsauceee/cross-modal-steering) Data: [this https URL](https://huggingface.co/saintsauce) Demo: [this https URL](https://saintsauceee.github.io/unified-cm-steer-demo)
点击查看摘要
Abstract:Are concepts and mechanisms unified across modalities in current AI models, or instead implemented separately for each one? We operationalize this broad question of modality unification by studying cross-modal steering: 1) finding vectors that successfully steer generation on tokens of one modality, which then 2) transfer zero-shot to steer generation when added to tokens of another modality. Our study goes beyond simple correlational alignment (e.g. representational similarity) because steering is fundamentally causal. We study cross-modal steering in several unified multimodal models (UMMs), since they possess shared parameters for language and image generation, focusing on these two modalities. Across diverse steered concepts such as emotion and object size, we show that steering vectors transfer zero-shot in both directions (text-to-image image-to-text). Even for concepts that are highly unique to one modality (e.g. formal vs. colloquial language), steering vectors often induce a consistent, interpretable effect in the other modality, such as formal clothing and design. This transfer has a geometric signature too: despite a clear modality gap separating text and image representations, steering vectors with strong cross-modal transferability tend to point in similar directions for the same concept. Our findings shed light on how vision and language interact inside unified multimodal models and point towards more general, modality-agnostic approaches for controlling their behavior.
135. 【2610.36249】Hierarchical Multimodal Interaction Reasoning for Dyadic Relationship Recognition
链接：https://arxiv.org/abs/2610.36249
作者：Wang Tang,Fethiye Irmak Dogan,Linbo Qing,Ce Zhu,Hatice Gunes
类目：Computer Vision and Pattern Recognition (cs.CV); Multimedia (cs.MM)
关键词：relationship recognition aims, recognition aims, Dyadic relationship recognition, latent social relationship, relationship
备注：
点击查看摘要
Abstract:Dyadic relationship recognition aims to identify the latent social relationship between two individuals from their multimodal interactions. Existing methods typically project heterogeneous cues into a shared representation and optimise a flat classification objective, overlooking that relationships may rely on different interaction patterns. For instance, distant relationships can often be inferred from direct behavioural correspondence, whereas close relationships are better reflected by coordinated affective, behavioural, and multimodal responses. To address this limitation, we propose HiRe-DRR, a Hierarchical Multimodal Interaction Reasoning framework that organises relationship evidence from three complementary perspectives: feature level, interaction type, and relationship hierarchy. HiRe-DRR decomposes facial, bodily, acoustic, and textual cues into low- and high-level representations and constructs homogeneous and heterogeneous cross-participant interactions. We further introduce the Mixture-of-Interaction Transformer (MoI-Former), which treats diverse interactions as specialised experts and employs relation-aware sparse routing to identify relationship-relevant evidence while preserving contextual interaction information. The proposed Hierarchical Conditional Loss (HC-Loss) exploits the hierarchical nature of social relationships through coarse-to-fine supervision, enabling structured relationship reasoning. Extensive experiments on three dyadic relationship benchmarks demonstrate that HiRe-DRR outperforms recent representative image-, video-, and multimodal methods. Our routing analysis further reveals that distant relationships tend to rely on low-level homogeneous interactions, whereas closer relationships focus on high-level heterogeneous interactions. Our code is publicly available at: this https URL.
136. 【2610.36210】Diagnosing and Correcting Bias in MLLM for Long Video Understanding
链接：https://arxiv.org/abs/2610.36210
作者：Xusheng Liang,Jianqiao Sun,Hao Zhang,Yulei Niu,Hengshuang Zhao,Jiawei Ma
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Large Language Models, Multimodal Large Language, force Multimodal Large, constraints force Multimodal, extremely low rates
备注： 10 pages, 6 figures. Code: [this https URL](https://github.com/Xiaoqiovo/CLEAR)
点击查看摘要
Abstract:Long-video question answering is challenging since the answer often hinges on a few decisive moments scattered throughout the video, while memory constraints force Multimodal Large Language Models (MLLMs) to sample frames at extremely low rates, resulting in sparsity that risks omitting key evidence. Though aggressively enlarging the context size is intuitive, we argue that performance remains fundamentally constrained by the bias, \emph{i.e.}, the misleading cues caused by spurious \textit{linguistic} correlations and salient yet irrelevant \textit{visual} observations. In this paper, we first introduce {S-MME}, a benchmark designed to systematically diagnose shortcut-biased behavior in MLLMs. To mitigate this failure, we further propose a training-free framework, Counterfactual Long-video Evidence-Aware Reasoning (CLEAR). By treating the full video-question pair as a complete view, CLEAR estimates bias effects via augmented views by only keeping the question or locally salient visual clips. Then, we intervene hidden states to mitigate the discrepancy at inference such that the correct answer can be predicted confidently. With experimental studies across five benchmarks, we show that our method is generalizable and can be integrated in different MLLMs, yielding consistent gains in prediction and robustness. We hope CLEAR can offer a complementary direction in test-time scaling for long-video understanding.
137. 【2610.36203】UT-HMR: Uncertainty-Guided Temporal Modeling for Robust 3D Human Mesh Recovery
链接：https://arxiv.org/abs/2610.36203
作者：Zhibo Wang,Sirisha Rambhatla,Yuhao Chen,Maria Koshkina,David Clausi
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：human mesh recovery, weak observations caused, human mesh, mesh recovery, caused by long
备注： Accepted at WACV 2027
点击查看摘要
Abstract:Monocular 3D human mesh recovery (HMR) remains unreliable under weak observations caused by long camera-to-person distances, occlusion, and motion blur. In challenging scenarios such as sports, these factors make the problem highly ambiguous, as different 3D poses may yield similar 2D projections. This ambiguity is especially severe for one-stage HMR, which recovers all meshes directly from the full image without person crops or external 2D cues. To handle this ambiguity, we present UT-HMR ( Uncertainty-guided Temporal HMR), to our knowledge the first one-stage HMR framework to capture correlated pose uncertainty across joints. Each person query predicts a Gaussian distribution over the full SMPL pose with a compact low-rank-plus-diagonal covariance, which is converted into joint-wise precision weights for heteroscedastic supervision while keeping inference deterministic. Temporal early fusion further injects neighboring-frame evidence before pose decoding, supplying the visual evidence needed to resolve the ambiguity that the uncertainty captures. With a lightweight ViT-B backbone, UT-HMR achieves state-of-the-art results on VIP-HockeyPose-v2 (ice hockey) and WorldPose (soccer), reducing MPJPE, PA-MPJPE, and PVE by up to 4.7%, 3.8%, and 5.6%, and remains competitive on 3DPW against methods with larger backbones and higher input resolutions.
138. 【2610.36195】Learning to Read Braille: Benchmarking and Improving Braille Recognition Capabilities of VLMs
链接：https://arxiv.org/abs/2610.36195
作者：Kartik Jangra,Atharva Gawane,Siddharth Pulipaka,Hemachandran Karah,Raj Dabre
类目：Computer Vision and Pattern Recognition (cs.CV); Computation and Language (cs.CL)
关键词：fundamental accessibility task, modern vision-language models, modern vision-language, accessibility task, reading Braille
备注： 22 pages, 8 figures, 16 tables. Code and data: [this https URL](https://github.com/kartik0806/BrailleBench)
点击查看摘要
Abstract:Despite rapid progress in visual understanding and document transcription, modern vision-language models (VLMs) struggle with a fundamental accessibility task: reading Braille from images. We introduce BrailleBench, a manually curated benchmark of 259 real-world Grade-1 and Grade-2 Braille images. We evaluate proprietary, open-weight, OCR-specialized, and tool-assisted multimodal systems and find that standalone general-purpose models perform poorly at directly transcribing Braille images, whereas tool-assisted systems perform much better. We design a synthetic Braille generation pipeline with diverse layouts and image perturbations. A 2B VLM model trained on our synthetic data reaches 87% exact match on Grade-1 and 61% on Grade-2 BrailleBench, outperforming standalone VLMs and achieving the highest Grade-2 exact match score among the evaluated systems. We further show that high accuracy on synthetic validation data does not guarantee high accuracy on real photographs in our experiments: models trained on prior synthetic data reach up to 96% on their synthetic validation set but at most 3.26% on Grade-1 BrailleBench. Our results identify an accessibility-relevant capability gap in multimodal systems and show that targeted synthetic supervision can improve real-world Braille transcription.
139. 【2610.36192】Beyond the Estimate: Wiener-Informed Decoding for Easier Training of Pixel-Space Flow Models
链接：https://arxiv.org/abs/2610.36192
作者：Ziqiao Wang,Yang You
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：Learning velocity fields, velocity fields directly, difficult and slow, fields directly, space is difficult
备注： 23 pages
点击查看摘要
Abstract:Learning velocity fields directly in pixel space is difficult and slow. We show that coarse second-order image statistics can ease this task: frozen Wiener estimates improve velocity learning, with gains extending beyond the linear predictions they explicitly provide. Moreover, we observe similar but complementary gains from frozen bases and pixel decoding. These observations motivate Wiener-informed Decoding (WiD), which uses statistical knowledge both for direct prediction and to organize decoder computation without modifying native blocks. WiD combines a trainable Wiener prediction path with coefficient interfaces that inject features into the native decoder and return its predicted coefficient corrections, with these components initialized with data statistics. All introduced parameters, including the spectrum and coordinate transforms, are trained jointly under the original pixel-space velocity objective. Across model scales and decoder architectures, WiD accelerates training and improves generation quality with modest parameter overhead. It also yields smoother gradient trajectories and remains effective with representation alignment. WiD improves class-conditional and text-to-image generation across different resolutions. On ImageNet 256 x 256, PixelDiT-XL with WiD reaches FID 1.53 after 500 epochs, achieving comparable quality to PixelDiT with 37.5% fewer training epochs. Statistical denoisers contribute beyond the estimate: their computational structure can also ease pixel-space training.
140. 【2610.36190】Bayesian Evidence Accumulation for Graph-Based Learning in Dynamic Data-Driven Applications Systems
链接：https://arxiv.org/abs/2610.36190
作者：Moises Ponce,Sarah Harkins Dayton,Ioannis Schizas,Vasileios Maroulas
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Driven Application Systems, Dynamic Data Driven, Data Driven Application, Graph Neural Networks, Application Systems
备注：
点击查看摘要
Abstract:Graph Neural Networks (GNNs) are widely used in modern machine learning, yet most existing frameworks remain fundamentally static, limiting their applicability in Dynamic Data Driven Application Systems (DDDAS) where observations arrive sequentially under uncertainty. We introduce B-EAGLe (Bayesian Evidence Accumulation for Graph-Based Learning), a probabilistic framework inspired by CBGT-Net (cortico-basal ganglia-thalamic network) that reformulates graph classification as a sequential evidence accumulation process. B-EAGLe combines a GNN encoder with a Bayesian accumulator that incrementally updates posterior beliefs over class labels as new observations arrive, committing to a decision only when sufficient confidence is achieved. Experiments on CIFAR10 demonstrate competitive performance together with principled confidence estimation under sequential observations.
141. 【2610.36168】PrinGS: Privacy Preservation in Gaussian Splatting
链接：https://arxiv.org/abs/2610.36168
作者：Gaurav Behera,Abhinav Raundhal,Archisha Panda,Saumya Balina,Gargi Shroff,Ponnurangam Kumaraguru
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Gaussian Splatting, trained splat, Face Similarity Measure, Face Detection Rate, scene reconstruction
备注： [this https URL](https://privacypreserving3dgs.github.io/)
点击查看摘要
Abstract:3D Gaussian Splatting (3DGS) has rapidly become the preferred representation for high-fidelity novel view synthesis and 3D scene reconstruction. However, the learned representation encodes sensitive visual information including human faces, license plates, documents, and computer screens, raising significant privacy concerns when trained splats are shared or deployed. In this work, we address the underexplored problem of privacy preservation in Gaussian Splatting by proposing a representation-level anonymization framework that directly anonymizes a trained splat. Given a trained splat and a user-provided reference view identifying sensitive content, our method localizes the corresponding regions in the underlying 3D representation and directly anonymizes them, ensuring that the sensitive information is absent from all subsequently rendered novel views while preserving the overall scene geometry and visual fidelity. We achieve this post-training anonymization in less than 1 second. Furthermore, we extend our framework with a privacy-by-design training strategy that prevents sensitive content from being embedded into the representation during optimization, enabling the generation of privacy-preserving splats directly from training images. Our method achieves a remarkably low Face Similarity Measure (FSM) of 9.79% at a retained Face Detection Rate (FDR) of 39.47% and makes sensitive text completely unreadable with an OCR Character Error Rate of 1.00. Our work aims to serve as the primary stepping stone towards privacy-aware 3D representations and motivates further research along these directions.
142. 【2610.36150】Any3R: Feedforward 3D Reconstruction from Any Camera Type
链接：https://arxiv.org/abs/2610.36150
作者：Jingong Chen,Qingwen Zhang,Youming Deng,Chulwoo Pack,Olaf Wysocki,Boris Jutzi,Kwanghee Won,Kyle Gao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Geometry foundation models, expect pinhole images, Geometry foundation, foundation models recover, dense geometry
备注：
点击查看摘要
Abstract:Geometry foundation models recover camera poses and dense geometry from a set of images with a feed-forward network, but they expect pinhole images. That assumption is inside the backbone too: the positional encoding and the training loss both bind an image position to a direction in space, and both depend on the lens. We condition both on the dense ray field, the unit direction through every pixel, which describes any central camera without a lens type, distortion coefficients or a bound on field of view. Angular coordinates give the rotary encoding the measured ray angle of each patch, evaluated per view, and solid-angle weighting scales the point loss by the area each pixel covers on the sphere, so neither the encoding nor the supervision depends on the lens. Any3R is therefore a feed-forward model that takes any central camera, and is robust to mixing many camera types per scene, with no retraining per lens. On a benchmark of thirteen central cameras across three datasets, where every method reconstructs with its own predicted camera poses, it is the most consistently accurate method. Any3R enables scalable 3D reconstruction from heterogeneous crowdsourced and archival imagery collections sourced across diverse camera types. Project page: this https URL
143. 【2610.36079】Closed-Loop Aware Planning via Imitation-Free Speed Scoring for End-to-End Autonomous Driving
链接：https://arxiv.org/abs/2610.36079
作者：Emad Aghajanzadeh,Thomas Schwarzfischer,Marc Kaufeld,Moritz Thoma,Ryan Pégoud,Manoj Rohit Vemparala,Pierpaolo Mori,Nael Fasfous,Johannes Betz,Daniel Mueller-Gritschneder,Ulf Schlichtmann
类目：Robotics (cs.RO); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：open-loop imitation learning, presents two limitations, predominantly relied, relied on open-loop, driving
备注： Accepted to WACV 2027. 17 pages (8-page main paper, references, and supplementary material), 5 figures, 7 tables. Project page: [this https URL](https://clap-ad.github.io) . \c{opyright} 2027 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media
点击查看摘要
Abstract:End-to-end autonomous driving has predominantly relied on open-loop imitation learning for training, which presents two limitations. First, expert demonstrations show only one behavior per scenario, so the model cannot learn alternative valid behaviors and, in turn, cannot adapt to user-specified preferences at test time. Second, noise or ambiguity in these demonstrations can produce inconsistent, unreliable supervision for the end-to-end models. Driving is inherently multi-modal: multiple different behaviors can be valid responses to the same scene, and this diversity arises largely from speed rather than path. We introduce a planning paradigm that learns the path through imitation while scoring a set of candidate speeds across multiple criteria with a learned function supervised by physically grounded safety constraints. We realize this paradigm as Closed-Loop Aware Planning for Autonomous Driving (CLAP-AD), a plug-in planning head that integrates with existing end-to-end driving models and, to our knowledge, is the first to enable explicit test-time control over their speed selection without speed-conditioned training. On Bench2Drive-Speed, CLAP-AD sets a new state of the art Speed-Adherence Score of 82.53, topping TFv6, the strongest baseline on this metric, by 12.9 points while retaining strong closed-loop driving performance. On Bench2Drive, it improves driving score by +28.5 and +32.7 over UniAD and VAD, and on NAVSIM v2, built on real-world driving data, EPDMS by +6.1 over its backbone. Project page: this https URL
144. 【2610.36077】he Trinity:Capability-Driven Recursive Self-Improvement for Multimodal Agents
链接：https://arxiv.org/abs/2610.36077
作者：Weidong Tang,Ruiheng Wang,Jingxuan Zhang,Hexin Wang,Haoyuan Chen,Zhengfeiyang Zhang,Yixing Ma,Zichen Jiang,Ziyu Guo,Haodong Li,Zhengbo Jiao,Zhiqing Cui,Xinxiang Yin,Shuo Liang,Zhenglin Wan,Hongzhan Lin,Wangbo Zhao Kaipeng Zhang,Pengfei Zhou,Odin Zhang,Yang You
类目：Artificial Intelligence (cs.AI); Computer Vision and Pattern Recognition (cs.CV)
关键词：Multimodal intelligence, agents through interaction, viewed as human-guided, human-guided co-evolution, Multimodal
备注：
点击查看摘要
Abstract:Multimodal intelligence can be viewed as human-guided co-evolution between worlds and agents through interaction. However, scaling this process faces two bottlenecks: constructing heterogeneous, verifiable environments is costly, and manual Harness iteration cannot keep pace with growing task diversity and complexity. A key insight is that tasks with different modalities and surface forms can share the same underlying capability requirements. We therefore introduce The Trinity, a recursive self-improvement framework coupling world generation with Harness evolution through three roles: Creator, Explorer, and Evolver. Drawing on verified execution trajectories, Evolver shifts the basis of task organization from surface categories to shared requirements, reorganizing the original task tree into a hierarchical capability tree. We introduce Capability-Driven Real2Sim2Real: for heterogeneous tasks at the same node, Creator abstracts their common requirements into simplified, verifiable simulated worlds for capability learning, while evaluation on original tasks measures transfer. Along this capability tree, Explorer progressively evolves reusable capability modules through selective inheritance, forming a Harness tree whose validated updates accumulate across iterations within a fixed topology. The resulting Harnesses specialize in different capabilities, motivating a Capability-Aware Harness Router that uses public task information to select compatible module configurations from the tree. Our evolved Harnesses improve mean performance by 34 points across 28 training benchmarks and 26 points across 18 unseen benchmarks, including two real-world embodied tasks.
145. 【2610.36022】Learning and Reasoning with Geometry: How Generation Helps Spatial Understanding
链接：https://arxiv.org/abs/2610.36022
作者：Rui Yang,Yanwei Li,Sili Chen,Jingjia Huang,Yi Lin,Hengshuang Zhao
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：produce spatially consistent, Image and video, understanding remains underexplored, consistent visual content, spatially consistent visual
备注： demo: [this https URL](https://yangr116.github.io/geoug-project-page)
点击查看摘要
Abstract:Image and video generators can produce spatially consistent visual content, but how to use this capability to improve spatial understanding remains underexplored. We study this problem from two perspectives: geometric supervision during training and explicit geometric evidence during inference. To this end, we introduce a unified geometric understanding and generation model (GeoUG) that integrates depth and multi-view generation with spatial understanding. First, we design a multi-scale depth codec that enables metric-depth generation using a pretrained visual autoencoder, and show that joint training yields task-dependent gains in spatial understanding. Second, we introduce 3DCueBench to control geometric difficulty while balancing selected 2D cues, and find that generated depth provides larger reasoning gains on questions requiring fine-grained geometric discrimination. Building on this finding, we develop adaptive interleaved reasoning, in which GeoUG first drafts an answer and then decides whether to generate geometric evidence to confirm or revise it. We train this decision through reinforcement learning, balancing accuracy gains over retaining the draft against generation cost. GeoUG achieves circular accuracies of 97.9%, 90.8%, and 94.2% on CV-Bench-3D, 3DCueBench, and DA-2K with fewer generation calls than always generating.
146. 【2610.36013】OmniBrain-0: A Unified Agentic Model for Embodied Intelligence
链接：https://arxiv.org/abs/2610.36013
作者：Xiaomi Embodied Intelligence Team:Yuechen Luo,Chong He,Fang Li,Shaoqing Xu,Jingkai Wang,Menglun Su,Jiaxin Liu,Shengyin Jiang,Zhiyi Lai,Long Chen,Longlong Wang,Liang Hu,Haochen Liu,Yuncheng Jiang,Hongwei Xie,Jieming Cui,Hanbing Li,Junjie Huang,Zhixiang Duan,Hexin Zhang,Weixiang Liang,Ying Gong,Yuhan Wang,Yong Pan,Pengna Li,Kangyi Wu,Ken Deng,Kun Ma,Fuxi Wen,Zhi-xin Yang,Hangjun Ye(University of Macau, Tsinghua University)
类目：Computation and Language (cs.CL); Computer Vision and Pattern Recognition (cs.CV)
关键词：General-purpose embodied intelligence, intelligence requires robots, coordinate diverse skills, embodied intelligence requires, General-purpose embodied
备注： Technical Report; 40 pages, 27 figures, 8 tables; Project Page at [this https URL](https://public-bots.github.io/OmniBrain-0/)
点击查看摘要
Abstract:General-purpose embodied intelligence requires robots to coordinate diverse skills over long horizons, track task progress, and recover from failures. Specialist policies alone do not ensure task-level reliability, while powerful multimodal agents rely on costly reasoning and external experience that compact models struggle to reproduce. We introduce OmniBrain-0, a lightweight unified embodied agent that coordinates manipulation and navigation through a shared high-level decision model, integrating task understanding, planning, progress tracking, and feedback-driven recovery. Our progressive training framework combines embodied pretraining, domain-specialized agent distillation, and multi-teacher on-policy distillation (MOPD). It distills powerful teachers' interaction experience into manipulation and navigation experts, then consolidates their decision capabilities into OmniBrain-0. Unification therefore occurs within the learned decision model rather than only at the tool interface. We further introduce Rubric-Guided Recursive Self-Improvement (RSI), a data flywheel in which a Meta-Agent turns execution evidence into refined rubrics, step-level reminders, and verified trajectories for domain-expert updates before their reconsolidation into OmniBrain-0 through MOPD. We evaluate OmniBrain-0 on LIBERO-Pro, LIBERO-Plus, RoboCasa365, RoboTwin 2.0, and R2R-CE Val-Unseen, as well as multiple real-world manipulation tasks. OmniBrain-0 combines strong cross-domain task performance with substantially lower inference and execution overhead than its closed-source teacher, demonstrating efficient transfer and consolidation of embodied capabilities into a compact unified agent.
147. 【2610.35961】Knowledge distillation across teacher architectures for compact diabetic retinopathy grading
链接：https://arxiv.org/abs/2610.35961
作者：Mossa Manisa,Habiba Jahan Priya,A.K.M. Fakhrul Hossain
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：Diabetic retinopathy grading, retinal fundus photographs, Diabetic retinopathy, five-class diabetic retinopathy, retinopathy grading
备注： 17 pages, 3 figures, 18 tables. Submitted to PLOS ONE
点击查看摘要
Abstract:Diabetic retinopathy grading from retinal fundus photographs is important but difficult to deploy on resource-constrained hardware. We conducted a controlled study of offline response-based knowledge distillation for five-class diabetic retinopathy grading on APTOS 2019, comparing ResNet-50, MobileNetV3-Large, and Swin Transformer-Tiny (Swin-T) teachers distilled into a MobileNetV3-Small student. A 3 x 4 x 2 grid of teacher, temperature, and hard-label weight was screened at one seed, while six configurations and the no-distillation baseline were evaluated across three seeds. The highest observed single-seed quadratic weighted kappa was 0.9093 (macro-F1 0.6851) for Swin-T at temperature 4 and hard-label weight 0.7; the corresponding three-seed mean was 0.9024, compared with 0.8804 for the baseline. The student used 1.52 M parameters and 5.94 MB, representing an 18.07x parameter reduction relative to Swin-T. Temperature and hard-label weight effects were teacher- and configuration-dependent, while small performance differences were sensitive to random seed. Knowledge distillation produced a compact student with competitive performance under the evaluated protocol, but independent external validation remains necessary.
148. 【2610.35960】From Slices to Volumes: Comparing 2D, 2.5D, and 3D Residual Networks for Pulmonary Nodule Malignancy-Risk Classification
链接：https://arxiv.org/abs/2610.35960
作者：Bahodir Nazarov,Zineb Gharib,Fatima Zazoul
类目：Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
关键词：pulmonary nodule malignancy-risk, nodule malignancy-risk classification, residual networks, networks for pulmonary, malignancy-risk classification
备注：
点击查看摘要
Abstract:Purpose: To compare 2D, 2.5D, and 3D residual networks for pulmonary nodule malignancy-risk classification and evaluate momentum-contrast pretraining, mild augmentation, and exclusion of indeterminate ratings. Methods: A retrospectively prepared LIDC-IDRI cohort contained 2,654 nodules labeled benign, indeterminate, or malignant using median radiologist ratings. Patient-disjoint splits comprised 1,876 training, 382 validation, and 396 test nodules. Representations included one axial slice, five neighboring slices, and a local CT volume. Each track evaluated a randomly initialized baseline, momentum-contrast pretraining followed by fine-tuning, and supervised training with mild augmentation. Checkpoints were selected by validation Macro-F1. The 2D experiments used three seeds; 2.5D and 3D results were single-run estimates. A separate binary experiment excluded indeterminate nodules. Results: Augmented models achieved test Macro-F1 values of $0.6134\pm0.0075$ for 2D, $0.6537$ for 2.5D, and $0.5403$ for 3D; the 2D uncertainty denotes population standard deviation across seeds. Corresponding accuracies were $0.6128$, $0.6869$, and $0.5455$. Augmentation improved Macro-F1 within every track, whereas the tested pretraining recipes reduced it. Binary Macro-F1 values were $0.8227$, $0.8664$, and $0.7554$, respectively. Conclusion: Augmented 2.5D achieved the highest observed performance. Differences in preprocessing, optimization, capacity, and replication limit attribution to dimensionality. Labels reflect radiologist-assessed malignancy risk rather than pathology-confirmed cancer. Code and experimental results are available at this https URL.
Subjects:
Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV)
Cite as:
arXiv:2610.35960 [cs.LG]
(or
arXiv:2610.35960v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2610.35960
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history From: Bahodir Nazarov [view email] [v1]
Sun, 25 Oct 2026 10:03:36 UTC (87 KB)
149. 【2610.35910】Physiognomy Revisited: How Vision-Language Models Encode Sensitive Attributes Through Image Transformation
链接：https://arxiv.org/abs/2610.35910
作者：Soumyajit Datta,Arka Dutta,Ashiqur R. KhudaBukhsh
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI); Computation and Language (cs.CL); Computers and Society (cs.CY)
关键词：Emergent generative, generative AI technologies, failure modes, remarkably beneficial, suffer from unforeseen
备注： Accepted at EMNLP 2026 (Main Conference Track)
点击查看摘要
Abstract:Emergent generative AI technologies, while remarkably beneficial across several tasks and domains, can suffer from unforeseen vulnerabilities and difficult-to-anticipate failure modes. Such failure modes can disparately affect vulnerable communities. This paper investigates two well-known vision language models (VLMs) and inspects how these models encode protected identities while generating images. We show that when VLMs are requested to transform human face images to reflect race identities (e.g., Hispanic, Black, White, or Asian) and sexual orientation (e.g., gay or straight), VLMs often comply with such requests. We demonstrate that compliance (and refusal) is non-deterministic, group-sensitive, and generated images are statistically distinguishable, often accentuating deep-seated stereotypes. We further show that representation biases introduced during image generation can re-emerge in textual reasoning and characterization tasks. Finally, we show that this worrisome finding is not limited to racial identity or sexual orientation, image generation can perpetuate bias around criminality, raising concerning possibilities of AI-assisted profiling.
150. 【2610.35905】ask-Utility IQA: Rethinking Image Quality Assessment in Embodied Tasks
链接：https://arxiv.org/abs/2610.35905
作者：Jirong Zha,Yanwei Liao,Yemin Wang,Xiangmin Yi,Siqi Peng,Yingfeng Chen,Chen Gao,Xinlei Chen
类目：Computer Vision and Pattern Recognition (cs.CV); Artificial Intelligence (cs.AI)
关键词：existing methods learn, methods learn task-agnostic, underpins embodied imaging, generic human ratings, embodied imaging pipelines
备注：
点击查看摘要
Abstract:Image quality assessment (IQA) underpins embodied imaging pipelines by judging whether visual quality satisfies downstream tasks, yet most existing methods learn task-agnostic scores aligned with generic human ratings on static benchmarks. This objective mismatches embodied and interactive settings, where image adequacy depends on task goals, context, and action requirements that shape an agent's decisions. We argue that IQA should shift from score regression to goal-conditioned judgment defined by embodied task utility. To this end, we propose an MLLM-based embodied IQA agent framework that reasons about task requirements, grounds quality evidence, and produces decision-facing assessments. A compact VisDrone evidence study shows that conventional perceptual metrics and generic MLLM-based IQA scores are weak proxies for downstream VLM task success, while a task-conditioned utility score better predicts whether visual input supports the target task. These findings support a task-utility-oriented reframing of IQA for embodied, explainable, and decision-aware visual perception.
151. 【2610.35904】ObjectTwin: Measuring the Asset Correspondence Gap for Capture-Anchored Digital Twins
链接：https://arxiv.org/abs/2610.35904
作者：Zhenghe Guo
类目：Computer Vision and Pattern Recognition (cs.CV)
关键词：Object-wise reconstruction increasingly, reconstruction increasingly inserts, Object-wise reconstruction, increasingly inserts generated, inserts generated meshes
备注：
点击查看摘要
Abstract:Object-wise reconstruction increasingly inserts generated meshes into captured scenes as editable proxies for observed objects. This use creates a requirement absent from isolated-asset scores and pose estimates: at the captured metric state, the proxy should reproduce calibrated observations of the same instance. We present ObjectTwin, a scan-grounded measurement protocol that freezes the instance, cameras, scan-projected support and recorded depth, metric anchor, and evaluation denominator, then replaces only the object representation. The resulting asset correspondence gap measures lost observation agreement relative to scan-derived visible geometry without treating the scan as complete physical ground truth. Across two indoor RGB-D capture domains and two generation backends, visible, anchored generated assets lose 0.302-0.497 MaskIoU under this replacement. Every tested scene-level estimate is positive, while same-input generator preference reverses across capture domains. Coverage and overlap-depth analyses locate disagreement in both visible support and surface placement; the evaluated conservative pose refinement does not systematically recover it. These results establish capture correspondence as a separately measurable interface between generated-asset quality and stronger physical or task-level evaluation.
152. 【2610.35871】Real-Time Smart Retail Analytics through Fog Computing using the RetailLightNet Lightweight Model
链接：https://arxiv.org/abs/2610.35871
作者：Mayank Atreya,Navin Chhibber,Shilpa Ajay,R Loshini,K Anitha
类目：Networking and Internet Architecture (cs.NI); Computer Vision and Pattern Recognition (cs.CV)
关键词：real-time video analytics, manage shelf inventory, track customer behavior, enhance in-store processes, Smart retail systems
备注： 2025 5th International Conference on Mobile Networks and Wireless Communications (ICMNWC), Conference Location: Tumkur, India
点击查看摘要
Abstract:Smart retail systems now depend on the application of real-time video analytics, which can track customer behavior, manage shelf inventory, and enhance in-store processes. Currently cloud-based applications of video analytics face multiple challenges such as high latency of the communication itself, privacy concerns surrounding transmitting raw video, and the computational demands of the heavy vision models used on the often limited network infrastructure. These challenges lead to delays in decision making where prompt action is crucial. To address these short comings, this research proposes Fog-based analytics withRetailLightNet (F RLN), an ultra lightweight deep learning model which is specifically suited for the edge, resource constrained hardware capabilities of devices like the NVIDIA Jetson Nano. The approach utilizes publicly available retail datasets, SKU110K, and RPC, which contains an assortment of product, shelf, and customer interaction scenarios for this http URL processes include preprocessing images through normalization and employing motion-gated frame selection to improve efficiency by omitting redundant frames to ease the workload on the fog processing. Internal within Retail LightNet, image feature extraction is realized through depth wise separable convolutions which help support spatial and channel-wise learning without heavy computational costs. The model employs two prediction heads presence classification, and density regression, supporting shelf monitoring and queue assessment. The proposed F RLN framework attained better results in terms of precision (0.988), recall (0.976), and F1-score(0.976) when compared with existing convolutional neural network. Keywords: fog computing, motion-gated frame selection,NVIDIA jetson, retail lightnet, smart retail.
153. 【2610.37213】Retrospective macromolecular pool fraction mapping from conventional clinical MRI: a physics-guided self-supervised deep learning framework
链接：https://arxiv.org/abs/2610.37213
作者：Jelmer van Lune,Miha Fuderer,Oscar van der Heide,Matteo Maspero,Martin B. Schilder,Jan Willem Dankbaar,Stefano Mandija,Alessandro Sbrizzi
类目：Medical Physics (physics.med-ph); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Macromolecular pool fraction, tissue macromolecular content, reconstruction methods limit, macromolecular content, Macromolecular pool
备注： 38 pages, 24 figures
点击查看摘要
Abstract:Macromolecular pool fraction (MPF) is a quantitative imaging biomarker sensitive to myelin integrity and other changes in tissue macromolecular content, but specialized acquisitions and reconstruction methods limit its use in large-scale studies. We present a physics-guided, self-supervised deep learning framework for retrospectively estimating MPF directly from conventional clinical brain MRI ($T_1$-weighted, $T_2$-weighted, and fluid-attenuated inversion recovery [FLAIR]) without paired quantitative reference scans. The framework embeds an analytical two-pool magnetization transfer signal model that related sequence-averaged radiofrequency transmit power to apparent longitudinal relaxation. To accommodate heterogeneous clinical protocols, the network conditions intermediate features on acquisition parameters via adaptive instance normalization. It was trained and evaluated on a multisite, multivendor, multiprotocol dataset of 7,705 MRI sessions (3 T). Across 1,237 test sessions, mean MPF was $0.182 \pm 0.007$ in white matter and $0.144 \pm 0.009$ in gray matter, with limited variation across vendor-by-protocol groups (between-group coefficient of variation: 2.65% and 5.63%, respectively). In 70 sessions with demyelinating-disease labels, MPF was 35.6% lower in segmented lesions than in normal-appearing white matter. MPF maps from two different clinical protocols acquired in a healthy volunteer showed a mean voxel-wise absolute percentage difference of 7.7% and a concordance correlation coefficient of $0.888$, indicating good cross-protocol consistency. These results suggest that magnetization transfer-informed self-supervised learning enables stable MPF mapping from conventional clinical MRI, providing a scalable approach to investigate demyelinating pathology in both existing imaging archives and prospectively acquired conventional clinical scans without dedicated qMT acquisitions.
154. 【2610.37056】Quantized Edge Inference of a Self-Supervised SAR-Optical Encoder on Commodity x86 Hardware
链接：https://arxiv.org/abs/2610.37056
作者：Christian Sanchez-Leon,Dongming Chen
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (cs.LG)
关键词：Self-supervised vision transformers, Earth observation, Self-supervised vision, CPU, rarely characterized
备注： 3 pages, 1 figure, 3 tables
点击查看摘要
Abstract:Self-supervised vision transformers are increasingly used as reusable encoders for Earth observation, but their inference cost on the hardware available in the field is rarely characterized. We deploy a pretrained SAR-optical masked-autoencoder encoder on three commodity x86 nodes, from a low-power CPU without AVX2 to an AVX2+VNNI reference, at FP32, FP16 and INT8 on the CPU and, where present, the integrated GPU, and report latency, energy (RAPL and wall plug) and linear-probe accuracy. Quantization is accuracy-neutral: INT8 changes micro-mAP by only +0.0006, within the seed spread, so precision becomes a pure cost decision. INT8 lowers CPU latency on every node, by 1.45x even on the CPU without AVX2, and CPU energy wherever it is measured, and the VNNI reference (1.53x) suggests a further gain beyond AVX2. The Pareto-optimal device shifts from the integrated GPU, which is 4.38x faster than the CPU on the weakest node, to the CPU as the CPU class improves.
155. 【2610.36646】Image Modeling: From Handcrafted Priors to Foundation Image Models
链接：https://arxiv.org/abs/2610.36646
作者：A. Murat Tekalp
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：explicit probabilistic characterization, data-driven deep foundation, inverse problems, solve inverse problems, Bayesian framework
备注：
点击查看摘要
Abstract:This paper unifies six decades of image modeling, evolving from handcrafted mathematical tractable priors to solve inverse problems in imaging to data-driven deep foundation image models for both image generation and solving inverse problems, under a common Bayesian framework that formulates image modeling as an implicit or explicit probabilistic characterization of a data manifold. Every image restoration or generative task fundamentally seeks to answer the same question: What makes an image look like a real image? In the Bayesian framework, this question is encapsulated by the prior probability density p(x), or its more optimization-friendly counterpart, the log-prior log p(x). While early works in solving inverse problems, such as Tikhonov, Total Variation (TV), and Non-local priors relied on explicit handcrafted definitions of log prior to model local smoothness, modern techniques, such as Plug-and-Play (PnP) priors and Denoising Diffusion models, are rooted in algorithmic uncoupling and implicit manifold learning that apply to both inverse problems and conditional image generation. By grounding imaging inverse problems and conditional image generation under a single mathematical engine: the gradient of the log-prior, or the Stein Score Function, we bridge the gap between signal processing and machine learning communities, turning what seems like parallel developments into a single, evolution of image modeling from handcrafted analytical models to models learned from big data, demonstrating that the pursuit of the denoising score is the common thread connecting variational optimization (in MAP estimation) to posterior sampling (in modern foundation image models).
156. 【2610.36364】When Slides Met Scans: Cross-Attention for Renal Cancer Prognosis
链接：https://arxiv.org/abs/2610.36364
作者：Anusha Krishnamoorthy,Basudha Pal
类目：Image and Video Processing (eess.IV); Computer Vision and Pattern Recognition (cs.CV)
关键词：provide complementary views, Histopathology and computed, computed tomography, provide complementary, renal cancer
备注：
点击查看摘要
Abstract:Histopathology and computed tomography (CT) provide complementary views of renal cancer. We connect these modalities through bidirectional cross-attention between 16 histology prototypes and up to 32 kidney-centered CT tokens from frozen foundation models. In 210 TCGA-KIRC patients with 46 disease-specific survival (DSS) events, 5-fold evaluation yielded a C-index of $0.760\pm0.081$ and 3-year AUROC of 0.773 (95\% CI 0.678--0.860), the highest averages among evaluated unimodal and fusion baselines. External testing in 180 CPTAC-CCRCC patients yielded DSS C-index of 0.629 with CT withheld. Attribution analysis linked predictions to image regions while exposing acquisition artifacts. These findings support further study of cross-scale fusion and independent multimodal validation.
